JP6220276B2 - Imaging apparatus and imaging method - Google Patents

Description

  The present invention relates to an imaging apparatus and an imaging method.

  The panoramic image is generated by the user moving the camera little by little to capture an image, and connecting a plurality of image data obtained thereby. When the user moves the camera excessively fast at the time of imaging, the subject in the captured image data may be shaken so that the image quality may deteriorate. The movement speed of the camera allowed for ensuring the image quality is determined according to the amount of light around the camera. Therefore, there is a technique for performing photometry of the imaging range and setting a moving speed threshold value of the camera according to the amount of light around the camera (see, for example, Patent Document 1).

  With the technique described in Patent Document 1, the moving speed threshold of the camera can be set according to the amount of light around the camera. In other words, a threshold is set that allows the camera to move relatively fast in an environment where there is a large amount of light and the camera shutter speed can be increased, and a camera that is relatively slow in an environment where the light amount is low and the camera shutter speed cannot be increased. It is possible to set a threshold value that only allows the movement of. This allows the camera to be moved as quickly as possible while ensuring the image quality, thereby improving the operability of the user during imaging.

JP 2009-232275 A

  Here, the moving speed of the camera allowed for ensuring the image quality is not always constant during imaging, and varies depending on the timing during imaging. That is, as in the technique described in Patent Document 1, simply setting the camera moving speed threshold value according to the amount of light around the camera cannot set the camera moving speed threshold value appropriately. It cannot be said that the operability has been improved to the maximum extent.

  Specifically, when image data for a panoramic image is captured, it is necessary to connect the image data, so that sufficient image quality is required. On the other hand, the current imaging position is detected from the captured image in order to determine whether or not the imaging position is the imaging position where the image data for the panoramic image should be captured. In the detection of the imaging position, the image quality as high as the image data for the panoramic image is not necessary. Therefore, if the moving speed of the camera is determined in accordance with the image data for panoramic images, the user's operability cannot be improved to the maximum extent.

  The present invention has been made in view of the above circumstances, and an object thereof is to provide an imaging apparatus and an imaging method capable of improving user operability during imaging while ensuring image quality.

  An imaging apparatus according to the present invention is an imaging apparatus that acquires image data for a plurality of panoramic images in order to generate panoramic image data by combining image data for a plurality of panoramic images. Imaging means for acquiring image data by capturing an image cut out by a frame, imaging position specifying means for specifying the position of an imaging frame from which image data for panoramic images should be acquired, and the amount of light input to the imaging apparatus A light amount detecting means for detecting a light amount, a frame position detecting means for detecting the position of an imaging frame based on a plurality of image data acquired by the imaging means, and a panorama image specified by the imaging position specifying means The position of the imaging frame from which image data should be acquired and the position of the imaging frame detected by the frame position detection means Accordingly, the determination unit that determines whether or not the imaging frame is located at or near the position of the imaging frame from which image data for panoramic images is to be acquired, the determination by the determination unit, and the light amount detection unit Reference value setting means for setting a reference value of the moving speed of the imaging frame based on the detected light amount, and control means for performing control based on the reference value set by the reference value setting means.

  An imaging method according to the present invention is an imaging method by an imaging device that acquires image data for a plurality of panoramic images in order to generate panoramic image data by combining a plurality of panoramic image image data. An imaging step for acquiring image data by capturing an image cut out by an imaging frame indicating an imaging region, an imaging position specifying step for specifying a position of an imaging frame from which image data for panoramic images should be acquired, and an imaging device A light amount detection step for detecting a light amount that is the amount of light to be input, a frame position detection step for detecting the position of the imaging frame, and an imaging position specifying step based on the plurality of image data acquired in the imaging step. The position of the imaging frame from which image data for panoramic images should be acquired and the frame position detection A determination step of determining whether or not the imaging frame is located at or near the position of the imaging frame from which image data for panoramic images is to be acquired based on the position of the imaging frame detected in the step; A reference value setting step for setting a reference value for the moving speed of the imaging frame based on the determination in the determination step and the light amount detected in the light amount detection step, and control based on the reference value set in the reference value setting step Control steps.

  According to these inventions, it is determined whether or not the position of the imaging frame is a position where image data for a panoramic image should be acquired. Further, the amount of light input to the imaging device is detected. A reference value for the moving speed of the imaging frame is set based on the determination result regarding the position of the imaging frame and the amount of light, and control based on the reference value is performed. By setting the reference value of the moving speed in consideration of the amount of light, the reference value corresponding to the imaging environment can be set. In addition, since the reference value of the moving speed is set in consideration of the position of the imaging frame, the position of the imaging frame is a position (or the vicinity thereof) where the panoramic image data should be acquired. Different control can be performed depending on whether or not this is the case. Thereby, for example, when acquiring image data for a panoramic image that requires sufficient image quality, control is performed with priority on the image quality, and in other cases, the movement speed is prioritized, and the user's Control capable of improving operability can be performed. As described above, according to the present invention, it is possible to improve user operability during imaging while ensuring image quality.

  Further, the reference value setting unit is configured to use the second reference value as a reference value when the determination unit determines that the imaging frame is located at or near the position of the imaging frame from which image data for panoramic images is to be acquired. In other cases, a first reference value larger than the second reference value may be set as a reference value. Sufficient image quality is required by increasing the reference value when the imaging frame is located at a position other than the reference value when the imaging frame is located at a position where the image data for the panoramic image is to be acquired. When acquiring panoramic image data, control is given priority to the image quality over the moving speed. In other cases where the image quality is not as high as the panoramic image data, the moving speed is higher. Therefore, it is possible to perform control for improving user operability.

  The frame position detection means detects the moving speed of the imaging frame, and the control means determines that the imaging means is positioned at or near the position of the imaging frame from which the image data for panoramic image should be acquired by the determination means. When the moving speed of the imaging frame detected and detected by the frame position detection means is lower than the second reference value set by the reference value setting means, the image data for a plurality of panoramic images is provided to the imaging means. You may control to acquire. By controlling so that the image data for the panoramic image is acquired when the moving speed of the imaging frame is lower than the second reference value set smaller than the first reference value, sufficient image quality is obtained. The image quality of the image data for the panoramic image that is required can be ensured. In addition, it is possible to automatically acquire image data for a panoramic image.

  The control means may perform output based on the reference value. By performing output based on the reference value, it is possible to prompt the user to perform an appropriate operation for each reference value, and the operability for the user is further improved.

  The frame position detection unit may detect the moving speed of the imaging frame, and the control unit may perform output based on the moving speed detected by the frame position detection unit and a reference value. By performing output based on the moving speed and the reference value, for example, an appropriate operation can be urged to a user who moves the imaging frame too fast, and the operability for the user is further improved.

  According to the present invention, it is possible to provide an imaging apparatus and an imaging method capable of improving user operability during imaging while ensuring image quality.

1 is an external view illustrating an external configuration of an imaging apparatus according to an embodiment of the present invention. It is a block diagram which shows the hardware constitutions of the imaging device shown in FIG. It is a block diagram which shows the function structure of the imaging device shown in FIG. It is a figure which shows the relationship between a brightness | luminance and the upper limit of camera operation speed. It is a figure which shows the example of a message displayed on a touchscreen display. It is a flowchart which shows operation | movement of an imaging device.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the description of the drawings, the same elements are denoted by the same reference numerals, and redundant description is omitted.

  FIG. 1 is an external view showing an external configuration of an imaging apparatus according to an embodiment of the present invention. As illustrated in FIG. 1, the imaging device 1 is a mobile terminal configured by a housing 2, for example, and includes a touch panel display 4 and a camera 6 disposed on one surface of the housing 2. When the touch panel display 4 is touched (operated by a finger, a touch pen, or the like) by the user, the imaging apparatus 1 executes an operation of the camera 6 or operations in various applications.

  The camera 6 includes a front-side camera 6a disposed on the front surface 2a that is a surface on which the touch panel display 4 of the housing 2 is disposed, and a back-side camera 6b disposed on the back surface 2b that is a surface facing the front surface 2a. including. The camera 6 has an imaging function of a camera provided in a normal mobile terminal, and can capture an image of a predetermined area to which the camera 6 is directed. A shutter button 12 is displayed in the touch panel display 4. When the imaging device 1 detects that the shutter button 12 is pressed by a user's touch operation, the captured image is acquired as data. Note that the imaging device 1 acquires the captured image as data not only at the timing of detecting the pressing of the shutter button 12 but also at the timing according to the movement of the imaging frame described later.

  The imaging device 1 has a panoramic image imaging mode for synthesizing a plurality of panoramic image data and generating panoramic image data. The imaging device 1 may be included in a panoramic photo generation system that generates a panoramic image (panoramic photo) from a plurality of panoramic image data acquired by the imaging device 1. Note that the same method as the conventional method can be used to generate the panoramic image. The imaging device 1 continuously captures images with the camera 6 in the state set to the panoramic image imaging mode, thereby image data for screen display (screen display data) of an image cut out by the imaging frame indicating the imaging region. Get as. The acquired screen display data is displayed on the touch panel display 4. In addition, when detecting the pressing of the shutter button 12 by the user, the imaging device 1 acquires a plurality of image data for a panoramic image (used as a panoramic image) among images cut out by an imaging frame indicating an imaging region. Hereinafter, one of the plurality of image data for the panoramic image is simply referred to as “first image data 40”, and has a region adjacent to and overlapping with the first image data 40 of the plurality of image data. The image data is simply referred to as “second image data”. The second image data is acquired after the first image data 40 is acquired. By repeatedly acquiring the first image data 40 and the second image data, all of the plurality of image data for the panoramic image are acquired. That is, the second image data becomes the first image data 40 for the next acquired image data.

  When the imaging device 1 acquires the first image data 40, the imaging device 1 displays the first image data 40 and an imaging guide including a frame 46a and an arrow 46b on the touch panel display 4. The imaging guide is a guide display for inviting a user operation when capturing a panoramic photograph. The imaging guide frame 46a guides the position of the imaging frame 42 to the position where the second image data should be cut out in order to acquire a plurality of image data necessary for generating a panoramic image. Various shapes corresponding to the shape of 42 are exhibited. Hereinafter, the configuration of the imaging apparatus 1 in a state where the imaging apparatus 1 is set to the panoramic image imaging mode will be described in detail with reference to FIGS.

  FIG. 2 is a block diagram showing a hardware configuration of the imaging apparatus 1 shown in FIG. As shown in FIG. 2, the imaging apparatus 1 includes a camera 6, a CPU 101 that executes camera control processing, an operating system, an application program, and the like, a main storage unit 102 that includes a ROM and a RAM, a hard disk, a memory, and the like. An auxiliary storage unit 103, an input unit 104 such as a touch panel display 4, and an output unit 105 such as a touch panel display 4. Each function in an imaging unit, an imaging position specifying unit, a light amount detection unit, a frame position detection unit, a determination unit, a reference value setting unit, and a control unit, which will be described later, causes the CPU 101 and the main storage unit 102 to read predetermined software. Executed under control.

  FIG. 3 is a block diagram illustrating a functional configuration of the imaging apparatus illustrated in FIG. 1. As illustrated in FIG. 3, the imaging device 1 functionally includes an imaging unit 20, an imaging position specifying unit 21, a frame position detection unit 22, a determination unit 23, a light amount detection unit 24, a reference value setting unit 25, and control. A portion 26 is provided. Each configuration will be described below.

  The imaging unit 20 is an imaging unit that acquires image data by capturing an image cut out by an imaging frame. The imaging frame indicates an area cut out as image data in the subject area, that is, an imaging area. The imaging frame indicates, for example, a predetermined area centered in the direction in which the camera 6 is directed by a rectangular frame.

  Images captured by the imaging unit 20 are roughly divided into the following two types. That is, first, it is screen display data. Secondly, there are first image data 40 and second image data which are image data for a panoramic image (used as a panoramic image). The screen display data is an image that is also used for detecting the position of the imaging frame by the frame position detection unit 22 and is an image that is necessary for acquiring feature points (details will be described later) of the image. Since the screen display data is not image data for panoramic images, the image quality is not as high as that for image data for panoramic images. On the other hand, the image data for the panoramic image is image data for generating a panoramic image (panoramic photograph) by being combined with the image data for other panoramic images. Since the image data for the panoramic image is an image that is assumed to be viewed by the user as a panoramic photo, a relatively high image quality is required.

  In a state where the panoramic image imaging mode is set and the user's operation is not particularly performed, the imaging unit 20 acquires an image cut out by the imaging frame as screen display data. Further, when detecting that the shutter button 12 is pressed by the user, the imaging unit 20 acquires first image data 40 that is one of the image data for the panoramic image. After acquiring the first image data 40, the imaging unit 20 outputs that the imaging frame has reached the position where the second image data should be acquired by the determination unit 23, and the control unit 26 performs predetermined control. Until then, the image cut out by the imaging frame is acquired as screen display data. The imaging unit 20 continuously acquires screen display data. In addition, after acquiring the first image data 40, the imaging unit 20 outputs that the imaging frame has reached the position where the second image data should be acquired by the determination unit 23, and the control unit 26 performs predetermined control. Is performed, the second image data, which is one of the panoramic image data, is acquired.

  The determination unit 23 outputs that the imaging frame has reached the position where the second image data should be acquired, and after the control unit 26 performs predetermined control, the imaging unit 20 outputs the second image data. The time until acquisition may be within a preset time. Thus, the user operates the shutter button 12 only when the first first image data 40 is acquired, and after the acquisition of the first first image data 40, the user performs the operation by the imaging unit 20 according to the movement of the imaging frame. A plurality of image data necessary for generating a panoramic image can be acquired automatically.

  The imaging unit 20 acquires all of the plurality of panoramic image data by repeating the acquisition of the first image data 40 and the second image data a plurality of times. The screen display data acquired by the imaging unit 20 is output to the frame position detection unit 22. Further, the first image data 40 and the second image data acquired by the imaging unit 20 are output to the imaging position specifying unit 21, the frame position detection unit 22, and the light amount detection unit 24.

  The imaging position specifying unit 21 is an imaging position specifying unit that specifies the position of an imaging frame from which image data for a panoramic image is to be acquired. The imaging position specifying unit 21 acquires second image data which is image data for a panoramic image acquired next to the first image data 40 based on the first image data 40 output from the imaging unit 20. The position of the imaging frame to be specified is specified. Specifically, the imaging position specifying unit 21 specifies the direction and distance to which the imaging frame should move from the position where the first image data 40 is cut out to the position where the second image data is to be cut out. The position of the imaging frame from which the image data is to be acquired is specified. In the following, the distance that the imaging frame should move to the position where the second image data should be cut out may be simply referred to as “distance Z that the imaging frame should move”. The imaging position specifying unit 21 outputs the direction in which the imaging frame should move to the position where the second image data should be cut out and the distance Z to which the imaging frame should move to the determination unit 23.

  For example, the imaging position specifying unit 21 may specify a preset direction as a direction in which the imaging frame should move to a position where the second image data should be cut out. Further, the imaging position specifying unit 21 may specify the direction in which the imaging frame detected by the frame position detection unit 22 described later has moved as the direction in which the imaging frame should move to the position where the second image data should be cut out. Good. That is, after the first image data 40 is acquired, the imaging position specifying unit 21 acquires the movement direction when the imaging frame moves or starts moving from the frame position detection unit 22, and the movement direction is The direction in which the imaging frame should move to the position where the second image data should be cut out may be specified.

  For example, the imaging position specifying unit 21 may specify a preset distance as the distance Z to which the imaging frame should move. Here, the panoramic image is generated by synthesizing each image data with each feature point in a portion where the first image data and the second image data overlap each other as a joint of the image data. An image feature point is a point that becomes a feature such as a border or corner of an image, and is, for example, a location where the color of the image changes greatly, a dark portion, a contour, or the like. When the distance set in advance is increased, when the first image data 40 and the second image data are combined, the overlapping images of the respective images (portions that serve as joints between the image data) are displayed. There may be few feature points and it may be difficult to synthesize image data. For this reason, it is preferable that the distance set in advance is small in consideration of image data with few feature points. Specifically, it is preferable that the area of the region where the imaging frame and the first image data 40 in a state in which the imaging frame has moved the distance Z to be moved overlap is about 75% of the total area of the imaging frame. .

  Further, the imaging position specifying unit 21 may specify the distance Z to which the imaging frame should move according to, for example, the number of feature points included in the first image data 40. As a result, when it is assumed that many feature points are included in the first image data 40 and the synthesis of the image data is easy, the distance Z to which the imaging frame should move is increased, and the first image data 40 includes only a few feature points and it is assumed that it is difficult to synthesize image data, the distance Z to which the imaging frame should move can be reduced, which is necessary for the synthesis of image data. It is possible to realize a wasteful imaging operation while securing the number of feature points of the image. Specifically, when increasing the distance Z to which the moving frame should move, the area of the region where the imaging frame and the first image data 40 in a state where the imaging frame has moved the distance Z to be moved is It is preferably about 25% of the total area of the imaging frame. When the distance Z to which the moving frame should move is reduced, the area of the region where the first image data 40 and the imaging frame in the state where the distance Z to which the imaging frame should move is overlapped is the area of the imaging frame. It is preferably about 75% of the total area.

  The frame position detection unit 22 is a frame position detection unit that detects the position of the imaging frame based on a plurality of image data acquired by the imaging unit 20. Specifically, the frame position detection unit 22 includes the position coordinates of the feature points in the screen display data output from the imaging unit 20 and the position coordinates of the feature points in the first image data 40 output from the imaging unit 20. Based on the change in the position coordinates of the feature points calculated from the above, the direction in which the imaging frame has moved from the position where the first image data 40 was cut out, and the imaging frame from the position where the first image data 40 was cut out The distance moved (hereinafter simply referred to as “distance X the imaging frame has moved”) is specified, and the position of the imaging frame is detected.

  For example, the frame position detection unit 22 creates luminance image data having a luminance component value as a pixel value from the image data, and detects an edge or the like in the luminance image data, whereby the screen display data and the first image are detected. A feature point in the data 40 is detected. Then, the frame position detection unit 22 compares the screen display data with the first image data 40, and cuts out the first image data 40 based on the same feature point change (movement direction and movement amount). The direction in which the imaging frame has moved from the determined position and the distance X to which the imaging frame has moved are specified. The frame position detection unit 22 outputs the direction in which the imaging frame has moved from the position where the first image data 40 has been cut out and the distance X to which the imaging frame has moved to the determination unit 23. Note that if the feature point of the screen display data could not be detected due to the fast moving speed of the imaging frame or the like, the frame position detection unit 22 could not identify the distance X to which the imaging frame moved. To the determination unit 23.

  The frame position detector 22 detects the moving speed of the imaging frame. Specifically, the frame position detection unit 22 includes the position coordinates of the feature points in the image data most recently acquired by the imaging unit 20 and the feature points in the image data acquired immediately before by the imaging unit 20. The distance traveled by the imaging frame calculated from the position coordinates, the time (timing) at which the most recently acquired image was output by the imaging unit 20, and the image acquired immediately before by the imaging unit 20 are The moving speed of the imaging frame is calculated from the time difference of the output time (timing). The frame position detection unit 22 outputs the moving speed of the imaging frame to the control unit 26. If the moving speed of the imaging frame cannot be detected because the feature point could not be detected, the frame position detection unit 22 informs the control unit 26 that the moving speed of the imaging frame could not be detected. Output. The frame position detection unit 22 detects the position of the imaging frame and the detection of the moving speed of the imaging frame in real time at predetermined intervals set in advance.

  Based on the position of the imaging frame from which the panoramic image data specified by the imaging position specifying unit 21 is to be acquired and the position of the imaging frame detected by the frame position detection unit 22, the determination unit 23 Is a determination unit that determines whether or not the image data for the panoramic image is located at the position of the imaging frame to be acquired.

  Specifically, the determination unit 23 determines the direction in which the imaging frame should move to the position where the second image data output by the imaging position specifying unit 21 should be cut out, the distance Z that the imaging frame should move, and the frame The difference between the direction in which the imaging frame has moved from the position where the first image data 40 output by the position detection unit 22 is cut out and the distance X to which the imaging frame has moved reaches a predetermined threshold α stored in advance. Whether or not (below α or less than α) is determined. That is, the determination unit 23 outputs the panoramic image data determined by the direction and distance and output from the imaging position specifying unit 21 and the frame position detection unit 22, and the current imaging frame position. It is determined whether or not the difference between the two has reached the threshold value α. For example, the predetermined threshold value α can be set to a value in units of the number of pixels that is so small that the distance Z to which the imaging frame should move and the distance X to which the imaging frame has moved can be regarded as substantially equal. When the determination unit 23 determines that the predetermined threshold value α has been reached, the imaging frame is located at the position of the imaging frame from which the panoramic image data is to be acquired, that is, the position at which the second image data is to be extracted. It is determined that it is located. The determination unit 23 determines that the predetermined threshold value α has not been reached when the frame position detection unit 22 outputs that the distance X to which the imaging frame has moved cannot be specified. The determination unit 23 performs the determination in real time at a predetermined interval.

  Note that the determination unit 23 outputs when the control unit 26 outputs that the moving speed of the imaging frame is lower than the imaging frame speed threshold S1 (details will be described later) when the screen display data is acquired. As long as the above-described determination is performed. As will be described later, the speed threshold value S1 is a threshold value of the moving speed of the imaging frame when the imaging unit 20 acquires screen display data that is an image used for position detection of the imaging frame. That is, the case where the moving speed of the imaging frame is lower than the speed threshold S1 is a case where the imaging unit 20 can appropriately acquire screen display data used for position detection. Therefore, when the determination unit 23 performs the above-described determination when the speed is lower than the speed threshold S1, the determination by the determination unit 23 can be reliably performed. If the determination unit 23 determines that the imaging frame is located at a position where the second image data is to be extracted, the determination unit 23 outputs the determination result to the reference value setting unit 25. On the other hand, when the determination unit 23 determines that the imaging frame is not located at the position where the second image data is to be extracted, the determination unit 23 outputs the determination result to the control unit 26.

  The light amount detection unit 24 is a light amount detection unit that detects a light amount that is the amount of light input to the imaging apparatus 1. Specifically, the light amount detection unit 24 detects the light amount from the image data input from the imaging unit 20. The light quantity detection unit 24 detects the light quantity from, for example, the luminance value of each pixel in the image data input from the imaging unit 20. For example, the light amount detection unit 24 acquires the luminance value of each pixel in the image data from the Y value of so-called YUV information (acquires luminance Y). YUV information is a format that expresses a color with three pieces of information: a luminance signal (Y), a difference (U) between the luminance signal and the blue component, and a difference (V) between the luminance signal and the red component. For example, the light amount detection unit 24 calculates the average luminance Y of the pixels included in the image data as the light amount. Further, the light amount detection unit 24 may be a photometric sensor that measures the luminance of the imaging range that is input to the imaging device 1 through the lens of the camera 6. The light quantity detection unit 24 may not have only a function as a photometric sensor. For example, the light quantity detection unit 24 may be an imaging element such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (COMS), and may be used as a photometric sensor. It may have the function. The light amount detection unit 24 may be any unit that has a function normally provided by a photometric sensor used in an imaging apparatus. The light amount detection unit 24 outputs the detected light amount to the reference value setting unit 25.

  The light amount detection unit 24 detects the light amount at the timing when the first image data 40 or the second image data (the image data itself or the fact that the image data has been acquired) is output by the imaging unit 20, and the detection result is obtained. The data is output to the reference value setting unit 25. The timing at which the light amount detector 24 detects and outputs the light amount is not limited to the above timing. For example, when the determination unit 23 determines that the imaging frame is located at a position where the second image data should be cut out, the light amount detection unit 24 receives the output of the determination result, and detects and outputs the light amount. It may be what performs. Note that the shutter speed of the camera 6 is set based on the amount of light detected by the light amount detector 24. When the amount of light is large, the shutter speed is set relatively fast, and when the amount of light is small, the shutter speed is set relatively slow. When the shutter speed is set fast, it is possible to pick up images with a clear image quality even when the imaging frame is moved relatively fast compared to when the shutter speed is set slow.

  The reference value setting unit 25 is a reference value setting unit that sets a reference value for the moving speed of the imaging frame. The reference value set by the reference value setting unit 25 includes a speed threshold S2 that is a reference value (second reference value) of the moving speed of the imaging frame when the imaging unit 20 acquires the second image data, and A speed threshold S1 that is a reference value (first reference value) of the moving speed of the imaging frame when the imaging unit 20 acquires screen display data is included. The speed threshold S2 is determined by the determination unit 23 that the imaging frame is located at the position of the imaging frame from which panoramic image data is to be acquired, that is, the second image data is to be extracted. This is a threshold value set in the case of On the other hand, the speed threshold value S1 is a threshold value set in other cases.

  As shown in FIG. 4, the speed threshold value S2 and the speed threshold value S1 that are upper limit values of the operation speed of the camera 6 (upper limit value of the moving speed of the imaging frame) are both the light amounts detected by the light amount detection unit 24 (for example, Is a variable value set according to the luminance Y), and a larger value is set as the luminance Y increases. Under the same luminance Y, the speed threshold value S1 is set to a larger value than the speed threshold value S2. As conventionally known, as the luminance Y increases, the speed threshold S2 and the speed threshold S1 increase exponentially. The reference value setting unit 25 stores in advance a relationship between the speed threshold (speed threshold S2 and speed threshold S1) and the amount of light (for example, information indicating the relationship shown in FIG. 4). Then, the reference value setting unit 25 sets a speed threshold corresponding to the light quantity based on the relationship between the speed threshold value and the light quantity stored in advance.

  The reference value setting unit 25 sets the speed threshold value S <b> 1 based on the light amount detected by the light amount detection unit 24 after the first image data is acquired by the imaging unit 20. The reference value setting unit 25 sets the speed threshold S2 based on the determination by the determination unit 23 and the light amount detected by the light amount detection unit 24. Specifically, the reference value setting unit 25 sets a speed threshold S2 corresponding to the light amount when the determination unit 23 determines that the imaging frame is located at a position where the second image data should be extracted. . The reference value setting unit 25 sets the speed threshold value S1 when the position of the imaging frame is not known at the time of determination by the determination unit 23. Further, the reference value setting unit 25 determines that the imaging frame is positioned at a position where the second image data should be extracted after the determination unit 23 determines that the imaging frame is positioned at the position where the second image data should be extracted. If not, a speed threshold S1 is set. The reference value setting unit 25 outputs the set speed threshold value S2 or the speed threshold value S1 to the control unit 26.

  The control unit 26 is a control unit that performs control based on the reference value set by the reference value setting unit 25. Specifically, the control unit 26 compares the speed threshold S2 or the speed threshold S1 set by the reference value setting unit 25 with the moving speed of the imaging frame output by the frame position detection unit 22 in real time, Control. That is, the control unit 26 determines that the imaging frame is positioned at the position of the imaging frame from which the panoramic image data is to be acquired (positioned at the position where the second image data is to be extracted) by the determination unit 23, and When the moving speed of the imaging frame falls below the speed threshold S2, the imaging unit 20 is controlled to acquire the second image data. The acquisition of the second image data by the imaging unit 20 in this case is automatically performed. The control unit 26 controls the imaging unit 20 to acquire the second image data, and then resets the speed threshold value S2 set by the reference value setting unit 25. On the other hand, when the moving speed of the imaging frame does not fall below (exceeds) the speed threshold value S2, the control unit 26 outputs a predetermined warning (for example, an output such as a screen display) and again, the frame The moving speed of the imaging frame output to the position detector 22 is compared with the speed threshold S2.

  The predetermined warning described above is performed as follows. That is, the control unit 26 displays on the touch panel display 4 the content that recommends reducing the moving speed of the imaging frame. For example, as shown in FIG. 5 (b), the control unit 26 displays on the touch panel display 4 a figure with a message “STOP” and “Please keep the camera firmly at the shooting location because the amount of light is low”. The user tries to slow down the moving speed of the imaging frame. There is a problem that when the moving speed of the imaging frame is increased in the case where the allowable light speed threshold S2 is small and the amount of light is small, the subject flows and is imaged (capturing with relatively high image quality is not possible). By outputting the message, it is possible to solve the problem that the subject flows and is imaged without the user himself / herself determining the speed threshold S2 in any luminance environment.

  Such a predetermined warning is performed so as not to cause a subject to flow and be imaged in any luminance environment and to prevent discontinuity of the joints of panoramic images. A plurality of such predetermined warnings may be set according to the degree of deviation from the moving speed of the imaging frame of the speed threshold S2. Further, the control unit 26 writes the message shown in FIG. 5B when the speed threshold S2 set based on the light amount is smaller than a predetermined value regardless of the moving speed of the imaging frame. The displayed figure may be displayed on the touch panel display 4.

  Note that the control unit 26 may output only the predetermined warning and may not automatically acquire the second image data. In that case, the second image data may be acquired by a user operation after the screen output. Further, the control unit 26 may perform only the automatic acquisition of the second image data and does not output the predetermined warning.

  In addition, when the speed threshold S1 is set by the reference value setting unit 25, the control unit 26 moves the imaging frame to the determination unit 23 when the moving speed of the imaging frame falls below the speed threshold S1. Outputs that the speed is below the speed threshold S1. The determination unit 23 determines whether or not the imaging frame is at a position where the second image data should be acquired after the output. On the other hand, when the moving speed of the imaging frame is not less than (exceeds) the speed threshold value S1, the control unit 26 outputs a predetermined warning. For example, as shown in FIG. 5A, the predetermined warning is to display a graphic with a message “Please move the camera slowly because the amount of light is small” on the touch panel display 4. There is a problem in that the feature points cannot be sufficiently acquired when the moving speed of the imaging frame is increased in a case where the allowable light speed threshold S1 is small with a small amount of light. In this case, there is a possibility that the position of the imaging frame cannot be detected. By performing display that informs the user that the camera needs to be moved slowly, it is possible to capture an image without reducing the number of feature points without the user himself / herself determining the speed threshold S1 in any luminance environment. Further, the control unit 26 writes the message shown in FIG. 5A when the speed threshold S1 set based on the light amount is smaller than a predetermined value regardless of the moving speed of the imaging frame. The displayed figure may be displayed on the touch panel display 4.

  After outputting the predetermined warning, the control unit 26 again compares the moving speed of the imaging frame output to the frame position detection unit 22 with the speed threshold S1. When the determination unit 23 determines that the imaging frame is not at the position where the second image data should be acquired, the control unit 26 again moves the imaging frame output to the frame position detection unit 22. The speed is compared with the speed threshold S1. Note that when the frame position detection unit 22 outputs that the moving speed cannot be detected, the control unit 26 determines that the speed threshold value S1 or the speed threshold value S2 is not below (exceeds).

  Further, the control unit 26 displays a figure indicating the imaging guide on the touch panel display 4 to guide the movement of the imaging frame from the position where the first image data 40 is extracted to the position where the second image data is to be extracted. You may do. In this case, for example, the control unit 26, the first image data 40 output by the imaging unit 20, the distance Z to which the imaging frame output by the imaging position specifying unit 21 should move, and the frame position detection unit The touch panel display 4 displays a graphic indicating an imaging guide indicating a moving direction, a moving distance, and the like of the imaging frame from the distance X to which the imaging frame output by 22 moves to the position where the second image data should be cut out. .

  Next, an imaging method using the imaging apparatus 1 will be described with reference to FIG.

  As illustrated in FIG. 6, in the imaging apparatus 1, for example, when an application that performs imaging is started by the user, the panoramic image imaging mode is set, and the shutter button 12 is pressed, the imaging unit 20 extracts the image by the imaging frame. First image data 40 to be acquired is acquired (S11: imaging step). Subsequently, image data for screen display is acquired by the imaging unit 20 in real time. Subsequently, the imaging position specifying unit 21 specifies the distance Z to which the imaging frame should move based on the first image data 40 output by the imaging unit 20, and the position of the imaging frame from which the second image data should be acquired. Is specified (S12: imaging position specifying step).

  Subsequently, the light amount detection unit 24 detects a light amount that is the amount of light input to the imaging device 1 (S13: light amount detection step). Note that step S13 may be performed before step S12. Subsequently, the speed threshold value S1 is set by the reference value setting unit 25 based on the light amount output from the light amount detection unit 24 (S14: reference value setting step). Subsequently, based on the first image data 40 and the screen display data acquired in real time, the direction and distance X in which the imaging frame has moved is specified by the frame position detection unit 22. Then, the position of the imaging frame is detected from the moving direction of the imaging frame and the distance X, and the moving speed of the imaging frame is detected (S15: frame position detection step).

  Subsequently, the control unit 26 determines whether the moving speed of the imaging frame exceeds the speed threshold S1 (S16). When it is determined in S16 that the moving speed of the imaging frame exceeds the speed threshold S1 (S16: NO), a predetermined warning is displayed on the touch panel display 4 by the control unit 26 (S17: control step). . Thereafter, the control unit 26 performs the process of S15 again.

  On the other hand, when it is determined in S16 that the moving speed of the imaging frame does not exceed the speed threshold S1 (S16: YES), the determination unit 23 positions the imaging frame at a position where the second image data is to be acquired. It is determined whether or not (S18: determination step). If it is determined in S18 that the second image data is not to be acquired (S18: NO), the process of S15 is performed again.

  On the other hand, if it is determined in S18 that the second image data is to be acquired (S18: YES), the reference value setting unit 25 uses the speed threshold S2 based on the light amount output from the light amount detection unit 24. Is set (S19: reference value setting step). Subsequently, the moving speed of the imaging frame is detected by the frame position detection unit 22 (S20). Subsequently, the control unit 26 determines whether the moving speed of the imaging frame exceeds the speed threshold S2 (S21).

  When it is determined in S21 that the moving speed of the imaging frame exceeds the speed threshold S2 (S21: NO), a predetermined warning is displayed on the touch panel display 4 by the control unit 26 (S22: control step). . Thereafter, the control unit 16 outputs an output indicating that the speed threshold value S2 is exceeded to the reference value setting unit 25, and the process of S21 is performed again. Although not shown, if it is not possible to determine whether or not it is the position where the second image data is to be acquired after the treatment of S21, and the position where the second image data is to be acquired is lost. In this case, the speed threshold S1 is set, and the process from S14 is performed again. On the other hand, when it is determined in S21 that the moving speed of the imaging frame does not exceed the speed threshold S2 (S21: YES), the control unit 26 acquires the second image data from the imaging unit 20. The second image data is acquired by the imaging unit 20 (step S23: imaging step). Thereafter, the speed threshold S2 is reset by the control unit 26. As described above, since the second image data is the first image data 40 for the next image data, the process of S23 is the process of S11 for the next image data acquisition.

  Next, the effect of this embodiment is demonstrated.

  According to the imaging apparatus 1 according to the present embodiment, the determination unit 23 determines whether or not the position of the imaging frame is a position where image data for panoramic images should be acquired. Further, the light amount detection unit 24 detects the light amount input to the imaging device 1. Then, based on the determination result regarding the position of the imaging frame and the amount of light, the reference value setting unit 25 sets the speed threshold S1 or the speed threshold S2 of the moving speed of the imaging frame, and based on the speed threshold S1 or the speed threshold S2. Control is performed. By setting the speed threshold S1 or the speed threshold S2 in consideration of the amount of light, the speed threshold corresponding to the imaging environment can be set. For example, conventionally, when a constant speed threshold value is set without considering the amount of light, there are the following problems. In other words, the shutter speed must be slowed in scenes with low light levels, so an imaging operation that stops the camera is necessary to prevent the subject in the captured image from flowing. Although the shutter speed can be increased, the camera must be stationary even though the camera can capture high-quality images without having to stand still. In this respect, by setting the speed threshold according to the amount of light, it is possible to realize smooth imaging for the user.

  In addition, since the speed threshold S1 or the speed threshold S2 is set in consideration of the position of the imaging frame, the case where the position of the imaging frame is a position where image data for a panoramic image should be acquired is not. Different control can be performed depending on the case. Thereby, for example, when acquiring image data for a panoramic image that requires sufficient image quality, control is performed with priority on the image quality, and in other cases, the movement speed is prioritized, and the user's Control capable of improving operability can be performed. As described above, according to the present invention, it is possible to improve user operability during imaging while ensuring image quality.

  The reference value setting unit 25 sets the speed threshold S2 when the determination unit 23 determines that the imaging frame is located at the position of the imaging frame from which panoramic image data is to be acquired. In this case, a speed threshold S1 larger than the speed threshold S2 may be set. Sufficient image quality is required by increasing the speed threshold value S1 when the imaging frame is located at a position other than the speed threshold value S2 when the imaging frame is located at a position where panoramic image data should be acquired. When acquiring image data for a panoramic image, control is performed with priority given to image quality over moving speed, and in other cases where image quality as high as panoramic image image data is not required, It is possible to perform control that gives priority to the moving speed and improves user operability.

  The frame position detection unit 22 detects the moving speed of the imaging frame, and the control unit 26 determines that the imaging frame is located at the position of the imaging frame from which the panoramic image data should be acquired by the determination unit 23. When the moving speed of the imaging frame detected by the frame position detection unit 22 is lower than the speed threshold S2 set by the reference value setting unit 25, a plurality of panoramic image data is sent to the imaging unit 20. You may control to make it acquire. When the moving speed of the imaging frame is lower than the speed threshold S2 set smaller than the speed threshold S1, control is performed so that image data for a panoramic image is acquired, so that sufficient image quality is required. The image quality of the image data for the panoramic image can be ensured. In addition, it is possible to automatically acquire image data for a panoramic image.

  Moreover, the control part 26 can prompt the user to perform an appropriate operation for each reference value by performing output based on the speed threshold values S1 and S2, and the operability for the user is further improved.

  In addition, the frame position detection unit 22 detects the moving speed of the imaging frame, and the control unit 26 performs an output based on the moving speed detected by the frame position detection unit 22 and the speed thresholds S1 and S2. For example, an appropriate operation can be urged to a user who moves the imaging frame too quickly, and the operability for the user is further improved.

  The preferred embodiment of the present invention has been described above, but the present invention is not limited to the above embodiment. For example, the determination unit 23 determines that the imaging frame is located at a position where the second image data should be cut out, the control unit 26 sets the speed threshold value S2, and the moving speed of the imaging frame falls below the speed threshold value S2. However, the present invention is not limited to this. That is, the determination unit 23 stores in advance a difference between the distance Z to which the imaging frame output by the imaging position specifying unit 21 should move and the distance X to which the imaging frame output by the frame position detection unit 22 has moved. It may be determined whether or not a predetermined threshold value β (threshold value larger than α described above) has been reached (below β or less than β). The case where the predetermined threshold value β is reached is a case where at least the imaging frame is located in the vicinity of the position where the panoramic image data is to be acquired. In this case, the speed threshold S2 is set by outputting to the reference value setting unit 25 that the determination unit 23 has reached the threshold value β. Further, when the imaging frame reaches the threshold value α, the determination unit 23 outputs a message to that effect to the control unit 26, and second image data is acquired under the control of the control unit 26. Thus, the determination unit 23 may determine whether or not the current imaging frame is located in the vicinity of the position of the imaging frame from which the second image data is to be acquired. As a result, the speed threshold S2 is set before the imaging frame is located at the position where the second image data should be cut out, and the speed of the imaging frame is smoothly reduced toward the position where the second image data should be cut out. Can do.

  DESCRIPTION OF SYMBOLS 1 Imaging device, 6 ... Camera, 20 ... Imaging part, 21 ... Imaging position specific | specification part, 22 ... Frame position detection part, 23 ... Determination part, 24 ... Light quantity detection part, 25 ... Reference value setting part, 26 ... Control part, DESCRIPTION OF SYMBOLS 101 ... CPU, 102 ... Main memory part, 103 ... Auxiliary memory part, 104 ... Input part, 105 ... Output part, S1, S2 ... Speed threshold value.

Claims (6)

An image pickup apparatus that acquires image data for a plurality of panoramic images in order to generate panoramic image data by combining image data for a plurality of panoramic images,
Imaging means for acquiring image data by capturing an image cut out by an imaging frame indicating an imaging region;
Imaging position specifying means for specifying the position of an imaging frame from which the image data for the panoramic image is to be acquired;
A light amount detection means for detecting a light amount that is an amount of light input to the imaging device;
Frame position detection means for detecting the position of the imaging frame based on a plurality of image data acquired by the imaging means;
Based on the position of the imaging frame from which the image data for the panoramic image specified by the imaging position specifying unit is to be acquired, and the position of the imaging frame detected by the frame position detection unit, the imaging frame is Determining means for determining whether or not the image data for the panoramic image is to be acquired or located near the position of the imaging frame;
A reference value setting unit that sets a reference value of the moving speed of the imaging frame based on the determination by the determination unit and the light amount detected by the light amount detection unit;
Control means for performing control based on the reference value set by the reference value setting means;
An imaging apparatus comprising:   The reference value setting means sets the second reference value as the reference value when the determination means determines that the imaging frame is located at or near the position of the imaging frame from which the image data for the panoramic image is to be acquired. The imaging apparatus according to claim 1, wherein a first reference value larger than the second reference value is set as the reference value in other cases. The frame position detecting means detects a moving speed of the imaging frame;
The control means determines that the imaging frame is located at or near the position of the imaging frame from which the image data for the panoramic image is to be acquired, and is detected by the frame position detection means. When the moving speed of the imaging frame is lower than the second reference value set by the reference value setting unit, the imaging unit is controlled to acquire image data for the plurality of panoramic images. The imaging device according to claim 2.   The imaging apparatus according to claim 1, wherein the control unit performs output based on the reference value. The frame position detecting means detects a moving speed of the imaging frame;
The imaging apparatus according to claim 4, wherein the control unit performs output based on the moving speed detected by the frame position detection unit and the reference value. In order to generate panoramic image data by combining image data for a plurality of panoramic images, an imaging method by an imaging device that acquires image data for the plurality of panoramic images,
An imaging step of acquiring image data by capturing an image cut out by an imaging frame indicating an imaging region;
An imaging position specifying step of specifying the position of the imaging frame from which the image data for the panoramic image is to be acquired;
A light amount detection step for detecting a light amount that is an amount of light input to the imaging device;
A frame position detection step for detecting the position of the imaging frame based on a plurality of image data acquired in the imaging step;
Based on the position of the imaging frame from which the image data for the panoramic image specified in the imaging position specifying step is to be acquired, and the position of the imaging frame detected in the frame position detection step, the imaging frame is A determination step for determining whether or not the image data for the panoramic image is to be acquired or located near the position of the imaging frame;
A reference value setting step of setting a reference value of the moving speed of the imaging frame based on the determination in the determination step and the light amount detected in the light amount detection step;
A control step for performing control based on the reference value set in the reference value setting step;
An imaging method including:

Images