JP2019033487A - Imaging apparatus, imaging method and program - Google Patents

Abstract

To correct a taken omnidirectional image with good accuracy according to an angle at time of shooting by an imaging apparatus even when the imaging apparatus is being moved or in motion.SOLUTION: An imaging apparatus 14 comprises: a shooting part 20; an acceleration detector 30; an angular velocity detector 32; a calculation part 22D; a creation part 22E; and a conversion part 22F. The shooting part 20 takes an omnidirectional image by image shooting. The acceleration detector 30 detects an acceleration in three axial directions. The angular velocity detector 32 detects an angular velocity in three axial directions. The calculation part 22D calculates a tilt angle of the imaging apparatus 14 with respect to a zenith direction based on an acceleration and an angular velocity detected when shooting the omnidirectional image. The creation part 22E creates a projective transformation parameter for projection transformation of the omnidirectional image for tilt of an angle according to the tilt angle. The conversion part 22F performs a projective transformation of the omnidirectional image with the projective transformation parameter.SELECTED DRAWING: Figure 5

Description

  The present invention relates to a photographing apparatus, a photographing method, and a program.

  A technique for detecting the tilt and orientation of a digital camera and correcting a captured image is known. For example, Patent Document 1 discloses a technique for specifying an optical axis direction of a photographing optical system using a three-axis electronic compass and correcting an orientation in a specific direction.

  However, in the prior art, it has not been possible to accurately correct an omnidirectional image captured during movement or movement of an imaging device that obtains an omnidirectional image according to an angle at the time of imaging of the imaging device.

  In order to solve the above-described problems, the present invention provides a photographing unit that obtains an omnidirectional image by photographing, an acceleration detecting unit that detects acceleration in three axial directions, an angular velocity detecting unit that detects angular velocity in three axial directions, Based on the acceleration and angular velocity detected at the time of capturing the omnidirectional image, a calculation unit that calculates an inclination angle of the imaging apparatus with respect to the zenith direction, an angle according to the calculated inclination angle, An imaging device comprising: a generation unit that generates a projective transformation parameter for projective transformation of the omnidirectional image so as to incline; and a conversion unit that performs the projective transformation of the omnidirectional image using the projective transformation parameter. Device.

  According to the present invention, even if the photographing apparatus is moving or exercising, there is an effect that the photographed omnidirectional image can be accurately corrected according to the angle at which the photographing apparatus is photographing.

FIG. 1 is a schematic diagram of the appearance of the photographing apparatus according to the present embodiment. FIG. 2 is a diagram illustrating an example of a usage pattern of the photographing apparatus. FIG. 3 is an explanatory diagram of an image photographed by the photographing apparatus according to the present embodiment. FIG. 4 is a schematic diagram illustrating another example of an omnidirectional image. FIG. 5 is a functional block diagram of the photographing apparatus. FIG. 6 is a flowchart showing the procedure of the photographing process. FIG. 7 is a hardware configuration diagram of the photographing apparatus.

  Embodiments of the present invention will be described below.

  FIG. 1 is a schematic diagram of the external appearance of the imaging device 14. FIG. 1A is a side view of the photographing apparatus 14. FIG. 1B is a side view of the imaging device 14 on the side opposite to FIG. 2A. FIG. 1C is a plan view of the imaging device 14.

  The photographing device 14 is, for example, a size that a human can hold with one hand. Note that the size of the photographing device 14 is not limited to this size.

  In the upper part of the imaging device 14, an image sensor 14A is provided on the front side (one surface side) and an image sensor 14B is provided on the back side (the other surface side). An operation unit 24 that is operated by the user is provided on the front side of the photographing apparatus 14. Further, a display unit 26 is provided on the side surface side of the photographing apparatus 14. The display unit 26 is a known display device that displays various images. The display unit 26 is, for example, a liquid crystal. The display unit 26 may be a touch panel having a function of receiving an operation instruction from the user.

  The imaging device 14 includes a control unit 22, a storage unit 28, an acceleration detection unit 30, an angular velocity detection unit 32, and a triaxial geomagnetism detection unit 34.

  The control unit 22 controls the entire photographing apparatus 14. The control unit 22 may be configured by a CPU (Central Processing Unit) or a circuit.

  The storage unit 28 stores various data. The storage unit 28 may be a storage medium that is removable from the main body of the photographing apparatus 14.

  The acceleration detection unit 30 is mounted on the imaging device 14 and detects acceleration in the triaxial direction of the imaging device 14. The acceleration detection unit 30 may use a known acceleration sensor that can detect acceleration in three axis directions. The acceleration detection unit 30 is, for example, a piezoresistive triaxial acceleration sensor, a capacitance triaxial acceleration sensor, a heat detection triaxial acceleration sensor, or the like.

  Among these, it is particularly preferable to use a triaxial acceleration sensor that is driven at a higher speed for the acceleration detection unit 30.

  The angular velocity detection unit 32 is mounted on the photographing apparatus 14 and detects angular velocities in the three axial directions of the photographing apparatus 14. The angular velocity detection unit 32 may use a known angular velocity sensor (sometimes referred to as a gyro sensor or a gyroscope) that can detect an angular velocity in three axial directions. The angular velocity detector 32 is preferably a triaxial angular velocity sensor that is driven at a higher speed.

  The triaxial geomagnetism detection unit 34 is mounted on the imaging device 14 and derives the direction of each azimuth (azimuth angle, magnetic north) with the imaging device 14 as the origin by detecting the geomagnetism in the triaxial direction of the earth. A known triaxial electronic compass may be used for the triaxial geomagnetic detection unit 34. The triaxial geomagnetic detector 34 is preferably a triaxial electronic compass that is driven at a higher speed.

  Next, an example of a usage pattern of the imaging device 14 of the present embodiment will be described. FIG. 2 is a diagram illustrating an example of a usage pattern of the imaging device 14. The photographing device 14 is used for photographing a subject around the user with the hand held by the user. In this case, the subject around the user is photographed by the optical system 20A and the optical system 20B (see FIG. 1), and two hemispherical images are obtained.

  Next, an image photographed by the photographing device 14 will be described. FIG. 3 is an explanatory diagram of an image photographed by the photographing device 14. 3A is a hemispheric image (front side) photographed by the photographing apparatus 14, FIG. 3B is a hemispheric image photographed by the photographing apparatus 14 (rear side), and FIG. 3C is represented by Mercator projection. It is the figure which showed the omnidirectional image.

  The image obtained by the optical system 20A shown in FIG. 3A is a hemispherical image (front side) curved by a fisheye lens (not shown) included in the optical system 20A. As shown in FIG. 3B, the image obtained by the optical system 20B is a hemispherical image (rear side) curved by a fisheye lens (not shown) included in the optical system 20B. Then, the hemispherical image (front side) and the hemispherical image (rear side) are combined by the photographing device 14 to obtain an omnidirectional image shown in FIG. FIG. 4 is a schematic diagram illustrating another example of an omnidirectional image.

  The omnidirectional image is an image obtained by photographing in all directions (sometimes referred to as an omnidirectional sphere), that is, 360 °. An image in which omnidirectional images as still images are continued in time series is a moving image.

  Next, a functional configuration of the photographing apparatus 14 will be described.

  FIG. 5 is a functional block diagram of the photographing apparatus 14. The imaging device 14 includes an imaging unit 20, an acceleration detection unit 30, an angular velocity detection unit 32, a triaxial geomagnetism detection unit 34, a control unit 22, an operation unit 24, a display unit 26, a storage unit 28, Is provided. The imaging unit 20, acceleration detection unit 30, angular velocity detection unit 32, triaxial geomagnetism detection unit 34, and operation unit 24 are connected to the control unit 22 so that signals and data can be exchanged.

  The imaging unit 20 includes an optical system 20A, an image sensor 21A, an optical system 20B, and an image sensor 21B.

  The image sensor 21A and the image sensor 21B are solid-state image sensors for photoelectrically converting an optical image, and for example, a CMOS or the like is used. The image pickup device 21A receives light incident through the optical system 20A, photoelectrically converts a photoelectric image by the received light, and outputs the photoelectric image to the control unit 22. The image sensor 21B receives light incident through the optical system 20B, photoelectrically converts a photoelectric image by the received light, and outputs the photoelectric image to the control unit 22.

  The operation unit 24 receives various operation instructions from the user. The operation unit 24 includes, for example, a changeover switch 24A and a release switch 24B. The operation unit 24 may further include a switch for performing another operation instruction. Further, as described above, the operation unit 24 may be a touch panel configured integrally with the display unit 26.

  The changeover switch 24A is a switch operated by the user when inputting a switching instruction between moving image shooting and still image shooting. The release switch 24B is a switch operated by the user when inputting a shooting instruction.

  The control unit 22 includes a first acquisition unit 22A, a signal processing unit 22B, a second acquisition unit 22C, a calculation unit 22D, a generation unit 22E, a conversion unit 22F, and an output unit 22G. Part or all of the first acquisition unit 22A, the signal processing unit 22B, the second acquisition unit 22C, the calculation unit 22D, the generation unit 22E, the conversion unit 22F, and the output unit 22G can be programmed into a processing device such as a CPU, for example. Execution, that is, may be realized by software, may be realized by hardware such as an IC (Integrated Circuit), or may be realized by using software and hardware in combination.

  The first acquisition unit 22A acquires an omnidirectional image from the imaging unit 20.

  The signal processing unit 22B performs known color correction and the like on the omnidirectional image acquired by the first acquisition unit 22A.

  Specifically, the signal processing unit 22B applies an optical black (OB) correction process, a defective pixel correction process, a linear correction process, a Shading correction process, an area division average process, a white color to the omnidirectional image acquired by the photographing unit 20. Signal processing such as balance (WB) processing, gamma (γ) correction processing, Bayer interpolation processing, YUV conversion processing, YCFLT (edge enhancement) processing, and color correction processing is performed.

  The optical black (OB) correction process is a process in which the output signal of the effective pixel area is clamp-corrected using the output signal of the optical black area as the black reference level. The defective pixel correction process is a process for correcting pixel values of defective pixels included in the image sensor 21A and the image sensor 21B. The linear correction process is a process for performing linear correction for each of RGB. The Shading correction process is a process for correcting shading (shading) distortion of the effective pixel region by multiplying the output signal of the effective pixel region by a correction coefficient (fixed value) prepared in advance.

  The area division average process is a process of dividing the obtained image and calculating the average luminance. The calculated average luminance is used for AE processing. The white balance (WB) process is a well-known white correction process, and is a process of performing correction by changing the R and B gains in each pixel.

  The gamma (γ) correction process is a known gamma correction process. In a CMOS, an array called a Bayer array, a color filter of any one of RED, GREEN, and BLUE is attached to one pixel, and RAW data has only one color information per pixel. However, in order to view an image from RAW data, information of three colors RED, GREEN, and BLUE is required for one pixel. In the Bayer interpolation process, an interpolation process for interpolating from surrounding pixels is performed to compensate for the two missing colors.

  In the RAW data stage, the RGB data format is RED, GREEN, and BLUE, but in the YUV conversion, the luminance signal Y and the color difference signal UV are converted into the YUV data format. In a JPEG image of a file format generally used in a digital camera or the like, an image is created from YUV data. For this reason, in the YUV conversion process, RGB data is converted into YUV data.

  YCFLT (edge enhancement) processing is performed in parallel with edge extraction filter processing for extracting an edge portion from a luminance (Y) signal of an image, gain multiplication processing for multiplying an edge extracted by the edge extraction filter, and edge extraction. Then, LPF (low pass filter) processing for removing image noise and data addition processing for adding edge extracted data after gain multiplication and image data after LPF processing are included.

  Color correction processing includes saturation setting, hue setting, partial hue change setting, color suppression setting, and the like. The saturation setting is a parameter setting that determines the color depth and indicates the UV color space. For example, in the second quadrant, the length of the vector from the origin to the RED dot is the RED color. The longer the color, the darker the color.

  The first acquisition unit 22A performs the above signal processing on the hemispherical image (front side) acquired from the image sensor 21A and the hemispherical image (rear side) acquired from the image sensor 21B, and synthesizes the omnidirectional image. get.

  The second acquisition unit 22C acquires, from each of the acceleration detection unit 30 and the angular velocity detection unit 32, the acceleration in the three-axis direction and the angular velocity in the three-axis direction when an image is captured by the imaging unit 20.

  Note that the second acquisition unit 22C has three-axis acceleration and three-axis direction when an image is captured by the imaging unit 20 from each of the acceleration detection unit 30, the angular velocity detection unit 32, and the triaxial geomagnetism detection unit 34. It is preferable to acquire each of the angular velocity and the direction of each direction. In the present embodiment, a case will be described in which the second acquisition unit 22C acquires detection results from each of the acceleration detection unit 30, the angular velocity detection unit 32, and the triaxial geomagnetism detection unit 34.

  In other words, in the present embodiment, the second acquisition unit 22C has the three-axis direction acceleration, the three-axis direction angular velocity, and the azimuths (azimuths) that have the shooting device 14 as the origin. Get the direction of (corner, magnetic north).

  The calculation unit 22D calculates the tilt angle of the imaging device 14 with respect to the zenith direction based on the triaxial acceleration and the triaxial angular velocity detected when the omnidirectional image is captured.

  The zenith direction indicates a direction directly above the user on the celestial sphere, and is a direction that coincides with the anti-vertical direction.

  Specifically, the calculation unit 22D acquires the accelerations in the three directions of the XYZ three axes in the global coordinate system detected by the acceleration detection unit 30. Further, the calculation unit 22D acquires the angular velocities in the three directions of the XYZ three axes in the global coordinate system detected by the angular velocity detection unit 32.

  When the acceleration detected by the acceleration detection unit 30 indicates that the acceleration is occurring (not constant), the calculation unit 22D displays the XYZ 3-axis in the global coordinate system detected by the acceleration detection unit 30. From the acceleration in the three directions, the tilt angle of the photographing device 14 with respect to the zenith direction is calculated by a known method.

  On the other hand, when the acceleration detected by the acceleration detection unit 30 indicates a constant acceleration, the calculation unit 22D calculates a known method from the angular velocities in the three directions of the XYZ three axes in the global coordinate system detected by the angular velocity detection unit 32. Thus, the inclination angle of the photographing device 14 with respect to the zenith direction is calculated.

  In the present embodiment, the inclination angle of the imaging device 14 with respect to the zenith direction indicates the inclination of the direction along the facing surface of the imaging device 14 that faces the optical system 20A and the optical system 20B with respect to the zenith direction.

  Note that the calculation unit 22D calculates the tilt angle of the imaging device 14 based on the acceleration in the three-axis direction, the angular velocity in the three-axis direction, and the direction of each direction detected when the omnidirectional image is captured. It is preferable.

  In this case, the calculation unit 22D further acquires the directions of the respective orientations with the imaging device 14 as the origin, detected by the triaxial geomagnetism detection unit 34, from the XYZ triaxial geomagnetic detection results in the global coordinate system. Specifically, the calculation unit 22D acquires the respective azimuths of the optical axis of the optical system 20A and the optical axis of the optical system 20B as the respective azimuths with the photographing device 14 as the origin.

  When the acceleration detected by the acceleration detection unit 30 indicates that the acceleration is occurring (not constant), the calculation unit 22D displays the XYZ 3-axis in the global coordinate system detected by the acceleration detection unit 30. Using the acceleration in the three directions, the azimuth of the optical axis of the optical system 20A, and the azimuth of the optical axis of the optical system 20B, the tilt angle and azimuth of the imaging device 14 with respect to the zenith direction are calculated by a known method. .

  In addition, when the acceleration detected by the acceleration detection unit 30 indicates constant acceleration, the calculation unit 22D determines the angular velocity in the three directions of the XYZ three axes in the global coordinate system detected by the angular velocity detection unit 32 and the optical system 20A. The tilt angle and the azimuth of the photographing device 14 with respect to the zenith direction are calculated by a known method using the azimuth of the optical axis and the azimuth of the optical axis of the optical system 20B.

  The generation unit 22E generates projective transformation parameters for performing projective transformation on the omnidirectional image so as to tilt the angle according to the tilt angle calculated by the calculation unit 22D.

  When the calculation unit 22D calculates the tilt angle and orientation of the photographing device 14, the generation unit 22E causes the tilt according to the tilt angle calculated by the calculation unit 22D and a direction that matches the calculated orientation. It is sufficient to generate projective transformation parameters for

  The generation unit 22E may generate projective transformation parameters using a known method. The generation unit 22E generates a projective transformation parameter (matrix) using, for example, OpenGL (Open Graphics Library).

  The conversion unit 22F calculates the omnidirectional image captured by the imaging unit 20 according to the detection result detected by the acceleration detection unit 30, the angular velocity detection unit 32, and the triaxial geomagnetic detection unit 34 when the omnidirectional image is captured. Projective transformation is performed using the projection transformation parameter generated from the tilt angle.

  Note that the conversion unit 22F performs projective conversion on each of a plurality of omnidirectional images captured in time series using each of a plurality of projection conversion parameters generated according to each of the plurality of omnidirectional images. Alternatively, a moving image composed of a plurality of omnidirectional images subjected to projective transformation may be generated.

  The output unit 22G outputs the omnidirectional image (still image or moving image) subjected to the projective conversion by the conversion unit 22F to the display unit 26. For output to the display unit 26, for example, OpenGL or the like may be used. Note that the output unit 22G may transmit the omnidirectional image (still image or moving image) subjected to projective conversion by the conversion unit 22F to an external device via a communication unit (not shown). Further, the output unit 22G may store the omnidirectional image (still image or moving image) subjected to projective conversion by the conversion unit 22F in the storage unit 28. Further, the output unit 22G may perform a known compression process on the omnidirectional image (still image or moving image) that has undergone the projective transformation, and then transmit it to an external device or store it in the storage unit 28.

  Next, a procedure of imaging processing executed by the control unit 22 will be described.

  FIG. 6 is a flowchart showing the procedure of the photographing process executed by the control unit 22.

  First, the first acquisition unit 22A of the control unit 22 acquires an omnidirectional image from the imaging unit 20 (step S100).

  Next, the signal processing unit 22B performs signal processing on the omnidirectional image acquired in step S100 (step S102).

  Next, the 2nd acquisition part 22C acquires the detection result at the time of imaging | photography of the omnidirectional image acquired by step S100 from each of the acceleration detection part 30, the angular velocity detection part 32, and the triaxial geomagnetism detection part 34 ( Step S104).

  Next, the calculation unit 22D calculates the tilt angle and azimuth of the imaging device 14 when the omnidirectional image acquired in step S100 is captured (step S106). Next, the generation unit 22E generates a projective transformation parameter from the tilt angle and direction calculated in step S100 (step S108).

  Next, the conversion unit 22F performs projective conversion on the omnidirectional image signal-processed in step S102 (step S110).

  Next, the conversion unit 22F determines which one of the moving image shooting instruction and the still image shooting instruction is received from the operation unit 24 (step S114).

  In the case where moving image shooting is instructed by an operation instruction of the changeover switch 24A by the user, the conversion unit 22F determines that a moving image shooting instruction has been issued (step S114: moving image). Then, the process proceeds to step S116. In step S116, the conversion unit 22F determines whether an instruction to end moving image shooting has been received (step S116). The conversion unit 22F determines whether or not a moving image shooting end instruction has been received from the changeover switch 24A or the release switch 24B, thereby determining step S116.

  If a negative determination is made in step S116 (step S116: No), the process returns to step S100. On the other hand, if an affirmative determination is made in step S116 (step S116: Yes), the process proceeds to step S118.

  In step S114, if a still image shooting instruction is given by an operation instruction of the changeover switch 24A by the user, the conversion unit 22F determines that a still image shooting instruction is given (step S114: still image). Image) and the process proceeds to step S118.

  Through the processes in steps S100 to S116, a moving image is generated as an omnidirectional image (still image) that has undergone projective transformation or a plurality of omnidirectional images that have undergone projective transformation.

  Next, the conversion unit 22F outputs the generated omnidirectional image (still image or moving image) to the display unit 26, the storage unit 28, or an external device (step S118).

  Then, this routine ends.

  As described above, the imaging device 14 according to the present embodiment includes the imaging unit 20, the acceleration detection unit 30, the angular velocity detection unit 32, the calculation unit 22D, the generation unit 22E, and the conversion unit 22F. . The photographing unit 20 obtains an omnidirectional image by photographing. The acceleration detection unit 30 detects acceleration in the triaxial direction. The angular velocity detector 32 detects angular velocities in the three axial directions. The calculation unit 22D calculates the tilt angle of the imaging device 14 with respect to the zenith direction based on the acceleration and the angular velocity detected when the omnidirectional image is captured. The generation unit 22E generates projective transformation parameters for performing projective transformation on the omnidirectional image so as to be inclined according to the inclination angle. The conversion unit 22F performs projective conversion on the omnidirectional image using the projective conversion parameter.

  Therefore, the imaging device 14 according to the present embodiment captures an omnidirectional image captured while the imaging device 14 is moving or exercising even when the imaging device 14 is moving or exercising. Can be accurately corrected according to the angle.

  The imaging device 14 according to the present embodiment further includes a triaxial geomagnetism detection unit 34, and the calculation unit 22D calculates the acceleration in the triaxial direction and the angular velocity in the triaxial direction detected when the omnidirectional image is captured. Based on the direction of each azimuth, the tilt angle of the photographing device 14 with respect to the zenith direction and the orientation of the photographing device 14 are calculated. In addition, the generation unit 22E generates projective transformation parameters for performing projective transformation on the omnidirectional image so as to incline in the direction corresponding to the inclination angle and the calculated azimuth.

  For this reason, by performing projective transformation of the omnidirectional image using the projective transformation parameter, the position and direction of the subject included in the omnidirectional image are fixed regardless of the inclination and azimuth of the imaging device 14, and can do. In other words, it is possible to obtain an omnidirectional image in which the zenith direction in the omnidirectional image and the shooting direction in the omnidirectional image (particularly the shooting direction of the still image) are set as a fixed direction.

  Next, a hardware configuration of the above-described photographing apparatus 14 will be described.

  FIG. 7 is a hardware configuration diagram of the imaging device 14. The photographing apparatus 14 has a hardware configuration equivalent to a CPU 52 that controls the entire apparatus, a ROM 50 that stores various data and various programs, a RAM 54 that stores various data and various programs, and an operation unit 24 (see FIG. 1). Input device 58, a display device 56 corresponding to the display unit 26 (see FIG. 1), a communication device 60, a photographing unit 20, and a detection unit 62 are mainly provided, and an ordinary computer is used. It has a hardware configuration. The detection unit 62 includes the acceleration detection unit 30, the angular velocity detection unit 32, and the triaxial geomagnetism detection unit 34 described above.

  The program executed by the photographing apparatus 14 of the above embodiment is a file in an installable format or an executable format, and is a computer such as a CD-ROM, a flexible disk (FD), a CD-R, a DVD (Digital Versatile Disk). Recorded on a readable recording medium and provided as a computer program product.

  Further, the program executed by the photographing apparatus 14 of the above embodiment may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Further, the program executed by the photographing apparatus 14 of the above embodiment may be provided or distributed via a network such as the Internet.

  In addition, the program executed by the imaging device 14 of the above-described embodiment may be configured to be provided by being incorporated in advance in a ROM or the like.

  The program executed by the imaging device 14 of the above embodiment has a module configuration including the above-described units, and as actual hardware, a CPU (processor) reads and executes the program from the storage medium. Each of the above parts is loaded on the main memory, and each of the above parts is generated on the main memory.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the components without departing from the scope of the invention in the implementation stage. Various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiments. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined. Various modifications are possible.

14 imaging device 20 imaging unit 22D calculation unit 22E generation unit 22F conversion unit 22G output unit 30 acceleration detection unit 32 angular velocity detection unit 34 triaxial geomagnetic detection unit

JP2013-3259A

In order to solve the above-described problems, the present invention provides an imaging unit having at least two imaging elements that capture images with different imaging directions, an acceleration detection unit that detects acceleration in three axes, and an angular velocity in three axes. an angular velocity detection unit for detecting a and acceleration of the detected by the acceleration detection section and the angular velocity detection, and the angular velocity, based on, and calculates the inclination angle of the imaging device relative to the zenith direction, the slope is calculated And a control unit that converts the image based on a corner and generates an omnidirectional image .

Claims (5)

A shooting unit that obtains an omnidirectional image by shooting;
An acceleration detection unit for detecting acceleration in three axis directions;
An angular velocity detector that detects angular velocities in three axial directions;
A calculation unit that calculates an inclination angle of the imaging device with respect to the zenith direction based on the acceleration and the angular velocity detected at the time of capturing the omnidirectional image;
A generation unit that generates a projective transformation parameter for projective transformation of the omnidirectional image so as to be tilted at an angle corresponding to the calculated tilt angle;
The omnidirectional image, a conversion unit that performs projective conversion using the projective conversion parameters;
An imaging device comprising: A triaxial geomagnetism detection unit that detects the direction of each azimuth with the imaging device as the origin by detecting the geomagnetism in the triaxial direction,
The calculation unit includes:
Based on the acceleration, the angular velocity, and the direction of each azimuth detected at the time of photographing the omnidirectional image, calculate the tilt angle of the photographic device and the azimuth of the photographic device,
The generator is
Generating the projective transformation parameters for projective transformation of the omnidirectional image so as to incline in an angle according to the calculated tilt angle and in a direction matching the calculated azimuth;
The imaging device according to claim 1. The conversion unit performs projective conversion of each of the plurality of omnidirectional images captured in time series using each of the plurality of projection conversion parameters generated according to each of the plurality of omnidirectional images. Generate moving images,
The imaging device according to claim 1 or 2. An imaging method executed by an imaging device including an imaging unit that obtains an omnidirectional image by imaging, an acceleration detection unit that detects acceleration in three axes, and an angular velocity detection unit that detects angular velocity in three axes. ,
Calculating an inclination angle of the photographing apparatus with respect to the zenith direction based on the acceleration and the angular velocity detected when photographing the omnidirectional image;
Generating a projective transformation parameter for projective transformation of the omnidirectional image so as to be tilted at an angle corresponding to the calculated tilt angle;
Projecting the omnidirectional image using the projective transformation parameters; and
Including shooting method. A computer having an imaging device that includes an imaging unit that obtains an omnidirectional image by imaging, an acceleration detection unit that detects acceleration in three axes, and an angular velocity detection unit that detects angular velocity in three axes.
Calculating an inclination angle of the imaging device with respect to the zenith direction based on the acceleration and the angular velocity detected at the time of capturing the omnidirectional image;
Generating a projective transformation parameter for projective transformation of the omnidirectional image so as to be tilted at an angle corresponding to the calculated tilt angle;
Projecting the omnidirectional image using the projective transformation parameters; and
A program that executes