JP2010199971A - Image pickup apparatus, imaging method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To simply image an omni-directional three-dimensional image by a general user, without the use of special apparatuses. <P>SOLUTION: A control part (CPU) 20 obtains, in real time, the pitch angle, yaw angle, and roll angle of a sensor measured by a three-axis magnetic sensor 34, in a state with a half-pushed shutter button during imaging of omni-directional three-dimensions. The optical axis coordinates of a digital camera, the rotational angle of a digital camera, and the spherical coordinates of a shot image are calculated by the pitch, the yaw, and the roll to calculate a memory address, to which the shot image in the direction should be recorded according to the optical axis coordinate, the rotational angle, and the spherical coordinate, accessing an image memory 31 according to the memory address which displays the imaged area in monochrome (transluscence), in an identifiable manner together with a through-image on a display part 25, when the previously photographed imaged data (hereinafter, to be referred to as "photographed image") is recorded. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an imaging apparatus, an imaging method, and a program.

  Conventionally, in a digital camera, images are taken in order from left (right) to right (left), and the captured images are combined to perform 360 ° panoramic shooting in the horizontal direction, as well as from the bottom (top). A technique is known in which images are taken in order upward (down), and the images taken are combined to perform continuous vertical shooting (see, for example, Patent Documents 1 and 2). In either case, each time a photograph is taken, a part of the previous photographed image is displayed semi-transparently on the display unit so that the image is not interrupted. The user is guided to determine the composition (photographing position, photographing direction) so as to match the transparent photographed image.

  In recent years, a technique has been known in which a desired image of a two-dimensional map can be specified on the Internet so that a photographed image of 360 ° in the horizontal direction at that position can be viewed (for example, see Non-Patent Document 1). ). In this technology, four digital cameras facing at least four directions (front / rear / left / right) are installed on the roof of an automobile, and the above four digital cameras are photographed at a predetermined interval while traveling on the road. Are combined to obtain a captured image of 360 ° in the horizontal direction.

JP 2007-174301 A JP 2005-184533 A

“Gallgle View, starting in major cities in Japan”, [Search February 9, 2009], Internet <URL: http://www.google.co.jp/intl/ja/press/pressrel/20080805. html>

  By the way, with the widespread use of digital cameras in recent years, it has become possible for anyone to enjoy various special shooting techniques easily (or automatically), but there are still techniques for shooting in all three-dimensional directions. Not proposed. However, a technique for photographing the zenith direction using a special lens (fisheye lens) is also known for a silver salt camera, but in this case, there is a problem that a photographed image is severely distorted.

  In addition, in the digital camera that performs 360 ° panoramic shooting in the horizontal direction or continuous shooting in the vertical direction according to the conventional technique, continuous images are shot only in a predetermined direction, that is, 360 ° in the horizontal direction and / or the vertical direction. There is a problem that can not be.

  In addition, as described above, a technique for capturing a horizontal 360 ° captured image at a time has been put into practical use, but it can also be captured only in the lateral 360 °, and is a special device to the last. There is a problem that it is not common and cannot be easily used by normal users.

  Thus, conventionally, there is no known technique that allows a general user to easily shoot in all three-dimensional directions without using a special device. However, it is clear that if there are captured images in all three-dimensional directions, it is possible to broaden the enjoyment of photography. When it becomes all three-dimensional orientation, it becomes difficult for the user to memorize and photograph which part has been photographed two-dimensionally. However, there is a problem that it is impossible to take an image efficiently without failure because there are unphotographed gaps or excessive overlapping portions.

  SUMMARY An advantage of some aspects of the invention is that it provides an imaging apparatus, an imaging method, and a program that allow a general user to easily perform imaging in all three-dimensional directions without using a special apparatus.

  In order to achieve the above object, the present invention provides an image pickup means, a display means, a detection means for detecting the shooting direction of the image pickup means in real time, and images taken in all directions taken by the image pickup means, Storage means for storing in association with the shooting direction detected by the detection means, and storage status of the image by the storage means for the shooting direction detected by the detection means is read in real time, and the storage status is displayed on the display means An image pickup apparatus comprising: a display control means for performing the above operation.

  Further, as a preferred aspect, for example, as in claim 2, in the imaging device according to claim 1, the display means displays an image in all directions captured by the imaging means, and the display control means Can read in real time the storage status of the image by the storage unit with respect to the shooting direction detected by the detection unit, and can identify the captured region and the non-photographed region on the through-displayed image on the display unit It is characterized by displaying.

  Further, as a preferred aspect, for example, as in claim 3, in the imaging apparatus according to claim 2, the display control means sets the non-photographed area on the image displayed through on the display means in color. It is characterized in that it is displayed and the photographed area is displayed in monochrome.

  Further, as a preferred aspect, for example, as in claim 4, in the imaging apparatus according to claim 1, the display means displays an image in all directions captured by the imaging means, and the display control means Reads the captured image stored in the storage unit in association with the shooting direction in real time based on the shooting direction detected by the detection unit, and displays the image on the through-displayed image on the display unit. It is characterized by combining and displaying so that it can be identified.

  Further, as a preferred aspect, for example, as in claim 5, in the imaging device according to claim 4, the display control means half-shoots the photographed image on the image displayed through on the display means. It is characterized by being displayed in a transparent and identifiable manner.

Further, as a preferable aspect, for example, as in claim 6, in the imaging apparatus according to any one of claims 1 to 5, the detection unit has a vertical direction, a left-right direction, and a shooting direction as the imaging unit. Detect the direction of rotation,
It is characterized by that.

  Further, as a preferred aspect, for example, as described in claim 7, in the imaging device according to any one of claims 1 to 6, a photographing completion notifying unit that determines and notifies that all photographing in all directions has been completed. Is further provided.

  Further, as a preferred aspect, for example, as in claim 8, in the imaging device according to any one of claims 1 to 7, the shooting direction by the imaging unit detected by the detection unit is stored in the storage unit. The image processing apparatus further includes conversion means for converting to an area address, and the storage means stores a captured image in all directions imaged by the imaging means in a storage area indicated by the storage area address converted by the conversion means. It is characterized by that.

  In order to achieve the above object, an invention according to claim 9 is an imaging method for displaying an image captured by an imaging unit on a display unit and storing the image in a storage unit, wherein the imaging direction of the imaging unit is set in real time. A step of detecting, a step of storing, in the storage unit, images taken in all directions imaged by the imaging unit in association with the detected shooting direction, and the storage unit for the detected shooting direction And reading out the storage state of the image in real time in real time and displaying the storage state on the display unit.

  Further, as a preferred aspect, for example, as described in claim 10, the imaging apparatus according to claim 9 further includes a step of determining and notifying that all photographing in all directions is completed. .

  Further, as a preferred aspect, for example, as in claim 11, in the imaging device according to claim 9 or 10, the step of converting the detected shooting direction by the imaging unit into a storage area address of the storage unit And storing the captured images in all directions imaged by the imaging unit in the storage area indicated by the converted storage area address.

  In order to achieve the above object, an invention according to claim 12 is provided in a computer of an imaging apparatus including an imaging unit, a display unit that displays an image captured by the imaging unit, and a storage unit that stores the captured image. Detecting the shooting direction of the imaging unit in real time; storing the captured images in all directions captured by the imaging unit in the storage unit in association with the detected shooting direction; A program that reads out in real time a storage state of an image by the storage unit with respect to the detected shooting direction, and displays the storage state on the display unit.

  According to the present invention, there is an advantage that a general user can easily shoot in all three-dimensional directions without using a special device.

It is a block diagram which shows the structure of the digital camera by embodiment of this invention. It is a conceptual diagram for demonstrating the optical-axis coordinate of the camera and the spherical coordinate of a picked-up image in the all-solid-direction imaging | photography with the digital camera by this embodiment. It is a schematic diagram for demonstrating a mode when the digital camera by this embodiment is made into the shutter half-pressed state toward a certain direction. It is a schematic diagram which shows the example of a through image display when the digital camera by this embodiment is made into the shutter half-pressed state toward a certain direction. In the digital camera by this embodiment, it is a schematic diagram which shows the example of a display for notifying a user of the imaging condition of all the three-dimensional directions. It is a flowchart for demonstrating the operation | movement at the time of the all-solid-directional imaging | photography of the digital camera by this embodiment. In the digital camera by this embodiment, it is a schematic diagram which shows the example of a display in the case of guiding appropriately the overlap condition with the already image | photographed image.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

A. Configuration of Embodiment FIG. 1 is a block diagram showing a configuration of a digital camera according to an embodiment of the present invention. In the figure, the image acquisition unit 10 includes a lens 11, a shutter 12, and an LPF 13. The lens 11 is a normal optical lens and includes a lens group in which aspherical lenses are stacked. The shutter 12 is a so-called mechanical shutter that is operated by a driver 14 driven by the control unit 20 when a shutter button is operated. Depending on the digital camera, a mechanical shutter may not be provided, and in the case of a model equipped with a retractable lens structure and mechanical zoom, these drivers are also controlled by the driver 14. The LPF 13 is a crystal low-pass filter and is mounted to prevent the occurrence of moire.

  Next, the analog signal processing unit 15 includes an image sensor (CCD, CMOS) 16, a sampling / signal amplification processing unit 17, and an A / D converter 18. The imaging sensor 16 forms a subject image (image), and converts the intensity of light of each color of RGB into a current value. The sampling / signal amplification processing unit 17 performs correlated double sampling processing and signal amplification processing for suppressing noise and color unevenness. The A / D converter 18 is also called an analog front end, and converts the sampled / amplified analog signal into a digital signal (converts each color of RGB and CMYG into 12-bit data and outputs it to the bus line).

  Next, the image memory 31 is a memory for recording captured image data in association with position information in all stereoscopic orientations, recording and managing image data of all captured portions in all stereoscopic orientations, It plays a role of managing a photographed area and a non-photographed area in all three-dimensional directions. Several methods are conceivable as specific methods for managing image data and photographed areas in consideration of all three-dimensional orientations, but one method is as follows: In this method, the information is recorded individually as a normal image file, and information on shooting positions (shooting areas) in all three-dimensional directions is recorded in association with each image file.

  The other method is a method in which one large bitmap memory capable of mutual address conversion with each position in all three-dimensional directions is provided, and image data obtained by photographing is overwritten and synthesized on this bitmap memory. Yes, unphotographed areas are filled with black (or white) in the initial state, and areas that are filled with black (or white) are detected by image processing etc. It is possible to determine the area.

  Any of the above methods may be used, but the latter method is used here. Moreover, since these methods are well-known techniques, detailed description is abbreviate | omitted.

  Next, the control unit (CPU) 20 executes a program stored in a program memory 30 described later to control the entire digital camera (imaging device). In particular, in the present embodiment, the control unit (CPU) 20 performs a sensor pitch (azimuth angle θ) measured by a triaxial magnetic sensor 34, which will be described later, in real time when the shutter is half-pressed during all-stereoscopic shooting. The yaw (elevation angle φ) and roll (rotation angle ψ) are acquired, and the pitch (azimuth angle θ), yaw (elevation angle φ), and roll (rotation angle ψ) from the optical axis coordinates of the digital camera, the rotation angle of the digital camera, And the spherical coordinates of the photographed image are calculated, a memory address at which an image photographed in that direction is to be recorded is calculated according to the optical axis coordinate, the rotation angle, and the spherical coordinate, and the image memory 31 is stored according to the memory address. When accessing and already recorded image data (hereinafter referred to as an already imaged image) is recorded, the area corresponding to the already imaged portion on the through image is monochrome (translucent) In controls to identification. Further, at this time, instead of identifying and displaying on the through image in monochrome (semi-transparent), a part of the already photographed image is combined with the through image in monochrome (semi-transparent) and displayed on the display unit 25. You may control so. If the image has not yet been photographed in that direction, the image is naturally displayed in monochrome (semi-transparent) and the already photographed image is not displayed.

  Therefore, if the user shakes the digital camera in an arbitrary direction while the shutter is half-pressed, if the image has been taken even once, the already taken area is identified and displayed in monochrome (semi-transparent) in real time ( (Alternatively, the already captured image is combined with the through image in monochrome (translucent) in real time and displayed on the display unit 25). The user can determine the shooting frame so as to be continuous with the already shot image while confirming the positional relationship between the through image and the already shot image in real time. That is, in order to capture an image in all three-dimensional directions without a gap, the user may determine a shooting frame so that the already-photographed area is identified and displayed on the display unit 25 in monochrome (translucent).

  When the shutter is fully pressed, the control unit (CPU) 20 is based on the pitch (azimuth angle θ), yaw (elevation angle φ), and roll (rotation angle ψ) measured by the triaxial magnetic sensor 34 at that time. The captured image data is stored in the image memory 31 in accordance with the calculated or converted memory address. Therefore, when there is a pre-photographed image portion, the pre-photographed image portion, that is, the overlapping portion is overwritten, and the non-photographed portion is newly recorded.

  In the present embodiment, the order of shooting is not determined as in the prior art, and it is possible to shoot at an arbitrary position in an arbitrary (random) order. In the present embodiment, the conversion from the optical axis coordinates of the digital camera and the spherical coordinates of the photographed image to the memory addresses of the image memory 31 is performed using the optical axis coordinates, the rotation angle, and the spherical coordinates of the photographed image and the memory address. An associated conversion table may be prepared and converted via the conversion table, or may be calculated according to a predetermined arithmetic expression.

  The preview engine 22 is stored in the image buffer 26 immediately after detection of digital data input via the image acquisition unit 10 and the analog signal processing unit 15 in the recording mode (also referred to as recording mode or photographing mode) or shutter operation detection. Thinning processing is performed in order to display the digital data and the digital data stored in the image memory 31 on the display unit 25.

  The D / A converter 23 converts the digital data thinned out by the preview engine 22 and outputs it to the driver 24 at the subsequent stage. The driver 24 includes a buffer area for temporarily storing digital data displayed on the display unit 25 at the subsequent stage, and drives the display unit 25 based on a control signal input via the key operation unit 27 and the control unit 20. The display unit 25 includes a color TFT liquid crystal, an STN liquid crystal, or the like, and displays a preview image, image data after shooting, a setting menu, and the like.

  The image buffer 26 temporarily stores digital data immediately after photographing until it is input via the analog signal processing unit 15 or the digital signal processing unit 28 and passed to the digital signal processing unit 28. The key operation unit 27 includes a shutter button 7 and various operation keys such as a recording / reproducing mode switching key, a cross key, and a menu key. The digital signal processing unit 28 performs white balance processing, color processing, gradation processing, and outline emphasis on the digital data (uncompressed RAW image data) input via the analog signal processing unit 15. The image compression / decompression processing unit 29 compresses and encodes digital data (uncompressed RAW image data) input via the digital signal processing unit 28 into the JPEG format, or decompresses a JPEG format file in the playback mode. To do.

  The program memory 30 stores various programs loaded on the control unit 20. The image memory 31 stores digital data converted into various file formats. The card I / F 32 controls data exchange between the external recording medium 33 and the imaging apparatus main body. The external recording medium 33 includes a compact flash (registered trademark), a memory stick, an SD card, and the like.

  The triaxial magnetic sensor 34 is a sensor that measures the magnetic level of each of the three axes, and uniquely defines the sensor pitch (azimuth angle θ), yaw (elevation angle φ), and roll (rotation angle ψ) (or posture). Three angles). By acquiring the pitch (azimuth angle θ), yaw (elevation angle φ), and roll (rotation angle ψ) by the sensor, the optical axis direction of the camera when the shutter is half-pressed or when the shutter is fully pressed (shooting) It is possible to calculate (the azimuth and elevation angles of the east, west, north, and south of the optical axis) and the rotation angle of the camera (information indicating how much the optical axis is tilted about the rotation axis). Note that details of the optical axis coordinates of the camera and the spherical coordinates of the captured image in all stereoscopic shooting will be described later.

  The microphone 36 inputs sound when shooting a moving image. The speaker 37 outputs sound when playing back a moving image. The audio processing unit 38 performs encoding (compression) / decoding (decompression) or the like using a predetermined codec, thereby converting the audio data output to the speaker 37 into an analog signal and digitizing the audio signal from the microphone 36. .

FIG. 2 is a conceptual diagram for explaining the optical axis coordinates of the camera and the spherical coordinates of the photographed image in omnidirectional photographing with the digital camera according to the present embodiment. For example, when the digital camera is turned halfway toward a certain direction, as shown in FIG. 2, the pitch (azimuth angle θ), yaw (elevation angle φ), roll (rotation angle) of the three-axis magnetic sensor 34 at that time is shown. ψ) is obtained. Then, from the pitch (azimuth angle θ), yaw (elevation angle φ), and roll (rotation angle ψ), when the shutter is half-pressed or when the shutter is fully pressed (shooting), the optical axis direction (1, θ, and phi), rotation angle of the camera and ([psi), spherical coordinates of the captured image _{(1, θ 0, φ 0} ), (1, θ 1, φ 1), (1, θ 2, φ 2), (1 , Θ ₃ , φ ₃ ) are calculated.

When the shutter is half-pressed or fully pressed, the control unit (CPU) 20 determines which part of the spherical surface the shooting range is in the optical axis direction (1, θ, φ) of the camera and the rotation of the camera. Angle (ψ) and spherical coordinates (1, θ ₀ , φ ₀ ), (1, θ ₁ , φ ₁ ), (1, θ ₂ , φ ₂ ), (1, θ ₃ , φ ₃ ) of the captured image And converted to a corresponding memory address or calculated.

  FIG. 3 is a schematic diagram for explaining a state in which the digital camera according to the present embodiment is in a half-pressed state toward a certain direction. In a certain landscape, hatched portions A1 and A2 are portions that have already been shot, and the rectangular frame L1 corresponds to a frame (view angle) that is shot in the direction in which the digital camera is currently directed.

  FIG. 4 is a schematic diagram illustrating a display example of a through image when the digital camera according to the present embodiment is in a half-pressed state toward a certain direction. In the case shown in FIG. 3, the digital camera display unit 25 has a monochrome (semi-transparent) through image as shown in FIG. 4 where the already photographed part (corresponding to the hatched parts A1 and A2) A is monochrome. It will be identified and displayed above. By viewing the through image displayed on the display unit 25, the user can easily identify a portion that has not yet been photographed, and can easily photograph images in all three-dimensional directions without gaps.

  FIG. 5 is a schematic diagram showing a display example for informing the user of the shooting situation of all stereoscopic directions in the digital camera according to the present embodiment. As described above, at the time of shooting, the already shot portion is displayed in monochrome (translucent) on the display unit 25. In addition to this, as shown in FIG. 5, the photographed portion (shaded portion) and the unphotographed portion (outlined portion) are distinguished by color coding, and the virtual spherical surface and the current digital camera orientation (▲) The relationship may be displayed.

A-2. Operation of Embodiment Next, the operation of the above-described embodiment will be described.
FIG. 6 is a flowchart for explaining the operation of the digital camera according to this embodiment at the time of photographing in all stereoscopic directions. When the omnidirectional shooting mode is selected, first, a through image is displayed on the display unit 25 (step S10), and it is determined whether the shutter is half-pressed (step S12). If the shutter is not half-pressed, the process returns to step S10, and the through image display is continued as in the normal shooting.

On the other hand, when the shutter is half-pressed, the pitch (azimuth angle θ), yaw (elevation angle φ), and roll (rotation angle ψ) are obtained from the triaxial magnetic sensor 34 (step S14). θ), yaw (elevation angle φ), roll (rotation angle ψ) to optical axis direction (1, θ, φ), camera rotation angle (ψ), and spherical coordinates (1, θ ₀ , φ _{0 of the} captured image) ), (1, θ ₁ , φ ₁ ), (1, θ ₂ , φ ₂ ), (1, θ ₃ , φ ₃ ) are calculated (step S 16). Next, the optical axis direction (1, θ, φ), the rotation angle (ψ) of the camera, and the spherical coordinates (1, θ ₀ , φ ₀ ), (1, θ ₁ , φ ₁ ), ( 1, θ ₂ , φ ₂ ), (1, θ ₃ , φ ₃ ) are converted into memory addresses of the image memory 31 (step S 18), and the shooting data within the shooting angle of view is converted from the image memory 31 according to the memory addresses. Read (step S20).

  Next, it is determined whether or not there is a photographed portion in the read photographing data (step S22). If there is a photographed image portion, the photographed image portion is converted into a through image in monochrome (translucent). It displays so that it can be identified (step S24). Here, whether or not there is a captured part is determined by whether or not there is a data area that remains in the initial black (or white) in the read captured data. Further, if management data indicating the photographed area and the non-photographed area is separately stored, the determination may be made by comparing the coordinate data of the areas. Next, it is determined whether or not the shutter is fully pressed (step S26). If the shutter is not fully pressed, the process returns to step S10 and the above-described processing is repeated.

  On the other hand, if there is no already captured image portion, it is determined whether or not the shutter is fully pressed (step S26). If the shutter is not fully pressed, the process returns to step S10 and the above-described processing is repeated.

  Therefore, if the user shakes the digital camera in any direction with the shutter half-pressed, the captured image portion can be identified on the through image in monochrome (semi-transparent) in real time if it has been captured even once. Will be displayed. The user can determine the shooting frame so as to be continuous with the already shot image or to exclude the already shot portion while confirming the positional relationship between the through image and the already shot image in real time. . That is, in order to shoot images in all three-dimensional directions with no gaps and without overlapping as much as possible, the user sets a shooting frame so that the already-taken image portion is not displayed in monochrome (semi-transparent) on the display unit 25. You just have to decide.

  On the other hand, when the shutter is fully pressed, the photographed image data is recorded in the image memory 31 according to the memory address (step S28). In other words, if there is a pre-photographed image portion, the pre-photographed image portion, that is, the overlapping portion is overwritten, and the non-photographed portion is newly recorded. Next, it is determined whether or not all areas on the virtual spherical surface have been imaged (step S30). If all areas have not been imaged, the process returns to step 10 to repeat the above-described processing. On the other hand, when all the regions on the virtual spherical surface have been photographed, the end of photographing in all three-dimensional directions is notified on a monitor or the like (step S32), and the processing is finished. Here, whether or not all the areas on the virtual spherical surface have been photographed is determined based on whether or not there is a data area that remains black (or white) in the initial state in the entire image memory 31.

  According to the above-described embodiment, a general user can easily take an image in all three-dimensional directions without using a special device. Further, in this embodiment, the shooting order is not determined as in the prior art, and any position can be shot in any (random) order, and images in all three-dimensional directions can be easily shot without gaps. can do.

  Note that, in the above-described embodiment, photography in all three-dimensional directions should ideally be performed in all directions by moving the camera around the image sensor so as to rotate. However, since the form of the digital camera is not a dedicated one but a normal one, it is conceivable that some parallel movement components are included every time a different direction is photographed. If these parallel movements are intense, depending on the balance with the distance to the subject, the images may not be connected properly during panorama synthesis.In the present invention, however, the parallel movements do not cause a major breakdown. Ingredients may also be included.

  In this case, in order to display the photographed area for the user, when only the area is identified and displayed on the display unit 25 with reduced brightness, the four corners on the spherical coordinates obtained each time a picture is taken are displayed. If the line connecting the points is used as the boundary line with the captured area as it is, if there is a parallel movement component and there are few ways to overlap the shooting of the user, there is a possibility that an unrecorded area will occur. is there. In order to avoid this as much as possible, when the captured area is identified and displayed on the display unit 25, a quadrilateral connecting points slightly inside the four corner stake points is displayed as the captured area. That's fine.

  Alternatively, as shown in FIGS. 7A and 7B, a guide 25-1 is displayed on the display unit 25. As shown in FIG. 7A, the already photographed portions A1 and A2 that are identified and displayed are displayed. If it is located outside the guide 25-1, there is a high possibility that a left-over area will occur, so a warning is given to the user (for example, the guide 25-1 blinks in red to disable full-pressing of the shutter). ), When the already photographed portion A3 to be identified and displayed is located inside the guide 25-1, as shown in FIG. 5B, a non-warning (for example, the guide 25-1 is displayed in blue or green). It is also possible to make full pressing of the shutter effective).

  Further, in the above-described embodiment, shooting in all three-dimensional directions is continued until shooting of all areas on the virtual sphere is completed. However, user operation is performed before all areas on the virtual sphere are shot. Thus, it may be possible to interrupt the photographing in all three-dimensional directions.

10 Image Acquisition Unit 11 Lens 12 Shutter 13 LPF
14 Driver 15 Analog Signal Processing Unit 16 Imaging Sensor 17 Sampling / Signal Amplification Processing Unit 18 A / D Converter 20 Control Unit (CPU)
22 Preview Engine 23 D / A Converter 24 Driver 25 Display Unit 26 Image Buffer 27 Key Operation Unit 28 Digital Signal Processing Unit 29 Image Compression / Expansion Processing Unit 30 Program Memory 31 Image Memory 32 Card I / F
33 External recording medium 34 Triaxial magnetic sensor 38 Audio processor 36 Microphone 37 Speaker

Claims (12)

Imaging means;
Display means;
Detection means for detecting the shooting direction of the imaging means in real time;
Storage means for storing images taken in all directions imaged by the imaging means in association with imaging directions detected by the detection means;
An image pickup apparatus comprising: a display control unit that reads out in real time an image storage state by the storage unit with respect to the photographing direction detected by the detection unit, and displays the storage state on the display unit. The display means includes
Through-display images in all directions imaged by the imaging means,
The display control means includes
The storage state of the image by the storage unit with respect to the shooting direction detected by the detection unit is read in real time, and the photographed area and the non-photographed area are displayed on the through-displayed image on the display unit in a distinguishable manner. To
The imaging apparatus according to claim 1. The display control means includes
A non-photographed area is displayed in color on the through-displayed image on the display means, and the photographed area is displayed in monochrome.
The imaging apparatus according to claim 2. The display means includes
Through-display images in all directions imaged by the imaging means,
The display control means includes
A captured image stored in the storage means in association with the shooting direction can be read out in real time based on the shooting direction detected by the detection means, and can be identified on the through-displayed image on the display means Synthesize and display
The imaging apparatus according to claim 1. The display control means includes
A photographed image is displayed in a semi-transparent and identifiable manner on the through-displayed image on the display means.
The imaging apparatus according to claim 4. The detection means includes
Detecting a vertical direction, a horizontal direction, and a rotation direction as a shooting direction by the imaging means,
The imaging apparatus according to claim 1, wherein the imaging apparatus is an imaging apparatus.   The imaging apparatus according to claim 1, further comprising imaging completion notification means for determining and notifying that all imaging for all directions has been completed. Further comprising conversion means for converting the shooting direction by the imaging means detected by the detection means into a storage area address of the storage means,
The storage means
Storing captured images in all directions captured by the imaging unit in the storage area indicated by the storage area address converted by the conversion unit;
The image pickup apparatus according to claim 1, wherein the image pickup apparatus is an image pickup apparatus. An image capturing method for displaying an image captured by an image capturing unit on a display unit and storing the image in a storage unit,
Detecting the shooting direction of the imaging unit in real time;
Storing images taken in all directions imaged by the imaging unit in the storage unit in association with the detected shooting direction;
An image capturing method comprising: reading out in real time a storage state of an image stored in the storage unit with respect to the detected shooting direction, and displaying the storage state on the display unit.   The imaging method according to claim 9, further comprising a step of determining and notifying that all photographing in all directions has been completed. Converting the detected shooting direction of the imaging unit into a storage area address of the storage unit;
The imaging method according to claim 9, further comprising: storing captured images in all directions captured by the imaging unit in a storage area indicated by the converted storage area address. . In a computer of an imaging apparatus comprising an imaging unit, a display unit that displays an image captured by the imaging unit, and a storage unit that stores the captured image,
Detecting the shooting direction of the imaging unit in real time;
Storing images taken in all directions imaged by the imaging unit in the storage unit in association with the detected shooting direction;
A program that reads in real time the image storage state of the storage unit with respect to the detected shooting direction and displays the storage state on the display unit.

Images