WO2002069035A2 - Miroir panoramique ameliore et systeme de production d'images panoramiques ameliorees - Google Patents

Miroir panoramique ameliore et systeme de production d'images panoramiques ameliorees Download PDF

Info

Publication number
WO2002069035A2
WO2002069035A2 PCT/US2002/005454 US0205454W WO02069035A2 WO 2002069035 A2 WO2002069035 A2 WO 2002069035A2 US 0205454 W US0205454 W US 0205454W WO 02069035 A2 WO02069035 A2 WO 02069035A2
Authority
WO
WIPO (PCT)
Prior art keywords
mirror
view
vertical field
angle
axis
Prior art date
Application number
PCT/US2002/005454
Other languages
English (en)
Other versions
WO2002069035A3 (fr
Inventor
Herman Herman
Sanjiv Singh
Original Assignee
Eyesee360, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Eyesee360, Inc. filed Critical Eyesee360, Inc.
Priority to CA002439296A priority Critical patent/CA2439296A1/fr
Priority to AU2002244132A priority patent/AU2002244132A1/en
Publication of WO2002069035A2 publication Critical patent/WO2002069035A2/fr
Publication of WO2002069035A3 publication Critical patent/WO2002069035A3/fr

Links

Classifications

    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B17/00—Details of cameras or camera bodies; Accessories therefor
    • G03B17/56—Accessories
    • G03B17/565—Optical accessories, e.g. converters for close-up photography, tele-convertors, wide-angle convertors
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B37/00—Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe
    • G03B37/06—Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe involving anamorphosis

Definitions

  • the present invention relates to panoramic imaging, and more particularly relates to an improved panoramic mirror for providing enhanced panoramic images.
  • One method for capturing a large field of view in a single image is to use an ultra-wide angle lens.
  • a drawback to this is the fact that a typical 180-degree lens can cause substantial amounts of optical distortion in the resulting image.
  • a video or still camera placed below a convex reflective surface can provide a large field of view provided an appropriate mirror shape is used. Such a configuration is suited to miniaturization and can be produced relatively inexpensively.
  • Spherical mirrors have been used in such panoramic imaging systems. Spherical mirrors have constant curvatures and are easy to manufacture, but do not provide optimal imaging or resolution.
  • Hyperboloidal mirrors have been proposed for use in panoramic imaging systems. The rays of light which are reflected off of the hyperboloidal surface, no matter where the point of origin, all converge at a single point, enabling perspective viewing. A major drawback to this system lies in the fact that the rays of light that make up the reflected image converge at the focal point of the reflector.
  • Another proposed panoramic imaging system uses a parabolic mirror and an orthographic lens for producing perspective images.
  • a disadvantage of this system is that many of the light rays are not orthographically reflected by the parabolic mirror. Therefore, the system requires an orthographic lens to be used with the parabolic mirror.
  • the present invention improves the usable resolution of panoramic mirrors.
  • An aspect of the present invention is to provide a panoramic photographic apparatus comprising a mirror, and a means for mounting the mirror on an axis.
  • the mirror includes a convex reflective surface symmetric about the axis, and the surface forms a first angle C with respect to a first plane perpendicular to the axis at a point of intersection between the axis and the mirror, the first angle C being determined by a lower limit of a controlled vertical field of view.
  • Another aspect of the present invention is to provide a panoramic photographic apparatus comprising a rod positioned on an axis, and a mirror mounted at a first end of the rod.
  • the mirror includes a convex reflective surface symmetric about the axis, and the surface forms a first angle E with respect to a first plane pe ⁇ endicular to the axis at a point of intersection between the rod and the mirror, the first angle E being determined by a lower limit of a controlled vertical field of view.
  • a further aspect of the present invention is to provide a system for providing enhanced panoramic images comprising a mirror, a means for mounting the mirror on an axis, and a camera with a lens.
  • the mirror includes a convex reflective surface symmetric about the axis, and the surface forms a first angle C with respect to a first plane pe ⁇ endicular to the axis at a point of intersection between the axis and the mirror, the first angle C being determined by a lower limit of a controlled vertical field of view.
  • the camera is positioned so that the lens is substantially aligned with the axis.
  • Another aspect of the present invention is to provide a system for providing enhanced panoramic images comprising a mirror, a rod positioned on an axis, a means for mounting the mirror on an axis, and a camera with a lens.
  • the mirror includes a convex reflective surface symmetric about the axis, and the surface forms a first angle E with respect to a first plane pe ⁇ endicular to the axis at a point of intersection between the rod and the mirror, the first angle E being determined by a lower limit of a controlled vertical field of view.
  • the camera is positioned so that the lens is substantially aligned with the axis.
  • a further aspect of the present invention is to provide a method of providing enhanced panoramic images.
  • the method includes the step of optimizing a resolution of a mirror by selecting the resolution based upon controlling at least one parameter selected from: a shape of the mirror, an upper limit of a controlled vertical field of view, a lower limit of a controlled vertical field of view, an upper limit of a desired vertical field of view, a lower limit of a desired vertical field of view, and a vertical pixel radius.
  • Another aspect of the present invention is to provide a method of providing enhanced panoramic images.
  • the method includes the steps of providing a camera with a mirror, wherein the mirror includes a convex reflective surface symmetric about an axis, obtaining a raw panoramic image using the camera and the mirror, the image having pixel representations comprising a vertical pixel radius, a horizontal pixel circumference at an upper limit of a desired vertical field of view, and a horizontal pixel circumference at a lower limit of a desired vertical field of view, and optimizing a resolution of the mirror by modifying the mirror to obtain desired pixel representations.
  • Fig. 1 shows a sectional schematic diagram illustrating a system for combining a camera with a convex reflective surface for producing panoramic images.
  • Fig. 2 shows a raw 360° image captured with a panoramic camera in accordance with an embodiment of the present invention.
  • Fig. 3 shows the raw 360° image of Fig. 2 unwa ⁇ ed into a viewable panoramic image camera in accordance with an embodiment of the present invention.
  • Fig. 4 shows the geometry of an equi-angular mirror.
  • Fig. 5 shows equiangular mirror shapes for a gain ⁇ of 3, 5, and 7.
  • Fig. 6 shows an equi-angular mirror that provides approximately equal angles for each pixel and a compensated equi-angular mirror that provides exactly equal angles for each pixel when ⁇ is equal to 3.
  • Fig. 7A shows a cross sectional image of a convex reflective mirror before an interior part of the two-dimensional mirror profile is removed.
  • Fig. 7B illustrates how the lower limit of the controlled vertical field of view can be selected by removing an interior part of the mirror profile in accordance with an embodiment of the present invention.
  • Fig. 8 illustrates how the lower limit of the controlled vertical field of view can be selected by removing an interior part of the mirror profile in accordance with another embodiment of the present invention.
  • Fig. 9 shows how an angle C can be formed with respect to a first plane pe ⁇ endicular to a central axis at a point of intersection between the central axis and a mirror, in accordance with an embodiment of the present invention.
  • Fig. 10 shows how the upper limit of the controlled vertical field of view can be selected in accordance with an embodiment of the present invention.
  • Fig. 11 shows how an angle D can be formed with respect to a second plane pe ⁇ endicular to the central axis at an end of the mirror opposite the point of intersection between the central axis and the mirror.
  • Fig. 12 shows a cross-sectional view of a compensated equi-angular mirror with a controlled vertical field of view, in accordance with an embodiment of the present invention.
  • Fig. 13A shows a schematic representation of a raw 360° image
  • Fig. 13B shows a schematic representation of a raw 360° image unwa ⁇ ed into a viewable panoramic image.
  • Fig. 14A shows a schematic representation of a raw 360° image captured with a panoramic mirror designed without a controlled vertical field of view
  • Fig. 14B shows a schematic representation of the raw 360° image of Fig. 10A unwa ⁇ ed into a viewable panoramic image.
  • Fig. 15A shows a schematic representation of a raw 360° image taken with a panoramic mirror designed with a controlled vertical field of view from 40° to 140°.
  • Fig. 15B shows a schematic representation of the raw 360° image of Fig. I IA unwa ⁇ ed into a viewable panoramic image.
  • Fig 16A shows a schematic representation of a raw 360° image taken with a panoramic mirror designed with a controlled vertical field of from 10° to 140°.
  • Fig. 16B shows a schematic representation of the raw 360° image of Fig. 12A unwa ⁇ ed into a viewable panoramic image.
  • Fig. 17 shows a raw 360° image captured with a panoramic mirror with a controlled vertical field of view, where the lower vertical field of view limit is controlled to be 10° and the upper vertical field of view limit is controlled to be 140°, in accordance with an embodiment of the present invention.
  • Fig. 18 shows the raw 360° image of Fig. 17 unwa ⁇ ed into a viewable panoramic image, and illustrates that a portion of the camera mount appears in the viewable panoramic image, in accordance with an embodiment of the present invention.
  • Fig. 19 shows a flow diagram for designing a compensated equi-angular mirror with a controlled vertical field of view to reflect panoramic images with an optimal resolution.
  • Fig. 20 shows how the vertical field of view can be controlled when the desired field of view may be mostly orthogonal to the optical axis of the camera, in accordance with an embodiment of the present invention.
  • Fig. 21 illustrates a means for mounting a panoramic mirror in front of a camera, in accordance with an embodiment of the present invention.
  • Fig. 22 shows an alternate means for mounting a panoramic mirror in front of a camera, in accordance with an embodiment of the present invention.
  • Fig. 23 illustrates an alternate means for mounting a panoramic mirror in front of a camera, in accordance with an embodiment of the present invention.
  • Fig. 24 shows how a panoramic image can be cropped in order to remove unwanted portions of the panoramic image from the resulting viewable panoramic image, in accordance with an embodiment of the present invention.
  • Fig. 25 shows a viewable panoramic image captured with a compensated equi- angular mirror with a controlled vertical field of view from 10° to 140°, with an additional
  • Fig. 26 shows a schematic diagram for providing panoramic images with increased resolution in accordance with an additional embodiment of the present invention.
  • the present invention improves the usable resolution of panoramic mirrors and provides enhanced panoramic images.
  • the term "panoramic images” means wide-angle images taken from a field of view of from about 60° to 360°, typically from about 90° to 360°.
  • the panoramic visual images comprise a field of view from about 180° to 360°.
  • the field of view is up to 360° in a principal axis, which is often oriented to provide a 360° horizontal field of view.
  • a secondary axis may be defined, e.g., a vertical field of view.
  • the vertical field of view may be defined with respect to the optical axis of a camera lens, with the optical axis representing 0°.
  • Such a vertical field of view may range from 0.1° to 180°, for example, from 1° to 160°.
  • the vertical field of view is controlled in order to maximize the resolution of the portion of the panoramic image that the viewer is most interested in seeing.
  • the vertical field of view is controlled in an attempt to eliminate unwanted portions of the panoramic image from the resulting viewable panoramic image.
  • the particular controlled vertical field of view chosen may not fully eliminate unwanted portions of the panoramic image from the viewable panoramic image.
  • the controlled vertical field of view may range from about 2° to about 160°, preferably from about 5° to about 150°.
  • a particularly preferred controlled vertical field of view that provides panoramic images with improved resolution and minimal unwanted portions of the panoramic image ranges from about 10° to about 140°.
  • the terms “high-resolution” and/or “improved resolution” mean panoramic images having a viewable resolution of at least 0.3 M pixel, preferably having a viewable resolution of at least at least 0.75 M pixel. In a particular embodiment, the terms “high-resolution” and/or “improved resolution” mean panoramic images having a viewable resolution of at least 1 M pixel.
  • FIG. 1 is a schematic diagram illustrating a system 2 for combining a camera 4 with a mirror 6 for producing panoramic images.
  • the mirror 6 is mounted in front of a camera lens 8 with a suitable mounting device (not shown).
  • the mirror 6 having a central axis 10 gathers light 12 from all directions and redirects it to camera 4.
  • the mirror 6 has a symmetric shape.
  • the terms "symmetric" and “symmetrical” mean that the mirror is symmetrical about an axis of rotation.
  • the axis of rotation corresponds to the central axis of the mirror and typically corresponds to the optical axis of the camera used with the mirror.
  • An axial center 14 can be defined, which is at the intersection of the central axis 10 and the surface of the mirror 6.
  • a panoramic image is typically captured with a system, such as the system 2 of Fig. 1, by mounting the camera on a tripod or holding the camera with the camera pointing up in a vertical direction.
  • a system such as the system 2 of Fig. 1
  • the camera would normally be oriented with the camera pointing in a vertical direction towards the ceiling of the room.
  • the resulting panoramic image would show the room with the ceiling at the upper portion of the image and the floor at the lower portion of the image.
  • the terms “upper” and/or “top”, and the terms “lower” and/or “bottom” refer to a panoramic image oriented in the same way.
  • a panoramic image of a room may also be captured by orienting the camera in a vertical direction towards the floor of the room, and such an orientation is within the present scope of the invention.
  • the terms “upper” and/or “top”, and the terms “lower” and/or “bottom” would have the reverse orientation and meaning.
  • Fig. 2 shows such a raw 360° image
  • Fig. 3 shows the raw 360° image of Fig. 2 unwa ⁇ ed into a viewable panoramic image.
  • viewable panoramic image includes, for example, a panoramic image presented as a rectangular image using a projection onto a cylindrical surface, a panoramic image presented as a six sided cubic, or a panoramic image presented in an equi-rectangular form.
  • panoramic images may be presented in many other desired viewable formats that are known in the art, and these other viewable formats are within the scope of the present invention.
  • the use of such imagery has distinct advantages. It is a passive sensor, so power requirements are minimal. It has the potential to be extremely robust, since the sensor is purely solid state and has no moving parts. Furthermore, curved mirrors can be made free of optical distortion that is typically seen in lenses. In addition, the large field of view available offers substantial advantages for panoramic photography, target tracking, obstacle detection, localization, and tele-navigation of machinery.
  • the camera 4 can image a full 360 degrees in azimuth and approach 180 degrees in elevation with an appropriately shaped mirror.
  • obtaining such a large horizontal and vertical field of view comes at the cost of resolution. This is because a fixed amount of pixels are being spread over a large field of view. For example, if a 3 M pixel camera is used with a standard 30 x 40 degree camera lens, the resulting picture will have a relatively high pixel density. However, if the same 3 M pixel camera is used with a panoramic mirror to capture a panoramic image, the same amount of pixels will now be spread over an area as large as 360 x 180 degrees. In order for the system 2 of Fig.
  • a panoramic mirror must be used that produces a panoramic image with a high resolution. Furthermore, since the amount of available resolution from a panoramic mirror is limited, it is very important to ensure that only a minimal amount, if any, of this resolution is utilized on portions of the panoramic image that are of least interest to the viewer. For example, in the system 2 of Fig. 1, if a panoramic image is captured with a
  • An embodiment of the present invention provides a high-resolution panoramic mirror designed with a controlled vertical field of view.
  • controlled vertical field of view refers to a vertical field of view that is adjusted in order to minimize unwanted images from being captured by the panoramic mirror and thereby appearing in the viewable panoramic image, and to maximize the resolution of the portion of the viewable panoramic image that the user desires to see.
  • the controlled vertical field of view may range from about 2° to about 170°, preferably from about 5° to about 150°.
  • a particularly preferred controlled vertical field of view that provides panoramic images with improved resolution and minimal unwanted portions of the panoramic image ranges from about 10° to about 140°.
  • the high-resolution qualities of the mirror provide resulting high- resolution panoramic images, while the controlled vertical field of view further increases the resolution of the resulting viewable panoramic image.
  • a mirror shape is used that is,exactly equi-angular when combined with camera optics.
  • each pixel in the image spans an equal angle irrespective of its distance from the center of the image, and the shape of the mirror is modified in order to compensate for the perspective effect a camera lens adds when combined with the mirror, thereby providing improved high- resolution panoramic images.
  • Fig. 4 shows the geometry of an equi-angular mirror 6. The reflected ray 16 is magnified by a constant gain of ⁇ , irrespective of location along the vertical profile. The general form of these mirrors is given in equation (1):
  • mirrors can be produced with a high degree of curvature or a low degree of curvature, while still maintaining their equi-angular properties.
  • ⁇ ranges from about 3 to about 15, preferably from about 5 to about 12. In a particular embodiment, is chosen to be 11.
  • One advantage of these mirrors is that the resolution is unchanged when the camera is pitched or yawed.
  • the mirror may be shaped to account for the perspective effect of the lens and the algorithms must be modified.
  • Such a modified equi-angular mirror shape is defined herein as a "compensated equi-angular mirror.” It is possible to make a small angle approximation by assuming that each pixel spans an equal angle.
  • equation (2) can be used to derive the mirror shape:
  • equation (3) The advantage of using equation (2) is that the surfaces produced have a closed-form solution, whereas equation (3) must be solved numerically. However, the result of solving equation (3) numerically is that it produces a profile of the mirror that produces a truly equi- angular relation where each pixel in the image has the same vertical field of view.
  • Fig. 6 shows the difference in the mirror shapes.
  • ⁇ equal to 3
  • an equiangular mirror 6d that provides approximately equal angles for each pixel and a compensated equi-angular mirror 6e that provides truly equal angles for each pixel is shown.
  • a typical convex mirror will have a continuous surface across any diameter. Because of this constraint, a significant portion of the imaged surface area of the mirror is likely to reflect portions of a panoramic image that the viewer is least interested in seeing. The pixels in the resulting photograph that reflect such unwanted portions of the panoramic image end up not being efficiently utilized. It is desirable to minimize these unwanted portions of the panoramic image. This is especially important when resolution is at a premium, as is the case with panoramic mirrors.
  • a panoramic mirror is fabricated with a controlled vertical field of view.
  • a mirror By fabricating a mirror with such a controlled vertical field of view, less desired portions of the panoramic image can be substantially reduced or eliminated from the resulting panoramic image.
  • a compensated equi-angular mirror is most suited to be used in this embodiment. This is because the uniform distribution of resolution along any radius of the mirror provides the most effective elimination of less desired portions of the panoramic image, in addition to producing high-resolution panoramic images.
  • a convex shaped panoramic mirror such as a compensated equi-angular panoramic mirror
  • a convex shaped panoramic mirror can be fabricated into a point at the center of the mirror.
  • a two-dimensional profile of such a mirror can be depicted by removing a conical portion from the center of the two-dimensional mirror profile and constricting the resulting two- dimensional mirror profile at the center to form a point.
  • This constricted shape is illustrated in the sectional views shown in Figs. 7A and 7B.
  • a cross sectional image of the profile as shown in Fig. 7 A may be modified by "trimming" an equal amount of surface 18 on either side of the central axis 10.
  • angle A ranges from about 2° to about 45°, preferably from about 5° to about 30°. In a particular embodiment, angle A is about 10°.
  • the unwanted portion of the mirror 22 to be removed may be determined by tracing a light ray 24 as it reflects from the camera lens 8 to the mirror 6, and then from the mirror 6 at the desired angle A, corresponding to the lower limit of the controlled vertical field of view. If the light ray 24 reflects from the mirror 6 at a desired angle A, then the light ray 24 will reflect from the camera lens 8 to the mirror 6 at an angle A / ⁇ , with ⁇ being the gain of the mirror.
  • the portions of the mirror 26 that are encompassed by the angle A / ⁇ on either side of the central axis of the mirror comprise the unwanted portion 22 of the mirror to be removed.
  • an angle C can be formed, shown in Fig. 9 as 28, with respect to a first plane pe ⁇ endicular to the central axis 10 at a point of intersection between the central axis and the mirror 6.
  • This angle C is dependant upon angle A, which defines the lower limit of the controlled vertical field of view. Equation (4) shows the relationship between angle C and angle A as:
  • Angle C ranges from about 0.5° to about 20°, preferably from about 1° to about 10°, more preferably from about 2° to about 8°. In a particular embodiment, angle C is about 5°.
  • equation (5) must also be solved numerically based on various values substituted for ⁇ .
  • ⁇ is the angle that a light ray makes with the central axis as it reflects off of a point on the surface of the mirror and into the camera lens.
  • the upper limit of the controlled vertical field of view can be denoted by angle B, shown in Fig. 10.
  • angle B ranges from about 95° to about 180°, preferably from about 120° to about 170°. In a particular embodiment, angle B is about 140°.
  • an angle D can be formed, shown in Fig. 11 as 30, with respect to a second plane pe ⁇ endicular to the central axis 10 at an end of the mirror 6 opposite the point of intersection between the central axis and the mirror.
  • This angle D is dependant upon angle A, which defines the lower limit of the controlled vertical field of view, and angle B, which defines the upper limit of the controlled vertical field of view.
  • Equation (6) shows the relationship between angle D, angle A, and angle B as:
  • Angle D ranges from about 50° to about 100°, preferably from about 65° to about 90°, more preferably from about 70° to about 85°. In a particular embodiment, angle D is about 76°.
  • a panoramic mirror with a controlled vertical field of view may be formed by generating a two-dimensional profile of such a mirror with the selected angle A, as depicted in Fig. 7B, choosing an appropriate value for B, a shown in Fig. 10, and then rotating the resulting two-dimensional profile around the axis of rotation to form a surface of revolution.
  • A is chosen to be 10°
  • B is chosen to be 140°
  • ⁇ is chosen to be 11.
  • the primary concern is providing a high-resolution viewable panoramic image, not eliminating central obscurations from the viewable panoramic image.
  • Fig. 12 shows a cross-sectional view of the resulting mirror shape.
  • the panoramic mirror comprises a substrate 32 made of PYREX glass coated with a reflective surface 34 made of aluminum, and with a silicon protective coating 36.
  • the smoothness of the mirror is 1/4 of the wavelength of visible light.
  • angle A defines half of the conical portion to be removed from the convex reflective mirror.
  • Angle A also corresponds to the lower limit desired for the controlled vertical field of view.
  • angle B corresponds to the upper limit desired for the controlled vertical field of view.
  • angle A is chosen so as to eliminate the entire lower portion of the viewable panoramic image that the viewer is not interested in seeing, and angle B would be chosen so as to eliminate the entire upper portion of the viewable panoramic image that the viewer is not interested in seeing. For example, if a viewer is not interested in viewing any portion of the viewable panoramic image below 40°, then it may be ideal to remove a 40° piece of the mirror from either side of the central axis.
  • the upper limit of the controlled vertical field of view may be 140°. This could direct the maximum amount of available resolution to the portion of the viewable panoramic image that the viewer is interested in viewing. Although this might be considered the ideal situation, there are other resolution constraints that should be considered when designing a panoramic mirror with a controlled vertical field of view.
  • This concept may be illustrated by considering the extreme cases: the situation where a panoramic mirror is designed without a controlled vertical field of view at all; and the situation where a panoramic mirror is designed with a controlled vertical field of view that completely eliminates all of the unwanted portions of the panoramic image from the resulting panoramic image.
  • Fig. 13A shows a schematic representation of a raw 360° image
  • Fig. 13B shows a schematic representation of a raw 360° image unwa ⁇ ed into a viewable panoramic image.
  • the viewable panoramic image has a fixed available resolution of
  • 360° image with a, b, c, and d in the unwa ⁇ ed viewable panoramic image it can be seen that when the raw 360° image is unwa ⁇ ed, points a and b in the raw 360° image get stretched to form the bottom of the viewable panoramic image, and points c and d in the raw 360° image get compressed to from the top of the viewable panoramic image.
  • pixels can be defined and represented in several ways.
  • the term "horizontal pixel circumference" is used to define the number of pixels that lie on the circumference of an imaginary circle drawn at any given point in the raw 360° image.
  • the horizontal pixel circumference is small on a circle 38 drawn closer to the center of the raw 360° image, and that the horizontal pixel circumference is largest on a circle 40 corresponding to the outer edge of the raw 360° image.
  • the horizontal pixel circumference in the raw 360° image corresponds to the horizontal resolution in the viewable panoramic image.
  • a circle with a given horizontal pixel circumference will correspond to a particular horizontal line in the viewable panoramic image.
  • Circles drawn near the center of the raw 360° image will correspond to horizontal lines towards the bottom of the viewable panoramic image, and circles drawn towards the outer edge of the raw 360° image will correspond to horizontal lines drawn towards the top of the viewable panoramic image.
  • the horizontal pixel circumference will be small on circles drawn towards the center of the raw 360° image, and portions of the raw 360° image towards the center of the raw 360° image will be stretched horizontally when the raw 360° image is unwa ⁇ ed. Therefore, for example, if the horizontal pixel circumference of circle 38 drawn near the center of the raw 360° image is 500 pixels, these 500 pixels must be stretched to fill the space of 2,000 pixels when the raw 360° image is unwa ⁇ ed. Therefore the horizontal resolution of the viewable panoramic image at 42, corresponding to circle 38, will have a resolution of 500 pixels stretched to fill the space of 2,000 pixels.
  • 360° image is unwa ⁇ ed. Therefore, for example, if the very outer circumference 40 of the raw 360° image has a horizontal pixel circumference of 2,500 pixels, these 2,500 pixels will be compressed horizontally to fill the space of 2,000 pixels when the raw 360° image is unwa ⁇ ed. Therefore the horizontal resolution of the viewable panoramic image at 44, corresponding to circle 40, will have a resolution of 2,500 pixels compressed to fill the space of 2,000 pixels.
  • portions of the viewable panoramic image towards the bottom of viewable panoramic image will have poor horizontal resolution, while portions of the viewable panoramic image towards the top of the viewable panoramic image will have significantly better horizontal resolution.
  • the horizontal resolution of the viewable panoramic image improves as one moves from the bottom of the viewable panoramic image towards the top of the viewable panoramic image.
  • An example of an extreme case is the point at the very center of the raw 360° image. This point corresponds to a horizontal pixel circumference of 1, meaning that this 1 pixel will be stretched to fill the space of 2,000 pixels at the very bottom of the viewable panoramic image.
  • the term "vertical pixel radius" is used to define the number of pixels that lie on an imaginary straight line anywhere on the raw 360° image, of any length, drawn pe ⁇ endicular to the outer edge of the raw 360° image.
  • An example of a line 46 with a particular vertical pixel radius is shown in Fig. 13A.
  • the vertical pixel radius of line 46 is 600 pixels.
  • the imaginary line drawn with the vertical pixel radius does not shrink or expand as the raw 360° image is unwa ⁇ ed into a viewable panoramic image.
  • the vertical pixel radius of 600 pixels will fill 600 of the available 800 pixels in the vertical direction of the viewable panoramic image, as shown in 48, and there will be a constant vertical resolution across the entire viewable panoramic image.
  • Fig. 14A shows a schematic representation of a raw 360° panoramic image captured with a panoramic mirror designed without a controlled vertical field of view
  • Fig. 14B shows a schematic representation of this raw 360° image unwa ⁇ ed into a viewable panoramic image.
  • the viewable panoramic image has a fixed available resolution of 2,000 pixels by 800 pixels, as shown in Fig. 14B.
  • This desired vertical field of view is marked as 50 in Fig. 14A.
  • the horizontal pixel circumference 52 at the 40° mark is
  • the horizontal pixel circumference 52 of 700 pixels will be stretched to fill the space of 2,000 pixels in the viewable panoramic image, shown at 58, and the horizontal pixel circumference 54 of 2,100 pixels will be compressed to fill the space of
  • 500 pixels will translate to the part of the viewable panoramic image that the viewer is interested in looking at, and will occupy 500 of the available 800 pixels in the vertical direction, shown at 62.
  • the bottom of the viewable panoramic image appears to be a problematic area.
  • the bottom of the portion of the viewable panoramic image that the viewer is interested in has a horizontal pixel circumference of 700 pixels spread out over a 2,000 pixel area, which in theory is not a very good horizontal resolution.
  • the area below the bottom of the portion of the viewable panoramic image that the user is interested in i.e., the area from 0° to 40°, suffers from an even poorer horizontal resolution, with the horizontal resolution at the 0° mark being 1 pixel spread out over the area of 2,000 pixels.
  • unwanted images usually lie at the bottom of the viewable panoramic image such as the camera, the camera lens, the mount holding the mirror in front of the camera, and other unwanted foreground images.
  • portions of the panoramic image that appear within the viewable panoramic image at the 40° mark suffer from a poorer horizontal resolution, and these may be portions of the viewable panoramic image that the viewer is interested in seeing, these portions of the resulting panoramic image are usually relatively close to the camera lens, which greatly decreases the effect that the poorer horizontal resolution has towards the bottom of the viewable panoramic image.
  • Fig. 15A shows a schematic representation of a raw 360° panoramic image taken with a panoramic mirror designed with a controlled vertical field of view from 40° to 140°
  • Fig. 15B shows a schematic representation of this raw 360° image unwa ⁇ ed into a viewable panoramic image.
  • the viewable panoramic image has a fixed available resolution of 2,000 pixels by 800 pixels, as shown in Fig. 15B.
  • the vertical pixel radius 64 is 800 pixels.
  • the horizontal pixel circumference 68 at the outer edge of the raw 360° image i.e., the 140° mark
  • the horizontal pixel circumference of 2,500 pixels will be compressed to an available horizontal resolution of 2,000 pixels, thereby giving the top of the portion of the viewable panoramic image the viewer is interested in a maximum horizontal resolution, as shown in 70. In this case, however, a problem arises at the bottom of the viewable panoramic image.
  • the panoramic mirror was designed with a controlled field of view which reflects a panoramic image starting only at 40° in the vertical direction, this 40° mark occurs at the tip of the panoramic mirror, which corresponds to the point 72 at the center of the raw 360° image shown in Fig. 15 A. Therefore, the horizontal pixel circumference 64 at the 40° mark is equal to 1 pixel, and this single pixel must be spread out over the space of the 2,000 available pixels when the raw 360° image is unwa ⁇ ed into a viewable panoramic image, as shown in 74. This is a portion of the panoramic image that the viewer is interested in seeing, but this portion of the viewable panoramic image will appear as a single line of a solid color because of the poor horizontal resolution and the fact that 1 pixel is being stretched into the space of 2,000 pixels.
  • This compromise may be achieved by balancing the vertical pixel radius, the horizontal pixel circumference at the upper limit of the desired vertical field of view, i.e. the upper limit of the portion of the viewable panoramic image that the viewer is interested in viewing, and the horizontal pixel circumference at the lower limit of the desired vertical field of view, i.e. the lower limit of the portion of the viewable panoramic image that the viewer is interested in viewing.
  • Fig. 16A and Fig. 16B depict such a compromise.
  • a panoramic mirror with a controlled vertical field of view is used with a lower vertical field of view limit of 10° and an upper vertical field of view limit of 140°.
  • Fig. 16A shows a schematic representation of a raw 360° image captured with such a panoramic mirror
  • Fig. 16B shows a schematic representation of this raw 360° image unwa ⁇ ed into a viewable panoramic image.
  • the vertical pixel radius 76 of the portion of the panoramic image the viewer is interested in seeing is 700 pixels.
  • this vertical pixel radius of 700 pixels translates to fill 700 of the 800 available vertical pixels in the viewable panoramic image, as shown at 78 in Fig. 16B. This represents only a loss of 100 pixels in the vertical direction.
  • the horizontal pixel circumference at the outer edge 80 of the raw 360° image i.e., at 140°
  • these 2,500 pixels get compressed at the top of the viewable panoramic image into the available 2,000 pixels, as shown at 82 in Fig. 16B.
  • the horizontal pixel circumference 84 at the 40° mark is
  • the vertical field of view of the viewable panoramic image that the viewer wishes to see is 40° to 140°
  • the controlled vertical field of view of the viewable panoramic image is 10° to 140°.
  • the term "desired vertical field of view” means the vertical field of view corresponding to the portion of the viewable panoramic image that the viewer is interested in viewing.
  • the desired vertical field of view may be equal to or less than the controlled vertical field of view.
  • the desired vertical field of view may range from about 2° to about 170°, preferably from about 15° to about 150°.
  • a particularly preferred desired vertical field of view that a viewer would typically be interested in viewing ranges from about 40° to about 140°.
  • Fig. 17 shows a raw 360° image captured with a panoramic mirror with a controlled vertical field of view, where the lower controlled vertical field of view limit is controlled to be 10° and the upper controlled vertical field of view limit is controlled to be 140°.
  • Fig. 18 shows this raw 360° image unwa ⁇ ed into a viewable panoramic image.
  • Fig. 18 shows that the viewable panoramic image has a high-quality resolution that appears constant throughout the image in the horizontal and vertical directions. However, Fig. 18 also shows that some unwanted portions of the panoramic image still appear in the viewable panoramic image, such as a portion of the mirror mount 88.
  • an optimum controlled vertical field of view was chosen by considering the vertical field of view that would be required for a particular application, and the resolution that would be required for that application.
  • a compensated equi-angular mirror was formed with an upper controlled vertical field of view limit of about 120° and a lower controlled vertical field of view limit of 0°. Low alpha values of 3, and then 5, were chosen, and the mirror was placed at about 30 cm from the camera lens. In this example, the resulting resolution of the portion of the viewable panoramic image that was interesting was acceptable, but a large portion of the viewable panoramic image was lost when the raw 360° image was formatted so that it would fill the entire frame of the viewable panoramic image.
  • a compensated equi-angular mirror was formed with an upper controlled vertical field of view limit of about 160° and a lower controlled vertical field of view limit of about 10°. An alpha value of 7 was chosen, and the mirror was placed at about 6 cm from the camera lens. In this example, the resulting resolution of the portion of the viewable panoramic image that was interesting was poor.
  • a compensated equi-angular mirror was formed with an upper controlled vertical field of view limit of about 140° and a lower controlled vertical field of view limit of about 10°.
  • An alpha value of 11 was chosen, and the mirror was placed at about 11 cm from the camera lens.
  • the resulting resolution of the portion of the viewable panoramic image that was interesting was good for most objects that a viewer would most ordinarily be interested in, and almost the entire image from the mirror filled the frame of the viewable panoramic image.
  • Fig. 19 shows a method for designing a compensated equi-angular mirror with a controlled vertical field of view to reflect panoramic images with an optimal resolution.
  • an initial assumption is made that a compensated equiangular mirror with a particular controlled vertical field of view is being used.
  • step 1 shown in box 90, particular values are chosen for the lower limit of the desired vertical field of view, A', and the upper limit of the desired vertical field of view, B'.
  • step 2 shown in box 92, candidate values are chosen for the lower limit of the controlled vertical field of view, A, and the upper limit of the controlled vertical field of view, B, and the value is supplied for the vertical pixel radius VP r between A and B.
  • Step 3 shown in box 94, the vertical resolution VR of the viewable panoramic image within the desired vertical field of view is calculated in pixels per degree, which remains constant throughout the image, the horizontal resolution at the upper limit of the desired vertical field of view HR upper is calculated in pixels per degree, and the horizontal resolution at the lower limit of the desired vertical field of view HR
  • Step 4 shown in box 96, the values obtained for the horizontal and vertical resolution for the desired vertical field of view are examined. If the values are satisfactory, Step 5 may be performed, as indicated at box 100. If the values are not satisfactory, then Step 2 is repeated and different values are chosen for the lower limit of the controlled vertical field of view, A, and the upper limit of the controlled vertical field of view, B, and the value of the vertical pixel radius VP r between A and B.
  • the step shown in box 98 may be performed once satisfactory values have been obtained for the vertical and horizontal resolution, so that these values may be checked to determine if the resulting pixel size is satisfactory for the particular object that the viewer desires to see. For example, if the viewer is interested in viewing a human face, the pixel size would need to be small enough to show, at least in some detail, objects such as the eyes of the face.
  • the distance that the camera is placed from the ground and the distance that the object of interest is located from the panoramic mirror are parameters that can be used to determine the pixel size.
  • Step 5 ensures that the image of the camera will not obscure the resulting viewable panoramic image within the desired vertical field of view.
  • a value is supplied for the distance the panoramic mirror is placed from the camera, r Camera . and a value is supplied for the distance from the axis of the camera to the furthest edge of the camera, dcamera-
  • the relationship shown in box 100 is evaluated, and r ca m-ra is adjusted until the image of the camera does not obscure the resulting viewable panoramic image within the desired vertical field of view.
  • Step 6 ensures that the image of the mirror mount will not obscure the resulting viewable panoramic image within the desired vertical field of view.
  • a value is supplied for the distance the panoramic mirror is placed from the widest portion of the mirror mount, r mount . and a value is supplied for the distance from the axis of the camera to the edge of the widest portion of the mirror mount, d m ⁇ unt.
  • the relationship shown in box 102 is evaluated, and r mount is adjusted until the image of the mirror mount does not obscure the resulting viewable panoramic image within the desired vertical field of view.
  • the resulting horizontal and vertical resolution of the viewable panoramic image within the desired vertical field of view would be greater if a compensated equi-angular mirror is used and the resulting horizontal and vertical resolution of the viewable panoramic image within the desired vertical field of view would be less if a compensated equi-angular mirror is not used
  • the resulting horizontal and vertical resolution of the viewable panoramic image within the desired vertical field of view would be greater if a controlled vertical field of view is used and the resulting horizontal and vertical resolution of the viewable panoramic image within the desired vertical field of view would be less if a controlled vertical field of view is not used
  • a compensated equi-angular mirror with a desired vertical field of view having a lower limit A' of about 40° and an upper limit B' of about 140° is designed with a controlled vertical field of view having an angle A equal to about 10 ° and an angle B equal to about 140°, a VP r of about 1,000 pixels, and an ⁇ equal to about 11.
  • the mirror is placed at a distance r camera from the camera of about 12 cm, and is placed on a mounting device with a d mount of about 4.25 cm.
  • the mirror is placed at a distance r mount from the widest portion of the mirror mount of about 4.7 cm.
  • the mirror is mounted in front of a camera sold under the designation NIKON 990 by NIKON, or a camera sold under the designation NIKON 995 by
  • NIKON with a dc amera of about 10.2 cm.
  • a unique mirror shape is produced with an angle C of about 5° and an angle D of about 76°.
  • This unique mirror shape reflects panoramic images with a resolution unparalleled in the prior art. This superior resolution is obtained from a combination of the compensated equi-angular properties of the panoramic mirror, and the fact that the resolution has been further optimized by controlling the appropriate vertical field of view for the mirror.
  • the primary concern is providing a high-resolution viewable panoramic image, not eliminating central obscurations from the viewable panoramic image.
  • an embodiment of the present invention provides a controlled vertical field of view from about 10° to about 140°, which in turn provides a viewer with a high resolution viewable panoramic image
  • the desired vertical field of view may be mostly orthogonal to the optical axis of the camera. This may be a situation when an object of interest is far away from the mirror and is close to the horizon. In this situation, a larger value will be chosen for angle A and a smaller value will be chosen for angle B, thereby increasing the size of the portion to be removed from the panoramic mirror and lowering the upper limit of the controlled vertical field of view, respectively. This in turn will focus the desired vertical field of view to the sides of the mirror.
  • angle A may be chosen to be about 45°, shown in Fig. 20 as 104
  • angle B may be chosen to be about 100°, as shown in Fig. 20 as 106. This will focus the resulting desired vertical field of view 108 on the object 110 that is off in the distance as shown in Fig. 20.
  • a compensated equi-angular mirror with a controlled vertical field of view is manufactured with a hole centered at the axial center of the mirror in order to accommodate various mounting devices.
  • the mounting hole may range in diameter from about 0.05 cm to about 15 cm, preferably from about 0.1 cm to about 5 cm. In a particular embodiment the mounting hole is 0.64 cm in diameter.
  • a panoramic mirror with a profile substantially described by equation (4) can be fitted with a rod 112 to accommodate mounting the mirror 6 in front of a camera (not shown).
  • the shape of the rod may be substantially cylindrical.
  • the mirror 6 can be produced with a hole 114 at the axial center of the mirror in order to accommodate the rod 112.
  • the mounting hole may range in diameter from about 0.05 cm to about 15 cm, preferably from about 0.1 cm to about 5 cm In a particular embodiment the mounting hole is 0.64 cm in diameter.
  • the rod 112 may range in diameter D R from about 0.05 cm to about 15 cm, preferably from about 0.1 cm to about 5 cm.
  • the rod is 0.64 cm in diameter.
  • the rod 112 may be of various lengths, depending on the values chosen for r camera , dcamer a , rmount, d m ⁇ u nt, and A'.
  • the rod 112 may range in length from about 3 cm to about 12 cm, preferably from about 4 cm to about 11 cm. In a particular embodiment the rod is about 10.8 cm in length.
  • the diameter D M of the mirror 6 may range from about 0.3 cm to about 60 cm, preferably from about 0.5 cm to about 20 cm. In a particular embodiment the diameter of the mirror is 7.94 cm in diameter.
  • a ratio of the diameter of the rod 112 to the diameter of the mirror 6 may be defined as D R :D M - D R :D M may range from about 1:4, preferably from about 1:5.
  • D R :D M is 1:12.5.
  • an angle E 116 may be formed with respect to a first plane pe ⁇ endicular to the central axis of the mirror at a point of intersection between the rod and the mirror. Angle E is dependant upon angle A, which defines the lower limit of the controlled vertical field of view. Equation (7) shows the relationship between angle E and angle A as:
  • ⁇ R is the radius of the rod.
  • Angle E ranges from about 5° to about 30°, preferably from about 10° to about 20°, more preferably from about 12° to about 16°. In a particular embodiment, angle E is about 14°.
  • a compensated equi-angular mirror with a controlled vertical field of view can be mounted in front of a camera as schematically illustrated in Fig. 22.
  • This mounting device comprises a primary stage 118 which attaches directly to a camera (not shown), and a secondary stage 120 which is affixed to the primary stage and supports the mirror 6 in front of a camera.
  • the primary stage 118 comprises a first disc 122 and a second disc 124 with a first vertical member 126, a second vertical member 128 and a third vertical member 130 placed between the two discs as shown in Fig. 22.
  • the first disc 122 and the second disc 124 may range in diameter from about 3 cm to about 12 cm, preferably from about 5 cm to about 12 cm.
  • the diameter of the first disc or the second disc may be about 8 cm.
  • the length of the first, second and third vertical members may range in length from about 1 cm to about 8 cm, preferably from about 2 cm to about 7 cm.
  • the first vertical member, second vertical member and third vertical member is each about 5.9 cm in length.
  • the length of the primary stage may range in length from about 1 cm to about 8 cm, preferably from about 2 cm to about 7 cm.
  • the primary stage is about 6.5 cm in length.
  • the second stage 120 may comprise a rod 132 with one end of the rod attached to the second disc 124 of the first stage 118 and the other end of the rod supporting the mirror 6 in front of a camera.
  • the shape of the rod may be substantially cylindrical.
  • the mirror 6 may be produced with a hole 114 at the axial center of the mirror in order to accommodate the rod.
  • the mounting hole may range in diameter from about 0.05 cm to about 15 cm, preferably from about 0.15 cm to about 5 cm. In a particular embodiment the mounting hole is 0.64 cm in diameter.
  • the rod 132 may range, along the length thereof, in diameter D R from about 0.05 cm to about 15 cm, preferably from about 0.15 cm to about 5 cm. In a particular embodiment the rod is 0.64 cm in diameter.
  • the rod 132 may be of various lengths, depending on the values chosen for r cam era. dcamera, r m0 unt, d moun t, and A'.
  • the rod may range in length from about 2 cm to about 6 cm, preferably from about 3 cm to about 5 cm. In a particular embodiment the rod is about 4.3 cm in length.
  • the D M of the mirror may range from about 0.3 cm to about 60 cm, preferably from about 0.6 cm. to about 20 cm.
  • the diameter of the mirror is 7.94 cm. in diameter.
  • a ratio of the diameter of the rod to the diameter of the mirror may be defined as D R : D M.
  • D R: D M may range from about 1:4, preferably from about 1:5.
  • an angle E 116 may be formed with respect to a first plane pe ⁇ endicular to the central axis of the mirror at a point of intersection between the rod and the mirror.
  • Angle E is dependant upon angle A, which defines the lower limit of the controlled vertical field of view. Equation (7), above, shows the relationship between angle E and angle A.
  • Angle E ranges from about 5° to about 30°, preferably from about 10° to about 20°, more preferably from about 12° to about 16°. In a particular embodiment, angle E is about 14°.
  • a compensated equi-angular mirror 6 with a controlled vertical field of view may be mounted in front of a camera 4 by using a cylinder 134 that attaches to a standard camera lens mount 136.
  • the diameter D CYL of the cylinder 134 may range from about 0.3 cm to about 60 cm, preferably from about 0.6 cm to about 20 cm. In a particular embodiment the diameter of the cylinder is about 8.5 cm.
  • the thickness of the cylinder 146 may range from about 0.2 cm to about 0.4 cm, preferably from about 0.25 cm to about 0.35 cm. In a particular embodiment the thickness of the cylinder is about 0.32 cm.
  • the cylinder 134 may be of various lengths, depending on the values chosen for ⁇ C ⁇ men , dcamera, ⁇ * mount, d mou nt, and A'. In one embodiment, the cylinder 134 may range in length from about 3 cm to about 12 cm, preferably from about 4 cm to about 11 cm. In a particular embodiment the cylinder is about 10.8 cm in length. In this embodiment, the diameter D M of the mirror 6 may range from about 0.3 cm to about 60 cm, preferably from about 0.6 cm. to about 20 cm. In a particular embodiment the diameter of the mirror is about 7.86 cm. In one embodiment, a rod or needle 138 may be attached to the axial center of the panoramic mirror and may extend downward into the cylinder.
  • the rod or needle serves to reduce reflections in the mirror that may be caused by the cylinder.
  • the rod or needle may be substantially cylindrical in shape.
  • the length of the rod or needle 138 may range from about 5 cm to about 10 cm, preferably from about 6 cm to about 9 cm. In a particular embodiment the length of the rod or needle is about 8 cm.
  • the rod or needle 138 may range in diameter from about 0.05 cm to about 15 cm, preferably from about 0.15 cm to about 5 cm. In a particular embodiment the rod or needle is 0.64 cm in diameter.
  • an angle E 116 may be formed with respect to a first plane pe ⁇ endicular to the central axis of the mirror at a point of intersection between the rod or needle and the mirror.
  • Angle E is dependant upon angle A, which defines the lower limit of the controlled vertical field of view. Equation (7), above, shows the relationship between angle E and angle A. Angle E ranges from about 5° to about 30°, preferably from about 10° to about 20°, more preferably from about 12° to about 16°. In a particular embodiment, angle E is about 14°.
  • a compensated equi-angular mirror with a desired vertical field of view having a lower limit A' of about 40° and an upper limit B' of about 140° is designed with a controlled vertical field of view having an angle A equal to about 10 ° and an angle B equal to about 140°, a VP r of about 1,000 pixels, an ⁇ equal to about 11, and a diameter D M of about 8 cm.
  • the mirror is placed at a distance r camera from the camera of about 12 cm, and is placed on a mounting device with a d moun t of about 4.25 cm.
  • the mirror is placed at a distance r m0u nt from the widest portion of the mirror mount of about 4.7 cm.
  • the mirror is mounted in front of a camera sold under the designation NIKON 990 by NIKON, or a camera sold under the designation NIKON 995 by NIKON, with a d camera of about 10.2 cm.
  • the mirror is mounted on a rod that is about 0.64 cm thick.
  • a unique mirror shape is produced with an angle E of about 14° and an angle D of about 76°.
  • the primary concern is providing a high-resolution viewable panoramic image, not eliminating central obscurations from the viewable panoramic image.
  • the particular parameters chosen provide a system that reflects panoramic images with a resolution unparalleled in the prior art.
  • the panoramic mirror has been designed to produce panoramic images with an optimal resolution
  • the design does not eliminate all unwanted portions of the panoramic image from the viewable panoramic image.
  • a lower controlled vertical field of view limit to be 10°
  • portions of the camera, the camera lens, the mount supporting the mirror in front of the camera and/or other unwanted foreground images will appear towards the bottom of the resulting viewable panoramic image.
  • These obstructions do not appear in the desired vertical field of view, but they are still undesirable to have in the resulting viewable panoramic image. Therefore, the resulting viewable panoramic image can be further enhanced by cropping the viewable panoramic image (i.e., masking, covering, or discarding certain portions of the viewable panoramic image) so that any unwanted portions of the panoramic image are fully eliminated from the viewable panoramic image.
  • computer software is used to crop an additional amount of the panoramic image from the bottom of the viewable panoramic image. This amount to crop may range from about an additional 0° to about an additional 40°, preferably from about an additional 15° to an additional 35°. In a particular embodiment the computer software is used to crop an additional 30° from the bottom of the viewable panoramic image.
  • computer software may be used to crop any unwanted portions of the panoramic image from the top of the resulting viewable panoramic image.
  • the computer software may be used to crop an additional 0° to an additional 10° from the top of the viewable panoramic image, preferably an additional 1° to an additional 5° from the top of the viewable panoramic image.
  • the computer software may be used to crop an additional 0° from the top of the viewable panoramic image.
  • Fig. 24 shows a viewable panoramic image captured with a compensated equiangular mirror with a controlled vertical field of view from 10° to 140°, and illustrates the additional top portion 140 of the viewable panoramic image that may be cropped with the computer software, and the additional bottom portion 142 of the viewable panoramic image that may be cropped with the computer software.
  • Fig. 25 shows a viewable panoramic image captured with a compensated equi- angular mirror with a controlled vertical field of view from 10° to 140°, with an additional
  • the resulting viewable panoramic image may be further enhanced by allowing the viewer to change the viewing perspective of the resulting panoramic image.
  • the viewing perspective is altered by allowing the user to "look" up and concentrate on the top portion of the resulting viewable panoramic image, to "look” down and concentrate more on the bottom portion of the resulting viewable panoramic image, to pan around the entire 360° horizontal field of view of the resulting viewable panoramic image, and/or to "zoom" in or out on portions of the resulting viewable panoramic image.
  • computer software is used to allow the viewer to alter the viewing perspective of the resulting viewable panoramic image. The viewer may use a mouse, a keyboard, a track ball or any other computer input device to facilitate altering the viewing perspective of the viewable panoramic image.
  • the viewer may use a head tracker coupled with a head mounted device to facilitate altering the viewing perspective of the viewable panoramic image.
  • the user is given the sense that he or she is standing in the center of the scene that was captured with the panoramic camera.
  • panoramic mirrors may be used in a panoramic imaging system in order to provide panoramic images with improved resolution.
  • the panoramic mirrors may be designed and manufactured to have controlled vertical fields of view.
  • these mirrors may be equi-angular shaped, compensated equi-angular shaped, parabolic shaped, hyperbolic shaped, spherical, or any other convex shaped mirror.
  • the multiple mirrors may be any combination of these shapes.
  • multiple cameras may be used in a panoramic imaging system in order to improve the usable resolution with panoramic mirrors. These multiple cameras may be used singularly or in combination with one or more convex shaped panoramic mirrors with or without controlled vertical fields of view.
  • a camera can be used with a rectangular sensing area. It is possible to 'zoom in' further to the mirror surface, which will allow the mirror image to occupy a larger proportion of the image. This comes at the cost of cropping part of the image surface.
  • the field of view that has been lost by framing in this manner can be recovered using a second image that overlaps the first image in certain areas. This can be accomplished by using a two camera, two mirror system whose mirrors are positioned back-to-back and whose cameras are oriented 90° off-axis from one another.
  • FIG. 26 A schematic diagram of this embodiment is shown in Fig. 26.
  • Mirror 6f is placed back-to-back with mirror 6g, and camera 4a is oriented 90° off-axis from camera 4b.
  • the vertical field of view for each mirror can be controlled by picking Angle A and angle B to give each panoramic mirror the best resolution. Additionally, the upper limit of the vertical field of view for mirror 6f will overlap with the upper limit of the vertical field of view for mirror 6g. These overlapping areas are marked in Fig. 26 as 144. The result is that the missing pieces of the viewable panoramic image from mirror 6f and camera 4a can be supplied by mirror 6g and camera 4b, and vice versa.
  • the present invention has been primarily described for use in a panoramic imaging system, such as the system of Fig. 1, it is to be understood that the apparatus and method of the present invention can be used in any other system that would benefit from the advantages disclosed herein and is within the scope of the present invention.
  • panoramic mirrors may be designed with a controlled vertical field of view, thereby increasing the resolution of the resulting viewable panoramic images and are within the scope of the present invention.
  • examples may include, but are not limited to, a spherical panoramic mirror, a parabolic panoramic mirror, a hyperbolic panoramic mirror and a non-compensated equi-angular mirror.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Stereoscopic And Panoramic Photography (AREA)
  • Studio Devices (AREA)

Abstract

L'invention a trait à la production d'images panoramiques améliorées au moyen d'un miroir panoramique amélioré. L'invention concerne également un miroir panoramique à champ de vision vertical régulé. Ce champ de vision vertical régulé améliore la résolution d'une vue panoramique par élimination des parties d'images non désirables de cette vue panoramique.
PCT/US2002/005454 2001-02-24 2002-02-22 Miroir panoramique ameliore et systeme de production d'images panoramiques ameliorees WO2002069035A2 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CA002439296A CA2439296A1 (fr) 2001-02-24 2002-02-22 Miroir panoramique ameliore et systeme de production d'images panoramiques ameliorees
AU2002244132A AU2002244132A1 (en) 2001-02-24 2002-02-22 Panoramic mirror and system for producing panoramic images

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US27115401P 2001-02-24 2001-02-24
US60/271,154 2001-02-24

Publications (2)

Publication Number Publication Date
WO2002069035A2 true WO2002069035A2 (fr) 2002-09-06
WO2002069035A3 WO2002069035A3 (fr) 2003-07-31

Family

ID=23034416

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2002/005454 WO2002069035A2 (fr) 2001-02-24 2002-02-22 Miroir panoramique ameliore et systeme de production d'images panoramiques ameliorees

Country Status (3)

Country Link
AU (1) AU2002244132A1 (fr)
CA (1) CA2439296A1 (fr)
WO (1) WO2002069035A2 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006119287A (ja) * 2004-10-20 2006-05-11 D Link Corp 全方位撮影用アタッチメント
GB2456334A (en) * 2008-01-11 2009-07-15 Panascopics Ltd Panoramic optical assembly comprising detachable mirror and storage housing

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5760826A (en) * 1996-05-10 1998-06-02 The Trustees Of Columbia University Omnidirectional imaging apparatus
US5790181A (en) * 1993-08-25 1998-08-04 Australian National University Panoramic surveillance system
US6157018A (en) * 1997-12-13 2000-12-05 Ishiguro; Hiroshi Omni directional vision photograph device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5790181A (en) * 1993-08-25 1998-08-04 Australian National University Panoramic surveillance system
US5760826A (en) * 1996-05-10 1998-06-02 The Trustees Of Columbia University Omnidirectional imaging apparatus
US6157018A (en) * 1997-12-13 2000-12-05 Ishiguro; Hiroshi Omni directional vision photograph device

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006119287A (ja) * 2004-10-20 2006-05-11 D Link Corp 全方位撮影用アタッチメント
GB2456334A (en) * 2008-01-11 2009-07-15 Panascopics Ltd Panoramic optical assembly comprising detachable mirror and storage housing
GB2456334B (en) * 2008-01-11 2012-08-15 Atreides Ltd Panoramic optical assembly

Also Published As

Publication number Publication date
WO2002069035A3 (fr) 2003-07-31
AU2002244132A1 (en) 2002-09-12
CA2439296A1 (fr) 2002-09-06

Similar Documents

Publication Publication Date Title
US6856472B2 (en) Panoramic mirror and system for producing enhanced panoramic images
US6594448B2 (en) Radially-oriented planar surfaces for flare reduction in panoramic cameras
KR100599423B1 (ko) 전방향성 이미징 장치
US7123777B2 (en) System and method for panoramic imaging
JP3485261B2 (ja) 半球状視野の電子結像及び処理のためのシステム及び方法
EP0897636B1 (fr) Appareil de prise d'image omnidirectionnel
TW528924B (en) Panorama image acquisition system, magnifying device for the panorama distorted image capture system, and the alignment device containing four fixed reflective surfaces
US20030095338A1 (en) System and method for panoramic imaging
US20050013022A1 (en) Apparatus for mounting a panoramic mirror
EP1133868A1 (fr) Camera de poursuite
US20050117227A1 (en) Panoramic imaging system with optical zoom capability
EP2040463A2 (fr) Système d'augmentation de champ de vue horizontal d'une caméra
CN108282632A (zh) 全景视频监控装置及基于该装置的成像方法
WO2002069035A2 (fr) Miroir panoramique ameliore et systeme de production d'images panoramiques ameliorees
US6963355B2 (en) Method and apparatus for eliminating unwanted mirror support images from photographic images
JP2006011103A (ja) 球面ミラー撮像装置
CA2324802C (fr) Appareillage et methode d'imagerie panoramique
WO2000042470A1 (fr) Imagerie panoramique invariante en resolution
CN210803962U (zh) 全景环形成像光学系统
Hicks The page of catadioptric sensor design
JP2002262157A (ja) 多重焦点全方位撮像装置
JP2002354302A (ja) 撮像装置及び撮像システム
MXPA00005531A (en) An omnidirectional imaging apparatus

Legal Events

Date Code Title Description
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
WWE Wipo information: entry into national phase

Ref document number: 2439296

Country of ref document: CA

121 Ep: the epo has been informed by wipo that ep was designated in this application
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP