CA2324802C - Panoramic imaging apparatus and method - Google Patents
Panoramic imaging apparatus and method Download PDFInfo
- Publication number
- CA2324802C CA2324802C CA 2324802 CA2324802A CA2324802C CA 2324802 C CA2324802 C CA 2324802C CA 2324802 CA2324802 CA 2324802 CA 2324802 A CA2324802 A CA 2324802A CA 2324802 C CA2324802 C CA 2324802C
- Authority
- CA
- Canada
- Prior art keywords
- mirror
- scene
- panoramic
- conical frustum
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 28
- 238000000034 method Methods 0.000 title claims abstract description 26
- 230000002093 peripheral effect Effects 0.000 claims abstract description 19
- 238000012545 processing Methods 0.000 claims abstract description 8
- 230000003287 optical effect Effects 0.000 claims description 28
- 230000007246 mechanism Effects 0.000 claims description 10
- 230000000295 complement effect Effects 0.000 abstract description 3
- 229910044991 metal oxide Inorganic materials 0.000 abstract description 3
- 150000004706 metal oxides Chemical class 0.000 abstract description 3
- 239000004065 semiconductor Substances 0.000 abstract description 3
- 230000008901 benefit Effects 0.000 description 9
- 238000004088 simulation Methods 0.000 description 4
- 239000005357 flat glass Substances 0.000 description 3
- 238000012546 transfer Methods 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 239000000428 dust Substances 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 230000001131 transforming effect Effects 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B37/00—Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Studio Devices (AREA)
- Stereoscopic And Panoramic Photography (AREA)
Abstract
A panoramic imaging apparatus and method for capturing a 360 degree outward looking panoramic image of a scene using a single, stationary camera, comprises a mirror in the shape of an inverted conical frustum, having an outward facing concavely shaped peripheral surface for reflecting light emanating from the 360 degree panoramic scene, a camera -- which may preferably be a still or video camera having a digital sensor such as a charge coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor, but which may also be a conventional film based camera -- for recording the image projected by the concave conical frustum mirror, and a mounting system for attaching the camera to the mirror. The apparatus may also include a suitably programmed computer for dewarping and processing the image for display using a virtual reality display program.
Description
_ . ~
PANORAMIC IMAGING APPARATUS AND METHOD
The present invention relates to a panoramic imaging apparatus and more particularly to an apparatus and method for capturing a 360 degree panoramic image of a scene using a single, stationary camera, for use in a virtual reality display system or to produce panoramic photographs.
BACKGROUND OF THE INVENTION
Virtual reality (VR) is becoming more and more popular and is a much desired new media entertainment and display concept. From video games that attempt to re-create the sense of live three-dimensional action, to Hollywood movies, to Web site displays that seek to put the viewer into the scene, virtual reality is in demand. People have a desire to experience the world from a realistic perspective that makes them feei like they are right in the action, and not just observing a flat two-dimensional picture from a single fixed vantage point.
In approximately 1995, AppleTM Computer released a computer program called QuicktimeTM VR that allowed the navigation of a panoramic photograph on a computer screen by moving the computer mouse. One of the advantages of this general approach is that it is photo-realistic, while at the same time having very small file sizes that are easy to handle and are well suited for transfer from one computer to another. The navigation capabilities provide one with the sense of moving around in a three-dimensional space, as if one was actually present in the scene.
Since that time, many other companies have released similar virtual reality display systems that can be used to view and navigate a panoramic photograph. These programs are now widely available and many of them are available free of charge.
Virtual reality display systems such as QuicktimeTM VR require systems for quickly and inexpensively capturing high quality, 360 degree, panoramic images.
One of the difficulties in capturing the required panoramic image is that most currently existing photographic systems operate with a limited field of view and are unable to capture an entire 360 degree panoramic view of a scene. A standard camera lens is only able to look outward at considerably less than 180 degrees.
Even with so-called "fish-eye" lenses, the field of view is at most 180 degrees. Such systems are therefore unable to capture, in a single shot, a 360 degree view of a scene required for virtual reality viewing.
Over the past century, panoramic photography has used a wide variety of image capture techniques. All of these methods suffer from the disadvantages of being slow, inefficient and costly. The traditional approach to the problem is to take a number of pictures of a scene in a 360 panorama and carefully stitch them together. At one time, these separate images were merely mounted side-by-side on a cardboard backing, but now they can be scanned, converted to computer readable formats and combined using "stitching" programs. The resulting panoramic image is then converted to a format that can be displayed as a navigable virtual reality scene using a display program such as QuicktimeTM VR. Of course, taking multiple photographs is costly and time consuming, and the scanning and stitching process tends to introduce artifacts into the final image. Furthermore, when separate images are stitched together, they tend to be uneven, requiring substantial cropping of the top and bottom of the scene.
Other panoramic image capturing techniques known in the art include:
camera clusters that take images on large panoramic shaped frames of film;
swing lens cameras that take images by swinging the lens during the exposure;
rotational panoramic cameras that revolve on a tripod while the film moves in the opposite direction; and strip-scan panoramas, like those used to capture horses at a finish line, that expose the image of a moving object onto a piece of film moving at the same speed. All of these techniques are generally unacceptable for producing images for use in current virtual reality displays.
Some recent attempts have been made to address this problem by using only two photographs of the same scene taken in exactly opposite directions with a single fish-eye lens. However, the two photographs must still be carefully aligned and stitched together to produce the required 360 degree panoramic view. Again, the stitching process is slow and introduces artifacts into the final image.
Moreover, any changes in lighting or object positioning within the scene between the two shots will cause disruption of the final image. A further disadvantage of using a fish-eye lens
PANORAMIC IMAGING APPARATUS AND METHOD
The present invention relates to a panoramic imaging apparatus and more particularly to an apparatus and method for capturing a 360 degree panoramic image of a scene using a single, stationary camera, for use in a virtual reality display system or to produce panoramic photographs.
BACKGROUND OF THE INVENTION
Virtual reality (VR) is becoming more and more popular and is a much desired new media entertainment and display concept. From video games that attempt to re-create the sense of live three-dimensional action, to Hollywood movies, to Web site displays that seek to put the viewer into the scene, virtual reality is in demand. People have a desire to experience the world from a realistic perspective that makes them feei like they are right in the action, and not just observing a flat two-dimensional picture from a single fixed vantage point.
In approximately 1995, AppleTM Computer released a computer program called QuicktimeTM VR that allowed the navigation of a panoramic photograph on a computer screen by moving the computer mouse. One of the advantages of this general approach is that it is photo-realistic, while at the same time having very small file sizes that are easy to handle and are well suited for transfer from one computer to another. The navigation capabilities provide one with the sense of moving around in a three-dimensional space, as if one was actually present in the scene.
Since that time, many other companies have released similar virtual reality display systems that can be used to view and navigate a panoramic photograph. These programs are now widely available and many of them are available free of charge.
Virtual reality display systems such as QuicktimeTM VR require systems for quickly and inexpensively capturing high quality, 360 degree, panoramic images.
One of the difficulties in capturing the required panoramic image is that most currently existing photographic systems operate with a limited field of view and are unable to capture an entire 360 degree panoramic view of a scene. A standard camera lens is only able to look outward at considerably less than 180 degrees.
Even with so-called "fish-eye" lenses, the field of view is at most 180 degrees. Such systems are therefore unable to capture, in a single shot, a 360 degree view of a scene required for virtual reality viewing.
Over the past century, panoramic photography has used a wide variety of image capture techniques. All of these methods suffer from the disadvantages of being slow, inefficient and costly. The traditional approach to the problem is to take a number of pictures of a scene in a 360 panorama and carefully stitch them together. At one time, these separate images were merely mounted side-by-side on a cardboard backing, but now they can be scanned, converted to computer readable formats and combined using "stitching" programs. The resulting panoramic image is then converted to a format that can be displayed as a navigable virtual reality scene using a display program such as QuicktimeTM VR. Of course, taking multiple photographs is costly and time consuming, and the scanning and stitching process tends to introduce artifacts into the final image. Furthermore, when separate images are stitched together, they tend to be uneven, requiring substantial cropping of the top and bottom of the scene.
Other panoramic image capturing techniques known in the art include:
camera clusters that take images on large panoramic shaped frames of film;
swing lens cameras that take images by swinging the lens during the exposure;
rotational panoramic cameras that revolve on a tripod while the film moves in the opposite direction; and strip-scan panoramas, like those used to capture horses at a finish line, that expose the image of a moving object onto a piece of film moving at the same speed. All of these techniques are generally unacceptable for producing images for use in current virtual reality displays.
Some recent attempts have been made to address this problem by using only two photographs of the same scene taken in exactly opposite directions with a single fish-eye lens. However, the two photographs must still be carefully aligned and stitched together to produce the required 360 degree panoramic view. Again, the stitching process is slow and introduces artifacts into the final image.
Moreover, any changes in lighting or object positioning within the scene between the two shots will cause disruption of the final image. A further disadvantage of using a fish-eye lens
-2-is that it can introduce considerable radial distortion. That is, horizontal lines of an object near the top of a scene appear as curved rather than straight lines.
Another solution has been described in Canadian Patent Application No.
2,174,157 (Nalwa) which describes a four-sided, pyramid shaped reflective element to reflect images from four different directions to four different cameras having a common optical centre. The resulting images must also be stitched together electronically to form a continuous 360 degree view. One of the problems with this solution is that it requires multiple cameras which must be carefully aligned to ensure that each has the same optical centre. A further disadvantage is that the angle of the flat mirrors must be carefully aligned and maintained.
A further solution is proposed in U.S. Patent No. 5,790,181 (Chahl, et al.), which issued on August 4, 1998. Chahl provides a single camera and a dome-like convex mirror which reflects a distorted image to be recorded by the camera.
The image is dewarped for display on a video screen. One of the main problems with this system is that the convex shape of the mirror results in a reduced image size.
In order to compensate, an expensive telephoto lens is required on the camera which in turn transfers any minor defects or dust on the mirror surface to the film or video image. A further disadvantage is that the convex mirror produces stretching of the image at the poles It is clear from the above that the techniques, skills and costs associated with obtaining 360 degree panoramic images suitable for virtual reality display applications could be significantly improved with the availability of improved panoramic imaging devices and methods.
BRIEF SUMMARY OF THE INVENTION
The object of the present invention is to overcome the above shortcomings by providing a new and improved apparatus and method for rapidly obtaining high quality, inexpensive 360 degree panoramic images of a scene, using a single image obtained from a single stationary camera.
Another solution has been described in Canadian Patent Application No.
2,174,157 (Nalwa) which describes a four-sided, pyramid shaped reflective element to reflect images from four different directions to four different cameras having a common optical centre. The resulting images must also be stitched together electronically to form a continuous 360 degree view. One of the problems with this solution is that it requires multiple cameras which must be carefully aligned to ensure that each has the same optical centre. A further disadvantage is that the angle of the flat mirrors must be carefully aligned and maintained.
A further solution is proposed in U.S. Patent No. 5,790,181 (Chahl, et al.), which issued on August 4, 1998. Chahl provides a single camera and a dome-like convex mirror which reflects a distorted image to be recorded by the camera.
The image is dewarped for display on a video screen. One of the main problems with this system is that the convex shape of the mirror results in a reduced image size.
In order to compensate, an expensive telephoto lens is required on the camera which in turn transfers any minor defects or dust on the mirror surface to the film or video image. A further disadvantage is that the convex mirror produces stretching of the image at the poles It is clear from the above that the techniques, skills and costs associated with obtaining 360 degree panoramic images suitable for virtual reality display applications could be significantly improved with the availability of improved panoramic imaging devices and methods.
BRIEF SUMMARY OF THE INVENTION
The object of the present invention is to overcome the above shortcomings by providing a new and improved apparatus and method for rapidly obtaining high quality, inexpensive 360 degree panoramic images of a scene, using a single image obtained from a single stationary camera.
-3-, _ .
A further object of the present invention is to provide an apparatus and method of obtaining 360 degree panoramic images of a scene which, when converted to a format for display using virtual reality display software, are small in size and easy to manipulate.
Another object of the present invention is to provide a light weight, portable imaging apparatus for capturing 360 degree panoramic images of a scene.
Briefly, these objectives are achieved by the present invention, which provides a mirror in the shape of an inverted conical frustum, having outward facing concavely shaped peripheral surfaces to reflect light emanating from a 360 degree panoramic scene to be recorded by a suitable camera, which may preferably be a still or video camera having a digital sensor such as a charge coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor, but which may also be a conventional film based camera. In a preferred embodiment, the inverted, concave conical frustum mirror is mounted on a mast secured at one end through the central axis of the mirror and at the other end to the centre of a flat glass plate located on a horizontal plane perpendicular to the mast. The flat glass plate is mounted in a suitable structure above a flat mirror placed at a 45 degree angle to the flat glass plate so as to reflect light reflected downward from the mirror, 90 degrees towards a camera whose optical axis is perpendicular to the axis of the mast.
In an alternative preferred embodiment, the inverted conical frustum mirror is mounted directly above and coincident with the optical axis of the camera without requirement for a flat mirror to redirect the light by 90 degrees. In both cases, the inverted, concave conical frustum mirror has a profile that projects a 360 degree view of the environment in which it is mounted onto the imaging plane of the camera.
The inverted, concave conical frustum mirror projects a warped 360 degree image of the scene onto the image plane of the camera which records the image.
The recorded, warped image is then transformed into rectilinear coordinates to provide a high quality 360 degree panoramic image of the original scene which can be displayed on a monitor or printed as a single flat image. The resulting de-warped image can also be formatted for display as a navigable three-dimensional image on a computer monitor using any widely available virtual reality display program, such as QuicktimeTM VR for example.
A further object of the present invention is to provide an apparatus and method of obtaining 360 degree panoramic images of a scene which, when converted to a format for display using virtual reality display software, are small in size and easy to manipulate.
Another object of the present invention is to provide a light weight, portable imaging apparatus for capturing 360 degree panoramic images of a scene.
Briefly, these objectives are achieved by the present invention, which provides a mirror in the shape of an inverted conical frustum, having outward facing concavely shaped peripheral surfaces to reflect light emanating from a 360 degree panoramic scene to be recorded by a suitable camera, which may preferably be a still or video camera having a digital sensor such as a charge coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor, but which may also be a conventional film based camera. In a preferred embodiment, the inverted, concave conical frustum mirror is mounted on a mast secured at one end through the central axis of the mirror and at the other end to the centre of a flat glass plate located on a horizontal plane perpendicular to the mast. The flat glass plate is mounted in a suitable structure above a flat mirror placed at a 45 degree angle to the flat glass plate so as to reflect light reflected downward from the mirror, 90 degrees towards a camera whose optical axis is perpendicular to the axis of the mast.
In an alternative preferred embodiment, the inverted conical frustum mirror is mounted directly above and coincident with the optical axis of the camera without requirement for a flat mirror to redirect the light by 90 degrees. In both cases, the inverted, concave conical frustum mirror has a profile that projects a 360 degree view of the environment in which it is mounted onto the imaging plane of the camera.
The inverted, concave conical frustum mirror projects a warped 360 degree image of the scene onto the image plane of the camera which records the image.
The recorded, warped image is then transformed into rectilinear coordinates to provide a high quality 360 degree panoramic image of the original scene which can be displayed on a monitor or printed as a single flat image. The resulting de-warped image can also be formatted for display as a navigable three-dimensional image on a computer monitor using any widely available virtual reality display program, such as QuicktimeTM VR for example.
-4-In accordance with the objectives of the present invention there is provided a panoramic imaging apparatus for viewing a scene comprising: an inverted conical frustum mirror having an outward facing concavely shaped peripheral surface, for reflecting a 360 degree panoramic view of the scene toward a single viewing location.
In accordance with another aspect, there is provided a panoramic imaging apparatus for viewing a scene comprising: a first conical frustum mirror having a first outward facing concavely shaped peripheral surface, for reflecting a first 360 degree panoramic view of the scene toward a first viewing location; and a second conical frustum mirror inversely mounted with respect to said first mirror and having a common optical axis with said first mirror, said second conical frustum mirror having a second outward facing concavely shaped peripheral surface, for reflecting a second 360 degree panoramic view of the scene toward a second viewing location, said first and second viewing locations being oppositely located on said common optical axis.
In accordance with a further aspect and objectives, there is provided a method for acquiring a 360 degree panoramic image of a scene comprising the steps of: locating an inverted conical frustum mirror having an outward facing concavely shaped peripheral surface within the scene so that said mirror reflects a 360 degree panoramic view of the scene toward a viewing location; locating an image capture mechanism at said viewing location; and capturing said panoramic view of the scene.
In accordance with another aspect, there is provided a method for acquiring a 360 degree panoramic image of a scene comprising the steps of: locating a first conical frustum mirror having a first outward facing concavely shaped peripheral surface within the scene so that the first mirror reflects a first 360 degree panoramic view of the scene toward a first viewing location; locating a second conical frustum mirror within the scene, said second mirror inversely mounted with respect to said first mirror and having a common optical axis with respect to said first mirror, said second conical frustum mirror having a second outward facing concavely shaped peripheral surface so that the second mirror reflects a second 360 degree panoramic
In accordance with another aspect, there is provided a panoramic imaging apparatus for viewing a scene comprising: a first conical frustum mirror having a first outward facing concavely shaped peripheral surface, for reflecting a first 360 degree panoramic view of the scene toward a first viewing location; and a second conical frustum mirror inversely mounted with respect to said first mirror and having a common optical axis with said first mirror, said second conical frustum mirror having a second outward facing concavely shaped peripheral surface, for reflecting a second 360 degree panoramic view of the scene toward a second viewing location, said first and second viewing locations being oppositely located on said common optical axis.
In accordance with a further aspect and objectives, there is provided a method for acquiring a 360 degree panoramic image of a scene comprising the steps of: locating an inverted conical frustum mirror having an outward facing concavely shaped peripheral surface within the scene so that said mirror reflects a 360 degree panoramic view of the scene toward a viewing location; locating an image capture mechanism at said viewing location; and capturing said panoramic view of the scene.
In accordance with another aspect, there is provided a method for acquiring a 360 degree panoramic image of a scene comprising the steps of: locating a first conical frustum mirror having a first outward facing concavely shaped peripheral surface within the scene so that the first mirror reflects a first 360 degree panoramic view of the scene toward a first viewing location; locating a second conical frustum mirror within the scene, said second mirror inversely mounted with respect to said first mirror and having a common optical axis with respect to said first mirror, said second conical frustum mirror having a second outward facing concavely shaped peripheral surface so that the second mirror reflects a second 360 degree panoramic
-5-view of the scene toward a second viewing location, said first and second viewing locations being oppositely located on said common optical axis; locating a first image capture mechanism at said first viewing location; locating a second image capture mechanism at said second viewing location; and capturing said first and second panoramic views of the scene.
The present invention advantageously provides for the rapid acquisition of high quality, professional grade 360 degree panoramic images at a much lower cost than professional grade optics. A further advantage of the present invention is that the concave peripheral surface of the conical frustum mirror produces a magnified image, thus eliminating the need to use expensive telephoto photographic lenses which can magnify distortions, scratches and dirt on the mirror. Yet another advantage is tDat the conical frustum mirror and supporting apparatus can be made of plastic, further reducing costs and increasing portability. A further advantage is that the present invention requires only a single camera and a single photograph to reproduce a 360 degree panoramic view of a scene. There is no requirement for multiple cameras or stitching together of multiple photographs. Another advantage is that the file sizes of the de-warped images produced by the present invention are much smaller than those typical of video. Therefore, when being viewed as a navigable three-dimensional image in a virtual reality display program such as QuicktimeTM, the images transfer much quicker and activate much faster.
Further objects and advantages of the present invention will be apparent from the following description, wherein preferred embodiments of the invention are clearly shown.
5a ' ' r r BRIEF DESCRIPTION OF THE DRAWINGS
The present invention will be further understood from the following description with reference to the drawings in which:
Figure 1 is a perspective view of a preferred embodiment of the present invention.
Figure 2 is a cross-sectional view of a preferred embodiment of the present invention showing an attached camera used for recording images.
Figure 3 is a plan view of a typical warped image of the simulated room shown in Figure 7 and projected on the image plane of a camera by the present invention.
Figure 4 is a perspective view of a typical cone, having a concave peripheral surface, used to produce the inverted concave conical frustum mirror of the present invention.
Figure 5 is a cross-sectional view of the inverted concave conical frustum mirror of the present invention.
Figure 6 is a graph showing the cross sectional surface curvature of a typical inverted conical frustum mirror of the present invention.
Figure 7 is perspective view of a simulation showing a concave conical frustum mirror of the present invention suspended in a simulated room.
Figure 8 is a side plan view of an alternative embodiment of the present invention in which the concave conical frustum mirror is attached directly to the camera.
Figure 9 is a side plan view of an embodiment of the present invention which includes two concave conical frustum mirrors used to image a substantially spherical view.
Figure 10 is a cross-sectional view of a further preferred embodiment of the present invention showing an alternative arrangement of the present invention collapsed for shipping purposes.
Figure 11 is a flow chart showing an embodiment of a method of the present invention for acquiring and processing panoramic images.
The present invention advantageously provides for the rapid acquisition of high quality, professional grade 360 degree panoramic images at a much lower cost than professional grade optics. A further advantage of the present invention is that the concave peripheral surface of the conical frustum mirror produces a magnified image, thus eliminating the need to use expensive telephoto photographic lenses which can magnify distortions, scratches and dirt on the mirror. Yet another advantage is tDat the conical frustum mirror and supporting apparatus can be made of plastic, further reducing costs and increasing portability. A further advantage is that the present invention requires only a single camera and a single photograph to reproduce a 360 degree panoramic view of a scene. There is no requirement for multiple cameras or stitching together of multiple photographs. Another advantage is that the file sizes of the de-warped images produced by the present invention are much smaller than those typical of video. Therefore, when being viewed as a navigable three-dimensional image in a virtual reality display program such as QuicktimeTM, the images transfer much quicker and activate much faster.
Further objects and advantages of the present invention will be apparent from the following description, wherein preferred embodiments of the invention are clearly shown.
5a ' ' r r BRIEF DESCRIPTION OF THE DRAWINGS
The present invention will be further understood from the following description with reference to the drawings in which:
Figure 1 is a perspective view of a preferred embodiment of the present invention.
Figure 2 is a cross-sectional view of a preferred embodiment of the present invention showing an attached camera used for recording images.
Figure 3 is a plan view of a typical warped image of the simulated room shown in Figure 7 and projected on the image plane of a camera by the present invention.
Figure 4 is a perspective view of a typical cone, having a concave peripheral surface, used to produce the inverted concave conical frustum mirror of the present invention.
Figure 5 is a cross-sectional view of the inverted concave conical frustum mirror of the present invention.
Figure 6 is a graph showing the cross sectional surface curvature of a typical inverted conical frustum mirror of the present invention.
Figure 7 is perspective view of a simulation showing a concave conical frustum mirror of the present invention suspended in a simulated room.
Figure 8 is a side plan view of an alternative embodiment of the present invention in which the concave conical frustum mirror is attached directly to the camera.
Figure 9 is a side plan view of an embodiment of the present invention which includes two concave conical frustum mirrors used to image a substantially spherical view.
Figure 10 is a cross-sectional view of a further preferred embodiment of the present invention showing an alternative arrangement of the present invention collapsed for shipping purposes.
Figure 11 is a flow chart showing an embodiment of a method of the present invention for acquiring and processing panoramic images.
-6-DETAILED DESCRIPTION OF THE
PREFERRED EMBODIMENTS OF THE INVENTION
Referring to Figure 1, a preferred arrangement of the present imaging apparatus 10 is shown which comprises an inverted conical frustum mirror 12 having an outward facing concavely shaped peripheral surface 14. Conical frustum mirror 12, as also shown in isolated cross-section in Figure 5, has a horizontal flat base 16, a horizontal flat top 18 and a vertical edge 20. Vertical edge 20 is added to the preferred arrangement shown for the purpose of increasing the strength of the mirror, but is not a required feature of the present invention.
Conical frustum mirror 12 is supported in an inverted position by mast 22 attached at one end through the centre of mirror top 18 and at the other end to a flat transparent plate 24, preferably made of either glass or plastic, positioned on a horizontal plane perpendicular to mast 22. Flat transparent plate 24 is supported in a suitable structure such as a glass or plastic support cube 26, however, it will be appreciated by one skilled in the art that any suitable supporting structure would function equally well in the present arrangement for supporting conical frustum mirror 12. A flat mirror 28 is located in the structure below flat transparent plate 24 and is positioned at an angle of 45 degrees to flat transparent plate 24. To assist in the alignment of the image reflected from conical frustum mirror 12, the angle of flat mirror 28 in relation to flat transparent plate 24 can be made adjustable using an adjustment screw 29 (see Figure 2) located at the base of flat mirror 28.
Imaging apparatus 10 includes a track 30 attached to the base of support cube 26 and extending at an angle of 90 degrees to mast 22.
As shown in Figure 2, track 30 supports a camera 35 which is removably attached to track 30 and located so that its optical axis is perpendicular to mast 22 and most, if not all, the curved surface 14 of conical frustum mirror 12 is within the field of view of the camera. Camera 35 can be any suitable imaging device such as a film based still camera, a movie camera, or a still camera or video camera having a digital image sensor such as charged coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor. Camera 35 is movable .
along track 30, allowing it to be located either closer to or farther away from flat
PREFERRED EMBODIMENTS OF THE INVENTION
Referring to Figure 1, a preferred arrangement of the present imaging apparatus 10 is shown which comprises an inverted conical frustum mirror 12 having an outward facing concavely shaped peripheral surface 14. Conical frustum mirror 12, as also shown in isolated cross-section in Figure 5, has a horizontal flat base 16, a horizontal flat top 18 and a vertical edge 20. Vertical edge 20 is added to the preferred arrangement shown for the purpose of increasing the strength of the mirror, but is not a required feature of the present invention.
Conical frustum mirror 12 is supported in an inverted position by mast 22 attached at one end through the centre of mirror top 18 and at the other end to a flat transparent plate 24, preferably made of either glass or plastic, positioned on a horizontal plane perpendicular to mast 22. Flat transparent plate 24 is supported in a suitable structure such as a glass or plastic support cube 26, however, it will be appreciated by one skilled in the art that any suitable supporting structure would function equally well in the present arrangement for supporting conical frustum mirror 12. A flat mirror 28 is located in the structure below flat transparent plate 24 and is positioned at an angle of 45 degrees to flat transparent plate 24. To assist in the alignment of the image reflected from conical frustum mirror 12, the angle of flat mirror 28 in relation to flat transparent plate 24 can be made adjustable using an adjustment screw 29 (see Figure 2) located at the base of flat mirror 28.
Imaging apparatus 10 includes a track 30 attached to the base of support cube 26 and extending at an angle of 90 degrees to mast 22.
As shown in Figure 2, track 30 supports a camera 35 which is removably attached to track 30 and located so that its optical axis is perpendicular to mast 22 and most, if not all, the curved surface 14 of conical frustum mirror 12 is within the field of view of the camera. Camera 35 can be any suitable imaging device such as a film based still camera, a movie camera, or a still camera or video camera having a digital image sensor such as charged coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor. Camera 35 is movable .
along track 30, allowing it to be located either closer to or farther away from flat
-7-= , mirror 28, permitting adjustment of the image size and location on an image plane 42.
Figure 3 shows a warped circular image 40 of the outward environment as shown in Figure 7 and projected onto image plane 42 of camera 35 by the arrangement of the present invention shown in Figures 1 and 2. The warped circular image 40 represents 360 degrees in azimuth of the viewed environment and from approximately -90 degrees (that is vertically downwards in the arrangement shown in Figure 2) to greater than 0 degrees (horizontal) in elevation. In practice, the lowest elevation is determined by the size of flat top 18 of conical frustum mirror 12 which blocks the downward view of the mirror at the lowest elevations. The highest elevation is determined by the curvature of the concave surface of the conical frustum mirror 12 or its cross-sectional profile as shown in Figure 5, and generally extends to beyond the horizontal so that objects above 0 degrees elevation, in the range of 0 to 30 degrees elevation, are visible.
In the warped circular image 40 generated by the conical frustum mirror 12, a given radial direction corresponds to a specific azimuth in the environment, and since the warped image produced by the conical frustum mirror 12 is inverted, increasing radii correspond to decreasing elevations. Thus, in the warped image 40 shown in Figure 3, the inner portion of the circle corresponds to the ceiling or top of the environment shown in Figure 7, while the outer edges of the circle correspond to the bottom or floor.
The concave surface profile of conical frustum mirror 12 may be any one of a large number of practical profiles, but in the case of the preferred arrangement of the present invention described herein, the concave profile of conical frustum mirror 12 is preferably chosen to map equal changes in elevation in the scene to equal changes in radius in the warped image. This ensures that both the top and bottom of the scene receive an equal number of image pixels, thus preventing stretching or distortion of image lines which is a common problem for imaging systems using convex mirrors.
Figure 3 shows a warped circular image 40 of the outward environment as shown in Figure 7 and projected onto image plane 42 of camera 35 by the arrangement of the present invention shown in Figures 1 and 2. The warped circular image 40 represents 360 degrees in azimuth of the viewed environment and from approximately -90 degrees (that is vertically downwards in the arrangement shown in Figure 2) to greater than 0 degrees (horizontal) in elevation. In practice, the lowest elevation is determined by the size of flat top 18 of conical frustum mirror 12 which blocks the downward view of the mirror at the lowest elevations. The highest elevation is determined by the curvature of the concave surface of the conical frustum mirror 12 or its cross-sectional profile as shown in Figure 5, and generally extends to beyond the horizontal so that objects above 0 degrees elevation, in the range of 0 to 30 degrees elevation, are visible.
In the warped circular image 40 generated by the conical frustum mirror 12, a given radial direction corresponds to a specific azimuth in the environment, and since the warped image produced by the conical frustum mirror 12 is inverted, increasing radii correspond to decreasing elevations. Thus, in the warped image 40 shown in Figure 3, the inner portion of the circle corresponds to the ceiling or top of the environment shown in Figure 7, while the outer edges of the circle correspond to the bottom or floor.
The concave surface profile of conical frustum mirror 12 may be any one of a large number of practical profiles, but in the case of the preferred arrangement of the present invention described herein, the concave profile of conical frustum mirror 12 is preferably chosen to map equal changes in elevation in the scene to equal changes in radius in the warped image. This ensures that both the top and bottom of the scene receive an equal number of image pixels, thus preventing stretching or distortion of image lines which is a common problem for imaging systems using convex mirrors.
-8-, , .
As shown in Figures 1, 2 and 5, inverted conical frustum mirror 12 has a flat base 16, and a flat top 18, which is created by slicing the top off a cone, similar to the cone shown in Figure 4, with a cut made parallel to the flat base 16. In one preferred embodiment of the present invention, base 16 has a diameter of approximately 4 inches and top 18 has a diameter of approximately 1.5 inches.
Figure 4 shows an example of a cone shaped mirror having a concave outwardly facing peripheral surface 14. The profile of conical frustum mirror 12 was chosen from a cone similar to the cone shown in Figure 4, by conducting extensive simulations using a large simulated room such as that shown in Figure 7. The concave curvature of surface 14 was varied and different sections of the cone were selected, until the ideal combination was obtained which, when inverted, projected the greatest range of elevation of the surrounding environment onto the image plane of camera 35. It is unnecessary for the purpose of this invention to describe the specific mathematical equation corresponding to the curvature of the mirror, as those skilled in the art will be able to easily select the most advantageous surface curvature and conical frustum by conducting simulations using commercially available three-dimensional rendering programs. One preferred curvature for the surface 14 of conical frustum mirror 12 is shown in Figure 6.
The various dimensions of the present invention as shown in Figure 2, will vary depending on the type of camera 35 used and the exact positioning and curvature of the conical frustum mirror 12. In one typical arrangement, the applicant has attached a NikonTM digital camera to track 30. In this preferred arrangement, the NikonTM camera is located three-quarters of an inch from the base of mirror 28 which is set at a 45 degree angle within support structure 26 which measures four inches long, two and one-half inches wide and two and four-tenths inches high. The base 16 of conical frustum mirror 12 is four inches in diameter and the top 18 is one and one-half inches in diameter, and the conical frustum mirror 12 is supported on mast 22 approximately five and one-quarter inches above the surface of transparent plate 24.
One of the main advantages of using a conical frustum mirror with a concave peripheral surface is that, in the arrangement of the present invention shown in
As shown in Figures 1, 2 and 5, inverted conical frustum mirror 12 has a flat base 16, and a flat top 18, which is created by slicing the top off a cone, similar to the cone shown in Figure 4, with a cut made parallel to the flat base 16. In one preferred embodiment of the present invention, base 16 has a diameter of approximately 4 inches and top 18 has a diameter of approximately 1.5 inches.
Figure 4 shows an example of a cone shaped mirror having a concave outwardly facing peripheral surface 14. The profile of conical frustum mirror 12 was chosen from a cone similar to the cone shown in Figure 4, by conducting extensive simulations using a large simulated room such as that shown in Figure 7. The concave curvature of surface 14 was varied and different sections of the cone were selected, until the ideal combination was obtained which, when inverted, projected the greatest range of elevation of the surrounding environment onto the image plane of camera 35. It is unnecessary for the purpose of this invention to describe the specific mathematical equation corresponding to the curvature of the mirror, as those skilled in the art will be able to easily select the most advantageous surface curvature and conical frustum by conducting simulations using commercially available three-dimensional rendering programs. One preferred curvature for the surface 14 of conical frustum mirror 12 is shown in Figure 6.
The various dimensions of the present invention as shown in Figure 2, will vary depending on the type of camera 35 used and the exact positioning and curvature of the conical frustum mirror 12. In one typical arrangement, the applicant has attached a NikonTM digital camera to track 30. In this preferred arrangement, the NikonTM camera is located three-quarters of an inch from the base of mirror 28 which is set at a 45 degree angle within support structure 26 which measures four inches long, two and one-half inches wide and two and four-tenths inches high. The base 16 of conical frustum mirror 12 is four inches in diameter and the top 18 is one and one-half inches in diameter, and the conical frustum mirror 12 is supported on mast 22 approximately five and one-quarter inches above the surface of transparent plate 24.
One of the main advantages of using a conical frustum mirror with a concave peripheral surface is that, in the arrangement of the present invention shown in
-9-Figures 1, 2, 8 and 9, the conical frustum mirror produces a magnified image of the surrounding environment on the image plane, thus eliminating the need to use expensive telephoto photographic lenses which can magnify distortions, scratches and dirt on the mirror. The result is that a professional quality image is obtained at reduced expense. Lenses used by the applicant in the present invention can be manufactured from relatively inexpensive plastic components.
It is important to select the diameter of top 18 so as to prevent imaging of objects directly below the conical frustum mirror, such as camera 35 or support 26.
This permits placement of the camera much closer to the conical frustum mirror than is possible in applications that use convex mirrors for example.
Placement of the camera closer to the conical frustum mirror 12 helps to eliminate vibration and improves the portability of the system.
As shown in Figures 1 and 2, it is important that during operation mast 22 not extend through the flat transparent plate 24 by any significant amount. Any extension of mast 22 into the optical field of view of camera 35 will result in an image of mast 22 appearing on the image plane of the camera. If mast 22 is merely imbedded in transparent plate 24, the entire mast is obscured by the blind spot created by top 18 of conical frustum mirror 12, which appears as a small dark circle in the centre of the circular warped image 40.
However, referring to Figure 10, in order to reduce the size of the arrangement of the present invention shown in Figures 1 and 2, during shipment or storage, mirror 28 can be provided with a central hole 50 located directly inline with mast 22. Mast 22 can be constructed so as to be slidably secured within transparent plate 24 thereby permitting mast 22 to be lowered through hole 50 reducing the size of the present invention for shipping or storage. Hole 50 is obscured by the blind spot of the apparatus created by the size of top 18 and is thus not visible on the image plane 42.
The positioning of flat mirror 28 at a 45 degree diagonal is a further important aspect of the preferred embodiment of the invention shown in Figures 1 and 2.
A
similar arrangement has been used in telescopes to reflect light gathered from a
It is important to select the diameter of top 18 so as to prevent imaging of objects directly below the conical frustum mirror, such as camera 35 or support 26.
This permits placement of the camera much closer to the conical frustum mirror than is possible in applications that use convex mirrors for example.
Placement of the camera closer to the conical frustum mirror 12 helps to eliminate vibration and improves the portability of the system.
As shown in Figures 1 and 2, it is important that during operation mast 22 not extend through the flat transparent plate 24 by any significant amount. Any extension of mast 22 into the optical field of view of camera 35 will result in an image of mast 22 appearing on the image plane of the camera. If mast 22 is merely imbedded in transparent plate 24, the entire mast is obscured by the blind spot created by top 18 of conical frustum mirror 12, which appears as a small dark circle in the centre of the circular warped image 40.
However, referring to Figure 10, in order to reduce the size of the arrangement of the present invention shown in Figures 1 and 2, during shipment or storage, mirror 28 can be provided with a central hole 50 located directly inline with mast 22. Mast 22 can be constructed so as to be slidably secured within transparent plate 24 thereby permitting mast 22 to be lowered through hole 50 reducing the size of the present invention for shipping or storage. Hole 50 is obscured by the blind spot of the apparatus created by the size of top 18 and is thus not visible on the image plane 42.
The positioning of flat mirror 28 at a 45 degree diagonal is a further important aspect of the preferred embodiment of the invention shown in Figures 1 and 2.
A
similar arrangement has been used in telescopes to reflect light gathered from a
-10-large primary mirror and direct it at an angle of 90 degrees to the optical axis of the primary mirror for focussing and viewing. The arrangement is referred to as a "Newtonian Reflector" and, as used in the present invention shown in Figures 1 and 2, permits camera 35 to be placed at a 90 degree angle to the optical axis of conical frustum mirror 12. This arrangement allows camera 35 to view ahead horizontally rather than upwards vertically toward the conical frustum mirror. The arrangement also permits the use of almost any type of camera so long as it can be mounted on track 30 and does not limit the invention to cameras which can be mounted directly to the conical frustum mirror.
In an alternative embodiment of the present invention, as shown in Figure 8, camera 35 is mounted on mast 22 directly in line with conical frustum mirror 12 so that the optical axis of camera 35 coincides with the optical axis of conical frustum mirror 12. In this alternative arrangement, the 360 degree panoramic image of the environment reflected from the conical frustum mirror 12 is projected directly onto the image plane 42 of camera 35, thus eliminating the requirement for flat mirror 28.
The arrangement shown in Figure 8 does restrict the selection for camera 35 to one that has been specifically adapted for mounting of mast 22 which supports conical frustum mirror 12. One advantage of the arrangement shown in Figure 8 is that the entire apparatus can be made smaller and lighter and is thus more portable.
As mentioned above, and as shown by example in Figure 3, the circular image 40 produced on image plane 42 of camera 35 by the present invention is usually a warped version of the viewed environment in which the azimuth corresponds to the environmental azimuth and the radial distance corresponds to the elevation angle.
To interpret this warped image and to produce an image that is usable in a virtual reality viewer such as QuicktimeTM VR, the warped image must be de-warped using a suitably programmed computer or microprocessor to transform pixels in the warped image to rectilinear coordinates. The specific conversion algorithms used may be any of a number of known algorithms for effecting the required transformation, but it is well known that skilled programmers will be able to generate their own algorithms for this purpose based on simulations conducted using three-dimensional rendering programs as discussed above.
In an alternative embodiment of the present invention, as shown in Figure 8, camera 35 is mounted on mast 22 directly in line with conical frustum mirror 12 so that the optical axis of camera 35 coincides with the optical axis of conical frustum mirror 12. In this alternative arrangement, the 360 degree panoramic image of the environment reflected from the conical frustum mirror 12 is projected directly onto the image plane 42 of camera 35, thus eliminating the requirement for flat mirror 28.
The arrangement shown in Figure 8 does restrict the selection for camera 35 to one that has been specifically adapted for mounting of mast 22 which supports conical frustum mirror 12. One advantage of the arrangement shown in Figure 8 is that the entire apparatus can be made smaller and lighter and is thus more portable.
As mentioned above, and as shown by example in Figure 3, the circular image 40 produced on image plane 42 of camera 35 by the present invention is usually a warped version of the viewed environment in which the azimuth corresponds to the environmental azimuth and the radial distance corresponds to the elevation angle.
To interpret this warped image and to produce an image that is usable in a virtual reality viewer such as QuicktimeTM VR, the warped image must be de-warped using a suitably programmed computer or microprocessor to transform pixels in the warped image to rectilinear coordinates. The specific conversion algorithms used may be any of a number of known algorithms for effecting the required transformation, but it is well known that skilled programmers will be able to generate their own algorithms for this purpose based on simulations conducted using three-dimensional rendering programs as discussed above.
-11-Finally, the resulting de-warped image can be printed or displayed as a panoramic photograph or further processed and formatted for display using any virtual reality viewer such as QuicktimeTM VR. Alternatively, the electronic signal generated by a camera having a CCD or CMOS sensor at its imaging plane can be de-warped directly without first recording it as a warped image, thus producing a de-warped image formatted for display on a monitor or in a virtual reality viewer. If the camera used is a video camera and the computer used has sufficient processing power and transmission bandwidth, it is within the concept of the present invention that successive images can be captured, processed and actively displayed to create a live, full-motion, three dimensional navigable display of the viewed environment.
In practice, the present invention is extremely simple to use. For many applications the most advantageous panoramic view of a scene is one taken from the perspective of a standing or seated person. Using either of the preferred embodiments of the present invention described and shown in Figures 1 and 2 or Figure 8, the operator, while standing or sitting, simply holds the invention at or slightly above eye level and activates camera 35 to record an image of the scene.
Because of the blind spot created by top 18 of conical frustum mirror 12, both the operator and the camera are not recorded in the resulting panoramic image. For more serious applications, the apparatus can be placed on a centrally located tripod and the camera activated remotely or by timer.
Referring to Figure 11, there is shown a flow chart illustrating a method for acquiring and processing panoramic images in accordance with an embodiment of the present invention. The steps include locating an inverted conical frustum mirror in the environment to be viewed 110, reflecting a 360 degree panoramic view of the environment from the conical frustum mirror 115, and sensing and recording the warped image reflected therefrom 120. The method may further include de-warping the warped images by transforming pixels in the warped image to rectilinear coordinates 125, displaying the de-warped image on a monitor or printing the image as a panoramic image 130, and further processing and formatting of the de-warped image for display using a virtual reality viewer 135, thus permitting three-dimensional navigation of the viewed environment.
In practice, the present invention is extremely simple to use. For many applications the most advantageous panoramic view of a scene is one taken from the perspective of a standing or seated person. Using either of the preferred embodiments of the present invention described and shown in Figures 1 and 2 or Figure 8, the operator, while standing or sitting, simply holds the invention at or slightly above eye level and activates camera 35 to record an image of the scene.
Because of the blind spot created by top 18 of conical frustum mirror 12, both the operator and the camera are not recorded in the resulting panoramic image. For more serious applications, the apparatus can be placed on a centrally located tripod and the camera activated remotely or by timer.
Referring to Figure 11, there is shown a flow chart illustrating a method for acquiring and processing panoramic images in accordance with an embodiment of the present invention. The steps include locating an inverted conical frustum mirror in the environment to be viewed 110, reflecting a 360 degree panoramic view of the environment from the conical frustum mirror 115, and sensing and recording the warped image reflected therefrom 120. The method may further include de-warping the warped images by transforming pixels in the warped image to rectilinear coordinates 125, displaying the de-warped image on a monitor or printing the image as a panoramic image 130, and further processing and formatting of the de-warped image for display using a virtual reality viewer 135, thus permitting three-dimensional navigation of the viewed environment.
-12-= = , + , .
It is contemplated that the steps of locating the mirror 110, reflecting the scene 115 and sensing and recording the warped image 120 can be done remotely by a person using the preferred arrangements of the present invention discussed above. It is further contemplated that the warped image thereby recorded can be submitted to a central location where the further steps of de-warping the image 125, printing a panoramic photograph 130, or processing and formatting the image for display using a virtual reality viewer 135 are performed.
As shown in Figure 9, a field of view that is almost global in scope may be obtained by using two concave conical frustum mirrors 12 mounted base-to-base, and sharing a common optical axis. The arrangement shown in Figure 9 utilizes two identical devices as shown in Figure 8, each having concave conical frustum mirror 12, a supporting mast 22 and a camera 32 mounted so that the optical axises of the cameras 35 are coincident with the optical axises of the conical frustum mirrors 12. One of the main advantage of this alternative arrangement is that the resulting images obtained from each mirror can be combined in the final de-warped image to produce a navigable three-dimensional image having 360 degrees of azimuth and a range in elevation from almost -90 degrees vertically downward to almost +90 vertically upward. The field of view in the final three-dimensional navigable scene is thus greatly expanded over an arrangement using a single conical frustum mirror 12.
The imaging apparatus and method of the present invention has applications in a wide number of areas requiring panoramic photographs and interactive panoramic displays, of which the following is a brief, but not exhaustive, list:
virtual home tours in the real estate industry;
virtual field trips to remote locations for use by educators and in the tourist industry;
virtual store tours and displays for on-line retailers, virtual displays of entertainment venues to provide virtual spectator views from particular seat locations; and visualization of harsh industrial environments.
The invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. The present embodiments are
It is contemplated that the steps of locating the mirror 110, reflecting the scene 115 and sensing and recording the warped image 120 can be done remotely by a person using the preferred arrangements of the present invention discussed above. It is further contemplated that the warped image thereby recorded can be submitted to a central location where the further steps of de-warping the image 125, printing a panoramic photograph 130, or processing and formatting the image for display using a virtual reality viewer 135 are performed.
As shown in Figure 9, a field of view that is almost global in scope may be obtained by using two concave conical frustum mirrors 12 mounted base-to-base, and sharing a common optical axis. The arrangement shown in Figure 9 utilizes two identical devices as shown in Figure 8, each having concave conical frustum mirror 12, a supporting mast 22 and a camera 32 mounted so that the optical axises of the cameras 35 are coincident with the optical axises of the conical frustum mirrors 12. One of the main advantage of this alternative arrangement is that the resulting images obtained from each mirror can be combined in the final de-warped image to produce a navigable three-dimensional image having 360 degrees of azimuth and a range in elevation from almost -90 degrees vertically downward to almost +90 vertically upward. The field of view in the final three-dimensional navigable scene is thus greatly expanded over an arrangement using a single conical frustum mirror 12.
The imaging apparatus and method of the present invention has applications in a wide number of areas requiring panoramic photographs and interactive panoramic displays, of which the following is a brief, but not exhaustive, list:
virtual home tours in the real estate industry;
virtual field trips to remote locations for use by educators and in the tourist industry;
virtual store tours and displays for on-line retailers, virtual displays of entertainment venues to provide virtual spectator views from particular seat locations; and visualization of harsh industrial environments.
The invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. The present embodiments are
-13-= ' . . .
therefore to be considered as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes that come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein.
therefore to be considered as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes that come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein.
-14-
Claims (18)
PROPERTY OR PRIVILEGE IS CLAIMED ARE DEFINED AS FOLLOWS.
1. A panoramic imaging apparatus for viewing a scene comprising.
an inverted conical frustum mirror having an outward facing concavely shaped peripheral surface, for reflecting a 360 degree panoramic view of the scene toward a single viewing location.
an inverted conical frustum mirror having an outward facing concavely shaped peripheral surface, for reflecting a 360 degree panoramic view of the scene toward a single viewing location.
2. The panoramic imaging apparatus of claim 1, including an image capture mechanism located at said viewing location for capturing said panoramic view of the scene.
3. The panoramic imaging apparatus of claim 2, wherein said image capture mechanism is an electronic camera having a digital image sensor at its image plane and the output of said sensor is connected to signal processing means.
4. The panoramic imaging apparatus as defined in claim 3, wherein said signal processing means is programmed to produce a dewarped image.
5. The panoramic imaging apparatus as defined in any one of claims 2 to 4 wherein said image capture mechanism is a video camera or a still camera.
6. The panoramic imaging apparatus of any one of claims 1 to 5, wherein said viewing location is located on an viewing axis perpendicular to a central optical axis of said conical frustum mirror.
7. The panoramic imaging apparatus of claim 6, including a flat mirror arranged along the central optical axis of said conical frustum mirror for reflecting said panoramic view of the scene towards said viewing location.
8. The panoramic imaging apparatus of claim 7, wherein the conical frustum mirror is mounted in said inverted position on an elongated mast coincident with the central optical axis of the conical frustum mirror, said mast mounted on a transparent plate positioned on a horizontal plane perpedicular to the central optical axis of the conical frustum mirror, whereby said panoramic view of the scene is reflected by the conical frustum mirror, through said transparent plate and onto said flat mirror.
9. The panoramic imaging apparatus of claim 8, including a hole centrally located in the flat mirror directly on the central optical axis of the conical frustum mirror and directly inline with the mast, and wherein said mast is slidably secured to said transparent plate thereby permitting said mast to be lowered through said hole thus reducing the overall size of the apparatus for purposes of shipping or storage.
10. The panoramic imaging apparatus of any one of claims 1 to 5, wherein said viewing location is located on a viewing axis coincident with a central optical axis of said conical frustum mirror.
11. The panoramic imaging apparatus of claim 10, wherein the conical frustum mirror is mounted in said inverted position on an elongated mast coincident with the central optical axis of the conical frustum mirror, said mast mounted directly on an image capture mechanism located at said viewing location.
12. A panoramic imaging apparatus for viewing a scene comprising:
a first conical frustum mirror having a first outward facing concavely shaped peripheral surface, for reflecting a first 360 degree panoramic view of the scene toward a first viewing location; and a second conical frustum mirror inversely mounted with respect to said first mirror and having a common optical axis with said first mirror, said second conical frustum mirror having a second outward facing concavely shaped peripheral surface, for reflecting a second 360 degree panoramic view of the scene toward a second viewing location, said first and second viewing locations being oppositely located on said common optical axis.
a first conical frustum mirror having a first outward facing concavely shaped peripheral surface, for reflecting a first 360 degree panoramic view of the scene toward a first viewing location; and a second conical frustum mirror inversely mounted with respect to said first mirror and having a common optical axis with said first mirror, said second conical frustum mirror having a second outward facing concavely shaped peripheral surface, for reflecting a second 360 degree panoramic view of the scene toward a second viewing location, said first and second viewing locations being oppositely located on said common optical axis.
13. A method for acquiring a 360 degree panoramic image of a scene comprising the steps of:
locating an inverted conical frustum mirror having an outward facing concavely shaped peripheral surface within the scene so that said mirror reflects a 360 degree panoramic view of the scene toward a viewing location;
locating an image capture mechanism at said viewing location; and capturing said panoramic view of the scene.
locating an inverted conical frustum mirror having an outward facing concavely shaped peripheral surface within the scene so that said mirror reflects a 360 degree panoramic view of the scene toward a viewing location;
locating an image capture mechanism at said viewing location; and capturing said panoramic view of the scene.
14. The method of claim 13, including the step of dewarping said panoramic view of the scene to produce a de-warped image of the scene that can be printed as a panoramic photograph or displayed as a image on a display screen.
15. The method of claim 13, including the further steps of:
recording said panoramic view of the scene; and submitting said recorded panoramic view to a central de-warping location for de-warping of said panoramic view of the scene to produce a de-warped image of the scene that can be printed as a panoramic photograph or displayed as a image on a display screen.
recording said panoramic view of the scene; and submitting said recorded panoramic view to a central de-warping location for de-warping of said panoramic view of the scene to produce a de-warped image of the scene that can be printed as a panoramic photograph or displayed as a image on a display screen.
16. The method of claim 13, including the further steps of:
recording said panoramic view of the scene;
submitting said recorded panoramic view to a central de-warping location; and de-warping said panoramic view of the scene at said central de-warping station to produce a de-warped image of the scene that can be printed as a panoramic photograph or displayed as a image on a display screen.
recording said panoramic view of the scene;
submitting said recorded panoramic view to a central de-warping location; and de-warping said panoramic view of the scene at said central de-warping station to produce a de-warped image of the scene that can be printed as a panoramic photograph or displayed as a image on a display screen.
17. A method for acquiring a 360 degree panoramic image of a scene comprising the steps of:
locating a first conical frustum mirror having a first outward facing concavely shaped peripheral surface within the scene so that the first mirror reflects a first 360 degree panoramic view of the scene toward a first viewing location;
locating a second conical frustum mirror within the scene, said second mirror inversely mounted with respect to said first mirror and having a common optical axis with respect to said first mirror, said second conical frustum mirror having a second outward facing concavely shaped peripheral surface so that the second mirror reflects a second 360 degree panoramic view of the scene toward a second viewing location, said first and second viewing locations being oppositely located on said common optical axis, locating a first image capture mechanism at said first viewing location;
locating a second image capture mechanism at said second viewing location; and capturing said first and second panoramic views of the scene.
locating a first conical frustum mirror having a first outward facing concavely shaped peripheral surface within the scene so that the first mirror reflects a first 360 degree panoramic view of the scene toward a first viewing location;
locating a second conical frustum mirror within the scene, said second mirror inversely mounted with respect to said first mirror and having a common optical axis with respect to said first mirror, said second conical frustum mirror having a second outward facing concavely shaped peripheral surface so that the second mirror reflects a second 360 degree panoramic view of the scene toward a second viewing location, said first and second viewing locations being oppositely located on said common optical axis, locating a first image capture mechanism at said first viewing location;
locating a second image capture mechanism at said second viewing location; and capturing said first and second panoramic views of the scene.
18. The method of claim 17, including the further steps of:
dewarping said first and second panoramic views of the scene to produce first and second de-warped images of the scene; and combining said first and second dewarped images to produce a single de-warped image of the scene.
dewarping said first and second panoramic views of the scene to produce first and second de-warped images of the scene; and combining said first and second dewarped images to produce a single de-warped image of the scene.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CA 2324802 CA2324802C (en) | 2000-10-31 | 2000-10-31 | Panoramic imaging apparatus and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CA 2324802 CA2324802C (en) | 2000-10-31 | 2000-10-31 | Panoramic imaging apparatus and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CA2324802A1 CA2324802A1 (en) | 2002-04-30 |
| CA2324802C true CA2324802C (en) | 2009-01-13 |
Family
ID=4167518
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA 2324802 Expired - Fee Related CA2324802C (en) | 2000-10-31 | 2000-10-31 | Panoramic imaging apparatus and method |
Country Status (1)
| Country | Link |
|---|---|
| CA (1) | CA2324802C (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106919248A (en) * | 2015-12-26 | 2017-07-04 | 华为技术有限公司 | It is applied to the content transmission method and equipment of virtual reality |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2008066742A1 (en) * | 2006-11-22 | 2008-06-05 | Geng Z Jason | Wide field-of-view reflector and method of designing and making same |
| GB201218583D0 (en) * | 2012-10-16 | 2012-11-28 | Poliquin Yves | Remote controlled moving platform for a camera |
| CN112866583B (en) * | 2020-12-30 | 2022-06-21 | 深圳追一科技有限公司 | Data acquisition system, method, device, electronic equipment and storage medium |
| CN114527551B (en) * | 2022-01-27 | 2024-06-04 | 西安理工大学 | Object outer wall overall imaging system based on conical specular reflection |
-
2000
- 2000-10-31 CA CA 2324802 patent/CA2324802C/en not_active Expired - Fee Related
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106919248A (en) * | 2015-12-26 | 2017-07-04 | 华为技术有限公司 | It is applied to the content transmission method and equipment of virtual reality |
Also Published As
| Publication number | Publication date |
|---|---|
| CA2324802A1 (en) | 2002-04-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2363775C (en) | A symmetric, high vertical field of view 360 degree reflector using cubic transformations and method | |
| US7123777B2 (en) | System and method for panoramic imaging | |
| JP3485261B2 (en) | System and method for electronic imaging and processing of a hemispherical field of view | |
| US6424377B1 (en) | Panoramic camera | |
| US6905218B2 (en) | Panoramic and horizontally immersive image display system and method | |
| US7429997B2 (en) | System and method for spherical stereoscopic photographing | |
| US6856472B2 (en) | Panoramic mirror and system for producing enhanced panoramic images | |
| KR100898824B1 (en) | Method and imaging system for obtaining panoramic and rectilinear images using rotationally symmetric wide-angle lens | |
| TWI356186B (en) | Panoramic video system with real-time distortion-f | |
| US20030095338A1 (en) | System and method for panoramic imaging | |
| CN105530431A (en) | Reflective panoramic imaging system and method | |
| JP2004536351A (en) | A method for capturing a panoramic image using a rectangular image sensor | |
| CN110213475A (en) | A kind of image pickup method of panoramic picture | |
| CN108205236B (en) | Panoramic camera and lens thereof | |
| CA2324802C (en) | Panoramic imaging apparatus and method | |
| JP5507884B2 (en) | All-view panorama stereoscopic viewer | |
| CN110225328A (en) | A kind of city intelligent virtual imaging apparatus, imaging system and its modeling method | |
| CN210093397U (en) | City intelligent virtual imaging device and imaging system thereof | |
| JP3030680U (en) | Panoramic camera | |
| JP4199940B2 (en) | Imaging apparatus and imaging system | |
| KR200378727Y1 (en) | A full direction panorama replaying device using a conical mirror | |
| KR200378726Y1 (en) | A full direction panorama camera device using a conical mirror | |
| CA2439296A1 (en) | Panoramic mirror and system for producing panoramic images | |
| KR20200116682A (en) | Scanning mono and stereoscopic panoramic image acquisition device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request | ||
| MKLA | Lapsed |
Effective date: 20131031 |