CN111917940A - Variable temporal and spatial panoramic 360 degree camera object relational imaging analysis - Google Patents

Variable temporal and spatial panoramic 360 degree camera object relational imaging analysis Download PDF

Info

Publication number
CN111917940A
CN111917940A CN201910379988.XA CN201910379988A CN111917940A CN 111917940 A CN111917940 A CN 111917940A CN 201910379988 A CN201910379988 A CN 201910379988A CN 111917940 A CN111917940 A CN 111917940A
Authority
CN
China
Prior art keywords
sub
optic
panoramic
degree
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910379988.XA
Other languages
Chinese (zh)
Inventor
高登
姚金哈斯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beiting Xingyun Technology Beijing Co ltd
Original Assignee
Beiting Xingyun Technology Beijing Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beiting Xingyun Technology Beijing Co ltd filed Critical Beiting Xingyun Technology Beijing Co ltd
Priority to CN201910379988.XA priority Critical patent/CN111917940A/en
Publication of CN111917940A publication Critical patent/CN111917940A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/54Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B37/00Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe
    • G03B37/04Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe with cameras or projectors providing touching or overlapping fields of view
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/45Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/55Optical parts specially adapted for electronic image sensors; Mounting thereof

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Studio Devices (AREA)
  • Stereoscopic And Panoramic Photography (AREA)

Abstract

Methods and systems are provided for variable temporal and spatial panoramic 360 degree camera object relational imaging analysis of large (e.g., gigapixel) images with high image quality using optical imaging systems with small form factors. The disclosed system can be manufactured in a cost-effective manner and can be easily assembled, aligned, tested, and utilized. One such system includes a panoramic 360 degree primary optic comprising one or more surfaces adapted to form a symmetrical arrangement about a common origin. The system also includes a secondary optic comprising a plurality of secondary optic sub-components, wherein each secondary optic sub-component can intercept at least a portion of the light collected by the panoramic 360 degree primary optic. The combination of the primary optic and the secondary optic is adapted to form an image.

Description

Variable temporal and spatial panoramic 360 degree camera object relational imaging analysis
Technical Field
This patent document relates to imaging optics, including apparatus, methods, and materials related to the development of optical lenses and imagers (imagers).
Background
The optical design of an imager can be affected by various characteristics including specific optical performance (e.g., image resolution, image quality, etc.), system cost, power consumption, weight, and physical footprint. Optical systems for providing large pixel counts (e.g., greater than 2000 thousand pixels) include complex optics and rather large image sensors that may affect physical factors. Some factors that produce high quality images include the size of the imager used and aberrations associated with the various optical elements.
Disclosure of Invention
The disclosed embodiments relate to methods and systems for capturing very large (e.g., gigapixels) images with high image quality using optical imaging systems with smaller form factors. The disclosed systems and methods can be manufactured in a cost-effective manner and can be easily assembled, aligned, tested, and utilized in accordance with the disclosed methods.
One aspect of the disclosed embodiments relates to a system comprising a panoramic 360 degree primary optic comprising one or more surfaces adapted to form a symmetrical arrangement about a common origin. The system further includes a secondary optic module comprising a plurality of secondary optic sub-assemblies, wherein each secondary optic sub-assembly is adapted to intercept at least a portion of the light collected by the panoramic 360 degree primary optic, and wherein the combination of the primary and secondary optics is adapted to form an image. In one example embodiment, the one or more surfaces adapted to form a symmetrical arrangement comprise a spherical or hemispherical arrangement about a common origin.
In one exemplary embodiment, each secondary optic sub-assembly fits within a cone radiating from a common origin of the primary optic. In another exemplary embodiment, each secondary optic sub-assembly is adapted to correct on-axis aberrations produced by the panoramic 360 degree primary optic, and each secondary optic sub-assembly includes components that are rotationally symmetric about the optical axis of the respective secondary optic sub-assembly. In yet another exemplary embodiment, all of the secondary optic sub-assemblies are substantially similar to one another.
According to another exemplary embodiment, the separate fields of view of each secondary optical sub-assembly may be combined by post-detection processing into a single continuous image covering a wide field of view. In yet another exemplary embodiment, the system includes an aperture stop within each secondary optic sub-assembly for each combination of primary optic-secondary optic sub-assembly. According to another exemplary embodiment, at least a portion of the primary optic provides an optomechanical reference surface for aligning the secondary optic sub-assembly.
In one exemplary embodiment, the primary optic of the above system comprises a generally spherical or hemispherical element. In another exemplary embodiment, the secondary optic includes a plurality of sub-assemblies, and each sub-assembly includes a plurality of lenses. For example, each sub-component may include a Cuk three-piece lens. In another example, each sub-assembly may include a field lens and a plurality of secondary lenses. According to another exemplary embodiment, at least a portion of the secondary optic provides mechanical registration of the secondary lens with the various remaining elements of the detector system.
In one exemplary embodiment, the images are formed in a plurality of discrete image areas, where each image area corresponds to a field of view captured by the combination of the panoramic 360 degree primary optic and secondary optic sub-assembly. In this exemplary embodiment, the system may further include a plurality of image sensing elements located at the plurality of discrete image areas and configured to sense an image formed at each of the plurality of discrete image areas.
Another aspect of the disclosed embodiments relates to an integrated imaging system, comprising: a panoramic 360 degree objective lens; and one or more substantially hemispherical three-dimensional optical components positioned to at least partially surround the panoramic 360 degree objective lens. Each three-dimensional optical component includes a plurality of optical elements, and each of the plurality of optical elements is positioned to intercept light collected by the panoramic 360 degree objective at a particular field of view. The integrated imaging system also includes a plurality of image sensors, wherein each image sensor of the plurality of image sensors is integrated into a respective sub-component of the WLC optics.
Another aspect of the disclosed embodiments relates to an integrated imaging system, comprising: a panoramic 360 degree objective lens; and a hemispherical three-dimensional field optic positioned to at least partially surround the panoramic 360 degree objective lens. The three-dimensional field optics includes a plurality of field elements, wherein each of the plurality of field elements is positioned to intercept light collected by the panoramic 360 degree objective at a particular field of view. The integrated imaging system described above also includes a Wafer Level Camera (WLC) optic comprising a plurality of subcomponents, wherein the WLC optic is positioned around the hemispherical three-dimensional field optic such that each subcomponent of the WLC optic is aligned with a respective field element. The integrated imaging system also includes a plurality of image sensors, wherein each image sensor of the plurality of image sensors is integrated into a respective sub-component of the WLC optical portion.
Another aspect of the disclosed embodiments relates to a method comprising receiving light at a panoramic 360 degree primary optic of a panoramic 360 degree multi-scale imaging device, wherein the panoramic 360 degree primary optic comprises one or more surfaces adapted to form a symmetrical arrangement about a common origin. The method also includes forming an image using a secondary optic of the panoramic 360 degree multi-scale imaging device, wherein the secondary optic includes a plurality of secondary optic sub-assemblies, and wherein each secondary optic sub-assembly is adapted to intercept at least a portion of the light received by the panoramic 360 degree primary optic.
Another aspect of the disclosed embodiments relates to an imaging system, comprising: a panoramic 360 degree primary optic comprising one or more surfaces adapted to form a symmetrical arrangement about a common origin to collect at least a portion of light associated with an image to be formed and output the collected light; a secondary optic comprising a plurality of secondary optic sub-components arranged at different field angles to capture different portions of the collected light output by the panoramic 360 degree primary optic at different field angles, wherein each secondary optic sub-component is adapted to capture at least a portion of the light collected and output by the panoramic 360 degree primary optic, wherein the light captured by each secondary optic sub-component is used to form a sub-image, and wherein the combination of the primary optic and the secondary optic is adapted to facilitate the formation of successive and collectively representative sub-images of the image based on the at least a portion of the light collected by the panoramic 360 degree primary optic; and an aperture stop for each combination of primary optic-secondary optic sub-assembly, wherein the aperture stop is located within the secondary optic sub-assembly.
Optionally, wherein the panoramic 360 degree primary optic is substantially a panoramic 360 degree.
Optionally wherein each of the secondary optical sub-assemblies is located within a cone radiating from a common origin of the primary optical component.
Optionally, wherein all of the secondary optics have substantially similar shapes, materials and focal planes.
Optionally, the system comprises: a plurality of imaging sensors coupled to receive captured light from the plurality of secondary optic subcomponents, respectively, to form successive sub-images; and a signal processing section combining successive sub-images from the imaging sensor into a single image.
Optionally wherein at least a portion of the primary optic provides an optomechanical reference surface for aligning one of the secondary optic sub-components.
Optionally wherein the primary optic comprises a spherical or hemispherical element.
Optionally, wherein each secondary optic sub-assembly comprises a plurality of lenses.
Optionally, wherein each secondary optical sub-assembly comprises a field lens adjacent the internal image plane and one or more secondary lenses forming an image of the internal image plane, the image of the internal image plane representing a respective sub-image.
Optionally wherein at least a portion of the secondary optic provides lateral mechanical registration of the various remaining elements of the secondary optic.
Optionally wherein the images are formed in a plurality of discrete image areas, each image area corresponding to a field of view captured by the combination of the panoramic 360 degree primary optic and secondary optic sub-assembly and representing a respective sub-image.
Optionally, the system further comprises a plurality of image sensing elements located at the plurality of discrete image areas and configured to sense respective sub-images formed at the plurality of discrete image areas.
Another aspect of the disclosed embodiments relates to an imaging system comprising: a panoramic 360 degree primary optic comprising one or more surfaces adapted to form a symmetrical arrangement about a common origin to collect at least a portion of light associated with an image to be formed and output the collected light; a secondary optic comprising a plurality of secondary optic sub-components arranged at different angles of view, to capture different portions of the collected light output by the panoramic 360 degree primary optic at different field angles, wherein each secondary optic sub-assembly is adapted to capture at least a portion of the light collected and output by the panoramic 360 degree primary optic, wherein the light captured by each secondary optic sub-assembly is used to form sub-images, and wherein the combination of the primary optic and the secondary optic is adapted to facilitate the formation of successive and collectively representative sub-images of the image based on at least a portion of the light captured by the panoramic 360 degree primary optic, wherein each of the secondary optic sub-assemblies is adapted to correct on-axis aberrations produced by the panoramic 360 degree primary optic, and each of the secondary optic sub-assemblies comprises a component that is rotationally symmetric about the optical axis of the respective secondary optic sub-assembly.
Optionally, the system comprises an aperture stop for each combination of primary optic-secondary optic sub-assembly, wherein the aperture stop is located within the secondary optic sub-assembly. Another aspect of the disclosed embodiments relates to an integrated imaging system comprising: a substantially panoramic 360 degree objective lens to capture at least a portion of light associated with an image to be formed; one or more substantially hemispherical three-dimensional optical components positioned to at least partially surround the substantially panoramic 360 degree objective, wherein each of the three-dimensional optical components comprises a plurality of optical elements, each of the plurality of optical elements positioned to capture at least a portion of the light collected by the substantially panoramic 360 degree objective at a particular field of view; and a plurality of image sensors, wherein each image sensor of the plurality of image sensors is integrated into a respective sub-component of the wafer level camera optics, wherein the plurality of image sensors are configured to receive light captured by the respective optics to form successive sub-images when combined to form an image.
Optionally, wherein each three-dimensional optical component is configured to correct on-axis aberrations produced by the substantially panoramic 360 degree objective lens.
Another aspect of the disclosed embodiments relates to a method of imaging comprising: receiving light at a substantially panoramic 360 degree primary optic of a substantially panoramic 360 degree multi-scale imaging device, the substantially panoramic 360 degree primary optic comprising one or more surfaces adapted to form a substantially symmetrical arrangement about a common origin; and forming an image using a secondary optic of the substantially panoramic 360 degree multi-scale imaging device, the secondary optic comprising a plurality of secondary optic sub-assemblies arranged at different field angles to capture portions of the light output by the substantially panoramic 360 degree primary optic at different field angles, wherein each secondary optic sub-assembly is adapted to capture at least a portion of the light received by the substantially panoramic 360 degree primary optic, the light captured by each secondary optic sub-assembly being used to produce a respective sub-image; and providing an aperture stop for each combination of primary optic-secondary optic within a secondary optic sub-assembly of the substantially panoramic 360 degree multi-scale imaging device, wherein forming an image comprises combining successive sub-images produced by the secondary optic sub-assembly into a single image.
Optionally, the method further comprises: the secondary optic sub-assembly is aligned using at least a portion of the primary optic as an optomechanical reference plane.
Optionally, wherein forming the image comprises generating successive sub-images comprising a plurality of discrete images, and wherein each of the plurality of discrete images corresponds to a field of view of the panoramic 360 degree multi-scale imaging device captured by a combination of the panoramic 360 degree primary optic and the secondary optic sub-assembly.
Optionally, the method further comprises: each of the plurality of discrete images is sensed using image sensing elements located at a plurality of discrete image locations.
Another aspect of the disclosed embodiments relates to a method of imaging comprising: receiving light at a substantially panoramic 360 degree primary optic of a substantially panoramic 360 degree multi-scale imaging device, the substantially panoramic 360 degree primary optic comprising one or more surfaces adapted to form a substantially symmetrical arrangement about a common origin; forming an image using a secondary optic of the substantially panoramic 360 degree multi-scale imaging device, the secondary optic comprising a plurality of secondary optic sub-assemblies arranged at different field angles so as to capture portions of light output by the substantially panoramic 360 degree primary optic at different field angles, wherein each secondary optic sub-assembly is adapted to capture at least a portion of the light received by the substantially panoramic 360 degree primary optic, the light captured by each secondary optic sub-assembly being used to produce a respective sub-image; and using each secondary optic sub-assembly to correct on-axis aberrations produced by the panoramic 360 degree primary optic in forming respective individual sub-images from the captured light, wherein forming the image comprises combining successive sub-images produced by the secondary optic sub-assemblies into a single image.
Optionally, the method further comprises: within the secondary optic sub-assembly of the substantially panoramic 360 degree multi-scale imaging device, an aperture stop is provided for each combination of primary optic-secondary optic sub-assembly.
Drawings
FIG. 1 shows a portion of a system for acquiring high resolution images according to an exemplary embodiment;
FIG. 2 illustrates other portions of the system shown in FIG. 1;
fig. 3 illustrates a panoramic 360 degree primary optic according to an exemplary embodiment.
Detailed Description
Practical implementation of high quality, high resolution imaging devices is challenging. These challenges are due in part to the expense associated with manufacturing ultra-large area image sensors. For example, a large astronomical telescope with a focal plane of 3.2 giga pixels, using 189,4K by 4K 10 μm pixel CCDs and a field of view of 9.6 degrees at a planar image plane of 640mm, is expected to occupy 8 cubic meters of space, at a cost of about $ 1.05 billion.
Another challenge is related to the aberration scaling of large image plane lenses. That is, lens aberrations scale with size such that a lens system with a diffraction limit at, for example, 10mm focal length (e.g., a Cuk triplet lens) will fail due to aberrations when configured to operate at 100mm focal length.
One approach for producing very high resolution (e.g., gigapixel) imagers is to utilize a multiple micro-camera array configuration in which stitched images can be acquired by a large number of independent cameras. In particular, such a micro-camera array may be arranged to comprise n independent diffraction limited cameras, each camera having a focal plane with S pixels. Each camera may be configured as part of a cylindrical package, where the diameter of the cylinder is the input aperture of the camera, and each camera may generate a separate sample image of the field. In such a micro-camera array, in order to acquire high resolution images, the field of view of each individual camera should have minimal overlap with adjacent cameras. To be able to capture higher resolution images using such a micro-camera system, the focal length of the individual cameras must be increased, thereby increasing the physical volume, weight, and overall cost of the camera array. These costs are prohibitively high for practical implementations of very high resolution imagers (e.g., where images in the range of several gigapixels are required).
To reduce the cost and size associated with a microphotograph array, some systems use a "multi-scale" lens design that includes a common primary optic and then multiple secondary optics. In such a multi-scale system, the primary optics may be curved to minimize aberrations, and the secondary lenses may each be designed to correct off-axis aberrations of the primary lens at the associated field angle. Multi-scale imagers typically produce segmented image planes with overlapping images that can be digitally processed and joined together to produce a single large image. However, such a split image plane does not require a large-scale planar focal plane array, and is therefore advantageous for constructing a high-resolution imager having a small size. In addition, such multi-scale configurations provide better aberration scaling (scaling of aberrations) for low-f iotaeld gigapixel imagers.
However, practical implementation of such multi-scale imagers remains challenging because the fabrication of the free-form (non-rotationally symmetric) aspheric components associated with the secondary optics is not straightforward. Furthermore, the lenses in the secondary portion (i.e., the free-form optics without an axis of symmetry) must be separately manufactured and positioned in three-dimensional space with high precision to correct for the aberrations associated with each field angle. In this way, each image plane may be oriented at a different scale or angle. These and other drawbacks of multi-scale lens designs make it difficult to produce cost-effective imaging systems that can be physically scaled to gigapixel resolution.
The disclosed embodiments relate to methods, apparatus and systems that are capable of producing extremely high resolution images while utilizing optical components that can be manufactured and implemented feasibly within a compact imaging system. Such imaging systems may be manufactured, at least in part, through the use of primary optics configured to produce the same off-axis aberrations for all angles of view. The primary optics providing the common aperture are radially symmetric and constitute a panoramic 360 degree lens. That is, the primary optic includes one or more surfaces adapted to form a symmetrical arrangement about a common origin. It should be noted that the term lens is used herein to include a single lens (or simple lens) as well as a compound lens that includes more than one optical element. In some embodiments, the panoramic 360 degree lens is comprised of one or more spherical or hemispherical portions having a common center of curvature. This panoramic 360 degree configuration provides a curved image plane and produces the same or nearly the same aberrations at each field angle. It should be noted that the terms spherical and hemispherical are used to express surfaces or portions that are substantially spherical or hemispherical. For example, the geometry of such surfaces or portions may deviate from a perfect sphere or hemisphere due to manufacturing limitations.
The high resolution imager of the disclosed embodiments also includes a secondary optic configured to correct for residual on-axis aberrations of the panoramic 360 degree primary optic at each field angle that is the same or nearly the same. Because the aberrations are on-axis, the secondary optic can be constructed using rotationally symmetric components (e.g., spheres) rather than free-form optics as used in other multi-scale designs. The use of a rotationally symmetric sphere in the secondary optic allows for the use of convenient manufacturing processes, e.g., some mature commercial manufacturing processes, and facilitates the construction of imagers using simple alignment techniques.
In some embodiments, each sub-component of the secondary optic is limited to fitting within a cone radiating from a common origin of the first optic. In this way, as long as the secondary optic sub-assembly is confined within the cone, adjacent secondary optic sub-assemblies can be added without overlapping the acquired image sub-assembly.
FIG. 1 illustrates a portion of a system for acquiring high resolution images according to an exemplary embodiment. The panoramic 360 degree primary optic 102 includes one or more common spherical optics 104 having a common point of symmetry that, in the exemplary configuration of fig. 1, is centered within the panoramic 360 degree primary optic 102. Fig. 1 also depicts the secondary optic 106 contained within a cone 108 radiating from a common origin of the primary optic 102. An image sensing device or element 110 (e.g., a CCD or CMOS imaging sensor element) captures light collected by the combination of primary and secondary optics at a particular field angle (in the exemplary configuration of fig. 1, only the on-axis conical portion is depicted). In an implementation, a plurality of imaging sensors or elements 110 are provided in an array configuration and placed in a symmetrical arrangement at different locations about a common origin. For example, a plurality of imaging sensors or elements 110 may be placed on a curved surface. Circuitry or a digital processor within signal processing component 112 may be used to process the outputs from multiple imaging sensors or elements 110 and combine the outputs to form a single composite image. This combined process may be performed by software.
In some embodiments, the signal processing component 112 includes at least one processor and/or controller, at least one memory unit in communication with the processor, and at least one communication unit capable of exchanging data and information directly or indirectly with other entities, devices, databases, and networks via communication links. A communication unit may provide wired and/or wireless communication capabilities according to one or more communication protocols and, thus, may include appropriate transmitter/receiver antennas, circuitry, and ports, as well as encoding/decoding capabilities as needed to properly transmit and/or receive data and other information.
Fig. 2 shows the rest of the system shown in fig. 1. In particular, the central secondary optic 106 is depicted with two adjacent (and physically non-overlapping) secondary optic subcomponents 208, 210 and +60 degree and-60 degree secondary optic subcomponents 212, 214. Other secondary optical sub-assemblies (i.e., sub-imagers) may be added as needed to acquire an image of a given desired field of view. The optical design of the secondary optics should preferably provide overlapping fields of view so that images acquired by adjacent secondary optical paths can be combined to provide a seamless composite image. Such combination may be implemented, at least in part, using signal processing components 112. In the exemplary configuration of FIG. 2, all of the secondary optic sub-assemblies may be substantially similar to each other (and to the central secondary optic sub-assembly 106), having substantially similar focal planes. Thus, the high resolution imaging system of fig. 2 can be mass produced at a lower cost than the multi-stage imagers discussed above, and can be assembled relatively easily due to its loose alignment tolerances. It should be noted that the plurality of secondary optical sub-assemblies have been described as being substantially similar to one another. Such defects are characterized by optical materials, variability in the manufacturing process, and other sources of variation that are present in most, if not all, actual manufacturing and assembly processes.
Fig. 3 illustrates a panoramic 360 degree primary optic according to an exemplary embodiment. The exemplary panoramic 360 degree primary optic of fig. 3 includes 5 elements 302, 304, 306, 308, 310 with a curved focal plane 312. In one exemplary embodiment, the exemplary panoramic 360 degree primary optic of fig. 3 has a focal ratio of 3, an effective focal length of 223mm, a full field of view of 100 degrees, and a length of 317 mm. The total length L is 339 mm. In one exemplary embodiment, five elements of the panoramic 360 degree primary optic are composed of the following glass materials: H-LAK4L, N-PK51, PK51A, H-ZLAF68 and KZFSN 5. The exemplary panoramic 360 degree primary optic of fig. 3 is capable of providing images up to 10 gigapixels over a 100 degree field of view.
Various embodiments described herein are described in the general context of methods or processes, which may be implemented at least in part by a computer program product, embodied in a computer-readable medium, including computer-executable instructions, e.g., program code, executed by computers in network environments. The computer-readable medium may include removable and non-removable storage devices, including, but not limited to, read-only memory (ROM), random-access memory (RAM), Compact Discs (CDs), Digital Versatile Discs (DVDs), Blu-ray discs, and the like. Thus, the computer-readable media described herein include non-transitory storage media. Generally, program modules may include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. Computer-executable instructions, associated data structures, and program modules represent examples of program code for executing steps of the methods disclosed herein. The particular sequence of such executable instructions or associated data structures represents examples of corresponding acts for implementing the functions described in such steps or processes.
While this specification contains many specifics, these should not be construed as limitations on the scope of any invention or of what may be claimed, but rather as descriptions of features specific to particular embodiments of particular inventions. Certain features that are described in this specification in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination. Furthermore, although features may be described above as acting in certain combinations and even initially claimed as such, one or more features from a claimed combination can in some cases be excised from the combination, and the claimed combination may be directed to a subcombination or variation of a subcombination.

Claims (10)

1. An imaging system, comprising:
a panoramic 360 degree primary optic comprising one or more surfaces adapted to form a symmetrical arrangement about a common origin to collect at least a portion of light associated with an image to be formed and output the collected light;
a secondary optic comprising a plurality of secondary optic sub-components arranged at different field angles to capture different portions of the collected light output by the panoramic 360 degree primary optic at the different field angles, wherein each of the secondary optic sub-components is adapted to capture at least a portion of the light collected and output by the panoramic 360 degree primary optic, wherein the light captured by each of the secondary optic sub-components is used to form a sub-image, and wherein the combination of the primary optic and the secondary optic is adapted to facilitate the formation of successive sub-images collectively representing the image based on the at least a portion of the light collected by the panoramic 360 degree primary optic; and
an aperture stop for each combination of primary optic-secondary optic sub-assembly, wherein the aperture stop is located within the secondary optic sub-assembly.
2. The system of claim 1 wherein the panoramic 360 degree primary optic is substantially a panoramic 360 degree.
3. The system of claim 1, wherein each of the secondary optical sub-assemblies is located within a cone radiating from a common origin of the primary optical component.
4. The system of claim 1, wherein all of said secondary optic subcomponents have substantially similar shapes, materials and focal planes.
5. The system of claim 1, comprising: a plurality of imaging sensors coupled to receive captured light from the plurality of secondary optical sub-components, respectively, to form a succession of the sub-images; and a signal processing component that combines successive said sub-images from said imaging sensor into a single image.
6. The system of claim 1 wherein at least a portion of the primary optic provides an optomechanical reference surface for aligning one of the secondary optic subcomponents.
7. The system of claim 1 wherein the primary optic comprises a spherical or hemispherical element.
8. The system of claim 1, wherein each of said secondary optical sub-assemblies comprises a plurality of lenses.
9. An imaging system, comprising:
a panoramic 360 degree primary optic comprising one or more surfaces adapted to form a symmetrical arrangement about a common origin to collect at least a portion of light associated with an image to be formed and output the collected light;
a secondary optic comprising a plurality of secondary optic sub-components arranged at different field angles to capture different portions of the collected light output by the panoramic 360 degree primary optic at the different field angles, wherein each of the secondary optic sub-components is adapted to capture at least a portion of the light collected and output by the panoramic 360 degree primary optic, wherein the light captured by each of the secondary optic sub-components is used to form a sub-image, and wherein the combination of the primary optic and the secondary optic is adapted to facilitate the formation of successive sub-images collectively representing the image based on the at least a portion of the light collected by the panoramic 360 degree primary optic, wherein each of the secondary optic sub-components is adapted to correct for on-axis aberrations produced by the panoramic 360 degree primary optic, and each of the secondary optic sub-assemblies comprises a component that is rotationally symmetric about the optical axis of the respective secondary optic sub-assembly.
10. An integrated imaging system, comprising:
a substantially panoramic 360 degree objective lens to capture at least a portion of light associated with an image to be formed;
one or more substantially hemispherical three-dimensional optical components positioned to at least partially surround the substantially panoramic 360 degree objective, wherein each of the three-dimensional optical components comprises a plurality of optical elements, each of the plurality of optical elements positioned to capture at least a portion of the light collected by the substantially panoramic 360 degree objective at a particular field of view; and
a plurality of image sensors, wherein each of the plurality of image sensors is integrated into a respective sub-component of the wafer level camera optics, wherein the plurality of image sensors are configured to receive the light captured by the respective optics to form successive sub-images when combined to form an image.
CN201910379988.XA 2019-05-08 2019-05-08 Variable temporal and spatial panoramic 360 degree camera object relational imaging analysis Pending CN111917940A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910379988.XA CN111917940A (en) 2019-05-08 2019-05-08 Variable temporal and spatial panoramic 360 degree camera object relational imaging analysis

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910379988.XA CN111917940A (en) 2019-05-08 2019-05-08 Variable temporal and spatial panoramic 360 degree camera object relational imaging analysis

Publications (1)

Publication Number Publication Date
CN111917940A true CN111917940A (en) 2020-11-10

Family

ID=73242980

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910379988.XA Pending CN111917940A (en) 2019-05-08 2019-05-08 Variable temporal and spatial panoramic 360 degree camera object relational imaging analysis

Country Status (1)

Country Link
CN (1) CN111917940A (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6611282B1 (en) * 1999-01-04 2003-08-26 Remote Reality Super wide-angle panoramic imaging apparatus
CN101122734A (en) * 2006-08-11 2008-02-13 船井电机株式会社 Panoramic imaging device
CN103698900A (en) * 2013-12-30 2014-04-02 苏州大学 Optical imaging method and system for large-scale high-resolution remote sensing camera

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6611282B1 (en) * 1999-01-04 2003-08-26 Remote Reality Super wide-angle panoramic imaging apparatus
CN101122734A (en) * 2006-08-11 2008-02-13 船井电机株式会社 Panoramic imaging device
CN103698900A (en) * 2013-12-30 2014-04-02 苏州大学 Optical imaging method and system for large-scale high-resolution remote sensing camera

Similar Documents

Publication Publication Date Title
US9482850B2 (en) Monocentric imaging
US9860443B2 (en) Monocentric lens designs and associated imaging systems having wide field of view and high resolution
JP5881679B2 (en) Multi-scale optical system based on a lens group with a single center and its use
JP6555264B2 (en) Compound eye imaging device
KR101583646B1 (en) Method and apparatus for generating omnidirectional plane image
JP2010504014A (en) Image system with improved image quality and associated method
CN111182191A (en) Wide-field high-resolution camera shooting equipment and method based on aberration compensation calculation
TWI610107B (en) Lens array for partitioned image sensor
CN103064171A (en) Novel high resolution large visual field optical imaging system
WO2012061571A1 (en) Camera systems and methods for gigapixel computational imaging
Moens et al. An insect eye-based image sensor with very large field of view
JP7378920B2 (en) Optical device and imaging system equipped with the same
CN108663778A (en) Wide-angle high-definition imaging system with mixed bionic fisheye-compound eye structure
CN111917940A (en) Variable temporal and spatial panoramic 360 degree camera object relational imaging analysis
Hiura et al. Krill-eye: Superposition compound eye for wide-angle imaging via grin lenses
EP3679415B1 (en) Contact lens inspection system and method
Wu et al. Heterogeneous compound eye camera for dual-scale imaging in a large field of view
US8982270B2 (en) Deformable focal plane array
US20240007747A1 (en) Camera system, mobile device and method of operating a mobile device for multi-focus imaging
Ganesh et al. Compact high resolution multi-aperture LWIR imaging system
Druart et al. Integration of wide field-of-view imagery functions in a detector dewar cooler assembly
US20210037183A1 (en) Monocentric multiscale (mms) camera having enhanced field of view
Liu et al. Monocentric imaging system with wide field of view and high resolution for distant view observation
EP3533216B1 (en) An optical arrangement for focusing images of a three-dimensional space from different divergent perspectives onto a camera sensor
Jahn et al. Wafer-level curved sensor manufacturing process for enhanced optical system designs

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20201110