WO2012029063A1 - Rotary image generator - Google Patents

Rotary image generator Download PDF

Info

Publication number
WO2012029063A1
WO2012029063A1 PCT/IL2011/000701 IL2011000701W WO2012029063A1 WO 2012029063 A1 WO2012029063 A1 WO 2012029063A1 IL 2011000701 W IL2011000701 W IL 2011000701W WO 2012029063 A1 WO2012029063 A1 WO 2012029063A1
Authority
WO
WIPO (PCT)
Prior art keywords
images
image
rotary
camera
captured
Prior art date
Application number
PCT/IL2011/000701
Other languages
French (fr)
Inventor
Raul Goldemann
Original Assignee
Raul Goldemann
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Raul Goldemann filed Critical Raul Goldemann
Priority to US13/819,705 priority Critical patent/US20130162761A1/en
Priority to EP11769942.1A priority patent/EP2612491A1/en
Publication of WO2012029063A1 publication Critical patent/WO2012029063A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/698Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture

Definitions

  • the present invention relates to image capture in general, and in particular to capturing, generating and displaying moving images surrounding a rotary image generator.
  • Video cameras are the common tool to use for capturing moving images.
  • a video camera can capture images of the same location over a period of time, when the camera is still.
  • the camera can be moved in a sweeping motion in order to capture images of different areas (an action commonly referred to as "panning"). If the panning motion is too quick or abrupt, the captured images quality frequently degrades and the image becomes blurred or fuzzy.
  • Certain applications or circumstances such as surveillance cameras or military vehicles require capturing images in real time of the entire surroundings, for example a 360 degrees view, referred to herein as “panoramic view” or “360 degrees view”, around the camera location.
  • a single video camera is unable to produce clear images in real time of the entire 360 degrees area surrounding the camera.
  • the present invention relates to a rotary system for capturing images of the surroundings, comprising:
  • a camera comprising one or more image sensors, one or more image sensor engines and one or more lenses for capturing a plurality of still images per second;
  • controller unit for controlling the rotary's rotation speed and for controlling the camera's image capture
  • the rotating camera takes a plurality of still images, each still image taken in a predetermined view angle and stored in said image buffer, such that the display unit can display from the images in the image buffer one or more views of the surrounding in a moving images view.
  • the images captured in one rotation of the rotary system cover the entire panorama of the surroundings in a field of view of 360 degrees vertically by up to 360 degrees horizontally.
  • every image captured overlaps with the previously captured image.
  • every image captured overlaps by 5% or less with the previously captured image.
  • every image captured does not overlap with the previously captured image.
  • placing the images taken side by side in chronological order produces in real time a panoramic view of the surroundings after compensating for overlaps in sequential image captures.
  • the series of still images taken with a plurality of view angles are displayed on one or more display devices.
  • the rotary rotates with variable rotation speeds.
  • the camera or the rotary or both can tilt.
  • the camera or the rotary or both can tilt upwards, downwards or in any angle.
  • the display unit can also display still images.
  • the display unit enables to zoom in a still image or a stream of moving images.
  • the image buffer resides in a video card, the camera, the controller, the display unit or any combination thereof.
  • the image buffer is a transfer link (such as data link or optical link) communicating directly between the camera and display unit.
  • system further comprises a permanent storage for saving the captured images.
  • the display unit can perform search and retrieval operations using the saved images in the permanent storage, and process any array of stored images into moving images and/or spherical moving images.
  • the search and retrieval operations comprise: pausing a moving image sequence, resuming to real time viewing, rewinding a moving image sequence, advancing a moving image sequence or any combination thereof.
  • the present invention further relates to a rotary method for capturing moving images of the surroundings, the method comprising the steps of:
  • Fig. 1 shows an embodiment of a rotary image generator of the invention.
  • Figs. 2A-2D show four examples of a miniature standalone system.
  • the rotating platform is inside an outer case which can be fixed to an asset or vehicle.
  • Fig. 2A shows a system with a single camera;
  • Fig. 2B shows a system with a single camera, wherein the camera is tilted;
  • Fig. 2C shows a system with a two cameras, one for day capture and one for night capture;
  • Fig. 2D shows a system with a two cameras, wherein the cameras are tilted.
  • Fig. 3 shows 100 images captured in 10 rotations, wherein each row shown the different images captured in that rotation, and each column shows images of the same view angle taken in different rotations.
  • Fig. 4 shows a column of images from Fig. 3 shot at the same view angle that is composed into a sequence of images in motion.
  • Fig. 5 shows a row of images from Fig. 3 shot in one rotation (10 images shown on top). When these images are stitched together, they form a panoramic view to cover a 360 degree field of view as shown below.
  • Fig. 6 shows an example of a micro air vehicle according to the invention.
  • Fig. 7 is a block diagram of the major components of a rotary system according to some embodiments. MODES FOR CARRYING OUT THE INVENTION
  • the present invention relates to a rotary system for capturing and displaying in real time spherical moving images of the surrounding scene in any resolution preferably in high resolution.
  • the rotary system comprises a camera, an image buffer, a rotary, a controller and a display unit.
  • the camera comprises an image sensor, an image sensor engine and lens where the camera rotates continuously around an axis.
  • the rotation speed is typically at least 120 rpm to speeds of up to 2,880 rpm or more in order to take numerous still images shots (captures) in a fraction of a second.
  • the invention enables to display the full sphere or any number of portions of it in any number of display devices in real time.
  • the term "real time” as used herein means a response time from capturing an image to displaying the image in the order of a fraction of a millisecond.
  • the camera is capable of taking a large number of images per second.
  • One camera used for testing is capable to capture up to 1 ,200 frames per second.
  • the camera is mounted on a rotary, such as a transportable pod with variable rotation speeds.
  • One configuration tested rotated at a rotation speed of up to 1,440 rounds per minute.
  • Tables 2 and 3 describe several configurations for day and night image capture.
  • An image sensor is a device that converts an optical image into an electronic signal.
  • a charge-coupled device CCD
  • CMOS complementary metal- oxide-semiconductor
  • the rotary can use any rotation mechanisms known in the industry such as a rotation motor, though other rotation mechanisms are know, for example, using air or fluids and all known and future rotation mechanisms are considered to be part of the invention.
  • the invention can work in real time mode, wherein the images captured are buffered, processed into moving images and displayed immediately.
  • a real time buffer for holding the captured images can be the memory of a video card, the memory of a camera, memory of an image sensor, the memory on a controller, the memory of a real-time processing unit or any combination thereof.
  • the image buffer can be a transfer link, such as data link or optical link, communicating directly between the camera and display unit.
  • Such memory can be both volatile and/or non volatile memory. It is also possible to use memories on different locations.
  • the system can use a permanent storage for storing the captured images.
  • the permanent storage may be one or more storage devices such as hard drives, typically large enough to save minutes if not hours of recordings.
  • the display unit can perform search and retrieval operations using the captured images in the permanent storage, and process any array of stored images into moving images.
  • displaying moving images means that a sequence of still images is displayed on a display device (screen), which for the user looks the same as watching a video or a movie.
  • the data is not in a video format, such as MPEG, but the data is a plurality of still images displayed rapidly.
  • the system's controller unit controls the rotary's speed and the camera's image capture.
  • the controller unit controls the image capture of the camera via a trigger.
  • a trigger initiates the capture of single or multiple images of a camera by analyzing the signals of its sensor. Any trigger in the industry can be used with the invention.
  • the trigger is not affected by the speed of rotation. It uses an absolute angle position around the rotating axis. At this location the camera receives a pulse which gives it a signal to capture an image at the location of the receipt of the signal. As the location is absolute, images are taken always at exactly the same absolute angles. Using such trigger methods is useful in order to avoid an effect of sweeping away of moving images.
  • the trigger is also able to action other devices then the camera, for example, lighting devices.
  • Electro-optical sensors are electronic detectors that convert light, or a change in light, into an electronic signal. They are used in many industrial and consumer applications, for example, lamps that turn on automatically in response to darkness.
  • Hall effect based image triggers • Hall effect based image triggers.
  • the Hall effect is the production of a voltage difference (the Hall voltage) across an electrical conductor, transverse to an electric current in the conductor and a magnetic field perpendicular to the current.
  • the display unit is responsible for displaying the images in the image buffer in a moving images view in real time according to different criteria and parameters. For example, the display unit can simultaneously open any number of high- resolution views of the spherical moving picture. In one example, more than 30 different views were opened. The display unit can enable the user to zoom in and out of any view.
  • the system can perform all the operations as if it was in real time mode. The difference being that instead of capturing new images, the display unit would use the captured images from the permanent storage. Any combination, number, location and size of regions of interest can be created/displayed in permanent storage mode, exactly like in real time mode.
  • One advantage of the rotary system of the invention is that it can generate multiple (and different) views of the surroundings, a useful feature whenever one needs the ability to look in several different directions at the same time, or quickly change directions.
  • the system is able to deliver an unlimited number of different views to different users simultaneously with a single capture device, without losing image information.
  • the different views can be generated by the display unit to a single screen where the user chooses each time which view to watch or alternatively several screens (including geographically distant screens) can be used where each user can choose on each screen which view to watch.
  • the rotary system of the invention enables the integration of night and day vision into the same system.
  • Two different image sensors can be mounted into the same camera, a day image sensor and a night image sensor. This is made possible because the image data of both sensors can be transmitted through one data connection - possible due to the control of the trigger.
  • the trigger signals can be split among image sensors to provide signals to both the day and the night image sensors as required, whereas the day and the night image sensor receive alternating signals from the image trigger.
  • the trigger signals can be split in a way where the first signal goes to the day image sensor, the second signal to the night image sensor, the third signal to the day image sensor, and so forth.
  • the data transmission would be split between the day and the night image sensors. Once the data transmission would be used to transmit the day image, and subsequently it would be used to transmit the night image, and so forth. A user can thus view simultaneously both day and night captures or only view one state.
  • the system of the invention can deliver any number of spherical views as a sequence of digital still images which are rendered to a moving images view in real time.
  • a "spherical view” as defined herein refers to view of 360 degrees vertically by up to 360 degrees horizontally and more.
  • a sphere can be defined as the set of points in three-dimensional space which are at distance r from a fixed point of that space, where r is a positive real number called the radius of the sphere. The fixed point is called the center and is not part of the sphere itself.
  • the rotary system of the invention can capture a large number of images in a fraction of a second, where the all the captured images - depending on the resolution of the image sensor - can have a very high resolution.
  • the rotary system of the invention does not have blind angles and is not a conventional panorama, fisheye or straw view. Due to the spherical nature of the moving pictures, it is possible to shoot a moving picture of the whole surroundings in real time.
  • the display unit is able to simultaneously generate any number of moving images display of regions of interest (sections) out of the captured images in the image buffer and/or permanent storage, which can be displayed in different screen windows and in different display units/devices.
  • the system of the invention does not require any stabilization mechanisms such as a gimbal or gimbal ring (typically devices consisting of two rings mounted on axes at right angles to each other so that an object, such as a ship's compass, will remain suspended in a horizontal plane between them regardless of any motion of its support).
  • the system of the invention does not require such (or other) stabilization means in view of the constant rotation, rapid rotation speed, use of still images, fast image capture rate per second and the fact that images are captured always through the same sensor, all these and other factors enable the system of the invention to work well without added stabilization means.
  • Fig. 1 shows an example of a rotary system of the invention.
  • a camera 10 is attached to a rotary 20 mounted on a tri-pod 30.
  • Other variations of the system can be mounted on top of an asset, vehicle, vessel or aircraft.
  • Figs. 2A-2D show four examples of miniature standalone system.
  • Fig. 2A shows a system with a single camera 10
  • Fig. 2B shows a system with a single camera 10, wherein the camera is in a tilted position
  • Fig. 2C shows a system with a two cameras 10, for example, when one camera 10 is used for day image capture and the other camera 10 is used for night image capture
  • Fig. 2D shows a system with a two cameras 10, wherein the cameras 10 are in a tilted position.
  • the rotating platform is inside an outer case which can be fixed to an asset or vehicle.
  • the camera 10 and lens 40 (or set of lenses 40) are coupled to a rotary 20 placed inside a chassis 60.
  • a slip ring 70 is a method of making an electrical and data connection through a rotating assembly. Slip rings 70 are also called rotary electrical interfaces, rotating electrical connectors, collectors, swivels, or electrical rotary joints. A slip ring 70 is a rotary coupling used to transfer data as well electric current from a stationary unit to a rotating unit. Either the brushes or the rings are stationary and the other component rotates. Another example of a power and data transmission unit would be using contactless rotary joints for transmitting power and data between stationary and rotating frames without the use of conventional slip rings or brushes. In such power and data transmission unit there is no physical contact between the rotating and fixed parts of the unit.
  • a power connector 80 is used when the power source used is an external power source, for example, in the vehicle or asset.
  • the data connector 90 is used to communicate with the controlling unit for controlling the rotary's speed and angle (tilt) and for controlling the camera's image capture in terms of speed, view angle and other image capture parameters such as zoom, aperture speed, exposure etc.
  • the data connector 90 is also used for saving images taken to the permanent storage, when the storage is external. When the storage is internal, the display unit accesses the storage via the data connector 90.
  • the following configuration enables the system to rotate at speeds of up to 2,880 rounds per minute (rpm).
  • Capture speed 100 images per second
  • Fig. 3 shows the images captured in a system configured to capture 100 images per second at 600 rpm. We obtain a stream of pictures which can then be processed by the display unit. Fig. 3 shows how ten images per rotation are generated for viewing up to ten field views simultaneously. After one second, the rotary system has completed ten rotations and shot 100 images.
  • rotation contains the 10 images captured in that rotation. Every images is captured with a different view angle. It is best that every images overlaps with the preceding and following images in order to be able to generate a panoramic view of that rotation. The overlap can be very small, for example, about 5% or less of each images.
  • Each row in Fig. 3 contains all the images captured with the same view angle (the 10 th row is marked "field view").
  • the images in a row are displayed continuously (in this example in a display rate of 10 frames per second), they create a moving images view the scene in that specific view angle as shown in Fig. 4.
  • Fig. 5 shows how all images taken in a single rotation numbered 31 to 40 (shown as one line in Fig. 3) are rendered into a view (bottom picture) showing a panoramic section of the surroundings generated on the fly.
  • the resulting image sequence is displayed as a moving 360 degree view (moving images view) of the scene. As each image is shot at high resolution, users can digitally zoom in into the movie.
  • An imaging pod can be defined as a specially designed container for a rotary system or several rotary system combinations (day & night) (e.g., video camera, photo camera, day vision camera, night vision camera (infrared, short-wave infrared (SWIR) camera using wavelengths from 0.9 to 1.7 microns).
  • a pod is attached to the outside of a vehicle, vessel or aircraft (manned or unmanned).
  • the rotary system of the invention can be built either as an integrated subsystem or as a standalone system.
  • imaging pod As an integrated subsystem, it is integrated into imaging systems of third parties.
  • imaging pod includes all hardware, software and interfaces necessary to communicate with the imaging systems, and with third-party software and control centers. It can be incorporated in a range of applications: for vehicles, airborne use, inside buildings, underground, on the ground, and maritime.
  • the standalone system represents an imaging pod, which can be deployed without further integration. It comes with all necessary software interfaces and connectivity to control centers and imaging applications. For example, it can be used for traffic surveillance and other urban surveillance uses as homeland security, robotics, etc.
  • Fig. 6 shows a preliminary prototype design for a Micro Air Vehicle (MAV).
  • MAV Micro Air Vehicle
  • the rotary system of the invention has been used to build an airframe around the image generation technology of the invention, which uses the rotation for propulsion and stabilization in the application as an Unmanned Arial Vehicle (UAV).
  • UAV Unmanned Arial Vehicle
  • the result is a camera 10 which is an airframe in itself, combining all the advantages of a micro-size UAV with the spherical viewing nature according to the invention. It represents a "third eye", an instant extension of vision to see in places which could otherwise not be reached.
  • the system will be comprised of the following components:
  • ⁇ Vision system glasses, head-up display, screen, etc.
  • Optional third-party payloads ammunition, image sensors, etc.
  • the single major competitive advantage is its small size combined with advanced image capturing 10 and transmission technology, which makes it ideally suited for deployment in urban environments, including its use inside and around buildings.
  • Design goals of the MAV include but are not limited to:
  • VTOL Vertical take off and landing
  • a camera 10 comprising an image sensor 100, an image sensor engine 110, and lens 40 is driven (controlled) by a controller unit 130 and a signal trigger unit 120.
  • the image sensor engine 110 (AKA image processing engine or image processor) operates the image sensor 100 in order to capture an image.
  • the camera 10 is rotated around its axis by a rotary 20.
  • the rotary 20 typically comprises a rotation motor or other rotation mechanisms (like air or fluids based rotaries) available in the industry.
  • the display unit 160 is in charge for processing and displaying in real time the captured images.
  • the captured images are held in an image buffer 180 shown here to reside in the display unit 160 though the image buffer 180 can reside in other locations such as the camera 10.
  • the display unit 160 comprises an image processing unit 170 and algorithms 200 in order to process and display the captured images.
  • Such processing can be, for example, displaying images according to a specific order, removing overlapping zone between two images, zooming on an image, streaming an array of still images as moving images view (seen by the user as a video) etc.
  • a data exchange interface unit 190 enables the system to communicate with third party system, for example, in order to send the moving images for display on third party display units.
  • one or more permanent storage units 140 can be connected to the system in order to record (save) the captured images. All components receive power from a power supply 150 that can be internal (like batteries) or external (external electricity source) or both.
  • the power transmission unit 90 is connected to the power supply 150 and is responsible for transferring power to the different components of the system and in particular to the rotating components (where a cable cannot be used).
  • the data transmission unit 80 is also connected to the power supply 150 in most cases.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

A rotary system and method for capturing images and displaying moving images of the surroundings by rotating a camera in high speed and capturing a plurality of still images per second. The still images are then processed in real time and displayed in one or more display units. Each display unit can display a moving images view of a region in the surroundings and/or still images. Any still or moving image can be zoomed in.

Description

ROTARY IMAGE GENERATOR
TECHNICAL FIELD
The present invention relates to image capture in general, and in particular to capturing, generating and displaying moving images surrounding a rotary image generator.
BACKGROUND ART
Video cameras are the common tool to use for capturing moving images. A video camera can capture images of the same location over a period of time, when the camera is still. Alternatively, the camera can be moved in a sweeping motion in order to capture images of different areas (an action commonly referred to as "panning"). If the panning motion is too quick or abrupt, the captured images quality frequently degrades and the image becomes blurred or fuzzy.
Certain applications or circumstances such as surveillance cameras or military vehicles require capturing images in real time of the entire surroundings, for example a 360 degrees view, referred to herein as "panoramic view" or "360 degrees view", around the camera location. A single video camera is unable to produce clear images in real time of the entire 360 degrees area surrounding the camera. In order to capture usable video images of 360 degrees and display them (on multiple displays) one would need today multiple, fixed video cameras or omni- directional systems.
SUMMARY OF INVENTION
It is an object of the present invention to provide a system and method for capturing spherical moving images.
It is another object of the present invention to provide a system and method for capturing moving images and displaying them on one or more display devices in real time. It is a further object of the present invention to provide a system and method for capturing full spherical moving images and displaying them on one or more display devices in real-time or substantially real-time.
The present invention relates to a rotary system for capturing images of the surroundings, comprising:
(i) a camera comprising one or more image sensors, one or more image sensor engines and one or more lenses for capturing a plurality of still images per second;
(ii) an image buffer for the captured plurality of still images;
(iii) a rotary connected to the camera for rotating the camera around its axis;
(iv) a controller unit for controlling the rotary's rotation speed and for controlling the camera's image capture; and
(v) a display unit for processing and displaying in real time the captured images in said image buffer,
wherein, the rotating camera takes a plurality of still images, each still image taken in a predetermined view angle and stored in said image buffer, such that the display unit can display from the images in the image buffer one or more views of the surrounding in a moving images view.
In some embodiments, the images captured in one rotation of the rotary system cover the entire panorama of the surroundings in a field of view of 360 degrees vertically by up to 360 degrees horizontally.
In some embodiments, every image captured overlaps with the previously captured image.
In some embodiments, every image captured overlaps by 5% or less with the previously captured image.
In some embodiments, every image captured does not overlap with the previously captured image. In some embodiments, placing the images taken side by side in chronological order, produces in real time a panoramic view of the surroundings after compensating for overlaps in sequential image captures.
In some embodiments, the series of still images taken with a plurality of view angles, are displayed on one or more display devices.
In some embodiments, the rotary rotates with variable rotation speeds.
In some embodiments, the camera or the rotary or both can tilt.
In some embodiments, the camera or the rotary or both can tilt upwards, downwards or in any angle.
In some embodiments, the display unit can also display still images.
In some embodiments, wherein the display unit enables to zoom in a still image or a stream of moving images.
In some embodiments, the image buffer resides in a video card, the camera, the controller, the display unit or any combination thereof.
In some embodiments, the image buffer is a transfer link (such as data link or optical link) communicating directly between the camera and display unit.
In some embodiments, the system further comprises a permanent storage for saving the captured images.
In some embodiments, the display unit can perform search and retrieval operations using the saved images in the permanent storage, and process any array of stored images into moving images and/or spherical moving images.
In some embodiments, the search and retrieval operations comprise: pausing a moving image sequence, resuming to real time viewing, rewinding a moving image sequence, advancing a moving image sequence or any combination thereof.
The present invention further relates to a rotary method for capturing moving images of the surroundings, the method comprising the steps of:
(i) capturing a plurality of still images per second by a camera comprising one or more image sensors, one or more image sensor engines and one or more lenses;
(ii) holding said plurality of still images in an image buffer; (iii) connecting the camera to a rotary for rotating the camera around its axis;
(iv) controlling the rotary's speed and controlling the camera's image capture by a controller unit; and
(v) processing and displaying the captured images by a display unit, wherein, the rotating camera takes a plurality of still images, each still image taken in a predetermined view angle and held in said image buffer such that the display unit can display in real time one or more views of the surrounding in a moving images view. BRIEF DESCRIPTION OF DRAWINGS
Fig. 1 shows an embodiment of a rotary image generator of the invention. Figs. 2A-2D show four examples of a miniature standalone system. The rotating platform is inside an outer case which can be fixed to an asset or vehicle. Fig. 2A shows a system with a single camera; Fig. 2B shows a system with a single camera, wherein the camera is tilted; Fig. 2C shows a system with a two cameras, one for day capture and one for night capture; Fig. 2D shows a system with a two cameras, wherein the cameras are tilted.
Fig. 3 shows 100 images captured in 10 rotations, wherein each row shown the different images captured in that rotation, and each column shows images of the same view angle taken in different rotations.
Fig. 4 shows a column of images from Fig. 3 shot at the same view angle that is composed into a sequence of images in motion.
Fig. 5 shows a row of images from Fig. 3 shot in one rotation (10 images shown on top). When these images are stitched together, they form a panoramic view to cover a 360 degree field of view as shown below.
Fig. 6 shows an example of a micro air vehicle according to the invention. Fig. 7 is a block diagram of the major components of a rotary system according to some embodiments. MODES FOR CARRYING OUT THE INVENTION
In the following detailed description of various embodiments, reference is made to the accompanying drawings that form a part thereof, and in which are shown by way of illustration specific embodiments in which the invention may be practiced. It is understood that other embodiments may be utilized and structural changes may be made without departing from the scope of the present invention.
The present invention relates to a rotary system for capturing and displaying in real time spherical moving images of the surrounding scene in any resolution preferably in high resolution. The rotary system comprises a camera, an image buffer, a rotary, a controller and a display unit. The camera comprises an image sensor, an image sensor engine and lens where the camera rotates continuously around an axis. The rotation speed is typically at least 120 rpm to speeds of up to 2,880 rpm or more in order to take numerous still images shots (captures) in a fraction of a second. The invention enables to display the full sphere or any number of portions of it in any number of display devices in real time. The term "real time" as used herein means a response time from capturing an image to displaying the image in the order of a fraction of a millisecond.
The camera is capable of taking a large number of images per second. One camera used for testing is capable to capture up to 1 ,200 frames per second. Typically, the camera is mounted on a rotary, such as a transportable pod with variable rotation speeds. One configuration tested rotated at a rotation speed of up to 1,440 rounds per minute. Tables 2 and 3 describe several configurations for day and night image capture.
An image sensor is a device that converts an optical image into an electronic signal. As example: a charge-coupled device (CCD) or a complementary metal- oxide-semiconductor (CMOS) active pixel image sensor. It is used mostly in digital cameras and other imaging devices.
The rotary can use any rotation mechanisms known in the industry such as a rotation motor, though other rotation mechanisms are know, for example, using air or fluids and all known and future rotation mechanisms are considered to be part of the invention.
The invention can work in real time mode, wherein the images captured are buffered, processed into moving images and displayed immediately. A real time buffer for holding the captured images can be the memory of a video card, the memory of a camera, memory of an image sensor, the memory on a controller, the memory of a real-time processing unit or any combination thereof. Alternatively, the image buffer can be a transfer link, such as data link or optical link, communicating directly between the camera and display unit. Such memory can be both volatile and/or non volatile memory. It is also possible to use memories on different locations.
In addition, the system can use a permanent storage for storing the captured images. The permanent storage may be one or more storage devices such as hard drives, typically large enough to save minutes if not hours of recordings. When the display unit is working with a permanent storage, the display unit can perform search and retrieval operations using the captured images in the permanent storage, and process any array of stored images into moving images.
The term "displaying moving images" as referred herein means that a sequence of still images is displayed on a display device (screen), which for the user looks the same as watching a video or a movie. The difference is that the data is not in a video format, such as MPEG, but the data is a plurality of still images displayed rapidly.
The system's controller unit controls the rotary's speed and the camera's image capture. There can be a single controller unit for both the camera and the rotary or separate controllers can be used. The controller unit controls the image capture of the camera via a trigger. A trigger initiates the capture of single or multiple images of a camera by analyzing the signals of its sensor. Any trigger in the industry can be used with the invention.
In some embodiments, the trigger is not affected by the speed of rotation. It uses an absolute angle position around the rotating axis. At this location the camera receives a pulse which gives it a signal to capture an image at the location of the receipt of the signal. As the location is absolute, images are taken always at exactly the same absolute angles. Using such trigger methods is useful in order to avoid an effect of sweeping away of moving images. The trigger is also able to action other devices then the camera, for example, lighting devices.
Examples of image triggers that can be used:
• Optical sensor (e.g., manufactured by Omron Electronics of 1 East Commerce Drive, Schaumburg, IL 60173 U.S.A.). Electro-optical sensors are electronic detectors that convert light, or a change in light, into an electronic signal. They are used in many industrial and consumer applications, for example, lamps that turn on automatically in response to darkness.
• Hall effect based image triggers. The Hall effect is the production of a voltage difference (the Hall voltage) across an electrical conductor, transverse to an electric current in the conductor and a magnetic field perpendicular to the current.
The display unit is responsible for displaying the images in the image buffer in a moving images view in real time according to different criteria and parameters. For example, the display unit can simultaneously open any number of high- resolution views of the spherical moving picture. In one example, more than 30 different views were opened. The display unit can enable the user to zoom in and out of any view.
When working with images in an image buffer, all user operations such as change views, zoom in, zoom out, pan, tilt are done in real time. The system captures the entire surroundings but the user chooses to view a region of interest from within the surroundings. Regions of interest can have different sizes, where each user defines the size and location of the region of interest within the surroundings. The user can shift the region of interest to different locations within the captured surroundings. In real time mode, the information not viewed by the user (if not recorded) is lost, since new images overwrite older images in the image buffer.
When the system comprises a permanent storage capable of recording minutes or hours of recordings (recorded time is unlimited theoretically and depends on the storage size and size of images captured), the system can perform all the operations as if it was in real time mode. The difference being that instead of capturing new images, the display unit would use the captured images from the permanent storage. Any combination, number, location and size of regions of interest can be created/displayed in permanent storage mode, exactly like in real time mode.
One advantage of the rotary system of the invention is that it can generate multiple (and different) views of the surroundings, a useful feature whenever one needs the ability to look in several different directions at the same time, or quickly change directions. The system is able to deliver an unlimited number of different views to different users simultaneously with a single capture device, without losing image information. The different views can be generated by the display unit to a single screen where the user chooses each time which view to watch or alternatively several screens (including geographically distant screens) can be used where each user can choose on each screen which view to watch.
It is important for most image capture systems to be able to work effectively both at day and at night. The rotary system of the invention enables the integration of night and day vision into the same system. Two different image sensors can be mounted into the same camera, a day image sensor and a night image sensor. This is made possible because the image data of both sensors can be transmitted through one data connection - possible due to the control of the trigger. The trigger signals can be split among image sensors to provide signals to both the day and the night image sensors as required, whereas the day and the night image sensor receive alternating signals from the image trigger.
In some embodiments, instead of all trigger signals per rotation going exclusively to a single image sensor, the trigger signals can be split in a way where the first signal goes to the day image sensor, the second signal to the night image sensor, the third signal to the day image sensor, and so forth. In this example, the data transmission would be split between the day and the night image sensors. Once the data transmission would be used to transmit the day image, and subsequently it would be used to transmit the night image, and so forth. A user can thus view simultaneously both day and night captures or only view one state.
The system of the invention can deliver any number of spherical views as a sequence of digital still images which are rendered to a moving images view in real time. A "spherical view" as defined herein refers to view of 360 degrees vertically by up to 360 degrees horizontally and more. A sphere can be defined as the set of points in three-dimensional space which are at distance r from a fixed point of that space, where r is a positive real number called the radius of the sphere. The fixed point is called the center and is not part of the sphere itself.
The rotary system of the invention can capture a large number of images in a fraction of a second, where the all the captured images - depending on the resolution of the image sensor - can have a very high resolution. The rotary system of the invention does not have blind angles and is not a conventional panorama, fisheye or straw view. Due to the spherical nature of the moving pictures, it is possible to shoot a moving picture of the whole surroundings in real time.
The display unit is able to simultaneously generate any number of moving images display of regions of interest (sections) out of the captured images in the image buffer and/or permanent storage, which can be displayed in different screen windows and in different display units/devices.
It should be noted that the system of the invention does not require any stabilization mechanisms such as a gimbal or gimbal ring (typically devices consisting of two rings mounted on axes at right angles to each other so that an object, such as a ship's compass, will remain suspended in a horizontal plane between them regardless of any motion of its support). The system of the invention does not require such (or other) stabilization means in view of the constant rotation, rapid rotation speed, use of still images, fast image capture rate per second and the fact that images are captured always through the same sensor, all these and other factors enable the system of the invention to work well without added stabilization means.
Fig. 1 shows an example of a rotary system of the invention. A camera 10 is attached to a rotary 20 mounted on a tri-pod 30. Other variations of the system can be mounted on top of an asset, vehicle, vessel or aircraft.
Figs. 2A-2D show four examples of miniature standalone system. Fig. 2A shows a system with a single camera 10; Fig. 2B shows a system with a single camera 10, wherein the camera is in a tilted position; Fig. 2C shows a system with a two cameras 10, for example, when one camera 10 is used for day image capture and the other camera 10 is used for night image capture; and Fig. 2D shows a system with a two cameras 10, wherein the cameras 10 are in a tilted position. The rotating platform is inside an outer case which can be fixed to an asset or vehicle. The camera 10 and lens 40 (or set of lenses 40) are coupled to a rotary 20 placed inside a chassis 60. Also shown is a slip ring 70, as an example of a power and data transmission unit. A slip ring 70 (in electrical engineering terms) is a method of making an electrical and data connection through a rotating assembly. Slip rings 70 are also called rotary electrical interfaces, rotating electrical connectors, collectors, swivels, or electrical rotary joints. A slip ring 70 is a rotary coupling used to transfer data as well electric current from a stationary unit to a rotating unit. Either the brushes or the rings are stationary and the other component rotates. Another example of a power and data transmission unit would be using contactless rotary joints for transmitting power and data between stationary and rotating frames without the use of conventional slip rings or brushes. In such power and data transmission unit there is no physical contact between the rotating and fixed parts of the unit.
On the bottom are shown the locations for the power connector 80 and data connector 90. A power connector 80 is used when the power source used is an external power source, for example, in the vehicle or asset. The data connector 90 is used to communicate with the controlling unit for controlling the rotary's speed and angle (tilt) and for controlling the camera's image capture in terms of speed, view angle and other image capture parameters such as zoom, aperture speed, exposure etc. The data connector 90 is also used for saving images taken to the permanent storage, when the storage is external. When the storage is internal, the display unit accesses the storage via the data connector 90.
The following configuration enables the system to rotate at speeds of up to 2,880 rounds per minute (rpm).
Manufacturer of image sensor and engine: Prosilica GB660C
Resolution: VGA 659x493 pixels
Pixel size: 5.6 x 5.6 μπι
Optical size: 1/4"
Interface: Gigabit Ethernet
Lens: 5 mm
Trigger: 10 signals per round
Rotation speed: 600 rounds per minute
Capture speed: 100 images per second
Fig. 3 shows the images captured in a system configured to capture 100 images per second at 600 rpm. We obtain a stream of pictures which can then be processed by the display unit. Fig. 3 shows how ten images per rotation are generated for viewing up to ten field views simultaneously. After one second, the rotary system has completed ten rotations and shot 100 images.
Every line in Fig. 3 marked "1. rotation" to " 10. rotation" contains the 10 images captured in that rotation. Every images is captured with a different view angle. It is best that every images overlaps with the preceding and following images in order to be able to generate a panoramic view of that rotation. The overlap can be very small, for example, about 5% or less of each images.
Each row in Fig. 3 contains all the images captured with the same view angle (the 10th row is marked "field view"). When the images in a row are displayed continuously (in this example in a display rate of 10 frames per second), they create a moving images view the scene in that specific view angle as shown in Fig. 4. Fig. 5 shows how all images taken in a single rotation numbered 31 to 40 (shown as one line in Fig. 3) are rendered into a view (bottom picture) showing a panoramic section of the surroundings generated on the fly. The resulting image sequence is displayed as a moving 360 degree view (moving images view) of the scene. As each image is shot at high resolution, users can digitally zoom in into the movie.
An imaging pod can be defined as a specially designed container for a rotary system or several rotary system combinations (day & night) (e.g., video camera, photo camera, day vision camera, night vision camera (infrared, short-wave infrared (SWIR) camera using wavelengths from 0.9 to 1.7 microns). Such a pod is attached to the outside of a vehicle, vessel or aircraft (manned or unmanned).
The rotary system of the invention can be built either as an integrated subsystem or as a standalone system.
As an integrated subsystem, it is integrated into imaging systems of third parties. Such an imaging pod includes all hardware, software and interfaces necessary to communicate with the imaging systems, and with third-party software and control centers. It can be incorporated in a range of applications: for vehicles, airborne use, inside buildings, underground, on the ground, and maritime.
The standalone system represents an imaging pod, which can be deployed without further integration. It comes with all necessary software interfaces and connectivity to control centers and imaging applications. For example, it can be used for traffic surveillance and other urban surveillance uses as homeland security, robotics, etc.
Fig. 6 shows a preliminary prototype design for a Micro Air Vehicle (MAV). The rotary system of the invention has been used to build an airframe around the image generation technology of the invention, which uses the rotation for propulsion and stabilization in the application as an Unmanned Arial Vehicle (UAV). The result is a camera 10 which is an airframe in itself, combining all the advantages of a micro-size UAV with the spherical viewing nature according to the invention. It represents a "third eye", an instant extension of vision to see in places which could otherwise not be reached.
The system will be comprised of the following components:
Multi-use airframe with auto-navigation.
« Base station with flight control.
Vision system: glasses, head-up display, screen, etc.
Optional third-party payloads: ammunition, image sensors, etc.
The single major competitive advantage is its small size combined with advanced image capturing 10 and transmission technology, which makes it ideally suited for deployment in urban environments, including its use inside and around buildings.
Design goals of the MAV include but are not limited to:
Operating radius: 1,000 and more meters.
Flight time: minimum 30 minutes.
■ Night vision capable.
Autonomous mission management.
Collision avoidance.
Flight in swarms on mutual mission.
Intelligent system health monitor.
■ Quick deployment within seconds.
• Low noise.
Vertical take off and landing (VTOL).
Reference is now made to Fig. 7 showing a block diagram with the major components of a rotary system, according to some embodiments. A camera 10 comprising an image sensor 100, an image sensor engine 110, and lens 40 is driven (controlled) by a controller unit 130 and a signal trigger unit 120. The image sensor engine 110 (AKA image processing engine or image processor) operates the image sensor 100 in order to capture an image. The camera 10 is rotated around its axis by a rotary 20. The rotary 20 typically comprises a rotation motor or other rotation mechanisms (like air or fluids based rotaries) available in the industry.
The display unit 160 is in charge for processing and displaying in real time the captured images. The captured images are held in an image buffer 180 shown here to reside in the display unit 160 though the image buffer 180 can reside in other locations such as the camera 10. The display unit 160 comprises an image processing unit 170 and algorithms 200 in order to process and display the captured images. Such processing can be, for example, displaying images according to a specific order, removing overlapping zone between two images, zooming on an image, streaming an array of still images as moving images view (seen by the user as a video) etc. A data exchange interface unit 190 enables the system to communicate with third party system, for example, in order to send the moving images for display on third party display units. Optionally, one or more permanent storage units 140 can be connected to the system in order to record (save) the captured images. All components receive power from a power supply 150 that can be internal (like batteries) or external (external electricity source) or both. The power transmission unit 90 is connected to the power supply 150 and is responsible for transferring power to the different components of the system and in particular to the rotating components (where a cable cannot be used). The data transmission unit 80 is also connected to the power supply 150 in most cases.
Competition Overview - There are different technologies which may seem to have similar features. All competing technologies are based on either multiple video cameras or special lenses. Table 1 shows how these technologies compare:
Table 1: Comparison of Technologies
Figure imgf000015_0001
(horiz.)
View angle Variable 0°-360° Fixed Fixed <180°
(vert.)
Number of 1 1 1
views
Number of Unlimited 1 1 1
users
Optical None None Low Medium distortion (needs
"dewarping")
Resolution of Very high Low High Low
detail
Price level Medium Low Very high High
Application Wide Wide Narrow Narrow range
Complexity of Low Low High High integration
The following configurations illustrate some examples of hardware configurations that can be used.
Table 2: Day Vision Configurations
Figure imgf000016_0001
Figure imgf000017_0001
Table 3: Night Vision Configurations
Figure imgf000017_0002
Many alterations and modifications may be made by those having ordinary skill in the art without departing from the spirit and scope of the invention. Therefore, it must be understood that the illustrated embodiment has been set forth only for the purposes of example and that it should not be taken as limiting the invention as defined by the following invention and its various embodiments.
Therefore, it must be understood that the illustrated embodiment has been set forth only for the purposes of example and that it should not be taken as limiting the invention as defined by the following claims. For example, notwithstanding the fact that the elements of a claim are set forth below in a certain combination, it must be expressly understood that the invention includes other combinations of fewer, more or different elements, which are disclosed in above even when not initially claimed in such combinations. A teaching that two elements are combined in a claimed combination is further to be understood as also allowing for a claimed combination in which the two elements are not combined with each other, but may be used alone or combined in other combinations. The excision of any disclosed element of the invention is explicitly contemplated as within the scope of the invention.
The words used in this specification to describe the invention and its various embodiments are to be understood not only in the sense of their commonly defined meanings, but to include by special definition in this specification structure, material or acts beyond the scope of the commonly defined meanings. Thus if an element can be understood in the context of this specification as including more than one meaning, then its use in a claim must be understood as being generic to all possible meanings supported by the specification and by the word itself.
The definitions of the words or elements of the following claims are, therefore, defined in this specification to include not only the combination of elements which are literally set forth, but all equivalent structure, material or acts for performing substantially the same function in substantially the same way to obtain substantially the same result. In this sense it is therefore contemplated that an equivalent substitution of two or more elements may be made for any one of the elements in the claims below or that a single element may be substituted for two or more elements in a claim. Although elements may be described above as acting in certain combinations and even initially claimed as such, it is to be expressly understood that one or more elements from a claimed combination can in some cases be excised from the combination and that the claimed combination may be directed to a sub-combination or variation of a sub-combination.
Insubstantial changes from the claimed subject matter as viewed by a person with ordinary skill in the art, now known or later devised, are expressly contemplated as being equivalently within the scope of the claims. Therefore, obvious substitutions now or later known to one with ordinary skill in the art are defined to be within the scope of the defined elements.
The claims are thus to be understood to include what is specifically illustrated and described above, what is conceptually equivalent, what can be obviously substituted and also what essentially incorporates the essential idea of the invention.

Claims

1. A rotary system for capturing images of the surroundings, comprising:
(i) a camera comprising an image sensor, image sensor engine and lens for capturing a plurality of still images per second;
(ii) an image buffer for holding the captured plurality of still images;
(iii) a rotary connected to the camera for rotating the camera around its axis;
(iv) a controller unit for controlling the rotary's rotation speed and for controlling the camera's image capture; and
(v) a display unit for processing and displaying in real time the captured images in said image buffer, wherein, the rotating camera takes a plurality of still images, each still image taken in a predetermined view angle and stored in said image buffer, such that the display unit can display from the images in the image buffer one or more views of the surrounding in a moving images view.
2. The rotary system according to claim 1, wherein the images captured in one rotation of the rotary system cover the entire panorama of the surroundings in a field of view of 360 degrees vertically by up to 360 degrees horizontally.
3. The rotary system according to claim 1 , wherein every image captured overlaps with the previously captured image.
4. The rotary system according to claim 3, wherein every image captured overlaps by 5% or less with the previously captured image.
5. The rotary system according to claim 1, wherein every image captured does not overlap with the previously captured image.
6. The rotary system according to claim 1, wherein placing the images taken side by side in chronological order, produces in real time a panoramic view of the surroundings after compensating for overlaps in sequential image captures.
7. The rotary system according to claim 1, wherein the series of still images taken with a plurality of view angles, are displayed on one or more display devices.
8. The rotary system according to claim 1, wherein the rotary rotates with variable rotation speeds.
9. The rotary system according to claim 1 , wherein the camera or the rotary or both can tilt.
10. The rotary system according to claim 8, wherein the camera or the rotary or both can tilt upwards, downwards or in any angle.
1 1. The rotary system according to claim 1 , wherein the display unit enables to zoom in a still image or a stream of moving images.
12. The rotary system according to claim 1, wherein the image buffer resides in a video card, the camera, the controller, the display unit, rotary or any combination thereof.
13. The rotary system according to claim 1, wherein the image buffer is a transfer link communicating directly between the camera and display unit.
14. The rotary system according to claim 1 , further comprising a permanent storage for saving the captured images.
15. The rotary system according to claim 14, wherein the display unit can perform search and retrieval operations using the saved images in the permanent storage, and process any array of stored images into a display of moving images and spherical moving images.
16. The rotary system according to claim 15, wherein the search and retrieval operations comprise: pausing a moving image sequence, resuming to real time viewing, rewinding a moving image sequence, advancing a moving image sequence or any combination thereof.
17. A rotary method for capturing moving images of the surroundings, the method comprising the steps of:
(i) capturing a plurality of still images per second by a camera comprising an image sensor, an image sensor engine and lens;
(ii) holding said plurality of still images in an image buffer; (iii) connecting the camera to a rotary for rotating the camera around its axis;
(iv) controlling the rotary's speed and controlling the camera's image capture by a controller unit; and
(v) processing and displaying the captured images by a display unit, wherein, the rotating camera takes a plurality of still images, each still image taken in a predetermined view angle and held in said image buffer such that the display unit can display in real time one or more views of the surrounding in a moving images view.
18. The rotary method according to claim 17, further comprising the step of saving the captured images in a permanent storage.
19. The rotary method according to claim 18, further comprising the step of perfomiing search and retrieval operations by the display unit using the saved images in the permanent storage, and processing any array of stored images into moving images.
20. The rotary method according to claim 17, further comprising the step of tilting the camera or the rotary or both upwards, downwards or in any angle.
PCT/IL2011/000701 2010-08-31 2011-08-31 Rotary image generator WO2012029063A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US13/819,705 US20130162761A1 (en) 2010-08-31 2011-08-31 Rotary image generator
EP11769942.1A EP2612491A1 (en) 2010-08-31 2011-08-31 Rotary image generator

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US37840110P 2010-08-31 2010-08-31
US61/378,401 2010-08-31

Publications (1)

Publication Number Publication Date
WO2012029063A1 true WO2012029063A1 (en) 2012-03-08

Family

ID=44800081

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IL2011/000701 WO2012029063A1 (en) 2010-08-31 2011-08-31 Rotary image generator

Country Status (3)

Country Link
US (1) US20130162761A1 (en)
EP (1) EP2612491A1 (en)
WO (1) WO2012029063A1 (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016206789A1 (en) * 2015-06-24 2016-12-29 Audi Ag Arrangement of an observation device on a motor vehicle, motor vehicle with such an arrangement and method for operating an observation device
EP3162709A1 (en) * 2015-10-30 2017-05-03 BAE Systems PLC An air vehicle and imaging apparatus therefor
WO2017072518A1 (en) * 2015-10-30 2017-05-04 Bae Systems Plc An air vehicle and imaging apparatus therefor
EP3030935A4 (en) * 2013-08-09 2017-09-27 Thermal Imaging Radar LLC Methods for analyzing thermal image data using a plurality of virtual devices and methods for correlating depth values to image pixels
GB2545076B (en) * 2015-10-30 2019-06-19 Bae Systems Plc Unmanned aerial vehicle with rotary body and imaging system
US10366509B2 (en) 2015-03-31 2019-07-30 Thermal Imaging Radar, LLC Setting different background model sensitivities by user defined regions and background filters
US10574886B2 (en) 2017-11-02 2020-02-25 Thermal Imaging Radar, LLC Generating panoramic video for video management systems
RU2721381C1 (en) * 2019-08-12 2020-05-19 Вячеслав Михайлович Смелков High-resolution panorama television surveillance computer system device
US10814972B2 (en) 2015-10-30 2020-10-27 Bae Systems Plc Air vehicle and method and apparatus for control thereof
US10822084B2 (en) 2015-10-30 2020-11-03 Bae Systems Plc Payload launch apparatus and method
US11059562B2 (en) 2015-10-30 2021-07-13 Bae Systems Plc Air vehicle and method and apparatus for control thereof
US11077943B2 (en) 2015-10-30 2021-08-03 Bae Systems Plc Rotary-wing air vehicle and method and apparatus for launch and recovery thereof
US11601605B2 (en) 2019-11-22 2023-03-07 Thermal Imaging Radar, LLC Thermal imaging camera device

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130278715A1 (en) * 2012-03-16 2013-10-24 Mark Nutsch System and method for discreetly collecting 3d immersive/panoramic imagery
US10977757B2 (en) * 2013-09-18 2021-04-13 James Brian Fry Video record receipt system and method of use
US20150360775A1 (en) * 2013-10-30 2015-12-17 Yusho Arai Vertical take-off and landing flight vehicle
US9350984B2 (en) 2014-05-27 2016-05-24 Semiconductor Components Industries, Llc Imagers with error generation capabilities
EP3782912A1 (en) * 2014-12-23 2021-02-24 SZ DJI Osmo Technology Co., Ltd. Uav panoramic imaging
US20160301864A1 (en) * 2015-04-10 2016-10-13 Caterpillar Inc. Imaging processing system for generating a surround-view image
WO2018147810A1 (en) * 2017-02-10 2018-08-16 Singapore University Of Technology And Design Aircraft
SG11202009468WA (en) * 2018-03-26 2020-10-29 Univ Singapore Technology & Design Aerial vehicles, methods of imaging a tunnel and methods of imaging a shaft
RU2725973C1 (en) * 2019-12-31 2020-07-08 Вячеслав Михайлович Смелков Method of generating a video signal in a television-computer system for monitoring industrial articles having a circular ring shape
RU2730177C1 (en) * 2020-01-16 2020-08-19 Вячеслав Михайлович Смелков Television system with selective image scaling (versions)
RU2743571C1 (en) * 2020-06-23 2021-02-20 Вячеслав Михайлович Смелков Computing system device for panoramic video surveillance with selective image scaling
RU2748754C1 (en) * 2020-09-28 2021-05-31 Вячеслав Михайлович Смелков Selective zoom tv system (options)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010043264A1 (en) * 1997-08-13 2001-11-22 Michael J. Sinclair Panoramic digital camera system and method
EP1289317A1 (en) * 2000-03-31 2003-03-05 Olympus Optical Co., Ltd. Method for posting three-dimensional image data and system for creating three-dimensional image
EP1359554A2 (en) * 2002-05-02 2003-11-05 Sony Corporation Monitoring system and method, and program and recording medium used therewith
US20050104999A1 (en) * 2003-09-19 2005-05-19 Shinya Wada Image processing method and device using photo assistant tool including rotator
US7149549B1 (en) * 2000-10-26 2006-12-12 Ortiz Luis M Providing multiple perspectives for a venue activity through an electronic hand held device

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5790183A (en) * 1996-04-05 1998-08-04 Kerbyson; Gerald M. High-resolution panoramic television surveillance system with synoptic wide-angle field of view
US7525567B2 (en) * 2000-02-16 2009-04-28 Immersive Media Company Recording a stereoscopic image of a wide field of view
US6614916B2 (en) * 2001-01-04 2003-09-02 Bell & Howell Mail And Messaging Technologies Company Machine vision system and triggering method
US7999842B1 (en) * 2004-05-28 2011-08-16 Ricoh Co., Ltd. Continuously rotating video camera, method and user interface for using the same
JP4521555B2 (en) * 2004-09-02 2010-08-11 富士フイルム株式会社 Image sensor unit and image photographing apparatus

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010043264A1 (en) * 1997-08-13 2001-11-22 Michael J. Sinclair Panoramic digital camera system and method
EP1289317A1 (en) * 2000-03-31 2003-03-05 Olympus Optical Co., Ltd. Method for posting three-dimensional image data and system for creating three-dimensional image
US7149549B1 (en) * 2000-10-26 2006-12-12 Ortiz Luis M Providing multiple perspectives for a venue activity through an electronic hand held device
EP1359554A2 (en) * 2002-05-02 2003-11-05 Sony Corporation Monitoring system and method, and program and recording medium used therewith
US20050104999A1 (en) * 2003-09-19 2005-05-19 Shinya Wada Image processing method and device using photo assistant tool including rotator

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3030935A4 (en) * 2013-08-09 2017-09-27 Thermal Imaging Radar LLC Methods for analyzing thermal image data using a plurality of virtual devices and methods for correlating depth values to image pixels
USD968499S1 (en) 2013-08-09 2022-11-01 Thermal Imaging Radar, LLC Camera lens cover
US10127686B2 (en) 2013-08-09 2018-11-13 Thermal Imaging Radar, Inc. System including a seamless lens cover and related methods
US9886776B2 (en) 2013-08-09 2018-02-06 Thermal Imaging Radar, LLC Methods for analyzing thermal image data using a plurality of virtual devices
US10366509B2 (en) 2015-03-31 2019-07-30 Thermal Imaging Radar, LLC Setting different background model sensitivities by user defined regions and background filters
WO2016206789A1 (en) * 2015-06-24 2016-12-29 Audi Ag Arrangement of an observation device on a motor vehicle, motor vehicle with such an arrangement and method for operating an observation device
CN106314279A (en) * 2015-06-24 2017-01-11 奥迪股份公司 An arrangement of an observation device on a motor vehicle and a method for operating the observation device
US10807708B2 (en) 2015-10-30 2020-10-20 Bae Systems Plc Air vehicle and imaging apparatus therefor
GB2545076B (en) * 2015-10-30 2019-06-19 Bae Systems Plc Unmanned aerial vehicle with rotary body and imaging system
WO2017072518A1 (en) * 2015-10-30 2017-05-04 Bae Systems Plc An air vehicle and imaging apparatus therefor
US10814972B2 (en) 2015-10-30 2020-10-27 Bae Systems Plc Air vehicle and method and apparatus for control thereof
US10822084B2 (en) 2015-10-30 2020-11-03 Bae Systems Plc Payload launch apparatus and method
US11059562B2 (en) 2015-10-30 2021-07-13 Bae Systems Plc Air vehicle and method and apparatus for control thereof
US11077943B2 (en) 2015-10-30 2021-08-03 Bae Systems Plc Rotary-wing air vehicle and method and apparatus for launch and recovery thereof
EP3162709A1 (en) * 2015-10-30 2017-05-03 BAE Systems PLC An air vehicle and imaging apparatus therefor
US10574886B2 (en) 2017-11-02 2020-02-25 Thermal Imaging Radar, LLC Generating panoramic video for video management systems
US11108954B2 (en) 2017-11-02 2021-08-31 Thermal Imaging Radar, LLC Generating panoramic video for video management systems
RU2721381C1 (en) * 2019-08-12 2020-05-19 Вячеслав Михайлович Смелков High-resolution panorama television surveillance computer system device
US11601605B2 (en) 2019-11-22 2023-03-07 Thermal Imaging Radar, LLC Thermal imaging camera device

Also Published As

Publication number Publication date
EP2612491A1 (en) 2013-07-10
US20130162761A1 (en) 2013-06-27

Similar Documents

Publication Publication Date Title
US20130162761A1 (en) Rotary image generator
CN108139799B (en) System and method for processing image data based on a region of interest (ROI) of a user
KR100898824B1 (en) Method and imaging system for obtaining panoramic and rectilinear images using rotationally symmetric wide-angle lens
JP7048011B2 (en) Imaging device
US20100045773A1 (en) Panoramic adapter system and method with spherical field-of-view coverage
US8581981B2 (en) Optical imaging system for unmanned aerial vehicle
CN101606387B (en) Digital mapping system based on continuous scanning line of sight
WO2018064831A1 (en) Tripod head, unmanned aerial vehicle and control method therefor
WO2000060870A1 (en) Remote controlled platform for camera
Leininger et al. Autonomous real-time ground ubiquitous surveillance-imaging system (ARGUS-IS)
WO2014162324A1 (en) Spherical omnidirectional video-shooting system
US20100002071A1 (en) Multiple View and Multiple Object Processing in Wide-Angle Video Camera
CN108495048B (en) Double-camera image acquisition equipment based on holder control
ES2704831T3 (en) Surveillance device
JP2016180866A (en) Aerial shoot device
JP6785412B2 (en) Unmanned aerial vehicle system
JP2021514573A (en) Systems and methods for capturing omni-stereo video using multi-sensors
US20180295284A1 (en) Dynamic field of view adjustment for panoramic video content using eye tracker apparatus
JP6528771B2 (en) Shooting device
CN110268704A (en) Method for processing video frequency, equipment, unmanned plane and system
CN110720209B (en) Image processing method and device
WO2015185161A1 (en) System and method for remote monitoring at least one observation area
CN108696724B (en) Live broadcast system capable of instantly obtaining high-definition photos
CN109660734A (en) A kind of distant view photograph image pickup method and device
Pattanayak et al. Comparative Analysis of ENG, EFP and Drone camera and its Impact in Television Production

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11769942

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 13819705

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE

REEP Request for entry into the european phase

Ref document number: 2011769942

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2011769942

Country of ref document: EP