EP2593904A1 - Multifunctional bispectral imaging method and device - Google Patents
Multifunctional bispectral imaging method and deviceInfo
- Publication number
- EP2593904A1 EP2593904A1 EP11741667.7A EP11741667A EP2593904A1 EP 2593904 A1 EP2593904 A1 EP 2593904A1 EP 11741667 A EP11741667 A EP 11741667A EP 2593904 A1 EP2593904 A1 EP 2593904A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- spectral
- images
- information
- image
- generating
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 50
- 230000003595 spectral effect Effects 0.000 claims abstract description 56
- 238000012545 processing Methods 0.000 claims abstract description 22
- 238000000034 method Methods 0.000 claims abstract description 21
- 230000002123 temporal effect Effects 0.000 claims description 25
- 238000001514 detection method Methods 0.000 claims description 12
- 239000011159 matrix material Substances 0.000 claims description 9
- 238000012544 monitoring process Methods 0.000 claims description 3
- 230000001360 synchronised effect Effects 0.000 claims description 3
- 230000008569 process Effects 0.000 claims description 2
- 238000001228 spectrum Methods 0.000 abstract 1
- 238000010586 diagram Methods 0.000 description 8
- 230000003287 optical effect Effects 0.000 description 5
- 230000005855 radiation Effects 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 4
- 238000000701 chemical imaging Methods 0.000 description 4
- 230000004907 flux Effects 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 230000009467 reduction Effects 0.000 description 3
- CURLTUGMZLYLDI-UHFFFAOYSA-N Carbon dioxide Chemical compound O=C=O CURLTUGMZLYLDI-UHFFFAOYSA-N 0.000 description 2
- 230000003247 decreasing effect Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000010354 integration Effects 0.000 description 2
- 229910002092 carbon dioxide Inorganic materials 0.000 description 1
- 239000001569 carbon dioxide Substances 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 230000005670 electromagnetic radiation Effects 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 238000007493 shaping process Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
- G06V10/12—Details of acquisition arrangements; Constructional details thereof
- G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
- G06V10/143—Sensing or illuminating at different wavelengths
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/255—Detecting or recognising potential candidate objects based on visual cues, e.g. shapes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
- G06V20/13—Satellite images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/52—Surveillance or monitoring of activities, e.g. for recognising suspicious objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
- H04N23/11—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths for generating image signals from visible and infrared light wavelengths
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/58—Extraction of image or video features relating to hyperspectral data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
- G06V20/194—Terrestrial scenes using hyperspectral data, i.e. more or other wavelengths than RGB
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/07—Target detection
Definitions
- the present invention relates to a multifunctional bi-spectral imaging method, of the type comprising a step of acquiring a plurality of bi-spectral images, each bi-spectral image being the combination of two images acquired in two different spectral bands. , and a step of generating a plurality of images each giving an impression of depth by combining the two images acquired in the two different bands, the plurality of images being an image information.
- the invention also relates to an imaging device implementing the imaging method.
- a bi-spectral device is a device for acquiring an image in two spectral bands, for example the spectral bands 3-5 ⁇ and 8-12 ⁇ .
- a special case is that of bi-color devices that use two sub-bands of the same main spectral band. For example, if we consider the band between 3 and 5 ⁇ , some two-color infrared devices acquire an image in the sub-band of 3.4 to 4.2 ⁇ and another image in the sub-band of 4.5 at 5 ⁇ .
- the invention applies to the field of optronic detection and panoramic vision systems. These systems are used in particular for the air platforms (transport aircraft, combat aircraft, drones and helicopters), maritime and land platforms (armored, troop transport ...) for surveillance and / or combat. Such platforms need a lot of information.
- a threat departure it is important to be able to detect what is called a threat departure and identify the type of threat, for example, a missile, a heavy weapon (cannon) or a gunshot.
- patent EP 0 759 674 describes a method for giving the impression of depth in an image, which is very useful information for the pilot of an air platform for example.
- the patent also discloses a camera designed to implement this method to provide an image giving the impression of depth.
- This camera is a bi-spectral camera that is to say adapted to provide two images in two distinct spectral bands in the infrared.
- the image giving the impression of depth is obtained by combining the two images acquired in the two spectral bands.
- the DAIRS system for "Distributed Aperture InfraRed Systems” developed by Northrop Grumman for the "Joint Strike Fighter” (JSF) aircraft is a single-spectral imaging device, that is to say for acquire an image in a single spectral band.
- This system therefore delivers imagery information. Nevertheless, it does not present an impression of depth obtained by bi-spectral or two-color systems.
- the system is not able to detect a very brief event such as a threat start such as a shot.
- the object of the invention is to provide a method and an imaging device less cumbersome, easier to integrate and globally less expensive than a set of single-function devices for platforms such as surveillance or combat platforms.
- the subject of the invention is an imaging method of the aforementioned type, characterized in that it comprises a step of simultaneous processing of the plurality of bi-spectral images to generate in addition to the information of imaging standby information and / or threat start information, comprising the following steps:
- the imaging method comprises one or more of the following characteristics:
- the two bands belong to the same infrared spectral band whose wavelength is between 3 and 5 ⁇ and are each located on either side of a wavelength substantially equal to 4.3 ⁇ ;
- the step of acquiring a plurality of bi-spectral images is performed at a high frequency at least equal to substantially 400 Hz; the step of acquiring a plurality of bi-spectral images comprises a micro-scanning step for generating a plurality of bi-spectral images of greater resolution;
- the plurality of bi-spectral images is acquired by at least two cameras previously synchronized temporally.
- the subject of the invention is also an imaging device comprising at least one bi-spectral camera, each comprising a bi-spectral matrix of a plurality of detectors able to acquire a plurality of bi-spectral images, each bi-spectral image being spectral being the combination of two images acquired in two different spectral bands, the imaging device comprising means for generating a plurality of images each giving an impression of depth from the two images acquired in the two different bands, the plurality of image being an image information and the device being characterized in that it comprises means for simultaneous processing of the plurality of bi-spectral images to generate at least two pieces of information from a standby information, a start information of threat and imaging information, the means of simultaneous processing being connected to the at least one bi-spectral camera and comprising :
- the imaging device comprises one or more of the following characteristics:
- the two bands belong to the same infrared spectral band whose wavelength is between 3 and 5 ⁇ and are each located on either side of a wavelength substantially equal to 4.3 ⁇ ;
- FIG. 1 is a block diagram of an embodiment of an imaging device according to the invention comprising a plurality of dual-spectral cameras,
- FIG. 2 is a block diagram of an embodiment of an imaging device according to the invention comprising a bi-spectral camera
- FIG. 3 is a block diagram illustrating an imaging and processing method implemented by the imaging device according to the invention
- FIG. 4 is a block diagram of a bi-spectral mega-image according to the invention.
- FIG. 5 is a graph representing the short and long-range atmospheric transmission in the infrared band between 3 and 5 ⁇ whose central wavelength is 4.3 ⁇ ,
- FIG. 6 is a graph representing the optical flux in the infrared band whose wavelength is between 3 and 5 ⁇ , for a missile jet, the terrestrial background and the solar radiation,
- FIGS. 7 and 8 are schematic diagrams illustrating the notions of spectral and temporal signatures of an object detected by the imaging device according to the invention
- FIG. 9 is a block diagram of another embodiment of an imaging device according to the invention comprising a bi-spectral camera,
- FIG. 10 is a block diagram illustrating the principle of a micro-scanning of a bi-spectral camera.
- FIG. 1 1 is a block diagram illustrating another embodiment of the imaging method according to the invention.
- the invention relates to an imaging device intended to be integrated into an aerial or land platform such as an airplane, a helicopter, a drone, an armored vehicle ...
- This type of platform is intended for surveillance and / or combat . It allows, day and night and in real time, the acquisition and processing of images for example to effectively coordinate the self-defense maneuvers of the platform or to help pilot the platform .
- This same device is suitable to allow the provision of an operator:
- imagery information namely an image interpretable by the man of the zone considered
- a standby information namely an image on which potential targets and their position appear, for example men, a tank, another platform ...
- a threat departure information namely an image on which a threat departure is clearly identified and positioned, for example a shot, a missile or cannon fire.
- FIG. 1 illustrates a device 2 according to the invention which comprises at least one bi-spectral camera 4, processing means 6 and a man / machine interface such as a screen 7.
- the processing means 6 are connected by a part to the or each bi-spectral camera 4 and secondly to the screen.
- the screen is intended to display the information processed by the processing means 6.
- bi-spectral cameras any number of bi-spectral cameras can be envisaged, three being represented in this figure.
- the dual-spectral cameras 4 are identical in principle and will be described in detail later. For example, they may differ in their resolution (number of pixels of the camera detector), their focal length and the field of optics.
- Each camera looks, that is to say is oriented, in a different average direction from the others.
- the fields of vision of each camera can be totally distinct but without having areas uncovered or have a common part to obtain and / or reconstruct an image having a continuous field of view from a camera to the other.
- the plurality of two-color cameras covers all or part of the space.
- a so-called frontal camera because placed on the front of the aerial platform such as a helicopter, is intended to image the space located in front of the platform, while two side cameras, because located on the flanks of the platform, are able to look each in a direction substantially perpendicular to that of the front camera.
- the front camera usually has better spatial resolution than the front cameras.
- the processing means 6 comprise means 14 for shaping the signals generated by each two-color camera 4 connected to means 16 for generating a watch information, means 18 for generating a threat information and means 20 generating an imaging information for driving or navigation.
- a processing of an image means processing of the signal associated with the image acquired by the camera, the image being converted into a signal by the camera.
- the means 14 for formatting the signals comprise means for synchronizing all the signals delivered by a plurality M of two-dimensional cameras.
- the means 16 for generating a watch information comprise bi-spectral mega-image processing means able to detect and identify at least one target by its radiometric and / or spectral signature and to generate a tracking of these targets.
- a target is a hot spot, that is to say that gives off heat in relation to its environment: a person, a material, a mobile platform ...
- a spectral signature of an object is the dependence with the wavelength of a set of characteristics of the electromagnetic radiation of the object, which contributes to identifying the object, for example its relative intensity of light emission. between two spectral bands, its maximum emission wavelength ...
- the radiometric signature of a target is defined by the intensity radiated by it relative to its environment, known in the known manner: background of the image.
- the means 18 for generating a threat information comprise means for searching for a spectral signature representative of a possible threat in the same bi-spectral mega-image.
- They also include means to search for a temporal signature of this possible threat and of discrimination of the type of threat, for example by comparison with a databank, to confirm that it is indeed a threat and what kind.
- a temporal signature of a threat is the time characteristic of the issuance of the threat. For example, a shot will be much shorter than a missile jet, and can be repeated quickly (for example, a burst of light weapons).
- the means 20 for generating an imaging information for driving or navigation comprises means for generating an image with a depth impression as described in patent EP 0 759 674.
- the dual-spectral camera 4 is a wide-field camera for covering part of the space to be analyzed. It comprises at least one large-field optical system 8 and a detector 10. Such a camera is for example described in patent EP 0 759 674. Such a wide-field optical system 8 has already been described, for example, in patent FR 2,692,369. Preferably, the field of optics 8 is substantially between 60 ° and 90 °.
- the detector 10 is a bi-spectral detector for example as described in patent EP 0 759 674, which comprises a bi-spectral matrix, for example of multi-quantum well or super-array type, in particular for delivering signals in two directions. sub-bands of the same spectral band or in two different spectral bands. In the first case, the detector is said to be two-color.
- the size of the bi-spectral matrix is substantially at least 640 pixels x 480 pixels.
- the dimensions of the matrix are 1000 ⁇ 1000 pixels corresponding to an elementary field of 1.57 mrad or 500 ⁇ 500 pixels corresponding to an elementary field of 3.14 mrad.
- the acquisition frequency of the dual-spectral camera 4 is high and preferably at least 400 Hz.
- the camera simultaneously acquires two images of the same field of view of space: one in each spectral band.
- the optic 8 focuses the luminous flux on the bi-spectral detector 10 which converts it into an electrical signal transmitted to the processing means 6.
- the two spectral bands in which the bi-spectral camera 2 is sensitive are such that they have particular characteristics, in particular as regards the electromagnetic emission of the missile jets and the variation of the atmospheric transmission according to of the distance.
- the spectral band is located in the infrared and its wavelength is between 3 and 5 ⁇ .
- the two sub-bands are located on either side of a wavelength substantially equal to 4.3 ⁇ .
- the first sub-band has a wavelength substantially between 3.4 and 4.2 ⁇ and the second a wavelength substantially between 4.5 and 5 ⁇ .
- the red or hot band is defined as the spectral subband whose wavelengths are the greatest compared with those of the second spectral subband, called the blue or cold band.
- the imaging device according to the invention implements the imaging method 100 which will now be described with reference to FIG.
- Each bi-spectral camera 4 of the imaging device 2 acquires a plurality of bi-spectral images denoted IB M where M is the number of the camera during a step 102 of acquisition of a plurality of bi images. -spectrals of the process 100.
- the acquisition is performed at the high frequency F, preferably substantially equal to 400 Hz.
- Each pair of images I M i, IM 2 is then combined to form a bi-spectral image IB M of 2xLxH, for example by juxtaposing them.
- the M cameras (for M ⁇ 1) are synchronized by construction before the acquisition of bi-spectral images. For example, they use a common clock.
- these means 14 combine the M bi-spectral images of the cameras to form a bi-spectral megapixel MIB during a step 106 of generating a bi-spectral mega-image.
- the bi-spectral mega-image MIB is generated by juxtaposing the bi-spectral images IB M of each camera, as shown in FIG. 4.
- This plurality of bi-spectral mega-images forms a single signal at the frequency F.
- processing means 16, 18, 20 simultaneously to generate at least two pieces of information from imaging, watch and threat starting information during steps 108, 1 10, 1 12 respectively.
- the step 108 of generating an imaging information implemented by the means 20 for generating a control information will now be detailed.
- the imaging information includes a mega-image of high spatial resolution formed from the images of each camera having a resolution of 1000 pixels x 1000 pixels.
- This step 108 comprises a sub-step 1 14 for generating a mega-image having a depth impression by combining the images acquired in the red band and the blue band.
- a measurement of the distance of the objects present in the image is performed as described in patent EP 0 759 674 by comparing the image obtained in each band.
- the exploitation of the bi-spectral images for the evaluation of the distance is unchanged compared to that described in this document.
- the red band is chosen to be partially absorbed. In the case of the band 3-5 ⁇ , for a natural object (black body or solar reflection) the blue band is little absorbed by the carbon dioxide, while the red band undergoes a variable effect with the distance.
- the comparison of the signals of the two bands makes it possible to estimate the distance.
- the ratio of the intensity of each pixel of the image in the red band and the blue band is calculated.
- the ratio is a function of the atmospheric transmission which is a function of the distance of the object imaged on the pixel.
- FIG. 5 is an example of atmospheric transmission, in the spectral bands situated on either side of 4.5 ⁇ between 3 and 5 ⁇ , for two different distances.
- an image is displayed by the screen 7.
- This image is either the image having a depth impression resulting from the step 108, or the image of one or the other band depending on weather conditions.
- the step 1 of generating a watch information implemented by the means 16 for generating a watch information will now be detailed.
- the watch is to search for and detect targets and track them, that is to say, track their movement by measuring their position over time.
- Step 1 comprises a sub-step 1 17 for detecting a radiometric contrast by the means 16 for generating a watch information.
- the intensity of each pixel is compared to the intensity of a pixel representative of the background of the image, that is to say of a normal environment.
- the pixels representative of a possible target have an intensity different from that of the background for at least one of the two bands.
- the means 16 for generating a watch information identify the target (s) by their respective spectral signature, comparing the images produced in each of the bands.
- the intensities of the pixels are compared in the two bands pixel by pixel or group of pixels per group of pixels. This comparison allows example to evaluate the apparent temperature of the target and thus to deduce a class of object (man, tank ).
- a tracking of each target is generated during a step 120, that is to say a tracking of the position of the target.
- the track is performed on at least a plurality of images acquired in the same band.
- a target may be detected in a so-called “sensitive band” band but not in the other, then called “blind band”.
- This non-detection in the blind band and the value of the light intensity emitted by the target in the sensitive band form identification elements of the target.
- the detections made in the sensitive band are then used to identify the pixels of the blind band where the target is located and thereby obtain the spectral signature information in that band.
- a target is detected in the first band during a first period T1 and then in the second band in a second period T2 consecutive to T1.
- the track is preferably made in the first band during T1, then in the second for the period T2.
- step 1 12 of generating a threat information implemented by the means 18 for generating threat information is executed in order to establish whether the target is a threat. This step 1 12 will now be detailed.
- a threat departure information includes the detection of the departure of this threat, that is to say a fugitive emission or having a temporal signature characteristic of a type of threat (related to the propulsion of this threat). To generate this information it is preponderant to have both a radiometric sensitivity and a high temporal response.
- the processing for generating threat start information is performed on images of dimensions at least equal to 500 pixels ⁇ 500 pixels and delivered at a rate of at least 400 Hz.
- Step 1 12 comprises a substep 122 for searching for a signature or radiometric contrast and then for a spectral signature followed by a sub-step 124 for searching for a temporal signature and for discriminating the type of threat.
- an intensity different from that of the background for a pixel is a radiometric signature and is associated with a possible threat. In the case of a flame or a jet, the intensity is stronger than that of the bottom.
- the images from the two Sr and blue Sb red bands are combined to distinguish the threats from the bright points caused by the solar reflections by comparing the radiation in the two subbands.
- each Sr, Sb image in the infrared spectral band between 3 and 5 ⁇ is the result of the light emission of three contributions: the terrestrial background, the solar radiation and the missile jet if a missile is fired or the jet of mouth if ammunition is fired.
- the purpose of combining the two images Sr and Sb is to cancel the contribution of the natural background in the two subbands.
- the parameter A is generally chosen for all the pixels of the image.
- a positive signal S highlights a missile jet or a jet of mouth.
- a negative S signal corresponds to a solar reflection and a null signal to the terrestrial background.
- An advantage of this method is that the probability of false alarm for missile detection is decreased compared to the use of single-spectral camera. Indeed, the combination of these bands makes it possible to get rid of solar reflections and distinguish the emission of the missile from natural sources, unlike a single-spectral imaging system. For such a mono-spectral device, it is easy to detect the "hot" pixels that is to say having a strong intensity, nevertheless it is difficult to differentiate if they are associated with a threat departure or a reflection solar on a surface.
- the luminous intensity of these pixels, identified as possible threats is tracked over time in one or both bands.
- the temporal profile of the luminous intensity then makes it possible to discriminate the type of threat, by what is called their temporal signature.
- a shot has a very short emission, of the order of a millisecond, compared to the missiles which are thus detected by the emission of their jet or flame whose emission is long, of the order of several seconds.
- tracking can be performed as in step 120 to track the threat. For example, to track the movement of a missile.
- Standby and threat information is then displayed on screen 7.
- the threat is indicated on the image having a depth impression made in step 1 14 and displayed on the screen in step 7.
- the track of a target is displayed by overlay on this same image.
- the detector of the or each bi-spectral camera 4 has a minimum dimension of 500 pixels ⁇ 500 pixels. In a known manner, this device makes it possible to improve the image intended for observation to the detriment of the temporal resolution.
- the dual-spectral camera 4 comprises a micro-scanning system 12, such as for example that described in patent EP 0 759 674.
- the microsweep is performed on a plurality k of consecutive positions and preferably on at least 4 positions.
- the micro-scanning system is of the diasporameter type.
- an example of a four-position micro-scan is illustrated by the displacement in four successive positions denoted Im T1 to Im T4 of the image of a point object on four adjacent pixels denoted P1 to P4 of the detector. 10.
- a bi-spectral matrix of dimensions of 500 pixels ⁇ 500 pixels and 400 Hz acquisition frequency then generates 400 frames per second, each of dimensions 500 pixels ⁇ 500 pixels.
- An image comprises the four consecutive bi-spectral fields generated by the micro-scan.
- a micro-scanning device makes it possible to generate additional pixels and thus to improve the sampling of the image and to increase its resolution.
- each bi-spectral image reconstructed after a micro-scan has a size of 1000 pixels x 1000 pixels x 2 spectral bands.
- the micro-scan makes it possible to perform non-uniformity corrections (NUC).
- FIG. 11 Another embodiment of the method will now be detailed.
- This embodiment is intended to be implemented by an imaging device comprising a micro-scanning device as shown in FIG. 9.
- the steps identical to the previous embodiment bear the same reference and will not be detailed here. -after.
- the step 102 of acquiring a plurality of bi-spectral images by M cameras comprises a sub-step 130 of micro-scanning in a plurality k of positions of the detector pixels.
- the optical flux sweeps each pixel of the array of the detector in a plurality k of positions through the micro-scan system 12.
- k is equal to 4.
- k positions of the scanning of the optical flux thus generate k frames shifted on the matrix of photodetectors forming an image.
- a plurality of bi-spectral images of k two-color frames are generated at the frequency F.
- Each frame of a strip has dimensions of at least 500 pixels x 500 pixels.
- the images resulting from the microsweep and the two spectral bands are treated in different ways according to the information to be generated.
- the imaging information generation step 108 comprises a sub-step 132 of combining two successive two-color mega-images before generating in step 1 an image having an impression of depth.
- This sub-step 132 is executed by means of combining a plurality of two-color mega-images of the processing means 6 of the imaging device 2.
- an imaging device having a two-color camera whose matrix has a dimension of 500 pixels ⁇ 500 pixels, an acquisition frequency of 400 Hz and comprising a 4-position micro-scanning device will make it possible to generate images.
- This temporal resolution is sufficient to display imaging information for example for flight aid that requires a temporal resolution at least equal to that of the human visual system.
- the step 1 of generating a standby information comprises a substep 134 identical to the substep 132 before carrying out the steps 11 and 18 for detecting a radiometric contrast and identification. of targets by spectral signature.
- these sub-steps are common and implemented by common means of processing the plurality of bi-spectral mega-images at means 16 and 20 in order to reduce the processing time of the images.
- the step 1 12 for generating a threat information comprises a substep 136 of summation of k adjacent pixels for each bi-spectral mega-image before carrying out the step 122 of searching for a radiometric contrast and spectral signature.
- This sub-step 136 is intended to improve the spatial resolution of the images. It is performed by calculation means integrated in the processing means 6 of the imaging device 2. Indeed, the micro-scanning dilutes the signal caused by the emission of a point object. For example, in FIG. 3, during the acquisition of the image Im T4, the signal is shared between the 4 pixels P1, P2, P3 and P4.
- the signals of 4 adjacent pixels are summed for each image of the same frame, the set of 4 pixels seeing at each instant almost the entire signal emitted by a point.
- a plurality of 400 Hz images of bi-spectral fields are generated, the image of which in a strip is 500 pixels ⁇ 500 pixels.
- the spatial resolution of an image is decreased by 2, but at least one of the pixels contains the entire signal.
- the spectral signature search step 122 is then performed on this frame.
- the images or signals generated during the micro-scanning step are exploited differently and optimally according to the information sought.
- the method according to the invention thus makes it possible to generate, simultaneously and by the same device, at least two of:
- An advantage of a multi-function imaging system according to the invention is the reduction of the number of detectors and means necessary to perform all the functions considered and thus the cost reduction of the entire system and the reduction of costs. integration with a platform.
- the invention is not limited to the embodiments described and shown, in particular it can be extended to other bands of the infrared band or other spectral bands, for example in the 8-12 ⁇ band.
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR1002957A FR2962827B1 (en) | 2010-07-13 | 2010-07-13 | METHOD AND DEVICE FOR BI-SPECTRAL MULTIFUNCTION IMAGING |
PCT/FR2011/051674 WO2012007692A1 (en) | 2010-07-13 | 2011-07-13 | Multifunctional bispectral imaging method and device |
Publications (1)
Publication Number | Publication Date |
---|---|
EP2593904A1 true EP2593904A1 (en) | 2013-05-22 |
Family
ID=43661948
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP11741667.7A Ceased EP2593904A1 (en) | 2010-07-13 | 2011-07-13 | Multifunctional bispectral imaging method and device |
Country Status (5)
Country | Link |
---|---|
US (1) | US20130235211A1 (en) |
EP (1) | EP2593904A1 (en) |
FR (1) | FR2962827B1 (en) |
IL (1) | IL224156A (en) |
WO (1) | WO2012007692A1 (en) |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2884422A1 (en) * | 2013-12-10 | 2015-06-17 | BAE Systems PLC | Data processing method and system |
AU2014361104B2 (en) | 2013-12-10 | 2019-11-21 | Bae Systems Plc | Data processing method |
AU2014361105A1 (en) * | 2013-12-10 | 2016-06-30 | Bae Systems Plc | Data processing method and system |
FR3051617B1 (en) * | 2016-05-23 | 2018-06-29 | Institut National De L'information Geographique Et Forestiere (Ign) | SHOOTING SYSTEM |
EP3591427B1 (en) * | 2018-07-05 | 2023-06-14 | HENSOLDT Sensors GmbH | Missile alerter and a method for issuing a warning about a missile |
CN111948955B (en) * | 2020-08-09 | 2022-12-09 | 哈尔滨新光光电科技股份有限公司 | Photoelectric distributed aperture system test method and simulation test system |
Family Cites Families (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3103586A (en) * | 1958-12-08 | 1963-09-10 | Gen Mills Inc | Passive infrared ranging device using absorption bands of water vapor or carbon dioxide |
IT9047971A1 (en) * | 1989-06-02 | 1990-12-03 | Thomson Csf | MULTISPETTRAL ANALYSIS PROCEDURE OF AN IMAGE WITH THE AID OF ONLY ONE DETECTOR SYSTEM AND MULTISPETTRAL DEVICE FOR THE IMPLEMENTATION OF THIS PROCEDURE. |
FR2650929B1 (en) * | 1989-08-08 | 1995-07-21 | Thomson Csf | SYSTEM FOR BISPECTRAL VIEWING AND FALSE COLOR VIEWING |
US4996430A (en) * | 1989-10-02 | 1991-02-26 | The United States Of America As Represented By The Secretary Of The Army | Object detection using two channel active optical sensors |
FR2692369A1 (en) * | 1992-06-12 | 1993-12-17 | Thomson Csf | Omnidirectional monitoring device with optimal coverage of the surrounding space by joining fields. |
US5282013A (en) * | 1992-06-26 | 1994-01-25 | Spar Aerospace Limited | Passive ranging technique for infrared search and track (IRST) systems |
FR2738067B1 (en) * | 1995-08-22 | 1997-09-19 | Thomson Csf | METHOD FOR PROVIDING THE DEPTH IMPRESSION IN A THERMAL IMAGE AND CAMERA FOR CARRYING OUT SAID METHOD |
FR2738630B1 (en) * | 1995-09-08 | 1997-10-24 | Thomson Csf | METHOD FOR CLASSIFYING THREATS BY BISPECTRAL INFRARED DETECTION AND CORRESPONDING WATCH DEVICE |
US5960097A (en) * | 1997-01-21 | 1999-09-28 | Raytheon Company | Background adaptive target detection and tracking with multiple observation and processing stages |
DE10118628C1 (en) * | 2001-04-12 | 2002-12-05 | Aeg Infrarot Module Gmbh | Detecting spectrally selective infrared radiator involves acquiring broadband image and image in sub-band of broadband image in immediate succession using infrared detector |
FR2830339B1 (en) * | 2001-10-02 | 2003-12-12 | Thales Sa | PASSIVE WATCH OPTRONIC DEVICE |
US7189970B2 (en) * | 2003-08-29 | 2007-03-13 | Power Diagnostic Technologies Ltd. | Imaging of fugitive gas leaks |
US20060021498A1 (en) * | 2003-12-17 | 2006-02-02 | Stanley Moroz | Optical muzzle blast detection and counterfire targeting system and method |
US7732769B2 (en) * | 2005-11-08 | 2010-06-08 | General Atomics | Apparatus and methods for use in flash detection |
BRPI0819966A2 (en) * | 2008-01-23 | 2015-06-16 | Elta Systems Ltd | "method for use in detecting a firearm flash event, device for use in detecting a firearm flash event, processing unit for use in detecting a flash event mouth and method for use in detecting firearm glare " |
DE102008011123B4 (en) * | 2008-02-26 | 2012-09-06 | Eads Deutschland Gmbh | Method for determining the distance of an object emitting an IR signature |
-
2010
- 2010-07-13 FR FR1002957A patent/FR2962827B1/en not_active Expired - Fee Related
-
2011
- 2011-07-13 EP EP11741667.7A patent/EP2593904A1/en not_active Ceased
- 2011-07-13 WO PCT/FR2011/051674 patent/WO2012007692A1/en active Application Filing
- 2011-07-13 US US13/810,079 patent/US20130235211A1/en not_active Abandoned
-
2013
- 2013-01-10 IL IL224156A patent/IL224156A/en active IP Right Grant
Non-Patent Citations (4)
Title |
---|
ARNOLD GOLDBERG: "IMAGING PERFORMANCE OF ADVANCED QWIP FOCAL PLANE ARRAYS", INTERNATIONAL JOURNAL OF HIGH SPEED ELECTRONICS, vol. 12, no. 03, 20 September 2002 (2002-09-20), GB, pages 659 - 690, XP055740666, ISSN: 0129-1564, DOI: 10.1142/S0129156402001666 * |
J.B. MONTGOMERY ET AL: "Two color missile signature measurements", AEROSPACE AND ELECTRONICS CONFERENCE, 1996. NAECON 1996., PROCEEDINGS OF THE IEEE 1996 NATIONAL, vol. 2, 1 January 1996 (1996-01-01), pages 782 - 786, XP055744268, ISBN: 978-0-7803-3306-2, DOI: 10.1109/NAECON.1996.517740 * |
RAINER BREITER ET AL: "Multicolor and dual-band IR camera for missile warning and automatic target recognition", PROCEEDINGS OF SPIE, vol. 4718, 6 August 2002 (2002-08-06), US, pages 280 - 288, XP055744299, ISSN: 0277-786X, DOI: 10.1117/12.478815 * |
See also references of WO2012007692A1 * |
Also Published As
Publication number | Publication date |
---|---|
US20130235211A1 (en) | 2013-09-12 |
FR2962827B1 (en) | 2013-05-10 |
WO2012007692A1 (en) | 2012-01-19 |
IL224156A (en) | 2017-03-30 |
FR2962827A1 (en) | 2012-01-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7732769B2 (en) | Apparatus and methods for use in flash detection | |
US7193214B1 (en) | Sensor having differential polarization and a network comprised of several such sensors | |
WO2012007692A1 (en) | Multifunctional bispectral imaging method and device | |
EP0628780B1 (en) | Aiming system for aircraft | |
EP3103062B1 (en) | Method for detecting and classifying events of a scene | |
EP3268691B1 (en) | Airborne device for detecting shots and for piloting assistance | |
AU2006202955A1 (en) | Infrared laser illuminated imaging systems and methods | |
US9300866B2 (en) | Method for image processing and method that can be performed therewith for the automatic detection of objects, observation device and method for high-precision tracking of the course followed by launched rockets over large distances | |
US11471717B1 (en) | Early fire detection and suppression | |
EP1718067A1 (en) | Airborne surveillance procedure and system using analysis of infrared images | |
EP3759518B1 (en) | Method and system for emitting and receiving laser pulses | |
EP3884656B1 (en) | Device and method for observing a scene comprising a target | |
von Flotow et al. | Shallow Search of a 10-Mile Swath with a Flight of Ship-Based UAVs | |
Peli et al. | Signal processing improvements for infrared missile warning sensors | |
Brännlund et al. | Detection and localization of light flashes using a single pixel camera in SWIR | |
EP3797510B1 (en) | Panoramic observation system for platform | |
EP0540395B1 (en) | Passive artillary fire or analogue detector | |
EP1882204B1 (en) | Optical head for detecting the launch of missiles or other monitoring equipment | |
FR2969273A1 (en) | Portable bi-spectral fire control system for launching surface to air missile toward aircraft, has camera detecting electromagnetic radiation with spectral band that is chosen so as to maximize contrast and/or signal to noise ratio | |
FR2974432A1 (en) | LASER ACTIVE IMAGING DIFFERENTIAL GUIDING DEVICE | |
WO2024018164A1 (en) | Method and system for daytime infrared space surveillance | |
FR3134470A1 (en) | Infrared surveillance system for military aircraft and military aircraft, in particular a missile, equipped with such a system | |
Chauhan et al. | Sensors for desert surveillance | |
FR2736491A1 (en) | OPTICAL DETECTION DEVICE | |
FR2924230A1 (en) | Detection device for detecting head of directed infrared counter-measure system in e.g. aircraft, has separation element arranged with respect to objective and matrix detector to produce reference and secondary images on surface of detector |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20130211 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
17Q | First examination report despatched |
Effective date: 20171122 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R003 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED |
|
18R | Application refused |
Effective date: 20210408 |