CN1707250A - Optically-augmented microwave imaging system and method - Google Patents
Optically-augmented microwave imaging system and method Download PDFInfo
- Publication number
- CN1707250A CN1707250A CN200510068211.XA CN200510068211A CN1707250A CN 1707250 A CN1707250 A CN 1707250A CN 200510068211 A CN200510068211 A CN 200510068211A CN 1707250 A CN1707250 A CN 1707250A
- Authority
- CN
- China
- Prior art keywords
- microwave
- optical image
- imaging system
- imagery
- image information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/88—Radar or analogous systems specially adapted for specific applications
- G01S13/89—Radar or analogous systems specially adapted for specific applications for mapping or imaging
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N22/00—Investigating or analysing materials by the use of microwaves or radio waves, i.e. electromagnetic waves with a wavelength of one millimetre or more
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/86—Combinations of radar systems with non-radar systems, e.g. sonar, direction finder
- G01S13/867—Combination of radar systems with cameras
Abstract
An imaging system includes an optical (visible-light or near IR) imaging system and a microwave imaging system. The optical imaging system captures an optical image of the object, produces optical image data representing the optical image and extracts optical image information from the optical image data. The microwave imaging system produces microwave image data representing a microwave image of the object in response to the optical image information.
Description
Technical field
The present invention relates to microwave imaging system and method that optics strengthens.
Background technology
Typical microwave imaging system is worked in the frequency range of 1GHz to 100GHz, corresponding to the wavelength of 30cm to 0.33cm in the free space.As a comparison, optics or visual light imaging system work in the frequency range of 750THz to 430THz, corresponding to the wavelength of 0.4 μ m to 0.7 μ m.Though all be electromagnetic wave in essence, different wavelength produces different imaging characteristics.For example, microwave radiation can penetrate the opaque object of visible light.As a result, microwave imaging system can pass the measurement that obtains object outerly.
Traditional microwave imaging system depends on measurement from the microwave radiation of object and set up the image of object based on this actinometry.Use antenna and adjacent receiver circuit to obtain actinometry.Antenna can be the unit piece antenna, or is made up of less sub antenna element array.In addition, antenna and receiver circuit can be worked in the combination of sending mode, receiving mode or transmission and receiving mode.
The microwave radiation of standard comprises from the amplitude of the wavefront of object scattering and phase place or one of them.Processing amplitude and/or phase measurement are to set up the image of object.For example, can use and set up algorithm based on the computer picture of Fourier and set up the wavefront that is sampled.In the Fourier Array Imaging (Fourier array image-forming) (1994) that Mehrdad Soumekh writes, the example of setting up algorithm based on the computer picture of Fourier has been described.But this sets up process often is computation-intensive.In addition, in many situations, what obtain sets up the shortcoming that image has poor resolution or the processing pseudomorphism such as spot (processing artifact).What therefore, microwave imaging system needed is to set up high-quality image with the computation complexity of reduction.
Summary of the invention
Embodiments of the invention provide a kind of imaging system that comprises optics (visible light or nearly IR) imaging system and microwave imaging system.Optical imaging system is configured to catch the optical imagery of object, produces and represents the optical image data of optical imagery, and extract optical image information from optical image data.Microwave imaging system can operate to use the microwave radiation irradiating object, and carries out microwave measurement in response to this.Microwave imaging system is configured in response to optical image information and microwave measurement, produces the microwave imagery data of the microwave imagery of representing object.
In one embodiment, microwave imaging system can be operated in response to optical image information, discerns the area of space corresponding data point relevant with object, and uses microwave measurement to handle the data point that is identified.In other embodiments, microwave imaging system can be operated microwave irradiation is guided to the area of space relevant with object.Use optical image information to discern described area of space.In another embodiment, microwave imaging system can operate the motion of following the tracks of object in response to optical image information.
Optical imaging system uses fast and simple algorithm is extracted optical image information.Optical image information can reduce the computation complexity of setting up microwave imagery, and microwave irradiation is limited in interesting areas on the object, makes it possible to improve resolution thus, and reduces the pseudomorphism of microwave imagery.In addition, embodiment provided by the invention perhaps substitutes above-mentioned feature and advantage except above-mentioned feature and advantage, also have other feature and advantage.With reference to the accompanying drawings, from the following description, many in these feature and advantage of the present invention will become clear.
Description of drawings
Invention disclosed will be described with reference to the drawings, and accompanying drawing shows the important example embodiment of the present invention, and it is bonded in the instructions with for referencial use, wherein:
Fig. 1 is the reduced representation according to the exemplary imaging system that optics (visible light) imaging system is combined with microwave imaging system of the embodiment of the invention;
Fig. 2 is the reduced representation according to the exemplary optics imaging system of the embodiment of the invention;
Fig. 3 is the reduced representation according to the exemplary microwave imaging system of the embodiment of the invention;
Fig. 4 strengthens the block scheme of the image processing system of microwave imaging system according to the embodiment of the invention with optical imaging system;
Fig. 5 A illustrates the conventional images of the simplification of object volume and sets up technology;
Fig. 5 B illustrates the image of the simplification of object volume according to an embodiment of the invention and sets up;
Fig. 6 illustrates the simplification of object periphery according to another embodiment of the present invention and sets up;
Fig. 7 A illustrates the conventional images of simplification of the part of object periphery and sets up technology;
Fig. 7 B illustrates the simplified image foundation of the part of object periphery according to another embodiment of the present invention;
Fig. 8 is the process flow diagram that passes through to determine with optical imaging system enhancing microwave imaging system the exemplary process of microwave imagery according to the embodiment of the invention;
Fig. 9 is the process flow diagram that the optical image information that uses optical imaging system to provide is according to an embodiment of the invention set up the exemplary process of microwave imagery;
Figure 10 is the process flow diagram that the optical image information that uses optical imaging system to provide according to another embodiment of the present invention guides to microwave irradiation the exemplary process of area-of-interest on the object
The motion that the optical image information that Figure 11 is to use optical imaging system to provide is followed the tracks of object is with the process flow diagram of the exemplary process of the microwave imagery of setting up object.
Embodiment
Fig. 1 is the reduced representation of exemplary imaging system 10, wherein uses optical imaging system 100 to strengthen microwave imaging system 200.Here, term " microwave imaging system " is meant the imaging system in microwave frequency range work, and the result images that obtains by microwave imaging system is called as " microwave imagery ".In addition, here, term " optical imaging system " is meant the imaging system of working in visible light or nearly IR frequency range, and is called as " optical imagery " by the result images of optical imaging system acquisition, so that they are distinguished mutually with the microwave imagery that obtains by microwave imaging system.
For example, imaging system 10 can be used in and be used for checking and salute or passenger's airport security system, during perhaps any other microwave imaging is used.Optical imaging system 100 comprises light source 110 and camera 140, and wherein light source 110 is used for light 120 irradiating objects 20, and camera 140 is used to receive from reflected by objects light 130 to catch the optical imagery of object 20.Camera 140 comprises one or more cameras 140 that are used to catch described optical imagery.Microwave imaging system 200 comprises microwave node 210 and 230, and they are configured to launched microwave radiation 220 and are used for irradiating object 20. Microwave node 210 and 230 also is configured to receive microwave radiation 225 from the object reflection to catch the microwave imagery of object 20.
Illustrate in greater detail optical imaging system 100 among Fig. 2.As mentioned above, light source 110 usefulness light 120 irradiating objects 20.Light source 110 can be any suitable visible light or nearly IR light source.For example, light source 110 can comprise one or more luminous units, for example, one or more pointolites, one or more collimations or structuring light source, one or more array of source, perhaps any other is suitable for use in the combination of the light source in the optical imaging system 100.Camera 140 receives from the light 130 of object 20 reflections.Should be appreciated that camera 140 is placed on the one or more cameras in the optical imaging system 100 with comprising optimization.To each camera 140, reflected light 130 is guided the sensor 150 that enters in the camera 140 with lens 145.Sensor 150 comprises a plurality of pixels 155, is used to catch the optical imagery of object 20 and produces the optical image data 165 of representing this optical imagery.
Optical imaging system 100 also comprises processor 160, is used to receive the optical image data 165 of the image of representing object 20 and optical image data 165 is handled to extract the optical image information 175 relevant with optical imagery.Processor 160 can be the other types processing apparatus that microprocessor, microcontroller, programmable logic device (PLD) maybe can be carried out function as described herein.In addition, processor 160 can comprise that a plurality of processors maybe can be the single general processors that can carry out some algorithms.
Microwave imaging system 200 (shown in Figure 1) uses optical image information 175 to produce the microwave imagery data of the microwave imagery of representing object 20.For example, in one embodiment, the corresponding data point of interested area of space that optical image information 175 identification and object 20 are relevant.Can use with the corresponding data point that is identified of interested area of space microwave radiation is directed to interested area of space, microwave imagery is set up in the corresponding microwave measurement of the data point of perhaps using and being identified.In another embodiment, by the position of microwave measurement with object 20 is associated, use optical image information 175 to follow the tracks of the motion of object 20.
Fig. 3 illustrates in greater detail microwave imaging system 200.As top described in conjunction with Figure 1, microwave node 210 and 230 usefulness microwave radiations, 220 irradiating objects 20, and receive microwave radiation 225 from object 20 reflections to catch the microwave imagery of object 20. Microwave node 210 and 230 each all comprise separately aerial array 215 and 235, they have a plurality of antenna elements 216 and 236 respectively. Antenna element 216 and 236 guides to object 20 with microwave radiation 220, and receives from the microwave radiation 225 of object 20 reflections.
Should be appreciated that, depend on the type and the application of microwave node 210 and 230, can use one or more microwave nodes 210 and 230.Should also be appreciated that, microwave node 210 and 230 can comprise the microwave antenna of any kind, and these microwave antennas comprise that a source antenna, reception also receive from the bilateral antenna of the microwave radiation 225 of object 20 reflections from the unidirectional antenna of the microwave radiation of object and to object transmission microwave radiation 220.For example, microwave node 210 and 230 can comprise transmission discrete in discrete transmission and receiving antenna, the same antenna array and receiving antenna unit, discrete transmission and receiving antenna array, perhaps can send and receive the one or more antennas or the antenna element of microwave radiation.
In one embodiment, microwave measurement 245 comprises from the amplitude and the phase measurement of the wavefront of object 20 scatterings.To measure 245 and send to processor 240, processor 240 is worked to set up the microwave imagery of object 20 in response to measurement 245.For example, processor 240 can use based on the algorithm of setting up of Fourier and set up microwave imagery.Processor 240 can be the other types processing apparatus that microprocessor, microcontroller, programmable logic device (PLD) maybe can be carried out function described here.In addition, processor 240 can comprise a plurality of processors, maybe can carry out the single general processor of some algorithms.
Fig. 4 is the block diagram according to the image processing system 400 of the embodiment of the invention, wherein uses optical imaging system to strengthen the microwave imagery system.Image processing system 400 comprises optical image processor 160 and microwave imagery processor 240.Optical image processor 160 comprises image processor 420 and extracts processor 430.In one embodiment, image processor 420 and extraction processor 430 are ASIC or the FPGA circuit that are configured to carry out following function.In another embodiment, image processor 420 and extraction processor 430 are combined in execution algorithm with in the general processor of carrying out following function.
Optical image processor 160 receives the view data 165 of representing optical imagery from sensor 150.Should be appreciated that if a plurality of cameras are arranged, then each camera provides independent optical imagery to optical image processor 160.In addition, depend on employed light source, optical image processor 160 may also need to obtain the information about the light source irradiation pattern.
A/D converter is numeral with view data 165 from analog-converted, and it is delivered to the image processor 420 of processes digital image data 165.For example, if sensor 150 is the color sensors that are combined with the chromatic filter array, then image processor 420 can remove mosaic (demosaic) to image.Removing mosaic is a kind of like this processing, by this processing, obtains the color-values that each location of pixels is lost from the neighbor interpolation.At present, the multiple known mosaic method of going is arranged in the prior art.As example and nonrestrictive, variously go that the mosaic method comprises that pixel is duplicated, bilinear interpolation and intermediate interpolated.The other types that image processor 240 can be carried out are handled and are comprised noise filtering and figure image intensifying.
Extract processor 430 and be connected the view data that receives after handling with from image processor 420, and operation is with the image data extraction optical image information 175 after processing.Multiple can being used for from the quick and simple algorithm known of view data 165 extraction optical image informations 175 arranged.For example, in one embodiment, the image that extraction processor 430 is used for 3-D view is set up the 3D surface that algorithm extracts object.In common pending trial and the common U.S. Patent Application Serial Number of transferring the possession of 10/392, describe the image that is used for 3-D view in 758 and set up the example of handling, wherein use the irradiation gradient to come to change from the intensity and/or the spectral characteristic of the irradiation of object reflection, to determine the surface graded of position, space on the body surface in the space.Use the surface graded 3-D view of setting up object then.Other 3-D views are set up to handle and are comprised laser triangulation, three-dimensional imaging, structured light and stereo photometry.For example, at Horn et al., " Toward Optimal structured Light Patterns ", IEEEProceedings International Conference on Recent Advances in 3-D DigitalImaging and Modeling, Ottowa, Ontario, Canada, May 12-15,1997, pp.28-35 and Beraldin et al., " Optimized Position Sensors for Flying-Spot ActiveTriangulation System ", IEEE Proceedings International Conference on RecentAdvances in 3-D Digital Imaging and Modeling, Banff.Albertta, Canada, October 6-10,2003, describe various 3-D views among the pp.29-36 and set up processing.
In another embodiment, extract the interested feature that processor 430 extracts object 20.Should be appreciated that employed phrase " feature of object " comprises measurement, object 20 surperficial last and inner assemblies or other marks of object 20 of object 20 here.In other embodiments, extract processor 430 and extract any other information of wanting from view data 165.
Extract processor 430 optical image information 175 is outputed to microwave treater 240, be used for when setting up microwave imagery, using.Also optical image information 175 is sent to display 180 from extracting processor 430.
Transceiver logic 440 receives microwave measurement 245, and microwave measurement 245 comprises from the amplitude and the phase measurement of the wavefront that receives microwave node (for example, node 210) scattering.Should be appreciated that, receive one or more antenna elements that microwave node 210 can comprise that individual antenna, entire antenna array or one or more aerial array are interior.A/D converter 450 is numeral with microwave measurement 245 from analog-converted, and it is delivered to image sets up processor 460, to set up the microwave imagery of object.Image is set up the view data 255 that processor 460 produces the microwave imagery of representing object, and microwave imagery data 255 are sent to display 180.
Transceiver logic 440 and image set up that 460 liang of processors are located or wherein a place receive by the optical image information 175 that extracts processor 430 outputs.In one embodiment, the relevant corresponding data point of interested area of space of optical image information 175 identification and object 20.Realize among the embodiment that at one transceiver logic 440 uses optical image information 175 to provide firing order 470 to launched microwave node (for example, microwave node 230), microwave radiation 220 is guided to interested area of space (or zone).Should be appreciated that launched microwave node 230 can comprise the one or more antenna elements in individual antenna, entire antenna array or the one or more aerial array.Realize among the embodiment that at another image is set up processor 460 and used optical image information 175 to set up microwave imagery to use with the corresponding measurement 245 of data point that is identified.
For example, at David M.Sheen et al., " Three-dimensional Millimeter-WaveImaging for Concealed Weapon Detection ", IEEE Tran.On Microwave Theoryand Techniques (MTT), Vol.49 (9): 1581-1592, September 2001 have described traditional microwave imagery and have set up processing in (hereinafter being called " Sheen ").In the scheme of the paper of Sheen, all (x, y is z) by discrete sampling for volumes.All carrying out the 3D inverse-Fourier transform on the volumes, this causes heavy computational load, and may cause inaccurately, thisly inaccurately itself shows as noise.Utilize optical image information 175, can discern the occupied actual volume of object that just is being studied, to determine which data point really needs to handle in the volume.Like this, in the discrete employing in space, only need handle relevant data point.Depend on to allow maximum volume of analyzing and the minimum that may run into to allow volume, can reduce computational load greatly.
As example, if object is 1m (wide) * 2m (length) * 1m (deeply), then the volume of object is 1 * 1 * 2=2m
3But, because do not know direction usually, so in traditional microwave imagery is set up, may need to handle 1.4 * 1.4 * 2=4m
3Volume.
By using optical image information 175 to determine that the actual volume that object is occupied, image set up 460 of processors and need the processing actual volume, this is representing and can save a large amount of computing times.The saving of this complexity is presented as following one or multinomial: calculate faster (1), the less measurement of (2) system (for example use still less frequency or antenna/camera still less) and (3) more excellent accuracy or to the more excellent refusal of the distortion " image " of the object outside the area-of-interest that drops on suitable definition.In addition, optical image information 175 can provide the knowledge of the shade that is caused about object 20.Determining which data point is blocked will be created in " clearer " scheme of the pseudomorphism that has minimizing in the microwave imagery, and/or scheme faster.
In another embodiment, optical image information 175 comprises 3D object space information, and image is set up processor and used this 3D object space information, with when moving, be associated with optical image information 175 by the microwave measurement 245 that will receive, determine the three-dimensional position of object.Optical processor 160 can be associated each point of given time by using traditional visible light track algorithm with the respective point of previous moment.Even this makes microwave treater 240 when movement of objects, also can handle microwave imagery data 255.At Shirai, " Estimation of 3-D Pose and Shape from aMonocular Image Sequence and Real-Time Human Tracking ", IEEEProceedings International Conference on Recent Advances in 3-D DigitalImaging and Modeling, Ottowa, Ontario, Canada, May 12-15,1997, pp.130-139 and Mecke et al., " 3-D Motion and Shape from Multiple Image Sequences ", IEEE Proceedings International Conference on Recent Advances in 3-D DigitalImaging and Modeling, Banff, Alberta, Canada, October 6-10,2003, the example of track algorithm has been described among the pp.155-162.
Fig. 5 A and Fig. 5 B illustrate the simplified image of the volume of object 20 and set up.The traditional image of Fig. 5 A representative is set up, and Fig. 5 B represents image foundation according to an embodiment of the invention.Fig. 5 A and Fig. 5 B illustrate and can easily be applied to three-dimensional two-dimensional example.
In Fig. 5 A, the grid of being made up of a plurality of data points 550 500 is used to handle entire area.Because the direction/position of object 20 in the space is unknown, grid must hold all changes.Therefore, in Fig. 5 A, each data point 550 in the grid 500 is all handled.As a comparison, shown in Fig. 5 B, when the position of object 20 (general at least) is known, only need the subclass 560 of deal with data point 550a.
Fig. 6 illustrates the periphery simplification of object 20 according to another embodiment of the present invention and sets up.Fig. 6 also illustrates and can easily be applied to three-dimensional two-dimensional example.Fig. 6 uses the same mesh 500 shown in Fig. 5 A.But, in Fig. 6, only the periphery 600 corresponding data point 550b with object 20 are handled.From optical image information identification periphery 600.For the object (for example, being installed with the people of loose clothes) of some kind, periphery 600 can be included in the interior data point of " deeply " shell around the object periphery, as shown in Figure 6.In other embodiments, not that whole peripheries are handled, form similar technology to wave beam and microwave radiation is only guided to the particular data point of considering but can use.Use optical image information to discern these particular data point.
Fig. 7 A and Fig. 7 B illustrate the simplified image of a part of the periphery of object 20 and set up.The traditional image of Fig. 7 A representative is set up, and Fig. 7 B represents image foundation according to another embodiment of the present invention.Because human body is extraordinary reflecting body at microwave frequency band, therefore strengthened the advantage of above-mentioned peripheral method.Like this, for example, in Fig. 7 A and Fig. 7 B, the oval xsect of representing human body (object 20), and triangle is represented imaging system 10.Usually, even because the reflection of human body, make and have only human body parts in the face of imaging system 10, but also should handle whole volumes by imaging.According to embodiments of the invention, use the microwave imaging system that strengthens with optical imaging system, use optical image information to discern borderline region 700, borderline region 700 comprises and the corresponding data point 550c of the part of human body periphery.Then, microwave imaging system guides to data point 550c in the borderline region 700 with microwave radiation, and only these data points 550c is handled.
Fig. 8 is the process flow diagram that produces the exemplary process 800 of the microwave imagery data of representing microwave imagery according to the use optics enhancing microwave imaging system of the embodiment of the invention.Processing starts from square frame 810.At square frame 820, obtain the optical imagery of object by optical imaging system.At square frame 830, from the optical image data of representing optical imagery, extract optical image information, and, optical image information is offered microwave imaging system at square frame 840.At square frame 850, microwave imaging system produces the microwave imagery data of representing microwave imagery in response to optical image information and the microwave measurement done by microwave imaging system.Processing ends at square frame 860.
Fig. 9 is the optical image information that provides in response to optical imaging system according to an embodiment of the invention and set up the process flow diagram of the exemplary process 900 of microwave imagery.Processing starts from square frame 910.At square frame 920, optical imaging system is caught the optical imagery of object.At square frame 930, the optical image data of representing optical imagery is handled to extract optical image information.At square frame 940, microwave imaging system obtains and the various response characteristics corresponding microwave measurement of object to microwave radiation.At square frame 950, microwave imaging system produces the microwave imagery data of representing the object microwave imagery in response to optical image information and microwave measurement.This processing ends at square frame 960.
Figure 10 is the optical image information that provides in response to optical imaging system according to another embodiment of the present invention and microwave irradiation is guided to the process flow diagram of the exemplary process 1000 of area-of-interest on the object.This processing starts from square frame 1010.At square frame 1020, optical imaging system is caught the optical imagery of object.At square frame 1030, the optical image data of representing optical imagery is handled to extract optical image information.At square frame 1040, use the optical image information identification area of space (for example, area-of-interest) relevant with object.At square frame 1050, shine area of space or the area-of-interest that is identified with microwave radiation, and at square frame 1060, microwave imaging system obtains and the various response characteristics corresponding microwave measurement of object to microwave radiation.At square frame 1070, microwave imaging system sets up from microwave measurement the microwave imagery of object by producing the microwave imagery data of representing microwave imagery.This processing ends at square frame 1080.
The motion that the optical image information that Figure 11 is to use optical imaging system to provide is followed the tracks of object is with the process flow diagram of the exemplary process 1100 of the microwave imagery of setting up object.This processing starts from square frame 1110.At square frame 1120, microwave imaging system begins to obtain and the various response characteristics corresponding microwave measurement of object to microwave radiation.At square frame 1130, optical imaging system is caught the optical imagery of object.At square frame 1140, the optical image data of representing optical imagery is handled to extract optical image information.At square frame 1150, use optical image information to determine the zone of being shone by microwave radiation on the position of object and the object.At square frame 1160, judge that microwave measurement obtains processing and whether finish.If do not finish, then catch the additional optical imagery of object, and in square frame 1140-1150, it is handled to determine the reposition of object at square frame 1130, wherein the reposition with object is associated with microwave measurement.Finish dealing with if microwave obtains, then at square frame 1170, microwave imaging system is set up the microwave imagery of object in response to optical image information and microwave measurement.This processing ends at square frame 1180.
The innovation concept of Miao Shuing can be modified in using on a large scale and change in this application.Therefore, the scope of patented subject matter is not limited in described any concrete exemplary teachings, but is defined by claims.
Claims (21)
1. imaging system comprises:
Optical imaging system, it is configured to catch the optical imagery of object, produces the optical image data of the described optical imagery of representative and extract optical image information from described optical image data; With
Microwave imaging system, it can be operated and use microwave radiation to shine described object, and carrying out microwave measurement in response to this, described microwave imaging system is configured in response to described optical image information and described microwave measurement, produces the microwave imagery data of the microwave imagery of the described object of representative.
2. imaging system as claimed in claim 1, wherein said microwave measurement are measured the response characteristic of described object to described microwave radiation.
3. imaging system as claimed in claim 1, wherein said microwave imaging system can be operated in response to described optical image information, discern the area of space corresponding data point relevant with described object, described microwave imaging system also can be operated and use described microwave measurement to handle the described data point that is identified to produce described microwave imagery data.
4. imaging system as claimed in claim 3, wherein said microwave imaging system can operate in response to described optical image information, and microwave radiation is guided to described area of space.
5. imaging system as claimed in claim 3, wherein said area of space is positioned at the periphery of described object.
6. imaging system as claimed in claim 3, wherein said area of space is positioned at borderline region, and described borderline region comprises at least one side of object.
7. imaging system as claimed in claim 3, wherein said area of space make described microwave imaging system can handle the data point in the occupied volume of described object.
8. imaging system as claimed in claim 1, wherein said microwave imaging system can operate in response to described optical image information, follow the tracks of the motion of described object.
9. imaging system as claimed in claim 1, wherein said optical imaging system comprises:
Light source is arranged to the described object of irradiation; With
Sensor is used for producing described optical image data in response to the light that is reflected by described object.
10. imaging system as claimed in claim 1, wherein said microwave imaging system comprises:
The microwave node is configured to microwave radiation is guided to described object, and receives from the microwave radiation of described object reflection.
11. an image processing system comprises:
Processor, it is connected to receive the optical image data of the optical imagery of representing object, described processor can be operated from described optical image data and extract optical image information, reception is in response to the microwave measurement of described object illumination being carried out with microwave radiation, and, produce the microwave imagery data of the microwave imagery of the described object of representative in response to described optical image information and described microwave measurement.
12. image processing system as claimed in claim 11, wherein said processor comprises optical image processor and microwave imagery processor, wherein said optical image processor can be operated and extract described optical image information, described microwave imagery processor is connected to receive described optical image information from described optical image processor and to receive described microwave measurement, and described microwave imagery processor can be operated to produce described microwave imagery data in response to described optical image information and described microwave measurement.
13. image processing system as claimed in claim 12, wherein said microwave imagery processor also can be operated in response to described optical image information, discern the area of space corresponding data point relevant with described object, described microwave imagery processor also can be operated and use described microwave measurement to handle the described data point that is identified to produce described microwave data.
14. image processing system as claimed in claim 13, wherein said microwave imagery processor can be operated in response to described optical image information, make described microwave radiation be directed to described area of space.
15. image processing system as claimed in claim 12, wherein said microwave imagery processor also can be operated in response to described optical image information, follow the tracks of the motion of described object.
16. the method to object image-forming, described method comprises:
Obtain the optical image data of the optical imagery of representing object;
From described optical image data, extract optical image information; With
In response to described optical image information and the microwave measurement carried out in response to shining described object, produce the microwave imagery data of the microwave imagery of the described object of representative with microwave radiation.
17. method as claimed in claim 16, wherein said generation step also comprises:
Use described optical image information to discern the area of space corresponding data point relevant with described object; With
Use described microwave measurement to handle the described data point that is identified.
18. method as claimed in claim 17 also comprises:
Use described optical image information that described microwave radiation is guided to described area of space.
19. method as claimed in claim 16, wherein said generation step also comprises:
Follow the tracks of the motion of described object in response to described optical image information, to produce described microwave imagery data.
20. method as claimed in claim 16, wherein said obtaining step also comprises:
With the described object of rayed;
Reception is from the light of described object reflection; With
In response to described reflected light, produce described optical image data.
21. method as claimed in claim 16, wherein said generation step also comprises:
Shine described object with microwave radiation; With
The microwave radiation that reception is reflected by described object.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US10/863,733 | 2004-06-08 | ||
| US10/863,733 US6972714B1 (en) | 2004-06-08 | 2004-06-08 | Optically-augmented microwave imaging system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1707250A true CN1707250A (en) | 2005-12-14 |
| CN100465628C CN100465628C (en) | 2009-03-04 |
Family
ID=35229741
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB200510068211XA Active CN100465628C (en) | 2004-06-08 | 2005-04-27 | Optically-augmented microwave imaging system and method |
Country Status (4)
| Country | Link |
|---|---|
| US (2) | US6972714B1 (en) |
| EP (1) | EP1612545A3 (en) |
| JP (1) | JP5178995B2 (en) |
| CN (1) | CN100465628C (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102236051A (en) * | 2010-03-30 | 2011-11-09 | 索尼公司 | Radiometric imaging device and corresponding method |
Families Citing this family (43)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6917309B2 (en) * | 2002-10-28 | 2005-07-12 | Integritech System Engineering Ltd. | Foreign object detection system and method |
| US20040184653A1 (en) * | 2003-03-20 | 2004-09-23 | Baer Richard L. | Optical inspection system, illumination apparatus and method for use in imaging specular objects based on illumination gradients |
| US8345918B2 (en) * | 2004-04-14 | 2013-01-01 | L-3 Communications Corporation | Active subject privacy imaging |
| US7973697B2 (en) * | 2004-04-14 | 2011-07-05 | L-3 Communications Security And Detection Systems, Inc. | Surveillance systems and methods with subject-related screening |
| US20080174401A1 (en) * | 2004-04-14 | 2008-07-24 | L-3 Communications Security And Detection Systems, Inc | Surveillance of subject-associated items with identifiers |
| US8350747B2 (en) | 2004-04-14 | 2013-01-08 | L-3 Communications Security And Detection Systems, Inc. | Surveillance with subject screening |
| US6972714B1 (en) * | 2004-06-08 | 2005-12-06 | Agilent Technologies, Inc. | Optically-augmented microwave imaging system and method |
| US7460014B2 (en) * | 2004-06-22 | 2008-12-02 | Vubiq Incorporated | RFID system utilizing parametric reflective technology |
| US8643503B2 (en) | 2005-01-28 | 2014-02-04 | Kirill Mostov | Transportation security system and associated methods |
| US7280068B2 (en) * | 2005-07-14 | 2007-10-09 | Agilent Technologies, Inc. | System and method for microwave imaging with suppressed sidelobes using a sparse antenna array |
| ES2371758T3 (en) * | 2005-11-09 | 2012-01-09 | Saab Ab | MULTIPLE SENSOR SYSTEM. |
| US20070139248A1 (en) * | 2005-12-16 | 2007-06-21 | Izhak Baharav | System and method for standoff microwave imaging |
| GB0617586D0 (en) * | 2006-09-07 | 2006-10-18 | Mbda Uk Ltd | Improvements in or relating to scanners |
| WO2008070788A2 (en) * | 2006-12-06 | 2008-06-12 | Kirsen Technologies Corporation | System and method for detecting dangerous objects and substances |
| GB2445758A (en) * | 2007-01-17 | 2008-07-23 | Univ Hospital Of North Staffor | Intraoperative electromagnetic apparatus and related technology |
| US7768457B2 (en) * | 2007-06-22 | 2010-08-03 | Vubiq, Inc. | Integrated antenna and chip package and method of manufacturing thereof |
| US8115472B2 (en) | 2007-10-24 | 2012-02-14 | Kirsen Technologies Corporation Inc. | System and method for space control and remote monitoring |
| US8178825B2 (en) * | 2007-10-29 | 2012-05-15 | Honeywell International Inc. | Guided delivery of small munitions from an unmanned aerial vehicle |
| US20110102233A1 (en) * | 2008-09-15 | 2011-05-05 | Trex Enterprises Corp. | Active millimeter-wave imaging system |
| US8368586B2 (en) * | 2009-03-26 | 2013-02-05 | Tialinx, Inc. | Person-borne improvised explosive device detection |
| US8385461B1 (en) | 2009-04-20 | 2013-02-26 | Vubiq, Inc. | On-off keying using vector modulation |
| WO2010143174A1 (en) | 2009-06-12 | 2010-12-16 | Smiths Detection Ireland Limited | An image system designed to scan for security threats |
| EP2449030A1 (en) | 2009-07-01 | 2012-05-09 | Dow Corning Corporation | Microcapsules containing curable siloxanes |
| US8577183B2 (en) * | 2009-08-05 | 2013-11-05 | Raytheon Company | Resolution on demand |
| WO2011022556A2 (en) | 2009-08-19 | 2011-02-24 | Vubiq Incorporated | Precision waveguide interface |
| US9893406B2 (en) | 2009-08-19 | 2018-02-13 | Vubiq Networks, Inc. | Method of forming a waveguide interface by providing a mold to form a support block of the interface |
| TR201205754T1 (en) | 2009-11-03 | 2012-09-21 | Vawd Applied Science & Technology Corporation | Safety distance, despite the obstacle detection radar system. |
| WO2011100343A2 (en) * | 2010-02-09 | 2011-08-18 | Dartmouth College | System and method for collection and use of magnetic resonance data and microwave data to identify boundaries of interest |
| US9135830B2 (en) * | 2010-02-18 | 2015-09-15 | Xsight Systems Ltd. | Airport travel surface edge lighting and foreign object detection system and method |
| EP2558882B1 (en) | 2010-04-15 | 2018-05-23 | Smiths Detection Ireland Limited | An imaging system |
| US9019153B1 (en) * | 2011-12-20 | 2015-04-28 | Raytheon Company | Calibration of large phased arrays using fourier gauge |
| US9386936B2 (en) | 2013-03-13 | 2016-07-12 | Ellumen, Inc. | Distributed microwave image processing system and method |
| US9111334B2 (en) | 2013-11-01 | 2015-08-18 | Ellumen, Inc. | Dielectric encoding of medical images |
| US10254395B2 (en) * | 2013-12-04 | 2019-04-09 | Trimble Inc. | System and methods for scanning with integrated radar detection and image capture |
| CN103901048B (en) * | 2014-04-02 | 2016-10-05 | 华南师范大学 | A kind of device and method of microwave imaging |
| US20160178746A1 (en) * | 2014-06-30 | 2016-06-23 | Unique Solutions Design Ltd. | Handheld multi-sensor system for sizing irregular objects |
| CN105486751A (en) * | 2016-01-26 | 2016-04-13 | 国网上海市电力公司 | Equipment defect comprehensive detection system |
| US9869641B2 (en) | 2016-04-08 | 2018-01-16 | Ellumen, Inc. | Microwave imaging device |
| US10436895B2 (en) * | 2016-06-09 | 2019-10-08 | Ellumen, Inc. | Phase confocal method for near-field microwave imaging |
| DE102017206332A1 (en) | 2017-04-12 | 2018-10-18 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | System for detecting non-metallic, non-aqueous substances in a water-containing sample, a corresponding system and a corresponding method |
| US10818997B2 (en) | 2017-12-29 | 2020-10-27 | Vubiq Networks, Inc. | Waveguide interface and printed circuit board launch transducer assembly and methods of use thereof |
| CN108827899B (en) * | 2018-05-24 | 2020-11-20 | 江苏大学 | Infrared and microwave composite detection imaging platform and imaging method thereof |
| WO2020118058A1 (en) | 2018-12-05 | 2020-06-11 | Vubiq Networks, Inc. | High bit density millimeter wave rfid systems, devices, and methods of use thereof |
Family Cites Families (31)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| FR2296336A1 (en) * | 1974-12-27 | 1976-07-23 | Thomson Csf | VIDEO IMAGE DISPLAY SYSTEM AND ESPECIALLY RADAR VIDEO IMAGES ON A COLOR CATHODIC TUBE |
| JPS6171787A (en) * | 1984-09-14 | 1986-04-12 | Mitsubishi Heavy Ind Ltd | Environmental video monitor device |
| JPS63222286A (en) * | 1987-03-11 | 1988-09-16 | Tokyo Electric Power Co Inc:The | Underground buried object examining system |
| JPS63255683A (en) * | 1987-04-13 | 1988-10-21 | Hitachi Ltd | Apparatus for imaging extraneous substance |
| US5005147A (en) * | 1988-12-30 | 1991-04-02 | The United States Of America As Represented By The Administrator, The National Aeronautics And Space Administration | Method and apparatus for sensor fusion |
| IE61778B1 (en) * | 1989-01-04 | 1994-11-30 | Emyville Enterprises | Image processing |
| US5083089A (en) * | 1991-02-20 | 1992-01-21 | Spatial Dynamics, Ltd. | Fluid mixture ratio monitoring method and apparatus |
| GB9115537D0 (en) * | 1991-07-18 | 1991-09-04 | Secr Defence | An electro-optical detection system |
| JP3070277B2 (en) * | 1992-08-04 | 2000-07-31 | 日産自動車株式会社 | Preceding vehicle detection device |
| US5365237A (en) * | 1993-05-13 | 1994-11-15 | Thermo Trex Corporation | Microwave camera |
| US5774088A (en) * | 1994-07-26 | 1998-06-30 | The University Of Pittsburgh | Method and system for warning birds of hazards |
| US5835054A (en) * | 1996-03-01 | 1998-11-10 | The Regents Of The University Of California | Ultra wideband ground penetrating radar imaging of heterogeneous solids |
| US5760397A (en) * | 1996-05-22 | 1998-06-02 | Huguenin; G. Richard | Millimeter wave imaging system |
| US6037908A (en) * | 1996-11-26 | 2000-03-14 | Thermotrex Corporation | Microwave antenna |
| US6057761A (en) * | 1997-01-21 | 2000-05-02 | Spatial Dynamics, Ltd. | Security system and method |
| JPH10282247A (en) * | 1997-04-10 | 1998-10-23 | Mitsubishi Electric Corp | Metal detecting device |
| US6061068A (en) * | 1998-06-30 | 2000-05-09 | Raytheon Company | Method and apparatus for providing synthetic vision using reality updated virtual image |
| US5982326A (en) * | 1997-07-21 | 1999-11-09 | Chow; Yung Leonard | Active micropatch antenna device and array system |
| JPH1183996A (en) * | 1997-09-03 | 1999-03-26 | Omron Corp | Millimetric wave detector |
| DE19806450A1 (en) * | 1998-02-17 | 1999-08-26 | Deutsch Zentr Luft & Raumfahrt | Method for monitoring airports, sea ports or other action region |
| US5952957A (en) * | 1998-05-01 | 1999-09-14 | The United States Of America As Represented By The Secretary Of The Navy | Wavelet transform of super-resolutions based on radar and infrared sensor fusion |
| JP4308405B2 (en) * | 2000-04-14 | 2009-08-05 | 富士通テン株式会社 | Object detection device |
| US6545945B2 (en) * | 2001-02-26 | 2003-04-08 | Ocean Data Equipment Corporation | Material classification apparatus and method |
| US6501414B2 (en) * | 2001-04-02 | 2002-12-31 | The United States Of America As Represented By The United States National Aeronautics And Space Administration | Method for locating a concealed object |
| US20040077943A1 (en) * | 2002-04-05 | 2004-04-22 | Meaney Paul M. | Systems and methods for 3-D data acquisition for microwave imaging |
| US8095204B2 (en) * | 2002-08-09 | 2012-01-10 | Interstitial, Llc | Apparatus and method for diagnosing breast cancer including examination table |
| US6720905B2 (en) * | 2002-08-28 | 2004-04-13 | Personnel Protection Technologies Llc | Methods and apparatus for detecting concealed weapons |
| US20040051659A1 (en) * | 2002-09-18 | 2004-03-18 | Garrison Darwin A. | Vehicular situational awareness system |
| US20040184653A1 (en) | 2003-03-20 | 2004-09-23 | Baer Richard L. | Optical inspection system, illumination apparatus and method for use in imaging specular objects based on illumination gradients |
| CN1276267C (en) * | 2003-05-29 | 2006-09-20 | 北京联合正方智卫系统技术有限公司 | Electromagnetic wave detection method for limited space border and inner object state and change |
| US6972714B1 (en) * | 2004-06-08 | 2005-12-06 | Agilent Technologies, Inc. | Optically-augmented microwave imaging system and method |
-
2004
- 2004-06-08 US US10/863,733 patent/US6972714B1/en active Active
-
2005
- 2005-04-27 CN CNB200510068211XA patent/CN100465628C/en active Active
- 2005-06-02 JP JP2005162679A patent/JP5178995B2/en active Active
- 2005-06-06 EP EP05253473A patent/EP1612545A3/en not_active Ceased
- 2005-07-13 US US11/180,276 patent/US7940208B2/en active Active
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102236051A (en) * | 2010-03-30 | 2011-11-09 | 索尼公司 | Radiometric imaging device and corresponding method |
Also Published As
| Publication number | Publication date |
|---|---|
| US6972714B1 (en) | 2005-12-06 |
| EP1612545A2 (en) | 2006-01-04 |
| US20050270223A1 (en) | 2005-12-08 |
| JP2005351893A (en) | 2005-12-22 |
| CN100465628C (en) | 2009-03-04 |
| JP5178995B2 (en) | 2013-04-10 |
| US20050270220A1 (en) | 2005-12-08 |
| US7940208B2 (en) | 2011-05-10 |
| EP1612545A3 (en) | 2007-05-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1707250A (en) | Optically-augmented microwave imaging system and method | |
| US10608002B2 (en) | Method and system for object reconstruction | |
| Musarra et al. | Non-line-of-sight three-dimensional imaging with a single-pixel camera | |
| KR101652393B1 (en) | Apparatus and Method for obtaining 3D image | |
| JP6435661B2 (en) | Object identification system, information processing apparatus, information processing method, and program | |
| Zhang et al. | Rapid shape acquisition using color structured light and multi-pass dynamic programming | |
| US8379020B2 (en) | Image processing device using selective neighboring voxel removal and related methods | |
| US20050201612A1 (en) | Method and apparatus for detecting people using stereo camera | |
| JP6467776B2 (en) | Ranging system, information processing apparatus, information processing method, and program | |
| EP3149428A1 (en) | Motion contrast depth scanning | |
| CN112534474A (en) | Depth acquisition device, depth acquisition method, and program | |
| KR101928391B1 (en) | Method and apparatus for data fusion of multi spectral image and radar image | |
| CN111047650A (en) | Parameter calibration method for time-of-flight camera | |
| CN111445507B (en) | Data processing method for non-visual field imaging | |
| CN114460805A (en) | Shielding scattering imaging system based on high-pass filtering | |
| Liang et al. | Image Fusion with Spatial Frequency. | |
| CN113689400B (en) | Method and device for detecting profile edge of depth image section | |
| KR102211483B1 (en) | Information estimation apparatus and mothod of the object based on the laser pattern analysis | |
| WO2022014416A1 (en) | Gating camera, vehicle sensing system, and vehicle lamp | |
| Hegde et al. | Imaging for concealed weapon detection | |
| Wu et al. | Single-pixel imaging for partially occluded objects | |
| CN114298939A (en) | Aperture synthesis-based lamination intensity coherent imaging method and device | |
| Li et al. | An image fusion method based on biorthogonal wavelet | |
| CN115942071A (en) | Image shooting device and image processing method | |
| CN111583392A (en) | Object three-dimensional reconstruction method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |