CN107357936A - It is a kind of to merge multi-source image automatically to provide the context aware system and method for enhancing - Google Patents
It is a kind of to merge multi-source image automatically to provide the context aware system and method for enhancing Download PDFInfo
- Publication number
- CN107357936A CN107357936A CN201710703866.2A CN201710703866A CN107357936A CN 107357936 A CN107357936 A CN 107357936A CN 201710703866 A CN201710703866 A CN 201710703866A CN 107357936 A CN107357936 A CN 107357936A
- Authority
- CN
- China
- Prior art keywords
- image
- geocoding
- frame
- enhancing
- context aware
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000002708 enhancing effect Effects 0.000 title claims abstract description 31
- 238000000034 method Methods 0.000 title claims abstract description 26
- 230000004927 fusion Effects 0.000 claims abstract description 30
- 230000015654 memory Effects 0.000 claims abstract description 23
- 238000003860 storage Methods 0.000 claims abstract description 11
- 238000005516 engineering process Methods 0.000 claims abstract description 8
- 238000013500 data storage Methods 0.000 claims description 11
- 238000000605 extraction Methods 0.000 claims description 5
- 238000004891 communication Methods 0.000 claims description 4
- 230000001953 sensory effect Effects 0.000 claims description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 claims description 2
- 238000012544 monitoring process Methods 0.000 abstract description 6
- 238000012545 processing Methods 0.000 abstract description 5
- 239000000284 extract Substances 0.000 abstract description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- RTZKZFJDLAIYFH-UHFFFAOYSA-N Diethyl ether Chemical compound CCOCC RTZKZFJDLAIYFH-UHFFFAOYSA-N 0.000 description 2
- 206010045178 Tunnel vision Diseases 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000001149 cognitive effect Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 206010039203 Road traffic accident Diseases 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000032683 aging Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 239000000686 essence Substances 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000014759 maintenance of location Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000003032 molecular docking Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/7867—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/29—Geographical information databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/765—Interface circuits between an apparatus for recording and another apparatus
- H04N5/77—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/183—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
- H04N7/185—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source from a mobile camera, e.g. for remote control
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Library & Information Science (AREA)
- Remote Sensing (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
The invention belongs to image data processing technology field, discloses a kind of automatic fusion multi-source image to provide the context aware system and method for enhancing, including：Video camera generates video flowing out of aircraft；Video flowing captures frame interested；By image of interest frame and it is associated geographical code storage in screens recording and storing device；Extract geocoding；Inquiry conventional images store and are based on Query Location one or more image；Intercepted geocoding surrounding geographical image is stored in intermediate images storage；Capture frame and interception geocoding surrounding geographical image are moved to temporary data memory and capture frame is oriented on positioned image；Write markup language KML/KMZ files.The present invention allows geographic pattern browser to check fused images；Detailed near-realtime picture is provided from monitoring video, while video image is placed in greater room context relation by conventional images；The image of fusion is watched in bigger spatial context relation.
Description
Technical field
The invention belongs to image data processing technology field, more particularly to a kind of automatic fusion multi-source image to provide enhancing
Context aware system and method.
Background technology
Various surveillance operations are dependent on the view data collected and handled.View data can take still image or video
Form.This surveillance operation can be carried out by aircraft, satellite, ship or vehicle.Regardless of source, collected image is all
The processing of real-time or near real-time, to support Real-time Decision.Unmanned vehicle (or " UAV "), can be terrestrial operation person
The monitoring video of near real-time is provided.Based on this, terrestrial operation person can make important decision-making.These decision-makings may include whether
Highway is promptly closed a road to traffic, fire brigade is sent, sends the scenes such as 120 rescues.Although UAV monitors video
Can in real time or near real-time shooting, but generally influenceed by the narrow visual field of camera.Need to carry out multi-source data
Fusion, to strengthen context aware ability.
In summary, the problem of prior art is present be：Existing context aware technology takes single or multiple independences substantially
Equipment obtains image or video, because single or multiple autonomous devices have tunnel vision, it is impossible to from the image and video of its acquisition
Obtain global space context aware.And conventional art and equipment, acquired image and video are without space and geographical coordinate, it is difficult to
The elaborate position of content acquired in accurate judgement, this multinomial activity to needing accurate geo-location, as fire alarm monitoring, road are supervised
The context awares such as control, emergency medical relief, do not have due effect.
The content of the invention
The problem of existing for prior art, the invention provides a kind of automatic fusion multi-source image to provide the feelings of enhancing
Border sensory perceptual system and method.
The present invention is achieved in that a kind of automatic fusion multi-source image to provide the context aware method of enhancing, described
Automatic fusion multi-source image is comprised the following steps with providing the context aware method of enhancing：
Video camera generation video flowing out of aircraft；
Geocoding is obtained from GPS；
Geocoding is embedded in video flowing, and by the video stream with geocoding to terrestrial operation person；
Using technologies such as image recognitions, picture frame interested is intercepted from video flowing；
Image of interest frame and associated geocoding are stored in screens recording and storing device；
The extraction geocoding associated with image of interest frame；
Extracted geocoding is utilized to position frame interested in large-scale geographic pattern；
Extracted geocoding is utilized, the ground on extracted geocoding periphery is intercepted in large-scale geographic pattern
Manage image.
The geographic pattern on the geocoding periphery of interception is stored in temporary image memory；
The geographic pattern of the frame of capture and the geocoding periphery of interception is moved to ephemeral data storage and will be captured
Frame be oriented on the geographic pattern on intercepted geocoding periphery；
Write-in markup language KML/KMZ files are stored to ephemeral data, make the frame of capture and the geocoding periphery of interception
Geographic pattern can by geographic pattern browser open check.
Further, the automatic fusion multi-source image is also included with providing the context aware method of enhancing：
Generate picture frame interested and associated geocoding；
The geocoding associated from the picture frame extraction interested；
Storage based on the geocoding inquiry conventional images extracted is simultaneously based on the one or more ground of the Query Location
Manage image；
By positioning picture frame interested on the geographic pattern on the geocoding periphery intercepted to create fusion
Image.
Further, the automatic fusion multi-source image is also included with providing the context aware method of enhancing：
From the image creation geographical markup language KML/KMZ files of fusion so that geographic pattern browser is checked；
One or more image primitives, geocoding metadata token is associated with the KML file；
The metadata token and the fused images are compressed into KMZ files；
Allow by geographic pattern browser access KMZ files.
Automatic fusion multi-source image of the present invention is also included with providing the context aware system of enhancing：
For producing the camera of video flowing in real time；
Video playback instrument, for capturing frame interested from the video that is generated, including geocoding with it is interested
The module that frame is mutually associated；
The data memory module of image of interest frame and associated geocoding；
Computer system, operate its by by the geocoding from the image of interest frame with it is described previously caused by
The geocoding of image is compared, and one or more geographic patterns are selected from a wide range of geographic pattern storage；
Computer creates fused images by orienting image of interest frame on selected image.
The camera can be connected with unmanned vehicle, be connected with manned vehicle, being connected with satellite and base
Scout vehicle in land is connected, is connected with unattended ground sensor, being connected with manned ground transaucer and unmanned water
Middle sensor is connected or the camera is connected with manned marine communication means.
Another object of the present invention is to provide it is a kind of using the automatic fusion multi-source image to provide the situation of enhancing
The aircraft of cognitive method.
Another object of the present invention is to provide it is a kind of using the automatic fusion multi-source image to provide the situation of enhancing
The manned marine communication means of cognitive method.
Advantages of the present invention and good effect are：Change existing context aware technology shooting video flowing to have tunnel vision, it is impossible to
The shortcomings that a wide range of geospatial relationship in region captured by embodiment, video flowing frame interested and a wide range of geographic pattern can be melted
The image of conjunction is written in geographical markup language KML/KMZ files, to allow geographic pattern browser to check the image of fusion, from
And the accurate context aware information in geographical position is obtained, be advantageous to the emergent monitoring such as fire, road patrol known a wide range of
Geography is accurately positioned.
It can create with enough details and with the image of the area view expanded, so as to increase context aware；Improve and work as
Preceding image finds that analysis and distribution are applied, so that this application is ageing and convenience is stronger.
The relatively conventional eye recognition efficiency of the present invention improves more than 5 times, and energy is in real time or near real-time acquisition is pinpoint
Context aware image, there is bigger emergent application value.
Brief description of the drawings
Fig. 1 is that automatic fusion multi-source image provided in an embodiment of the present invention is shown with providing the context aware system architecture of enhancing
It is intended to.
Fig. 2 is automatic fusion multi-source image provided in an embodiment of the present invention to provide the context aware method flow of enhancing
Figure.
Fig. 3 is the block diagram of the alternate embodiment of system provided in an embodiment of the present invention.
Fig. 4 is the schematic diagram that frame of video provided in an embodiment of the present invention is aligned with multiple pre-existing images.
Fig. 5 is that the image of Fig. 4 fusions provided in an embodiment of the present invention is checked in the geographic pattern browser such as Google Earth
Schematic diagram.
Fig. 6 is that automatic fusion multi-source image provided in an embodiment of the present invention realizes stream to provide the context aware method of enhancing
Cheng Tu.
Embodiment
In order to make the purpose , technical scheme and advantage of the present invention be clearer, with reference to embodiments, to the present invention
It is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not used to
Limit the present invention.
The application principle of the present invention is explained in detail below in conjunction with the accompanying drawings.
As shown in figure 1, provided in an embodiment of the present invention merge multi-source image to provide the context aware system of enhancing automatically
Including：Context aware system 10 based on unmanned vehicle.
System 10 uses the context aware data processor 20 run on one or more computers；Program 20 can be with
Write with any appropriate computer language, such as C, C++, assembler language, Java, Visual Basic, and other
Or its any combinations.Program 20 passes through ether via video playback instrument 24 and various data storages with video earth station 22
Net or Internet protocol docking.These memories include ephemeral data storage 36, video memory 28, temporary image memory 32
With data storage 34.Program 20 also interacts via video playback instrument 24 with screens recording and storing device 26.These storages
Device can be hard disk drive, or other fixed or movable storage mediums.Content can be by earth station 22 or computer network
Network remotely stores.
Unmanned vehicle 38 can be civilian, military fixed-wing unmanned vehicle and more rotor unmanned aircrafts.This
One common trait of a little unmanned vehicles is that they are assembled with surveillance camera/camera system with direction controlling.
Captured real-time/near real-time video can be sent to earth station 22 via data link 42, and data link 42 can be
The civilian WIFI frequency ranges data link of 2.4G or 5.8G or satellite data links.
System 10 can also be performed easily with reference to other kinds of someone and nobody aircraft.The system may be used also
To be used in combination with the means based on spatial observation, such as satellite.It can also be implemented by continental rise and carrier waterborne.
As shown in Fig. 2 provided in an embodiment of the present invention merge multi-source image to provide the context aware method of enhancing automatically
Comprise the following steps：
S101：Video camera generation video flowing out of aircraft, video flowing includes associated geocoding, by video flowing
Earth station is sent to so that operator examines with associated geocoding；
S102：Frame interested is captured from the video flowing generated；
S103：Image of interest frame and associated geocoding are stored in screens recording and storing device；
S104：The extraction geocoding associated with image of interest frame；
S105：Storage based on the geocoding inquiry conventional images extracted is simultaneously schemed based on Query Location one or more
Picture；
S106：The geographic pattern on the geocoding periphery intercepted is stored in intermediate images storage；
S107：The geographic pattern of the frame of capture and the geocoding periphery of interception is moved to ephemeral data storage and incited somebody to action
The frame of capture is oriented on the geographic pattern on intercepted geocoding periphery；
S108：Write-in markup language KML/KMZ files are stored to ephemeral data, to allow the geography of the frame of capture and interception
The geographic pattern on coding periphery is checked by geographic pattern browser.
Automatic fusion multi-source image provided in an embodiment of the present invention with provide the context aware method of enhancing specifically include with
Lower step：
Video camera generation video flowing out of aircraft；
Geocoding is obtained from GPS；
Geocoding is embedded in video flowing, and by the video stream with geocoding to terrestrial operation person；
Using technologies such as image recognitions, picture frame interested is intercepted from video flowing；
Image of interest frame and associated geocoding are stored in screens recording and storing device；
The extraction geocoding associated with image of interest frame；
Extracted geocoding is utilized to position frame interested in large-scale geographic pattern；
Extracted geocoding is utilized, the ground on extracted geocoding periphery is intercepted in large-scale geographic pattern
Manage image.
The geographic pattern on the geocoding periphery of interception is stored in temporary image memory；
The geographic pattern of the frame of capture and the geocoding periphery of interception is moved to ephemeral data storage and will be captured
Frame be oriented on the geographic pattern on intercepted geocoding periphery；
Write-in markup language KML/KMZ files are stored to ephemeral data, make the frame of capture and the geocoding periphery of interception
Geographic pattern can by geographic pattern browser open check.
The application principle of the present invention is further described below in conjunction with the accompanying drawings.
As shown in figure 1, unmanned vehicle 38 produces sport video stream.Nolo flight at video earth station 22
The video flowing that device operator monitoring is generated by Airborne Camera.Video can be monitored by video playback instrument 24.Playback instrument
24 can be located at earth station 22 locally or in network remote.According between unmanned vehicle 38 and earth station 22 away from
From can near real-time provide video.In the case where some are distant, delay may be up to the 1-2 seconds.Connect in earth station 22
In the case of nearly unmanned vehicle 38, video can near real-time be watched.
In highway line walking task, once finding the target areas such as traffic congestion, traffic accident, user utilizes video playback
Instrument 24 captures specific frame 44 (see Fig. 4) interested, frame interested is captured will be stored for subsequent retrieval and
Processing.In disclosed method, the frame of video 44 of capture is stored in screens recording and storing device 26.Depending on image
Analysis requires, can store frame 44 using various picture formats.Some possible picture formats include lossless TIF forms and
The jpeg format of compression.
In addition to the frame 44 of capture, the metadata associated with the frame 44 of capture also is stored in screens recording and storing
In device 26.The metadata can include such as time and date stamp and geocoding.Geocoding can be four of image
The geographic latitude of each in angle 46, longitude and altitude, and other reference points, the center of such as image (see Fig. 4).Ground
The frame 44 that reason coding should be enough to describe capture is relative to the complete geographical of earth surface.Geocoding can be with image one
Rise and automatically generate, can also be manually entered after image is generated.Form for geocoding can be included with degree, divide and the second is
The form such as the WGS84 coordinate systems of unit or the Xi'an1980 coordinate system of China's standard.
When the frame 44 and its metadata of the detection capture of program 20 are saved to screen recording memory 26.Hereafter, extract
The geocoding associated with the frame 44 captured.Then, program based on the geocoding extracted come query image memory
28.Video memory 28 can be preprepared satellite image, or be obtained in advance from manned or UAV
Take image.Image in memory 28 equally includes associated geocoding.Therefore, program 20 is by the frame 44 from capture
Compared with the geocoding geocoding associated with the image in image storage 28, inquiry returns to any geographical position weight
Folded image, inquire about the row for initially returning and including with the partially or completely candidate image of overlapping any image of the frame 44 of capture
Table.The integrality stored according to the geographic area discussed and image, can return to multiple candidate images.Can establish standard with
Some images are selected from candidate image.In one example, program 20 is superfluous to be removed from candidate image using preassigned
Remaining or insufficient image.Then remaining image or the geographic pattern 48 on the geocoding periphery intercepted are sent to temporarily
Video memory 32.The geographic pattern 48 that program 20 detects intercepted geocoding periphery reaches temporary image memory 32
In.Hereafter, program 20 detects the frame of capture in temporary image memory 32, and by the geography on the geocoding periphery intercepted
Image 48 and the frame 44 of capture are moved in ephemeral data storage 36.
Then, the frame 44 of capture is positioned on the top of the geographic pattern 48 on intercepted geocoding periphery by program 20
To create the image 52 (Fig. 4) of single fusion.Fused images 52 are by the He of rest image 48 for forming underlying basis layer that is positioned
The capture frame 44 for forming top layer forms.Corresponding geocoding is used to make image 44 and 48 be properly oriented to relative to each other.This
It is related in overlay chart picture and is directed at two or more coordinates, or a coordinate is aligned with to the angle reference in north or south.
Can modifying layer as needed transparency with protrusion potential geographical feature interested.Fused images 52 allow larger existing
The frame 44 of analysis capture in the spatial context relation of image 48.This provides the situation awareness of enhancing for operator.Fusion figure
As 52 can store in the jpeg-format with accelerate processing and secondary products create.
The image 52 of fusion can also be checked come real in geographic pattern browser (such as Google earth) by permission
Now additional context aware.Geographic pattern browser including local computer, Intranet and based on internet and based on intelligence
The geographic pattern browser of energy mobile phone.For the ease of using, by the write-in ephemeral data storage of geographical markup language KML/KMZ files
36.KML is a kind of language based on XML, and it is based on the open standard defined by Open Geospatial Consortium.The volume that KML is provided
A part of the code as larger KMZ files, it is allowed to the work(such as display image in geographic pattern browser or geography information browser
Can be (see FIG.4).Other forms in addition to KML and KMZ can also be used.
According to disclosed method, one or more metadata tokens can be associated with KML file.These marks can be by
Such as the annotation or terrestrial reference of unmanned vehicle operator or analyst's generation.The subsequent frame with capture of these metadata tokens
It is compressed to together in KMZ files with the geographic pattern on the geocoding periphery of interception.Hereafter KMZ files are moved to individually
Data storage 34 is so as to by traditional geographic pattern browser access based on internet.
As shown in figure 3, the alternative system 54 is identical with disclosed system 10 in Fig. 1 at most of aspects.But in the reality
Apply in example, video is generated by the satellite 56 based on space rather than unmanned vehicle.In other embodiments, it can be used and be based on
Ground or supervision equipment waterborne, such as monitoring camera is first-class replaces satellite.In the fig. 3 embodiment, screens are recorded
Memory 26 and temporary data memory 36 have been combined into single temporary data memory 58 (see Fig. 1) (see Fig. 3).The number
Network remote is may be mounted in video earth station 22 or is arranged to according to memory 58.In addition, the image storage from system 10
Device 28 and temporary image memory 32 are combined into single image memory 62.
The step of system with reference to disclosed in Fig. 6 performs combines flow chart.In first step 120, capture and feel from video
The frame of interest.Frame 44 can have metadata associated there, or related metadata can be automatically generated by computer
Or operator is manually inserted into.Frame interested and associated metadata are then stored so that program 20 is then retrieved.In step
122, program 20 extracts metadata from the frame 44 of capture, and metadata can take the form of space coordinates.Hereafter, in step 124,
Program 20 is based on the metadata extracted come query image memory 28.Based on the inquiry, geographically related candidate's figure is positioned
The list of picture.Image is selected from candidate image in step 126, selection can be defined by different standards, such as can select to have
There is the image of Maximum overlap amount.Finally, in step 128, the frame captured is oriented on selected image 48 to create most
Whole fused images.
The foregoing is merely illustrative of the preferred embodiments of the present invention, is not intended to limit the invention, all essences in the present invention
All any modification, equivalent and improvement made within refreshing and principle etc., should be included in the scope of the protection.
Claims (7)
1. a kind of merge multi-source image to provide the context aware method of enhancing automatically, it is characterised in that the automatic fusion is more
Source images are comprised the following steps with providing the context aware method of enhancing：
Video camera generation video flowing out of aircraft；
Geocoding is obtained from GPS；
Geocoding is embedded in video flowing, and by the video stream with geocoding to terrestrial operation person；
Using technologies such as image recognitions, picture frame interested is intercepted from video flowing；
Image of interest frame and associated geocoding are stored in screens recording and storing device；
The extraction geocoding associated with image of interest frame；
Extracted geocoding is utilized to position frame interested in large-scale geographic pattern；
Extracted geocoding is utilized, the geographical map on extracted geocoding periphery is intercepted in large-scale geographic pattern
Picture.
The geographic pattern on the geocoding periphery of interception is stored in temporary image memory；
The geographic pattern of the frame of capture and the geocoding periphery of interception is moved to ephemeral data storage and by the frame of capture
It is oriented on the geographic pattern on intercepted geocoding periphery；
Write-in markup language KML/KMZ files are stored to ephemeral data, make the frame of capture and the ground on the geocoding periphery of interception
Reason image can be opened by geographic pattern browser and checked.
2. as claimed in claim 1 merge multi-source image to provide the context aware method of enhancing automatically, it is characterised in that institute
State automatic fusion multi-source image is also included with providing the context aware method of enhancing：
Generate image interested and associated geocoding；
The geocoding being associated from the image zooming-out interested；
Storage based on the geocoding inquiry conventional images extracted is simultaneously based on the Query Location one or more image；
The image merged by orienting creation of image interested on the geographic pattern on the geocoding periphery intercepted.
3. as claimed in claim 1 merge multi-source image to provide the context aware method of enhancing automatically, it is characterised in that institute
State automatic fusion multi-source image is also included with providing the context aware method of enhancing：
From the image creation geographical markup language KML/KMZ files of fusion so that geographic pattern browser is checked；
One or more metadata tokens are associated with the KML file；
The metadata token and the fused images are compressed into KMZ files；
Allow by geographic pattern browser access KMZ files.
4. a kind of fusion multi-source image automatic as claimed in claim 1 is more to provide the automatic fusion of the context aware method of enhancing
Source images are to provide the context aware system of enhancing, it is characterised in that the automatic fusion multi-source image is to provide the feelings of enhancing
Border sensory perceptual system includes：
The camera of video is produced for real-time or near real-time；
Video playback instrument, for capturing frame interested, wherein geocoding and frame phase interested from the video generated
Relating module；
Data memory module comprising the image being previously generated and associated geocoding；
Computer, its operate with by by geocoding from the image of interest frame with it is described previously caused by image
Geocoding is compared to select one or more images from the data storage；
Computer creates fused images by orienting image of interest frame on selected image.
5. as claimed in claim 4 merge multi-source image to provide the context aware system of enhancing automatically, it is characterised in that institute
State camera be connected with unmanned vehicle, be connected with manned vehicle, being connected with satellite, with the scouting based on land
Vehicle is connected, is connected with unattended ground sensor, being connected with manned ground transaucer, being connected with sensor in unmanned water
Connect or the camera is connected with manned marine communication means.
6. a kind of merge multi-source image to provide the context aware side of enhancing using automatic described in claims 1 to 3 any one
The aircraft of method.
7. a kind of merge multi-source image to provide the context aware side of enhancing using automatic described in claims 1 to 3 any one
The manned marine communication means of method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710703866.2A CN107357936A (en) | 2017-08-16 | 2017-08-16 | It is a kind of to merge multi-source image automatically to provide the context aware system and method for enhancing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710703866.2A CN107357936A (en) | 2017-08-16 | 2017-08-16 | It is a kind of to merge multi-source image automatically to provide the context aware system and method for enhancing |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107357936A true CN107357936A (en) | 2017-11-17 |
Family
ID=60287780
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710703866.2A Pending CN107357936A (en) | 2017-08-16 | 2017-08-16 | It is a kind of to merge multi-source image automatically to provide the context aware system and method for enhancing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107357936A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110097406A (en) * | 2019-05-08 | 2019-08-06 | 东南大学 | A kind of medical services resource optimization system based on multiple medicine room coordination technique |
| CN112136309A (en) * | 2018-10-09 | 2020-12-25 | 谷歌有限责任公司 | System and method for performing rewind operations with a mobile image capture device |
| CN114531554A (en) * | 2022-04-24 | 2022-05-24 | 浙江华眼视觉科技有限公司 | Video fusion synthesis method and device for express code recognizer |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110234796A1 (en) * | 2010-03-29 | 2011-09-29 | Raytheon Company | System and Method for Automatically Merging Imagery to Provide Enhanced Situational Awareness |
| CN105324633A (en) * | 2013-01-30 | 2016-02-10 | 英西图公司 | Augmented video system providing enhanced situational awareness |
| CN105847750A (en) * | 2016-04-13 | 2016-08-10 | 中测新图(北京)遥感技术有限责任公司 | Geo-coding based unmanned aerial vehicle video image real time presenting method and apparatus |
-
2017
- 2017-08-16 CN CN201710703866.2A patent/CN107357936A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110234796A1 (en) * | 2010-03-29 | 2011-09-29 | Raytheon Company | System and Method for Automatically Merging Imagery to Provide Enhanced Situational Awareness |
| CN105324633A (en) * | 2013-01-30 | 2016-02-10 | 英西图公司 | Augmented video system providing enhanced situational awareness |
| CN105847750A (en) * | 2016-04-13 | 2016-08-10 | 中测新图(北京)遥感技术有限责任公司 | Geo-coding based unmanned aerial vehicle video image real time presenting method and apparatus |
| CN105847750B (en) * | 2016-04-13 | 2019-01-15 | 中测新图(北京)遥感技术有限责任公司 | The method and device of UAV Video image real-time display based on geocoding |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112136309A (en) * | 2018-10-09 | 2020-12-25 | 谷歌有限责任公司 | System and method for performing rewind operations with a mobile image capture device |
| US11417364B2 (en) | 2018-10-09 | 2022-08-16 | Google Llc | System and method for performing a rewind operation with a mobile image capture device |
| CN112136309B (en) * | 2018-10-09 | 2022-10-11 | 谷歌有限责任公司 | System and method for performing rewind operations with a mobile image capture device |
| US11848031B2 (en) | 2018-10-09 | 2023-12-19 | Google Llc | System and method for performing a rewind operation with a mobile image capture device |
| CN110097406A (en) * | 2019-05-08 | 2019-08-06 | 东南大学 | A kind of medical services resource optimization system based on multiple medicine room coordination technique |
| CN110097406B (en) * | 2019-05-08 | 2022-03-18 | 东南大学 | Medical service resource optimization system based on multi-pharmacy cooperation technology |
| CN114531554A (en) * | 2022-04-24 | 2022-05-24 | 浙江华眼视觉科技有限公司 | Video fusion synthesis method and device for express code recognizer |
| CN114531554B (en) * | 2022-04-24 | 2022-08-16 | 浙江华眼视觉科技有限公司 | Video fusion synthesis method and device of express mail code recognizer |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Xiang et al. | Mini-unmanned aerial vehicle-based remote sensing: Techniques, applications, and prospects | |
| Geraldes et al. | UAV-based situational awareness system using deep learning | |
| Kanade et al. | Advances in cooperative multi-sensor video surveillance | |
| EP2423871B1 (en) | Apparatus and method for generating an overview image of a plurality of images using an accuracy information | |
| US11415986B2 (en) | Geocoding data for an automated vehicle | |
| CN109447048A (en) | A kind of artificial intelligence early warning system | |
| MX2013000158A (en) | Real-time moving platform management system. | |
| US20110234796A1 (en) | System and Method for Automatically Merging Imagery to Provide Enhanced Situational Awareness | |
| US20180262789A1 (en) | System for georeferenced, geo-oriented realtime video streams | |
| US11403822B2 (en) | System and methods for data transmission and rendering of virtual objects for display | |
| US20200035030A1 (en) | Augmented/virtual mapping system | |
| US11668577B1 (en) | Methods and systems for response vehicle deployment | |
| CN110189411A (en) | Emergency management and rescue Search Area method for visualizing after a kind of accident of aircraft | |
| US20170280107A1 (en) | Site sentinel systems and methods | |
| CN107357936A (en) | It is a kind of to merge multi-source image automatically to provide the context aware system and method for enhancing | |
| Renwick et al. | Drone-based reconstruction for 3D geospatial data processing | |
| US11412186B2 (en) | Enhanced video system | |
| CN106027980A (en) | Flight control system for aerial survey of traffic accident | |
| Shukla et al. | DL based system for on-board image classification in real time, applied to disaster mitigation | |
| US20190286876A1 (en) | On-Demand Outdoor Image Based Location Tracking Platform | |
| DE112017007169T5 (en) | METHOD AND DEVICE FOR COLLECTING VISUAL DATA USING AN AUGMENTED REALITY APPLICATION | |
| US11947354B2 (en) | Geocoding data for an automated vehicle | |
| Alamouri et al. | The joint research project ANKOMMEN–Exploration using automated UAV and UGV | |
| KR101948792B1 (en) | Method and apparatus for employing unmanned aerial vehicle based on augmented reality | |
| WO2021149484A1 (en) | Image generation device, image generation method, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |