CN105631922B - The synchronization simulation method of infrared and low-light video based on Vega - Google Patents
The synchronization simulation method of infrared and low-light video based on Vega Download PDFInfo
- Publication number
- CN105631922B CN105631922B CN201510971274.XA CN201510971274A CN105631922B CN 105631922 B CN105631922 B CN 105631922B CN 201510971274 A CN201510971274 A CN 201510971274A CN 105631922 B CN105631922 B CN 105631922B
- Authority
- CN
- China
- Prior art keywords
- video
- infrared
- low
- light
- vega
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000004088 simulation Methods 0.000 title claims abstract description 37
- 238000000034 method Methods 0.000 title claims abstract description 25
- 238000003384 imaging method Methods 0.000 claims abstract description 9
- 238000009877 rendering Methods 0.000 claims abstract description 7
- 230000015572 biosynthetic process Effects 0.000 claims abstract description 4
- 238000005094 computer simulation Methods 0.000 claims description 5
- 238000012545 processing Methods 0.000 claims description 4
- 239000000654 additive Substances 0.000 claims description 3
- 230000000996 additive effect Effects 0.000 claims description 3
- 230000003139 buffering effect Effects 0.000 claims 1
- 230000004927 fusion Effects 0.000 abstract description 14
- 230000003068 static effect Effects 0.000 description 6
- 230000001360 synchronised effect Effects 0.000 description 6
- 238000004891 communication Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 239000000463 material Substances 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000002156 mixing Methods 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/005—General purpose rendering architectures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/28—Indexing scheme for image data processing or generation, in general involving image processing hardware
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Graphics (AREA)
- Image Processing (AREA)
Abstract
The synchronization simulation method of the invention discloses a kind of infrared and low-light video based on Vega, the simulated environment that method is imaged including the use of Vega software rendering infrared target；Utilize the simulated environment of Vega software rendering low-light target imaging；Using the api interface function of Vega, each frame image is rendered, the movement position of real-time update target forms simulation video；It is primary to the simulation video pause of formation, until infrared video and low-light video stop rendering, it is again started up simulation video, forms the infrared video and low-light video of synchronization simulation.The present invention can not only provide infrared target simulation video and low-light target simulator video, infrared and low-light synchronization simulation video image can also be provided, original image is provided to the Image Fusion of low-light and relevant product to be infrared, has saved the cost for obtaining and handling original image.
Description
Technical field
It is especially a kind of infrared synchronous imitative with low-light video based on Vega the invention belongs to technical field of image processing
True method.
Background technique
Infrared image is the image for reflecting target surface temperature distribution, but infrared sensor is unwise to the variation of scene brightness
Sense, so that infrared image contrast is poor, details is unintelligible, edge blurry.Twilight image texture information is abundant, practises with eye-observation
It is used consistent, but the acquisition of twilight image has certain requirement to atmospheric conditions, when inclement condition, the image quality of twilight image
Difference, noise are obvious, target identification difficulty is larger.Spectrum and temporal information are carried out to different images sensor acquired image
It extracts and processes, complementary corresponding informance, reduces redundancy, fusion obtains high quality graphic, is more advantageous to realization to target
Identification and acquisition.
General fusion original image is all to test acquisition on the spot by carrying out a large amount of field, but this method is former in fusion
A large amount of man power and material will be spent in the selection of image and processing, and sometimes due to many reasons, and not all needs
Scene image can obtain.
Summary of the invention
The synchronization simulation method of the purpose of the present invention is to provide a kind of infrared and low-light video based on Vega.
Realize the technical solution of the object of the invention are as follows: a kind of synchronization simulation side of the infrared and low-light video based on Vega
Method, comprising the following steps:
Step 1 utilizes the simulated environment of Vega software rendering infrared target imaging；
Step 2 utilizes the simulated environment of Vega software rendering low-light target imaging；
Step 3, the api interface function using Vega, render each frame image, the movement position of real-time update target, shape
At simulation video；
Step 4 suspends once the simulation video of formation, until infrared video and low-light video stop rendering, opens again
Dynamic simulation video, forms the infrared video and low-light video of synchronization simulation.
Compared with prior art, the present invention its remarkable advantage are as follows: (1) present invention utilizes serial port communication technology, passes through FPGA
Control panel sends data to two computers simultaneously, ensure that two computers receive the synchronism of data, this method and two
Platform computer-directed communications is compared, and faster, synchronization is more accurate for communication speed；(2) the serial ports program of computer is realized in the present invention
Monitoring to serial ports buffer area once receiving data just reads data at once, and the present invention can be when receiving the first of data
Between read data, execute artificial tasks, provide guarantee for the synchronization simulation of computer；(3) FPGA control panel is every in the present invention
The primary valid data for indicating to update picture are sent, after computer receives and identifies effectively, just update a frame picture, including target
The update of movement position, a this data ensure that target in two Computer Simulations to the mode of a frame frame updating
It is synchronous；(4) the infrared target video and low-light target video that each frame all exactly matches are generated in the present invention, output infrared and
Twilight image can directly carry out image co-registration without image registration, reduce acquisition and processing fusion original image manpower,
Material resources and financial resources, improve conventional efficient.
Present invention is further described in detail with reference to the accompanying drawing.
Detailed description of the invention
Fig. 1 is the general frame of the synchronization simulation method of the infrared and low-light video of the invention based on Vega.
Fig. 2 (a) is that synchronization simulation method generates before not eliminating the emulation static loading time difference in the embodiment of the present invention
Infrared image, Fig. 2 (b) are the noiseless low-light figure that synchronization simulation method generates before not eliminating the emulation static loading time difference
Picture.
Fig. 3 (a) is the red of synchronization simulation method generation after eliminating the emulation static loading time difference in the embodiment of the present invention
Outer image, Fig. 3 (b) are the noiseless twilight image that synchronization simulation method generates after eliminating the emulation static loading time difference.
Fig. 4 (a) is the infrared image that synchronization simulation method generates in the embodiment of the present invention, and Fig. 4 (b) is plus 0.5 makes an uproar at random
The twilight image of sound.
The infrared image that Fig. 5 (a) generates for synchronization simulation method in the embodiment of the present invention, Fig. 5 (b) are to add 0.2 to fix to add
The twilight image of property noise.
Fig. 6 (a) is the infrared image that synchronization simulation method generates in the embodiment of the present invention, and Fig. 6 (b) is plus 0.2 fixation multiplies
The twilight image of property noise.
Fig. 7 (a) is asynchronous fusion results schematic diagram in the embodiment of the present invention, and Fig. 7 (b) is synchronous using the method for the present invention
Fusion results schematic diagram.
Specific embodiment
In conjunction with Fig. 1, a kind of synchronization simulation method of infrared and low-light video based on Vega of the invention, including following step
It is rapid:
Step 1 utilizes the simulated environment of Vega software rendering infrared target imaging；
Step 2 utilizes the simulated environment of Vega software rendering low-light target imaging；
Step 3, the api interface function using Vega, render each frame image, the movement position of real-time update target, shape
At simulation video；
Step 4 suspends once the simulation video of formation, until infrared video and low-light video stop rendering, opens again
Dynamic simulation video, forms the infrared video and low-light video of synchronization simulation.
Further, the low-light video selection emulated in step 2 adds different size of random noise, fixed additive noise
With one of fixed multiplicative noise or a variety of.
Further, receive buffer area to data to be monitored, enter buffer area when having monitored data, read number immediately
According to the data received by identification, execution forms simulation video, suspends/continue emulation, output or save and work as previous frame image.
Realize that hardware of the invention is two computers and a FPGA control panel that Vega software is housed, specific works
Principle are as follows:
The first step loads atmospheric transfer model according to the principle of low-light level television and thermal infrared imager using Vega software,
Instrument parameter is set, corresponding low-light target imaging and infrared target image scene, and the analogous diagram of low-light target imaging are rendered
Random noise, fixed additive noise and fixed multiplicative noise as can choose addition different size and range；
Second step realizes the different keys on selection control panel based on FPGA development platform, simultaneously by two serial ports
It exports to two corresponding data of computer, guarantee the serial ports buffer area of two computers while receiving data；
Third step, by the api interface function of Vega, so that the position of target is controllable in render scenes, movement is continuous；
4th step, is monitored serial ports, using message passing mechanism, guarantees once have data to enter serial ports of computers
Data are read at once, and data are identified in buffer area；By identification receive data, execution formed simulation video, temporarily
Stop/continue emulation, output or save to work as previous frame image, it is imitative to computer to realize the data that serial ports is sent on FPGA control panel
Really control；
In use, first opening the serial ports of computer, it is at serial monitoring state, is then pressed on control panel
" beginning " key, control panel send the valid data for indicating to update picture to two computers simultaneously by serial ports；Computer receives
And after identification signal, start to render emulating image, since the performance of computer is different, time not phase needed for starting emulation
Together, therefore when starting starting, Computer Buffer can have the case where data are piled up, after two computers normally start,
" pause " key on control panel is pressed, the starting time difference of two computers is eliminated, then presses " pause " key again, is continued
Emulation, such two computers are it is ensured that fully synchronized, can be by pressing " screenshot " key and in simulation process, will
A current frame image is saved in specified path.
Since the lowest frame speed that human eye can identify is 24 frames/second, under the premise of guaranteeing that video is smooth, it is contemplated that
Vega rendering emulated interface needs the regular hour, and 24 valid data of control panel transmission per second, Vega application program is arranged
24 frame images of rendering per second.
The present invention is further explained in the light of specific embodiments.
Embodiment
There are two framves on emulation Plain from the fighter plane that flies eastwards of west, two tanks moved from east to west, one from west
Eastwards walk soldier scene, do not eliminate emulation the static loading time difference before, the asynchronous Infrared video image of generation and
Shown in low-light video image such as Fig. 2 (a) and Fig. 2 (b), after eliminating the emulation static loading time difference, generation synchronizes infrared view
Frequency image and low-light video image such as Fig. 3 (a) and Fig. 3 (b) are shown, and the acquisition of twilight image has certain want to atmospheric conditions
It asks, in the case where atmospheric conditions are severe, twilight image is of poor quality, and noise is obvious.In order to more really simulate twilight image,
Synchronous Infrared video image and noisy low-light video image can be generated, such as Fig. 4 (a), Fig. 4 (b), Fig. 5 (a), Fig. 5
(b), shown in Fig. 6 (a), Fig. 6 (b)；Using based on Gauss-Laplace changing image blending algorithm to Fig. 2 (a), Fig. 2 (b), figure
3 (a) and Fig. 3 (b) is handled, and comparing result such as Fig. 7 (a) and Fig. 7 (b) are shown.
There are the asynchronous renderings within 10 frames for asynchronous infrared video and low-light video when emulation starts, due to figure
The field of view of picture is the movement with target and changes that movement position variation of the target within the scope of 10 frames is smaller, therefore
The background of image hardly happens variation.By Fig. 7 (a) it is found that there are serious in the fusion results figure of non-synchronous video image
The fusion results of inconsistent phenomenon, especially target, aircraft, soldier and tank have apparent ghost image, do not see target surface
Feature；But in fusion results Fig. 7 (b) of synchronization video image, dislocation-free phenomenon, the fusion results of target are exact matchings,
There is no edge blurrys and ghost image, and corresponding position reflects all features of infrared original image and low-light original image, for example, flying
There is a pattern in the side of machine cockpit, which is invisible in low-light original image as it can be seen that in infrared original image, but
It in fusion results figure, is visible, and the temperature both reflected in its infrared original image that each section of aircraft is all lucky
Distribution field also reflects the grain effect in its low-light original image.It can be seen that the synchronization simulation infrared video and low-light that generate
Video is that each frame all exactly matches, the infrared image and twilight image arbitrarily exported can without registration process directly into
Row fusion can provide video source images for infrared Image Fusion and Related product with low-light.
Claims (2)
1. a kind of synchronization simulation method of the infrared and low-light video based on Vega, which comprises the following steps:
Step 1 utilizes the simulated environment of Vega software rendering infrared target imaging；
Step 2 utilizes the simulated environment of Vega software rendering low-light target imaging；
Step 3 exports the serial ports buffering for guaranteeing two computers to two corresponding data of computer by two serial ports simultaneously
Area receives data simultaneously；Using the api interface function of Vega, each frame image is rendered, the movement position of real-time update target,
Form simulation video；
Step 4 carries out pause processing to the simulation video of formation, until infrared video and low-light video stop rendering, opens again
Dynamic simulation video, forms the infrared video and low-light video of synchronization simulation；
Receive buffer area to data to be monitored, enter buffer area when having monitored data, read data immediately, is connect by identification
The data received, execution form simulation video, suspend/continue emulation, output or save and work as previous frame image, realize FPGA control panel
Control of the data that upper serial ports is sent to Computer Simulation.
2. the synchronization simulation method of the infrared and low-light video according to claim 1 based on Vega, which is characterized in that step
The low-light video selection emulated in rapid 2 is added in different size of random noise, fixed additive noise and fixed multiplicative noise
It is one or more.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510971274.XA CN105631922B (en) | 2015-12-21 | 2015-12-21 | The synchronization simulation method of infrared and low-light video based on Vega |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510971274.XA CN105631922B (en) | 2015-12-21 | 2015-12-21 | The synchronization simulation method of infrared and low-light video based on Vega |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105631922A CN105631922A (en) | 2016-06-01 |
| CN105631922B true CN105631922B (en) | 2019-05-07 |
Family
ID=56046806
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510971274.XA Expired - Fee Related CN105631922B (en) | 2015-12-21 | 2015-12-21 | The synchronization simulation method of infrared and low-light video based on Vega |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105631922B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106686281B (en) * | 2016-06-28 | 2020-04-07 | 南京理工大学 | Fuse circuit board noise suppression ability test system |
| CN108122220B (en) * | 2017-12-11 | 2021-11-30 | 深圳先进技术研究院 | Infrared image and low-light image fusion system and method |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101907772A (en) * | 2010-07-12 | 2010-12-08 | 南京理工大学 | Infrared and glimmer multispectral fusion front end optical-mechanic structure |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3129954A4 (en) * | 2014-04-07 | 2017-10-18 | BAE SYSTEMS Information and Electronic Systems Integration Inc. | Contrast based image fusion |
-
2015
- 2015-12-21 CN CN201510971274.XA patent/CN105631922B/en not_active Expired - Fee Related
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101907772A (en) * | 2010-07-12 | 2010-12-08 | 南京理工大学 | Infrared and glimmer multispectral fusion front end optical-mechanic structure |
Non-Patent Citations (1)
| Title |
|---|
| 红外运动目标视景仿真及检测跟踪技术研究;夏琪;《万方学位论文数据库》;20151203;正文第1-2,8-9,15-16,19-24,29,71,79页 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105631922A (en) | 2016-06-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11270419B2 (en) | Augmented reality scenario generation method, apparatus, system, and device | |
| CN110163943B (en) | Image rendering method and device, storage medium and electronic device | |
| WO2018103244A1 (en) | Live streaming video processing method, device, and electronic apparatus | |
| CN107566739B (en) | photographing method and mobile terminal | |
| CN107566747A (en) | A kind of brightness of image Enhancement Method and device | |
| CN108292489A (en) | Information processing unit and image generating method | |
| CN110852942B (en) | Model training method, and media information synthesis method and device | |
| CN110610546B (en) | Video picture display method, device, terminal and storage medium | |
| CN113099298A (en) | Method and device for changing virtual image and terminal equipment | |
| US11475652B2 (en) | Automatic representation toggling based on depth camera field of view | |
| CN112199016A (en) | Image processing method, image processing device, electronic equipment and computer readable storage medium | |
| CN111311757A (en) | Scene synthesis method and device, storage medium and mobile terminal | |
| CN105631922B (en) | The synchronization simulation method of infrared and low-light video based on Vega | |
| CN107172415B (en) | A kind of VR holography integrated synchronous interactive exhibition system and its control method | |
| US11200653B2 (en) | Local histogram matching with global regularization and motion exclusion for multi-exposure image fusion | |
| CN109885172B (en) | Object interaction display method and system based on Augmented Reality (AR) | |
| CN111242838A (en) | Blurred image rendering method and device, storage medium and electronic device | |
| US20230131418A1 (en) | Two-dimensional (2d) feature database generation | |
| CN113489920B (en) | Video synthesis method and device and electronic equipment | |
| US11983915B2 (en) | Content generation system and method | |
| KR102617789B1 (en) | Picture processing methods and devices, storage media and electronic devices | |
| JP7319215B2 (en) | Information systems, terminals and programs | |
| CN111343472B (en) | Image processing effect adjusting method, device, equipment and medium | |
| CN113192165A (en) | Control information generation method and device based on personalized expression base, electronic equipment and readable storage medium | |
| JP2020126393A (en) | Image processing apparatus, image processing method, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20190507 Termination date: 20201221 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |