CN105631922A - Vega-based infrared and low-light-level video synchronization simulation method - Google Patents
Vega-based infrared and low-light-level video synchronization simulation method Download PDFInfo
- Publication number
- CN105631922A CN105631922A CN201510971274.XA CN201510971274A CN105631922A CN 105631922 A CN105631922 A CN 105631922A CN 201510971274 A CN201510971274 A CN 201510971274A CN 105631922 A CN105631922 A CN 105631922A
- Authority
- CN
- China
- Prior art keywords
- video
- low
- infrared
- light
- simulation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/005—General purpose rendering architectures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration by the use of more than one image, e.g. averaging, subtraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/28—Indexing scheme for image data processing or generation, in general involving image processing hardware
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Graphics (AREA)
- Image Processing (AREA)
Abstract
The invention discloses a Vega-based infrared and low-light-level video synchronization simulation method. The method comprises steps: Vega software is used for rendering a simulation environment for infrared target imaging; the Vega software is used for rendering a simulation environment for low-light-level target imaging; an API interface function of the Vega is used for rendering each frame of image, the motion position of the target is updated in real time, and a simulation video is formed; and the formed simulation video is paused for one time until the infrared video and the low-light-level video stop rendering, the simulation video is started again, and the infrared video and the low-light-level video which are simulated synchronously are formed. The infrared target simulation video and the low-light-level target simulation video can be provided, the infrared and low-light-level synchronization simulation video image can also be provided, an original image is provided for an infrared and low-light-level image fusion algorithm and a related product, and the cost of acquiring and processing the original image is saved.
Description
Technical field
The invention belongs to technical field of image processing, particularly a kind of synchronization simulation method based on the infrared of Vega with low-light video.
Background technology
Infrared image is the image of reflection target surface temperature distribution, but infrared sensor is insensitive to the change of scene brightness so that infrared image contrast is poor, details is unintelligible, edge blurry. Twilight image texture information is abundant consistent with eye-observation custom, but atmospheric condition are had certain requirement by the acquisition of twilight image, and when inclement condition, the image quality of twilight image is poor, noise obvious, target recognition difficulty is bigger. To different images sensor acquisition to image carry out extraction and the process of spectrum and temporal information, complementary corresponding informance, reduce redundancy, merge and obtain high quality graphic, be more beneficial for realizing the identification to target and acquisition.
The general original image that merges all tests acquisition on the spot by carrying out substantial amounts of field, but this method will spend substantial amounts of man power and material on the choosing and process of original image merging, and sometimes due to many reasons, and the scene image that not all needs can obtain.
Summary of the invention
It is an object of the invention to provide a kind of synchronization simulation method based on the infrared of Vega with low-light video.
The technical scheme realizing the object of the invention is: a kind of synchronization simulation method based on the infrared of Vega with low-light video, comprises the following steps:
Step 1, Vega software is utilized to render the simulated environment of infrared target imaging;
Step 2, Vega software is utilized to render the simulated environment of low-light target imaging;
Step 3, utilize the api interface function of Vega, render each two field picture, the movement position of real-time update target, form simulation video;
Step 4, the simulation video formed is suspended once, until infrared video and low-light video stop rendering, be again started up simulation video, form infrared video and the low-light video of synchronization simulation.
The present invention is compared with prior art, its remarkable advantage is: (1) present invention utilizes serial port communication technology, two computers are sent data by FPGA panel simultaneously, ensure that two computers accept the synchronicity of data, this method is compared with two computer-directed communications, communication speed faster, synchronizes more accurate; (2) the serial ports program of Computer of the present invention achieves the monitoring to serial ports relief area, once receive data, just reading data at once, the present invention can read data in the very first time receiving data, performing artificial tasks, the synchronization simulation for computer provides guarantee; (3) in the present invention, FPGA panel often sends the valid data once representing renewal picture, computer receives and identifies after effectively, just update a frame picture, renewal including target travel position, this secondary data mode to a frame frame updating, it is ensured that the synchronization of target in two Computer Simulations; (4) present invention generates infrared target video and low-light target video that each frame all mates completely, infrared and the twilight image of output can be made directly image co-registration without image registration, decrease and obtain and process the human and material resources and financial resources merging original image, improve conventional efficient.
Below in conjunction with accompanying drawing, the present invention is described in further detail.
Accompanying drawing explanation
Fig. 1 is the general frame based on the infrared of Vega with the synchronization simulation method of low-light video of the present invention.
Fig. 2 (a) for the embodiment of the present invention does not eliminate emulation static loading time difference before synchronization simulation method generate infrared image, Fig. 2 (b) be do not eliminate emulation static loading time difference before synchronization simulation method generation noiseless twilight image.
The infrared image that Fig. 3 (a) generates for synchronization simulation method after eliminating emulation static loading time difference in the embodiment of the present invention, Fig. 3 (b) is the noiseless twilight image that after elimination emulates static loading time difference, synchronization simulation method generates.
The infrared image that Fig. 4 (a) generates for synchronization simulation method in the embodiment of the present invention, Fig. 4 (b) is the twilight image adding 0.5 random noise.
The infrared image that Fig. 5 (a) generates for synchronization simulation method in the embodiment of the present invention, Fig. 5 (b) is the twilight image adding 0.2 and fixing additive noise.
Fig. 6 (a) is the infrared image that in the embodiment of the present invention, synchronization simulation method generates, what Fig. 6 (b) was the fixing multiplicative noise that adds 0.2 twilight image.
Fig. 7 (a) is fusion results schematic diagram asynchronous in the embodiment of the present invention, and Fig. 7 (b) is for adopting the inventive method synchronous fusion result schematic diagram.
Detailed description of the invention
In conjunction with Fig. 1, a kind of synchronization simulation method based on the infrared of Vega with low-light video of the present invention, comprise the following steps:
Step 1, Vega software is utilized to render the simulated environment of infrared target imaging;
Step 2, Vega software is utilized to render the simulated environment of low-light target imaging;
Step 3, utilize the api interface function of Vega, render each two field picture, the movement position of real-time update target, form simulation video;
Step 4, the simulation video formed is suspended once, until infrared video and low-light video stop rendering, be again started up simulation video, form infrared video and the low-light video of synchronization simulation.
Further, in step 2, the low-light video of emulation selects one or more in the different size of random noise of interpolation, fixing additive noise and fixing multiplicative noise.
Further, data being accepted relief area and is monitored, enter relief area when having monitored data, read data immediately, by identifying the data of acceptance, execution forms simulation video, previous frame image is worked as in time-out/continuation emulation, output or preservation.
The hardware realizing the present invention is two computers equipped with Vega software and a FPGA panel, and its specific works principle is:
The first step, utilize Vega software, principle according to low-light level television and thermal infrared imager, load atmospheric transfer model, instrument parameter is set, render corresponding low-light target imaging and infrared target image scene, and the emulating image of low-light target imaging can select to add the random noise of different size and scope, fixing additive noise and fixing multiplicative noise;
Second step, is realized selecting the different button on panel based on FPGA development platform, is exported to two corresponding data of computer by two serial ports, it is ensured that the serial ports relief area of two computers receives data simultaneously simultaneously;
3rd step, by the api interface function of Vega so that in render scenes, the position of target is controlled, motion is continuously;
4th step, is monitored serial ports, adopts message passing mechanism, it is ensured that once there be data to enter the relief area of serial ports of computers, reading data at once, and data are identified; By identifying the data of acceptance, execution forms simulation video, previous frame image is worked as in time-out/continuation emulation, output or preservation, it is achieved that the data of the serial ports transmission control to Computer Simulation on FPGA panel;
During use, first being opened by the serial ports of computer so that it is be in serial monitoring state, then press " beginning " key on panel, panel is sent to two computers by serial ports simultaneously and represents the valid data updating picture, after computer receives and identifies signal, start to render emulating image, owing to the performance of computer is different, the time starting emulation required differs, therefore when starting to start, can there is the situation that data are piled up in Computer Buffer, after two computers normally start, press " time-out " key on panel, the startup time difference of two computers is eliminated, and then press " time-out " key, continue emulation, such two computers are it is ensured that Complete Synchronization, and in simulation process, can pass through to press " sectional drawing " key, a current two field picture is saved in specified path.
The lowest frame speed that can recognise that due to human eye is 24 frames/second, under ensureing the premise that video is smooth continuously, considering that Vega renders emulated interface and needs the regular hour, arrange panel 24 these valid data of transmission per second, Vega application program is per second renders 24 two field pictures.
Below in conjunction with specific embodiment, the invention will be further described.
Embodiment
Emulation Plain has the fighter plane that two framves fly eastwards from west, two tanks moved from east to west, the scene of one soldier walked eastwards from west, before not eliminating emulation static loading time difference, shown in the asynchronous Infrared video image generated and low-light video image such as Fig. 2 (a) and Fig. 2 (b), after eliminating emulation static loading time difference, shown in the synchronization Infrared video image generated and low-light video image such as Fig. 3 (a) and Fig. 3 (b), atmospheric condition are had certain requirement by the acquisition of twilight image, when atmospheric condition are severe, twilight image is of poor quality, noise is obvious. in order to simulate twilight image more really, it is possible to generate the Infrared video image and noisy low-light video image that synchronize, as shown in Fig. 4, Fig. 5, Fig. 6, utilize and based on Gauss-Laplace changing image blending algorithm, Fig. 2 and Fig. 3 is processed, shown in comparing result such as Fig. 7 (a) and Fig. 7 (b).
What asynchronous infrared video and low-light video when emulation starts existed within 10 frames asynchronous renders, change owing to the field of view of image is as the motion of target, target movement position change within the scope of 10 frames is less, and therefore the background of image changes hardly. by Fig. 7 (a) it can be seen that in the fusion results figure of non-synchronous video image, there is serious inconsistent phenomenon, the especially fusion results of target, aircraft, soldier and tank have obvious ghost image, do not see the feature of target surface, but in fusion results Fig. 7 (b) of synchronization video image, dislocation-free phenomenon, the fusion results of target is mated completely, it is absent from edge blurry and ghost image, and correspondence position reflects all features of infrared original image and low-light original image, such as, there is a pattern side of aircraft cockpit, this pattern is visible in low-light original image, infrared original image is invisible, but in fusion results figure, it is visible, and the Temperature Distribution field both reflected in its infrared original image that every part of aircraft is all lucky, also reflects the grain effect in its low-light original image. as can be seen here, the synchronization simulation infrared video and the low-light video that produce are that each frame all mates completely, the infrared image and the twilight image that arbitrarily export can be made directly fusion without registration process, it is possible to provide video source image for the infrared Image Fusion with low-light and Related product.
Claims (3)
1. the synchronization simulation method based on the infrared of Vega with low-light video, it is characterised in that comprise the following steps:
Step 1, Vega software is utilized to render the simulated environment of infrared target imaging;
Step 2, Vega software is utilized to render the simulated environment of low-light target imaging;
Step 3, utilize the api interface function of Vega, render each two field picture, the movement position of real-time update target, form simulation video;
Step 4, the simulation video formed is carried out time-out process, until infrared video and low-light video stop rendering, be again started up simulation video, form infrared video and the low-light video of synchronization simulation.
2. the synchronization simulation method based on the infrared of Vega with low-light video according to claim 1, it is characterized in that, in step 2, the low-light video of emulation selects one or more in the different size of random noise of interpolation, fixing additive noise and fixing multiplicative noise.
3. the technical method based on the infrared of Vega with the synchronization simulation of low-light video according to claim 1, it is characterized in that, data are accepted relief area be monitored, relief area is entered when having monitored data, read data immediately, by identifying the data of acceptance, execution forms simulation video, previous frame image is worked as in time-out/continuation emulation, output or preservation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510971274.XA CN105631922B (en) | 2015-12-21 | 2015-12-21 | The synchronization simulation method of infrared and low-light video based on Vega |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510971274.XA CN105631922B (en) | 2015-12-21 | 2015-12-21 | The synchronization simulation method of infrared and low-light video based on Vega |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105631922A true CN105631922A (en) | 2016-06-01 |
| CN105631922B CN105631922B (en) | 2019-05-07 |
Family
ID=56046806
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510971274.XA Expired - Fee Related CN105631922B (en) | 2015-12-21 | 2015-12-21 | The synchronization simulation method of infrared and low-light video based on Vega |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105631922B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106686281A (en) * | 2016-06-28 | 2017-05-17 | 南京理工大学 | Fusion circuit board noise suppression performance testing system |
| CN108122220A (en) * | 2017-12-11 | 2018-06-05 | 深圳先进技术研究院 | Infrared image and LLL image fusion system and method |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101907772A (en) * | 2010-07-12 | 2010-12-08 | 南京理工大学 | Infrared and glimmer multispectral fusion front end optical-mechanic structure |
| WO2015157058A1 (en) * | 2014-04-07 | 2015-10-15 | Bae Systems Information & Electronic Systems Integration Inc. | Contrast based image fusion |
-
2015
- 2015-12-21 CN CN201510971274.XA patent/CN105631922B/en not_active Expired - Fee Related
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101907772A (en) * | 2010-07-12 | 2010-12-08 | 南京理工大学 | Infrared and glimmer multispectral fusion front end optical-mechanic structure |
| WO2015157058A1 (en) * | 2014-04-07 | 2015-10-15 | Bae Systems Information & Electronic Systems Integration Inc. | Contrast based image fusion |
Non-Patent Citations (1)
| Title |
|---|
| 夏琪: "红外运动目标视景仿真及检测跟踪技术研究", 《万方学位论文数据库》 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106686281A (en) * | 2016-06-28 | 2017-05-17 | 南京理工大学 | Fusion circuit board noise suppression performance testing system |
| CN106686281B (en) * | 2016-06-28 | 2020-04-07 | 南京理工大学 | Fuse circuit board noise suppression ability test system |
| CN108122220A (en) * | 2017-12-11 | 2018-06-05 | 深圳先进技术研究院 | Infrared image and LLL image fusion system and method |
| CN108122220B (en) * | 2017-12-11 | 2021-11-30 | 深圳先进技术研究院 | Infrared image and low-light image fusion system and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105631922B (en) | 2019-05-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11210838B2 (en) | Fusing, texturing, and rendering views of dynamic three-dimensional models | |
| US20220004765A1 (en) | Image processing method and apparatus, and storage medium | |
| EP3760287B1 (en) | Method and device for generating video frames | |
| WO2018103244A1 (en) | Live streaming video processing method, device, and electronic apparatus | |
| US20210152751A1 (en) | Model training method, media information synthesis method, and related apparatuses | |
| CN111783647A (en) | Training method of face fusion model, face fusion method, device and equipment | |
| WO2021098338A1 (en) | Model training method, media information synthesizing method, and related apparatus | |
| CN109510975B (en) | Video image extraction method, device and system | |
| CN111832745A (en) | Data augmentation method and device and electronic equipment | |
| CN111768356A (en) | Face image fusion method and device, electronic equipment and storage medium | |
| CN107172415B (en) | A kind of VR holography integrated synchronous interactive exhibition system and its control method | |
| CN111467803B (en) | Display control method and device in game, storage medium and electronic equipment | |
| US11776201B2 (en) | Video lighting using depth and virtual lights | |
| WO2022148248A1 (en) | Image processing model training method, image processing method and apparatus, electronic device, and computer program product | |
| CN105631922A (en) | Vega-based infrared and low-light-level video synchronization simulation method | |
| WO2023244320A1 (en) | Generating parallax effect based on viewer position | |
| US20230245396A1 (en) | System and method for three-dimensional scene reconstruction and understanding in extended reality (xr) applications | |
| US20230131418A1 (en) | Two-dimensional (2d) feature database generation | |
| CN116530078A (en) | 3D video conferencing system and method for displaying stereo-rendered image data acquired from multiple perspectives | |
| JP7319215B2 (en) | Information systems, terminals and programs | |
| CN116664603B (en) | Image processing method, device, electronic equipment and storage medium | |
| US20220076047A1 (en) | Content generation system and method | |
| CN117764890A (en) | Image processing method and device and electronic equipment | |
| TW202418043A (en) | Image processing method and virtual reality display system | |
| CN115719392A (en) | Virtual character generation method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20190507 Termination date: 20201221 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |