CN101860657B - Real-time image acquisition method and system of large-view field visible infrared dual-channel camera - Google Patents
Real-time image acquisition method and system of large-view field visible infrared dual-channel camera Download PDFInfo
- Publication number
- CN101860657B CN101860657B CN2010101775108A CN201010177510A CN101860657B CN 101860657 B CN101860657 B CN 101860657B CN 2010101775108 A CN2010101775108 A CN 2010101775108A CN 201010177510 A CN201010177510 A CN 201010177510A CN 101860657 B CN101860657 B CN 101860657B
- Authority
- CN
- China
- Prior art keywords
- data
- image acquisition
- channel
- dual
- software
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Abstract
The invention discloses an asynchronous variable transmission code rate image acquisition method and a system thereof of a large-view field TDI-CCD (Time Delayed Integration-Charge Coupled Device) infrared dual-channel camera. In the dual-channel image acquisition method, the variable code rate data of double channels is synchronized by adopting a mode of software and hardware pipelining, and a double-thread and double-buffering mode in software is combined, thereby effective data can be guaranteed to be not lost. The dual-channel image acquisition system comprises infrared detectors, a TDI-CCD, an experimental optical system, a platform, a detector driving plate, an image acquisition plate, a PCI7300A acquisition card and upper computer image acquisition software and solves the problems of asynchronous data in the large-view field camera and high-speed real-time synchronous acquisition and display of two detectors with different code rates from two aspects of hardware and software, wherein the used hardware and software platform can be directly applied to similar dual-channel image data acquisition tasks and also expanded to multi-channel variable code data acquisition tasks.
Description
Technical field
The present invention relates to the photoelectric instrument technology, specifically refer to a kind of large-view field visible and infrared dual-channel camera image-pickup method and system thereof, it directly applies in the similar dual-channel camera imaging task.
Background technology
The imaging mechanism of range detector has nothing in common with each other; For example Infrared Detectors is to utilize the target infrared radianting capacity that the temperature difference of target and background is embodied in the infrared image with different gray scales, and visible-light detector is to utilize target the volume reflection of visible light to be decided the gray value of image.The TDI-CCD that is applied among the present invention utilizes the principle of the incoherent addition of noise signal, useful signal linear, additive, can obtain visible images in the occasion of low-light.The big visual field camera that comprises the multichannel detector can be in more wide room and time range detection to target, and application prospect very extensively.Therefore, under the different prerequisite of data upload parameter in the synchronous acquisition camera image of multichannel detector be to solve this type key of problem technology.
At present, the image acquisition process of single detector generally is divided into following a few step: current signal converts voltage signal to through the reading circuit in the detector; Through amplifying circuit magnitude of voltage is amplified to suitable scope, converts digital signal to through A/D converter; Convert the digital signal of serial into word or byte that parallel being suitable for uploaded and stored, be uploaded to host computer through the collection of specific collecting device (PCI/USB etc.); Upper computer software receives and image data processing.When using collection in real time of two passages or multiplexed detection device and transmission in the same camera; Two steps in front are constant basically; Because the requirement of big visual field; Optical system adopts the design of light path altogether, and two channel detectors are in order to reach real-time collection, needs in the back synchronous two channel image data in two steps.
The asynchronous of two types of detector datas shows among the present invention:
(1) residence time is different: the residence time of Infrared Detectors is longer than TDI-CCD.Electric charge must equal residence time the transfer time from the N level to the N+1 level among the TDI-CCD, and by task and device decision itself, can not arbitrarily change.
(2) the line data rate is different: what Infrared Detectors adopted is 2048 yuan of long line array devices, and what TDI-CCD adopted is 4096 yuan of visible-light detectors.Both unified 200BYTE wardrobe that add, the line data amount is different.
(3) the data read frequency is different: Infrared Detectors serial data read frequency is lower than TDI-CCD, determined by system itself, and infrared, visible data reads changeable frequency, can regulate as requested.
According to the transmission means of routine, the difference that above-mentioned three indexs exist unavoidably can cause the situation of loss of effective data.The difference that solves above-mentioned three aspects is a key technology of the present invention to the problem that real-time collection two channel detector images bring.
Summary of the invention:
The object of the present invention is to provide the data upload of synchronous dissimilar detectors in the multichannel camera of a kind of big visual field and the method for reception; And, the high-speed real-time synchronous acquisition of two types of detectors that data are asynchronous in the camera of big visual field, code check is different and the problem of demonstration have been solved from the software and hardware of unitary construction two waveband IMAQ and the system that deposits.
The technical scheme of binary channels image capturing system of the present invention is: the analog signal of Infrared Detectors and the output of TDI-CCD detector becomes independently serial digital signal of two passages afterwards through the A/D conversion and the formatting of detector drive plate, is exported by the LVDS difference; After the LVDS of image acquisition board received, it was the unit view data that the FPGA in the image acquisition board converts two channel datas with the byte into, adopted synchronous two channel datas of pipeline system; The PCI7300A capture card is installed in the host computer, and two channel datas after synchronously are uploaded to host computer by the PCI connector of image acquisition board, and upper computer software is responsible for receiving in real time and handling two channel image data.Wherein, two channel detector synchronization of data are accomplished in the common coordination of image acquisition board and upper computer software.
The simultaneous techniques scheme step of image acquisition board is divided among the present invention:
3 groups of differential signals of two channel detectors of the LVDS of S1.1, image acquisition board pick-up probe drive plate output simultaneously comprise clock signal, enable signal and serial digital signal, among the FPGA of input picture collection plate.
After S1.2, FPGA receive the single-ended TTL signal after the conversion, be the form of byte with two channel serial data transaction respectively.
S1.3, two passages detect wardrobe respectively, when wardrobe arrive, parallel data are imported the asynchronous FIFO buffer stores of opening up separately among the FPGA.
The threshold value that S1.4, two passages are uploaded is made as corresponding each row of data amount (threshold value uploaded of visible channel is made as the 4096+200 byte, and infrared channel is made as the 2048+200 byte) respectively, and the actual amount that two passages are uploaded is the data volume of big threshold value wherein.When the data of any buffering area reached separately preset threshold, the passage that data do not reach kept valid data, uploads with invalid data.When reaching self threshold value earlier, also need add invalid data behind the valid data of infrared channel and just can gather together enough to the amount of uploading for infrared channel.The purpose of such pipeline organization is to make two channel datas scrabble up the double word form, and the PCI capture card that is beneficial to 32 is uploaded simultaneously.
S1.5, parallel 32 bit data adopt external trigger mode to be uploaded to host computer by FPGA given triggering signal PCI_TRG and clock PCI_REQ through the PCI7300A capture card.
The simultaneous techniques scheme step of upper computer software is divided among the present invention:
S2.1, turn-on data are gathered main thread.The hardware and software state of initialization PCI-7300A card, for capture card distributes and initialization associated internal memory zone, triggering mode and drainage pattern that specified data is gathered, and distribute temporary data multiple buffer.
S2.2, when arbitrary buffering area of PCI capture card reaches full up state, get into data processing from thread.Judge that according to wardrobe whether two channel datas are valid data, extract the data of effective passage.
S2.3, storage valid data.When the infrared channel data are effective, also need carry out the background subtraction operation during storage.
S2.4, when stored valid data reaches a frame, view data is shown and storage with the form of bitmap.
S2.5, program come back to the data acquisition main thread, up to artificial end.
The technical characterictic that the method for synchronous of binary channels collection of the present invention has is:
(1) adopts pipeline work, guarantee that two channel datas under the unmatched situation of data transfer rate, can both be stored to buffering area, form the complete image of a frame.
(2) adopt the Windows multithread mode, satisfy system high-speed real-time collection and treatment requirement.Introduce the multitasking technique (multitasking) of Windows, the flow process of software is opened up be data acquisition main thread and data processing two-wire journey pattern from thread.
(3) adopt the double buffering pattern, cooperate the processing mode of multithreading to accomplish data " table tennis " operation, rationally utilize system resource.
Description of drawings:
Fig. 1 is a system configuration sketch map of the present invention.
Fig. 2 is a detector drive plate functional schematic of the present invention.
Fig. 3 is an image acquisition board functional schematic of the present invention.
Fig. 4 is an image capture software general flow chart of the present invention.
Fig. 5 A is image capture software data acquisition main thread flow process figure of the present invention.
Fig. 5 B is that image capture software data processing of the present invention is from the thread flow chart.
Fig. 6 is an image capture software of the present invention interface sectional drawing.
Embodiment:
Step below in conjunction with accompanying drawing and practical implementation is further described the present invention:
In conjunction with Fig. 1, Infrared Detectors, TDI-CCD and optical system are built on the experiment turntable, and Infrared Detectors and TDI-CCD are positioned at the optical system rear end.The reading circuit of two detectors is received respectively on two identical detector drive plates by shielding conductor.The LVDS of two drive plates draws totally 6 groups of digital differential signals, the LVDS receiving terminal of input picture collection plate.Built-in PCI7300A capture card is connected in the PCI connector of image acquisition board and the host computer.
In conjunction with Fig. 2, A/D converter needs to regulate in the detector drive plate, and the dynamic range of amplifier suitably regulates according to the gain of detector.
In conjunction with Fig. 3, FPGA selects the SPARTAN 3A series of XINLINX company for use in the image acquisition board.Before IMAQ, with the USB download line of XINLINX company program is downloaded and is cured among the external PROM, after powering on, image acquisition board gets final product work.
In conjunction with Fig. 6, upper computer software has been write the system parameter setting dialog box, and the number of scanning lines of a two field picture, the parameters such as pattern, image rectification mode, the attribute that shows storage and experiment condition of PCI capture card need be set before gathering.Gather and stop key and be responsible for opening and stopping acquisition tasks respectively.The background button is responsible for opening the acquisition tasks that infrared image deducts data in the dark background operation.When experimental situation temperature and radiation illumination variation are bigger, need to gather earlier current dark background, guarantee that dark background is less to the influence of infrared image.After passage collects image arbitrarily, all be presented in the corresponding interface, and real-time storage.
Through above step, set up complete, a real-time dual-channel camera image capturing system.
Claims (4)
1. visible and infrared dual-channel camera IMAQ method for synchronous, its characteristic may further comprise the steps:
1) in the FPGA of image acquisition board, opens up the redundant asynchronous FIFO of two corresponding data amounts; Serial data is converted into the form of word; When detecting wardrobe, store among the storing one row data input FIFO; Through judging whether two data among the FIFO reach threshold value separately, when any one the tunnel arrives, the invalid data polishing is used on another road, trigger the PCI capture card and upload data to host computer;
2) after installation PCI capture card drives in host computer; Buffering area is provided with; In the Installed System Memory of host computer, open up double buffering, receive the view data that the PCI capture card is uploaded, the ping-pong operation through two buffer datas realizes that the real-time nothing of data loses;
3) the image acquisition and processing The software adopted two-wire journey pattern in the host computer; Turn-on data is gathered main thread; The hardware and software state of initialization PCI-7300A card; For capture card distributes and initialization associated internal memory zone, triggering mode and drainage pattern that specified data is gathered, and distribute temporary data multiple buffer; When arbitrary buffering area of PCI capture card reaches full up state, get into data processing from thread, judge that according to wardrobe whether two channel datas are valid data, extract the data of effective passage.
2. visible and Infrared Detectors dual-channel camera IMAQ method for synchronous according to claim 1; It is characterized in that: the working method that adopts streamline when the FPGA of the image acquisition board described in the step 1) stores two paths of data; Two channel datas exist two-way valid data while and situation about arriving respectively, and this working method can guarantee not lose the valid data of any passage.
3. visible and Infrared Detectors dual-channel camera IMAQ method for synchronous according to claim 1; It is characterized in that: step 2) described in host computer in open up double buffering for the PCI capture card; " table tennis " that the double buffering of in PCI capture card initialization procedure, opening up can be accomplished data alternately receives and handles, and guarantees the real-time of system.
4. visible and Infrared Detectors dual-channel camera IMAQ method for synchronous according to claim 1; It is characterized in that: the mode of the host computer image acquisition and processing The software adopted multithreading described in the step 3); Accomplish PCI capture card and allocation buffer initial work with the data acquisition main thread respectively; Data processing is accomplished image from thread and is shown and stores processor work that the working method of multithreading has satisfied the real-time requirement of system's continuous acquisition.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010101775108A CN101860657B (en) | 2010-05-14 | 2010-05-14 | Real-time image acquisition method and system of large-view field visible infrared dual-channel camera |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010101775108A CN101860657B (en) | 2010-05-14 | 2010-05-14 | Real-time image acquisition method and system of large-view field visible infrared dual-channel camera |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101860657A CN101860657A (en) | 2010-10-13 |
| CN101860657B true CN101860657B (en) | 2012-11-14 |
Family
ID=42946291
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2010101775108A Active CN101860657B (en) | 2010-05-14 | 2010-05-14 | Real-time image acquisition method and system of large-view field visible infrared dual-channel camera |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101860657B (en) |
Families Citing this family (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102158651A (en) * | 2011-03-23 | 2011-08-17 | 中国科学院上海技术物理研究所 | TDI-CCD (time-delayed-integration charge coupled device) camera real-time image motion digital compensation system and compensation method |
| CN102346959A (en) * | 2011-08-11 | 2012-02-08 | 北京电子工程总体研究所 | Remote acquisition system of analog signals |
| CN103248881A (en) * | 2013-05-17 | 2013-08-14 | 中国科学院长春光学精密机械与物理研究所 | Method for receiving and displaying image data of kilomega network by using upper computer |
| CN103905728B (en) * | 2014-03-03 | 2017-02-08 | 中国科学院长春光学精密机械与物理研究所 | Astronautic camera LVDS data reliable transmission and reception method |
| CN104267290A (en) * | 2014-10-09 | 2015-01-07 | 惠州市蓝微电子有限公司 | Calibration and verification method for electric power management IC |
| CN105681786A (en) * | 2016-03-16 | 2016-06-15 | 昆山软龙格自动化技术有限公司 | USB 3.0 test card based on FPGA LVDS interfaces |
| CN105895495A (en) * | 2016-06-15 | 2016-08-24 | 安图实验仪器(郑州)有限公司 | Ion detection system applicable to laser desorption ionization time-of-flight mass spectrometer |
| CN106791908B (en) * | 2016-11-25 | 2019-11-01 | 上海熙菱信息技术有限公司 | A kind of live video stream storage method for supporting cloud platform to use double buffering |
| CN108616706A (en) * | 2016-12-10 | 2018-10-02 | 南京理工大学 | Cmos image sensor system with image-capable |
| CN107748011B (en) * | 2017-09-20 | 2019-08-16 | 南京航空航天大学 | The test macro and test method of medium-wave infrared detector image-forming delay time |
| CN109544493A (en) * | 2018-11-09 | 2019-03-29 | 中国科学院长春光学精密机械与物理研究所 | A kind of real-time injection device of high speed optoelectronic theodolite target |
-
2010
- 2010-05-14 CN CN2010101775108A patent/CN101860657B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN101860657A (en) | 2010-10-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101860657B (en) | Real-time image acquisition method and system of large-view field visible infrared dual-channel camera | |
| CN103986869A (en) | Image collecting and displaying device of high-speed TDICCD remote sensing camera | |
| Plackett et al. | Merlin: a fast versatile readout system for Medipix3 | |
| CN104950770B (en) | Controllable high speed multichannel signal acquisition control circuit system and its control method | |
| CN103024432B (en) | Automatic efficient full-covering test method of over-the-ground visible light remote sensing satellite image data | |
| CN102521182A (en) | Extensible multichannel parallel real-time data acquisition device and method | |
| CN104317752A (en) | Condition type triggering high-speed synchronous collecting and recording system with expandable channels | |
| CN202171812U (en) | Bar code identification device | |
| CN208872796U (en) | A kind of general card oscillograph of multichannel based on pci interface and system | |
| CN103330571A (en) | Data acquisition system, data acquisition control method and mobile CT scanner | |
| CN101929859B (en) | Image full-frame scanning based space debris detecting method | |
| CN103595924A (en) | Image fusion system based on Cameralink and image fusion method based on Cameralink | |
| CN101266714A (en) | Radiation imaging collection device and radiation imaging data collection method | |
| CN103412141B (en) | Young grape sprout growing rate measuring system and method based on machine vision | |
| WO2022052845A1 (en) | Linear array detector-based high-speed big data transmission system and method, terminal, and medium | |
| CN201523414U (en) | Long linear array CIS image acquisition device | |
| CN105245798A (en) | CCD video compression measurement imaging system based on block-oriented compression sensing, and control method | |
| CN112362939A (en) | Signal recording method and device, lower computer, upper computer and medium | |
| CN103822710A (en) | Spectral signal collecting circuit based on CCD | |
| CN102944301A (en) | Digital peak detection method and system for ultrasonic signals based on variable-pitch sectioning method | |
| US20230131042A1 (en) | Optoelectronic sensor device, detector and electronic device, and method of operating such a sensor device or detector | |
| CN109100556A (en) | A kind of general card oscillograph of multichannel based on pci interface | |
| CN201118765Y (en) | An image collection and playback system based on CMOS image sensor | |
| CN111123343A (en) | Double-time-step PET system imaging device and method | |
| CN100367281C (en) | Pulsed laser spot software synchronization acquisition method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |