CN111654679B - Multichannel image acquisition processing system for light path collimation control - Google Patents

Abstract

The invention discloses a multi-channel image acquisition processing system facing light path collimation control, which comprises an industrial CCD, at least one embedded front-end controller and an auxiliary controller, wherein the embedded front-end controller is provided with CCD equipment service and image processing service software, the front-end controller is connected with each CCD through a PCIE expansion network card so as to realize the parallel acquisition of multiple paths of CCD images, perform image processing according to the number of the current CCD connections, and finally transmit the images to a client side by a synchronization or event mechanism. The invention provides a multi-channel image acquisition processing system facing light path collimation control, which can realize power supply and baffle brightness control of a power grid port CCD and parallel acquisition and processing of a multi-channel CCD through the cooperation of an embedded front-end controller and an auxiliary controller, and meet the real-time monitoring requirement of the multi-channel CCD.

Description

Multichannel image acquisition processing system for light path collimation control

Technical Field

The invention relates to a system used under the condition of light path collimation control of a large-scale laser device. More particularly, the invention relates to a multi-channel image acquisition and processing system facing light path collimation control, which adopts a CCD (charge coupled device) to carry out video monitoring in a light path collimation control system of a large laser device.

Background

A large number of CCDs of different manufacturers exist in a light path collimation control system of a large laser device, the large laser device runs in a dark vacuum environment, strong laser damage needs to be avoided through a baffle, and the brightness value of an LED is adjusted to meet the requirement of CCD dark field imaging. In the collimation process, the image acquisition and processing software needs to meet the requirements of multi-light-path parallel collimation and multi-CCD parallel monitoring.

The traditional video monitoring system cannot meet the requirements of light path collimation control, such as hard trigger acquisition, image processing and the like. The current light path collimation control software runs in a virtual computer or a PC (personal computer), parallel acquisition of multiple paths of CCDs (charge coupled devices) is realized in a single process through a thread lock, and the light path collimation control requirement is basically met. However, hardware devices such as synchronous triggering, CCD power supply, baffle brightness control and a convergence switch occupy too much hardware integration space, and CCDs of different manufacturers face the risk of driving conflict, when the CCDs are directly accessed to a network, a UDP transmission mechanism of the CCDs causes network broadcast storm, the software coupling is poor, and the parallel monitoring of multiple CCDs is difficult to realize by upper computer software. Especially, as the scale of the optical path increases, the above method is difficult to meet the parallel monitoring requirement of the control system.

Disclosure of Invention

An object of the present invention is to solve at least the above problems and/or disadvantages and to provide at least the advantages described hereinafter.

The invention also aims to provide a multi-channel image acquisition processing system facing to light path collimation control, which can be matched with an auxiliary controller through an embedded front-end controller, has strong software coupling, can realize power supply and baffle brightness control of a power grid port CCD and parallel acquisition and processing of a plurality of paths of CCDs, and meets the requirement of real-time monitoring.

To achieve these objects and other advantages in accordance with the purpose of the invention, there is provided a multi-channel image acquisition processing system oriented to optical path collimation control, comprising:

a plurality of industrial CCDs for collecting images in the light path collimation control system;

at least one embedded front-end controller provided with CCD equipment service and image processing service software;

the auxiliary controller is matched with each front controller to adjust the brightness of each CCD power supply and the baffle;

the client is in communication connection with the front-end controller;

the front-end controller is connected with each CCD through a PCIE expansion network card so as to realize the parallel collection of multiple CCD images, and the front-end controller processes the images according to the number of the current CCD connections and finally transmits the images to the client end through a synchronization or event mechanism.

Preferably, the embedded front-end controllers are all configured to adopt a processor capable of running a Ubuntu operating system, so that the processor can run CCD equipment service and image processing service;

the CCD equipment service realizes the switching or control of corresponding functions of a CCD trigger mode, an acquisition mode, baffle brightness control, image acquisition, an image format, an image size and acquisition frequency, only one CCD equipment is operated by a single CCD equipment service, and the single CCD is bound by a network card, so that after the network card equipment sets an IP address and an MAC address, the CCD equipment service can establish connection with a hardware CCD;

the image processing service obtains the central position of the light spot according to the CCD far field, the CCD near field, the far field cavity mirror, the far field inverter and the far field or near field general image, realizes the image processing of the light path collimation control and can remotely upgrade the image processing algorithm;

the client can subscribe the CCD equipment service, and the parallel monitoring of hundreds of CCD channels is realized.

Preferably, each embedded front-end controller is connected with two PCIE expansion network cards respectively to realize expansion of 8-channel 1GbE RJ45 standard network ports, thereby realizing hardware parallel acquisition of 8-channel CCDs.

Preferably, the embedded front controllers are all configured to be connected with the auxiliary controller through a downlink ethernet interface so as to realize control of the CCD power supply and the baffle brightness.

Preferably, each embedded front-end controller can expand a hardware storage space through an SATAIII interface, realize an uplink network through a standard 1000Base-T interface, and realize a downlink 1000Base-T network through a PCIEx1 expansion network card and an I1210LM chip.

Preferably, the auxiliary controller realizes power supply, electric synchronization trigger signals, baffle power supply and RS485 serial port communication of the 8-path CCD through a single chip microcomputer MCU chip STM32F407IG, and provides a communication interface for the outside through a hundred mega network port chip W5500.

Preferably, each of the CCDs is connected to the embedded front controller through an RJ 45;

each CCD is respectively connected with an auxiliary controller cable interface through an M8 interface;

each embedded front-end controller is connected with an auxiliary controller network interface through RJ 45.

Preferably, the service of the CCD equipment provides a consistency command and an attribute interface for the outside, and different types of CCDs realize the CCD control function by calling corresponding CCD drives;

the CCD equipment service provides an image processing interface for the outside, and directly calls the image processing service to obtain the image processing interface and returns the image processing interface to the user.

Preferably, the client is provided with an upper computer program so as to call a CCD equipment service interface through a client API to realize the control and monitoring functions of the CCD;

when monitoring multiple paths and hundreds of paths of CCDs, the upper computer program subscribes the attribute of a compressed image by setting the compression size, the acquisition frequency and the compression format of the CCDs, and the client displays the compressed image on a corresponding channel according to the image source after receiving an event, so that the parallel monitoring of the multiple paths of CCDs is realized.

The invention at least comprises the following beneficial effects:

the multichannel image acquisition and processing system can be matched with the auxiliary controller through the embedded front-end controller, has strong software coupling, can realize power supply and baffle brightness control of a power grid port CCD and parallel acquisition and processing of a plurality of paths of CCDs, and meets the requirement of real-time monitoring.

Secondly, compared with the prior art, the invention has higher hardware integration level, more modularized cable connection and loosely coupled framework of image acquisition and processing, and meets the requirements of remote control, management, acquisition processing and parallel monitoring of the CCD.

Additional advantages, objects, and features of the invention will be set forth in part in the description which follows and in part will become apparent to those having ordinary skill in the art upon examination of the following or may be learned from practice of the invention.

Drawings

FIG. 1 is a schematic structural diagram of a multi-channel image acquisition processing system facing optical path collimation control in an embodiment of the present invention;

FIG. 2 is a diagram illustrating a hardware structure of an embedded front-end controller according to the present invention;

fig. 3 is a schematic block diagram of the multichannel image acquisition processing system of the present invention for monitoring hundreds of CCDs in parallel.

Detailed Description

The present invention is further described in detail below with reference to the attached drawings so that those skilled in the art can implement the invention by referring to the description text.

It will be understood that terms such as "having," "including," and "comprising," as used herein, do not preclude the presence or addition of one or more other elements or groups thereof.

It is to be understood that in the description of the present invention, the terms indicating orientation or positional relationship are based on the orientation or positional relationship shown in the drawings, and are used only for convenience in describing the present invention and for simplification of the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and thus, should not be construed as limiting the present invention.

Fig. 1-3 show an implementation form of a multi-channel image acquisition processing system facing optical path collimation control according to the invention, which comprises:

a plurality of industrial CCDs 1 for image acquisition in the optical path collimation control system, each CCD configured to employ multiple network ports;

the embedded front controller 2 is provided with CCD equipment service and image processing service software and is used for realizing CCD parallel acquisition and processing, specifically, the image processing service provides a modular image processing function, such as a light spot center computing interface of a CCD far field, a CCD near field, a far field cavity mirror, a far field reverser, a far field or near field general image and the like, and a user realizes corresponding algorithm processing according to a function name and an image and returns a character serialization image processing result. The image processing service can be packaged into a c + + dynamic link library, and can also be used for providing a consistency command and an attribute interface for the outside through a python script, the CCD equipment service provides a consistency command and an attribute interface for the outside, and different types of CCDs realize CCD control functions by calling corresponding CCD drivers, wherein the functions comprise functions of a trigger mode, an acquisition mode, baffle brightness control, image acquisition, an image format, an image size, acquisition frequency, an original image, a compressed image and the like. The CCD equipment service provides an image processing interface for the outside, and directly calls the image processing service to obtain the image processing interface and returns the image processing interface to the user;

the auxiliary controller 3 is matched with each front controller to regulate the brightness of each CCD power supply and the baffle 6 and is used for providing integrated auxiliary control functions such as power supply, synchronization and baffle power supply control;

the client 4 is in communication connection with the front-end controller, and client software of an upper computer is installed on the client 4;

wherein, the front-end controller is connected with each CCD through a PCIE expansion network card 5 to realize the parallel collection of multi-path CCD images, the general idea of the scheme is to realize the parallelization of CCD acquisition hardware by a PCIE expansion network card, realize the integration of CCD auxiliary control by an auxiliary controller, realize the parallelization of CCD control service by an embedded front controller, realize the modularization of image processing, realize the parallelization of multi-path CCD transmission by a client and the like, and further adjust the image processing or video processing effect by the number of the CCD currently processed, such as few, the image pixel, sharpness may be set higher and vice versa to be lower to satisfy the smoothness of large-scale CCD processing.

In another example, the embedded front-end controllers are all configured to adopt a processor capable of running an Ubuntu operating system to run CCD device services and image processing services through the processor, the embedded front-end controllers run an Ubuntu1604 operating system in a CPU motherboard i7-6822EQ (or i 5) for running CCD device services, image processing service software and service management software, further, the embedded front-end controllers are 1U in size, the CPU processing core adopts a fourth generation intel core processor i5-6440EQ, and connects a 128G solid state disk through SATA, and expands to an RJ45 standard network port of 8-way 1GbE through PCI-E2.0 x4, and installs the Ubuntu1604 operating system to provide 1 ac power input interface of 220 VAC; the system comprises 1 RS232 interface, 1 485 interface, 1 DVI-I video signal output interface, 2 USB3.0 interfaces, an uplink gigabit network standard RJ45 interface, a downlink gigabit network standard RJ45 interface and 8 gigabit Ethernet interfaces LAN 1-LAN 8;

the CCD equipment service realizes the switching or control of corresponding functions of a CCD trigger mode, an acquisition mode, baffle brightness control, image acquisition, an image format, an image size and acquisition frequency, only one CCD equipment is operated by a single CCD equipment service, and a single CCD is bound by a network card, so that the condition that multiple devices serially call a dynamic library is avoided, after the network card equipment sets an IP address and an MAC address, the CCD equipment service can establish connection with a hardware CCD, specifically, CCD equipment service software realizes the integrated control function of the CCD through C + + driving realization of a manufacturer and an embedded front-end controller communication interface, and the interface definition is as follows:

the attributes are as follows:

grayImage 8; a/8 bit gray level image, a two-dimensional array, including width and height;

grayImage 16; a 16 bit gray scale image, a two dimensional array, including width and height;

a rawImage; v/original image, one-dimensional array, including total length;

an encodedImage; v/compressed image, one-dimensional array, image length;

imageWidth// int image width;

imageHeight// int image height;

imagePixelBit// int pixel number;

a hiderState// int baffle status;

HinderLightness// int baffle brightness;

acqMode; v/int camera acquisition mode, 0-internal trigger acquisition; 1-external trigger acquisition; 2-continuous collection;

encodedImageWidth// int compressed image width;

encodedImageheight// int compressed image height;

encodedImageFormat// string compressed image format;

encodedImagefreq// int compressed image acquisition frequency;

command:

void PowerOn (), power-up of the/CCD power supply;

void PowerOff (), powering down// CCD power supply;

void OpenHinder (); // open the flap;

void closeHinder ()/close baffle;

void StartAcq ()/start acquiring images;

void StopAcq (); // turn off the captured image;

string CalcImage (String)// image processing;

the image processing service obtains the center position of a light spot according to a CCD far field, a CCD near field, a far field cavity mirror, a far field inverter and a far field or near field general image, realizes image processing of light path collimation control, and can remotely upgrade an image processing algorithm, specifically, the image processing service provides an image processing function externally, and a client API or CCD equipment service can realize image processing through a function name and return an image processing result. The user may also continually add new image processing interfaces. Wherein the image processing service commands and attributes are defined as follows:

the attributes are as follows:

grayImage 16; a 16 bit gray scale image, a two dimensional array, including width and height;

method,/shaping, image processing method;

command:

string CalcImageFarField (); // far field image processing

String CalcImageNearField (); // near field image processing

String CalcImageFarFieldCm (); // far field endoscope image processing

String CalcImageNearField (); // near field image processing

String CalcImageFarFieldReverse (); // remote inverter image processing

String CalcImageFarFieldCommon (); // far field image general processing

String CalcImageNearFieldCommon (); // near field image general processing

Wherein the character string returns the result in json map format, such as { "zx":125.0 { "zy":125.0 };

the client side can subscribe CCD equipment service to realize parallel monitoring of hundreds of CCD, an upper computer program on the client side calls a CCD equipment service interface through a client side API to realize the control and monitoring functions of the CCD, when multi-path and hundreds of CCD monitoring is realized, the parallel monitoring of the multi-path CCD is realized by setting the compression size, the acquisition frequency and the compression format of the CCD and subscribing the attribute of a compressed image, and particularly, the client side API can realize the functions of CCD baffle control, power supply control, trigger mode setting, image acquisition and the like through a CCD equipment object interface; when the client side carries out multi-path CCD monitoring, firstly, the updating frequency of the event and the size of the event data are determined by setting parameters such as the width, the height, the sampling frequency and the image format of the attribute compressed image, the event is subscribed through the encodedImage attribute, and the client side receives the event and then displays the event on a corresponding channel according to the image source. The monitoring CCD and the collimation CCD in the laser device are 8-bit or 12-bit 1392 × 1040 gray level images, when jpeg compression is adopted, the compression is about 50KB, the gigabit network bandwidth meets about 1200 events, and the monitoring requirement of hundreds of CCDs in the laser device is met;

the client can also realize the functions of remote updating, registering, starting and stopping and monitoring of the CCD service and the image processing service through service management software, namely the client can register the names and equipment addresses of 1-8 CCD equipment and the starting and stopping and monitoring of the CCD equipment on the embedded controller through the service management software.

In another example, each embedded front-end controller is connected with two PCIE expansion network cards respectively to realize expansion of 8-channel 1GbE RJ45 standard network ports and further realize hardware parallel acquisition of 8-channel CCDs, in this scheme, expansion of 8-channel gigabit electric network ports is realized through 2 PCIE 4 expansion network cards NMC-0107 of the chip, the structural design layout is reasonable, and the parallel collection effect is better.

In another example, the embedded front controllers are all configured to be connected with the auxiliary controller through a downlink ethernet interface to realize control of the CCD power supply and the baffle brightness, and in this way, signal interconnection and interaction of the embedded controllers are realized to fulfill functional interoperation requirements between system boards.

In another example, each embedded front-end controller can expand a hardware storage space through an SATAIII interface to meet the requirement of CCD collection and storage, an uplink network is realized through standard 1000Base-T, and downlink 1000Base-T network expansion is realized through a PCIEx1 expansion network card and an I1210LM chip.

In another example, the auxiliary controller realizes power supply, electric synchronization trigger signals, baffle power supply and RS485 serial port communication of 8-path CCDs through a single chip microcomputer MCU chip STM32F407IG, provides a communication interface to the outside through a hundred mega network port chip W5500, meets the operation requirement and functional requirement of the invention through specialization of equipment plates, and has better adaptability.

In another example, each of the CCDs is connected to the embedded front controller through an RJ 45;

each CCD is respectively connected with an auxiliary controller cable interface through an M8 interface;

each embedded front-end controller is connected with an auxiliary controller network interface through RJ45, and the communication and power supply among the plates are realized through the interfaces, so that the electrical property and communication interconnection of the plates are realized.

In another example, the service of the CCD equipment provides a consistency command and an attribute interface to the outside, and different types of CCDs realize the CCD control function by calling corresponding CCD drivers;

the CCD equipment service provides an image processing interface for the outside, and directly calls the image processing service to obtain the image processing interface and returns the image processing interface to the user.

In another example, the client is provided with an upper computer program to call a CCD equipment service interface through a client API (application program interface) to realize the control and monitoring functions of the CCD;

when monitoring multiple paths and hundreds of paths of CCDs, the upper computer program sets the compression size, the acquisition frequency and the compression format of the CCDs and subscribes the attribute of a compressed image, the client receives an event and then displays the event on a corresponding channel according to the image source to realize the parallel monitoring of the multiple paths of CCDs, and through the action of client software, when the large-scale CCDs are subjected to video or image acquisition, the video or image can be correspondingly compressed according to the requirement so as to meet the requirement of the multi-path parallel monitoring in real-time monitoring, and the system can normally run and has better stability through the reduction of the quality of the video or image.

The above scheme is merely illustrative of the preferred embodiment, but not limiting. When the invention is implemented, appropriate replacement and/or modification can be carried out according to the requirements of users.

The number of apparatuses and the scale of the process described herein are intended to simplify the description of the present invention. Applications, modifications and variations of the present invention will be apparent to those skilled in the art.

While embodiments of the invention have been disclosed above, it is not intended to be limited to the uses set forth in the specification and examples. It can be applied to all kinds of fields suitable for the present invention. Additional modifications will readily occur to those skilled in the art. It is therefore intended that the invention not be limited to the exact details and illustrations described and illustrated herein, but fall within the scope of the appended claims and equivalents thereof.

Claims (7)

1. A multi-channel image acquisition processing system facing to light path collimation control is characterized by comprising:

a plurality of industrial CCDs for collecting images in the light path collimation control system;

at least one embedded front-end controller provided with CCD equipment service and image processing service software;

the auxiliary controller is matched with each front controller to adjust the brightness of each CCD power supply and the baffle;

the client is in communication connection with the front-end controller;

the front-end controller is connected with each CCD through a PCIE expansion network card so as to realize the parallel acquisition of multi-path CCD images, and performs image processing according to the number of the current CCD connections, namely, the image processing or video processing effect is adjusted through the number of the current processing CCDs, if the number is small, the image pixel and definition can be set to be higher, otherwise, the image pixel and definition are set to be lower so as to meet the smoothness of large-scale CCD processing, and finally, the images are transmitted to a client end through a synchronization or event mechanism;

the CCD equipment service provides a consistency command and an attribute interface for the outside, and different types of CCDs realize the CCD control function by calling corresponding CCD drivers;

the CCD equipment service provides an image processing interface for the outside, and directly calls the image processing service to obtain the image processing interface and returns the image processing interface to the user;

the embedded front controllers are all configured to adopt a processor capable of running a Ubuntu or Windows operating system so as to run CCD equipment service and image processing service through the processor;

the CCD equipment service realizes the switching or control of corresponding functions of a CCD trigger mode, an acquisition mode, baffle brightness control, image acquisition, an image format, an image size and acquisition frequency, only one CCD equipment is operated by a single CCD equipment service, and the single CCD is bound by a network card, so that after the network card equipment sets an IP address and an MAC address, the CCD equipment service can establish connection with a hardware CCD;

the image processing service obtains the central position of the light spot according to the CCD far field, the CCD near field, the far field cavity mirror, the far field inverter and the far field or near field general image, realizes the image processing of the light path collimation control and can remotely upgrade the image processing algorithm;

the client can subscribe the CCD equipment service, and the parallel monitoring of hundreds of CCD channels is realized.

2. The optical path collimation control-oriented multi-channel image acquisition processing system as claimed in claim 1, wherein each embedded pre-controller is respectively connected with two PCIE expansion network cards to realize expansion of an 8-path 1GbE RJ45 standard network port, thereby realizing hardware parallel acquisition of an 8-path CCD.

3. The multi-channel image acquisition processing system facing optical path collimation control as recited in claim 1, wherein the embedded pre-controllers are all configured to connect with an auxiliary controller through a downlink ethernet interface to achieve control of CCD power supply and baffle brightness.

4. The multi-channel image acquisition processing system facing optical path collimation control as claimed in claim 1, wherein each embedded front-end controller can expand a hardware storage space through an SATAIII interface, realize an uplink network through a standard 1000Base-T, and realize a downlink 1000Base-T network through a PCIEx1 expansion network card and an I1210LM chip.

5. The multi-channel image acquisition processing system facing to optical path collimation control as claimed in claim 1, wherein the auxiliary controller realizes power supply, electric synchronization trigger signal, baffle power supply and RS485 serial port communication of 8-channel CCD through a single chip microcomputer MCU chip STM32F407IG, and provides a communication interface to outside through a hundred mega network port chip W5500.

6. The multi-channel image acquisition processing system facing the optical path collimation control as recited in claim 1, wherein each of the CCDs is respectively connected to the embedded front-end controller through an RJ 45;

each CCD is respectively connected with an auxiliary controller cable interface through an M8 interface;

each embedded front-end controller is connected with an auxiliary controller network interface through RJ 45.

7. The multi-channel image acquisition processing system facing to the light path collimation control as claimed in claim 1, wherein an upper computer program is arranged on the client to call a CCD device service interface through a client API to realize the control and monitoring functions of the CCD;

when monitoring multiple paths and hundreds of paths of CCDs, the upper computer program subscribes the attribute of a compressed image by setting the compression size, the acquisition frequency and the compression format of the CCDs, and the client displays the compressed image on a corresponding channel according to the image source after receiving an event, so that the parallel monitoring of the multiple paths of CCDs is realized.

Images