WO2019085605A1 - 一种基于cpu+gpu+fpga架构的自动光学检测系统 - Google Patents
一种基于cpu+gpu+fpga架构的自动光学检测系统 Download PDFInfo
- Publication number
- WO2019085605A1 WO2019085605A1 PCT/CN2018/102154 CN2018102154W WO2019085605A1 WO 2019085605 A1 WO2019085605 A1 WO 2019085605A1 CN 2018102154 W CN2018102154 W CN 2018102154W WO 2019085605 A1 WO2019085605 A1 WO 2019085605A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- data
- module
- unit
- camera
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/01—Arrangements or apparatus for facilitating the optical investigation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
- G06T1/20—Processor architectures; Processor configuration, e.g. pipelining
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/95—Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/04—Programme control other than numerical control, i.e. in sequence controllers or logic controllers
- G05B19/042—Programme control other than numerical control, i.e. in sequence controllers or logic controllers using digital processors
- G05B19/0428—Safety, monitoring
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
- G06T1/0014—Image feed-back for automatic industrial control, e.g. robot with camera
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/04—Programme control other than numerical control, i.e. in sequence controllers or logic controllers
- G05B19/042—Programme control other than numerical control, i.e. in sequence controllers or logic controllers using digital processors
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/26—Pc applications
- G05B2219/2656—Instrumentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30168—Image quality inspection
Definitions
- the invention belongs to the technical field of automatic optical detection, and particularly relates to an automatic optical detection system based on CPU+GPU+FPGA architecture.
- AOI automatic optical inspection involves optical systems, mechanism control systems, point screen control systems, software control systems, image processing systems, and more.
- the traditional AOI equipment is based on the image acquisition card + PC, the acquisition card and PC are many, the cost is high, the coordination is difficult, the system stability is poor, the expansion is inconvenient, it is difficult to be used for large-scale module detection; and each TFT-LCD AOI automatic optics Testing equipment manufacturers have only one or two areas of technology accumulation and research and development capabilities, basically can not fully cover all areas, can only build a complete AOI automatic optical test system through 2-3 products together, the equipment The overall responsibility is usually to master the unit based on machine vision image processing algorithms.
- the dot screen signal and the image acquisition processing unit are two different system schemes, and another main control unit is required to cooperatively control the dot screen signal and the image acquisition processing unit, thereby bringing about an overall system efficiency degradation; each image acquisition
- the card can only be connected to a 1-way camera.
- most image acquisition cards use the PCIE interface to communicate with the PC.
- Such a PC can support a limited number of acquisition cards at the same time, and will use a large number of image acquisition cards and increase the number of PCs.
- the PCs are coordinated and controlled by the master PC. The complexity and system stability are difficult to control, and the PC image processing and processing capabilities are poor.
- the existing AOI detection equipment scheme, dot screen signal, light source and AOI detection The system is an independent system unit, which requires the total control unit to coordinate the control point screen signal generation, light source, AOI detection system image acquisition and processing, the control process is complex, and the tact time is long.
- the object of the present invention is to solve the deficiencies of the above background art, and provide an automatic system based on CPU+GPU+FPGA architecture capable of supporting multiple cameras and realizing integration of dot screen signal generation, light source control, image acquisition and image calculation processing.
- Optical inspection system Optical inspection system.
- an automatic optical detection system based on CPU + GPU + FPGA architecture, comprising an image storage unit, an image calculation unit and an image acquisition unit, the image storage unit having a first communication interface and a second communication An interface, the image computing unit has a first fiber interface, a second fiber interface, a third fiber interface, and a fourth fiber interface, the image acquisition unit having a third communication interface and a camera interface;
- the image storage unit sends configuration parameters and test commands to the image computing unit through the first communication interface, and receives test results sent by the image calculation unit, and receives data of the collection unit through the second communication interface;
- the image computing unit receives the configuration parameters and test commands sent by the image storage unit through the first fiber interface, sends the test result to the image storage unit, receives the data of the image acquisition unit through the second fiber interface, and sends the configuration parameters to the image acquisition unit.
- the test command controls the dot screen signal generation through the third fiber interface, and controls the IO light source through the fourth fiber interface;
- the image acquisition unit outputs image data, receives configuration parameters, and test commands through the third communication interface, receives camera data through the camera interface, and transmits configuration parameters and test commands to the camera.
- the image storage unit includes
- the main control PC is configured to perform parameter configuration, output configuration parameters and test commands through human-computer interaction, and is used for receiving the test result of the FPGA storage platform and reporting the result;
- the FPGA storage platform is configured to receive image acquisition unit data, perform lossless compression on the received data, and send the data to the disk array for receiving the test result of the image calculation unit and outputting the output configuration parameter to the image acquisition unit. For performing image data retrieval based on stored data;
- a disk array for storing data.
- the FPGA storage platform includes
- a data interaction module configured to receive configuration parameters sent by the master PC, and used to feed back the test result of the received image calculation unit to the master PC;
- An image data receiving/transmitting module configured to receive the image capturing unit data and output the data to the data lossless compression module, configured to receive the configuration parameter and send the configuration parameter to the image collecting module, and receive the test result of the image computing unit;
- a data lossless compression module configured to perform lossless compression on the received data and store the data to the disk array through the disk storage management unit;
- a data disk storage management module that manages the storage and reading functions of the disk array.
- the FPGA storage platform further includes
- An image retrieval management module for controlling a read disk array
- the image data exchange control module has a fourth communication interface for communicating with an external server to implement image retrieval data exchange and data communication control.
- the image computing unit includes an FPGA computing platform and a computing PC, and the first fiber interface, the second fiber interface, the third fiber interface, and the fourth fiber interface are all disposed on an FPGA computing platform, and the FPGA computing platform further has A fifth fiber interface coupled to the computing PC and an expansion interface that implements cascading expansion of the FPGA computing platform.
- the FPGA computing platform includes a central controller, an image processing accelerator, a data summary sending module, and DDR memory.
- the central controller is configured to send a control command to the computing PC and the image processing accelerator respectively according to the set instruction;
- the calculating PC is configured to read part of the image data from the DDR memory according to the control command, perform a calculation process, and send the processing result to the data summary sending module;
- the image processing accelerator is configured to read a partial image from the DDR memory according to the control command, perform a calculation process, and send the calculation result to the data summary sending module;
- the data summary sending module is configured to summarize the processing results of the computing PC and the image processing accelerator to form a final test result and send the result to the image storage module;
- the DDR memory is used to store image data and test results that need to be processed.
- the FPGA computing platform further includes a receiving configuration parameter module, a data receiving/parameter configuration module, a signal expansion module, and an IO control module.
- the receiving configuration parameter module is configured to receive configuration parameters and test commands and send them to a central controller
- the central controller is further configured to send the received configuration parameters to the data receiving/parameter configuration module, and respectively distribute the received test commands to the data receiving/parameter configuration module, the IO control module, and the signal expansion module;
- the data receiving/parameter configuration module is configured to receive image data of the image capturing unit and store it in the DDR memory, and send the received configuration parameter and the test command to the image collecting unit;
- the signal expansion module is configured to implement point screen signal generation and control according to the test command
- the IO control module is configured to implement IO light source control according to a test command.
- the image acquisition unit includes
- a protocol parsing module configured to receive camera data, and parse the camera data according to a protocol to send valid image data to a DDR physical memory for storage as original image data
- DDR physical memory for storing raw image data and processing image data
- the image quality evaluation and pre-processing module is configured to read original image data from the DDR physical memory according to the control unit control command, perform image pre-processing on the original image data, and send the pre-processed data to the DDR physical memory for storage. Processing image data;
- the main control unit sends a control command to the image quality evaluation and pre-processing and reading DDR data format conversion according to the set instruction;
- the DDR data format conversion module is configured to read the original image data and/or process the image data from the DDR physical memory according to the configuration command of the main control unit, and send the data to the high-speed interface data packet module.
- a high speed interface data encapsulation module for transmitting the received raw image data and/or processed image data to an image storage unit and an image computing unit.
- the image acquisition unit further includes an automatic alignment focus exposure module and a camera configuration module.
- the high speed interface data encapsulation module is further configured to receive configuration parameters and test commands and send the same to the main control unit;
- the protocol parsing module is further configured to receive camera data, and parse the camera data according to a protocol to send valid image data to the DDR physical memory; and send the camera configuration parameter to the camera;
- the image quality evaluation and pre-processing module is further configured to perform image collection quality evaluation on the camera data according to the control unit control command, and send the quality evaluation result to the main control unit.
- the main control unit is further configured to send the received configuration parameter, the test command, and the quality evaluation result to the automatic registration focus exposure module;
- the automatic alignment focus exposure module is configured to implement camera parameter setting according to configuration parameters and quality evaluation results, and send configuration parameters and test commands to the camera configuration module;
- the camera configuration module is configured to send camera configuration parameters and test commands to the protocol parsing module.
- the protocol parsing module includes a Camera link protocol parsing module, a Gige Vision protocol parsing module, and a CLHS protocol parsing module, where the interfacing interface includes multiple Camera Link interfaces, multiple Gige interfaces, and multiple CLHS interfaces.
- the plurality of Camera Link interfaces are connected to the Camera link protocol parsing module, and the plurality of Gige interfaces are connected to the Gige Vision protocol parsing module, and the plurality of CLHS interfaces are connected to the CLHS protocol parsing module.
- the invention has the beneficial effects that the image storage unit, the image calculation unit and the image acquisition unit cooperate with each other, and can realize image storage and retrieval, and has the functions of human-computer interaction, main control and display, processing result analysis and reporting; It can realize dot screen signal generation and signal expansion, light source, image acquisition, camera integrated control function, short tact time, communication and data interaction between each unit through optical fiber, and data transmission speed is fast; image calculation unit can also pass level
- the connection method expands the computing processing capability; and the image computing unit uses the CPU+GPU+FPGA architecture to fully expand the CPU+GPU unit to enhance the processing power of the GPU; and the FPGA as the central controller, the processing data needs to be distributed to different GPU processing units.
- the FPGA itself realizes the image acceleration processor, fully utilizes the parallel processing capability of the FPGA, and performs image processing segmentation and FPGA+ GPUs to coordinate processing, which effectively improves the image processing computing capability;
- Camera interface support automatic alignment, focus, automatic exposure parameter setting An image quality evaluation, image preprocessing functions.
- the whole system architecture has the advantages of simple structure, low cost, good stability, good coordination ability and strong computing and processing capability.
- Figure 1 is a schematic block diagram of the present invention.
- FIG. 2 is a flow chart of the tuning machine of the present invention.
- Figure 3 is a flow chart of the test of the present invention.
- FIG. 4 is a schematic block diagram of an image storage unit of the present invention.
- Figure 5 is a flow chart showing the operation of the image storage unit of the present invention.
- Figure 6 is a schematic block diagram of an image calculation unit of the present invention.
- Figure 7 is a flow chart showing the operation of the image computing unit of the present invention.
- Figure 8 is a schematic block diagram of an image acquisition unit of the present invention.
- Figure 9 is a flow chart showing the operation of the image acquisition unit of the present invention.
- 1-image storage unit 1.1-master PC, 1.2-FPGA storage platform; 1.3-disk array; 1.4-data interaction module; 1.5-image data receiving/transmitting module; 1.6-data lossless compression module; Data disk storage management module; 1.8-image retrieval management module; 1.9-image data exchange control module;
- 2-image computing unit 2.1-FPGA computing platform; 2.2-computing PC; 2.3-data receiving/parameter configuration module; 2.4-write DDR data format conversion module; 2.5-signal expansion module; 2.6-IO control module; Controller; 2.8-image processing accelerator; 2.9-receive configuration parameter module; 2.10-configuration register; 2.11-data summary transmission module; 2.12-read DDR data format conversion module; 2.13-data transmission module; 2.14-AXI bus interconnection module 2.14 ; 2.15-DDR controller 2.15; 2.16-DDR memory 2.16;
- 3-Image acquisition unit 3.1-Protocol resolution module; 3.2-Valid data extraction module; 3.3-Write DDR data format conversion module; 3.4-AXI bus interconnection; 3.5-DDR control module; 3.6-DDR physical memory; 3.7-Image quality Evaluation and pre-processing module; 3.8-master unit; 3.9-register configuration module; 3.10-read DDR data format conversion module; 3.11-high-speed interface data packet module; 3.12-automatic alignment focus exposure module; 3.13-camera configuration module;
- the present invention includes an image storage unit 1, an image calculation unit 2, and an image acquisition unit 3 having a first communication interface and a second communication interface, the image calculation unit 2 having a a fiber optic interface, a second fiber optic interface, a third fiber optic interface, and a fourth fiber optic interface, the image acquisition unit 3 having a third communication interface and a camera interface;
- the image storage unit 1 performs parameter configuration by human-computer interaction, and sends a configuration parameter and a test command to the image computing unit through the first communication interface, and the test result sent by the image computing unit is reported and reported, and the configuration parameters sent by the image storage unit include Pattern list, dot screen parameters, camera parameters, detection parameters, etc.; receiving data of the acquisition unit through the second communication interface and storing;
- the image computing unit 2 receives configuration parameters and test commands sent by the image storage unit through the first fiber interface, sends test results to the image storage unit, receives data of the image acquisition unit through the second fiber interface, and sends configuration parameters to the image collection unit. And the test command, through the third fiber optic interface control point screen signal generation (control signal expansion unit 7 lighting module), through the fourth fiber optic interface control IO light source (related light source 9 [backlight and side light]);
- the image acquisition unit outputs image data, receives configuration parameters, and test commands through the third communication interface, receives camera data through the camera interface, and transmits configuration parameters and test commands to the camera.
- the tuning refers to the adjustment of the working distance of the camera, the focusing parameter, the exposure parameter, the gain parameter, the white balance parameter, the brightness of the backlight, etc.
- the tuning process is as shown in FIG. 2:
- Device initialization including camera and lens parameters, Panel parameters, Panel transmittance parameters, backlight parameters, etc.
- This automatic tuning device and solution usually takes only a few minutes to complete the camera adjustment work; the traditional adjustment method usually takes hours or even days; and through this automatic adjustment device scheme, the image consistency is higher. .
- the main control unit sets a one-button test start command.
- Image pre-processing including brightness correction, vignetting correction, ROI area extraction and cutting, background suppression, moiré removal, grayscale stretching, and the like.
- the detection result is reported, and the report includes the data storage part sent to the customer MCMQ system and the timely display part is sent to the customer CIM 6 system through the PLC 5.
- the image storage unit 1 includes a host PC 1.1, an FPGA storage platform (an FPGA-based storage processing board) 1.2, and a disk array 1.3, an FPGA storage platform 1.3, and a data interaction module 1.4.
- the image data receiving/transmitting module 1.6, the data lossless compression module 1.6, the data disk storage management module 1.7, the image retrieval management module 1.8, and the image data exchange control module 1.9, the image storage unit is responsible for image storage and retrieval, and also has both Human-computer interaction, master control and display, processing result analysis and reporting.
- the main control PC and the FPGA storage platform communicate and interact with each other through the PCIE x8 mode.
- the first communication interface and the second communication interface are both located on the FPGA storage platform, that is, between the FPGA storage platform and the image computing unit and the image acquisition unit. Data communication and interaction are carried out through optical fibers, and the optical fiber connection network is used to facilitate image storage and retrieval.
- the storage unit is mainly used to store the original image data and/or the processed image data sent by the image acquisition unit, and the processing result data of the image calculation unit is not saved to the local server, and is directly uploaded to the system of the client MCMQ 4.
- the images saved to the local are used for subsequent data analysis and retrieval, and have high requirements on storage space, storage and retrieval efficiency.
- each module of the image storage unit is as follows:
- the main control PC 1.1 is used for parameter configuration, output configuration parameters and test commands through human-computer interaction, and is used for receiving the test result of the FPGA storage platform 1.2 and reporting it, for connecting with the customer MCMQ, reporting the defect data, reporting the defect image, The test result XML data is reported.
- Disk array 1.3 for storing data.
- the data interaction module 1.4 is configured to receive configuration parameters sent by the master PC for feeding back the test result of the received image calculation unit to the master PC.
- the image data receiving/transmitting module 1.5 is configured to receive the image capturing unit data and output the data to the data lossless compression module, and receive the configuration parameters and send the configuration parameters to the image capturing module for receiving the test result of the image computing unit.
- the data lossless compression module 1.6 is configured to perform lossless compression on the received data and store it to the disk array through the disk storage management unit; the lossless compression of the data can greatly improve the storage space utilization and the pressure on the retrieval bandwidth.
- the data disk storage management module 1.7 is used to manage the storage and reading functions of the disk array.
- the image retrieval management module 1.8 is configured to control the read disk array.
- the image data exchange control module 1.9 has a fourth communication interface for communicating with an external server, and implementing image retrieval data exchange and data communication control under an external server command.
- the search is performed, the required image data is read out locally, and transmitted to the search server through the optical fiber exchange network, and the search server can perform non-destructive decompression on the image.
- the data processing flow of the image storage unit is as follows:
- the compressed image data is stored
- the image computing unit 2 includes an FPGA computing platform 2.1 (an FPGA-based computing processing board) and a computing PC 2.2, a first fiber interface, a second fiber interface, a third fiber interface, and a fourth
- the optical fiber interfaces are all disposed on the FPGA computing platform, and the FPGA computing platform further has a fifth optical fiber interface connected to the computing PC, and an extended interface for implementing cascade expansion of the FPGA computing platform.
- the FPGA computing platform 2.1 includes a data receiving/parameter configuration module 2.3, a write DDR data format conversion module 2.4, a signal expansion module 2.5, an IO control module 2.6, a central controller 2.7, an image processing accelerator 2.8, a receiving configuration parameter module 2.9, and a configuration.
- Register 2.10, data summary transmission module 2.11, data transmission module 2.13, AXI bus interconnection module 2.14, DDR controller 2.15 and DDR memory 2.16, computing PC 2.2 consists of CPU and GPU.
- the image calculation unit also has dot screen signal generation and signal expansion, and integrated light source control functions.
- An FPGA computing platform consists of 12 QSFP+ fiber interfaces, which can connect up to 6 computing PCs. Multiple computing PCs can be switched between 16 KVM 8 devices, FPGA computing platform and computing PC, image storage unit, and image acquisition.
- the unit, the signal expansion unit 7, and the IO light source control unit communicate and exchange data through the optical fiber mode; the FPGA computing platform supports the expansion and expansion of the calculation processing capability through the fiber interface cascading expansion.
- the FPGA computing platform forms the CPU+GPU+FPGA computing architecture together with the CPU and GPU that make up the computing PC. According to the image data stream mode, Pipeline structure processing, FPGA image pre-processing, and CPU+GPU image post-processing, the calculation speed is fully improved.
- each module of the image calculation unit is as follows:
- the calculation PC 2.2 is configured to read part of the image data from the DDR memory according to the control command, perform calculation processing, and send the processing result to the data summary sending module.
- the data receiving/parameter configuration module 2.3 is configured to receive image data of the image capturing unit, and convert the image into a DDR memory after being converted by the DDR data format conversion module, and configured to send the received configuration parameter and the test command to the image collecting unit.
- the DDR data format conversion module 2.4 is written to perform format conversion on the received data.
- the signal expansion module 2.5 is configured to implement point screen signal generation and control according to the test command.
- the IO control module 2.6 is configured to implement IO light source control according to the test command.
- the central controller 2.7 is configured to send a control command to the computing PC and the image processing accelerator respectively according to the set instruction; for transmitting the received configuration parameter to the data receiving/parameter configuration module, and respectively distributing the received test command to the data receiving /Parameter configuration module, IO control module and signal expansion module.
- the image processing accelerator 2.8 is configured to read a partial image from the DDR memory according to the control command for calculation processing, and send the calculation result to the data summary sending module.
- the receiving configuration parameter module 2.9 is configured to receive configuration parameters and test commands of the image storage unit and send the same to the central controller.
- Configuration register 2.10 completes the relevant register configuration.
- the data summary sending module 2.11 is configured to summarize the processing results of the computing PC and the image processing accelerator to form a final test result and send the result to the image storage module.
- the DDR data format conversion module 2.12 is read to perform format conversion on the received data.
- a data sending module 2.13 configured to send part of data that needs to be processed to a computing PC
- the AXI bus interconnect module 2.14 is used to read and write image data to the DDR memory under the control of the central controller.
- DDR controller 2.15 used to control read and write image data and test results.
- DDR memory 2.16 used to store image data and test results that need to be processed.
- the image acquisition unit 3 includes a protocol parsing module 3.1, an effective data extracting module 3.2, a write DDR data format conversion module 3.3, an AXI bus interconnect 3.4, a DDR control module 3.5, a DDR physical memory 3.6, and an image.
- the image acquisition sheet supports multiple camera interfaces, supports multiple cameras, supports automatic alignment, focus, automatic exposure parameter setting, image quality evaluation, and better image consistency [according to backlight brightness, panel transmittance, lens distortion) ⁇ Automatically adjust exposure time, gain, brightness correction and vignetting correction to improve image quality and consistency; can perform image pre-processing, including: brightness correction, vignetting correction, ROI area extraction and cutting, background suppression, moiré removal , grayscale stretching, etc.
- each module of the image acquisition unit 3 is as follows:
- the protocol parsing module 3.1 is configured to receive camera data, and parse the camera data according to the protocol, and validate the image data according to the protocol, send the DDR data format conversion module to the DDR physical memory, and store the data as the original image data; After receiving the camera data, and parsing the camera data according to the protocol, the valid image data is sent to the DDR physical memory through the effective data extraction module and the write DDR data format conversion module, and the parsed image data includes 24 bit image data and a frame control signal.
- VS/HS/DE used to send camera configuration parameters to the camera.
- the protocol parsing module includes a Camera link protocol parsing module, a Gige Vision protocol parsing module, and a CLHS protocol parsing module.
- the mating interface includes a plurality of Camera Link interfaces, a plurality of Gige interfaces, and a plurality of CLHS interfaces, and the plurality of Camera Link interfaces and The Camera link protocol parsing module is connected, and the plurality of Gige interfaces are connected to the Gige Vision protocol parsing module, and the plurality of CLHS interfaces are connected to the CLHS protocol parsing module.
- the effective data extraction module 3.2 extracts valid image data portions according to the configuration parameters of the main control unit; the 24-bit data is extracted from the protocol analysis module, and valid data bits are extracted according to the configuration of the main control unit.
- Write DDR data format conversion module 3.3 save the received data to physical memory; format the camera's valid image data, and convert it to AXI4 write Memory data format.
- AXI bus interconnect 3.4 is used to read and write image data to DDR physical memory under the control of the main control unit.
- the DDR control module 3.5 is used to control reading and writing image data.
- DDR physical memory 3.6 for storing raw image data and processing image data.
- the image quality evaluation and pre-processing module 3.7 is configured to read original image data from the DDR physical memory according to the CPU control command, perform image pre-processing on the original image data, and send the pre-processed data to the DDR physical memory for processing.
- Image data, pre-processing includes vignetting correction, brightness correction, AOI area automatic extraction and cutting, perspective transformation, morie pattern removal and other image processing functions; for quality evaluation of camera data according to the control unit control command, quality assessment results Send to the master unit.
- the main control unit 3.8 sends a control command to the image quality evaluation and pre-processing and read DDR data format conversion according to the set instruction; and is configured to send the received configuration parameter, the test command and the quality evaluation result to the automatic registration focus exposure module.
- Register Configuration Module 3.9 completes the relevant register configuration.
- the DDR data format conversion module 3.10 is configured to read raw image data and/or process image data from the DDR physical memory according to the configuration command of the main control unit and send the data to the high speed interface data packet module.
- the high speed interface data packet module 3.11 is configured to send the received raw image data and/or processed image data to the image storage unit and the image computing unit. Used to receive configuration parameters and test commands and send them to the main control unit.
- the automatic registration focus exposure module 3.12 is configured to implement camera parameter setting according to configuration parameters and quality evaluation results, and send configuration parameters and test commands to the camera configuration module.
- the camera configuration module 3.13 is configured to send camera configuration parameters and test commands to the protocol parsing module.
- the data processing flow of the image computing unit is as follows:
- the command includes the tuning command and the image capturing command; the receiving tuning command will enter the tuning mode, and when the image capturing command is received, the normal capturing mode will be entered.
- adjustment mode here the adjustment refers to the camera working distance, focus parameters, exposure parameters, gain parameters, white balance parameters, backlight brightness and other adjustments:
- test standard If the test standard is not met, adjust the working distance of the camera, that is, the alignment, according to the configuration parameters, and then adjust the camera's focal length, exposure time, gain and white balance; then repeat the above actions until the image is satisfied. Testing standards.
- image pre-processing including image correction such as brightness correction, vignetting correction, AOI area extraction and cutting, background suppression, moiré removal, etc.;
- the invention has the ability to manage data acquisition and processing of up to 20 cameras at the same time, greatly optimizes the system complexity of the high-resolution and large-size panel automatic detection system, the Tact Time of the compressed image acquisition, and the stability of the system; It integrates camera automatic alignment, focusing, image quality detection and integration, automatically realizes camera image quality management, and greatly facilitates on-site adjustment; through the self-developed image quality evaluation system, it can quickly realize line body adjustment and image consistency. Good; based on FPGA image storage management system, improve image storage efficiency and facilitate image retrieval; provide necessary source images for machine learning and intelligent detection.
Landscapes
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Immunology (AREA)
- Health & Medical Sciences (AREA)
- Biochemistry (AREA)
- General Health & Medical Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Pathology (AREA)
- Analytical Chemistry (AREA)
- Theoretical Computer Science (AREA)
- Automation & Control Theory (AREA)
- Quality & Reliability (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Robotics (AREA)
- Studio Devices (AREA)
- Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
- Image Processing (AREA)
Abstract
Description
Claims (10)
- 一种基于CPU+GPU+FPGA架构的自动光学检测系统,其特征在于:包括图像存储单元、图像计算单元和图像采集单元,所述图像存储单元具有第一通信接口和第二通信接口,所述图像计算单元具有第一光纤接口、第二光纤接口、第三光纤接口和第四光纤接口,所述图像采集单元具有第三通信接口和相机接口;所述图像存储单元通过第一通信接口向图像计算单元下发配置参数和测试命令、接收图像计算单元发送的测试结果,通过第二通信接口接收采集单元的数据;所述图像计算单元通过第一光纤接口接收图像存储单元发送的配置参数及测试命令、向图像存储单元发送测试结果,通过第二光纤接口接收图像采集单元的数据、向图像采集单元发送配置参数及测试命令,通过第三光纤接口控制点屏信号生成,通过第四光纤接口控制IO光源;所述图像采集单元通过第三通信接口输出图像数据、接收配置参数及测试命令,通过相机接口接收相机数据、向相机发送配置参数和测试命令。
- 根据权利要求1所述的基于CPU+GPU+FPGA架构的自动光学检测系统,其特征在于:所述图像存储单元包括主控PC,用于通过人机交互进行参数配置、输出配置参数及测试命令,用于接收FPGA存储平台的测试结果并上报;FPGA存储平台,用于接收图像采集单元数据、将接收的数据进行无损压缩后发送至磁盘阵列,用于接收图像计算单元的测试结果并输出,用于将接收的配置参数输出至图像采集单元,用于根据存储的数据进行图像数据检索;磁盘阵列,用于存储数据。
- 根据权利要求2所述的基于CPU+GPU+FPGA架构的自动光学检测系统,其特征在于:所述FPGA存储平台包括数据交互模块,用于接收主控PC发送的配置参数,用于将接收的图像计算单元的测试结果反馈至主控PC;图像数据接收/发送模块,用于接收图像采集单元数据并输出至数据无损压缩模块,用于接收配置参数并发送至图像采集模块,用于接收图像计算单元的测试结果;数据无损压缩模块,用于对接收的数据进行无损压缩后经磁盘存储管理单元存储至磁盘阵列;数据磁盘存储管理模块,用于管理磁盘阵列的存储、读取功能。
- 根据权利要求2所述的基于CPU+GPU+FPGA架构的自动光学检测系统,其特征在于:所述FPGA存储平台还包括图像检索管理模块,用于控制读磁盘阵列;图像数据交换控制模块,具有第四通信接口,用于与外部服务器通信,实现图像检索数据交换、数据通信控制。
- 根据权利要求1所述的基于CPU+GPU+FPGA架构的自动光学检测系统,其特征在于:所述图像计算单元包括FPGA计算平台和计算PC,所述第一光纤接口、第二光纤接口、第三光纤接口和第四光纤接口均设置于FPGA计算平台上,FPGA计算平台还具有与所述计算PC连接的第五光纤接口,以及实现FPGA计算平台级联扩展的扩展接口。
- 根据权利要求1或5所述的基于CPU+GPU+FPGA架构的自动光学检测系统,其特征在于:所述FPGA计算平台包括中央控制器、图像处理加速器、数据汇总发送模块和DDR内存,所述中央控制器用于根据设定的指令分别向计算PC和图像处理加速器发送控制命令;所述计算PC,用于根据控制命令从DDR内存中读取部分图像数据进行计算处理并将处理结果发送至数据汇总发送模块;所述图像处理加速器用于根据控制命令从DDR内存中读取部分图像进行计算处理,将计算结果发送至数据汇总发送模块;所述数据汇总发送模块用于将计算PC和图像处理加速器的处理结果进行汇总形成最终的测试结果发送至图像存储模块;所述DDR内存用于存储需要处理的图像数据及测试结果。
- 根据权利要求6所述的基于CPU+GPU+FPGA架构的自动光学检测系统,其特征在于:所述FPGA计算平台还包括接收配置参数模块、数据接收/参数配置模块、信号 扩展模块和IO控制模块,所述接收配置参数模块用于接收配置参数及测试命令并发送至中央控制器;所述中央控制器还用于将接收的配置参数发送至数据接收/参数配置模块,将接收的测试命令分别分配至数据接收/参数配置模块、IO控制模块和信号扩展模块;所述数据接收/参数配置模块用于接收图像采集单元图像数据并存储至DDR内存中,将接收的配置参数及测试命令发送至图像采集单元;所述信号扩展模块用于根据测试命令实现点屏信号生成与控制;所述IO控制模块用于根据测试命令实现IO光源控制。
- 根据权利要求1所述的基于CPU+GPU+FPGA架构的自动光学检测系统,其特征在于:所述图像采集单元包括协议解析模块,用于接收相机数据,并将相机数据按照协议解析出有效的图像数据发送至DDR物理内存中存储为原始图像数据;DDR物理内存,用于存储原始图像数据和处理图像数据;图像质量评估与前处理模块,用于根据主控单元控制命令从DDR物理内存中读取原始图像数据,对原始图像数据进行图像前处理,将前处理后的数据发送至DDR物理内存中存储为处理图像数据;主控单元,根据设定的指令向图像质量评估与前处理和读DDR数据格式转换发送控制命令;读DDR数据格式转换模块,用于根据主控单元的配置命令从DDR物理内存中读取原始图像数据和/或处理图像数据发送至高速接口数据封包模块,高速接口数据封包模块,用于将接收的原始图像数据和/或处理图像数据发送至图像存储单元和图像计算单元。
- 根据权利要求8所述的基于CPU+GPU+FPGA架构的自动光学检测系统,其特征在于,所述图像采集单元还包括自动对位对焦曝光模块和相机配置模块,所述高速接口数据封包模块还用于接收配置参数及测试命令并发送至主控单元;所述协议解析模块还用于接收相机数据,并将相机数据按照协议解析出有效的图像数据发送至DDR物理内存;将相机配置参数发送至相机;所述图像质量评估与前处理模块还用于根据主控单元控制命令对相机数据进行图像采集质量评估,将质量评估结果发送至主控单元,所述主控单元还用于将接收的配置参数、测试命令及质量评估结果发送至自动对位对焦曝光模块;所述自动对位对焦曝光模块,用于根据配置参数及质量评估结果实现相机参数设置,并将配置参数及测试命令发送至相机配置模块;所述相机配置模块,用于将相机配置参数及测试命令发送至协议解析模块。
- 根据权利要求8或9所述的基于CPU+GPU+FPGA架构的自动光学检测系统,其特征在于:所述协议解析模块包括Camera link协议解析模块、Gige Vision协议解析模块和CLHS协议解析模块,所述相接接口包括多个Camera Link接口、多个Gige接口和多个CLHS接口,所述多个Camera Link接口与Camera link协议解析模块连接,所述多个Gige接口与Gige Vision协议解析模块连接,所述多个CLHS接口与CLHS协议解析模块连接。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020207015690A KR102243499B1 (ko) | 2017-10-31 | 2018-08-24 | 중앙 처리 장치와 그래픽 처리 장치와 필드 프로그램 가능 게이트 어레이가 결합된 아키텍처 기반의 자동 광학 탐지 시스템 |
JP2020540625A JP6867555B2 (ja) | 2017-10-31 | 2018-08-24 | Cpu+gpu+fpgaアーキテクチャに基づく自動光学検査システム |
US16/862,610 US11080840B2 (en) | 2017-10-31 | 2020-04-30 | Automatic optical inspection device based on CPU+GPU+FPGA architecture |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201711049462.2A CN107817216B (zh) | 2017-10-31 | 2017-10-31 | 一种基于cpu+gpu+fpga架构的自动光学检测系统 |
CN201711049462.2 | 2017-10-31 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/862,610 Continuation-In-Part US11080840B2 (en) | 2017-10-31 | 2020-04-30 | Automatic optical inspection device based on CPU+GPU+FPGA architecture |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2019085605A1 true WO2019085605A1 (zh) | 2019-05-09 |
Family
ID=61603472
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2018/102154 WO2019085605A1 (zh) | 2017-10-31 | 2018-08-24 | 一种基于cpu+gpu+fpga架构的自动光学检测系统 |
Country Status (6)
Country | Link |
---|---|
US (1) | US11080840B2 (zh) |
JP (1) | JP6867555B2 (zh) |
KR (1) | KR102243499B1 (zh) |
CN (1) | CN107817216B (zh) |
TW (1) | TWI713907B (zh) |
WO (1) | WO2019085605A1 (zh) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114363541A (zh) * | 2021-11-15 | 2022-04-15 | 中国科学院西安光学精密机械研究所 | 一种用于立方体卫星的小型化cmos成像系统及方法 |
CN115509974A (zh) * | 2022-08-03 | 2022-12-23 | 中勍科技股份有限公司 | 一种基于fpga光纤数据收发处理的方法 |
Families Citing this family (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107817216B (zh) * | 2017-10-31 | 2020-06-02 | 武汉精测电子集团股份有限公司 | 一种基于cpu+gpu+fpga架构的自动光学检测系统 |
CN108804376B (zh) * | 2018-06-14 | 2021-11-19 | 山东航天电子技术研究所 | 一种基于gpu和fpga的小型异构处理系统 |
CN109286749B (zh) * | 2018-09-18 | 2020-12-08 | 中国科学院自动化研究所 | 高带宽图像采集、预处理和分发系统及图像处理系统 |
CN111402190B (zh) * | 2018-12-28 | 2023-06-09 | 上海尤图智能科技有限公司 | 一种用于线材在线检测的图像处理装置和系统 |
TWI693386B (zh) * | 2019-05-09 | 2020-05-11 | 聯策科技股份有限公司 | 取像參數最佳化調整系統與方法 |
JP7348754B2 (ja) * | 2019-06-03 | 2023-09-21 | キヤノン株式会社 | 画像処理装置及びその制御方法、プログラム、記憶媒体 |
CN112148470B (zh) * | 2019-06-28 | 2022-11-04 | 富联精密电子(天津)有限公司 | 参数同步方法、计算机装置及可读存储介质 |
CN110766600B (zh) * | 2019-12-26 | 2020-05-22 | 武汉精立电子技术有限公司 | 一种分布式架构的图像处理系统 |
TWI825289B (zh) * | 2020-03-13 | 2023-12-11 | 竑騰科技股份有限公司 | 自動光學檢測設備的控制系統 |
CN111787315A (zh) * | 2020-08-05 | 2020-10-16 | 昆山软龙格自动化技术有限公司 | 一种基于fpga的嵌入式高速运算网卡装置 |
CN112148670B (zh) * | 2020-10-19 | 2023-12-19 | 北京大地信合信息技术有限公司 | 多功能业务板卡以及数据处理方法 |
CN112506720A (zh) * | 2020-11-20 | 2021-03-16 | 苏州华兴源创科技股份有限公司 | 一种基于fpga的显示模组测试的驱动装置、系统及方法 |
CN112672142B (zh) * | 2020-12-16 | 2022-04-15 | 长光卫星技术股份有限公司 | 一种反馈式图像质量补偿校正自动化判定系统及方法 |
CN112804443A (zh) * | 2020-12-29 | 2021-05-14 | 中国科学院半导体研究所 | 图像处理方法及应用其的高速智能相机 |
CN113156855A (zh) * | 2021-04-07 | 2021-07-23 | 杭州永谐科技有限公司成都分公司 | 一种微型数据采集处理系统 |
CN113472964B (zh) * | 2021-06-05 | 2024-04-16 | 山东英信计算机技术有限公司 | 一种图像处理装置和系统 |
CN113865826B (zh) * | 2021-08-31 | 2024-04-09 | 广东省威汇智能科技有限公司 | 一种显示屏模组检测装置以及检测系统 |
CN114726927A (zh) * | 2021-11-30 | 2022-07-08 | 武汉卓目科技有限公司 | 一种Coaxpress高速图像接口与光纤传输接口的转换系统及方法 |
CN115942072B (zh) * | 2022-11-21 | 2024-07-16 | 北京航空航天大学 | 一种双处理器架构下的任意曝光时长图像采集装置及方法 |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1621866A1 (en) * | 2004-07-22 | 2006-02-01 | Lockheed Martin Corporation | Tribological debris analysis system |
KR20150111057A (ko) * | 2014-03-25 | 2015-10-05 | 구충열 | 액정디스플레이 검사용 이미지패턴 업로딩장치와 그 방법 |
CN105607312A (zh) * | 2016-01-22 | 2016-05-25 | 武汉精测电子技术股份有限公司 | 用于lcd液晶模组缺陷检测的光学自动检测装置及方法 |
US20160292839A1 (en) * | 2015-04-01 | 2016-10-06 | Nuflare Technology, Inc. | Inspection method, inspection apparatus, and inspection system |
CN107144992A (zh) * | 2017-06-23 | 2017-09-08 | 武汉精测电子技术股份有限公司 | 基于aoi技术的全自动化lcd检测控制系统及方法 |
CN107273331A (zh) * | 2017-06-30 | 2017-10-20 | 山东超越数控电子有限公司 | 一种基于cpu+gpu+fpga架构的异构计算系统和方法 |
CN107817216A (zh) * | 2017-10-31 | 2018-03-20 | 武汉精测电子技术股份有限公司 | 一种基于cpu+gpu+fpga架构的自动光学检测系统 |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4616864B2 (ja) * | 2007-06-20 | 2011-01-19 | 株式会社日立ハイテクノロジーズ | 外観検査方法及びその装置および画像処理評価システム |
US8872912B2 (en) * | 2009-09-22 | 2014-10-28 | Cyberoptics Corporation | High speed distributed optical sensor inspection system |
US8670031B2 (en) * | 2009-09-22 | 2014-03-11 | Cyberoptics Corporation | High speed optical inspection system with camera array and compact, integrated illuminator |
US20120133920A1 (en) * | 2009-09-22 | 2012-05-31 | Skunes Timothy A | High speed, high resolution, three dimensional printed circuit board inspection system |
CN105260339A (zh) * | 2015-08-17 | 2016-01-20 | 中南大学 | 一种基于Xilinx Zynq技术的大规模PLC系统 |
US10429321B2 (en) * | 2016-08-29 | 2019-10-01 | Kla-Tencor Corporation | Apparatus for high-speed imaging sensor data transfer |
-
2017
- 2017-10-31 CN CN201711049462.2A patent/CN107817216B/zh active Active
-
2018
- 2018-08-24 WO PCT/CN2018/102154 patent/WO2019085605A1/zh active Application Filing
- 2018-08-24 KR KR1020207015690A patent/KR102243499B1/ko active IP Right Grant
- 2018-08-24 JP JP2020540625A patent/JP6867555B2/ja active Active
- 2018-10-04 TW TW107135049A patent/TWI713907B/zh active
-
2020
- 2020-04-30 US US16/862,610 patent/US11080840B2/en active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP1621866A1 (en) * | 2004-07-22 | 2006-02-01 | Lockheed Martin Corporation | Tribological debris analysis system |
KR20150111057A (ko) * | 2014-03-25 | 2015-10-05 | 구충열 | 액정디스플레이 검사용 이미지패턴 업로딩장치와 그 방법 |
US20160292839A1 (en) * | 2015-04-01 | 2016-10-06 | Nuflare Technology, Inc. | Inspection method, inspection apparatus, and inspection system |
CN105607312A (zh) * | 2016-01-22 | 2016-05-25 | 武汉精测电子技术股份有限公司 | 用于lcd液晶模组缺陷检测的光学自动检测装置及方法 |
CN107144992A (zh) * | 2017-06-23 | 2017-09-08 | 武汉精测电子技术股份有限公司 | 基于aoi技术的全自动化lcd检测控制系统及方法 |
CN107273331A (zh) * | 2017-06-30 | 2017-10-20 | 山东超越数控电子有限公司 | 一种基于cpu+gpu+fpga架构的异构计算系统和方法 |
CN107817216A (zh) * | 2017-10-31 | 2018-03-20 | 武汉精测电子技术股份有限公司 | 一种基于cpu+gpu+fpga架构的自动光学检测系统 |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114363541A (zh) * | 2021-11-15 | 2022-04-15 | 中国科学院西安光学精密机械研究所 | 一种用于立方体卫星的小型化cmos成像系统及方法 |
CN114363541B (zh) * | 2021-11-15 | 2024-02-02 | 中国科学院西安光学精密机械研究所 | 一种用于立方体卫星的小型化cmos成像系统及方法 |
CN115509974A (zh) * | 2022-08-03 | 2022-12-23 | 中勍科技股份有限公司 | 一种基于fpga光纤数据收发处理的方法 |
CN115509974B (zh) * | 2022-08-03 | 2023-06-20 | 中勍科技股份有限公司 | 一种基于fpga光纤数据收发处理的方法 |
Also Published As
Publication number | Publication date |
---|---|
CN107817216B (zh) | 2020-06-02 |
KR102243499B1 (ko) | 2021-04-21 |
US20200258210A1 (en) | 2020-08-13 |
TWI713907B (zh) | 2020-12-21 |
US11080840B2 (en) | 2021-08-03 |
JP6867555B2 (ja) | 2021-04-28 |
TW201919000A (zh) | 2019-05-16 |
CN107817216A (zh) | 2018-03-20 |
JP2021501330A (ja) | 2021-01-14 |
KR20200080295A (ko) | 2020-07-06 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2019085605A1 (zh) | 一种基于cpu+gpu+fpga架构的自动光学检测系统 | |
CN102202171A (zh) | 一种嵌入式高速多通道图像采集与存储系统 | |
CN107817217B (zh) | 一种适用于lcm自动光学检测的图像加速处理系统 | |
CN107907867A (zh) | 一种多工作模式的实时sar快视系统 | |
CN102148922B (zh) | 一种电子设备、图像采集装置及图像采集控制方法 | |
CN111090603B (zh) | 一种lvds转usb3.0适配器 | |
CN103986869A (zh) | 一种高速tdiccd遥感相机图像采集与显示装置 | |
CN109714621A (zh) | 一种时序可配置的多路动态视频模拟方法及其处理系统 | |
CN107830990A (zh) | 一种基于fpga平台的自动光学检测系统 | |
CN110620920A (zh) | 车载摄像头测试装置及车载摄像头测试系统 | |
CN110730304B (zh) | 一种加速图像采集和显示的智能相机 | |
CN106454023B (zh) | Usb3.0cmos线阵工业相机 | |
CN110766600B (zh) | 一种分布式架构的图像处理系统 | |
CN113038138A (zh) | 一种嵌入式图像处理及回传系统 | |
CN104458206A (zh) | 基于labview的图像传感器测试系统 | |
CN110069435B (zh) | 基于usb3.0转sccb的多摄像模组配置方法 | |
CN115766901A (zh) | 一种图像传感器的数据传输设备及方法 | |
CN108924460A (zh) | 一种图像数据采集盒以及图像采集系统 | |
CN214205739U (zh) | 一种光电平台用基于fpga的通用型高清显示系统 | |
CN212230036U (zh) | 显示面板检测装置及系统 | |
CN209311350U (zh) | 一种基于以太网传输的流水线光学缺陷检测系统 | |
CN110572612A (zh) | 一种医用3d影像显示系统 | |
CN206164677U (zh) | Usb3.0cmos线阵工业相机 | |
CN109710551A (zh) | 一种基于fmc标准的注入式仿真系统 | |
CN211505255U (zh) | 显示面板检测装置及系统 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 18872334 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2020540625 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 20207015690 Country of ref document: KR Kind code of ref document: A |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 18872334 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 02/11/2020) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 18872334 Country of ref document: EP Kind code of ref document: A1 |