WO2023045038A1 - 一种融合云端的产品分拣系统及方法 - Google Patents

一种融合云端的产品分拣系统及方法 Download PDF

Info

Publication number
WO2023045038A1
WO2023045038A1 PCT/CN2021/128475 CN2021128475W WO2023045038A1 WO 2023045038 A1 WO2023045038 A1 WO 2023045038A1 CN 2021128475 W CN2021128475 W CN 2021128475W WO 2023045038 A1 WO2023045038 A1 WO 2023045038A1
Authority
WO
WIPO (PCT)
Prior art keywords
unit
product
detection
workpiece
cloud
Prior art date
Application number
PCT/CN2021/128475
Other languages
English (en)
French (fr)
Inventor
罗一星
李思迪
曾钰洋
吴崇林
谢泽楷
夏咏琪
王红志
Original Assignee
深圳技术大学
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳技术大学 filed Critical 深圳技术大学
Publication of WO2023045038A1 publication Critical patent/WO2023045038A1/zh

Links

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B07—SEPARATING SOLIDS FROM SOLIDS; SORTING
    • B07C—POSTAL SORTING; SORTING INDIVIDUAL ARTICLES, OR BULK MATERIAL FIT TO BE SORTED PIECE-MEAL, e.g. BY PICKING
    • B07C5/00—Sorting according to a characteristic or feature of the articles or material being sorted, e.g. by control effected by devices which detect or measure such characteristic or feature; Sorting by manually actuated devices, e.g. switches
    • B07C5/34—Sorting according to other particular properties
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/70—Denoising; Smoothing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0004—Industrial image inspection
    • G06T7/0006—Industrial image inspection using a design-rule based approach
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/10—Segmentation; Edge detection
    • G06T7/13—Edge detection
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/60—Analysis of geometric attributes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20172—Image enhancement details
    • G06T2207/20192—Edge enhancement; Edge preservation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30108—Industrial image inspection
    • G06T2207/30164—Workpiece; Machine component

Definitions

  • the invention relates to the technical field of product sorting, in particular to a cloud-integrated product sorting system and method.
  • Sorting operation is an important link in most assembly lines. Objects to be sorted are continuously sent into the sorting work area.
  • the object to be sorted refers to the product that has not been determined and will be identified and sorted.
  • the objects to be sorted enter the sorting work area along with the conveyor belt.
  • the product inspection technology in the sorting area of the existing production line still uses manual inspection methods. Obviously, the speed of manual inspection is at an absolute disadvantage compared with the production speed of automated production lines. Most of the time, only sampling inspections can be performed on products, which cannot effectively guarantee product quality. Many small and medium-sized factories are still Use purely manual methods to test products, and let front-line workers use testing equipment to test whether the quality of products is qualified.
  • the traditional method is to monitor the feedback data manually on site in real time, which is not only unintuitive, but also prone to missing and missed judgments due to brain fatigue.
  • a product sorting system and method integrated with the cloud is proposed.
  • the machine vision algorithm By using the machine vision algorithm, the workpiece products on the production line are identified, and the defective products and qualified products are classified and placed, which solves the problem in the existing manual inspection process.
  • the existing problems of misjudgment and low detection efficiency reduce labor costs.
  • users Through real-time monitoring of the operation of sorting system equipment, users can connect to the cloud platform through mobile terminals to monitor the operating status of equipment anytime and anywhere, which improves the efficiency of the production line. degree of automation.
  • a cloud-integrated product sorting system for testing and sorting products including:
  • the image acquisition unit is used to acquire the product image of the workpiece on the assembly line, and transmit the product image to the identification unit;
  • the identification unit is used to perform defect detection on the product image according to a computer vision algorithm and using detection parameters, and transmit the detection result to the sorting device;
  • the sorting device classifies and places the workpiece products according to the detection results
  • the central control unit is connected with each unit for processing data information according to an algorithm and outputting control instructions;
  • the detection parameters include one or more of a detection level, a detection template, a detection area, a binarization threshold, and statistics of abnormal points.
  • the sorting system further includes:
  • the monitoring unit is used to monitor the operation of the system equipment in real time and send the monitoring video data to the cloud platform;
  • the operation monitoring unit is used to monitor system equipment operation information, and send the operation equipment information to the cloud platform;
  • the cloud platform is used to send real-time operation information of system equipment to the user according to the operation information and monitoring video according to the user request for remote monitoring.
  • the cloud platform includes:
  • the storage unit is used to store the workpiece product detection result data, system equipment operation data and operation monitoring video data sent from the system;
  • the virtual simulation unit is used for virtual simulation of system equipment operation data
  • the comparative analysis unit is used to compare and analyze the operation monitoring video and the virtual simulation image corresponding to the operation data, and send early warning information to the user according to the analysis result;
  • the digital analysis unit is used to analyze the operating data of the system equipment, extract the operating parameters of the equipment, and send the operating parameters of the equipment to the system end or the user terminal for display;
  • the communication unit is used for network communication between the system equipment and the cloud platform, and between the cloud platform and the user terminal for data transmission.
  • the cloud platform further includes:
  • the management unit is used to manage the storage resources of the storage unit, deploy a distributed file management system, store the received user data in slices with a set protection strategy, and manage the stored user data.
  • the image acquisition unit includes:
  • the coaxial light source unit is used for irradiating the coaxial light source to the workpiece product through reflection, so as to overcome the reflection interference on the surface of the workpiece product.
  • a product sorting method integrated with the cloud uses the sorting system in the first aspect to sort workpiece products, including:
  • Step 100 irradiating a coaxial light source to the workpiece product on the assembly line to obtain an image of the workpiece product
  • Step 200 performing defect detection on the product image according to computer vision algorithms and using detection parameters
  • Step 300 classifying and placing the workpiece products according to the detection results
  • the detection parameters include one or more of a detection level, a detection template, a detection area, a binarization threshold, and statistics of abnormal points.
  • the method further includes:
  • Step 400 cloud-storing the detection result data, system equipment operation data and operation monitoring video data
  • Step 500 according to the operation information and monitoring video, and according to the user's request, send the real-time operation information of the system equipment to the user for remote monitoring.
  • the step 200 includes:
  • Step 210 mapping the workpiece product image to a set detection level
  • Step 220 determining the detection area according to the detection template
  • Step 230 performing binarization processing on the product image and the detection template in the detection area to obtain a binarized difference
  • Step 240 comparing the binarization difference with the binarization threshold to obtain the number of abnormal points
  • Step 250 comparing the number of abnormal points with an abnormal threshold, and determining whether the workpiece has a defect according to the comparison result.
  • the step 230 includes:
  • Step 231 smoothing and filtering the product image in the detection area to filter noise
  • Step 232 performing grayscale processing on the product image to obtain a grayscale image of the workpiece product
  • Step 233 performing binarization processing on the grayscale image of the workpiece product.
  • the step 200 further includes:
  • Step 260 using the canny edge detection operator to detect the edge of the workpiece product to obtain the contour edge of the workpiece product;
  • Step 270 calling a polygon approximation operator and a smoothing filter operator to respectively correct and filter the contour shape of the edge, and obtain the number of vertices and the angle range of the contour edge;
  • Step 280 according to the number of vertices and their angle ranges, combined with the pixel size of the camera, the size of the workpiece is obtained.
  • Fig. 1 is a schematic diagram of an embodiment of a product sorting system fused with cloud in the present invention
  • Fig. 2 is a schematic diagram of an embodiment of a cloud platform in a product sorting system fused with the cloud in the present invention
  • Fig. 3 is a schematic diagram of the first embodiment of a product sorting method integrated with the cloud in the present invention
  • Fig. 4 is a schematic diagram of a second embodiment of a product sorting method integrated with the cloud in the present invention.
  • Fig. 5 is a schematic diagram of a third embodiment of a product sorting method integrated with the cloud in the present invention.
  • Fig. 6 is a schematic diagram of a fourth embodiment of a product sorting method integrated with the cloud in the present invention.
  • Fig. 7 is a schematic diagram of a fifth embodiment of a product sorting method integrated with the cloud in the present invention.
  • 110 central control unit
  • 120 image acquisition unit
  • 130 monitoring unit
  • 140 operation monitoring unit
  • 150 identity unit
  • 160 point Picking device
  • 170 cloud platform
  • 171 storage unit
  • 172 virtual simulation unit
  • 173 management unit
  • 174 comparative analysis unit
  • 175 communication unit
  • 176 digital analysis unit
  • 180 terminal.
  • FIG. 1 is a schematic diagram of an embodiment of a cloud-integrated product sorting system in the present invention, which is used to detect and sort production line workpiece products, including: image acquisition Unit 120, recognition unit 150, sorting device 160 and central control unit 110; image acquisition unit 120 is used to obtain the image of workpiece product on the assembly line, and transmits the product image to recognition unit 150; recognition unit 150 is used for according to computer vision algorithm and Use the detection parameters to detect defects on the product image, and transmit the detection results to the sorting device; the sorting device 160 classifies and places the workpiece products according to the detection results; the central control unit 110 is connected to each unit for processing data information according to the algorithm And output control instructions; wherein, the detection parameters include one or more of detection level, detection template, detection area, binarization threshold, and statistics of abnormal points.
  • the detection parameters include one or more of detection level, detection template, detection area, binarization threshold, and statistics of abnormal points.
  • the machine vision algorithm By using the machine vision algorithm to identify the workpiece products on the production line, the defective products and qualified products are classified and placed, which solves the problems of misjudgment and low detection efficiency in the existing manual detection process, and reduces labor costs.
  • the detection level can include RGB monochrome level, HSV monochrome level, Laplace transform level, Fourier transform level, and gradient level.
  • the detection module refers to the real image of a good or qualified product. By calculating the number of connected domains, the maximum The number of abnormal points in the connected domain points is compared with the threshold to determine whether there is a defect.
  • the sorting system also includes monitoring unit 130, operation monitoring unit 140 and cloud platform 170;
  • the unit 140 is used to monitor system equipment operation information, and send the operation equipment information to the cloud platform 170;
  • the cloud platform 170 is used to send real-time operation information of the system equipment to the user according to the operation information and monitoring video, and according to the user's request, for remote monitoring .
  • Figure 2 is a schematic diagram of an embodiment of a cloud platform in a product sorting system that integrates the cloud in the present invention
  • the cloud platform 170 includes a storage unit 171, a virtual simulation unit 172, and a comparative analysis unit 174 , a digital analysis unit 176 and a communication unit 175
  • the storage unit 171 is used to store the workpiece product detection result data sent from the system, the system equipment operation data and the operation monitoring video data
  • the virtual simulation unit 172 is used to perform virtual simulation on the system equipment operation data
  • the comparative analysis unit 174 is used to compare and analyze the virtual simulation image of the operation monitoring video and its corresponding operation data, and send early warning information to the user according to the analysis results
  • the digital analysis unit 176 is used to analyze the system equipment operation data and extract equipment operation parameters , and send the device operating parameters to the system or user terminal for display
  • the communication unit 175 is used for network communication between the system device and the cloud platform 170, and between the cloud platform 170 and the user terminal for data
  • the video combined with virtual reality is transmitted to the storage unit 171 of the cloud platform 170, and the user can read the video through the webpage.
  • Configure the webpage as follows: open the webpage to display the digital twin video, and the comparison and analysis unit 174 will still compare the virtual simulation with the actual operation of the system equipment. If there is an inconsistency between the virtual simulation and the actual operation of the system equipment, the cloud platform 170 will send Alert, requesting human intervention. In this way, not only the function of remote monitoring system equipment operation can be realized, but also the occupation of less memory and less bandwidth can be realized.
  • the storage unit 171 is the basis of cloud storage. Cloud storage relies on the storage unit 171 to interconnect different storage devices to form a service-oriented distributed storage system. Above the physical storage device is a unified storage management unit 173, which can implement functions such as logical virtualization management, status monitoring and maintenance of the physical storage device.
  • the recognition result Recognize the image of each product, get the recognition result, and make an overall analysis of the product within a period of time, which can be made into a pie chart with excellent visualization.
  • the database configured on the cloud server
  • the pie chart of the recognition result is transmitted to the database, and the images of the workpieces are arranged in sequence according to the order of the workpieces, without overlay processing, so as to facilitate subsequent yield calculation and inspection.
  • the pie chart of the recognition result can be displayed on the webpage, and the management personnel can query the cloud through the terminal 180 or PC to check the operation status of the sorting system in real time.
  • users can connect to the cloud platform 170 through the terminal 180 to monitor the operating status of the equipment anytime and anywhere, which improves the automation of the production line.
  • the cloud platform 170 also includes a management unit 173; the management unit 173 is used to manage the storage resources of the storage unit 171, deploy a distributed file management system, and process the received user data with a set protection policy. Fragmented storage and management of stored user data.
  • the main function of the management unit 173 is to deploy a distributed file system on the storage resources provided by the storage layer, or to establish and organize storage resource objects, and to perform fragmentation processing on user data, and to divide the fragmented data into Multiple copies or redundant erasure codes are distributed and stored on specific storage resources.
  • this layer will also perform tasks such as read-write load balancing scheduling among nodes, business scheduling and data reconstruction and recovery after node or storage resource failure, so as to always provide high-performance and high-availability access services.
  • the function of this layer can also be moved up, located between the access interface layer and the application service layer, or even directly embedded in the application service layer, and closely integrated with business applications to form a business-specific cloud storage.
  • the cloud platform 170 also includes a licensing unit. On any machine connected to the Internet, as long as the user is authorized, he can enter the cloud storage platform system to perform authorized operations on the cloud storage and enjoy Various services brought by cloud storage.
  • the image acquisition unit 120 includes a coaxial light source unit; the coaxial light source unit is used to irradiate the workpiece product with the coaxial light source through reflection, so as to overcome the reflection interference on the surface of the workpiece product.
  • the light on the uneven object surface will be reflected obliquely to other places, and the image will appear dark. Only the flat object surface can better reflect the light into the lens. Therefore, using a coaxial light source to emit coaxial light can highlight the uneven surface of the object and overcome the interference caused by surface reflection. It can be used to detect bumps, scratches, cracks and foreign objects on the flat and smooth surface of objects. It is preferably used for objects with high reflectivity, such as scratch detection on the surface of metal, glass, film, wafer, etc., damage detection of chip and silicon wafer, packaging barcode recognition, etc.
  • FIG. 3 is a schematic diagram of a first embodiment of a cloud-integrated product sorting method in the present invention, using the sorting system of the first aspect to sort workpiece products, include:
  • Step 100 irradiating a coaxial light source to the workpiece product on the assembly line to obtain the image of the workpiece product;
  • Step 200 performing defect detection on the product image according to the computer vision algorithm and using detection parameters;
  • Step 300 classifying and placing the workpiece product according to the detection result;
  • the detection parameters include one or more of a detection level, a detection template, a detection area, a binarization threshold, and statistics on the number of abnormal points.
  • Fig. 4 is a schematic diagram of a second embodiment of a cloud-integrated product sorting method in the present invention, the method also includes:
  • Step 400 cloud storage of test result data, system equipment operation data, and operation monitoring video data;
  • Step 500 sending system equipment real-time operation information to the user according to the operation information and monitoring video, and according to the user's request, for remote monitoring.
  • step 200 includes:
  • Step 210 map the workpiece product image to the set detection level; step 220, determine the detection area according to the detection template; step 230, perform binarization processing on the product image and detection template in the detection area, and obtain the binarization difference ; Step 240, compare the binarization difference with the binarization threshold to obtain the number of abnormal points; Step 250, compare the number of abnormal points with the abnormal threshold, and determine whether the workpiece product is defective according to the comparison result.
  • step 230 includes: Step 231, smoothing and filtering the product images in the detection area , to filter the noise; step 232, perform grayscale processing on the product image, and obtain the grayscale image of the workpiece product; step 233, perform binarization processing on the grayscale image of the workpiece product.
  • FIG. 7 is a schematic diagram of a fifth embodiment of a product sorting method integrated with the cloud in the present invention.
  • Step 200 also includes:
  • Step 260 use the canny edge detection operator to detect the edge of the workpiece product, and obtain the contour edge of the workpiece product;
  • Step 270 call the polygon approximation operator and the smoothing filter operator to correct and filter the shape of the edge contour respectively, and obtain the vertex of the contour edge Number and its angle range;
  • step 280 according to the number of vertices and its angle range, combined with the pixel size of the camera, obtain the size of the workpiece product.
  • a cloud-integrated product sorting system and method of the present invention by using machine vision algorithms to identify workpiece products on the production line, and classify and place defective products and qualified products, it solves the problems existing in the existing manual inspection process. Misjudgments and low detection efficiency have reduced labor costs.
  • users can connect to the cloud platform 170 through the terminal 180 to monitor the operating status of the equipment anytime and anywhere, improving the efficiency of the production line. degree of automation.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Quality & Reliability (AREA)
  • Geometry (AREA)
  • Image Processing (AREA)

Abstract

一种融合云端的产品分拣系统及分拣方法，用于对产品进行检测、分拣。系统包括图像获取单元（120）、识别单元（150）、分拣装置（160）、中央控制单元（110）；图像获取单元（120）用于获取流水线上工件产品图像，并将产品图像传输到识别单元（150）；识别单元（150）用于根据计算机视觉算法并利用检测参数对产品图像进行缺陷检测，并将检测结果传输到分拣装置（160）；分拣装置（160）根据检测结果将工件产品进行分类放置；中央控制单元（110）与各个单元连接，用于根据算法处理数据信息并输出控制指令。系统解决了现有人工检测过程中存在的误判、检测效率低的问题，降低了人力成本，通过对分拣系统设备的运行进行实时监控，提高了产线的自动化程度。

Description

一种融合云端的产品分拣系统及方法 技术领域
本发明涉及产品分拣技术领域，特别涉及一种融合云端的产品分拣系统及方法。
 背景技术
目前自动化生产线平台中，将产品输送到分拣平台后，需要将合格产品与不合格产品分开。分拣作业是大多数流水生产线上的一个重要环节。待分拣对象被不断地送入分拣作业区。待分拣对象是指未被确定是何种产品，将要被执行识别和分拣的产品。待分拣对象随着传送带进入分拣作业区。
现有产线分拣区的产品检测技术则依旧使用人工检测的方法比较多。很显然人工检测的速度和自动化生产线的生产速度相比时处于绝对的劣势，大多数时候只能对产品进行抽样检查，并不能有效地做到对产品质量的保障，很多中小型工厂，依旧是使用纯人工的方式对产品进行检测，让一线的工人使用测试仪器来检测产品的质量是否合格。
在对合格产品的分拣过程中，通常依赖检测者的经验，耗时费力，且无法形成客观严谨的评判，其检测结果存在较大的差异。并且传统的人工检测较难满足大批量生产时的质检效率要求，在大批量检测与分拣时所需的人工成本较高。人工检测会因为长时间的肉眼观察而产生视觉疲劳，更易产生误判，从而影响检测结果，且人存在情绪化等不确定因素。
另外，在设备运行监测与预警方面，传统的做法是通过人工在现场对反馈数据进行实时监测，这样不仅不直观，还易因大脑的疲劳而导致缺判、漏判的现象发生。
综上所述，现有产品线的分拣流程中，在产品检测、设备运行预警与监控时，工作效率低，自动化程度低，且容易出现误判。
 技术问题
现有产品线的分拣流程中，在产品检测、设备运行预警与监控时，工作效率低，自动化程度低，且容易出现误判。
 技术解决方案
针对上述问题，提出一种融合云端的产品分拣系统及方法，通过利用机器视觉算法，对产线上的工件产品进行识别，将缺陷产品与合格产品分类放置，解决了现有人工检测过程中存在的误判、检测效率低的问题，降低了人力成本，通过对分拣系统设备的运行进行实时监控，用户可以通过移动终端连接云平台，随时随地监控设备的运行状态，提高了产线的自动化程度。
一种融合云端的产品分拣系统，用于对产品进行检测、分拣，包括：
图像获取单元；
识别单元；
分拣装置；
中央控制单元；
所述图像获取单元用于获取流水线上工件产品图像，并将所述产品图像传输到所述识别单元；
所述识别单元用于根据计算机视觉算法并利用检测参数对所述产品图像进行缺陷检测，并将检测结果传输到所述分拣装置；
所述分拣装置根据所述检测结果将所述工件产品进行分类放置；
所述中央控制单元与各个单元连接，用于根据算法处理数据信息并输出控制指令；
其中，所述检测参数包括检测层面、检测模板、检测区域、二值化阈值、异常点数统计中的一种或者多种。
结合本发明所述的融合云端的产品分拣系统，第一种可能实施方式中，所述分拣系统还包括：
监控单元；
运行监测单元；
云平台；
所述监控单元用于对系统设备运行进行实时监控并将监控视频数据发送到所述云平台；
所述运行监测单元用于监测系统设备运行信息，并将运行设备信息发送到所述云平台；
所述云平台用于根据所述运行信息及监控视频，并根据用户请求向用户发送系统设备实时运行信息，以进行远程监控。
结合本发明第一种可能实施方式，第二种可能的实施方式中，所述云平台包括：
存储单元；
虚拟仿真单元；
对比分析单元；
数字分析单元；
通信单元；
所述存储单元用于存储从系统发送的工件产品检测结果数据、系统设备运行数据及运行监控视频数据；
所述虚拟仿真单元用于对系统设备运行数据进行虚拟仿真；
所述对比分析单元用于将所述运行监控视频与其对应运行数据的虚拟仿真影像进行对比分析，根据分析结果向用户发送预警信息；
所述数字分析单元用于对系统设备运行数据进行分析，抽取设备运行参数，并将所述设备运行参数发送到系统端或者用户终端进行显示；
所述通信单元用于系统设备与云平台、云平台与用户终端之间的网络通信，以进行数据传输。
结合本发明第二种可能实施方式，第三种可能的实施方式中，所述云平台还包括：
管理单元；
所述管理单元用于对所述存储单元的存储资源进行管理，部署分布式文件管理系统，以设定的保护策略将接收的用户数据进行分片化存储，并对存储的用户数据进行管理。
结合本发明第三种可能实施方式，第四种可能的实施方式中，所述图像获取单元包括：
同轴光源单元；
所述同轴光源单元用于通过反射向工件产品照射同轴光源，以克服工件产品表面的反光干扰。
第二方面，一种融合云端的产品分拣方法，利用第一方面的分拣系统对工件产品进行分拣，包括：
步骤100、向流水线上工件产品照射同轴光源，获取工件产品图像；
步骤200、根据计算机视觉算法并利用检测参数对所述产品图像进行缺陷检测；
步骤300、根据所述检测结果将所述工件产品进行分类放置；
其中，所述检测参数包括检测层面、检测模板、检测区域、二值化阈值、异常点数统计中的一种或者多种。
结合第二方面所述的分拣方法，第一种可能的实施方式中，所述方法还包括：
步骤400、对检测结果数据、系统设备运行数据及运行监控视频数据进行云存储；
步骤500、根据运行信息及监控视频，并根据用户请求向用户发送系统设备实时运行信息，以进行远程监控。
结合第二方面第一种可能的实施方式，第二种可能的实施方式中，所述步骤200包括：
步骤210、将所述工件产品图像映射到设定的检测层面；
步骤220、根据检测模板确定检测区域；
步骤230、对检测区域内的产品图像及检测模板进行二值化处理，获取二值化差值；
步骤240、将所述二值化差值与二值化阈值进行比较，获取异常点数；
步骤250、将所述异常点数与异常阈值进行比较，并根据比较结果确定所述工件产品是否存在缺陷。
结合第二方面第二种可能的实施方式，第三种可能的实施方式中，所述步骤230包括：
步骤231、对对检测区域内的产品图像进行平滑滤波，以过滤噪声；
步骤232、将产品图像进行灰度处理，获取工件产品灰度图；
步骤233、对所述工件产品灰度图进行二值化处理。
结合第二方面第三种可能的实施方式，第四种可能的实施方式中，所述步骤200还包括：
步骤260、利用canny边缘检测算子对工件产品边缘进行检测，获取工件产品轮廓边缘；
步骤270、调用多边形逼近算子及平滑滤波算子分别对所述边缘轮廓形状进行矫正、滤波，获取所述轮廓边缘的顶点数目及其角度范围；
步骤280、根据所述顶点数目及其角度范围，结合相机的像素尺寸，获取工件产品的尺寸。
实施本发明所述的一种融合云端的产品分拣系统及方法，通过利用机器视觉算法，对产线上的工件产品进行识别，将缺陷产品与合格产品分类放置，解决了现有人工检测过程中存在的误判、检测效率低的问题，降低了人力成本，通过对分拣系统设备的运行进行实时监控，用户可以通过移动终端连接云平台，随时随地监控设备的运行状态，提高了产线的自动化程度。
 附图说明
为了更清楚地说明本发明实施例中的技术方案，下面将对实施例描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1是本发明中一种融合云端的产品分拣系统实施例示意图；
图2是本发明中一种融合云端的产品分拣系统中云平台实施例示意图；
图3是本发明中一种融合云端的产品分拣方法第一实施例示意图；
图4是本发明中一种融合云端的产品分拣方法第二实施例示意图；
图5是本发明中一种融合云端的产品分拣方法第三实施例示意图；
图6是本发明中一种融合云端的产品分拣方法第四实施例示意图；
图7是本发明中一种融合云端的产品分拣方法第五实施例示意图；
附图中各数字所指代的部位名称为：110——中央控制单元、120——图像获取单元、130——监控单元、140——运行监测单元、150——识别单元、160——分拣装置、170——云平台、171——存储单元、172——虚拟仿真单元172、173——管理单元、174——对比分析单元、175——通信单元、176——数字分析单元、180——终端。
 本发明的实施方式
下面将结合发明中的附图，对本发明中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明的一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有付出创造性劳动前提下所获得的其他实施例，都属于本发明保护的范围。
说明书中对“一个实施例”或“一实施例”的参考意味着在本发明的至少一个实施例中可包括结合所述实施例描述的特定特征、结构或特性。在说明书的各种地方中出现短语“在一个实施例中”未必全部指代同一实施例。由包含硬件( 例如，电路、专用逻辑等)、软件或两者的组合的处理逻辑来执行在以下图式中所描绘的过程。虽然下文中根据一些顺序操作来描述所述过程，但应了解，所描述的一些操作可按不同次序来执行。此外，一些操作可并行地而非顺序地来执行。
应当理解，当在本说明书和所附权利要求书中使用时，术语“包括”和 “包含”指示所描述特征、整体、步骤、操作、元素和/或组件的存在，但并不排除一个或多个其它特征、整体、步骤、操作、元素、组件和/或其集合的存在或添加。
应当理解，当在本说明书和所附权利要求书中使用时，术语“包括”和 “包含”指示所描述特征、整体、步骤、操作、元素和/或组件的存在，但并不排除一个或多个其它特征、整体、步骤、操作、元素、组件和/或其集合的存在或添加。
还应当理解，在此本发明说明书中所使用的术语仅仅是出于描述特定实施例的目的而并不意在限制本发明。如在本发明说明书和所附权利要求书中所使用的那样，除非上下文清楚地指明其它情况，否则单数形式的“一”、“一个”及“该”意在包括复数形式。
现有产品线的分拣流程中，在产品检测、设备运行预警与监控时，工作效率低，自动化程度低，且容易出现误判。
针对上述问题，提出一种融合云端的产品分拣系统及方法。
一种融合云端的产品分拣系统，如图1，图1是本发明中一种融合云端的产品分拣系统实施例示意图，用于对产线工件产品进行检测、分拣，包括：图像获取单元120、识别单元150、分拣装置160及中央控制单元110；图像获取单元120用于获取流水线上工件产品图像，并将产品图像传输到识别单元150；识别单元150用于根据计算机视觉算法并利用检测参数对产品图像进行缺陷检测，并将检测结果传输到分拣装置；分拣装置160根据检测结果将工件产品进行分类放置；中央控制单元110与各个单元连接，用于根据算法处理数据信息并输出控制指令；其中，检测参数包括检测层面、检测模板、检测区域、二值化阈值、异常点数统计中的一种或者多种。
通过利用机器视觉算法，对产线上的工件产品进行识别，将缺陷产品与合格产品分类放置，解决了现有人工检测过程中存在的误判、检测效率低的问题，降低了人力成本。
检测层面可以包括RGB单色层面、HSV单色层面、拉普拉斯变换层面、傅里叶变换层面、梯度层面，检测模块是指良品或者合格产品的真实图像，通过计算连通域个数、最大连通域点数中的异常点数，将异常点数与阈值比较，判定是否出现缺陷。
在一个优选实施方式中，分拣系统还包括监控单元130、运行监测单元140及云平台170；监控单元130用于对系统设备运行进行实时监控并将监控视频数据发送到云平台170；运行监测单元140用于监测系统设备运行信息，并将运行设备信息发送到云平台170；云平台170用于根据运行信息及监控视频，并根据用户请求向用户发送系统设备实时运行信息，以进行远程监控。
在一个优选实施方式中，如图2，图2是本发明中一种融合云端的产品分拣系统中云平台实施例示意图，云平台170包括存储单元171、虚拟仿真单元172、对比分析单元174、数字分析单元176及通信单元175；存储单元171用于存储从系统发送的工件产品检测结果数据、系统设备运行数据及运行监控视频数据；虚拟仿真单元172用于对系统设备运行数据进行虚拟仿真；对比分析单元174用于将运行监控视频与其对应运行数据的虚拟仿真影像进行对比分析，根据分析结果向用户发送预警信息；数字分析单元176用于对系统设备运行数据进行分析，抽取设备运行参数，并将设备运行参数发送到系统端或者用户终端进行显示；通信单元175用于系统设备与云平台170、云平台170与用户终端之间的网络通信，以进行数据传输。
将虚实结合的视频传入云平台170存储单元171，用户可以通过网页读取视频。将网页配置为：打开网页即展示数字孪生视频，对比分析单元174仍然会对虚拟仿真和系统设备实际运行情况进行对比，若存在虚拟仿真和系统设备实际运行情况不一致的情况，云平台170会发出警报，请求人为介入处理。这样不仅能实现远程监控系统设备运行这一功能，还能实现少内存、少带宽的占用。
存储单元171是云存储的基础。云存储依靠存储单元171将不同的存储设备互联起来，形成一个面向服务的分布式存储系统。在物理存储设备之上是一个统一的存储管理单元173，能实现对物理存储设备的逻辑虚拟化管理、状态监控和维护等功能。
对每一产品的图像进行识别，得到识别结果，对一段时间内产品进行总体分析，可以制作成可视化极佳的饼状图，通过访问云服务器上所配置的数据库，将识别出来的工件图像和识别结果饼状图传输至数据库，工件图像按照工件顺序依次排列，不做覆盖处理，以便后续成品率计算和查验校核。识别结果饼状图可以展示于网页，管理人员可以通过终端180或者PC查询云端实时查看分拣系统运行情况。
通过对分拣系统设备的运行进行实时监控，用户可以通过终端180连接云平台170，随时随地监控设备的运行状态，提高了产线的自动化程度。
在一个优选实施方式中，云平台170还包括管理单元173；管理单元173用于对存储单元171的存储资源进行管理，部署分布式文件管理系统，以设定的保护策略将接收的用户数据进行分片化存储，并对存储的用户数据进行管理。
管理单元173主要功能是在存储层提供的存储资源上部署分布式文件系统，或者建立、组织存储资源对象，并将用户数据进行分片处理，按照设定的保护策略将分片后的数据以多副本或者冗余纠删码的方式分散存储到具体的存储资源上去。同时，在本层还会在节点间进行读写负载均衡调度以及节点或存储资源失效后的业务调度与数据重建恢复等任务，以便始终提供高性能、高可用的访问服务。不过，在具体实现时，该层的功能也可以上移，位于访问接口层和应用服务层之间，甚至直接嵌入到应用服务层中，和业务应用紧密结合，形成业务专用云存储。
在有的实施方式中，云平台170还包括许可单元，在连接互联网的任何一台机器上，只要用户经过授权，都可以进入的云存储平台系统，进行云存储上的允许的授权操作，享受云存储带来的各种服务。
在一个优选实施方式中，图像获取单元120包括同轴光源单元；同轴光源单元用于通过反射向工件产品照射同轴光源，以克服工件产品表面的反光干扰。
根据同轴光源的特点，不平整的物面上的光会被斜着反射到其他地方，在图像中呈现暗色，只有平整的物体表面，才能较好的将光反射到镜头中。因此，利用同轴光源发射同轴光能够凸显物体表面不平整，克服表面反光造成的干扰。可以用于检测物体平整光滑表面的碰伤、划伤、裂纹和异物。优选用于反射度极高的物体，如金属、玻璃、胶片、晶片等表面的划伤检测、芯片和硅晶片的破损检测、包装条码识别等。
一种融合云端的产品分拣方法，如图3，图3是本发明中一种融合云端的产品分拣方法第一实施例示意图，利用第一方面的分拣系统对工件产品进行分拣，包括：
步骤100、向流水线上工件产品照射同轴光源，获取工件产品图像；步骤200、根据计算机视觉算法并利用检测参数对产品图像进行缺陷检测；步骤300、根据检测结果将工件产品进行分类放置；其中，检测参数包括检测层面、检测模板、检测区域、二值化阈值、异常点数统计中的一种或者多种。
一个优选实施方式中，如图4，图4是本发明中一种融合云端的产品分拣方法第二实施例示意图，方法还包括：
步骤400、对检测结果数据、系统设备运行数据及运行监控视频数据进行云存储；步骤500、根据运行信息及监控视频，并根据用户请求向用户发送系统设备实时运行信息，以进行远程监控。
在一个优选实施方式中，如图5，图5是本发明中一种融合云端的产品分拣方法第三实施例示意图，步骤200包括：
步骤210、将工件产品图像映射到设定的检测层面；步骤220、根据检测模板确定检测区域；步骤230、对检测区域内的产品图像及检测模板进行二值化处理，获取二值化差值；步骤240、将二值化差值与二值化阈值进行比较，获取异常点数；步骤250、将异常点数与异常阈值进行比较，并根据比较结果确定工件产品是否存在缺陷。
在一个优选实施方式中，如图6，图6是本发明中一种融合云端的产品分拣方法第四实施例示意图，步骤230包括：步骤231、对对检测区域内的产品图像进行平滑滤波，以过滤噪声；步骤232、将产品图像进行灰度处理，获取工件产品灰度图；步骤233、对工件产品灰度图进行二值化处理。
在一个优选实施方式中，如图7，图7是本发明中一种融合云端的产品分拣方法第五实施例示意图，步骤200还包括：
步骤260、利用canny边缘检测算子对工件产品边缘进行检测，获取工件产品轮廓边缘；步骤270、调用多边形逼近算子及平滑滤波算子分别对边缘轮廓形状进行矫正、滤波，获取轮廓边缘的顶点数目及其角度范围；步骤280、根据顶点数目及其角度范围，结合相机的像素尺寸，获取工件产品的尺寸。
实施本发明的一种融合云端的产品分拣系统及方法，通过利用机器视觉算法，对产线上的工件产品进行识别，将缺陷产品与合格产品分类放置，解决了现有人工检测过程中存在的误判、检测效率低的问题，降低了人力成本，通过对分拣系统设备的运行进行实时监控，用户可以通过终端180连接云平台170，随时随地监控设备的运行状态，提高了产线的自动化程度。
以上仅为本发明的较佳实施例，并不用以限制本发明，凡在本发明的精神和原则之内，所作的任何修改、等同替换、改进等，均应包含在本发明的保护范围之内。

Claims (10)

  1. 一种融合云端的产品分拣系统，用于对产品进行检测、分拣，其特征在于，包括：
    图像获取单元；
    识别单元；
    分拣装置；
    中央控制单元；
    所述图像获取单元用于获取流水线上工件产品图像，并将所述产品图像传输到所述识别单元；
    所述识别单元用于根据计算机视觉算法并利用检测参数对所述产品图像进行缺陷检测，并将检测结果传输到所述分拣装置；
    所述分拣装置根据所述检测结果将所述工件产品进行分类放置；
    所述中央控制单元与各个单元连接，用于根据算法处理数据信息并输出控制指令；
    其中，所述检测参数包括检测层面、检测模板、检测区域、二值化阈值、异常点数统计中的一种或者多种。
  2. 根据权利要求1所述的融合云端的产品分拣系统，其特征在于，所述分拣系统还包括：
    监控单元；
    运行监测单元；
    云平台；
    所述监控单元用于对系统设备运行进行实时监控并将监控视频数据发送到所述云平台；
    所述运行监测单元用于监测系统设备运行信息，并将设备运行信息发送到所述云平台；
    所述云平台用于根据所述运行信息及监控视频，并根据用户请求向用户发送系统设备实时运行信息，以进行远程监控。
  3. 根据权利要求2所述的融合云端的产品分拣系统，其特征在于，所述云平台包括：
    存储单元；
    虚拟仿真单元；
    对比分析单元；
    数字分析单元；
    通信单元；
    所述存储单元用于存储从系统发送的工件产品检测结果数据、系统设备运行数据及运行监控视频数据；
    所述虚拟仿真单元用于对系统设备运行数据进行虚拟仿真；
    所述对比分析单元用于将运行监控视频与其对应运行数据的虚拟仿真影像进行对比分析，根据分析结果向用户发送预警信息；
    所述数字分析单元用于对系统设备运行数据进行分析，抽取设备运行参数，并将所述设备运行参数发送到系统端或者用户终端进行显示；
    所述通信单元用于系统设备与云平台、云平台与用户终端之间的网络通信，以进行数据传输。
  4. 根据权利要求3所述的融合云端的产品分拣系统，其特征在于，所述云平台还包括：
    管理单元；
    所述管理单元用于对所述存储单元的存储资源进行管理，部署分布式文件管理系统，以设定的保护策略将接收的用户数据进行分片化存储，并对存储的用户数据进行管理。
  5. 根据权利要求4所述的融合云端的产品分拣系统，其特征在于，所述图像获取单元包括：
    同轴光源单元；
    所述同轴光源单元用于通过反射向工件产品照射同轴光源，以克服工件产品表面的反光干扰。
  6. 一种融合云端的产品分拣方法，利用权利要求1-5任一所述的分拣系统对工件产品进行分拣，包括：
    步骤100、向流水线上工件产品照射同轴光源，获取工件产品图像；
    步骤200、根据计算机视觉算法并利用检测参数对所述产品图像进行缺陷检测；
    步骤300、根据检测结果将所述工件产品进行分类放置；
    其中，所述检测参数包括检测层面、检测模板、检测区域、二值化阈值、异常点数统计中的一种或者多种。
  7. 根据权利要求6所述的融合云端的产品分拣方法，其特征在于，所述方法还包括：
    步骤400、对检测结果数据、系统设备运行数据及运行监控视频数据进行云存储；
    步骤500、根据运行信息及监控视频，并根据用户请求向用户发送系统设备实时运行信息，以进行远程监控。
  8. 根据权利要求6所述的融合云端的产品分拣方法，其特征在于，所述步骤200包括：
    步骤210、将所述工件产品图像映射到设定的检测层面；
    步骤220、根据检测模板确定检测区域；
    步骤230、对检测区域内的产品图像及检测模板进行二值化处理，获取二值化差值；
    步骤240、将所述二值化差值与二值化阈值进行比较，获取异常点数；
    步骤250、将所述异常点数与异常阈值进行比较，并根据比较结果确定所述工件产品是否存在缺陷。
  9. 根据权利要求8所述的融合云端的产品分拣方法，其特征在于，所述步骤230包括：
    步骤231、对对检测区域内的产品图像进行平滑滤波，以过滤噪声；
    步骤232、将产品图像进行灰度处理，获取工件产品灰度图；
    步骤233、对所述工件产品灰度图进行二值化处理。
  10. 根据权利要求6所述的融合云端的产品分拣方法，其特征在于，所述步骤200还包括：
    步骤260、利用canny边缘检测算子对工件产品边缘进行检测，获取工件产品轮廓边缘；
    步骤270、调用多边形逼近算子及平滑滤波算子分别对所述边缘轮廓形状进行矫正、滤波，获取所述轮廓边缘的顶点数目及其角度范围；
    步骤280、根据所述顶点数目及其角度范围，结合相机的像素尺寸，获取工件产品的尺寸。
PCT/CN2021/128475 2021-09-27 2021-11-03 一种融合云端的产品分拣系统及方法 WO2023045038A1 (zh)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN202111138951.1 2021-09-27
CN202111138951 2021-09-27
CN202111280723.8 2021-11-01
CN202111280723.8A CN113996556B (zh) 2021-09-27 2021-11-01 一种融合云端的产品分拣系统及方法

Publications (1)

Publication Number Publication Date
WO2023045038A1 true WO2023045038A1 (zh) 2023-03-30

Family

ID=79926083

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/128475 WO2023045038A1 (zh) 2021-09-27 2021-11-03 一种融合云端的产品分拣系统及方法

Country Status (2)

Country Link
CN (1) CN113996556B (zh)
WO (1) WO2023045038A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114405837A (zh) * 2022-02-08 2022-04-29 泰州市龙洋木业有限公司 一种用于板材同步识别分拣的处理系统
CN114741427B (zh) * 2022-04-18 2023-11-14 赛那德科技有限公司 一种数字化云平台分拣分析系统及方法

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101751572A (zh) * 2008-12-05 2010-06-23 比亚迪股份有限公司 一种图案检测方法、装置、设备及系统
CN105451005A (zh) * 2016-01-08 2016-03-30 北京中电普华信息技术有限公司 一种监控装置及监控系统
CN106292483A (zh) * 2015-05-28 2017-01-04 上海博内智能化科技有限公司 一种电气设施现场监控方法及系统
CN106770331A (zh) * 2017-02-10 2017-05-31 南京航空航天大学 一种基于机器视觉的工件缺陷检测系统
US20190311470A1 (en) * 2018-04-10 2019-10-10 ONS Communications Apparel production monitoring system using image recognition
CN110567987A (zh) * 2019-08-12 2019-12-13 北京三清互联科技有限公司 一种基于自动视觉技术的馈线终端基板检测系统及方法

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE19836071A1 (de) * 1998-08-10 2000-02-17 Schlafhorst & Co W Verfahren zur Erkennung von Fadenresten auf Spinnkopshülsen
CN110246122A (zh) * 2019-05-20 2019-09-17 江苏理工学院 基于机器视觉的小型轴承质量检测方法、装置及系统
CN111359912A (zh) * 2020-04-08 2020-07-03 苏州正德行智能物联有限公司 一种基于机器视觉的smt生产线智能化检测系统及方法
CN111389741A (zh) * 2020-04-16 2020-07-10 长春光华学院 基于机器视觉的汽车刹车片表面缺陷检测自动分拣系统
CN112388632A (zh) * 2020-10-26 2021-02-23 无锡职业技术学院 一种远程Delta机器人分拣监控系统
CN112718552A (zh) * 2020-12-11 2021-04-30 江苏烨明光电有限公司 一种用于led电路板质量缺陷自动检验装置及其工作方法
CN112861421A (zh) * 2021-01-08 2021-05-28 陕西比瑞控制技术设备有限公司 一种电力设备智能分析预警系统和方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101751572A (zh) * 2008-12-05 2010-06-23 比亚迪股份有限公司 一种图案检测方法、装置、设备及系统
CN106292483A (zh) * 2015-05-28 2017-01-04 上海博内智能化科技有限公司 一种电气设施现场监控方法及系统
CN105451005A (zh) * 2016-01-08 2016-03-30 北京中电普华信息技术有限公司 一种监控装置及监控系统
CN106770331A (zh) * 2017-02-10 2017-05-31 南京航空航天大学 一种基于机器视觉的工件缺陷检测系统
US20190311470A1 (en) * 2018-04-10 2019-10-10 ONS Communications Apparel production monitoring system using image recognition
CN110567987A (zh) * 2019-08-12 2019-12-13 北京三清互联科技有限公司 一种基于自动视觉技术的馈线终端基板检测系统及方法

Also Published As

Publication number Publication date
CN113996556A (zh) 2022-02-01
CN113996556B (zh) 2022-11-04

Similar Documents

Publication Publication Date Title
US11488294B2 (en) Method for detecting display screen quality, apparatus, electronic device and storage medium
TWI757825B (zh) 基於假點缺陷檢測之pcb檢修系統及檢修方法
US10733723B2 (en) Methods and system for improved quality inspection
US11341626B2 (en) Method and apparatus for outputting information
US10706525B2 (en) Methods and systems for improved quality inspection
CN113095438B (zh) 晶圆缺陷分类方法及其装置、系统、电子设备和存储介质
KR20200004825A (ko) 디스플레이 장치 품질 검사 방법, 장치, 전자 장치 및 저장 매체
WO2023045038A1 (zh) 一种融合云端的产品分拣系统及方法
KR20200013148A (ko) 콘크리트 구조물 결함 분석 서비스 제공 방법, 시스템 및 컴퓨터 프로그램
CN109946303A (zh) 检查装置和方法
CN112613569B (zh) 图像识别方法、图像分类模型的训练方法及装置
CN112560816A (zh) 一种基于YOLOv4的设备指示灯识别方法及系统
JP2022507678A (ja) 自動目視検査プロセスにおけるセットアップ段階の最適化
WO2024002187A1 (zh) 缺陷检测方法、缺陷检测设备及存储介质
CN115937101A (zh) 质量检测方法、装置、设备及存储介质
KR20220105689A (ko) 머신러닝 모델에 기반한 디스플레이 패널의 결함 판정 시스템
CN116718600B (zh) 一种用于对线束产品进行智能化检测的检测装置
CN116958035A (zh) 产品零件缺陷检测方法、装置、介质及电子设备
KR20220161601A (ko) 딥러닝 모델을 이용한 영상검사 대상체의 결함 판정시스템
KR102355997B1 (ko) 스마트글래스 기반의 콘크리트 구조물 건전도 모니터링 방법
CN111366582A (zh) 一种基于自动光学检测自动判等方法
US20230408421A1 (en) Method for defect detection for rolling elements
TWI810016B (zh) 軟性電路板檢測系統
TWI769688B (zh) 一種印刷電路板遠程光學檢修方法及系統
WO2022254858A1 (ja) 検査装置、検査方法、および検査プログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21958151

Country of ref document: EP

Kind code of ref document: A1