CN112712505A - Workpiece detection method and system based on cloud and computer-readable storage medium - Google Patents
Workpiece detection method and system based on cloud and computer-readable storage medium Download PDFInfo
- Publication number
- CN112712505A CN112712505A CN202011615606.8A CN202011615606A CN112712505A CN 112712505 A CN112712505 A CN 112712505A CN 202011615606 A CN202011615606 A CN 202011615606A CN 112712505 A CN112712505 A CN 112712505A
- Authority
- CN
- China
- Prior art keywords
- workpiece
- terminal
- model
- characteristic information
- cloud
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000001514 detection method Methods 0.000 title claims abstract description 86
- 238000003860 storage Methods 0.000 title claims abstract description 15
- 238000000034 method Methods 0.000 claims description 26
- 238000007689 inspection Methods 0.000 claims description 23
- 238000012549 training Methods 0.000 claims description 9
- 238000004891 communication Methods 0.000 claims description 6
- 238000004458 analytical method Methods 0.000 claims description 5
- 230000000007 visual effect Effects 0.000 claims description 3
- 238000013473 artificial intelligence Methods 0.000 description 127
- 238000007726 management method Methods 0.000 description 58
- 230000006870 function Effects 0.000 description 14
- 238000010586 diagram Methods 0.000 description 13
- 238000005516 engineering process Methods 0.000 description 11
- 238000012423 maintenance Methods 0.000 description 8
- 238000012360 testing method Methods 0.000 description 8
- 238000013135 deep learning Methods 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000007246 mechanism Effects 0.000 description 3
- 230000006855 networking Effects 0.000 description 3
- 238000013523 data management Methods 0.000 description 2
- 230000018109 developmental process Effects 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000013480 data collection Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000002950 deficient Effects 0.000 description 1
- 238000009795 derivation Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 238000003708 edge detection Methods 0.000 description 1
- 238000003709 image segmentation Methods 0.000 description 1
- 238000009776 industrial production Methods 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
- G06T2207/30164—Workpiece; Machine component
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Engineering & Computer Science (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Evolutionary Computation (AREA)
- Evolutionary Biology (AREA)
- Bioinformatics & Computational Biology (AREA)
- Artificial Intelligence (AREA)
- Multimedia (AREA)
- Computing Systems (AREA)
- Life Sciences & Earth Sciences (AREA)
- Quality & Reliability (AREA)
- General Factory Administration (AREA)
Abstract
The application discloses a workpiece detection method and system based on a cloud end and a computer readable storage medium. The workpiece detection method based on the cloud comprises the following steps: the terminal sends a downloading request to the cloud; the cloud terminal issues at least one AI model to the terminal according to the downloading request; the terminal acquires the characteristic information of the workpiece; and the terminal matches the characteristic information with preset characteristic information and detects the workpiece by using an AI model corresponding to the preset characteristic information. Through the mode, the detection accuracy and the detection efficiency of the workpiece can be improved.
Description
Technical Field
The present disclosure relates to the field of workpiece detection technologies, and in particular, to a cloud-based workpiece detection method and system, and a computer-readable storage medium.
Background
In the industrial production process, workpiece detection is an extremely important step in the links of workpiece quality detection, classification and the like. In the workpiece detection, image information and the like on the surface of the workpiece are processed by an Artificial Intelligence (AI) model to identify a defective workpiece or classify the workpiece.
However, the types of workpieces processed in the same factory are often multiple, the same workpiece may have multiple types, and the characteristics of workpieces of different types have certain differences, which may result in lower detection accuracy of the workpiece or higher complexity of the AI model, and thus lower detection efficiency of the workpiece.
Disclosure of Invention
The technical problem that this application mainly solved is how to improve detection precision and detection efficiency that the work piece detected.
In order to solve the technical problem, the application adopts a technical scheme that: a workpiece detection method based on a cloud is provided. The workpiece detection method based on the cloud comprises the following steps: the terminal sends a downloading request to the cloud; the cloud terminal issues at least one AI model to the terminal according to the downloading request; the terminal acquires the characteristic information of the workpiece; and the terminal matches the characteristic information with preset characteristic information and detects the workpiece by using an AI model corresponding to the preset characteristic information.
In order to solve the above technical problem, another technical solution adopted by the present application is: a cloud-based workpiece detection system is provided. This work piece detecting system based on high in clouds includes: the system comprises a terminal and a cloud end communicated with the terminal; the terminal sends a downloading request to the cloud; the cloud terminal issues at least one AI model to the terminal according to the downloading request; the terminal obtains the feature information of the workpiece, matches the feature information with the preset feature information, and detects the workpiece by using the AI model corresponding to the preset feature information.
In order to solve the above technical problem, another technical solution adopted by the present application is: a computer-readable storage medium is provided. The computer-readable storage medium stores program instructions that can be executed to implement the above-described workpiece detection method.
The beneficial effects of the embodiment of the application are that: the workpiece detection method based on the cloud comprises the following steps: the terminal sends a downloading request to the cloud; the cloud terminal issues at least one AI model to the terminal according to the downloading request; the terminal acquires the characteristic information of the workpiece; and the terminal matches the characteristic information with preset characteristic information and detects the workpiece by using an AI model corresponding to the preset characteristic information. By the mode, the characteristic information of the workpiece is matched with the preset characteristic information, and the AI model corresponding to the preset characteristic information is selected to detect the workpiece after the matching is successful, so that different AI models can be selected for the workpieces with different characteristic information to detect, the workpiece detection accuracy can be improved, the complexity of the AI model can be reduced, and the detection efficiency can be improved; therefore, the workpiece detection precision and the workpiece detection efficiency can be improved. The AI model can detect the workpiece at the terminal, the terminal does not need to send a large amount of acquired workpiece characteristic information to the cloud, network resources can be saved, and the problems that the cloud cannot receive the workpiece characteristic information and cannot detect the workpiece by the AI model due to poor factory network environment can be solved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
Fig. 1 is a schematic structural diagram of an embodiment of a cloud-based workpiece inspection system according to the present application;
FIG. 2 is a block diagram of the cloud-based workpiece inspection system of the embodiment of FIG. 1;
FIG. 3 is a functional block diagram of the cloud-based workpiece inspection system of the embodiment of FIG. 1;
FIG. 4 is a functional block diagram of an application scenario of the cloud-based workpiece inspection system of the embodiment of FIG. 1;
FIG. 5 is a schematic diagram of an application interaction timing sequence of the cloud-based workpiece detection system of the embodiment of FIG. 1;
FIG. 6 is a schematic flow chart diagram illustrating an embodiment of a cloud-based workpiece inspection method according to the present disclosure;
FIG. 7 is a schematic flow chart diagram illustrating an embodiment of a cloud-based workpiece inspection method of the present application;
FIG. 8 is a schematic flow chart diagram illustrating an embodiment of a cloud-based workpiece inspection method of the present application;
FIG. 9 is a schematic flow chart diagram illustrating an embodiment of a cloud-based workpiece inspection method of the present application;
FIG. 10 is a flowchart illustrating an embodiment of a cloud-based workpiece inspection method according to the present disclosure;
FIG. 11 is a schematic structural diagram of an embodiment of a computer-readable storage medium of the present application.
Detailed Description
The present application will be described in further detail with reference to the following drawings and examples. It is to be noted that the following examples are only illustrative of the present application, and do not limit the scope of the present application. Likewise, the following examples are only some examples and not all examples of the present application, and all other examples obtained by a person of ordinary skill in the art without any inventive step are within the scope of the present application.
AI technology has become a basic technology that has played an increasing role in many industries, and the application of technologies such as autopilot, go, face recognition, etc. is not independent of AI technology. However, the application of the AI technology in the detection field of the conventional industry is relatively lagged, many problems in the detection of the conventional industry are not solved yet, the application of the AI technology to the detection of the conventional industry is an urgent need, and the support of the AI technology is more needed to realize the intelligent manufacturing in the conventional industry field.
The traditional industrial detection method has the problems of difficult algorithm feature extraction and debugging and poor applicability, and the upgrading of the industry needs to introduce a new technology to solve the existing problems, thereby driving the development of the whole industry. Deep learning algorithms in AI techniques can work well for these solutions. The deep learning method is an end-to-end learning method, and aiming at specific problems, only the data collection of samples and the definition of the problems need to be concerned, and better results can be obtained without paying more attention to the training process.
At present, although the AI technology is applied to industrial quality inspection, the requirement on users is high, the users are often required to have certain AI knowledge and also need to understand certain hardware knowledge, the popularization and the application of the AI technology are very unfavorable, many front-line personnel in the manufacturing industry do not have the AI knowledge, and people with the AI knowledge do not necessarily understand the AI requirement of front-line workers. Therefore, it is an urgent problem to provide a simple and easy-to-use AI tool without professional knowledge.
In order to solve the problems, the application provides a cloud-based workpiece detection system, which is an AI suite detection system based on deep learning and combining software and hardware, on one hand, the system can provide low-threshold AI capability for a user, and the system does not need to have professional knowledge in hardware and software and only needs to carry out model training according to business scene requirements; on the other hand, the user site limitation can be liberated by the fool type one-key training model, the operation and deployment application is easy, and the real-time monitoring and control of multiple users and multiple scenes can improve the working efficiency and provide the reliability guarantee for the use of users and operation and maintenance personnel.
The cloud-based workpiece detection system provides two modes for management of models and data, and develops Application program (APP) Application based on a mobile terminal and World Wide Web (Web) Application based on a Personal Computer (PC) terminal. The user can log in the cloud end through two modes, and can visit all the weather under the networking condition. The PC terminal or the mobile terminal can perform operations such as account registration, login, data uploading, downloading and labeling, model training, testing, downloading, updating and the like.
The cloud end and the terminal can communicate through network protocols such as a Transmission Control Protocol/Internet Protocol (TCP/IP), equipment management software is installed on the terminal, the software binds the terminal (such as a mac address) through a unique identification code, and then the terminal identification code is stored in a cloud platform, and the cloud platform can manage the equipment, including updating of software and models.
When the model needs to be downloaded, a downloading request is sent to the cloud end through a downloading function interface (which may be an interface button for a user) of the terminal, and the cloud end transmits the model file to the terminal after receiving the downloading request. The model can be actively updated on the cloud end, and can also be performed on management software of the terminal. Uploading and training can be performed through a web and App operation interface of the PC side provided for the user.
The present application first proposes a cloud-based workpiece detection system, as shown in fig. 1 to 3, fig. 1 is a schematic structural diagram of an embodiment of the cloud-based workpiece detection system of the present application; FIG. 2 is a block diagram of the cloud-based workpiece inspection system of the embodiment of FIG. 1; fig. 3 is a functional architecture diagram of the cloud-based workpiece inspection system of the embodiment of fig. 1. The cloud-based workpiece detection system 10 of the present embodiment includes: a terminal 20 and a cloud 30 in communication with the terminal 20; wherein, the terminal 20 sends a download request to the cloud 30; the cloud 30 issues at least one AI model to the terminal 20 according to the download request; the terminal 20 acquires feature information of the workpiece, matches the feature information with preset feature information, and detects the workpiece by using an AI model corresponding to the preset feature information.
The AI algorithm of the embodiment may be a conventional algorithm (e.g., gaussian filtering, median filtering sift feature extraction, canny edge detection algorithm, hough transform, etc.), or may be based on a deep learning algorithm (e.g., a rest residual network, a mobilenet network, a fast-rcnn network, an SSD network, a YOLOV3 network, a deplaybv 3 network, a mask-rcnn network, etc.), which is not specifically limited; the AI algorithm of the present embodiment is mainly used for identifying the feature information of the workpiece according to the image information of the workpiece, and matching the feature information with the preset feature information to identify the workpiece with a defect, or classify the workpiece, etc.
The embodiment can also be used in application scenes such as workpiece segmentation and face recognition.
Different from the prior art, in the embodiment, firstly, the feature information of the workpiece is matched with the preset feature information, and after the matching is successful, the AI model corresponding to the preset feature information is selected to detect the workpiece, so that different AI models can be selected for the workpieces with different feature information to detect, the accuracy of workpiece detection can be improved, the complexity of the AI model can be reduced, and the detection efficiency can be improved; therefore, the embodiment can improve the detection accuracy and the detection efficiency of the workpiece. In addition, the AI model of this embodiment detects the workpiece at the terminal 20, and the terminal 20 does not need to send a large amount of acquired workpiece characteristic information to the cloud 30, so that not only can network resources be saved, but also the problem that the cloud 30 cannot receive the workpiece characteristic information and cannot detect the workpiece by using the AI model due to poor factory network environment can be avoided.
Further, the terminal 20 matches the feature information with preset feature information; in response to the feature information being successfully matched with the preset feature information, the terminal 20 acquires the workpiece type of the workpiece; the terminal 20 acquires an AI model corresponding to the type of the workpiece to detect the workpiece.
Further, the download request includes a download request instruction and identification information of the terminal 20, the cloud 30 obtains a workpiece type corresponding to the identification information according to the download request instruction, and the cloud 30 obtains an AI model corresponding to the workpiece type and issues the AI model to the terminal 20.
Further, the download request includes a download request instruction and image information of the workpiece, and the cloud 30 acquires a workpiece type corresponding to the image information according to the download request instruction, acquires an AI model corresponding to the workpiece type, and issues the AI model to the terminal 20.
The cloud-based workpiece inspection system 10 of the present embodiment is further configured to implement the following method, which can be referred to as follows.
Optionally, the workpiece detecting system 10 of the present embodiment further includes an auxiliary device 40, which is in communication with the terminal 20, and is configured to collect characteristic information of the workpiece, and transmit the characteristic information to the terminal 20, so that the terminal 20 detects the characteristic information by using the AI model.
The terminal 20 and the auxiliary device 40 of the present embodiment belong to a hardware device 70 of a workpiece detection system.
The terminal 20 of this embodiment may be an AI box, which is an AI super computer with rich interfaces, small appearance and powerful performance. The AI box can operate a larger and deeper neural network, so that the equipment is more intelligent, and higher precision and faster response are realized; in other embodiments, the terminal may also be a mobile terminal or other electronic device provided with an AI model.
The auxiliary device 40 of the present embodiment includes: an image sensor (not shown), a light source 410, a vision controller 420; the image sensor is used for acquiring image information of the workpiece, so that the terminal 20 acquires characteristic information of the workpiece from the image information; the light source 410 is used to provide optical compensation for the image sensor; the vision controller 420 is used for realizing the control of the image sensor and the analysis of the image information; the image sensor includes, among other things, a camera 430 and a lens 440.
The auxiliary device 40 of the present embodiment further includes: a light source controller 450, an auxiliary 460, a network device 470, and the like; the light source controller 450 is configured to control the turning on, the light intensity, the position, the beam direction angle, and the like of the light source 410; the auxiliary 460 may include a loading and unloading assembly, a roller, a conveyor belt, a driving member, and the like, and is mainly used for transferring the workpiece; the network device 470 is mainly used for communication between the terminal 20 and the cloud 30.
Optionally, the cloud-based workpiece detection system 10 of the present embodiment further includes a management system 50, and the management system 50 may be integrated in the terminal 20 or the cloud 30; among them, the management system 50 includes: a device management module 51, an AI model management module 52, and an interface management module 53; the device management module 51 is configured to implement management of the terminal 20 and the auxiliary device 40; the AI model management module 52 is configured to implement management of an AI model; the interface management module 53 is configured to implement interface management of the cloud-based workpiece inspection system 10.
Certainly, in other embodiments, the management system may also be partially integrated in the cloud and partially integrated in the terminal.
Wherein, the device management module 51 includes: an equipment registration management submodule 511, an operating state management submodule 512 and an online update management submodule 513; the device registration management sub-module 511 is configured to implement registration management of the devices such as the terminal 20, the image sensor, the light source 410, the visual controller 420, the light source controller 450, the auxiliary 460, and the network device 470; the operation status management sub-module 512 is configured to manage the operating status and abnormal status of the terminal 20, the image sensor, the light source 410, the visual controller 420, the light source controller 450, the auxiliary 460, and the network device 470; the online update management sub-module 513 is configured to implement management of online update, maintenance, and replacement of SDKs (Software Development Kit, SDKs) of the terminal 20, the image sensor, the light source 410, the vision controller 420, the light source controller 450, the auxiliary 460, and the network device 470.
In an application scenario, a user first registers through the device registration management sub-module 511, and then the device management module 51 manages the devices in a unified manner, including checking the running state of the devices in real time, so as to implement an online update function.
The new equipment needs to be registered, and the registered equipment has a unique serial number of displacement; under the condition of networking, the background can monitor the running state of the equipment in real time and the condition of network disconnection, and then the running state and the condition of network disconnection are stored in a log form.
The AI model management module 52 includes: an AI model deployment management submodule 521, an AI model update management submodule 522 and an AI inference management submodule 523; the AI model deployment management submodule 521 is used for realizing deployment and operation of a plurality of AI models, the software defaults to an automatic loading model each time the software is started, and the starting of the operation interface is successful after the loading model is successful; the AI model update management submodule 522 is used to implement online update of the background under the networking condition, and also provide offline update of the copied model file; the AI inference management submodule 523 is configured to implement detection of workpiece image information by receiving input image information.
In an application scenario, the AI model management module 52 may implement image detection, which includes but is not limited to image classification, image segmentation, target detection, and other algorithm functions. The user configures different algorithms according to needs to realize industrial quality inspection and other customized functions.
Among them, the interface management module 53 includes: a log management submodule 531, a result statistics submodule 532, an AI model management submodule 533, and a technical support submodule 534.
The cloud-based workpiece detection system 10 of the present embodiment further includes a screen end 60, where the screen end 60 may be an APP display interface disposed on the terminal 20, or a display interface of a separate PC end communicating with the management system 50; the log management submodule 531 mainly includes statistical detection results and result derivation; the result counting submodule 532 is used for counting the workpiece test results and displaying the test results on the screen end 60; the AI model management submodule 533 is configured to display information of the AI model on the screen 60, so as to implement deployment, management, update, and the like of the AI model; the technical support sub-module 534 is used for providing an operation interface for operation and maintenance personnel; of course, the ordinary user or the operation and maintenance personnel can also interact with other information among the management system 50, the terminal 20 and the cloud 30 through the screen terminal 60.
The interface management module 53 further includes a picture (image) detection module, which is used to implement functions of opening a picture, opening a camera, testing a picture, saving a picture, and the like; after a user opens a picture, the camera is opened successively, then the background sends the displayed picture to the AI model for detection, and finally, the AI detection result graph is stored.
Optionally, the cloud 30 of this embodiment includes: a database 31, a Hadoop Distributed File System (HDFS) 32, and an AI module 33.
The cloud may be a server, a computer, or the like. The database 31 is used for storing the AI model, the feature information of the workpiece, and the preset feature information; the database 31 of this embodiment may be MySQL, mariidb, or the like. HDFS32 is used to enable access to database 31; HDFS32 is designed to fit distributed file systems running on general purpose hardware, is a highly fault tolerant system, is suitable for deployment on inexpensive machines, provides high throughput data access, and is well suited for large-scale data set applications. The AI module 33 is used to implement updating and training of the AI model.
Further, the cloud 30 of the present embodiment further includes: UI module 34 and user management module 35, which are used to interact with management system 50, and to implement management of system interface and user, and relevant data is stored in database 31.
As shown in fig. 3, the cloud-based workpiece detection system 10 of the present embodiment can simultaneously implement functions of device management, AI algorithm, and operation interface, and can integrate functions of device registration, device operation state management, device online update, (AI) model deployment, (AI) model update, (AI) model inference, picture detection, (AI) model management, and technical support, and implement functions required for workpiece detection.
In the embodiment, the cloud-based workpiece detection system is mainly divided into two types of users, the permissions of different users are different, the operation of an ordinary user includes a local interface and the cloud 30, and operation and maintenance personnel manage all devices and deal with some user feedback problems.
As shown in fig. 4, a general user may perform operations such as result display, detection result statistics, model deployment, model update, and information feedback with the cloud-based workpiece detection system 10 through a local user interface of the screen end 60, so as to implement data management, one-touch training, and model management on the AI module; the data management comprises picture uploading, picture marking, data set management and the like, and the model management comprises model updating, model deployment, model testing, model exporting and the like.
The operation and maintenance personnel have different authorities from the ordinary user, and the operation and maintenance personnel can perform operations such as state checking, SDK (device or SDK of AI model) updating, device maintenance, information processing, user management and the like through the screen end 60 and the device management module 51 in the management system 50 so as to realize one-key training and model management on the AI module; the model management comprises model updating, model deployment, model testing, model export and the like.
As shown in fig. 5, in an application scenario, a user may double-click an operation interface, background operation software loads a model, after loading is successful, the operation interface software is opened, then a camera is opened, when the camera is opened, an image of a workpiece is shot in real time, the image is transmitted to the model for reasoning, and then a reasoning result is displayed on a screen to remind the user; finally, the model can be updated according to the inference result.
The present application further provides a cloud-based workpiece detection method, as shown in fig. 6, fig. 6 is a schematic flowchart of an embodiment of the cloud-based workpiece detection method of the present application. The workpiece inspection method of the present embodiment can be applied to the cloud-based workpiece inspection system 10. The workpiece detection method based on the cloud end comprises the following steps:
step S601: the terminal 20 sends a download request to the cloud 30.
The terminal 20 establishes a wired or wireless communication connection with the cloud 30 through the network device 470 or a network port of the terminal 20; after the communication connection is established, the terminal 20 sends an AI model download request to the cloud 30.
Step S602: the cloud 30 issues at least one AI model to the terminal 20 according to the download request.
The cloud 30 verifies the download request, and issues at least one AI model to the terminal 20 after the verification is successful.
Step S603: the terminal 20 acquires characteristic information of the workpiece.
The terminal 20 may acquire characteristic information of the workpiece through an auxiliary device 40 such as an image sensor.
Step S604: the terminal 20 matches the characteristic information with preset characteristic information and detects the workpiece using the AI model matched with the preset characteristic information.
The terminal 20 stores preset feature information and a mapping relationship between the preset feature information and the AI model; and the terminal 20 identifies the image information of the workpiece to obtain the characteristic information, matches the characteristic information with the preset characteristic information, obtains an AI model corresponding to the preset characteristic information from the downloaded AI model according to the mapping relationship after the matching is successful, and detects the workpiece by using the AI model.
Different from the prior art, in the embodiment, firstly, the feature information of the workpiece is matched with the preset feature information, and after the matching is successful, the AI model corresponding to the preset feature information is selected to detect the workpiece, so that different AI models can be selected for the workpieces with different feature information to detect, the accuracy of workpiece detection can be improved, the complexity of the AI model can be reduced, and the detection efficiency can be improved; therefore, the embodiment can improve the detection accuracy and the detection efficiency of the workpiece. In addition, the AI model of this embodiment detects the workpiece at the terminal 20, and the terminal 20 does not need to send a large amount of acquired workpiece characteristic information to the cloud 30, so that not only can network resources be saved, but also the problem that the cloud 30 cannot receive the workpiece characteristic information and cannot detect the workpiece by using the AI model due to poor factory network environment can be avoided.
Specifically, the present embodiment may implement step S604 by the method as described in fig. 7. The method of the present embodiment includes steps S701 to S703.
Step S701: the terminal 20 matches the feature information with preset feature information.
Wherein the characteristic information includes at least any one of identification information, contour information, shape, color, or size.
In other embodiments, the feature information may also be the name, model, etc. of the workpiece, or may also be set according to the selection of the user, that is, the terminal obtains the feature information selected by the user.
Specifically, the terminal 20 may obtain a matching degree between the feature information and the preset feature information.
Step S702: and responding to the characteristic information and the preset characteristic information which are successfully matched, and acquiring the workpiece type of the workpiece by the terminal 20.
Specifically, if the matching degree is greater than a preset value, the feature information of the workpiece is considered to be successfully matched with the preset feature information, otherwise, the feature information of the workpiece is considered to be unsuccessfully matched with the preset feature information; generally, a workpiece can be distinguished from other workpieces through a plurality of pieces of feature information, and therefore, the terminal 20 obtains the plurality of pieces of feature information of the workpiece respectively, and correspondingly obtains a plurality of matching degrees, and obtains a total matching degree according to the plurality of matching degrees, for example, obtains a weighted value of the plurality of matching degrees; the matching degree of each piece of characteristic information can be set according to the influence of the characteristic information on the type of the workpiece; and if the total matching degree is greater than the preset value, the feature information of the workpiece is considered to be successfully matched with the preset feature information, otherwise, the feature information of the workpiece is considered to be unsuccessfully matched with the preset feature information.
Of course, a larger preset value may be set for the important feature information, and when the matching degree of the important feature information is greater than the preset value and the total matching degree is greater than the preset value, it is determined that the feature information of the workpiece matches the preset feature information.
If the feature information of the workpiece is determined to match the preset feature information, the terminal 20 obtains the workpiece type of the workpiece.
The workpiece type in the application refers to the type of the workpiece or the type of the workpiece and the like.
Step S703: the terminal 20 acquires an AI model corresponding to the type of the workpiece to detect the workpiece.
As can be seen from the above analysis, there are a plurality of pieces of feature information of the workpieces, and part of the feature information of different types of workpieces may be the same, so to improve the detection accuracy, the present embodiment first determines the workpiece type according to the feature information of the workpiece, and then associates the AI model according to the workpiece type.
The present application further provides another embodiment of a cloud-based workpiece testing method, as shown in fig. 8, the workpiece detecting method of the present embodiment may be applied to the cloud-based workpiece detecting system 10. The workpiece detection method based on the cloud end comprises the following steps:
step S801: the terminal 20 sends a download request to the cloud 30.
The download request of the present embodiment includes a download request instruction and identification information of the terminal 20.
The identification information of the terminal 20 may be a serial number or a MAC address of the terminal 20, or the like; the cloud 30 may obtain the identification information of the registered device from the device registration management sub-module 511 and the database 31 in the management system 50, match the identification information of the terminal 50 with the identification information of the registered device, and if the matching is successful, the terminal 20 that sends the download request to the cloud 30 has the right to download the AI model; at this time, the cloud 30 issues at least one AI model to the terminal 20.
Of course, the download request may further include identification information of the AI model or a workpiece type of the workpiece, so that the cloud 30 issues the AI model required by the terminal 20 to the terminal 20.
Step S801 is similar to step S601 described above and is not described here.
Step S802: the cloud 30 obtains the workpiece type corresponding to the identification information according to the download request instruction.
As can be seen from the analysis of the above embodiment, in order to improve the detection accuracy, in the embodiment, the workpiece type is determined according to the feature information of the workpiece, and then the AI model is associated according to the workpiece type; therefore, in order to simplify the logical association, in the embodiment, the workpiece type is associated according to the identification information of the terminal 20, and then the AI model is associated according to the workpiece type, so that the workpiece feature information, the workpiece type, the identification information of the terminal 20, and the AI model can be associated in a unified manner.
Step S803: the cloud 30 acquires an AI model corresponding to the workpiece type and issues the AI model to the terminal 20.
Step S804: the terminal 20 acquires characteristic information of the workpiece.
Step S804 is similar to step S603 described above, and is not described herein again.
Step S805: the terminal 20 matches the characteristic information with preset characteristic information and detects the workpiece using the AI model matched with the preset characteristic information.
Step S805 is similar to step S604 described above and will not be described herein.
While the embodiment of fig. 6 selects an AI model according to the feature information of the workpiece, the embodiment further selects an AI model according to the identification information of the terminal 20 based on the embodiment of fig. 6, because in some application scenarios, different types of workpieces may be detected by using different terminals 20; therefore, the present embodiment can primarily select the AI by the identification information of the terminal 20 and then select the AI model again by using the feature information of the workpiece.
The present application further provides another embodiment of a cloud-based workpiece testing method, as shown in fig. 9, the workpiece detecting method of the present embodiment may be applied to the cloud-based workpiece detecting system 10. The workpiece detection method based on the cloud end comprises the following steps:
step S901: the terminal 20 acquires image information of the workpiece.
Specifically, image information of the workpiece may be acquired by the auxiliary device 40.
Step S902: the terminal 20 sends a download request to the cloud 30.
The download request of the embodiment includes a download request command and image information of the workpiece.
Step S902 is similar to step S801 described above, and is not described here in detail.
Step S903: the cloud 30 obtains the workpiece type corresponding to the image information according to the download request instruction.
As can be seen from the analysis of the above embodiment, in order to improve the detection accuracy, in this embodiment, a workpiece type is determined according to feature information of a workpiece, an AI model is associated according to the workpiece type, the type of the workpiece is associated according to identification information of the terminal 20, and then the AI model is associated according to the type of the workpiece, so to simplify the logical association, in this embodiment, the type of the workpiece is associated according to image information of the workpiece, and then the AI model is associated according to the type of the workpiece, so that the image information of the workpiece, the type of the workpiece, the identification information of the terminal 20, and the AI model can be associated uniformly.
Step S904: the AI model corresponding to the workpiece type is obtained and sent to the terminal 20.
Step S904 is similar to step S803 described above and will not be described in detail here.
Step S905: the terminal 20 acquires characteristic information of the workpiece.
Step S905 is similar to step S804 described above and is not described herein.
Step S906: the terminal 20 matches the characteristic information with preset characteristic information and detects the workpiece using the AI model matched with the preset characteristic information.
Step S906 is similar to step S805 described above and will not be described herein.
On the basis of the above embodiment, in the embodiment, the AI model is selected again according to the image information of the workpiece at the cloud 30, so that the detection accuracy and the detection efficiency of the workpiece can be further improved.
The present application further provides another embodiment of a cloud-based workpiece detection method, as shown in fig. 10, the workpiece detection method of the present embodiment may be applied to the cloud-based workpiece detection system 10. The workpiece detection method based on the cloud end comprises the following steps:
step S101: the terminal 20 sends a download request to the cloud 30.
Step S102: the cloud 30 issues at least one AI model to the terminal 20 according to the download request.
Step S103: the terminal 20 acquires characteristic information of the workpiece.
Step S104: the terminal 20 matches the characteristic information with preset characteristic information and detects the workpiece using the AI model matched with the preset characteristic information.
Steps S101 to S104 are similar to steps S601 to S604, and are not repeated here.
Step S105: the terminal 20 sends the detection result of the workpiece and the workpiece type of the detected workpiece to the cloud 30.
Step S106: the cloud 30 trains and updates the AI model corresponding to the workpiece type.
Specifically, the cloud 30 trains the AI model by using the AI module 33 thereof to update the AI model, thereby implementing deep learning of the AI model.
The present application further proposes a computer-readable storage medium, as shown in fig. 11, the computer-readable storage medium 80 of the present embodiment is used for storing the program instructions 810 of the above-mentioned embodiment, and the program instructions 810 can be executed by the method of the above-mentioned method embodiment. The program instructions 810 have been described in detail in the above method embodiments, and are not described in detail here.
The computer readable storage medium 80 of the embodiment may be, but is not limited to, a usb disk, an SD card, a PD optical drive, a removable hard disk, a high-capacity floppy drive, a flash memory, a multimedia memory card, a server, etc.
Different from the prior art, the workpiece detection method based on the cloud end comprises the following steps: the terminal sends a downloading request to the cloud; the cloud terminal issues at least one AI model to the terminal according to the downloading request; the terminal acquires the characteristic information of the workpiece; and the terminal matches the characteristic information with preset characteristic information and detects the workpiece by using an AI model corresponding to the preset characteristic information. By the mode, the characteristic information of the workpiece is matched with the preset characteristic information, and the AI model corresponding to the preset characteristic information is selected to detect the workpiece after the matching is successful, so that different AI models can be selected for the workpieces with different characteristic information to detect, the workpiece detection accuracy can be improved, the complexity of the AI model can be reduced, and the detection efficiency can be improved; therefore, the workpiece detection precision and the workpiece detection efficiency can be improved. The AI model can detect the workpiece at the terminal, the terminal does not need to send a large amount of acquired workpiece characteristic information to the cloud, network resources can be saved, and the problems that the cloud cannot receive the workpiece characteristic information and cannot detect the workpiece by the AI model due to poor factory network environment can be solved.
In addition, if the above functions are implemented in the form of software functions and sold or used as a standalone product, the functions may be stored in a storage medium readable by a mobile terminal, that is, the present application also provides a storage device storing program data, which can be executed to implement the method of the above embodiments, the storage device may be, for example, a usb disk, an optical disk, a server, etc. That is, the present application may be embodied as a software product, which includes several instructions for causing an intelligent terminal to perform all or part of the steps of the methods described in the embodiments.
In the description of the present application, reference to the description of the terms "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, mechanism, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present application. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, mechanisms, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present application, "plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and the scope of the preferred embodiments of the present application includes other implementations in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present application.
The logic and/or steps represented in the flowcharts or otherwise described herein, such as an ordered listing of executable instructions that can be viewed as implementing logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device (e.g., a personal computer, server, network device, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions). For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory. The above description is only an embodiment of the present application, and not intended to limit the scope of the present application, and all equivalent mechanisms or equivalent processes performed by the present application and the contents of the appended drawings, or directly or indirectly applied to other related technical fields, are all included in the scope of the present application.
Claims (11)
1. A workpiece detection method based on a cloud end is characterized by comprising the following steps:
the terminal sends a downloading request to the cloud;
the cloud terminal issues at least one AI model to the terminal according to the downloading request;
the terminal acquires the characteristic information of the workpiece;
and the terminal matches the characteristic information with preset characteristic information and detects the workpiece by using the AI model corresponding to the preset characteristic information.
2. The workpiece detection method according to claim 1, wherein the matching the feature information with preset characteristic information and the detecting the workpiece by using the AI model corresponding to the preset feature information comprises:
matching the characteristic information with preset characteristic information;
responding to the characteristic information and the preset characteristic information to be successfully matched, and acquiring the type of the workpiece comprising the workpiece;
and acquiring an AI model corresponding to the workpiece type to detect the workpiece.
Wherein the characteristic information includes at least any one of identification information, contour information, a shape, a color, or a size.
3. The workpiece detection method of claim 1, wherein the download request comprises a download request instruction and identification information of the terminal, and the issuing at least one AI model to the terminal according to the download request comprises:
acquiring a workpiece type corresponding to the identification information according to the downloading request instruction;
and acquiring an AI model corresponding to the workpiece type and issuing the AI model to the terminal.
4. The workpiece inspection method of claim 1, further comprising: acquiring image information of the workpiece, wherein the download request comprises a download request instruction and the image information, and issuing at least one AI model to the terminal according to the download request comprises:
acquiring a workpiece type corresponding to the image information according to the downloading request instruction;
and acquiring an AI model corresponding to the workpiece type and issuing the AI model to the terminal.
5. The workpiece inspection method according to any one of claims 1 to 4, characterized by further comprising:
the terminal sends the detection result of the workpiece and the type of the detected workpiece to the cloud end;
and the cloud end trains and updates the AI model corresponding to the workpiece type.
6. A workpiece detection system based on a cloud end is characterized by comprising: the system comprises a terminal and a cloud end communicated with the terminal; the terminal sends a downloading request to the cloud end; the cloud terminal issues at least one AI model to the terminal according to the downloading request; and the terminal acquires the characteristic information of the workpiece, matches the characteristic information with preset characteristic information, and detects the workpiece by using the AI model corresponding to the preset characteristic information.
7. The workpiece inspection system of claim 6, further comprising an auxiliary device in communication with the terminal for collecting characteristic information of the workpiece and transmitting the characteristic information to the terminal so that the terminal performs inspection based on the characteristic information using the AI model.
8. The workpiece inspection system of claim 7, wherein the auxiliary equipment comprises:
the image sensor is used for acquiring image information of the workpiece so that the terminal can acquire the characteristic information from the image information;
a light source to provide light compensation for the image sensor;
and the visual controller is used for realizing the control of the image sensor and the analysis of the image information.
9. The system of claim 7, further comprising a management system integrated with the terminal or the cloud, wherein the management system comprises:
the equipment management module is used for realizing the management of the terminal and the auxiliary equipment;
the AI model management module is used for realizing the management of the AI model;
and the interface management module is used for realizing the interface management of the workpiece detection system based on the cloud.
10. The workpiece inspection system of claim 9, wherein the cloud comprises: the database is used for storing the AI model, the characteristic information of the workpiece and preset characteristic information;
the HDFS is used for realizing access to the database;
and the AI module is used for updating and training the AI model.
11. A computer-readable storage medium, characterized in that the computer-readable storage medium stores program instructions executable to implement the workpiece detection method of any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011615606.8A CN112712505A (en) | 2020-12-30 | 2020-12-30 | Workpiece detection method and system based on cloud and computer-readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011615606.8A CN112712505A (en) | 2020-12-30 | 2020-12-30 | Workpiece detection method and system based on cloud and computer-readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112712505A true CN112712505A (en) | 2021-04-27 |
Family
ID=75547429
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011615606.8A Pending CN112712505A (en) | 2020-12-30 | 2020-12-30 | Workpiece detection method and system based on cloud and computer-readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112712505A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113342382A (en) * | 2021-06-30 | 2021-09-03 | 北京京东乾石科技有限公司 | Data verification method and system and edge terminal equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108235763A (en) * | 2017-12-20 | 2018-06-29 | 深圳达闼科技控股有限公司 | Detecting system, method and relevant apparatus |
| CN111080633A (en) * | 2019-12-20 | 2020-04-28 | Oppo（重庆）智能科技有限公司 | Screen defect detection method and device, terminal equipment and storage medium |
| CN111539923A (en) * | 2020-04-17 | 2020-08-14 | 西安数合信息科技有限公司 | Digital ray detection method and system for weld defects and server |
| CN112082999A (en) * | 2020-07-27 | 2020-12-15 | 深检数据科技(江苏)有限公司 | Industrial product defect detection method and industrial intelligent camera |
| CN112102263A (en) * | 2020-08-31 | 2020-12-18 | 深圳思谋信息科技有限公司 | Defect detection model generation system, method and device and computer equipment |
-
2020
- 2020-12-30 CN CN202011615606.8A patent/CN112712505A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108235763A (en) * | 2017-12-20 | 2018-06-29 | 深圳达闼科技控股有限公司 | Detecting system, method and relevant apparatus |
| CN111080633A (en) * | 2019-12-20 | 2020-04-28 | Oppo（重庆）智能科技有限公司 | Screen defect detection method and device, terminal equipment and storage medium |
| CN111539923A (en) * | 2020-04-17 | 2020-08-14 | 西安数合信息科技有限公司 | Digital ray detection method and system for weld defects and server |
| CN112082999A (en) * | 2020-07-27 | 2020-12-15 | 深检数据科技(江苏)有限公司 | Industrial product defect detection method and industrial intelligent camera |
| CN112102263A (en) * | 2020-08-31 | 2020-12-18 | 深圳思谋信息科技有限公司 | Defect detection model generation system, method and device and computer equipment |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113342382A (en) * | 2021-06-30 | 2021-09-03 | 北京京东乾石科技有限公司 | Data verification method and system and edge terminal equipment |
| CN113342382B (en) * | 2021-06-30 | 2024-04-09 | 北京京东乾石科技有限公司 | Data verification method, system and edge terminal equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112712504B (en) | Cloud-based workpiece detection method and system and computer-readable storage medium | |
| CN105817430B (en) | Product inspection method based on machine vision | |
| CN107179324B (en) | The methods, devices and systems of testing product packaging | |
| US11080844B2 (en) | System and method for testing an electronic device | |
| US11954846B2 (en) | Explainability and complementary information for camera-based quality assurance inspection processes | |
| CN112711603A (en) | Workpiece detection method and system based on cloud and computer-readable storage medium | |
| US20230048386A1 (en) | Method for detecting defect and method for training model | |
| CN112712505A (en) | Workpiece detection method and system based on cloud and computer-readable storage medium | |
| CN115695541A (en) | Method, device and equipment for monitoring dot polling based on edge calculation and storage medium | |
| US11961218B2 (en) | Machine vision systems and methods for automatically generating one or more machine vision jobs based on region of interests (ROIs) of digital images | |
| Variz et al. | Machine learning applied to an intelligent and adaptive robotic inspection station | |
| US20220394215A1 (en) | Multi-Image Sensor Module for Quality Assurance | |
| US20220284699A1 (en) | System and method of object detection using ai deep learning models | |
| CN103913150A (en) | Consistency detection method for electron components of intelligent ammeter | |
| CN113449701B (en) | Vision-based lightweight capacity control method under industrial Internet of things | |
| CN114218430A (en) | Remote cooperative equipment operation and maintenance system, method and device | |
| CN109344799B (en) | Article identification method, article identification device, article identification equipment, storage medium and electronic device | |
| CN110252686A (en) | The determination method and device of remote controler quality | |
| CN112714284A (en) | Power equipment detection method and device and mobile terminal | |
| US20230245433A1 (en) | Systems and Methods for Implementing a Hybrid Machine Vision Model to Optimize Performance of a Machine Vision Job | |
| ZeChern | Towards Industry 4.0: Color-based object sorting using a robot arm and real-time object detection | |
| CN116703905B (en) | Empty material detection method, device, electronic equipment and computer readable storage medium | |
| CN113632099B (en) | Distributed product defect analysis system, method and computer readable storage medium | |
| US20230095647A1 (en) | Systems and Methods for Precise Anomaly Localization Within Content Captured by a Machine Vision Camera | |
| KR102623979B1 (en) | Masking-based deep learning image classification system and method therefor |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |