CN112988316A - Industrial vision system development method based on BS architecture and storage medium - Google Patents
Industrial vision system development method based on BS architecture and storage medium Download PDFInfo
- Publication number
- CN112988316A CN112988316A CN202110543769.8A CN202110543769A CN112988316A CN 112988316 A CN112988316 A CN 112988316A CN 202110543769 A CN202110543769 A CN 202110543769A CN 112988316 A CN112988316 A CN 112988316A
- Authority
- CN
- China
- Prior art keywords
- program
- industrial vision
- industrial
- instruction
- architecture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/70—Software maintenance or management
- G06F8/71—Version control; Configuration management
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computer Security & Cryptography (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present application relates to the field of industrial vision technologies, and in particular, to a BS architecture-based industrial vision system development method and a storage medium. The method comprises the steps of receiving a second instruction sent by a server side; establishing an industrial visual program according to the first instruction and the second instruction, and displaying the industrial visual program in a first user interface; analyzing the industrial vision program to obtain configuration information of the industrial vision program; calculating according to the configuration information of the industrial vision program to obtain the operation result of the industrial vision program; the results of the operation of the industrial vision program are displayed in the second user interface. The industrial vision system is established through the BS architecture, so that a local user and a non-local user can be supported to deploy an industrial vision program at the same time, and the user experience is improved.
Description
Technical Field
The present application relates to the field of industrial vision technologies, and in particular, to a BS architecture-based industrial vision system development method, a client, a server, and a computer-readable storage medium.
Background
In the field of industrial vision, corresponding solutions are rapidly provided for different industrial vision application scenes through visual tool software, and efficient and rapid delivery of projects is supported. Traditional industrial vision software is developed and deployed based on local application, belongs to stand-alone application, is connected through Windows remote control even in remote access, and can only be accessed to one person at a time by the method, and cannot meet the requirement of multi-user cooperative operation.
Disclosure of Invention
In view of the above, embodiments of the present application provide at least a BS architecture-based industrial vision system development method and a storage medium.
The application mainly comprises the following aspects:
in a first aspect, an embodiment of the present application provides a BS architecture-based industrial vision system development method, including: acquiring a first instruction of a local user based on a user interface of a local browser;
receiving a second instruction sent by the server;
establishing an industrial visual program according to the first instruction and the second instruction, and displaying the industrial visual program in a first user interface;
analyzing the industrial vision program to obtain configuration information of the industrial vision program;
calculating according to the configuration information of the industrial vision program to obtain the operation result of the industrial vision program;
the results of the operation of the industrial vision program are displayed in the second user interface.
The first instruction and the second instruction are used for configuring input information of the industrial visual program according to an application scene, and the second instruction is an instruction of a non-local user acquired by a remote browser.
In a possible implementation, the user interface includes at least a plurality of configuration tools, the plurality of configuration tools are constructed based on WEB technology, and the configuration tools include at least: pattern acquisition, ROI region, calibration tools, mathematical morphology, geometric transformation, color processing, Blob analysis, shape fitting, geometry creation, geometry measurement, intersection measurement, pattern matching, two-dimensional code recognition, one-dimensional code recognition, OCR recognition, image filtering, communication and system.
In a possible embodiment, each configuration tool comprises a plurality of functional submodules, each functional submodule is provided with a preset program corresponding to its function, each functional submodule comprises an input and an output, and the input and the output of any functional submodule can be connected.
In a possible embodiment, the step of parsing the industrial vision program and acquiring the configuration information of the industrial vision program specifically includes: analyzing the industrial visual program, and acquiring the connection information of a plurality of functional sub-modules, the configuration parameters of the plurality of sub-modules and the preset programs of the plurality of sub-modules in the industrial visual program.
In a possible embodiment, the step of performing calculation according to the configuration information of the industrial vision program and obtaining the operation result of the industrial vision program specifically includes: and performing system simulation operation according to the connection information, the configuration parameters and the preset program of the plurality of functional sub-modules, and taking the result of the system simulation operation as the operation result of the industrial visual program.
In one possible embodiment, the industrial vision program includes at least: a positioning guide program, a character recognition program, a size measurement program and a flaw detection program.
In a second aspect, an embodiment of the present application further provides a BS architecture-based industrial vision system development method, for a server, including:
acquiring a second instruction of the non-local user based on the user interface of the remote browser;
sending a second instruction to the client;
receiving configuration information of an industrial vision program;
calculating according to the configuration information of the industrial vision program to obtain the operation result of the industrial vision program;
and sending the operation result of the industrial vision program to the client.
In a third aspect, an embodiment of the present application further provides a client, configured to execute the BS architecture-based industrial vision system development method provided in the first aspect.
In a fourth aspect, an embodiment of the present application further provides a server side, configured to execute the BS architecture-based industrial vision system development method provided in the second aspect.
In a fifth aspect, the present application further provides a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to perform the steps of the BS architecture based industrial vision system development method in any one of the possible implementations of the first aspect or the second aspect.
According to the BS architecture-based industrial vision system development method and the storage medium, a first instruction of a local user is obtained based on a user interface of a local browser, and a second instruction sent by a non-local user in a remote browser can be received. The industrial vision program is configured through the first instruction and the second instruction together, and is established based on the first instruction and the second instruction and displayed in the first user interface. And analyzing the configured industrial visual program, acquiring configuration information of the industrial visual program, performing system operation according to the configuration information of the industrial visual program to obtain an operation result, and displaying the operation result in the second user interface. The industrial vision system is established through the BS architecture, so that a local user and a non-local user can be supported to deploy an industrial vision program at the same time, and the user experience is improved.
In order to make the aforementioned objects, features and advantages of the present application more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained from the drawings without inventive effort.
FIG. 1 is a flow chart illustrating a BS architecture-based industrial vision system development method provided by an embodiment of the present application;
FIG. 2 is a flow chart of another BS architecture-based industrial vision system development method provided by an embodiment of the application;
FIG. 3 is a flow chart of a method for developing an industrial vision system based on a BS architecture according to an embodiment of the present application;
FIG. 4 is a diagram illustrating an architecture of an industrial time system development platform based on a BS architecture according to an embodiment of the present application;
FIG. 5 is a schematic diagram of a user interface of an industrial time system development platform based on a BS architecture according to an embodiment of the present application;
FIG. 6 is a second schematic diagram of a user interface of an industrial time system development platform based on a BS architecture according to an embodiment of the present disclosure;
fig. 7 shows a schematic structural diagram of an electronic device provided in an embodiment of the present application.
Description of the main element symbols:
400-an electronic device; 401-a processor; 402-a communication bus; 403-a user interface; 404-a network interface; 405-a memory; 4051-operating system; 4052-application program.
Detailed Description
To make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it should be understood that the drawings in the present application are for illustrative and descriptive purposes only and are not used to limit the scope of protection of the present application. Additionally, it should be understood that the schematic drawings are not necessarily drawn to scale. The flowcharts used in this application illustrate operations implemented according to some embodiments of the present application. It should be understood that the operations of the flow diagrams may be performed out of order, and that steps without logical context may be performed in reverse order or concurrently. One skilled in the art, under the guidance of this application, may add one or more other operations to, or remove one or more operations from, the flowchart.
In addition, the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. The components of the embodiments of the present application, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present application without making any creative effort, shall fall within the protection scope of the present application.
To enable those skilled in the art to utilize the present disclosure, the following embodiments are presented in conjunction with a specific application scenario, "BS architecture-based industrial vision system development," for which it would be apparent to those skilled in the art that the general principles defined herein may be applied to other embodiments and application scenarios without departing from the spirit and scope of the present application.
The following method, apparatus, electronic device or computer-readable storage medium in the embodiments of the present application may be applied to any scenario that requires BS architecture-based industrial vision system development, and the embodiments of the present application do not limit specific application scenarios, and any scheme that uses the BS architecture-based industrial vision system development method and the storage medium provided in the embodiments of the present application is within the scope of the present application.
It is worth noting that, before the application is proposed, the existing scheme uses visual tool software to quickly provide a solution for different industrial visual application scenarios, and supports a project to complete efficient and quick delivery. However, the conventional industrial vision software is developed and deployed based on local application at present and belongs to stand-alone application. If the current industrial vision program is deployed by remote access, the desktop of the local client can be controlled only through Windows remote control access. However, this method can only support access by one worker each time, so the existing industrial vision software cannot meet the requirement that the local user and the non-local user in the fixed application scene deploy the same industrial vision program at the same time.
Furthermore, in existing industrial vision systems, providing graphical editing vision tools is typically developed based on CS software graphics, such as C # or QT technology. Such patterning tools provide a limited number of tools.
In view of the above problems, embodiments of the present application provide a BS architecture-based industrial vision system development method and a storage medium, which are described below by way of embodiments.
For the convenience of understanding of the present application, the technical solutions provided in the present application will be described in detail below with reference to specific embodiments.
Example one
Fig. 1 is a flowchart of a BS architecture-based industrial vision system development method according to an embodiment of the present disclosure. As shown in fig. 1, the BS architecture-based industrial vision system development method provided in the embodiment of the present application is applied to a client, and includes the following steps:
s101: acquiring a first instruction of a local user based on a user interface of a local browser;
s102: receiving a second instruction sent by the server;
s103: establishing an industrial visual program according to the first instruction and the second instruction, and displaying the industrial visual program in a first user interface;
s104: analyzing the industrial vision program to obtain configuration information of the industrial vision program;
s105: calculating according to the configuration information of the industrial vision program to obtain the operation result of the industrial vision program;
s106: the results of the operation of the industrial vision program are displayed in the second user interface.
The first instruction and the second instruction are used for configuring input information of the industrial visual program according to an application scene, and the second instruction is an instruction of a non-local user acquired by a remote browser.
In step S101, a local user deploys an industrial visual program in a user interface of a browser of a local client, and issues a first instruction. The first instruction is an instruction of a local user, and parameter configuration of each sub-module, connection relation configuration between modules and the like can be completed through mouse clicking or finger touch screen sliding and the like.
In step S102, the client receives the second instruction sent by the server. And the second instruction is a configuration instruction which is sent by a non-local user through a user interface of the remote browser and aims at the same industrial vision program. The second instruction can complete parameter configuration of each sub-module, connection relation configuration between modules and the like through mouse clicking or finger touch screen sliding and other operations.
In step S103, as shown in fig. 5, the industrial vision program is created according to the first instruction and the second instruction, and the industrial vision program is displayed in the first user interface. Wherein the first user interface includes a system user interface of a local user and a system user interface of a non-local user. Both local and non-local users can see the details of the configured industrial vision program through the browser.
Wherein, step S103 may further include: and sending the first instruction and the second instruction to a server side, and generating the flow of the industrial vision program through the server side. And the server side sends the generated industrial visual program to the client side, and the client side displays the received industrial visual program in the first user interface.
In step S104, the industrial vision program is analyzed to acquire configuration information of the industrial vision program. And analyzing the configured industrial vision program to obtain the industrial vision program configured and generated by the local user and the non-local user.
Specifically, step S104 specifically includes: analyzing the industrial visual program, and acquiring the connection information of a plurality of functional sub-modules, the configuration parameters of the plurality of sub-modules and the preset programs of the plurality of sub-modules in the industrial visual program.
It is understood that a local user or a non-local user can configure the configuration tool provided in the user interface according to needs, wherein the configuration tool comprises a plurality of functional sub-modules. By connecting a plurality of functional sub-modules, a complete industrial visual program can be formed, and the parameters of each functional sub-module can be customized. Therefore, the industrial vision program is analyzed, and the connection information of the plurality of functional sub-modules, the configuration parameters of the plurality of sub-modules and the preset programs of the plurality of sub-modules can be obtained. The preset program of the submodule is preset in the building and developing platform and is used for realizing the corresponding function of the functional submodule.
In step S105, the industrial vision program is run based on the configuration information of the industrial vision program obtained by the analysis, and a final running result is obtained.
Specifically, the analyzed industrial visual program can be sent to the server, the operation of the industrial visual program is completed through the server, and the operation result sent by the server is received. The server side is used for completing the operation, so that the burden of the client side is reduced, and the operation time of the industrial vision program is shortened.
In step S106, the acquired operation result of the industrial vision program is displayed in the second user interface. The second user interface is used for displaying the results of the industrial vision system, and comprises a system user interface of a local user and a system user interface of a non-local user, namely all users participating in the configuration of the industrial vision system can see the calculation results.
Specifically, in addition to displaying the operation result in the second user interface, information related to the operation result is also displayed in the second user interface, for example, when the output operation result is a picture, information such as a gray value and a gray histogram of the picture may be displayed in a sidebar. The display mode can also be set and adjusted, for example, when the output operation result is a picture, the size, the direction and the like of the displayed picture can be adjusted. And the user can conveniently obtain the detailed information of the program running result, and further implement the project.
As shown in fig. 6, it can be understood that each functional sub-module in the configured industrial visual program may output a corresponding operation result, a user may click the corresponding functional sub-module, and the operation result of the node corresponding to the current functional sub-module may be displayed in the second user interface. And the second user interface displays the operation processing time of the current functional submodule node, wherein the operation processing time comprises the current processing time, the average processing time, the minimum processing time and the maximum processing time. The operation of the current node may be a single trigger or a round-robin trigger. The user can select according to actual need, can also self-define the interval time that triggers simultaneously. If the operation result is obtained through single trigger, if the current obtained result does not achieve the ideal effect, the parameter configuration of the input or functional sub-module is adjusted through circulating trigger simultaneously to obtain a satisfactory processing effect, and the requirements of users are met.
The second user interface can also display the parameter configuration of the current functional sub-module, and can also perform input setting, output setting or detailed setting on the current output result. If the current operation result is a picture, the gray value output by the picture can be adjusted.
In the embodiment, the first instruction of the local user and the second instruction of the non-local user are respectively obtained, the industrial vision system is cooperatively configured, a working scene developed by multiple users at the same time is met, and project site implementation of an industrial vision application scene can be realized by combining industrial motion control application. And an operation platform can be provided for education and popularization of the industrial vision system in a multi-user online deployment mode.
Further, the user interface at least comprises a plurality of configuration tools, the plurality of configuration tools are constructed based on the WEB technology, and the configuration tools at least comprise: pattern acquisition, ROI region, calibration tools, mathematical morphology, geometric transformation, color processing, Blob analysis, shape fitting, geometry creation, geometry measurement, intersection measurement, pattern matching, two-dimensional code recognition, one-dimensional code recognition, OCR recognition, image filtering, communication and system.
Specifically, a toolbar is arranged on a user interface of the development platform, and the toolbar includes a plurality of configuration tools, and the configuration tools are used for constructing an industrial visual program, and include a graph acquisition tool, an ROI region tool, a calibration tool, a mathematical morphology tool, a geometric transformation tool, a color processing tool, a Blob analysis tool, a shape fitting tool, a geometric creation tool, a geometric measurement tool, an intersection measurement tool, a pattern matching tool, a two-dimensional code recognition tool, a one-dimensional code recognition, an OCR recognition, an image filtering, a communication and a system, and the like. By selecting a plurality of tools for combined connection, the industrial vision system applied to different scenes can be deployed. In the embodiment, a configuration tool for industrial visual program deployment is constructed by adopting a WEB technology, graphical tools with common functions are provided, a user can deploy a program in a quick drag operation mode, an industrial visual detection application constructed by zero-code programming is provided, and a development process is simplified. Compared with a graphical tool constructed by the UI technology in the traditional scheme, the provided tool is richer.
Specifically, the tool bar on the user interface further comprises a setting bar, a canvas status bar and the like. The setting bar can adjust and set the current industrial visual program and can also open some auxiliary functions provided by the development platform. The canvas status bar is used to display status information of the canvas.
Furthermore, each configuration tool comprises a plurality of function submodules, each function submodule is provided with a preset program corresponding to the function of the function submodule, each function submodule comprises an input end and an output end, and the input end and the output end of any function submodule can be connected.
Each configuration tool in the user interface comprises a plurality of function submodules, the function submodules are preset with corresponding functions and preset programs corresponding to the functions of the function submodules, each function submodule comprises an input end and an output end, and the input end and the output end of any function submodule can be connected. The user can select the functional sub-modules with the required functions according to the requirements, and the functional sub-modules are connected according to the logic to form a complete industrial visual program.
Specifically, the running time of each node is also displayed on each functional sub-module, so that a user can be helped to obtain the operation information of each node, and the program can be modified or the error existing in the program can be found. If the running time of a certain functional submodule is 0, the node is not connected in the program or the node is not running.
The functional sub-modules of the image acquisition tool comprise a camera tool, a line scanning camera, a static image and an analog camera.
Functional sub-modules of the ROI area tool include ROI settings.
The functional sub-modules of the calibration tool comprise camera calibration, static calibration, nine-point calibration, first piece calibration, motion compensation, 2D coordinate matrix conversion, single-point deviation correction, two-point deviation correction, single-point rotation deviation correction and two-point rotation deviation correction.
The functional sub-modules of the mathematical morphology tool comprise region expansion, region erosion, region opening operation, region closing operation, gray scale expansion, gray scale erosion, gray scale opening operation, gray scale closing operation, gray scale top cap, gray scale bottom cap and gray scale watershed.
The functional sub-modules of the geometric transformation tool comprise image cutting, image correction, image alignment, image mirroring, image subtraction, image averaging, affine transformation, ROI alignment, BOI/region image, projection correction, coordinate adjustment, polarity expansion, splicing calibration and multi-input splicing.
The functional sub-modules of the color processing tool include color channel, red channel, green channel, blue channel, gray scale conversion, color extraction and color matching.
Functional sub-modules of the Blob analysis tool comprise a global threshold, an automatic threshold, a dynamic threshold, a high-level threshold, a region difference, a region superposition, a region feature selection, a gray feature selection, an area feature, a roundness feature, a compactness feature, a contour length feature, a region feature calculation, a gray feature calculation, an area, a roundness, a compactness and a contour length.
The functional sub-modules of the shape fitting tool comprise straight line fitting, circle fitting, ellipse fitting, Hough circle finding, caliper circle finding, line finding and edge pair finding.
Functional sub-modules of the geometry creation tool include circles, ellipses, straight lines, line segments, perpendicular lines, perpendicular bisectors, parallel lines, and mean lines.
The functional sub-modules of the geometric measuring tool comprise a point-line distance, a point-section distance, a point-circle distance, a point-point distance, a section-circle distance, a section-ellipse distance, a section-section distance, a section-line distance, a line-line included angle, a line-circle distance, a line-ellipse distance, a circle-circle distance, an edge pair measurement and a straight line gradient.
The functional sub-modules of the intersection measuring tool comprise coordinate turning points, line-line intersection, line-circle intersection, segment-line intersection, segment-segment intersection, segment-circle intersection, circle-circle intersection, line-ellipse intersection and segment-ellipse intersection.
The functional sub-modules of the pattern matching tool include a shape model, a multi-shape model, a grayscale model, a DXF model, a multi DXF model, a grayscale search, a shape search, a multi-shape model search-1, a multi-grayscale model search, and a matching label.
The functional sub-modules of the two-dimension Code recognition tool comprise two-dimension Code training, two-dimension Code recognition, a two-dimension Code, QR, Aztec Code, Data Matrix, Micro QR and PDF 417.
The functional sub-modules of the one-dimensional Code recognition tool comprise one-dimensional codes, Code 39, Code 128, EAN-8, EAN-13, UPC-A, UPC-E and 2/5 Interleaved.
The functional sub-modules of the OCR recognition tool comprise OCR-1 training, OCR-2 training, OCR-1 recognition and OCR-2 recognition.
The functional sub-modules of the image filtering tool comprise mean filtering, Gaussian filtering, median filtering, contrast increasing and image multiplying.
The functional sub-modules of the communication tool comprise serial ports.
The functional sub-modules of the system tool comprise an image storage module, a result analysis module, a tool module, an image interface and a message receiving module.
Further, the industrial vision program includes at least: a positioning guide program, a character recognition program, a size measurement program and a flaw detection program. Through the development platform, a positioning guide program, a character recognition program, a size measurement program and a flaw detection program can be constructed. For example, when a user needs to configure an industrial visual program configuration for Blob analysis, a static image function sub-module of an image acquisition tool is set as an input in a dragging mode, and is respectively connected with an ROI setting function sub-module, a global threshold function sub-module, a gray feature selection function sub-module, an image multiplication function sub-module, an OCR-1 training function sub-module and a region feature selection function sub-module according to a preset program, and finally a gray feature calculation function sub-module and a region feature calculation function sub-module are set as outputs, and a foreground and background separated binary image is finally output.
Example two
Based on the same application concept, fig. 2 is a flowchart of an industrial vision system development method based on a BS architecture according to an embodiment of the present application. As shown in fig. 2, the BS architecture-based industrial vision system development method provided in the embodiment of the present application is applied to a server side, and includes the following steps:
step S201: acquiring a second instruction of the non-local user based on the user interface of the remote browser;
step S202: and sending a second instruction to the client.
In step S201, the non-local user may log in the development platform through the browser by using other terminal devices except the local terminal, log in the same project as the local user in the multi-user cooperation mode, and display a user interface of the development platform in the browser, and the non-local user may complete parameter configuration of each sub-module, configuration of connection relationship between modules, and the like by clicking with a mouse or by sliding with a finger touch screen.
In the embodiment, the first instruction of the local user and the second instruction of the non-local user are respectively obtained, the industrial vision system is cooperatively configured, a working scene developed by multiple users at the same time is met, and project site implementation of an industrial vision application scene can be realized by combining industrial motion control application. And an operation platform can be provided for education and popularization of the industrial vision system in a multi-user online deployment mode.
In another embodiment, as shown in fig. 3, the server may further perform:
s301, receiving configuration information of the industrial vision program;
step S302: calculating according to the configuration information of the industrial vision program to obtain the operation result of the industrial vision program;
step S303: and sending the operation result of the industrial vision program to the client.
In the embodiment, the server receives the configuration of the front end, generates the operation result of the industrial visual program according to the configuration information, sends the operation result to the client, and displays the operation result on the front end.
EXAMPLE III
As shown in fig. 4, a block diagram of a BS architecture based industrial vision system development platform is provided for embodiments of the present application. Embodiments of the present application provide a BS architecture based industrial vision system development platform.
Further, the industrial vision system development platform provided by the embodiment of the application is based on a WEB front-end technology, and the system and an image back-end processing algorithm are combined to complete construction of the industrial vision development platform. The front-end system comprises a visual tool constructed based on WEB technology and a graphical configuration tool. The local user or the remote user can drag the required function sub-module to the configuration area, connect according to the scene requirement, configure the parameters in the configuration tool, and the like, thereby completing the configuration of the industrial visual process. And the back end system, namely the server end system, receives the configuration information sent by the front end system, generates the industrial visual program and operates the industrial visual program.
The front-end system communicates with the client and receives a configuration instruction sent by a user on a human-computer interface, such as an instruction for adding a functional sub-module, an instruction for connecting the functional sub-module or an instruction for modifying the configuration parameters of the functional sub-module. And the rear end, namely the server end, receives the configuration data of the front end, generates a corresponding industrial visual program and displays the industrial visual program in the human-computer interface.
The industrial vision development platform comprises a WEB configuration module, a man-machine interaction module, an REST interface module, a configuration management module, an application management module, a service monitoring module, a camera monitoring module, a motion control module and an algorithm library SDK module. The WEB configuration module and the human-computer interaction module are communicated with the REST interface module in an HTTP mode, the motion control module is communicated with the scene visual application in an MQTT mode, the configured industrial visual program is sent to the industrial motion control application, and the project landing of an industrial visual scene can be realized. The well-configured industrial vision program control equipment is used for working, and positioning, guiding and assembling of products, size measurement of the products, character recognition of the products, flaw detection of the products and the like can be achieved.
Example four
Based on the same application concept, the embodiment of the application also provides the client. The client is used for executing the industrial vision system development method based on the BS architecture in the first embodiment.
EXAMPLE five
Based on the same application concept, the embodiment of the application also provides a server side. The client is used for executing the BS architecture-based industrial vision system development method in the second embodiment.
EXAMPLE six
Based on the same application concept, referring to fig. 7, a structure of an electronic device 400 provided in an embodiment of the present application is that the electronic device 400 includes: at least one processor 401, at least one network interface 404 or other user interface 403, memory 405, at least one communication bus 402. A communication bus 402 is used to enable connective communication between these components. The electronic device 400 optionally contains a user interface 403 including a display (e.g., touchscreen, LCD, CRT, Holographic (Holographic) or projection (Projector), etc.), a keyboard or a pointing device (e.g., mouse, trackball (trackball), touch pad or touchscreen, etc.).
In some embodiments, memory 405 stores the following elements, executable modules or data structures, or a subset thereof, or an expanded set thereof:
an operating system 4051, which contains various system programs, for implementing various basic services and processing hardware-based tasks;
the application programs 4052 include various application programs such as a desktop (launcher), a Media Player (Media Player), a Browser (Browser), and the like, for implementing various application services.
In an embodiment of the present invention, the processor 401 is configured to execute the steps of the BS architecture-based industrial vision system development method provided in any of the above embodiments by calling a program or instructions stored in the memory 405.
Based on the same application concept, the present application further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program performs the steps of the BS-architecture-based industrial vision system development method provided by the foregoing embodiment.
Specifically, the storage medium can be a general storage medium, such as a mobile disk, a hard disk, and the like, when a computer program on the storage medium is run, the BS architecture-based industrial vision system development method can be executed, and the industrial vision system is cooperatively configured by respectively obtaining a first instruction of a local user and a second instruction of a non-local user, so that a working scenario of simultaneous development among multiple users is satisfied, and project implementation of an industrial vision application scenario can be realized in combination with an industrial motion control application. And an operation platform can be provided for education and popularization of the industrial vision system in a multi-user online deployment mode.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the system and the apparatus described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again. In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and there may be other divisions when actually implemented, and for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of devices or units through some communication interfaces, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a non-volatile computer-readable storage medium executable by a processor. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (10)
1. A BS architecture-based industrial vision system development method is used for a client, and is characterized by comprising the following steps:
acquiring a first instruction of a local user based on a user interface of a local browser;
receiving a second instruction sent by the server;
establishing an industrial visual program according to the first instruction and the second instruction, and displaying the industrial visual program in a first user interface;
analyzing the industrial vision program to obtain configuration information of the industrial vision program;
calculating according to the configuration information of the industrial vision program to obtain the operation result of the industrial vision program;
displaying the operation result of the industrial vision program in a second user interface;
the first instruction and the second instruction are used for configuring input information of an industrial visual program according to an application scene, and the second instruction is an instruction of a non-local user acquired by a remote browser.
2. The BS architecture-based industrial vision system development method according to claim 1, wherein the user interface at least comprises a plurality of configuration tools, and the plurality of configuration tools are constructed based on WEB technology, and the method comprises:
the configuration tool comprises at least: pattern acquisition, ROI region, calibration tools, mathematical morphology, geometric transformation, color processing, Blob analysis, shape fitting, geometry creation, geometry measurement, intersection measurement, pattern matching, two-dimensional code recognition, one-dimensional code recognition, OCR recognition, image filtering, communication and system.
3. The BS architecture-based industrial vision system development method of claim 2, wherein:
each configuration tool comprises a plurality of function sub-modules, the function sub-modules are provided with preset programs corresponding to functions of the function sub-modules, each function sub-module comprises an input end and an output end, and the input ends and the output ends of the function sub-modules can be connected arbitrarily.
4. The BS architecture-based industrial vision system development method according to claim 1, wherein the step of parsing the industrial vision program and obtaining configuration information of the industrial vision program specifically comprises:
analyzing the industrial visual program to obtain the connection information of a plurality of functional sub-modules, the configuration parameters of the plurality of sub-modules and the preset programs of the plurality of sub-modules in the industrial visual program.
5. The BS architecture-based industrial vision system development method according to claim 4, wherein the step of performing the calculation according to the configuration information of the industrial vision program and obtaining the operation result of the industrial vision program specifically comprises:
and performing system simulation operation according to the connection information, the configuration parameters and the preset program of the plurality of functional sub-modules, and taking the result of the system simulation operation as the operation result of the industrial vision program.
6. The BS architecture-based industrial vision system development method of claim 1, wherein the industrial vision program comprises at least:
a positioning guide program, a character recognition program, a size measurement program and a flaw detection program.
7. A BS architecture-based industrial vision system development method is used for a server side and is characterized by comprising the following steps:
acquiring a second instruction of the non-local user based on the user interface of the remote browser;
sending the second instruction to a client;
receiving configuration information of an industrial vision program;
calculating according to the configuration information of the industrial vision program to obtain the operation result of the industrial vision program;
and sending the operation result of the industrial vision program to the client.
8. A client, comprising:
for performing the BS architecture based industrial vision system development method of any one of claims 1-6.
9. A server side, comprising:
for performing the BS architecture based industrial vision system development method of claim 7.
10. A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, which computer program, when being executed by a processor, performs the steps of the method as set forth in any one of claims 1 to 6 or claim 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110543769.8A CN112988316B (en) | 2021-05-19 | 2021-05-19 | Industrial vision system development method based on BS architecture and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110543769.8A CN112988316B (en) | 2021-05-19 | 2021-05-19 | Industrial vision system development method based on BS architecture and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112988316A true CN112988316A (en) | 2021-06-18 |
| CN112988316B CN112988316B (en) | 2021-10-26 |
Family
ID=76336811
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110543769.8A Active CN112988316B (en) | 2021-05-19 | 2021-05-19 | Industrial vision system development method based on BS architecture and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112988316B (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103105193A (en) * | 2011-11-15 | 2013-05-15 | 株式会社三丰 | Precision machine vision inspection system and method for operating the same |
| US20130125044A1 (en) * | 2011-11-15 | 2013-05-16 | Mitutoyo Corporation | Machine Vision System Program Editing Environment Including Synchronized User Interface Features |
| CN103825894A (en) * | 2014-02-21 | 2014-05-28 | 南京莱斯信息技术股份有限公司 | Multi-screen application system based on browser B / S structure |
| CN108181878A (en) * | 2018-01-04 | 2018-06-19 | 江苏科瑞恩自动化科技有限公司 | A kind of kinetic control system for the equipment containing vision system |
| CN108628597A (en) * | 2018-04-25 | 2018-10-09 | 赵宇 | A kind of NI Vision Builder for Automated Inspection development approach and device |
| CN109690473A (en) * | 2017-09-11 | 2019-04-26 | 深圳配天智能技术研究院有限公司 | A kind of graphic programming method, apparatus, computer storage medium and vision system |
| CN208890936U (en) * | 2018-08-29 | 2019-05-21 | 泰科电子(上海)有限公司 | Vision system |
| CN112363730A (en) * | 2020-11-06 | 2021-02-12 | 上海节卡机器人科技有限公司 | Visual item deployment method, visual system, electronic equipment and storage medium |
| CN112463138A (en) * | 2020-11-18 | 2021-03-09 | 华南师范大学 | Software and hardware combined artificial intelligence education learning system |
| CN112558974A (en) * | 2019-09-26 | 2021-03-26 | 罗克韦尔自动化技术公司 | Systems, methods, and computer media for collaborative development of industrial applications |
-
2021
- 2021-05-19 CN CN202110543769.8A patent/CN112988316B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103105193A (en) * | 2011-11-15 | 2013-05-15 | 株式会社三丰 | Precision machine vision inspection system and method for operating the same |
| US20130120553A1 (en) * | 2011-11-15 | 2013-05-16 | Mitutoyo Corporation | Machine vision system editing environment for a part program in which a continuous stream of image acquisition operations are performed during a run mode |
| US20130125044A1 (en) * | 2011-11-15 | 2013-05-16 | Mitutoyo Corporation | Machine Vision System Program Editing Environment Including Synchronized User Interface Features |
| CN103825894A (en) * | 2014-02-21 | 2014-05-28 | 南京莱斯信息技术股份有限公司 | Multi-screen application system based on browser B / S structure |
| CN109690473A (en) * | 2017-09-11 | 2019-04-26 | 深圳配天智能技术研究院有限公司 | A kind of graphic programming method, apparatus, computer storage medium and vision system |
| CN108181878A (en) * | 2018-01-04 | 2018-06-19 | 江苏科瑞恩自动化科技有限公司 | A kind of kinetic control system for the equipment containing vision system |
| CN108628597A (en) * | 2018-04-25 | 2018-10-09 | 赵宇 | A kind of NI Vision Builder for Automated Inspection development approach and device |
| CN208890936U (en) * | 2018-08-29 | 2019-05-21 | 泰科电子(上海)有限公司 | Vision system |
| CN112558974A (en) * | 2019-09-26 | 2021-03-26 | 罗克韦尔自动化技术公司 | Systems, methods, and computer media for collaborative development of industrial applications |
| CN112363730A (en) * | 2020-11-06 | 2021-02-12 | 上海节卡机器人科技有限公司 | Visual item deployment method, visual system, electronic equipment and storage medium |
| CN112463138A (en) * | 2020-11-18 | 2021-03-09 | 华南师范大学 | Software and hardware combined artificial intelligence education learning system |
Non-Patent Citations (1)
| Title |
|---|
| 张昊等: "面向嵌入式机器视觉的图编程式算法开发平台设计", 《电子测量技术》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112988316B (en) | 2021-10-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3769509B1 (en) | Multi-endpoint mixed-reality meetings | |
| CN112115678B (en) | Information display method and device, storage medium and electronic equipment | |
| JP2018535459A (en) | Robotic process automation | |
| CN111695628A (en) | Key point marking method and device, electronic equipment and storage medium | |
| CN108762740B (en) | Page data generation method and device and electronic equipment | |
| CN112991178B (en) | Image splicing method, device, equipment and medium | |
| AU2016262789A1 (en) | 3d modeling by tracing 2d image ui | |
| JP7389824B2 (en) | Object identification method and device, electronic equipment and storage medium | |
| US20210335008A1 (en) | Method and apparatus for processing video frame | |
| CN113657396A (en) | Training method, translation display method, device, electronic equipment and storage medium | |
| US20230237777A1 (en) | Information processing apparatus, learning apparatus, image recognition apparatus, information processing method, learning method, image recognition method, and non-transitory-computer-readable storage medium | |
| Apostolidis et al. | A fast smart-cropping method and dataset for video retargeting | |
| CN114327057A (en) | Object selection method, device, equipment, medium and program product | |
| CN113359995A (en) | Man-machine interaction method, device, equipment and storage medium | |
| CN112988316B (en) | Industrial vision system development method based on BS architecture and storage medium | |
| US20180181262A1 (en) | Grid-based rendering of nodes and relationships between nodes | |
| CN105912101A (en) | Projection control method and electronic equipment | |
| CN112017140B (en) | Method and apparatus for processing character image data | |
| CN111524165A (en) | Target tracking method and device | |
| CN111563453A (en) | Method, apparatus, device and medium for determining table vertices | |
| Nóbrega et al. | Design your room: adding virtual objects to a real indoor scenario | |
| CN116301551A (en) | Touch identification method, touch identification device, electronic equipment and medium | |
| CN114415876A (en) | Hand-drawn image processing method and device and electronic equipment | |
| CN111913644B (en) | Line drawing method and device for whiteboard and readable storage medium | |
| CN108605113A (en) | Effective mixed method of autokinesis is directed to according to the video used captured by airphoto head |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |