CN116048655A - Internet of things equipment low-code quick access method and system - Google Patents

Internet of things equipment low-code quick access method and system Download PDF

Info

Publication number
CN116048655A
CN116048655A CN202211708730.8A CN202211708730A CN116048655A CN 116048655 A CN116048655 A CN 116048655A CN 202211708730 A CN202211708730 A CN 202211708730A CN 116048655 A CN116048655 A CN 116048655A
Authority
CN
China
Prior art keywords
data
flow
elements
component
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211708730.8A
Other languages
Chinese (zh)
Inventor
曹阳
杨美艳
王超
张昊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chengdu Yiyang Telecom Information Technology Co ltd
Original Assignee
Chengdu Yiyang Telecom Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chengdu Yiyang Telecom Information Technology Co ltd filed Critical Chengdu Yiyang Telecom Information Technology Co ltd
Priority to CN202211708730.8A priority Critical patent/CN116048655A/en
Publication of CN116048655A publication Critical patent/CN116048655A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/445Program loading or initiating
    • G06F9/44568Immediately runnable code
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/445Program loading or initiating
    • G06F9/44505Configuring for program initiating, e.g. using registry, configuration files
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Abstract

The invention provides a low-code quick access system of Internet of things equipment, which comprises the following components: the static control unit records corresponding element parameters, corresponding element control methods and corresponding flow steps. The static management and control unit comprises an element management module. The element management module configures and initializes the generated elements according to the corresponding functions of data acquisition, each generated element is independent in storage and operation, the generated elements can perform data interaction through a unified input/output interface, and the generated elements can be freely combined to form a new element. The dynamic control unit dynamically loads the corresponding elements according to the flow steps, and the collected data is processed through the flow engine. Aiming at the scenes of numerous devices and different protocols under the factory of the Internet of things, the method and the system for quickly accessing to various devices for acquisition are effectively realized through low-code configuration.

Description

Internet of things equipment low-code quick access method and system
Technical Field
The application relates to the technical field of internet of things, in particular to a quick access method and a quick access system.
Background
In recent years, with the vigorous development of the internet of things technology and the intelligent sensor industry, the expansion of industrial project scale and the gradual diversification of equipment types. And various data communication protocols exist in the scene of the Internet of things and are responsible for data exchange and communication of the equipment local area network/the Internet. Different from the HTTP (hyper text transport protocol) main protocol in the Internet, various industrial devices currently exist under the Internet of things, and factors such as various working environments, geographic positions, special positions, power consumption requirements, battery power supply options, existence of physical barriers, cost and the like need to be adapted to determine the scene of coexistence of various protocols in the Internet of things, such as Rest/HTTP, coAP, MQTT, DDS, SOCKET, OPC, AMQP, manufacturer private protocols and the like. Therefore, the internet of things access system needs to access devices supporting different protocols in a big data environment.
The traditional internet of things access system mainly adopts a mode of code development and customized equipment docking. The equipment access development workload is large, the time consumption is long, the period of the application project of the Internet of things is long, and the service application cannot be supported rapidly. Aiming at the scene that a plurality of protocols coexist in the scene of the Internet of things, the existing development technology is mainly divided into 2 types: one class is equipment-centric. According to different protocols and different manufacturers, different devices are customized and developed according to needs, and the method causes high coupling degree of an application system and the devices and poor universality. The equipment is difficult to adjust when changing. The requirements of acquisition, analysis and monitoring of upper business projects of the Internet of things cannot be rapidly met. In the other type, the gateway is analyzed through the Internet of things by development or purchase, and various protocols are converted through the gateway, so that the method needs to introduce independent gateway equipment, the cost is high, only the general protocol is supported, and the private protocol of a manufacturer is limited. From the above, the prior art mainly has the following drawbacks: on the one hand, the Internet of things protocol adopted in the prior art is numerous, an access system needs to be customized and developed according to equipment, and the coupling degree is too high. On the other hand, the vendor proprietary protocol is not compatible with the corresponding access system and is therefore difficult to access. In addition, the adjustment and maintenance of the access system after the device protocol change is very complex.
For this reason, there is a need for an access method and system that address the shortcomings of the prior art.
Disclosure of Invention
The invention aims to provide a low-code quick access method and a system for Internet of things equipment, which can be used for realizing corresponding functional components in Internet of things acquisition, presetting various standard processing capacities, quickly interfacing the Internet of things equipment through visual configuration and dynamically adjusting corresponding data.
In order to achieve the above object, the present invention provides a low-code quick access system for an internet of things device, comprising: the static control unit records corresponding element parameters, corresponding element control methods and corresponding flow steps. The static management and control unit comprises an element management module. The element management module configures and initializes the generated elements according to the corresponding functions of data acquisition, each generated element is independent in storage and operation, the generated elements can perform data interaction through a unified input/output interface, and the generated elements can be freely combined to form a new element. The dynamic control unit dynamically loads the corresponding elements according to the flow steps, and the collected data is processed through the flow engine.
In the system of the present invention, the element management module includes an element implementation module. The element implementation module records a mapping table of the types, initialization assignments, result values and inheritance relationships of the plurality of elements.
In the system of the present invention, the component management module further includes a component distribution module. The component distribution module records the structure of each independent component package, and the structure is composed of a jar package, an html file, a js file and an xml file.
In the system of the present invention, the component management module further includes a component classification module. The element classification module classifies the corresponding elements into access elements, data processing elements or data output elements according to preset types.
In the system of the present invention, the element management module further includes a parameter configuration module. The parameter configuration module initializes the flow parameters and the element parameters, and generates the parameters into the flow package for distribution.
In the system of the present invention, the element management module further includes a flow definition module. The flow definition module can configure elements required by the acquisition flow, connection relations among the elements and parameter configuration of each element through a visual interface.
In the system of the present invention, the dynamic management and control unit includes a device access element, a data parsing element, and a data normalization element. The device access element comprises an element downloading unit and a flow downloading unit. The data analysis element comprises an element hot loading unit and a flow analysis unit. The component download unit automatically searches for a required component through the corresponding component storage table to download the corresponding component package. The flow downloading unit automatically downloads corresponding flow packages when the task is executed. The component hot loading unit loads the corresponding component class by means of class loading. The flow analysis unit is used for analyzing the definition of the corresponding step flow.
In the system of the invention, the dynamic management and control unit further comprises a flow engine, a dynamic initialization unit, an execution unit and a cleaning unit. The dynamic initialization unit is used for initializing corresponding element parameters. The execution unit is used for dynamically loading the corresponding elements according to the flow steps and processing the acquired data through the flow engine. The cleaning unit is used for cleaning the processed data.
In the system of the present invention, the element management module includes a message queue data receiving element, a data parsing element, a data sorting element, a data calculating element, a normalization processing element, a database linking element, and a data warehousing element: the message queue data receiving element receives messages incoming in real time from the message queue. The data parsing element recognizes the format of the incoming message and parses the data into generic message objects. The data classifying element divides the intercepted data into different branches for analysis processing. The data calculation element analyzes the received data character string for a plurality of attributes and performs calculation processing on each data. The normalized processing element output field is normalized, specifying the output attribute. The database link element creates a database link for database warehousing. The data warehouse-in component stores the data after the previous processing to a database.
The invention discloses a low-code quick access method for Internet of things equipment. The generating elements are configured and initialized according to the corresponding functions of data acquisition, each generated element is independent in storage and operation, data interaction can be carried out among the generated elements through a unified input/output interface, and the generated elements can be freely combined to form a new element. And dynamically loading the corresponding elements according to the flow steps, and processing the acquired data through a flow engine.
The low-code quick access method and system for the Internet of things equipment can be used for realizing corresponding functional elements in Internet of things acquisition, presetting various standard processing capacities, quickly interfacing the Internet of things equipment through visual configuration and dynamically adjusting corresponding data. Aiming at the scenes of numerous devices and different protocols under the factory of the Internet of things, the method and the system for quickly accessing to various devices for acquisition are effectively realized through low-code configuration.
Compared with the prior art, the method and the system have the following advantages:
1. aiming at a plurality of problems of the Internet of things protocol, the acquisition access part is independent, and a standard protocol access element is arranged in the access part, so that the universal capability is improved.
2. Aiming at a manufacturer private protocol, on one hand, a configurable socket type access element is provided, access capabilities such as fixed length, fixed protocol separator and the like are supported, and equipment is docked through configuration; on the other hand, the method provides a dynamic loading external plug-in (such as a separate jar package) and the like for analysis adaptation.
3. Aiming at the problem of equipment change, the system splits the whole acquisition step into acquisition, analysis and output, and combines the steps through flow configuration, and the equipment change only needs to adjust the corresponding acquisition and analysis parts, so that the quick adjustment is realized.
Drawings
FIG. 1 is a schematic diagram of a system framework of the present invention;
FIG. 2 is a schematic diagram of a system module structure according to the present invention;
FIG. 3 is a schematic view of a component dispensing module according to the present invention;
FIG. 4 is a schematic diagram of an access component of the component classification module according to the present invention;
FIG. 5 is a schematic diagram of a data warehouse component of the component classification module according to the present invention;
FIG. 6 is a schematic diagram of a flow definition module according to the present invention;
FIG. 7 is a schematic diagram of a dynamic management and control unit according to the present invention;
FIG. 8 is a diagram showing an example of the configuration of the present invention;
FIG. 9 is a flow engine example diagram of the present invention.
Detailed Description
In order that the above-recited objects, features and advantages of the present invention will become more readily apparent, a more particular description of the invention will be rendered by reference to the appended drawings and appended detailed description. The embodiments described herein are specific embodiments of the present invention, which are intended to be illustrative and exemplary of the inventive concept, and should not be construed as limiting the scope of the invention and embodiments of the invention. In addition to the embodiments described herein, those skilled in the art can adopt other obvious solutions based on the disclosure of the claims and specification of the present application, including those adopting any obvious substitutions and modifications to the embodiments described herein.
The drawings in the present specification are schematic diagrams, assist in explaining the concept of the present invention, and schematically represent interrelationships of the parts.
First, the meaning of terms related to the present invention is explained as follows:
internet of things equipment: various information sensors, radio frequency identification technology, infrared sensors, laser scanners and other devices in the Internet of things. The intelligent sensing, identification and management of the objects and the processes are realized by acquiring the objects or the processes requiring real-time monitoring, connection and interaction, acquiring various required information such as sound, light, heat, electricity, mechanics, chemistry, biology, position and the like, and accessing through various networks.
The acquisition process comprises the following steps: and the data acquisition in the acquisition platform is combined with each step.
Element: and acquiring single atomic capacity in the platform, and realizing a certain single function, such as data access or analysis.
HTTP: the hypertext transfer protocol is a simple request-response protocol. It specifies what messages the client might send to the server and what responses it gets.
REST: the method is a design style and development mode of a network application program, and data interaction is performed based on the HTTP protocol.
CoAP: coAP is a computer protocol applied to the internet of things.
MQTT: the MQTT protocol is a message queuing transmission protocol, and adopts a subscription and publishing mechanism, so that subscribers only receive subscribed data, and non-subscribed data is not received, thereby ensuring necessary data exchange and avoiding storage and processing caused by invalid data.
Socks: when two network applications communicate, endpoints in respective communication connections.
OPC: is an industry standard for process control. A standard set comprising a complete set of interfaces, properties and methods is used in process control and manufacturing automation systems.
Kafka: kafka is an open source stream processing platform developed by the Apache software foundation, written by Scala and Java. Kafka is a high-throughput distributed publish-subscribe messaging system that can handle all action flow data for consumers in a web site.
As shown in fig. 1, the present invention provides a low-code quick access system for an internet of things device, which includes: the static control unit records corresponding element parameters, corresponding element control methods and corresponding flow steps. The static management and control unit comprises an element management module. The element management module configures and initializes the generated elements according to the corresponding functions of data acquisition, each generated element is independent in storage and operation, the generated elements can perform data interaction through a unified input/output interface, and the generated elements can be freely combined to form a new element. The dynamic control unit dynamically loads the corresponding elements according to the flow steps, and the collected data is processed through the flow engine.
Specifically, the system combines functions in a mode of element, flow and low code configuration, so that quick equipment access is realized. As shown in fig. 1, the system is mainly divided into a static control unit and a dynamic control unit 2. The dynamic management and control unit comprises a device access element, a data analysis element and a data standardization element. The device access element comprises an element downloading unit and a flow downloading unit. The data analysis element comprises an element hot loading unit and a flow analysis unit. The component download unit automatically searches for a required component through the corresponding component storage table to download the corresponding component package. The flow downloading unit automatically downloads corresponding flow packages when the task is executed. The component hot loading unit loads the corresponding component class by means of class loading. The flow analysis unit is used for analyzing the definition of the corresponding step flow.
Furthermore, the static control unit mainly provides element management, flow design and corresponding parameter configuration, and performs graphical design in a low-code mode. The dynamic management and control unit is used for dynamically loading corresponding elements according to the related flow, and processing the acquired data in a flow engine mode to realize specific acquisition capacity. The invention can rapidly design the acquisition flow by building blocks, thereby rapidly accessing the equipment data. In this way, the collection flow is abstracted, split into individual elements with general capability according to the steps, and the combination and configuration of the elements are carried out through the low-code integrated development function, so that the customization system of the collection flow can be realized. The system mainly comprises an element realization module, an element distribution module, an element classification module, a parameter configuration module, a flow definition module and the like.
In an embodiment according to the invention, the element management module comprises an element implementation module. The element implementation module records a mapping table of the types, initialization assignments, result values and inheritance relationships of the plurality of elements.
According to the foregoing, the system combines functions in a manner of element+flow+low code configuration, thereby implementing fast device access. As shown in fig. 2, the system module includes: capacity management, collection arrangement and collection operation 3 parts. Capacity management: registration management of element capability is mainly provided, and acquisition integration capability is expanded. Collecting and arranging: the graphic design is carried out in a low-code mode, the capabilities of a plurality of elements are combined to form corresponding acquisition configuration, and the acquisition flow is rapidly designed in a building block building mode, so that equipment data is rapidly accessed. And (3) collecting and running: and dynamically loading corresponding elements according to the arranged acquisition tasks, and processing acquired data in a flow engine mode to realize specific acquisition capacity.
In an embodiment according to the present invention, as shown in fig. 3, the component management module further includes a component distribution module. The component delivery module records the structure of each individual component package. The component package structure: the component package is in a compressed file format, and each component includes a java archive software package (xml file, component execution logic package), a component configuration interface file (html file, hypertext markup language file), a component configuration interface script file (js file, component configuration script file), and a component description configuration file (node xml).
In an embodiment according to the invention, the component management module further comprises a component classification module. The collection flow is abstracted, the collection flow is split into various elements with general capabilities according to the steps, each element is mutually independent, and data interaction is carried out among the elements through a unified interface, so that high-cohesion low-coupling among the elements is realized; the element consists of a back-end execution program package and a front-end configuration program; the components are directly independent of each other and distributed in a compressed package mode; the platform registers the extended element capacity through element registration; the registered elements are dynamically loaded by the system, so that the non-stop capacity expansion is realized; the registered elements are uniformly stored in a file center for downloading after acquisition and execution; the elements are classified according to the use scenario: the device is divided into an access element, a data processing element and a data output element.
As shown in fig. 4, the access element can interface according to the acquisition object/device protocol, and receive data such as a file, a database or a message according to the access protocol, and output a real-time message or a batch text file for processing by a subsequent element. The access element can also extract a standard protocol as element support, and the corresponding key parameters (such as server ip, port, account number password and other information) are configured to adapt to the equipment environment in a page configuration mode. And the single package is uploaded and expanded for the private protocol support interface of the manufacturer.
The data processing element is capable of processing the received data: such as multiple data interception, character string segmentation, data filtering, data desensitization, data calculation (performing operations on each field, including dictionary translation, binary conversion, data four-rule operation, and the like, and supporting dynamic grammar script expansion), data caching, data counting, and the like. Meanwhile, batch data and real-time data factories are adapted, data file processing or single message processing is supported, and a plurality of elements are supported to complete complex data processing through serial/parallel/branch connection combination; the data processing element on the other hand supports an input data file or a single message, and an output data file or a single message (JSON format). In addition, the data processing element configures each element through the interface, each field algorithm does not need to modify codes, and a plurality of elements can realize complex data processing through serial connection combination.
As shown in fig. 5, the data output element is capable of output persistence of processed data, supporting output of input data to a data file, message queue, or persistence to a database. Secondly, the data output element can support the output of data to multiple destinations simultaneously through the flow branches.
In an embodiment according to the invention, the element management module further comprises a flow definition module. The flow definition module can configure elements required by the acquisition flow, connection relations among the elements and parameter configuration of each element through a visual interface.
The components required by the acquisition flow, the connection relation among the components and the configuration of parameters and the like of each component are designed through visual interface configuration; as shown in fig. 6, the flow packet structure: the process package is in a compressed file format, and the file comprises: flow_ui.xml (flow element relationship definition), flow_parameter.xml (flow parameter definition), element unique id_config.xml (per element configuration definition, multiple elements and multiple configuration files), the format is as follows:
Figure BDA0004025616230000081
configuration description:
Figure BDA0004025616230000091
/>
in an embodiment according to the invention, the element management module further comprises a parameter configuration module. The parameter configuration module initializes the flow parameters and the element parameters, and generates the parameters into the flow package for distribution.
The parameter configuration is divided into flow_parameter.xml and element parameter definition [ ComponentId ] _config.xml, and the flow parameter definition and the element parameter definition are simultaneously generated into a flow packet for distribution during flow design. flow/u
param. Xml: the flow parameter definition is used for configuring the common parameters of the whole flow, and the format is as follows:
Figure BDA0004025616230000092
Figure BDA0004025616230000101
configuration description:
Figure BDA0004025616230000102
component parameters define [ componentId ] _config.xml, which is defined by each component, in xml, for configuring the own configuration parameters required by the component.
In an embodiment according to the present invention, a process of customizing an acquisition procedure by a dynamic management and control unit based on an element package and a procedure package generated by a static management and control unit is shown in fig. 7. The acquisition arrangement module is realized by combining and configuring elements through the visualized integrated development function. The acquisition arrangement module comprises: the system comprises an acquisition step unit and an acquisition step parameter unit, and acquires a flow packet. The acquisition step unit comprises an acquisition step definition module, an acquisition step relation definition module, an acquisition step parameter configuration module and an acquisition arrangement flow result module. And the step parameter configuration module dynamically loads the front end configuration program of each element through an interface to carry out parameter configuration. The collection and arrangement result module stores the 2 parts of content in an XML (extensible markup language) format and distributes the 2 parts of content in a compressed package mode.
The configuration content comprises:
Figure BDA0004025616230000103
Figure BDA0004025616230000111
the acquisition step definition module selects corresponding required elements according to each step, such as access, analysis and output; the acquisition step relation definition module connects adjacent elements according to the interaction sequence executed by the elements and configures the jump rule, such as sequence execution, branch execution, condition execution and the like.
The acquisition flow package comprises a file defined by the acquisition flow, and the program dynamically realizes data acquisition according to the steps of arrangement based on the acquisition flow package generated by the arrangement of the acquisition. And according to the elements defined by the acquisition flow, thermally loading the corresponding java class and starting the thread pool to run tasks. The process operation comprises the following steps:
the acquisition flow is operated: and according to the elements defined by the acquisition flow, thermally loading the corresponding program class files and starting the thread pool to run tasks.
Component download: after the system is started, actively retrieving a component package list registered in the system from a file center, and downloading the component package in the list to the local through a file transfer protocol.
Element heat loading: after the component is downloaded successfully, the component package is automatically decompressed, the java archiving software package corresponding to the component is loaded according to the component description configuration file, and the component logic package is loaded into the memory to be called when the task execution is waited.
And (3) downloading the flow: before the system starts to execute the acquisition task, the corresponding flow configuration is identified according to the task information, the flow package is queried from the file center according to the name, and then the flow package is downloaded through the file transmission protocol.
And (3) collecting and running: initializing required elements according to flow definition and parameters, and starting corresponding access elements to start processing data; the dynamic management and control unit also comprises a flow engine, a dynamic initialization unit, an execution unit and a cleaning unit. The dynamic initialization unit is used for initializing corresponding element parameters. The execution unit is used for dynamically loading the corresponding elements according to the flow steps and processing the acquired data through the flow engine. The cleaning unit is used for cleaning the processed data.
The collection operation comprises 4 steps of flow analysis, initialization, execution and cleaning:
flow analysis: analyzing the configuration file of the flow package after the flow downloading: analyzing flow element definition file flow_ui.xml, and identifying an element list needed to be used by the flow; and analyzing the flow_parameter.xml of the flow parameter definition file to generate a flow parameter list.
Initializing: initializing flow parameters: acquiring and assigning values from the task parameters according to the parsed flow parameter list; initializing a flow element: traversing the element list related to the flow analysis, and creating a corresponding element instance object; initializing a flow: initializing an element engine according to the flow element relation, and calling each element initialization function according to the sequence;
performing: the flow engine sequentially starts the element execution. After each element support is completed, acquiring the execution output; the flow engine obtains a direct result of a single element, judges whether a downward execution condition is met according to a jump condition among the flow elements, and transmits the output of the element to the input of the element of the next month and starts to execute; after each element is executed, judging whether the following elements exist or not, and if the following elements do not exist, completing the executing step.
Cleaning: after each element is executed, the flow engine calls an element cleaning interface to execute cleaning operations such as resource release and the like.
As shown in fig. 9, the flow engine of the present invention is responsible for running the collection task according to the configured flow package, and the main functions include flow loading, flow execution and monitoring management.
And (3) loading a flow: the method mainly comprises the steps of flow initialization, configuration loading and node grouping. Initializing a flow: the process engine instance is initialized, including process parameters. Configuration loading: and analyzing and loading the flow configuration according to the flow configuration file. Node grouping: according to the node operation type (resident node and single execution node), the nodes are divided into different thread groups for operation.
The flow is executed: including initialization, single execution, resident execution, branch determination, event listening, cleaning, etc. Initializing: and initializing a flow engine instance, wherein the flow engine instance comprises a node list, context information and node initialization. Single execution: executing the designated node by single call; when executing, the element executing function is directly called to start executing. Resident execution: the designated node is started and periodically executed for nodes that need to operate for a long period of time, such as receiving message queue data. Branch judgment: and judging whether the flow is executed downwards or not according to the node execution result and the flow configuration condition. Event monitoring: event notification such as start of execution, completion of execution, etc. of the listening node. Cleaning: and after the execution of the flow engine is completed, calling an element cleaning function to execute cleaning operation.
And (3) monitoring and managing: and monitoring the process of the flow, such as thread management and operation management. Thread management: thread usage monitoring management in monitoring process operation. And (3) operation management: and starting and stopping management on the running of the procedure.
The system of the invention also comprises a device access step, a data analysis step and a data output step.
And (3) equipment access: actively collecting data (file type interface) of the Internet of things equipment or reporting data (such as message queue interface and network communication interface) of the passive receiving equipment according to the selected element; after receiving the data, the data basic format processing is carried out, and the data message is uniformly transferred to the next step.
And a data analysis step: according to the analysis steps defined in the flow, loading the corresponding elements to perform data analysis and calculation, such as field type conversion, field value operation, dictionary translation, field standardization and the like.
And a data output step: and outputting the parsed data to a plurality of destinations, such as databases, message queues, files and the like, according to the outputting steps defined in the flow.
As shown in fig. 8, in an embodiment according to the present invention, the element management module includes a message queue data receiving element, a data parsing element, a data sorting element, a data calculating element, a normalization processing element, a database linking element, and a data warehousing element: the message queue data receiving element receives messages incoming in real time from the message queue. The data parsing element recognizes the format of the incoming message and parses the data into generic message objects. The data classifying element divides the intercepted data into different branches for analysis processing. The data calculation element analyzes the received data character string for a plurality of attributes and performs calculation processing on each data. The normalized processing element output field is normalized, specifying the output attribute. The database link element creates a database link for database warehousing. The data warehouse-in component stores the data after the previous processing to a database.
The message queue data receiving element configuration example is as follows:
Figure BDA0004025616230000141
the data computing element elements are configured as follows:
Figure BDA0004025616230000151
/>
Figure BDA0004025616230000161
the data warehouse component configuration examples are as follows:
Figure BDA0004025616230000162
/>
Figure BDA0004025616230000171
/>
Figure BDA0004025616230000181
the low-code quick access system for the Internet of things equipment can be used for realizing corresponding functional elements in Internet of things acquisition, presetting various standard processing capacities, quickly interfacing the Internet of things equipment through visual configuration and dynamically adjusting corresponding data. Aiming at the scenes of numerous devices and different protocols under the factory of the Internet of things, the invention effectively realizes the system for quickly accessing various devices to collect through low-code configuration.
Compared with the prior art, the system of the invention has the following advantages:
1. aiming at a plurality of problems of the Internet of things protocol, the acquisition access part is independent, and a standard protocol access element is arranged in the access part, so that the universal capability is improved.
2. Aiming at a manufacturer private protocol, on one hand, a configurable socket type access element is provided, access capabilities such as fixed length, fixed protocol separator and the like are supported, and equipment is docked through configuration; on the other hand, the method provides a dynamic loading external plug-in (such as a separate jar package) and the like for analysis adaptation.
3. Aiming at the problem of equipment change, the system splits the whole acquisition step into acquisition, analysis and output, and combines the steps through flow configuration, and the equipment change only needs to adjust the corresponding acquisition and analysis parts, so that the quick adjustment is realized.
The invention provides a low-code quick access method of Internet of things equipment. The generating elements are configured and initialized according to the corresponding functions of data acquisition, each generated element is independent in storage and operation, data interaction can be carried out among the generated elements through a unified input/output interface, and the generated elements can be freely combined to form a new element. And dynamically loading the corresponding elements according to the flow steps, and processing the acquired data through a flow engine.
The low-code quick access method for the Internet of things equipment can be used for realizing corresponding functional elements in Internet of things acquisition, presetting various standard processing capacities, quickly interfacing the Internet of things equipment through visual configuration and dynamically adjusting corresponding data. Aiming at the scenes of numerous devices and different protocols under the factory of the Internet of things, the method and the system for quickly accessing to various devices for acquisition are effectively realized through low-code configuration.
The acquisition operation of the low-code quick access method of the Internet of things equipment mainly comprises the following steps:
1. and downloading the flow, namely collecting and starting to download the generated flow packet and analyzing the flow packet.
2. And (3) downloading the element, analyzing flow element definition file flow_ui.xml in the flow packet, identifying 7 element lists required by the flow, downloading according to element names, and loading the downloaded element names into a memory through an element hot loading function after the downloading is successful.
3. And analyzing the flow, analyzing an element definition file in the flow packet, generating a flow instance, and submitting the flow instance to a flow engine for execution.
4. And initializing a flow, namely initializing and loading 7 element execution functions by a flow engine, and sequentially executing the element initialization functions according to an [ element unique id ] _config.xml (each element configuration definition) file in a flow packet.
5. Executing, the flow engine starts to execute the following seven element defined steps:
1) Message queue data receiving element: subscribing the kafka message queue, waiting for message receiving, and outputting the next element after receiving the message;
2) Data analysis: receiving a message transmitted by a previous element, analyzing the message (a character string or json character string (JavaScript Object Notation, JS object numbered musical notation)) into a unified dictionary type data format according to configuration, and outputting a next element;
3) Data classification: identifying the incoming data, supplementing data type field information, and outputting the result to the next element;
4) And (3) data calculation: according to the element parameter configuration, the rule configured by each field of the received message is operated, including data interception, data four-rule operation, data system type conversion and other operations, and the calculation result is output
5) Data normalization: according to the configuration field list, only selecting page configuration data, combining the data into a new data object and outputting the new data object;
6) Database connection: executing once during initialization to generate database connection;
7) And (3) data storage: and storing the received data into a lost warehouse database and a table according to the field information.
6. When the cleaning is stopped, the process engine sequentially calls the cleaning mode of each element to release the corresponding resource.
Compared with the prior art, the method has the following advantages:
1. aiming at a plurality of problems of the Internet of things protocol, the acquisition access part is independent, and a standard protocol access element is arranged in the access part, so that the universal capability is improved.
2. Aiming at a manufacturer private protocol, on one hand, a configurable socket type access element is provided, access capabilities such as fixed length, fixed protocol separator and the like are supported, and equipment is docked through configuration; on the other hand, the method provides a dynamic loading external plug-in (such as a separate jar package) and the like for analysis adaptation.
3. Aiming at the problem of equipment change, the whole acquisition step is split into acquisition, analysis and output, and the acquisition, analysis and output are combined through flow configuration, and the equipment change only needs to adjust the corresponding acquisition and analysis parts, so that the quick adjustment is realized.
The embodiment of the method and the system for quickly accessing the low codes of the Internet of things equipment are described above, and the purpose of the invention is to explain the spirit of the invention. Note that modifications and combinations of the features of the above-described embodiments can be made by those skilled in the art without departing from the spirit of the present invention, and therefore, the present invention is not limited to the above-described embodiments. Specific features such as shape, size and position of the low-code quick access system for the internet of things equipment can be specifically designed according to the functions of the disclosed features, and the design can be realized by those skilled in the art. Moreover, each feature disclosed above is not limited to the combination of the features disclosed with other features, and other combinations of features may be made by those skilled in the art in accordance with the purpose of the present invention, so as to achieve the purpose of the present invention.

Claims (10)

1. The utility model provides a thing networking equipment low code quick access system which characterized in that includes:
a static control unit and a dynamic control unit, wherein,
the static control unit records corresponding element parameters, corresponding element control methods and corresponding flow steps; the static management and control unit comprises an element management module;
the element management module configures and initializes the generated elements according to the corresponding functions of data acquisition, each generated element is independent in storage and operation, the generated elements can perform data interaction through a unified input/output interface, and the generated elements can be freely combined to form a new element;
the dynamic control unit dynamically loads the corresponding elements according to the flow steps, and the collected data is processed through the flow engine.
2. The system of claim 1, wherein the element management module comprises an element implementation module; wherein, the liquid crystal display device comprises a liquid crystal display device,
the element implementation module records a mapping table of the types, initialization assignments, result values and inheritance relationships of the elements.
3. The system of claim 1, wherein the component management module further comprises a component distribution module; wherein, the liquid crystal display device comprises a liquid crystal display device,
the component distribution module records the structure of each independent component package, wherein the structure consists of a jar package, an html file, a js file and an xml file.
4. The system of claim 1, wherein the component management module further comprises a component classification module; wherein, the liquid crystal display device comprises a liquid crystal display device,
the element classification module classifies the corresponding elements into access elements, data processing elements or data output elements according to preset types.
5. The system of claim 1, wherein the element management module further comprises a parameter configuration module; wherein, the liquid crystal display device comprises a liquid crystal display device,
the parameter configuration module initializes the flow parameters and the element parameters, and generates the parameters into the flow package for distribution.
6. The system of claim 1, wherein the element management module further comprises a flow definition module; wherein, the liquid crystal display device comprises a liquid crystal display device,
the flow definition module can configure elements required by the acquisition flow, connection relations among the elements and parameter configuration of each element through a visual interface.
7. The system of claim 1, wherein the dynamic management and control unit comprises a device access element, a data parsing element, and a data normalization element; the device access element comprises an element downloading unit and a flow downloading unit; the data analysis element comprises an element hot loading unit and a flow analysis unit;
the component downloading unit automatically searches the required components through the corresponding component storage table so as to download the corresponding component package;
the flow downloading unit automatically downloads corresponding flow packages when the task is executed;
the element hot loading unit loads corresponding element classes in a class loading mode;
the flow analysis unit is used for analyzing the definition of the corresponding step flow.
8. The system of claim 1, wherein the dynamic management and control unit further comprises a flow engine, a dynamic initialization unit, an execution unit, and a cleaning unit;
the dynamic initialization unit is used for initializing corresponding element parameters;
the execution unit is used for dynamically loading the corresponding elements according to the flow steps and processing the acquired data through the flow engine;
the cleaning unit is used for cleaning the processed data.
9. The system of claim 1, wherein the element management module comprises a message queue data receiving element, a data parsing element, a data sorting element, a data computing element, a normalization processing element, a database linking element, and a data warehousing element: wherein, the liquid crystal display device comprises a liquid crystal display device,
the message queue data receiving element receives messages which are transmitted in real time by the message queue;
the data analysis element identifies the format of the incoming message and analyzes the data into a general message object;
the data classifying element divides the intercepted data into different branches for analysis processing;
the data calculation element analyzes the received data character strings into a plurality of attributes, and calculates and processes each data;
the normalization processing element output field is normalized, and output attributes are specified;
the database link element creates a database link for database warehousing;
the data warehouse-in component stores the data after the previous processing to a database.
10. A low-code quick access method for Internet of things equipment is characterized in that,
recording corresponding element parameters, corresponding element management and control methods and corresponding flow steps; configuring and initializing the generated elements according to the corresponding functions of data acquisition, wherein each generated element is independent in storage and operation, the generated elements can perform data interaction through a unified input/output interface, and the generated elements can be freely combined to form a new element;
and dynamically loading the corresponding elements according to the flow steps, and processing the acquired data through a flow engine.
CN202211708730.8A 2022-12-29 2022-12-29 Internet of things equipment low-code quick access method and system Pending CN116048655A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211708730.8A CN116048655A (en) 2022-12-29 2022-12-29 Internet of things equipment low-code quick access method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211708730.8A CN116048655A (en) 2022-12-29 2022-12-29 Internet of things equipment low-code quick access method and system

Publications (1)

Publication Number Publication Date
CN116048655A true CN116048655A (en) 2023-05-02

Family

ID=86119307

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211708730.8A Pending CN116048655A (en) 2022-12-29 2022-12-29 Internet of things equipment low-code quick access method and system

Country Status (1)

Country Link
CN (1) CN116048655A (en)

Similar Documents

Publication Publication Date Title
CN108510082B (en) Method and device for processing machine learning model
CN111427664B (en) Container-based protocol analysis method, device, system and storage medium
CN101605056B (en) J2EE server monitoring device and monitoring method employing same
CN113868081A (en) Edge computing frame for power grid internet of things management platform and working method thereof
CN111737329A (en) Unified data acquisition platform for rail transit
CN113542365B (en) Terminal-side Internet of things platform architecture based on multi-scene application
CN110912782B (en) Data acquisition method, device and storage medium
CN105183452A (en) Spring AOP based remote protocol service middleware for monitoring power distribution device
CN113010378B (en) Log processing method and device of microservice module, storage medium and electronic device
CN112261101B (en) Method for introducing rule engine into MQTT message center
CN112187922A (en) Intelligent Internet of things shutdown machine based on MQTT communication protocol
CN113900794A (en) Industrial data acquisition platform and method
CN113766026B (en) Data processing method and system applied to energy industrial network
CN110380775B (en) Large-scale multi-service satellite constellation operation and management system and working method thereof
CN113489802B (en) Internet of things collection equipment
CN113179269B (en) Protocol data analysis method, system and medium based on Internet of things
CN112817539A (en) Industrial data storage method and system, electronic device and storage medium
CN116048655A (en) Internet of things equipment low-code quick access method and system
US20020087945A1 (en) System and method for providing flexible network service application components
CN114185695A (en) Loosely-coupled data processing method and system based on industrial APP micro-service
US11921602B2 (en) Edge-based data collection system for an observability pipeline system
CN110555042A (en) Real-time data retrieval method, device and system
US11799982B2 (en) Message push method, apparatus, device and medium
CN116582582B (en) Data acquisition method, system, equipment and medium for component type Internet of things
CN112859752B (en) Remote monitoring management system of laser embroidery machine

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination