CN116582582B - Data acquisition method, system, equipment and medium for component type Internet of things - Google Patents
Data acquisition method, system, equipment and medium for component type Internet of things Download PDFInfo
- Publication number
- CN116582582B CN116582582B CN202310866192.3A CN202310866192A CN116582582B CN 116582582 B CN116582582 B CN 116582582B CN 202310866192 A CN202310866192 A CN 202310866192A CN 116582582 B CN116582582 B CN 116582582B
- Authority
- CN
- China
- Prior art keywords
- component
- data
- communication
- analysis
- output
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 83
- 238000004891 communication Methods 0.000 claims abstract description 112
- 238000004458 analytical method Methods 0.000 claims abstract description 69
- 230000002688 persistence Effects 0.000 claims abstract description 15
- 238000004590 computer program Methods 0.000 claims description 22
- 230000006870 function Effects 0.000 claims description 11
- 238000013480 data collection Methods 0.000 claims description 7
- 238000012986 modification Methods 0.000 claims description 5
- 230000004048 modification Effects 0.000 claims description 5
- 238000003672 processing method Methods 0.000 claims description 5
- 238000012217 deletion Methods 0.000 claims description 4
- 230000037430 deletion Effects 0.000 claims description 4
- 230000000452 restraining effect Effects 0.000 claims description 4
- 238000007429 general method Methods 0.000 claims description 3
- 238000012423 maintenance Methods 0.000 abstract description 6
- 238000012827 research and development Methods 0.000 abstract description 5
- 238000010586 diagram Methods 0.000 description 7
- 238000011161 development Methods 0.000 description 5
- 238000012545 processing Methods 0.000 description 5
- 238000012544 monitoring process Methods 0.000 description 3
- 239000003795 chemical substances by application Substances 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 239000000428 dust Substances 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 238000003780 insertion Methods 0.000 description 1
- 230000037431 insertion Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000004064 recycling Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/51—Discovery or management thereof, e.g. service location protocol [SLP] or web services
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/448—Execution paradigms, e.g. implementations of programming paradigms
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/18—Multiprotocol handlers, e.g. single devices capable of handling multiple protocols
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Medical Informatics (AREA)
- General Health & Medical Sciences (AREA)
- Computer Security & Cryptography (AREA)
- Computing Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Computer And Data Communications (AREA)
Abstract
The application discloses a data acquisition method, a system, equipment and a medium of a component type internet of things, wherein the system comprises a communication component, an analysis component, an output component, an interface module and a channel service; the communication component supports a plurality of communication protocols, establishes communication with the field device and transmits and receives data; the analysis component supports a plurality of message protocols, organizes data into JSON character strings according to the protocols and pushes the JSON character strings to the output component; the output component supports various data persistence and display modes; the three components all realize interface methods defined by the interface module, and the components can be independently maintained and upgraded; the channel service combines the components, creates a data acquisition channel, and coordinates the components to complete data reception, analysis and persistence. The application can freely combine components, and can improve the efficiency of equipment access and operation and maintenance by configuring and completing the acquisition and storage of the data of the Internet of things, and simultaneously can reduce the research and development difficulty and investment cost of an enterprise data acquisition system, and can be applied to different data acquisition scenes of the Internet of things.
Description
Technical Field
The application relates to the field of data acquisition of the Internet of things, in particular to a method, a system, equipment and a medium for acquiring data of the Internet of things in a component mode.
Background
The device monitoring data can be used for monitoring the running state of the device, optimizing the production flow, predictively maintaining, improving the product quality, improving the user experience, improving the energy utilization efficiency and other scenes, and is an important support for the activities of improving the quality, reducing the cost, enhancing the efficiency, saving the energy and reducing the emission of enterprises.
The number of the base numbers of the devices of the Internet of things related to one factory is large, the data formats and protocols among different devices are different, and the realization of efficient, reliable and unified data acquisition is a difficult problem. The mainstream data acquisition scheme is to develop independent acquisition programs for each type of protocol of each type of equipment, and a plurality of independent acquisition programs are directly deployed or issued into micro-services, and the acquisition programs gather data into a message queue for unified consumption and storage by a persistence module. When a new type of protocol data is added, a technician is required to build a huge software project, a certain technical difficulty exists, and after the software is fully tested, the new equipment data is accessed and persisted; in addition, the collection system has a plurality of collection services, increases the delivery cycle and the research and development cost of the collection system, and also brings difficulty to the operation and maintenance of the collection data of the factory.
Therefore, a simple and easy-to-operate data acquisition system is needed, and the data access and persistence work of the internet of things with different protocols for different devices is completed under the condition that no software engineering is newly built as far as possible in a configuration mode.
Disclosure of Invention
In order to overcome the defects in the prior art, the application provides a method, a system, equipment and a medium for acquiring data of a component type internet of things, which are used for solving at least one technical problem.
According to an aspect of the present disclosure, there is provided a method for collecting data of a component internet of things, including:
creating a data acquisition channel, and combining a communication component, an analysis component and an output component by utilizing channel services according to a data protocol of equipment to be accessed;
configuring communication component parameters and outputting component parameters;
starting the created data acquisition channel;
the communication component passively or actively establishes a communication channel with the field device, receives or polls the field device data and transmits the field device data to the analysis component, and simultaneously transmits feedback data returned by the analysis component back to the field device;
the analysis component analyzes the data transmitted from the communication component according to the selected analysis type, organizes the analysis result into a JSON character string, sends the JSON character string to the output component, calculates feedback data and sends the feedback data to the communication component;
the output component outputs the JSON string from the parsing component to a specified database system, file system or medium according to the selected output type.
According to the technical scheme, the channel service is utilized to carry out the combination of all the components, and the mode of component configuration is utilized to finish the data access and persistence work of the Internet of things with different protocols for different devices under the condition that software engineering is not newly established as far as possible.
As a further technical solution, the channel service includes: component registration service, component query service, component instantiation, and component combination to form an acquisition channel and start-stop service of the acquisition channel.
Optionally, the communication component supports TCP, MQTT, HTTP, serial port, OPC UA and other communication protocols, and is used as a communication agent to passively or actively establish a communication channel with the field device, receive or poll the field device data and send the field device data to the parsing component, and simultaneously transmit feedback data returned by the parsing component back to the field device.
Optionally, the parsing component supports multiple data parsing methods such as HJ212, JTT809, CJT188, DLT645, BACnet, modbus, parses data transmitted from the communication component, organizes parsing results into JSON strings, sends the JSON strings to the output component, and calculates feedback data to send to the communication component.
Optionally, the output component supports various data persistence, publishing and display methods such as database insertion, HTTP interface transmission, file writing, console printing and the like, and is used for outputting the JSON string from the parsing component to a designated database system, file system or medium.
Optionally, the channel service is configured to manage the registration and instantiation processes of the communication component, the analysis component, and the output component, and provide a method for combining and configuring the components, so as to complete creation, modification, and deletion of the data acquisition channel, and implement data acquisition of the internet of things device in a configuration and combination manner.
According to an aspect of the present disclosure, there is provided a modular internet of things data acquisition system, including: the system comprises a communication component, a resolving component, an output component, an interface module and a channel service, wherein,
the communication component is used as a communication agent and is used for establishing a communication channel with the field device passively or actively, receiving or polling the field device data and sending the field device data to the analysis component, and simultaneously returning feedback data returned by the analysis component to the field device;
the analysis component is used for analyzing the data transmitted by the communication component, organizing the analysis result into a JSON character string, sending the JSON character string to the output component, calculating feedback data and sending the feedback data to the communication component;
the output component is used for outputting the JSON character string from the analysis component to a specified database system, file system or medium;
the interface module is used for defining interfaces of the communication component, the analysis component and the output component and realizing the universality of the components;
the channel service is used for managing the registration and instantiation processes of the communication component, the analysis component and the output component, providing the combination and configuration methods of the components, completing the creation, modification and deletion of the data acquisition channel, and realizing the acquisition of the data of the Internet of things equipment in a configuration and combination mode.
According to the technical scheme, one or more data acquisition channels can be formed in a data acquisition system in a configuration and combination assembly mode, multi-equipment multi-protocol internet of things data are acquired, and a data persistence method is provided; when the existing components can not meet the data acquisition requirement, technicians are allowed to newly add a component inheriting the interface module in the provided data acquisition system and register the component in the component service, so that the reutilization of the existing resources is realized, and the research and development investment, the technical difficulty and the operation and maintenance cost are reduced.
Optionally, the channel service manages the communication component, the analysis component and the output component and provides component registration service; inquiring the communication component, the analysis component, the output component code and the name list service; acquiring component instantiation according to component codes; the communication assembly, the analysis assembly and the output assembly are combined to form an acquisition channel; providing the opening and closing functions of the acquisition channel.
Furthermore, the acquisition channels created by the channel service are basic units for acquiring data of the Internet of things, one acquisition channel can acquire and store the data of the Internet of things of one protocol of one device, and meanwhile, in the provided data acquisition system of the Internet of things, any number of acquisition channels are supported to be created so as to complete the access of the data of multiple protocols and multiple devices.
As a further technical solution, the interface module includes:
the universal component interface is used for defining and restricting the names, codes, parameter lists and log functions of the communication component, the analysis component and the output component, and enabling the components to meet the requirements of an acquisition system;
the general component method is used for solidifying the communication component, analyzing the component and outputting the general method required by the component, and comprises a query and setting method of the component name, a query and setting method of the component code, a query and setting method of the component parameter and a setting and calling method of the component log function;
the communication assembly interface is used for defining a starting method and a closing method of the communication assembly, wherein the starting method and the closing method both restrict the type of entering the parameters and force the starting method and the closing method to return to the execution state;
the analysis component interface is used for defining an execution method of the analysis component and restraining the execution method from returning to an execution state;
and the output component interface is used for defining an execution method of the output component and restraining the execution method from returning to an execution state.
The interface module defines interfaces of the communication component, the analysis component and the output component, realizes a general method for a plurality of components, ensures that the components operate correctly in the acquisition system, is used for reducing development period and standardizes development of new components.
As a further technical scheme, the communication assembly inherits a communication assembly interface, a general assembly interface and a general assembly method in the interface module, and meanwhile, each communication assembly is embedded with a communication protocol, including TCP, MQTT, HTTP, serial ports and OPC UA communication protocols, so as to form a TCP service communication assembly, a TCP client communication assembly, an MQTT service communication assembly, an MQTT client communication assembly, an HTTP service communication assembly, an HTTP client communication assembly, a serial port communication assembly and an OPC UA communication assembly.
As a further technical scheme, the parsing components inherit the parsing component interfaces, the universal component interfaces and the universal component methods in the interface module, and meanwhile, each parsing component is embedded with a message protocol, including HJ212, JTT809, CJTT 188, DLT645 and BACnet, modbus message protocols, so as to form a HJ212 parsing component, a JTT809 parsing component, a CJTT 188 parsing component, a DLT645 parsing component, a BACnet parsing component and a Modbus parsing component.
As a further technical scheme, the output components inherit the output component interfaces, the universal component interfaces and the universal component methods in the interface module, and meanwhile, each output component is embedded with a data processing method, wherein the data processing method comprises a relational database writing method, a time sequence database writing method, a file writing method, a WebAPI calling method and a console printing method, so that a relational database output component, a time sequence database output component, a file output component, a WebAPI output component and a console output component are formed.
As a further technical scheme, the communication component, the analysis component and the output component are all independent components.
According to an aspect of the present disclosure, there is provided an electronic device, including a processor, a memory, and a computer program stored on the memory and executable by the processor, wherein the computer program when executed by the processor implements the steps of the method for collecting data of the component internet of things.
According to an aspect of the present disclosure, there is provided a computer readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the steps of the method for collecting data of the component internet of things.
Compared with the prior art, the application has the beneficial effects that:
aiming at the problems of large development workload and complex operation and maintenance management of a multi-equipment multi-protocol internet of things data acquisition program, the application provides a modular internet of things data acquisition system and a modular internet of things data acquisition method, which can enable an operator to form a plurality of data acquisition channels by combining different communication modules, analysis modules and output modules in one data acquisition system, thereby completing acquisition of multi-equipment multi-protocol internet of things data and providing data persistence and display work; when the existing components can not meet the data acquisition requirement, technicians can newly add a component inheriting the interface module in the data acquisition system and register the component into the component service to finish the data access and storage of new equipment with a new protocol; the communication component, the analysis component and the output component are all independent components, can be maintained and upgraded respectively, and reduce research and development investment, technical difficulty and operation and maintenance cost effects by recycling the existing resources.
Drawings
FIG. 1 is a block diagram of a modular Internet of things data acquisition system according to an embodiment of the present application;
FIG. 2 is a data acquisition channel model and an access flow chart of a modular Internet of things data acquisition system according to an embodiment of the present application;
fig. 3 is a flowchart of a method for collecting data of a component internet of things according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made in detail and with reference to the accompanying drawings, wherein it is apparent that the embodiments described are only some, but not all embodiments of the present application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to fall within the scope of the application.
In the description of the present application, it should be noted that, unless explicitly specified and limited otherwise, the terms "mounted," "connected," and "connected" are to be construed broadly, and may be either fixedly connected, detachably connected, or integrally connected, for example; can be mechanically connected, electrically connected or can be communicated with each other; can be directly connected or indirectly connected through an intermediate medium, and can be communicated with the inside of two elements or the interaction relationship of the two elements. The specific meaning of the above terms in the present application can be understood by those of ordinary skill in the art according to the specific circumstances.
Referring to fig. 1, a modular internet of things data acquisition system includes a communication module, an analysis module, an output module, an interface module and a channel service, and in one data acquisition system, a plurality of data acquisition channels are formed by combining different communication modules, analysis modules and output modules, so as to complete acquisition of multi-device multi-protocol internet of things data and provide data persistence and display.
Specifically, the communication assembly inherits the communication assembly interface, the universal assembly interface and the universal assembly method in the interface module, and meanwhile, each communication assembly is embedded with a communication protocol, including TCP, MQTT, HTTP, serial port and OPC UA communication protocol, and the communication assembly comprises a TCP service communication assembly, a TCP client communication assembly, an MQTT service communication assembly, an MQTT client communication assembly, an HTTP service communication assembly, an HTTP client communication assembly, a serial port communication assembly and an OPC UA communication assembly.
The parsing components inherit the parsing component interfaces, the universal component interfaces and the universal component methods in the interface module, and meanwhile, each parsing component is embedded with a message protocol, including HJ212, JTT809, CJTT 188, DLT645 and BACnet, modbus message protocols, and the parsing component comprises a HJ212 parsing component, a JTT809 parsing component, a CJTT 188 parsing component, a DLT645 parsing component, a BACnet parsing component and a Modbus parsing component.
The output assembly inherits the output assembly interface, the general assembly interface and the general assembly method in the interface module, and meanwhile, each output assembly is embedded with a data processing method, wherein the data processing method comprises a relation database writing method, a time sequence database writing method, a file writing method, a WebAPI calling method and a console printing method, so that a relation database output assembly, a time sequence database output assembly, a file output assembly, a WebAPI output assembly and a console output assembly are formed.
The interface module encapsulates the universal component interface, the universal component method, the communication component interface, the analysis component interface and the output component interface, constrains the communication component, the analysis component and the output component interface, provides necessary method functions, ensures that the components can be effectively registered and correctly and stably operated in the component type physical data acquisition system, reduces the development threshold and the development period of the acquisition system, and also can be operated and maintained with difficulty.
The channel service is provided with a component registration service, a component query service, a component instantiation service, a channel creation service and a control channel start-stop service, and manages a communication component, an analysis component and an output component, registers a new component and identifies the new component; inquiring the communication component, the analysis component, the output component code and the name list service, and providing a selection menu of different components for the subsequent creation of the acquisition channel; acquiring component instantiation according to component codes; the communication assembly, the analysis assembly and the output assembly are combined to form an acquisition channel; control functions of the acquisition channel are provided, including opening and closing functions.
Referring to fig. 2, a modular data acquisition system for internet of things completes creation of a data acquisition channel by combining different communication modules, analysis modules and output modules, and completes data access, persistence or display of different protocol devices of different devices by instantiating and serially scheduling the communication modules, the analysis modules and the output modules through the acquisition channel.
Specifically, the data of the internet of things (such as running current, data of a dust removal fan, environmental monitoring and the like) is sent to an acquisition channel of the assembly type data acquisition system of the internet of things, access of the acquired data is completed through mutual cooperation of a communication assembly, a resolving assembly and an output assembly, and data storage and display are performed, such as data storage to a relational database, time sequence database, file storage, third party system sending, console printing and the like.
The acquisition channels are created and maintained by channel services, are basic units of the data acquisition system of the Internet of things, can acquire and store Internet of things data of one protocol of equipment, and simultaneously support the creation of any number of acquisition channels in the data acquisition system of the Internet of things, so that the access purpose of multi-protocol multi-equipment data is realized.
Referring to fig. 3, a method for collecting data of a component internet of things includes the following steps:
step 1, creating a data acquisition channel, and combining a communication component, an analysis component and an output component by utilizing channel services according to a data protocol of equipment to be accessed;
step 2, configuring communication component parameters, and setting parameters such as an IP port, an account password and the like according to the communication type and the network environment;
step 3, configuring output component parameters, and setting parameters such as a connection character string or a WebAPI address according to the storage type;
step 4, starting the data acquisition channel created in the step 1;
step 5, the communication component passively or actively establishes a communication channel with the field device, receives or polls the field device data and sends the field device data to the analysis component, and simultaneously returns feedback data returned by the analysis component to the field device;
step 6, analyzing the data transmitted by the communication component by the analysis component according to the selected analysis type, organizing the analysis result into a JSON character string, sending the JSON character string to the output component, calculating feedback data and sending the feedback data to the communication component;
and 7, outputting the JSON character string from the analysis component to a specified database system, file system or medium by the output component according to the selected output type, and completing the tasks of data persistence, display and the like.
The application also provides electronic equipment which can be an industrial personal computer, a server or a computer terminal. The electronic equipment comprises a processor, a memory and a computer program stored on the memory and executable by the processor, wherein the computer program realizes the steps of the data acquisition method of the component type internet of things when being executed by the processor.
The electronic device includes a processor, a memory, and a network interface connected by a system bus, where the memory may include a non-volatile storage medium and an internal memory. The non-volatile storage medium may store an operating system and a computer program. The computer program comprises program instructions which, when executed, cause the processor to perform the steps of any of the component internet of things data collection methods.
The processor is used to provide computing and control capabilities to support the operation of the entire electronic device. The internal memory provides an environment for the execution of a computer program in the non-volatile storage medium, which when executed by the processor, causes the processor to perform the steps of any of the component internet of things data collection methods.
The network interface is used for network communication such as transmitting assigned tasks and the like. It should be appreciated that the processor may be a central processing unit (CentralProcessingUnit, CPU), but may also be other general purpose processors, digital signal processors (DigitalSignalProcessor, DSP), application specific integrated circuits (ApplicationSpecificIntegratedCircuit, ASIC), field programmable gate arrays (Field-ProgrammableGateArray, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. Wherein the general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The application also provides a computer readable storage medium, wherein the computer readable storage medium stores a computer program, and the computer program realizes the steps of the data acquisition method of the component type internet of things when being executed by a processor.
The communication component supports various communication protocols and can establish communication and transmit and receive data with field equipment; the analysis component supports a plurality of message protocols, organizes data into JSON character strings according to the protocols and pushes the JSON character strings to the output component; the output component supports various data persistence and display modes, such as saving to a database or a file; the three components all realize interface methods defined by the interface module, and the components can be independently maintained and upgraded; the channel service combines the components, creates a data acquisition channel, and coordinates the components to complete data reception, analysis and persistence. The application makes the data acquisition service into a freely combined component type service, completes the acquisition and storage of the data of the Internet of things through configuration, improves the equipment access and operation and maintenance efficiency, can reduce the research and development difficulty and investment cost of an enterprise data acquisition system, and can be applied to different data acquisition scenes of the Internet of things.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and are not limiting; although the application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced with equivalents; these modifications or substitutions do not depart from the essence of the corresponding technical solutions from the technical solutions of the embodiments of the present application.
Claims (9)
1. The data acquisition method of the component type internet of things is characterized by being used for forming a plurality of data acquisition channels by combining different communication components, analysis components and output components in one data acquisition system, completing acquisition of multi-equipment multi-protocol internet of things data, and providing data persistence and display work; when the existing components can not meet the data acquisition requirement, a component inheriting the interface module is newly added in the data acquisition system and registered in the component service to finish the data access and storage of new equipment with new protocol; the communication component, the analysis component and the output component are all independent components; the interface module is used for defining interfaces of the communication component, the analysis component and the output component and realizing the universality of the components; the method comprises the following steps:
creating a data acquisition channel, and combining a communication component, an analysis component and an output component by utilizing channel services according to a data protocol of equipment to be accessed;
configuring communication component parameters and outputting component parameters;
starting the created data acquisition channel;
the communication component passively or actively establishes a communication channel with the field device, receives or polls the field device data and transmits the field device data to the analysis component, and simultaneously transmits feedback data returned by the analysis component back to the field device;
the analysis component analyzes the data transmitted from the communication component according to the selected analysis type, organizes the analysis result into a JSON character string, sends the JSON character string to the output component, calculates feedback data and sends the feedback data to the communication component;
the output component outputs the JSON character string from the analysis component to a specified database system, file system or medium according to the selected output type;
the channel service is used for managing the registration and instantiation processes of the communication component, the analysis component and the output component, providing the combination and configuration methods of the components, completing the creation, modification and deletion of the data acquisition channel, and realizing the acquisition of the data of the Internet of things equipment in a configuration and combination mode.
2. The method for collecting data of the internet of things according to claim 1, wherein the channel service comprises: component registration service, component query service, component instantiation, and component combination to form an acquisition channel and start-stop service of the acquisition channel.
3. The component type data acquisition system of the internet of things is characterized in that the component type data acquisition system is used for forming a plurality of data acquisition channels by combining different communication components, analysis components and output components in one data acquisition system, completing acquisition of multi-equipment multi-protocol data of the internet of things, and providing data persistence and display work; when the existing components can not meet the data acquisition requirement, a component inheriting the interface module is newly added in the data acquisition system and registered in the component service to finish the data access and storage of new equipment with new protocol; the communication component, the analysis component and the output component are all independent components, and the system comprises: the system comprises a communication component, a resolving component, an output component, an interface module and a channel service, wherein,
the communication component is used as a communication agent and is used for establishing a communication channel with the field device passively or actively, receiving or polling the field device data and sending the field device data to the analysis component, and simultaneously returning feedback data returned by the analysis component to the field device;
the analysis component is used for analyzing the data transmitted by the communication component, organizing the analysis result into a JSON character string, sending the JSON character string to the output component, calculating feedback data and sending the feedback data to the communication component;
the output component is used for outputting the JSON character string from the analysis component to a specified database system, file system or medium;
the interface module is used for defining interfaces of the communication component, the analysis component and the output component and realizing the universality of the components;
the channel service is used for managing the registration and instantiation processes of the communication component, the analysis component and the output component, providing the combination and configuration methods of the components, completing the creation, modification and deletion of the data acquisition channel, and realizing the acquisition of the data of the Internet of things equipment in a configuration and combination mode.
4. The modular internet of things data collection system of claim 3, wherein the interface module comprises:
the universal component interface is used for defining and restricting the names, codes, parameter lists and log functions of the communication component, the analysis component and the output component, and enabling the components to meet the requirements of an acquisition system;
the general component method is used for solidifying the general methods required by the communication component, the analysis component and the output component;
the communication assembly interface is used for defining a starting method and a closing method of the communication assembly, wherein the starting method and the closing method both restrict the type of entering the parameters and force the starting method and the closing method to return to the execution state;
the analysis component interface is used for defining an execution method of the analysis component and restraining the execution method from returning to an execution state;
and the output component interface is used for defining an execution method of the output component and restraining the execution method from returning to an execution state.
5. The system of claim 4, wherein the communication modules inherit communication module interfaces, universal module interfaces and universal module methods in the interface module, and each communication module has a communication protocol embedded therein.
6. The component-based internet of things data collection system according to claim 4, wherein the parsing component inherits parsing component interfaces, general component interfaces and general component methods in the interface module, and each parsing component is embedded with a message protocol.
7. The modular internet of things data collection system of claim 4, wherein the output modules inherit output module interfaces, generic module interfaces and generic module methods in the interface module, with one data processing method embedded in each output module.
8. An electronic device comprising a processor, a memory, and a computer program stored on the memory and executable by the processor, wherein the computer program when executed by the processor implements the steps of the modular internet of things data collection method of any one of claims 1 to 2.
9. A computer-readable storage medium, wherein a computer program is stored on the computer-readable storage medium, wherein the computer program, when executed by a processor, implements the steps of the modular internet of things data collection method according to any one of claims 1 to 2.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310866192.3A CN116582582B (en) | 2023-07-14 | 2023-07-14 | Data acquisition method, system, equipment and medium for component type Internet of things |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310866192.3A CN116582582B (en) | 2023-07-14 | 2023-07-14 | Data acquisition method, system, equipment and medium for component type Internet of things |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116582582A CN116582582A (en) | 2023-08-11 |
| CN116582582B true CN116582582B (en) | 2023-10-13 |
Family
ID=87536456
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310866192.3A Active CN116582582B (en) | 2023-07-14 | 2023-07-14 | Data acquisition method, system, equipment and medium for component type Internet of things |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116582582B (en) |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2004077212A2 (en) * | 2003-01-30 | 2004-09-10 | Vaman Technologies (R & D) Limited | Data server independent of communication protocols, operating systems, formats, features and syntaxes |
| US8473519B1 (en) * | 2008-02-25 | 2013-06-25 | Cisco Technology, Inc. | Unified communication audit tool |
| CN104410662A (en) * | 2014-10-23 | 2015-03-11 | 山东大学 | Parallel mass data transmitting middleware of Internet of things and working method thereof |
| CN108900524A (en) * | 2018-07-13 | 2018-11-27 | 中国电子科技集团公司第十五研究所 | Object node interactive system in a kind of Internet of Things |
| CN110971666A (en) * | 2019-11-01 | 2020-04-07 | 湖南深拓智能设备股份有限公司 | Internet of things management system and communication method thereof |
| CN111193780A (en) * | 2019-12-17 | 2020-05-22 | 国电南瑞科技股份有限公司 | Modularized Internet of things platform data transmission system |
| CN111787066A (en) * | 2020-06-06 | 2020-10-16 | 王科特 | Internet of things data platform based on big data and AI |
| WO2021213293A1 (en) * | 2020-04-24 | 2021-10-28 | 西北工业大学 | Ubiquitous operating system oriented toward group intelligence perception |
| WO2022257181A1 (en) * | 2021-06-07 | 2022-12-15 | 刘天琼 | Aiot paas internet of things operation platform |
| CN115665197A (en) * | 2022-10-19 | 2023-01-31 | 成都数智索信息技术有限公司 | Automatic warehousing system and method based on data acquisition of Internet of things |
| CN116055524A (en) * | 2022-12-30 | 2023-05-02 | 中科云谷科技有限公司 | Interaction method, processor and device for Internet platform and Internet of things equipment |
| CN116132317A (en) * | 2022-12-12 | 2023-05-16 | 南京理工大学 | Industrial Internet data acquisition analysis and visualization integrated system and deployment method thereof |
| CN116233283A (en) * | 2023-05-05 | 2023-06-06 | 湖南盛鼎科技发展有限责任公司 | Dynamic expansion and hot plug method of equipment communication protocol |
| KR102545220B1 (en) * | 2022-12-30 | 2023-06-20 | (주)임픽스 | Edge gateway device that simultaneously supports open platform communications-unified architecture and publish subscribe standard communication protocols |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7389921B2 (en) * | 2005-02-28 | 2008-06-24 | Sap Aktiengesellschaft | Dynamic component management |
| US8825664B2 (en) * | 2012-08-17 | 2014-09-02 | Splunk Inc. | Indexing preview |
-
2023
- 2023-07-14 CN CN202310866192.3A patent/CN116582582B/en active Active
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2004077212A2 (en) * | 2003-01-30 | 2004-09-10 | Vaman Technologies (R & D) Limited | Data server independent of communication protocols, operating systems, formats, features and syntaxes |
| US8473519B1 (en) * | 2008-02-25 | 2013-06-25 | Cisco Technology, Inc. | Unified communication audit tool |
| CN104410662A (en) * | 2014-10-23 | 2015-03-11 | 山东大学 | Parallel mass data transmitting middleware of Internet of things and working method thereof |
| CN108900524A (en) * | 2018-07-13 | 2018-11-27 | 中国电子科技集团公司第十五研究所 | Object node interactive system in a kind of Internet of Things |
| CN110971666A (en) * | 2019-11-01 | 2020-04-07 | 湖南深拓智能设备股份有限公司 | Internet of things management system and communication method thereof |
| CN111193780A (en) * | 2019-12-17 | 2020-05-22 | 国电南瑞科技股份有限公司 | Modularized Internet of things platform data transmission system |
| WO2021213293A1 (en) * | 2020-04-24 | 2021-10-28 | 西北工业大学 | Ubiquitous operating system oriented toward group intelligence perception |
| CN111787066A (en) * | 2020-06-06 | 2020-10-16 | 王科特 | Internet of things data platform based on big data and AI |
| WO2022257181A1 (en) * | 2021-06-07 | 2022-12-15 | 刘天琼 | Aiot paas internet of things operation platform |
| CN115665197A (en) * | 2022-10-19 | 2023-01-31 | 成都数智索信息技术有限公司 | Automatic warehousing system and method based on data acquisition of Internet of things |
| CN116132317A (en) * | 2022-12-12 | 2023-05-16 | 南京理工大学 | Industrial Internet data acquisition analysis and visualization integrated system and deployment method thereof |
| CN116055524A (en) * | 2022-12-30 | 2023-05-02 | 中科云谷科技有限公司 | Interaction method, processor and device for Internet platform and Internet of things equipment |
| KR102545220B1 (en) * | 2022-12-30 | 2023-06-20 | (주)임픽스 | Edge gateway device that simultaneously supports open platform communications-unified architecture and publish subscribe standard communication protocols |
| CN116233283A (en) * | 2023-05-05 | 2023-06-06 | 湖南盛鼎科技发展有限责任公司 | Dynamic expansion and hot plug method of equipment communication protocol |
Non-Patent Citations (1)
| Title |
|---|
| 丁楠 ; 徐成 ; .基于ARM处理器及Linux的通信管理机研发.微计算机信息.2010,(32),全文. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116582582A (en) | 2023-08-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1992635B (en) | Method of simulating SNMP network element and performing network management system test with the network element | |
| CN107621987B (en) | Unmanned aerial vehicle general ground station software architecture system based on message | |
| WO2011150715A1 (en) | Method and device for collecting data of third-party equipment in distributed control system | |
| CN110912782B (en) | Data acquisition method, device and storage medium | |
| CN112491743A (en) | Configuration method and device of exchange chip | |
| CN111552901B (en) | H5 cross-engine client data automation updating method and storage medium | |
| CN113347195B (en) | Dynamic mounting system and method for communication protocol packet of Internet of things equipment | |
| CN116582582B (en) | Data acquisition method, system, equipment and medium for component type Internet of things | |
| CN114513410A (en) | Method and system for equipment to rapidly access Internet of things platform | |
| CN109788036B (en) | Distributed computing method and device based on cloud network and cloud server with distributed computing method and device | |
| CN108092959B (en) | BACnet protocol analysis method based on configuration | |
| CN112422314B (en) | Method and system for collecting and reporting alarm performance data | |
| KR20080047248A (en) | Security testing apparatus and method of remote remote procedure call software | |
| CN110955537B (en) | Method and device for containing pipes by physical machine | |
| CN1627752A (en) | General method for controlling interconnecting device based on UPNP protocol | |
| CN113821560A (en) | DAP platform-based big data processing method and system | |
| CN117135011B (en) | Method for adapting gateway to multiple cloud platforms based on MQTT communication and gateway system | |
| CN101145953B (en) | Method and system for dynamic debugging of network device management software | |
| CN114070896B (en) | Communication interface, electronic device and device management method | |
| CN104298750B (en) | Renewal processing method and processing device for real-time system communication | |
| CN115037639B (en) | Processing method, device, equipment and medium of edge data platform interface information | |
| CN114936098B (en) | Data transfer method, device, back-end equipment and storage medium | |
| CN108446131B (en) | ATM firmware upgrading method, device, equipment and storage medium | |
| CN115242912A (en) | STF-based mobile phone automatic test method | |
| CN116886530A (en) | Comprehensive communication method and system based on database plug-in |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |