CN114153524A - Internet of things data acquisition method, device and system - Google Patents
Internet of things data acquisition method, device and system Download PDFInfo
- Publication number
- CN114153524A CN114153524A CN202111424794.0A CN202111424794A CN114153524A CN 114153524 A CN114153524 A CN 114153524A CN 202111424794 A CN202111424794 A CN 202111424794A CN 114153524 A CN114153524 A CN 114153524A
- Authority
- CN
- China
- Prior art keywords
- internet
- data
- plug
- things
- things data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/445—Program loading or initiating
- G06F9/44521—Dynamic linking or loading; Link editing at or after load time, e.g. Java class loading
- G06F9/44526—Plug-ins; Add-ons
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/20—Software design
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/546—Message passing systems or structures, e.g. queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/547—Remote procedure calls [RPC]; Web services
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16Y—INFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
- G16Y20/00—Information sensed or collected by the things
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16Y—INFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
- G16Y30/00—IoT infrastructure
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16Y—INFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
- G16Y40/00—IoT characterised by the purpose of the information processing
- G16Y40/10—Detection; Monitoring
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04Q—SELECTING
- H04Q9/00—Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/54—Indexing scheme relating to G06F9/54
- G06F2209/548—Queue
Abstract
The invention relates to a method, a device and a system for acquiring Internet of things data.A collecting plug-in corresponding to each communication protocol is determined according to the communication protocol corresponding to each Internet of things data acquired by an intermediate component in advance; performing plug-in configuration initialization operation on the plug-in configuration file to obtain plug-in configuration data; performing resource initialization on all acquisition plug-ins according to the plug-in configuration data to obtain target acquisition plug-ins corresponding to each Internet of things data; acquiring target internet-of-things data from an interface of a communication protocol corresponding to each target acquisition plug-in by using each target acquisition plug-in; performing data processing on all target Internet of things data to obtain processed Internet of things data; and carrying out data persistence processing on the processed Internet of things data to obtain application Internet of things data. The scheme utilizes different acquisition plug-ins corresponding to different communication protocols to acquire the data of the Internet of things, improves the adaptation capability of products, reduces the complexity of the data acquisition of the Internet of things, and improves the data acquisition efficiency of the Internet of things.
Description
Technical Field
The invention relates to the technical field of Internet of things data acquisition, in particular to a method, a device and a system for acquiring Internet of things data.
Background
The internet of things is that any object or process needing monitoring, connection and interaction is collected in real time through various devices and technologies such as various information sensors, radio frequency identification technologies, global positioning systems, infrared sensors, laser scanners and the like, various required information such as sound, light, heat, electricity, mechanics, chemistry, biology, positions and the like is collected, ubiquitous connection of objects and objects, and ubiquitous connection of objects and people are realized through various possible network accesses, and intelligent sensing, identification and management of the objects and the processes are realized. The internet of things is an information bearer based on the internet, a traditional telecommunication network and the like, and all common physical objects which can be independently addressed form an interconnected network.
In the process of accessing equipment data by the platform of the internet of things, the equipment is various, the communication protocols used by the equipment are also various, the communication protocols of the equipment of the same type are different, the required technologies are correspondingly different, the difficulty in building the docking environment is higher, the data acquisition of the internet of things is complex, and the acquisition efficiency is lower.
Therefore, how to reduce the complexity of acquiring the internet of things data and improve the efficiency of acquiring the internet of things data is a technical problem that needs to be solved urgently by those skilled in the art.
Disclosure of Invention
In view of this, the present invention aims to provide a method, a device and a system for acquiring internet of things data, so as to solve the problems of complex acquisition and low acquisition efficiency of the internet of things data in the prior art.
In order to achieve the purpose, the invention adopts the following technical scheme:
an internet of things data acquisition method, comprising:
according to communication protocols corresponding to the various internet of things data acquired by the intermediate component in advance, determining a collection plug-in corresponding to each communication protocol;
performing plug-in configuration initialization operation on a pre-stored plug-in configuration file to obtain plug-in configuration data;
performing resource initialization on all the acquisition plug-ins according to the plug-in configuration data to obtain target acquisition plug-ins corresponding to each communication protocol;
acquiring target Internet of things data from an interface of a communication protocol corresponding to each target acquisition plug-in by using each target acquisition plug-in;
performing data processing on all the target Internet of things data to obtain processed Internet of things data;
and carrying out data persistence processing on the processed Internet of things data to obtain application Internet of things data so that an application platform utilizes the application Internet of things data to carry out application development.
Further, the method for acquiring the internet of things data further comprises the following steps:
acquiring preview data and a data structure corresponding to the target Internet of things data by utilizing a pre-stored read adaptation file;
and previewing the target Internet of things data according to the preview data and the data structure.
Further, the method for acquiring the internet of things data further comprises the following steps:
packaging all the target acquisition plug-ins to obtain plug-in jar packets corresponding to the target acquisition plug-ins;
and sending the plug-in jar packets corresponding to all the target acquisition plug-ins to a server so that the target acquisition plug-ins are deployed on servers of different local area networks.
Further, the method for acquiring the internet of things data further comprises the following steps:
generating a plug-in configuration page corresponding to the plug-in configuration file according to the plug-in configuration file;
starting a debugging mode by using the plug-in configuration page, and acquiring and debugging the Internet of things data by using a preset debugging tool;
acquiring a debugging log in a debugging process;
and analyzing the abnormal operation information in the debugging process according to the debugging log, and performing abnormal positioning on the abnormal operation information.
Further, in the above method for acquiring the internet of things data, the target internet of things data is in json format.
Further, in the above method for acquiring data of an internet of things, the performing data persistence processing on the processed data of an internet of things to obtain application data of an internet of things includes:
and sending the processed Internet of things data to a data platform to obtain application Internet of things data which is stored persistently so as to realize persistent storage of the processed Internet of things data.
Further, in the above method for acquiring internet of things data, the data platform includes: at least one of elastic search, MySQL, Neo4j, and Redis.
Further, in the above method for acquiring internet of things data, the intermediate module includes: at least one of a gateway, an edge device, an interface, and a database.
The invention also provides an internet of things data acquisition device, which comprises:
the plug-in determining module is used for determining a collecting plug-in corresponding to each communication protocol according to the communication protocol corresponding to each internet of things data acquired by the intermediate assembly in advance;
the configuration initialization module is used for carrying out plug-in configuration initialization operation on a pre-stored plug-in configuration file to obtain plug-in configuration data;
the plug-in initialization module is used for carrying out resource initialization on all the acquisition plug-ins according to the plug-in configuration data to obtain target acquisition plug-ins corresponding to each communication protocol;
the acquisition module is used for acquiring target internet of things data from an interface of a communication protocol corresponding to each target acquisition plug-in by using each target acquisition plug-in;
the data processing module is used for carrying out data processing on all the target internet of things data to obtain processed internet of things data;
and the data persistence module is used for performing data persistence processing on the processed internet of things data to obtain application internet of things data so that an application platform can perform application development by using the application internet of things data.
The invention also provides an internet of things data acquisition system, which comprises: the system comprises a processor and a memory connected with the processor;
the memory is used for storing a computer program, and the computer program is at least used for executing the above Internet of things data acquisition method;
the processor is used for calling and executing the computer program.
A method, a device and a system for acquiring Internet of things data are provided, wherein the method comprises the following steps: determining a collection plug-in corresponding to each communication protocol according to the communication protocol corresponding to each internet of things data acquired by the intermediate component in advance; performing plug-in configuration initialization operation on a pre-stored plug-in configuration file to obtain plug-in configuration data; performing resource initialization on all acquisition plug-ins according to the plug-in configuration data to obtain target acquisition plug-ins corresponding to each communication protocol; acquiring target internet-of-things data corresponding to each target acquisition plug-in from all the internet-of-things data by using a data acquisition interface in each target acquisition plug-in; performing data processing on all target Internet of things data to obtain processed Internet of things data; and carrying out data persistence processing on the processed Internet of things data to obtain application Internet of things data so that the application platform utilizes the application Internet of things data to carry out application development. By adopting the technical scheme of the invention, different acquisition plug-ins corresponding to different communication protocols can be directly utilized to acquire the data of the internet of things, the plug-ins can be enabled to operate independently, different acquisition functions have independent operation environments, the mutual conflict among the functions is avoided, the adaptive capacity of the acquisition plug-ins is improved, the complexity of acquiring the data of the internet of things is reduced, and the efficiency of acquiring the data of the internet of things is improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a flow chart provided by an embodiment of a method for collecting Internet of things data according to the present invention;
fig. 2 is a schematic structural diagram provided by an embodiment of the internet of things data acquisition device of the present invention;
fig. 3 is a schematic structural diagram provided in an embodiment of the system for acquiring data through internet of things according to the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the technical solutions of the present invention will be described in detail below. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. All other embodiments, which can be derived by a person skilled in the art from the examples given herein without any inventive step, are within the scope of the present invention.
Fig. 1 is a flowchart provided in an embodiment of the method for acquiring internet of things data of the present invention, and as shown in fig. 1, the method for acquiring internet of things data of the present embodiment specifically includes the following steps:
s101, according to the communication protocols corresponding to the various internet of things data acquired by the intermediate component in advance, determining a collection plug-in corresponding to each communication protocol.
In this embodiment, the terminal device or the device management system needs to send or converge the internet of things data to the intermediate component, and after the intermediate component acquires all the internet of things data, the acquisition plug-in platform determines the acquisition plug-in corresponding to each communication protocol according to the communication protocol corresponding to each internet of things data. That is, different intermediate components acquire different internet of things data, and each intermediate component provides a communication protocol for transmitting the internet of things data. Wherein, the communication protocol comprises: HTTP, MQTT, TCP/UDP, JDBC, SNMP, Modbus, etc. The intermediate assembly includes: at least one of a gateway, an edge device, an interface, and a database.
S102, performing plug-in configuration initialization operation on a pre-stored plug-in configuration file to obtain plug-in configuration data.
In this embodiment, the collection plug-in platform stores the plug-in configuration file, and the collection plug-in platform can perform plug-in configuration initialization operation on the plug-in configuration file, so as to obtain plug-in configuration data. Specifically, the plug-in configuration may be initialized by using a method of void initialization (PluginConfig readerConfig), where the method is stored in a read adaptation file, where the read adaptation file requires java development and a dependent package
<dependency>
<groupId>org.coredata</groupId>
<artifactId>coredata-core-collector-api</artifactId>
<version>5.0.1-RELEASE</version>
</dependency>
Inherits the ReaderAdapter class and implements initialize, getData abstract methods.
In addition, the acquisition plug-in platform can also dynamically generate a configuration page according to the plug-in configuration file, and the configuration page does not need to be developed, so that the efficiency of the data acquisition of the internet of things is improved.
S103, initializing resources of all acquisition plugins according to the plugin configuration data to obtain target acquisition plugins corresponding to each communication protocol.
Through the steps, after the plug-in configuration data is obtained, resource initialization can be carried out on all the acquisition plug-ins according to the plug-in configuration data, and therefore the target acquisition plug-ins corresponding to each communication protocol are obtained. In particular, a void initialization (plugin config) method may be utilized to initialize protocol resources (such as connection pools) according to the plug-in configuration data.
And S104, acquiring target Internet of things data from the interface of the communication protocol corresponding to each target acquisition plug-in by using each target acquisition plug-in.
After the acquisition plug-in platform determines the target acquisition plug-ins corresponding to each communication protocol, the acquisition plug-ins need to operate each target acquisition plug-in, and the acquisition of the data of the Internet of things is realized by reading the corresponding target Internet of things data from the interfaces of the communication protocols corresponding to each target acquisition plug-in by using each target acquisition plug-in. Specifically, a data acquisition interface can be established by using a String getData (bootstrap ispreview) method to acquire target internet-of-things data, wherein the method is also stored in a read adaptation file. Data can be acquired in the getData, and then the data is processed into json to return. Therefore, the target internet of things data is in json format.
And S105, performing data processing on all the target Internet of things data to obtain processed Internet of things data.
After all the target internet of things data are acquired by using the target acquisition plug-in, all the target internet of things data need to be subjected to data processing, such as data cleaning, so that the processed internet of things data are acquired.
And S106, performing data persistence processing on the processed Internet of things data to obtain application Internet of things data.
After the processed internet of things data is obtained, the data persistence processing needs to be performed on all the processed internet of things data, so that the application internet of things data is obtained. The application platform can develop corresponding application according to the application Internet of things data. The specific execution steps are as follows:
and sending the processed Internet of things data to a data platform to realize persistent storage of the processed Internet of things data.
The acquisition plug-in platform needs to send all processed internet of things data to the data platform through RPC or message queues, so that persistent storage of the processed internet of things data is achieved, and application internet of things data stored by the data platform is obtained. The application platform can directly extract the application internet of things data from the data platform. Wherein, data platform includes: at least one of elastic search, MySQL, Neo4j, and Redis. Applications developed include: graph, report, interface, alarm, model, etc.
According to the method for acquiring the internet of things data, an acquisition plug-in corresponding to each communication protocol is determined according to the communication protocol corresponding to each internet of things data acquired by the intermediate component in advance; performing plug-in configuration initialization operation on a pre-stored plug-in configuration file to obtain plug-in configuration data; performing resource initialization on all acquisition plug-ins according to the plug-in configuration data to obtain target acquisition plug-ins corresponding to each communication protocol; acquiring target internet-of-things data corresponding to each target acquisition plug-in from all the internet-of-things data by using a data acquisition interface in each target acquisition plug-in; performing data processing on all target Internet of things data to obtain processed Internet of things data; and carrying out data persistence processing on the processed Internet of things data to obtain application Internet of things data so that the application platform utilizes the application Internet of things data to carry out application development. By adopting the technical scheme of the embodiment, different acquisition plug-ins corresponding to different communication protocols can be directly utilized to acquire the data of the internet of things, the plug-ins can be enabled to operate independently, different acquisition functions have independent operation environments, mutual conflict among the functions is avoided, the adaptive capacity of the acquisition plug-ins is improved, the complexity of the data acquisition of the internet of things is reduced, and the data acquisition efficiency of the internet of things is improved.
Further, the method for acquiring the internet of things data of the embodiment further comprises the following steps:
firstly, preview data and a data structure corresponding to target internet of things data are obtained by utilizing a pre-stored reading adaptation file.
The embodiment may extract a RecordData preview () method from a pre-stored read adaptation file, acquire preview data corresponding to target internet-of-things data using the method, extract a List < String > getFieldNames () method from the pre-stored read adaptation file, and acquire a data structure corresponding to the preview data using the method. In addition, a void close () method is also included in the read adaptation file, and the method can realize the function of closing the plug-in task.
Secondly, previewing the target internet of things data according to the preview data and the data structure.
The preview of the target Internet of things data can be realized by using the pre-acquired preview data and the corresponding data structure.
Further, the method for acquiring the internet of things data of the embodiment further comprises the following steps:
firstly, packaging all target acquisition plug-ins to obtain plug-in jar packages corresponding to the target acquisition plug-ins.
Secondly, plug-in jar packages corresponding to all the target acquisition plug-ins are sent to the server, so that the target acquisition plug-ins are deployed on the servers of different local area networks. Therefore, the deployment of the target acquisition plug-in units across the local area network can be realized, the problem that a plurality of systems are needed to be deployed in a multi-local area network scene, which is redundant and heavy, is solved, the complexity of the data acquisition of the internet of things is reduced, and the data acquisition efficiency of the internet of things is improved.
Further, the method for acquiring the internet of things data of the embodiment further comprises the following steps:
firstly, generating a plug-in configuration page corresponding to the plug-in configuration file according to the plug-in configuration file.
And secondly, starting a debugging mode by utilizing a plug-in configuration page, and acquiring and debugging the Internet of things data by utilizing a preset debugging tool. Wherein, predetermine the debug tool and include: remote debugging component of Remote JVM Debug.
And thirdly, acquiring a debugging log in the debugging process.
Fourthly, analyzing the abnormal operation information in the debugging process according to the debugging log, and carrying out abnormal positioning on the abnormal operation information. Therefore, the abnormity in the debugging process is conveniently positioned, the abnormity is timely processed, and the accuracy of the Internet of things data acquisition is improved.
In order to be more comprehensive, the application also provides an internet of things data acquisition device corresponding to the internet of things data acquisition method provided by the embodiment of the invention.
Fig. 2 is a schematic structural diagram provided in an embodiment of the internet of things data acquisition device of the present invention, and as shown in fig. 2, the internet of things data acquisition device of the present embodiment includes: the system comprises a plug-in determination module 11, a configuration initialization module 12, a plug-in initialization module 13, an acquisition module 14, a data processing module 15 and a data persistence module 16.
The plug-in determining module 11 is configured to determine, according to the communication protocol corresponding to each piece of internet-of-things data acquired in advance by the intermediate component, an acquisition plug-in corresponding to each communication protocol;
the configuration initialization module 12 is configured to perform plugin configuration initialization operation on a prestored plugin configuration file to obtain plugin configuration data;
the plug-in initialization module 13 is configured to perform resource initialization on all the acquisition plug-ins according to the plug-in configuration data to obtain target acquisition plug-ins corresponding to each communication protocol;
the acquisition module 14 is configured to acquire, by using each target acquisition plug-in, target internet-of-things data from an interface of a communication protocol corresponding to each target acquisition plug-in;
the data processing module 15 is used for performing data processing on all target internet of things data to obtain processed internet of things data;
and the data persistence module 16 is configured to perform data persistence processing on the processed internet of things data to obtain application internet of things data, so that the application platform performs application development by using the application internet of things data.
The thing of this embodiment allies oneself with data acquisition device can directly utilize the different collection plug-ins that different communication protocols correspond to carry out thing and allies oneself with data acquisition, can let plug-in components independent operation, makes different collection function possess independent operational environment, has avoided the mutual conflict between the function, has improved the adaptation ability of gathering plug-in components, has reduced thing and allies oneself with data acquisition complexity, has improved thing and allies oneself with data acquisition efficiency.
Further, the internet of things data acquisition device of this embodiment further includes: the device comprises an acquisition module and a preview module.
And the acquisition module is used for acquiring preview data and a data structure corresponding to the target Internet of things data by utilizing the pre-stored reading adaptation file.
And the preview module is used for previewing the target Internet of things data according to the preview data and the data structure.
Further, the internet of things data acquisition device of this embodiment further includes: the device comprises a packaging module and an uploading module.
And the packaging module is used for packaging all the target acquisition plug-ins to obtain plug-in jar packages corresponding to the target acquisition plug-ins.
And the uploading module is used for sending the plug-in jar packages corresponding to all the target acquisition plug-ins to the server so as to deploy the target acquisition plug-ins on the servers of different local area networks.
Further, the internet of things data acquisition device of this embodiment further includes: the device comprises a generating module, a debugging module and an analyzing module.
The generating module is used for generating a plug-in configuration page corresponding to the plug-in configuration file according to the plug-in configuration file;
the debugging module is used for starting a debugging mode by utilizing the plug-in configuration page and acquiring and debugging the Internet of things data by utilizing a preset debugging tool;
the acquisition module is also used for acquiring a debugging log in the debugging process;
and the analysis module is used for analyzing the abnormal operation information in the debugging process according to the debugging log and carrying out abnormal positioning on the abnormal operation information.
Further, in the data acquisition device for the internet of things of the present embodiment, the data persistence module 16 is specifically configured to send the processed data of the internet of things to the data platform, so as to obtain application data of persistent storage, so as to implement persistent storage of the processed data of the internet of things.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
Fig. 3 is a schematic structural diagram provided in an embodiment of the system for acquiring data through internet of things according to the present invention. As shown in fig. 3, the system for acquiring internet of things data of the present embodiment includes: a processor 21 and a memory 22. Wherein the processor 21 is connected to the memory 22.
The data acquisition system of the internet of things can directly utilize different acquisition plug-in units corresponding to different communication protocols to acquire data of the internet of things, can allow the plug-in units to operate independently, enables different acquisition functions to have independent operation environments, avoids mutual conflict among the functions, improves the adaptation capability of the acquisition plug-in units, reduces the complexity of data acquisition of the internet of things, and improves the data acquisition efficiency of the internet of things.
It is understood that the same or similar parts in the above embodiments may be mutually referred to, and the same or similar parts in other embodiments may be referred to for the content which is not described in detail in some embodiments.
It should be noted that the terms "first," "second," and the like in the description of the present invention are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. Further, in the description of the present invention, the meaning of "a plurality" means at least two unless otherwise specified.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and alternate implementations are included within the scope of the preferred embodiment of the present invention in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present invention.
It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.
In addition, functional units in the embodiments of the present invention may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.
The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention, and that variations, modifications, substitutions and alterations can be made to the above embodiments by those of ordinary skill in the art within the scope of the present invention.
Claims (10)
1. An internet of things data acquisition method is characterized by comprising the following steps:
according to communication protocols corresponding to the various internet of things data acquired by the intermediate component in advance, determining a collection plug-in corresponding to each communication protocol;
performing plug-in configuration initialization operation on a pre-stored plug-in configuration file to obtain plug-in configuration data;
performing resource initialization on all the acquisition plug-ins according to the plug-in configuration data to obtain target acquisition plug-ins corresponding to each communication protocol;
acquiring target Internet of things data from an interface of a communication protocol corresponding to each target acquisition plug-in by using each target acquisition plug-in;
performing data processing on all the target Internet of things data to obtain processed Internet of things data;
and carrying out data persistence processing on the processed Internet of things data to obtain application Internet of things data so that an application platform utilizes the application Internet of things data to carry out application development.
2. The method for acquiring the internet of things data according to claim 1, further comprising:
acquiring preview data and a data structure corresponding to the target Internet of things data by utilizing a pre-stored read adaptation file;
and previewing the target Internet of things data according to the preview data and the data structure.
3. The method for acquiring the internet of things data according to claim 1, further comprising:
packaging all the target acquisition plug-ins to obtain plug-in jar packets corresponding to the target acquisition plug-ins;
and sending the plug-in jar packets corresponding to all the target acquisition plug-ins to a server so that the target acquisition plug-ins are deployed on servers of different local area networks.
4. The method for acquiring the internet of things data according to claim 1, further comprising:
generating a plug-in configuration page corresponding to the plug-in configuration file according to the plug-in configuration file;
starting a debugging mode by using the plug-in configuration page, and acquiring and debugging the Internet of things data by using a preset debugging tool;
acquiring a debugging log in a debugging process;
and analyzing the abnormal operation information in the debugging process according to the debugging log, and performing abnormal positioning on the abnormal operation information.
5. The method for acquiring the data of the internet of things according to claim 1, wherein the target data of the internet of things is in json format.
6. The method for acquiring the internet of things data according to claim 1, wherein the step of performing data persistence processing on the processed internet of things data to obtain application internet of things data comprises the following steps:
and sending the processed Internet of things data to a data platform to obtain application Internet of things data which is stored persistently so as to realize persistent storage of the processed Internet of things data.
7. The method of claim 6, wherein the data platform comprises: at least one of elastic search, MySQL, Neo4j, and Redis.
8. The method of claim 1, wherein the intermediate component comprises: at least one of a gateway, an edge device, an interface, and a database.
9. An internet of things data acquisition device, comprising:
the plug-in determining module is used for determining a collecting plug-in corresponding to each communication protocol according to the communication protocol corresponding to each internet of things data acquired by the intermediate assembly in advance;
the configuration initialization module is used for carrying out plug-in configuration initialization operation on a pre-stored plug-in configuration file to obtain plug-in configuration data;
the plug-in initialization module is used for carrying out resource initialization on all the acquisition plug-ins according to the plug-in configuration data to obtain target acquisition plug-ins corresponding to each communication protocol;
the acquisition module is used for acquiring target internet of things data from an interface of a communication protocol corresponding to each target acquisition plug-in by using each target acquisition plug-in;
the data processing module is used for carrying out data processing on all the target internet of things data to obtain processed internet of things data;
and the data persistence module is used for performing data persistence processing on the processed internet of things data to obtain application internet of things data so that an application platform can perform application development by using the application internet of things data.
10. An internet of things data acquisition system, comprising: the system comprises a processor and a memory connected with the processor;
the memory is used for storing a computer program for at least performing the method of acquiring the data of the internet of things according to any one of claims 1 to 8;
the processor is used for calling and executing the computer program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111424794.0A CN114153524B (en) | 2021-11-26 | 2021-11-26 | Internet of things data acquisition method, device and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111424794.0A CN114153524B (en) | 2021-11-26 | 2021-11-26 | Internet of things data acquisition method, device and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114153524A true CN114153524A (en) | 2022-03-08 |
| CN114153524B CN114153524B (en) | 2023-01-24 |
Family
ID=80458756
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111424794.0A Active CN114153524B (en) | 2021-11-26 | 2021-11-26 | Internet of things data acquisition method, device and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114153524B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103218220A (en) * | 2013-02-25 | 2013-07-24 | 上海谐宇网络科技有限公司 | Dynamic pluggable component based-Internet of things middleware system |
| CN105404169A (en) * | 2015-12-29 | 2016-03-16 | 上海大学 | Central control system of smart home and control method |
| CN111416845A (en) * | 2020-03-12 | 2020-07-14 | 腾讯云计算（北京）有限责任公司 | Method and device for configuring edge device and storage medium |
| CN111901381A (en) * | 2020-06-29 | 2020-11-06 | 北京智芯微电子科技有限公司 | Internet of things agent device based on edge calculation and data decision method |
| CN112087454A (en) * | 2020-09-10 | 2020-12-15 | 上海顺舟智能科技股份有限公司 | Communication method, device, equipment and storage medium of Internet of things gateway equipment |
-
2021
- 2021-11-26 CN CN202111424794.0A patent/CN114153524B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103218220A (en) * | 2013-02-25 | 2013-07-24 | 上海谐宇网络科技有限公司 | Dynamic pluggable component based-Internet of things middleware system |
| CN105404169A (en) * | 2015-12-29 | 2016-03-16 | 上海大学 | Central control system of smart home and control method |
| CN111416845A (en) * | 2020-03-12 | 2020-07-14 | 腾讯云计算（北京）有限责任公司 | Method and device for configuring edge device and storage medium |
| CN111901381A (en) * | 2020-06-29 | 2020-11-06 | 北京智芯微电子科技有限公司 | Internet of things agent device based on edge calculation and data decision method |
| CN112087454A (en) * | 2020-09-10 | 2020-12-15 | 上海顺舟智能科技股份有限公司 | Communication method, device, equipment and storage medium of Internet of things gateway equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114153524B (en) | 2023-01-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9973390B2 (en) | Method of discovering network topology | |
| KR100823122B1 (en) | Remote management and access of databases, services and devices associated with a mobile terminal | |
| US6772205B1 (en) | Executing applications on a target network device using a proxy network device | |
| EP2151095B1 (en) | Method and apparatus for discovering universal plug and play device using resource information | |
| CN113542365B (en) | Terminal-side Internet of things platform architecture based on multi-scene application | |
| RU2636112C1 (en) | Object of interface management service, function service object and method of control of elements | |
| US20200128077A1 (en) | Data transmission method and device | |
| US10594614B2 (en) | Context aware routing | |
| US20180074933A1 (en) | Management of log data in electronic systems | |
| CN111831247A (en) | Screen projection method, device and equipment based on two-dimensional code and storage medium | |
| US11740997B2 (en) | Method and apparatus for debugging a device | |
| Kazmi et al. | Vital-os: An open source iot operating system for smart cities | |
| Eridani et al. | Performance of sensors monitoring system using raspberry Pi through MQTT protocol | |
| GB2608925A (en) | Automated malware monitoring and data extraction | |
| Al Sunny et al. | Mtcomm: A semantic ontology based internet scale communication method of manufacturing services in a cyber-physical manufacturing cloud | |
| WO2021162860A1 (en) | Multi-tenant java agent instrumentation system | |
| WO2018202440A1 (en) | Data transmission method and apparatus | |
| CN114153524B (en) | Internet of things data acquisition method, device and system | |
| WO2022056927A1 (en) | Gateway, data collection method, electronic device, storage medium, and program | |
| Petrović | Model-based approach for semantic-driven deployment of containerized applications to support future internet services and architectures | |
| Bosman et al. | Gateway architectures for service oriented application-level gateways | |
| CN109218049B (en) | Control method, related equipment and system | |
| Noman et al. | From threads to events: Adapting a lightweight middleware for Contiki OS | |
| KR20180014546A (en) | Apparatus for virtualizing Internet of things and test environment | |
| CN108287752B (en) | Terminal-oriented task scheduling method and system, storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |