CN114124695A - Data acquisition method and device and electronic equipment - Google Patents
Data acquisition method and device and electronic equipment Download PDFInfo
- Publication number
- CN114124695A CN114124695A CN202111392362.6A CN202111392362A CN114124695A CN 114124695 A CN114124695 A CN 114124695A CN 202111392362 A CN202111392362 A CN 202111392362A CN 114124695 A CN114124695 A CN 114124695A
- Authority
- CN
- China
- Prior art keywords
- data acquisition
- data
- service module
- attribute information
- middleware
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 41
- 238000004891 communication Methods 0.000 claims abstract description 29
- 238000012544 monitoring process Methods 0.000 claims abstract description 11
- 238000011161 development Methods 0.000 claims description 7
- 230000003044 adaptive effect Effects 0.000 claims description 6
- 238000013480 data collection Methods 0.000 claims description 6
- 238000012423 maintenance Methods 0.000 abstract description 7
- 238000012545 processing Methods 0.000 description 12
- 238000010586 diagram Methods 0.000 description 11
- 238000004590 computer program Methods 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 238000013461 design Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 238000011144 upstream manufacturing Methods 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000003252 repetitive effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0803—Configuration setting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0803—Configuration setting
- H04L41/0806—Configuration setting for initial configuration or provisioning, e.g. plug-and-play
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/2866—Architectures; Arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/2866—Architectures; Arrangements
- H04L67/30—Profiles
Abstract
The embodiment of the specification provides a data acquisition method, which comprises the steps of building a configuration platform, a registration center, a middleware, a message queue module and data acquisition service modules corresponding to different data acquisition protocols, sending configuration information to the registration center for registration when the data acquisition service modules are started for the first time, the attribute information of the acquisition equipment is configured for the acquisition equipment by the configuration center, the middleware establishes communication with the message queue module and the registration center, newly added registration information in the registration center is monitored, and establishes communication with the corresponding data acquisition service module, the middleware reads the configured equipment attribute information, and the middleware acquires data acquired by the acquisition equipment under each data acquisition service module through each data acquisition service module and sends the data to the message queue module. The operation and maintenance difficulty is reduced and the resource utilization efficiency is improved in an automatic monitoring and matching mode through the middleware.
Description
Technical Field
The present application relates to the field of internet, and in particular, to a data acquisition method and apparatus, and an electronic device.
Background
The internet of things is a mechanism for sharing information and generating useful information between things by connecting the internet and operating without human management. As long as the internet can be connected with the internet, the internet of things is called an object. The data acquisition technology of the internet of things is used for receiving data from equipment and uploading the data to other services for further processing and storage. In the past, most of researches on the internet of things are focused on equipment communication challenges, but with the development of technologies, the application of the internet of things starts to consider the design of openness and expandability of a method and a system for integrating existing network equipment, so the most basic data acquisition of the application of the internet of things should also consider the design of more openness and high expandability.
Traditional monolithic architectures of the internet of things couple almost all functions together, and the internet of things becomes more and more complex in a distributed environment due to the increase in system functions. Therefore, the overload phenomenon often occurs, and at this time, the system can be expanded only by repeatedly deploying a plurality of systems with the same volume, which easily causes resource waste and has high operation and maintenance management difficulty.
Therefore, it is necessary to provide a new data acquisition method to reduce the operation and maintenance difficulty and improve the resource utilization efficiency.
Disclosure of Invention
The embodiment of the specification provides a data acquisition method, a data acquisition device and electronic equipment, which are used for reducing operation and maintenance difficulty and improving resource utilization efficiency.
An embodiment of the present specification provides a data acquisition method, including:
building a configuration platform, a registration center, middleware, a message queue module and data acquisition service modules corresponding to different data acquisition protocols;
the data acquisition service module sends configuration information to a registration center for registration when being started for the first time;
configuring attribute information of acquisition equipment for the acquisition equipment through a configuration center, establishing communication between the middleware and the message queue module as well as a registration center, monitoring newly added registration information in the registration center, and establishing communication with a corresponding data acquisition service module;
the middleware reads the configured equipment attribute information, determines an acquisition service module corresponding to acquisition equipment according to the configured equipment attribute information, and sends the equipment attribute information to the acquisition service module;
the middleware acquires data acquired by acquisition equipment under each data acquisition service module through each data acquisition service module and sends the data to the message queue module.
Optionally, the determining, according to the configured device attribute information, a data collection service module corresponding to a collection device includes:
and matching the corresponding data acquisition service module according to the protocol type in the equipment attribute information.
Optionally, configuring, by the configuration center, attribute information of the acquisition device for the acquisition device includes:
and updating the attribute information of the acquisition equipment for the acquisition equipment through the configuration center.
Optionally, the acquiring the device attribute information includes: device address information and device protocol information.
Optionally, the method further comprises:
building a remote calling system adaptive to a plurality of development languages;
the middleware acquires the data acquired by the acquisition equipment under each data acquisition service module through each data acquisition service module, and the method comprises the following steps:
the middleware establishes communication with each data acquisition service module through the remote calling system and acquires data acquired by acquisition equipment under each data acquisition service module.
Optionally, configuring, by the configuration center, attribute information of the acquisition device for the acquisition device includes:
and pulling the equipment attribute information from the platform of the Internet of things, and automatically configuring.
Optionally, the sending the data to a message queue module includes:
and the middleware collects the data and sends the data to a message queue module.
An embodiment of the present specification further provides a data acquisition apparatus, including:
the system comprises a system building module, a configuration platform, a registration center, a middleware, a message queue module and data acquisition service modules corresponding to different data acquisition protocols;
the data acquisition service module is used for sending configuration information to the registration center for registration when the data acquisition service module is started for the first time;
the configuration platform configures the attribute information of the acquisition equipment for the acquisition equipment;
the middleware establishes communication with the message queue module and the registration center, monitors newly added registration information in the registration center and establishes communication with the corresponding data acquisition service module;
the middleware reads the configured equipment attribute information, determines an acquisition service module corresponding to acquisition equipment according to the configured equipment attribute information, and sends the equipment attribute information to the acquisition service module;
the middleware acquires data acquired by acquisition equipment under each data acquisition service module through each data acquisition service module and sends the data to the message queue module.
Optionally, the determining, according to the configured device attribute information, a data collection service module corresponding to a collection device includes:
and matching the corresponding data acquisition service module according to the protocol type in the equipment attribute information.
Optionally, configuring, by the configuration center, attribute information of the acquisition device for the acquisition device includes:
and updating the attribute information of the acquisition equipment for the acquisition equipment through the configuration center.
Optionally, the acquiring the device attribute information includes: device address information and device protocol information.
Optionally, the method further comprises:
building a remote calling system adaptive to a plurality of development languages;
the middleware acquires the data acquired by the acquisition equipment under each data acquisition service module through each data acquisition service module, and the method comprises the following steps:
the middleware establishes communication with each data acquisition service module through the remote calling system and acquires data acquired by acquisition equipment under each data acquisition service module.
Optionally, configuring, by the configuration center, attribute information of the acquisition device for the acquisition device includes:
and pulling the equipment attribute information from the platform of the Internet of things, and automatically configuring.
Optionally, the sending the data to a message queue module includes:
and the middleware collects the data and sends the data to a message queue module.
An embodiment of the present specification further provides an electronic device, where the electronic device includes:
a processor; and the number of the first and second groups,
a memory storing a computer executable program which, when executed, causes the processor to perform any of the methods described above.
The present specification also provides a computer readable storage medium, wherein the computer readable storage medium stores one or more programs which, when executed by a processor, implement any of the above methods.
The technical proposal provided by the embodiment of the specification sends configuration information to the registration center for registration when the data acquisition service module is started for the first time by building a configuration platform, the registration center, a middleware, a message queue module and data acquisition service modules corresponding to different data acquisition protocols, the attribute information of the acquisition equipment is configured for the acquisition equipment by the configuration center, the middleware establishes communication with the message queue module and the registration center, newly added registration information in the registration center is monitored, and establishes communication with the corresponding data acquisition service module, the middleware reads the configured equipment attribute information, and the middleware acquires data acquired by the acquisition equipment under each data acquisition service module through each data acquisition service module and sends the data to the message queue module. The operation and maintenance difficulty is reduced and the resource utilization efficiency is improved in an automatic monitoring and matching mode through the middleware.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
FIG. 1 is a schematic diagram illustrating a data collection method according to an embodiment of the present disclosure;
fig. 2 is a schematic structural diagram of a data acquisition device provided in an embodiment of the present disclosure;
fig. 3 is a schematic structural diagram of a data acquisition device provided in an embodiment of the present disclosure;
fig. 4 is a schematic structural diagram of an electronic device provided in an embodiment of the present disclosure;
fig. 5 is a schematic diagram of a computer-readable medium provided in an embodiment of the present specification.
Detailed Description
Exemplary embodiments of the present invention will now be described more fully with reference to the accompanying drawings. The exemplary embodiments, however, may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these exemplary embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of the invention to those skilled in the art. The same reference numerals denote the same or similar elements, components, or parts in the drawings, and thus their repetitive description will be omitted.
Features, structures, characteristics or other details described in a particular embodiment do not preclude the fact that the features, structures, characteristics or other details may be combined in a suitable manner in one or more other embodiments in accordance with the technical idea of the invention.
In describing particular embodiments, the present invention has been described with reference to features, structures, characteristics or other details that are within the purview of one skilled in the art to provide a thorough understanding of the embodiments. One skilled in the relevant art will recognize, however, that the invention may be practiced without one or more of the specific features, structures, characteristics, or other details.
The flow charts shown in the drawings are merely illustrative and do not necessarily include all of the contents and operations/steps, nor do they necessarily have to be performed in the order described. For example, some operations/steps may be decomposed, and some operations/steps may be combined or partially combined, so that the actual execution sequence may be changed according to the actual situation.
The block diagrams shown in the figures are functional entities only and do not necessarily correspond to physically separate entities. I.e. these functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor means and/or microcontroller means.
The term "and/or" and/or "includes all combinations of any one or more of the associated listed items.
Fig. 1 is a schematic diagram of a data acquisition method provided in an embodiment of the present disclosure, where the method may include:
s101: and (3) building a configuration platform, a registration center, middleware, a message queue module and data acquisition service modules corresponding to different data acquisition protocols.
By combining the concepts of high cohesion, low coupling, openness and high reusability of the existing internet information system, the data acquisition service of the industrial internet of things system and various data processing services can be decoupled into independent services, the data acquisition services of various different protocols are decoupled into a plurality of independent data acquisition services, the adaptation of various protocols of industrial equipment is realized by matching with a gPC (remote process calling system) and a dynamic configuration design, the expandability of a large amount of industrial equipment is supported, and meanwhile, the occupation of resources is reduced as much as possible.
The data acquisition service module is deployed for a plurality of devices using the same communication protocol, the middleware is deployed for a plurality of data acquisition service modules, core service is provided, the middleware is responsible for scheduling and managing the data acquisition service modules, collected data corresponding to the data acquisition service modules are collected in a unified mode, and the collected data are transmitted to an upstream message queue module for data processing service.
S102: and the data acquisition service module sends configuration information to a registration center for registration when being started for the first time.
All the independently deployed data acquisition service modules are started according to default initialization configuration, and the default initialization configuration may not contain acquired equipment information and acquisition point location information, and may only contain information required by a registration center (etcd) and service configuration information. After being started, the data acquisition service registers to the registration center.
S103: and configuring attribute information of the acquisition equipment for the acquisition equipment through a configuration center, establishing communication between the middleware and the message queue module as well as the registration center, monitoring newly added registration information in the registration center, and establishing communication with the corresponding data acquisition service module.
In an embodiment of this specification, the configuring, by the configuration center, attribute information of the acquisition device for the acquisition device includes:
and updating the attribute information of the acquisition equipment for the acquisition equipment through the configuration center.
In an embodiment of this specification, the acquiring of the device attribute information includes: device address information and device protocol information.
And the user enters a configuration page, and if the equipment needing configuration is configured before, the user acquires the previous configuration information to modify. If the equipment needing to be configured is new equipment, the equipment attribute information can be pulled from the platform of the Internet of things, and the configured configuration file is stored in the registration center.
Therefore, in this embodiment of the present specification, the configuring, by the configuration center, attribute information of the acquisition device for the acquisition device may include:
and pulling the equipment attribute information from the platform of the Internet of things, and automatically configuring.
S104: the middleware reads the configured equipment attribute information, determines an data acquisition service module corresponding to acquisition equipment according to the configured equipment attribute information, and sends the equipment attribute information to the data acquisition service module.
In an embodiment of this specification, the determining, according to the configured device attribute information, a data acquisition service module corresponding to an acquisition device includes:
and matching the corresponding data acquisition service module according to the protocol type in the equipment attribute information.
After the middleware is started, the middleware is connected to an upstream message queue and a registry, and the change or update of equipment configuration in the registry is monitored.
And after monitoring the change or update, the middleware finds the address of the data acquisition service module of the corresponding protocol from the data acquisition service registered in the registration center, and triggers the data acquisition service module to acquire data by using the new data acquisition configuration information.
And the data acquisition service module acquires the data according to the configuration information in the middleware request and the equipment point location data in the configuration information by matching with the corresponding protocol, converts the data according to the data format configured by the configuration platform and returns the data to the middleware.
S105: the middleware acquires data acquired by acquisition equipment under each data acquisition service module through each data acquisition service module and sends the data to the message queue module.
The method comprises the steps of building a configuration platform, a registration center, a middleware, a message queue module and data acquisition service modules corresponding to different data acquisition protocols, sending configuration information to the registration center for registration when the data acquisition service modules are started for the first time, configuring acquisition equipment attribute information for acquisition equipment through the configuration center, establishing communication between the middleware and the message queue module as well as the registration center, monitoring newly added registration information in the registration center, establishing communication with the corresponding data acquisition service modules, reading the configured equipment attribute information by the middleware, determining the data acquisition service modules corresponding to the acquisition equipment according to the configured equipment attribute information, sending the equipment attribute information to the data acquisition service modules, and acquiring data acquired by the acquisition equipment under each data acquisition service module through each data acquisition service module by the middleware and sending the data acquired by the acquisition equipment to the message queue module. The operation and maintenance difficulty is reduced and the resource utilization efficiency is improved in an automatic monitoring and matching mode through the middleware.
In the embodiment of this specification, still include:
building a remote calling system adaptive to a plurality of development languages;
the middleware acquires the data acquired by the acquisition equipment under each data acquisition service module through each data acquisition service module, and the method comprises the following steps:
the middleware establishes communication with each data acquisition service module through the remote calling system and acquires data acquired by acquisition equipment under each data acquisition service module.
In an embodiment of this specification, the sending the data to a message queue module includes:
and the middleware collects the data and sends the data to a message queue module.
In specific implementation, a redundant standby data acquisition service module can be set up, and the middleware is switched into the standby data acquisition service module when the state of the middleware meets the preset condition by monitoring the state of the data acquisition service module.
In the embodiment of the specification, a multi-stage data acquisition service module with gradually increasing load capacity can be set up, the middleware switches to the previous-stage data acquisition service module by monitoring the state of the current data acquisition service module when a preset condition is met, and the previous-stage data acquisition service module replaces the current data acquisition service module to acquire data acquired by the acquisition equipment deployed below the previous-stage data acquisition service module.
Fig. 2 is a schematic structural diagram of a data acquisition device provided in an embodiment of the present disclosure, where the data acquisition device may include:
the system comprises a system building module 201, a configuration platform, a registration center, a middleware, a message queue module and data acquisition service modules corresponding to different data acquisition protocols;
the data acquisition service module 202 is used for sending configuration information to a registration center for registration when the data acquisition service module is started for the first time;
the configuration platform configures the attribute information of the acquisition equipment for the acquisition equipment;
the middleware 203 establishes communication with the message queue module and the registration center, monitors newly added registration information in the registration center, and establishes communication with the corresponding data acquisition service module;
the middleware reads the configured equipment attribute information, determines an acquisition service module corresponding to acquisition equipment according to the configured equipment attribute information, and sends the equipment attribute information to the acquisition service module;
the middleware acquires data acquired by acquisition equipment under each data acquisition service module through each data acquisition service module and sends the data to the message queue module.
The device builds a configuration platform, a registration center, a middleware, a message queue module and data acquisition service modules corresponding to different data acquisition protocols, the data acquisition service modules send configuration information to the registration center for registration when being started for the first time, the configuration center configures acquisition equipment attribute information for acquisition equipment, the middleware establishes communication with the message queue module and the registration center, monitors newly added registration information in the registration center and establishes communication with the corresponding data acquisition service modules, the middleware reads the configured equipment attribute information, determines the data acquisition service modules corresponding to the acquisition equipment according to the configured equipment attribute information and sends the equipment attribute information to the data acquisition service modules, and the middleware acquires data acquired by the acquisition equipment under each data acquisition service module through each data acquisition service module and sends the data acquired to the message queue module. The operation and maintenance difficulty is reduced and the resource utilization efficiency is improved in an automatic monitoring and matching mode through the middleware.
Optionally, the determining, according to the configured device attribute information, a data collection service module corresponding to a collection device includes:
and matching the corresponding data acquisition service module according to the protocol type in the equipment attribute information.
Optionally, configuring, by the configuration center, attribute information of the acquisition device for the acquisition device includes:
and updating the attribute information of the acquisition equipment for the acquisition equipment through the configuration center.
Optionally, the acquiring the device attribute information includes: device address information and device protocol information.
Optionally, the method further comprises:
building a remote calling system adaptive to a plurality of development languages;
the middleware acquires the data acquired by the acquisition equipment under each data acquisition service module through each data acquisition service module, and the method comprises the following steps:
the middleware establishes communication with each data acquisition service module through the remote calling system and acquires data acquired by acquisition equipment under each data acquisition service module.
Optionally, configuring, by the configuration center, attribute information of the acquisition device for the acquisition device includes:
and pulling the equipment attribute information from the platform of the Internet of things, and automatically configuring.
Optionally, the sending the data to a message queue module includes:
and the middleware collects the data and sends the data to a message queue module.
Fig. 3 is a schematic structural diagram of a data acquisition apparatus provided in an embodiment of the present disclosure, where the apparatus includes a configuration platform 301, middleware 302, a registry 303, a message queue module 304, and a data acquisition service module 305.
b1 is that a user performs configuration operation, including updating data attribute information of configured data acquisition equipment, b2 is that the equipment attribute information is directly acquired from an internet of things platform for automatic configuration, b3 stores the configuration information to a registration center, a middleware monitors the change of the registration center, b4 issues the equipment attribute information of the acquisition equipment to a data acquisition service module, the data acquisition service module can send the data acquired by the acquisition equipment to the middleware, the data acquisition service module can convert the data into json format data and then send the json format data to the middleware, the middleware sends the json format data to a message queue module, and the message queue module can send messages to a real-time database or an I internet of things platform.
Based on the same inventive concept, the embodiment of the specification further provides the electronic equipment.
In the following, embodiments of the electronic device of the present invention are described, which may be regarded as specific physical implementations for the above-described embodiments of the method and apparatus of the present invention. Details described in the embodiments of the electronic device of the invention should be considered supplementary to the embodiments of the method or apparatus described above; for details which are not disclosed in embodiments of the electronic device of the invention, reference may be made to the above-described embodiments of the method or the apparatus.
Fig. 4 is a schematic structural diagram of an electronic device provided in an embodiment of the present specification. An electronic device 400 according to this embodiment of the invention is described below with reference to fig. 4. The electronic device 400 shown in fig. 4 is only an example and should not bring any limitation to the function and the scope of use of the embodiments of the present invention.
As shown in fig. 4, electronic device 400 is embodied in the form of a general purpose computing device. The components of electronic device 400 may include, but are not limited to: at least one processing unit 410, at least one memory unit 420, a bus 430 that connects the various system components (including the memory unit 420 and the processing unit 410), a display unit 440, and the like.
Wherein the storage unit stores program code executable by the processing unit 410 to cause the processing unit 410 to perform steps according to various exemplary embodiments of the present invention described in the above-mentioned processing method section of the present specification. For example, the processing unit 410 may perform the steps as shown in fig. 1.
The storage unit 420 may include readable media in the form of volatile storage units, such as a random access memory unit (RAM)4201 and/or a cache memory unit 4202, and may further include a read only memory unit (ROM) 4203.
The storage unit 420 may also include a program/utility 4204 having a set (at least one) of program modules 4205, such program modules 4205 including, but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment.
The electronic device 400 may also communicate with one or more external devices 500 (e.g., keyboard, pointing device, bluetooth device, etc.), with one or more devices that enable a user to interact with the electronic device 400, and/or with any devices (e.g., router, modem, etc.) that enable the electronic device 400 to communicate with one or more other computing devices. Such communication may occur via input/output (I/O) interfaces 450. Also, the electronic device 400 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the internet) via the network adapter 460. The network adapter 460 may communicate with other modules of the electronic device 400 via the bus 430. It should be appreciated that although not shown in FIG. 4, other hardware and/or software modules may be used in conjunction with electronic device 400, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAI D systems, tape drives, and data backup storage systems, etc.
Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments of the present invention described herein may be implemented by software, or by software in combination with necessary hardware. Therefore, the technical solution according to the embodiment of the present invention can be embodied in the form of a software product, which can be stored in a computer-readable storage medium (which can be a CD-ROM, a usb disk, a removable hard disk, etc.) or on a network, and includes several instructions to make a computing device (which can be a personal computer, a server, or a network device, etc.) execute the above-mentioned method according to the present invention. The computer program, when executed by a data processing apparatus, enables the computer readable medium to implement the above-described method of the invention, namely: such as the method shown in fig. 1.
Fig. 5 is a schematic diagram of a computer-readable medium provided in an embodiment of the present specification.
A computer program implementing the method shown in fig. 1 may be stored on one or more computer readable media. The computer readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The computer readable storage medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable storage medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).
In summary, the invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art will appreciate that some or all of the functionality of some or all of the components in embodiments in accordance with the invention may be implemented in practice using a general purpose data processing device such as a microprocessor or a Digital Signal Processor (DSP). The present invention may also be embodied as apparatus or device programs (e.g., computer programs and computer program products) for performing a portion or all of the methods described herein. Such programs implementing the present invention may be stored on computer-readable media or may be in the form of one or more signals. Such a signal may be downloaded from an internet website or provided on a carrier signal or in any other form.
While the foregoing embodiments have described the objects, aspects and advantages of the present invention in further detail, it should be understood that the present invention is not inherently related to any particular computer, virtual machine or electronic device, and various general-purpose machines may be used to implement the present invention. The invention is not to be considered as limited to the specific embodiments thereof, but is to be understood as being modified in all respects, all changes and equivalents that come within the spirit and scope of the invention.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments.
The above description is only an example of the present application and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims (16)
1. A method of data acquisition, comprising:
building a configuration platform, a registration center, middleware, a message queue module and data acquisition service modules corresponding to different data acquisition protocols;
the data acquisition service module sends configuration information to a registration center for registration when being started for the first time;
configuring attribute information of acquisition equipment for the acquisition equipment through a configuration center, establishing communication between the middleware and the message queue module as well as a registration center, monitoring newly added registration information in the registration center, and establishing communication with a corresponding data acquisition service module;
the middleware reads the configured equipment attribute information, matches an acquisition service module corresponding to acquisition equipment according to the configured equipment attribute information, and issues the equipment attribute information to the acquisition service module;
the middleware acquires data acquired by acquisition equipment under each data acquisition service module through each data acquisition service module and sends the data to the message queue module.
2. The method according to claim 1, wherein the matching, according to the configured device attribute information, the data collection service module corresponding to the collection device comprises:
and matching the corresponding data acquisition service module according to the protocol type in the equipment attribute information.
3. The method of claim 1, wherein configuring, by the configuration center, the collection device attribute information for the collection device comprises:
and updating the attribute information of the acquisition equipment for the acquisition equipment through the configuration center.
4. The method of claim 1, wherein the collecting device attribute information comprises: device address information and device protocol information.
5. The method of claim 1, further comprising:
building a remote calling system adaptive to a plurality of development languages;
the middleware acquires the data acquired by the acquisition equipment under each data acquisition service module through each data acquisition service module, and the method comprises the following steps:
the middleware establishes communication with each data acquisition service module through the remote calling system and acquires data acquired by acquisition equipment under each data acquisition service module.
6. The method of claim 1, wherein configuring, by the configuration center, the collection device attribute information for the collection device comprises:
and pulling the equipment attribute information from the platform of the Internet of things, and automatically configuring.
7. The method of claim 1, wherein sending the data to a message queue module comprises:
and the middleware collects the data and sends the data to a message queue module.
8. A data acquisition device, comprising:
the system comprises a system building module, a configuration platform, a registration center, a middleware, a message queue module and data acquisition service modules corresponding to different data acquisition protocols;
the data acquisition service module is used for sending configuration information to the registration center for registration when the data acquisition service module is started for the first time;
the configuration platform configures the attribute information of the acquisition equipment for the acquisition equipment;
the middleware establishes communication with the message queue module and the registration center, monitors newly added registration information in the registration center and establishes communication with the corresponding data acquisition service module;
the middleware reads the configured equipment attribute information, matches an acquisition service module corresponding to acquisition equipment according to the configured equipment attribute information, and issues the equipment attribute information to the acquisition service module;
the middleware acquires data acquired by acquisition equipment under each data acquisition service module through each data acquisition service module and sends the data to the message queue module.
9. The apparatus according to claim 8, wherein the matching, according to the configured device attribute information, the data collection service module corresponding to the collection device includes:
and matching the corresponding data acquisition service module according to the protocol type in the equipment attribute information.
10. The apparatus of claim 8, wherein the configuring, by the configuration center, the collecting device attribute information for the collecting device comprises:
and updating the attribute information of the acquisition equipment for the acquisition equipment through the configuration center.
11. The apparatus of claim 8, wherein the collecting device attribute information comprises: device address information and device protocol information.
12. The apparatus of claim 8, further comprising:
building a remote calling system adaptive to a plurality of development languages;
the middleware acquires the data acquired by the acquisition equipment under each data acquisition service module through each data acquisition service module, and the method comprises the following steps:
the middleware establishes communication with each data acquisition service module through the remote calling system and acquires data acquired by acquisition equipment under each data acquisition service module.
13. The apparatus of claim 8, wherein the configuring, by the configuration center, the collecting device attribute information for the collecting device comprises:
and pulling the equipment attribute information from the platform of the Internet of things, and automatically configuring.
14. The apparatus of claim 8, wherein sending the data to a message queue module comprises:
and the middleware collects the data and sends the data to a message queue module.
15. An electronic device, wherein the electronic device comprises:
a processor; and the number of the first and second groups,
a memory storing a computer executable program that, when executed, causes the processor to perform the method of any of claims 1-7.
16. A computer readable storage medium, wherein the computer readable storage medium stores one or more programs which, when executed by a processor, implement the method of any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111392362.6A CN114124695A (en) | 2021-11-23 | 2021-11-23 | Data acquisition method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111392362.6A CN114124695A (en) | 2021-11-23 | 2021-11-23 | Data acquisition method and device and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114124695A true CN114124695A (en) | 2022-03-01 |
Family
ID=80439993
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111392362.6A Pending CN114124695A (en) | 2021-11-23 | 2021-11-23 | Data acquisition method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114124695A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115314509A (en) * | 2022-07-27 | 2022-11-08 | 上海浦东发展银行股份有限公司 | Synchronization method, device, equipment and storage medium of application registration information |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103942063A (en) * | 2013-11-08 | 2014-07-23 | 国家电网公司 | Centralized configuration and remote deployment method for Java Web application |
| CN109327335A (en) * | 2018-10-07 | 2019-02-12 | 杭州安恒信息技术股份有限公司 | A kind of cloud monitoring solution system and method |
| CN111224817A (en) * | 2020-04-21 | 2020-06-02 | 重庆鲲量科技有限公司 | Distributed micro-acquisition system and method thereof |
| CN111416821A (en) * | 2020-03-20 | 2020-07-14 | 杭州物源科技有限公司 | Internet of things equipment information acquisition method, system and device |
| CN112737855A (en) * | 2020-12-30 | 2021-04-30 | 百视通网络电视技术发展有限责任公司 | Multi-dimensional terminal configuration system in OTT service |
| WO2021203968A1 (en) * | 2020-10-28 | 2021-10-14 | 平安科技（深圳）有限公司 | Method for unified management of micro-services of multiple registration centers, and apparatus, device and medium |
-
2021
- 2021-11-23 CN CN202111392362.6A patent/CN114124695A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103942063A (en) * | 2013-11-08 | 2014-07-23 | 国家电网公司 | Centralized configuration and remote deployment method for Java Web application |
| CN109327335A (en) * | 2018-10-07 | 2019-02-12 | 杭州安恒信息技术股份有限公司 | A kind of cloud monitoring solution system and method |
| CN111416821A (en) * | 2020-03-20 | 2020-07-14 | 杭州物源科技有限公司 | Internet of things equipment information acquisition method, system and device |
| CN111224817A (en) * | 2020-04-21 | 2020-06-02 | 重庆鲲量科技有限公司 | Distributed micro-acquisition system and method thereof |
| WO2021203968A1 (en) * | 2020-10-28 | 2021-10-14 | 平安科技（深圳）有限公司 | Method for unified management of micro-services of multiple registration centers, and apparatus, device and medium |
| CN112737855A (en) * | 2020-12-30 | 2021-04-30 | 百视通网络电视技术发展有限责任公司 | Multi-dimensional terminal configuration system in OTT service |
Non-Patent Citations (1)
| Title |
|---|
| 虞敏;张为民;HORST MEIER;: "分布式设备远程监控系统研究", 计算机工程与应用, no. 05, 11 February 2009 (2009-02-11) * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115314509A (en) * | 2022-07-27 | 2022-11-08 | 上海浦东发展银行股份有限公司 | Synchronization method, device, equipment and storage medium of application registration information |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107426023B (en) | Cloud platform log collection and forwarding method, system, equipment and storage medium | |
| CN110262902B (en) | Information processing method and system, medium, and computing device | |
| CN104885407A (en) | Network function virtualisation NFV fault management apparatus, device, and method | |
| CN112291224B (en) | Interaction method and device for real-time communication and electronic equipment | |
| CN111294235A (en) | Data processing method, device, gateway and readable storage medium | |
| CN114124695A (en) | Data acquisition method and device and electronic equipment | |
| KR20110065448A (en) | Composing message processing pipelines | |
| KR100567825B1 (en) | Apparatus and method for sharing services on network | |
| CN102904754A (en) | Method and system for managing server | |
| CN113138900B (en) | Data acquisition processing method and device and electronic equipment | |
| CN113434315A (en) | Interface management method and device, storage medium and electronic equipment | |
| CN113821352A (en) | Remote service calling method and device | |
| CN112448833B (en) | Multi-management-domain communication method and device | |
| CN106936937B (en) | Method and device for realizing universal interface for internet service interaction | |
| CN116155978A (en) | Multi-registry adaptation method, device, electronic equipment and storage medium | |
| CN115934076A (en) | Cross-platform client micro-service providing device and method and electronic equipment | |
| CN115022351A (en) | Storage method, device and system of battery swapping data and storage medium | |
| CN112954011A (en) | Image resource compression method and device and electronic equipment | |
| CN114218175A (en) | Resource cross-platform sharing method and device, terminal equipment and storage medium | |
| CN113568623A (en) | Application deployment method and device and electronic equipment | |
| CN113360558A (en) | Data processing method, data processing device, electronic device, and storage medium | |
| CN109388536B (en) | Data collection method and device | |
| CN103685404B (en) | Network service system and its method updating firmware | |
| CN108989586B (en) | IVR implementation method, system, equipment and storage medium | |
| US20240146800A1 (en) | Data plane reduction for eventing components |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |