CN107948092A - Real-time data acquisition method and real-time data acquisition system - Google Patents
Real-time data acquisition method and real-time data acquisition system Download PDFInfo
- Publication number
- CN107948092A CN107948092A CN201711175515.5A CN201711175515A CN107948092A CN 107948092 A CN107948092 A CN 107948092A CN 201711175515 A CN201711175515 A CN 201711175515A CN 107948092 A CN107948092 A CN 107948092A
- Authority
- CN
- China
- Prior art keywords
- data
- real
- gathered
- gathered data
- service
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/10—Flow control; Congestion control
- H04L47/24—Traffic characterised by specific attributes, e.g. priority or QoS
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
- G06F9/5038—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the execution order of a plurality of tasks, e.g. taking priority or time dependency constraints into consideration
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/50—Indexing scheme relating to G06F9/50
- G06F2209/5018—Thread allocation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/50—Indexing scheme relating to G06F9/50
- G06F2209/5021—Priority
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The present invention proposes a kind of real-time data acquisition method, real-time data acquisition system, computer equipment, computer-readable recording medium.Wherein, real-time data acquisition method includes：The configuration information that management server is sent is received, the address of data/address bus is obtained according to configuration information；Type of service according to belonging to the corresponding operation code of gathered data determines gathered data；Corresponding multiple tasks thread is created according to type of service；The gathered data of corresponding type of service is reported to data platform by control multiple tasks thread by data/address bus, so that data platform carries out operational decision making according to gathered data.The present invention is realized intelligently to be shunted by gathered data according to type of service, be ensure that data collection point different in operation system is independent of each other, be ensure that the real-time of data acquisition.
Description
Technical field
The present invention relates to service data acquisition technical field, in particular to a kind of real-time data acquisition method, in real time
Data collecting system, computer equipment, computer-readable recording medium.
Background technology
The application and the rapid growth of business to deepen continuously with big data in business, traditional " T+1 " pattern from
Line processing scheme is constantly exaggerated in the drawbacks of timeliness etc., and business constantly strengthens the demand of real time data processing.For
Meet real time data calculate promptness, first have to solve the problems, such as be exactly real time data collection.
Therefore, how solving to gather all data reported in application product, collection reports respectively by type, protects at the same time
Card data are comprehensive, transmission delay is low becomes urgent problem to be solved.
The content of the invention
It is contemplated that at least solve one of technical problem present in the prior art or correlation technique.
For this reason, the first aspect of the present invention is to propose a kind of real-time data acquisition method.
The second aspect of the invention is to propose a kind of real-time data acquisition system.
The third aspect of the invention is to propose a kind of computer equipment.
The fourth aspect of the invention is to propose a kind of computer-readable recording medium.
In view of this, according to an aspect of the present invention, it proposes a kind of real-time data acquisition method, including：Reception pipe
The configuration information that server is sent is managed, the address of data/address bus is obtained according to configuration information；According to the corresponding business of gathered data
Coding determines the type of service belonging to gathered data；Corresponding multiple tasks thread is created according to type of service；Control multiple
The gathered data of corresponding type of service is reported to data platform by business thread by data/address bus, so that data platform is according to collection
Data carry out operational decision making.
Real-time data acquisition method provided by the invention, receives the configuration information that management server is sent, from matching somebody with somebody for reception
The address of data/address bus is obtained in confidence breath, data can be so acquired by the data/address bus of the address reports biography
Defeated, in transmitting procedure is reported, specified services are encoded to distinguish the data packet of push, according to the operation code of real-time data collection
To determine the type of service belonging to gathered data, corresponding multiple and different mission thread is respectively created further according to type of service,
These threads control these mission threads to correspond to the gathered data of type of service by data/address bus in units of type of service
Data platform is reported to, carries out data processing to complete real time business decision-making, the present invention is carried out by gathered data according to data packet
Mark is shunted by type of service automatically, be ensure that data collection point different in operation system is independent of each other, be ensure that data are adopted
The real-time of collection.
Above-mentioned real-time data acquisition method according to the present invention, can also have following technical characteristic：
In the above-mentioned technical solutions, it is preferable that receive the configuration information that management server is sent, obtained according to configuration information
Before the address of data/address bus, further include：Log-on message is sent to management server, to obtain the visit for being used for asking configuration information
Ask key；Heartbeat message is sent to management server, so that management server sends configuration information after heartbeat message is received.
In the technical scheme, the configuration information of management server transmission is being received, it is total to obtain data according to configuration information
Before the address of line, first have to send log-on message to management server, management server is responsible for the registration letter of collector
Breath and configuration, while an access key (accessKey) for being used to ask configuration information is distributed for collector, and be every kind of industry
Business data creation data transmission channel；Collector, which receives, accesses key, and heartbeat message is sent to management service according to key is accessed
Device, management server are returning to the dynamic configuration information of collector in a manner of heartbeat response after receiving heartbeat message, such as
This, collector can be configured and be obtained the data bus address for being used for transmission data according to configuration information.
In any of the above-described technical solution, it is preferable that control multiple tasks thread will corresponding service class by data/address bus
The gathered data of type reports to data platform, so that data platform carries out operational decision making according to gathered data, specifically includes：Call
Application programming interface API is packaged gathered data；The number of current task thread is determined according to the handling capacity of gathered data
Amount；The priority of gathered data is determined according to the information of gathered data；Current task thread is controlled to gather number according to priority
According to reporting to data platform.
In the technical scheme, control multiple tasks thread by data/address bus by the gathered data of corresponding type of service
Report is to data platform, so that data platform carries out the process of operational decision making according to gathered data, user is provided and reports real-time number
According to application programming interface (API), by api interface call can gather the data reported, to operation system invade
Property is small.Api interface is called to be packaged gathered data first, it is true according to the handling capacity (packets/second) of every kind of gathered data stream
Determine the quantity of current task thread, the number of tasks of the concurrent thread of adjust automatically is realized to prevent from blocking, so as to meet that height is handled up
The demand of amount；The priority of gathered data is determined further according to the information of gathered data, and line is determined according to the priority of gathered data
Gathered data is reported to data platform, ensure that important by the priority of journey scheduling, control current task thread according to priority
High priority data be pushed, realize the relatively low delay of the data of push.
In any of the above-described technical solution, it is preferable that control current task thread reports gathered data according to priority
To data platform, further include：The uploaded state of monitoring gathered data in real time, determines whether to report into according to uploaded state
Work(；If not reporting success, by acquired data storage to embedded data storehouse；Transmission does not report successful information to management service
Device, so that management server re-calls instruction according to delivering pre-warning signal and according to pre-warning signal transmission；Receive again
Call instruction, the step of application programming interface API is packaged gathered data is called according to instruction is re-called.
In the technical scheme, control current task thread according to priority, by gathered data report to data platform it
Afterwards, whether the also uploaded state of monitoring gathered data in real time, determine to report and succeed according to uploaded state, when reporting failed
Wait, according to the data validity interval of configuration, the data of collection are stored to embedded data storehouse, ensure that gathered data will not lose；
It will not also report successful information to send to management server, management server to issue warning signal so that management server pair
The monitoring management of acquisition state and the early warning to abnormality, when selection resurveys the gathered data reported, receive management
Server re-calls instruction, re-calls api interface, carries out data encapsulation and data report, realize gathered data one
It is secondary to report failure, carry out the secondary loss for reporting, avoiding data.
In any of the above-described technical solution, it is preferable that gathered data includes：The real-time transaction data of each operation system and/
Or the daily record data of each operation system.
In the technical scheme, gathered data includes the real-time transaction data of each operation system, and real-time logs data,
By different gathered data types, different operational decision makings is carried out, all real time datas are all split pushing to big data
Platform, meets the needs of data are calculated and excavated in real time.
According to the second aspect of the invention, it is proposed that a kind of real-time data acquisition system, including：Acquiring unit, is used for
The configuration information that management server is sent is received, the address of data/address bus is obtained according to configuration information；First determination unit, is used for
Type of service according to belonging to the corresponding operation code of gathered data determines gathered data；Creating unit, for according to service class
Type creates corresponding multiple tasks thread；Control unit, for controlling multiple tasks thread will corresponding business by data/address bus
The gathered data of type reports to data platform, so that data platform carries out operational decision making according to gathered data.
Real-time data acquisition system provided by the invention, acquiring unit receive the configuration information that management server is sent, from
The address of data/address bus is obtained in the configuration information of reception, so data can be acquired by the data/address bus of the address
Transmission is reported, in transmitting procedure is reported, the first determination unit specified services are encoded to distinguish the data packet of push, according to real-time
The operation code of gathered data determines the type of service belonging to gathered data, and creating unit is respectively created further according to type of service
Corresponding multiple and different mission thread, for these threads in units of type of service, control unit controls these mission threads to lead to
Cross data/address bus and the gathered data of corresponding type of service is reported into data platform, carry out data processing and determined with completing real time business
Plan, the present invention is carried out to be shunted by type of service automatically by gathered data according to package identification, ensure that different in operation system
Data collection point be independent of each other, ensure that the real-time of data acquisition.
Above-mentioned real-time data acquisition system according to the present invention, can also have following technical characteristic：
In the above-mentioned technical solutions, it is preferable that cipher key unit, for sending log-on message to management server, to obtain
For asking the access key of configuration information；Information unit, for sending heartbeat message to management server, so that management service
Device sends configuration information after heartbeat message is received.
In the technical scheme, the configuration information of management server transmission is being received, it is total to obtain data according to configuration information
Before the address of line, cipher key unit will send log-on message to management server, management server and be responsible for collector first
Log-on message and configuration, while distribute one for collector and be used to ask the access key (accessKey) of configuration information, and
Data transmission channel is created for every kind of business datum；The information unit reception of collector accesses key, is sent according to key is accessed
Heartbeat message to management server, management server is returning to collector after receiving heartbeat message in a manner of heartbeat response
Dynamic configuration information, in this way, collector can be configured and be obtained the data for being used for transmission data according to configuration information
Bus address.
In any of the above-described technical solution, it is preferable that control unit specifically includes：Encapsulation unit, journey is applied for calling
Sequence programming interface API is packaged gathered data；Second determination unit, for being determined according to the handling capacity of gathered data as predecessor
The quantity of business thread；3rd determination unit, for determining the priority of gathered data according to the information of gathered data；Control is single
Member, for controlling current task thread that gathered data is reported to data platform according to priority.
In the technical scheme, control unit control multiple tasks thread will correspond to adopting for type of service by data/address bus
Collection data report to data platform, so that data platform carries out the process of operational decision making according to gathered data, in user's offer
The application programming interface (API) of real time data is reported, the data reported can be gathered by being called to api interface, to business
System is invasive small.Encapsulation unit calls api interface to be packaged gathered data first, and the second determination unit is according to every kind of collection
The handling capacity (packets/second) of data flow determines the quantity of current task thread, realizes the task of the concurrent thread of adjust automatically
Number is to prevent from blocking, so as to meet the needs of high-throughput；3rd determination unit determines collection number according to the information of gathered data
According to priority, control subelement determines the priority of thread scheduling according to the priority of gathered data, controls current task line
Gathered data is reported to data platform, ensure that important high priority data is pushed, realize push by journey according to priority
The relatively low delay of data.
In any of the above-described technical solution, it is preferable that detection unit, for monitoring the uploaded state of gathered data in real time,
Determined whether to report success according to uploaded state；Storage unit, if for not reporting success, by acquired data storage to embedded
Database；Transmitting element, does not report successful information to management server, so that management server is sent out according to information for sending
Go out pre-warning signal and sent according to pre-warning signal and re-call instruction；Encapsulation unit, is additionally operable to reception and re-calls instruction, according to
Re-call instruction and be called the step of application programming interface API is packaged gathered data.
In the technical scheme, control current task thread according to priority, by gathered data report to data platform it
Afterwards, whether detection unit also monitors the uploaded state of gathered data in real time, determine to report according to uploaded state and succeed, report not
When success, the data of collection are stored to embedded data storehouse according to the data validity interval of configuration, ensure that and adopt by storage unit
Collection data will not lose；Transmitting element will not also report successful information to send to send pre- to management server, management server
Alert signal so that monitoring management of the management server to acquisition state and the early warning to abnormality, resurvey in selection
During the gathered data of report, encapsulation unit reception management server re-calls instruction, re-calls api interface, carries out data
Encapsulation and data report, and realize gathered data and once report failure, carry out the secondary loss for reporting, avoiding data.
In any of the above-described technical solution, it is preferable that gathered data includes：The real-time transaction data of each operation system and/
Or the daily record data of each operation system.
In the technical scheme, gathered data includes the real-time transaction data of each operation system, and real-time logs data,
By different gathered data types, different operational decision makings is carried out, all real time datas are all split pushing to big data
Platform, meets the needs of data are calculated and excavated in real time.
According to the third aspect of the present invention, the present invention provides a kind of computer equipment, including memory, processor and
The computer program that can be run on a memory and on a processor is stored, processor realizes following step when performing computer program
Suddenly：The configuration information that management server is sent is received, the address of data/address bus is obtained according to configuration information；According to gathered data pair
The operation code answered determines the type of service belonging to gathered data；Corresponding multiple tasks thread is created according to type of service；Control
The gathered data of corresponding type of service is reported to data platform by multiple tasks thread processed by data/address bus, so that data platform
Operational decision making is carried out according to gathered data.
A kind of computer equipment provided by the invention, processor are realized when performing computer program：Receive management server
The configuration information of transmission, the address of data/address bus is obtained from the configuration information of reception, can so pass through the data of the address
What bus was acquired data reports transmission, and in transmitting procedure is reported, specified services codings distinguishes the data packet of push, root
The type of service belonging to gathered data is determined according to the operation code of real-time data collection, is respectively created pair according to type of service
The multiple and different mission threads answered, these threads control these mission threads to pass through data/address bus in units of type of service
The gathered data of corresponding type of service is reported into data platform, carries out data processing to complete real time business decision-making, the present invention
Carry out and shunted automatically by type of service according to package identification by gathered data, ensure that data acquisition different in operation system
Point is independent of each other, and ensure that the real-time of data acquisition.
According to the fourth aspect of the present invention, the present invention provides a kind of computer-readable recording medium, it is stored thereon with
Computer program, realizes following steps when computer program is executed by processor：The configuration information that management server is sent is received,
The address of data/address bus is obtained according to configuration information；Industry according to belonging to the corresponding operation code of gathered data determines gathered data
Service type；Corresponding multiple tasks thread is created according to type of service；Control multiple tasks thread will be corresponding by data/address bus
The gathered data of type of service reports to data platform, so that data platform carries out operational decision making according to gathered data.
A kind of computer-readable recording medium provided by the invention, is stored thereon with computer program, computer program quilt
Processor is realized when performing：The configuration information that management server is sent is received, data/address bus is obtained from the configuration information of reception
Address, data can be so acquired by the data/address bus of the address reports transmission, in transmitting procedure is reported, refer to
Determine operation code to distinguish the data packet of push, gathered data is determined according to the operation code of real-time data collection belonging to industry
Service type, is being respectively created corresponding multiple and different mission thread, these threads are using type of service to be single according to type of service
Position, controls these mission threads that the gathered data of corresponding type of service is reported to data platform by data/address bus, into line number
According to processing to complete real time business decision-making, the present invention is carried out by gathered data according to package identification automatically by type of service point
Stream, ensure that data collection point different in operation system is independent of each other, ensure that the real-time of data acquisition.
The additional aspect and advantage of the present invention will become obvious in following description section, or the practice by the present invention
Recognize.
Brief description of the drawings
The above-mentioned and/or additional aspect and advantage of the present invention will become in the description from combination accompanying drawings below to embodiment
Substantially and it is readily appreciated that, wherein：
Fig. 1 shows the flow diagram of the real-time data acquisition method of one embodiment of the present of invention；
Fig. 2 shows the flow diagram of the real-time data acquisition method of an alternative embodiment of the invention；
Fig. 3 shows the schematic block diagram of the real-time data acquisition system of one embodiment of the present of invention；
Fig. 4 shows the schematic block diagram of the real-time data acquisition system of an alternative embodiment of the invention；
Fig. 5 shows the configuration diagram of the real-time data acquisition system of the specific embodiment of the present invention；
Fig. 6 shows the principle schematic of the real-time data acquisition method of the specific embodiment of the present invention；
Fig. 7 shows the schematic block diagram of the computer equipment of one embodiment of the present of invention.
Embodiment
It is below in conjunction with the accompanying drawings and specific real in order to be more clearly understood that aforementioned aspect of the present invention, feature and advantage
Mode is applied the present invention is further described in detail.It should be noted that in the case where there is no conflict, the implementation of the application
Feature in example and embodiment can be mutually combined.
Many details are elaborated in the following description to facilitate a thorough understanding of the present invention, still, the present invention may be used also
To be implemented using other different from other modes described here, therefore, protection scope of the present invention is not limited to following public affairs
The limitation for the specific embodiment opened.
The embodiment of first aspect present invention, proposes a kind of real-time data acquisition method, and Fig. 1 shows one of the present invention
The flow diagram of the real-time data acquisition method of embodiment：
Step 102, the configuration information that management server is sent is received, the address of data/address bus is obtained according to configuration information；
Step 104, the type of service according to belonging to the corresponding operation code of gathered data determines gathered data；
Step 106, corresponding multiple tasks thread is created according to type of service；
Step 108, control multiple tasks thread that the gathered data of corresponding type of service is reported to number by data/address bus
According to platform, so that data platform carries out operational decision making according to gathered data.
The real-time data acquisition method that the embodiment provides, receives the configuration information that management server is sent, from reception
The address of data/address bus is obtained in configuration information, data can be so acquired by the data/address bus of the address reports biography
Defeated, in transmitting procedure is reported, specified services are encoded to distinguish the data packet of push, according to the operation code of real-time data collection
To determine the type of service belonging to gathered data, corresponding multiple and different mission thread is respectively created further according to type of service,
These threads control these mission threads to correspond to the gathered data of type of service by data/address bus in units of type of service
Data platform is reported to, carries out data processing to complete real time business decision-making, the present invention is carried out by gathered data according to data packet
Mark is shunted by type of service automatically, be ensure that data collection point different in operation system is independent of each other, be ensure that data are adopted
The real-time of collection.
Fig. 2 shows the flow diagram of the real-time data acquisition method of an alternative embodiment of the invention.Wherein, the party
Method includes：
Step 202, log-on message is sent to management server, to obtain the access key for being used for asking configuration information；
Step 204, heartbeat message is sent to management server, so that management server is sent after heartbeat message is received
Configuration information；
Step 206, the configuration information that management server is sent is received, the address of data/address bus is obtained according to configuration information；
Step 208, the type of service according to belonging to the corresponding operation code of gathered data determines gathered data；
Step 210, corresponding multiple tasks thread is created according to type of service；
Step 212, application programming interface API is called to be packaged gathered data；
Step 214, the quantity of current task thread is determined according to the handling capacity of gathered data；
Step 216, the priority of gathered data is determined according to the information of gathered data；
Step 218, control current task thread that gathered data is reported to data platform according to priority；
Step 220, the uploaded state of gathered data is monitored in real time, is determined whether to report success according to uploaded state, is, then
Terminate, it is no, then enter step 222；
Step 222, by acquired data storage to embedded data storehouse；
Step 224, send and do not report successful information to management server, so that management server is pre- according to delivering
Warn signal and sent according to pre-warning signal and re-call instruction；
Step 226, receive and re-call instruction, execution re-calls instruction, enters step 212.
The real-time data acquisition method that the embodiment provides, available for the real-time transaction data for gathering each operation system, with
And real-time logs data, by data/address bus and stream process platform, complete real-time operational decision making.Send log-on message extremely first
Management server, management server is responsible for log-on message and the configuration of collector, while distributes one for collector and be used for
The access key (accessKey) of configuration information is asked, and data transmission channel is created for every kind of business datum；Collector receives
Key is accessed, sends heartbeat message to management server according to key is accessed, management server is after heartbeat message is received
The dynamic configuration information of collector is returned in a manner of heartbeat response, in this way, collector can be matched somebody with somebody according to configuration information
Put and obtain the data bus address for being used for transmission data.
In this embodiment, the configuration information that management server is sent is received, data are obtained from the configuration information of reception
The address of bus, data can be so acquired by the data/address bus of the address reports transmission, reports transmitting procedure
In, specified services are encoded to distinguish the data packet of push, and gathered data institute is determined according to the operation code of real-time data collection
The type of service of category, is respectively created corresponding multiple and different mission thread, these threads are with service class further according to type of service
Type is unit, controls these mission threads that the gathered data of corresponding type of service is reported to data platform by data/address bus,
Data processing is carried out to complete real time business decision-making, is carried out by gathered data according to package identification automatically by type of service point
Stream, ensure that data collection point different in operation system is independent of each other, ensure that the real-time of data acquisition.
In this embodiment, multiple tasks thread is controlled to report the gathered data of corresponding type of service by data/address bus
To data platform, so that data platform carries out the process of operational decision making according to gathered data, user is provided and reports real time data
Application programming interface (API), by api interface call can gather the data reported, it is invasive to operation system
It is small.Call api interface to be packaged gathered data first, determined according to the handling capacity (packets/second) of every kind of gathered data stream
The quantity of current task thread, realizes the number of tasks of the concurrent thread of adjust automatically to prevent from blocking, so as to meet high-throughput
Demand；The priority of gathered data is determined further according to the information of gathered data, and thread is determined according to the priority of gathered data
Gathered data is reported to data platform, ensure that important by the priority of scheduling, control current task thread according to priority
High priority data is pushed, and realizes the relatively low delay of the data of push.
In this embodiment, current task thread is controlled according to priority, after gathered data is reported to data platform,
Whether the also uploaded state of monitoring gathered data in real time, determine to report and succeed according to uploaded state, when reporting failed,
According to the data validity interval of configuration, the data of collection are stored to embedded data storehouse, ensure that gathered data will not lose；To also
Do not report successful information to send to management server, management server to issue warning signal so that management server is to collection
The monitoring management of state and the early warning to abnormality, when selection resurveys the gathered data reported, receive management service
Device re-calls instruction, re-calls api interface, carries out data encapsulation and data report, realize gathered data once on
Report lost property to the authorities and lose, carry out the secondary loss for reporting, avoiding data.
The embodiment of second aspect of the present invention, proposes a kind of real-time data acquisition system 300, and Fig. 3 shows the present invention's
The schematic block diagram of the real-time data acquisition system 300 of one embodiment.As shown in figure 3, real-time data acquisition system 300 includes：
Acquiring unit 10, the first determination unit 12, creating unit 14, control unit 16.Wherein, acquiring unit 10, manage for receiving
The configuration information that server is sent, the address of data/address bus is obtained according to configuration information；First determination unit 12, is adopted for basis
The corresponding operation code of collection data determines the type of service belonging to gathered data；Creating unit 14, for being created according to type of service
Build corresponding multiple tasks thread；Control unit 16, for controlling multiple tasks thread will corresponding service class by data/address bus
The gathered data of type reports to data platform, so that data platform carries out operational decision making according to gathered data.
The real-time data acquisition system 300 that the embodiment provides, acquiring unit 10 receive the configuration that management server is sent
Information, the address of data/address bus is obtained from the configuration information of reception, can so be adopted by the data/address bus of the address
Collection data report transmission, and in transmitting procedure is reported, 12 specified services of the first determination unit are encoded to distinguish the data of push
Bag, gathered data is determined according to the operation code of real-time data collection belonging to type of service, creating unit 14 is further according to industry
Corresponding multiple and different mission thread is respectively created in service type, these threads in units of type of service, control by control unit 16
Make these mission threads and the gathered data of corresponding type of service is reported to by data platform by data/address bus, carry out data processing
To complete real time business decision-making, the present invention is carried out to be shunted by type of service automatically by gathered data according to package identification, is ensured
Different data collection points is independent of each other in operation system, ensure that the real-time of data acquisition.
Fig. 4 shows the schematic block diagram of the real-time data acquisition system 400 of an alternative embodiment of the invention.Wherein, it is real
When data collecting system 400 include：Acquiring unit 20, the first determination unit 22, creating unit 24, control unit 26, key list
Member 28, information unit 30, detection unit 32, storage unit 34, transmitting element 36.Wherein, control unit 26 specifically includes：Encapsulation
Unit 262, the second determination unit 264, the 3rd determination unit 266, control subelement 268.
The real-time data acquisition system 400 that the embodiment provides, available for the real-time transaction data for gathering each operation system,
And real-time logs data, by data/address bus and stream process platform, complete real-time operational decision making.Cipher key unit 28 will first
Log-on message is sent to management server, management server is responsible for log-on message and the configuration of collector, while is collection
Device distributes an access key (accessKey) for being used to ask configuration information, and creates data transfer for every kind of business datum
Passage；The information unit 30 of collector, which receives, accesses key, and heartbeat message is sent to management server, management according to key is accessed
Server is returning to the dynamic configuration information of collector in a manner of heartbeat response after receiving heartbeat message, in this way, collection
Device can be configured and be obtained the data bus address for being used for transmission data according to configuration information.
In this embodiment, acquiring unit 20 receives the configuration information that management server is sent, from the configuration information of reception
The middle address for obtaining data/address bus, data can be so acquired by the data/address bus of the address reports transmission, upper
Report in transmitting procedure, 22 specified services of the first determination unit are encoded to distinguish the data packet of push, according to real-time data collection
Operation code determines the type of service belonging to gathered data, and creating unit 24 is respectively created corresponding more further according to type of service
A different mission thread, for these threads in units of type of service, control unit 26 controls these mission threads to pass through data
The gathered data of corresponding type of service is reported to data platform by bus, carries out data processing to complete real time business decision-making, this
Invention is carried out to be shunted by type of service automatically by gathered data according to package identification, ensure that data different in operation system
Collection point is independent of each other, and ensure that the real-time of data acquisition.
In this embodiment, control unit 26 controls multiple tasks thread to correspond to adopting for type of service by data/address bus
Collection data report to data platform, so that data platform carries out the process of operational decision making according to gathered data, in user's offer
The application programming interface (API) of real time data is reported, the data reported can be gathered by being called to api interface, to business
System is invasive small.Encapsulation unit 262 calls api interface to be packaged gathered data first, and the second determination unit 264 is according to every
The handling capacity (packets/second) of kind gathered data stream determines the quantity of current task thread, realizes the concurrent thread of adjust automatically
Number of tasks to prevent from blocking, so as to meet the needs of high-throughput；3rd determination unit 266 is true according to the information of gathered data
Determine the priority of gathered data, control subelement 268 determines the priority of thread scheduling, control according to the priority of gathered data
Gathered data is reported to data platform, ensure that important high priority data is pushed, in fact by current task thread according to priority
The relatively low delay of the data of push is showed.
In this embodiment, detection unit 32 also monitors the uploaded state of gathered data in real time, is determined according to uploaded state
Report and whether succeed, when reporting failed, storage unit 34 deposits the data of collection according to the data validity interval of configuration
Storage ensure that gathered data will not lose to embedded data storehouse；Transmitting element 36 will not also report successful information to send to pipe
Server is managed, management server issues warning signal so that monitoring management of the management server to acquisition state and to abnormal shape
The early warning of state, when selection resurveys the gathered data reported, the reception management server of encapsulation unit 262 re-calls finger
Order, re-calls api interface, carries out data encapsulation and data report, and realizes gathered data and once reports failure, carries out secondary
Report, avoid the loss of data.
Illustrate the real-time data acquisition system 500 of a specific embodiment of the present invention and its right with reference to Fig. 5 and Fig. 6
The real-time data acquisition method answered.
The configuration diagram of real-time data acquisition system 500 as shown in Figure 5, real-time data acquisition system 500 include collection
Device 50 and monitoring management service 60.Collector (Agent) includes the first collector 502 (Agent1), the second collector 504
(Agent2), the 3rd collector 506 (Agent3).Monitoring management service 60 includes acquisition state monitoring modular 602, warning module
604th, Agent registration managements module 606, service configuration management module 608.Real-time data acquisition system 500 can be used for collection each
The real-time transaction data and daily record data of operation system, by data/address bus and stream process platform, complete real-time operational decision making.
Whole system mainly includes the first collector 502 (Agent1), the second collector 504 (Agent2), the 3rd collector 506
(Agent3) and monitoring management services 60 (Serve) two, the first collector 502 (Agent1), the second collector 504
(Agent2), the 3rd collector 506 (Agent3) reports its state periodically through heartbeat to monitoring management service 60, supervises at the same time
Control management service 60 returned in a manner of heartbeat response the first collector 502 (Agent1), the second collector 504 (Agent2),
The dynamic configuration information of 3rd collector 506 (Agent3).First collector 502 (Agent1), the second collector 504
(Agent2), the 3rd collector 506 (Agent3) can enable multithreading task by data by business according to configuration information is received
Type real time propelling movement is on the corresponding Topic of Kafka clusters.The real-time data acquisition system 500 of the specific embodiment is corresponding
Data acquisition flow is called by interface and is as shown in fig. 6, real-time data acquisition system 500 is invasive to operation system small
Reported data can be gathered.
In this specific embodiment, the first collector 502 (Agent1), the second collector 504 (Agent2), the 3rd collection
Device 506 (Agent3) includes Embedded database, according to the data validity interval of configuration, in local retained data copy.Such as Fig. 6
Shown, the first collector 502 (Agent1), the second collector 504 (Agent2), the 3rd collector 506 (Agent3) send number
Fail according to if there is push, then data can be preserved in embedded data storehouse, while update the first collector of monitoring client 502
(Agent1), the second collector 504 (Agent2), the 3rd collector 506 (Agent3) state, monitoring management service 60 are pre- in time
It is alert, so realize the reliability of gathered data.
In this specific embodiment, when collection reports real time data, specified services are encoded to distinguish the data packet institute of push
The type of service of category.First collector 502 (Agent1), the second collector 504 (Agent2), the 3rd collector 506
(Agent3) different threads task can be respectively created according to type of service coding, these threads are in units of type of service by data
Data/address bus is pushed to, while the priority of thread scheduling ensure that important high priority data is pushed, in this way, realizing collection
The intelligence shunting of data, ensure that collection point different in operation system is independent of each other, while ensure that important data have
Higher priority, meets the low latency requirements of data-pushing.
In this specific embodiment, the first collector 502 (Agent1), the second collector 504 (Agent2), the 3rd collection
Device 506 (Agent3) pushes data into distributed data/address bus, during push the first collector 502 (Agent1),
Second collector 504 (Agent2), the 3rd collector 506 (Agent3) can be according to every kind of data flow handling capacities (packets/second)
The concurrent thread number of tasks of adjust automatically prevents from blocking, so as to meet the needs of high-throughput, realizes the high concurrent of collection.
In this specific embodiment, monitoring management service 60 is mainly responsible for the first collector 502 (Agent1) of management, second
Collector 504 (Agent2), the 3rd collector 506 (Agent3) log-on message, the first collector 502 (Agent1) of monitoring, the
Two collectors 504 (Agent2), the 3rd collector 506 (Agent3) state, abnormal conditions early warning, Statistical Analysis Report.Such as Fig. 6
Shown, the first collector 502 (Agent1), the second collector 504 (Agent2), the 3rd collector 506 (Agent3) are registered
An accessKey can be distributed after work(to be used to identify heartbeat message, while can be the first collector 502 in registration process
(Agent1), the second collector 504 (Agent2), 506 (Agent3) configuration data bus address of the 3rd collector, and to need
Every kind of business datum of collection creates data transmission channel.
The embodiment of third aspect present invention, proposes a kind of computer equipment, and Fig. 7 shows one embodiment of the present of invention
Computer equipment 700 schematic block diagram.Wherein, which includes：
Memory 702, processor 704 and it is stored in the computer journey that can be run on memory 702 and on processor 704
Sequence, processor 704 realize following steps when performing computer program：Receive management server send configuration information, according to
Put the address of acquisition of information data/address bus；Service class according to belonging to the corresponding operation code of gathered data determines gathered data
Type；Corresponding multiple tasks thread is created according to type of service；Control multiple tasks thread will corresponding business by data/address bus
The gathered data of type reports to data platform, so that data platform carries out operational decision making according to gathered data.
A kind of computer equipment 700 provided by the invention, processor 704 are realized when performing computer program：Receive management
The configuration information that server is sent, the address of data/address bus is obtained from the configuration information of reception, can so pass through the address
Data/address bus be acquired data report transmission, in transmitting procedure is reported, specified services codings distinguishes the number of push
According to bag, gathered data is determined according to the operation code of real-time data collection belonging to type of service, further according to type of service point
Corresponding multiple and different mission thread is not created, these threads control these mission threads to pass through in units of type of service
The gathered data of corresponding type of service is reported to data platform by data/address bus, is carried out data processing and is determined with completing real time business
Plan, the present invention is carried out to be shunted by type of service automatically by gathered data according to package identification, ensure that different in operation system
Data collection point be independent of each other, ensure that the real-time of data acquisition.
The embodiment of fourth aspect present invention, there is provided a kind of computer-readable recording medium, is stored thereon with computer
Program, realizes following steps when computer program is executed by processor：Receive management server send configuration information, according to
Put the address of acquisition of information data/address bus；Service class according to belonging to the corresponding operation code of gathered data determines gathered data
Type；Corresponding multiple tasks thread is created according to type of service；Control multiple tasks thread will corresponding business by data/address bus
The gathered data of type reports to data platform, so that data platform carries out operational decision making according to gathered data.
A kind of computer-readable recording medium provided by the invention, is stored thereon with computer program, computer program quilt
Processor is realized when performing：The configuration information that management server is sent is received, data/address bus is obtained from the configuration information of reception
Address, data can be so acquired by the data/address bus of the address reports transmission, in transmitting procedure is reported, refer to
Determine operation code to distinguish the data packet of push, gathered data is determined according to the operation code of real-time data collection belonging to industry
Service type, is respectively created corresponding multiple and different mission thread, these threads are using type of service to be single further according to type of service
Position, controls these mission threads that the gathered data of corresponding type of service is reported to data platform by data/address bus, into line number
According to processing to complete real time business decision-making, the present invention is carried out by gathered data according to package identification automatically by type of service point
Stream, ensure that data collection point different in operation system is independent of each other, ensure that the real-time of data acquisition.
In the description of this specification, the description of term " one embodiment ", " some embodiments ", " specific embodiment " etc.
Mean to combine at least one reality that the particular features, structures, materials, or characteristics that the embodiment or example describe are contained in the present invention
Apply in example or example.In the present specification, schematic expression of the above terms is not necessarily referring to identical embodiment or reality
Example.Moreover, description particular features, structures, materials, or characteristics can in any one or more embodiments or example with
Suitable mode combines.
The foregoing is only a preferred embodiment of the present invention, is not intended to limit the invention, for the skill of this area
For art personnel, the invention may be variously modified and varied.Within the spirit and principles of the invention, that is made any repaiies
Change, equivalent substitution, improvement etc., should all be included in the protection scope of the present invention.
Claims (12)
- A kind of 1. real-time data acquisition method, it is characterised in that including：The configuration information that management server is sent is received, the address of data/address bus is obtained according to the configuration information；Type of service according to belonging to the corresponding operation code of gathered data determines gathered data；Corresponding multiple tasks thread is created according to the type of service；Control the multiple mission thread that the gathered data of corresponding type of service is reported to data by the data/address bus to put down Platform, so that the data platform carries out operational decision making according to the gathered data.
- 2. real-time data acquisition method according to claim 1, it is characterised in that receive the configuration that management server is sent Information, before the address of configuration information acquisition data/address bus, further includes：Log-on message is sent to the management server, to obtain the access key for being used for asking the configuration information；Heartbeat message is sent to the management server, so that the management server is sent after the heartbeat message is received The configuration information.
- 3. real-time data acquisition method according to claim 1, it is characterised in that control the multiple mission thread to pass through The gathered data of corresponding type of service is reported to data platform by the data/address bus, so that the data platform is adopted according to Collect data and carry out operational decision making, specifically include：Application programming interface API is called to be packaged the gathered data；The quantity of current task thread is determined according to the handling capacity of the gathered data；The priority of the gathered data is determined according to the information of the gathered data；Control the current task thread that the gathered data is reported to the data platform according to the priority.
- 4. real-time data acquisition method according to claim 3, it is characterised in that control the current task thread according to The priority, after the gathered data is reported to the data platform, further includes：The uploaded state of the gathered data is monitored in real time, determines whether to report success according to the uploaded state；If not reporting success, by the acquired data storage to embedded data storehouse；Transmission does not report successful information to the management server so that the management server sent according to described information it is pre- Warn signal and sent according to the pre-warning signal and re-call instruction；Instruction is re-called described in reception, according to it is described re-call instruction be called application programming interface API carry out The step of encapsulating the gathered data.
- 5. real-time data acquisition method according to any one of claim 1 to 4, it is characterised in thatThe gathered data includes：The daily record data of the real-time transaction data of each operation system and/or each operation system.
- A kind of 6. real-time data acquisition system, it is characterised in that including：Acquiring unit, for receiving the configuration information of management server transmission, data/address bus is obtained according to the configuration information Address；First determination unit, for the type of service belonging to determining gathered data according to the corresponding operation code of gathered data；Creating unit, for creating corresponding multiple tasks thread according to the type of service；Control unit, for control the multiple mission thread by the data/address bus will corresponding type of service gathered data Data platform is reported to, so that the data platform carries out operational decision making according to the gathered data.
- 7. real-time data acquisition system according to claim 6, it is characterised in that further include：Cipher key unit, for sending log-on message to the management server, to obtain the visit for being used for asking the configuration information Ask key；Information unit, for sending heartbeat message to the management server so that the management server receive it is described The configuration information is sent after heartbeat message.
- 8. real-time data acquisition system according to claim 6, it is characterised in that described control unit specifically includes：Encapsulation unit, for calling application programming interface API to be packaged the gathered data；Second determination unit, for determining the quantity of current task thread according to the handling capacity of the gathered data；3rd determination unit, for determining the priority of the gathered data according to the information of the gathered data；Subelement is controlled, for controlling the current task thread that the gathered data is reported to institute according to the priority State data platform.
- 9. real-time data acquisition system according to claim 8, it is characterised in that further include：Detection unit, for monitoring the uploaded state of the gathered data in real time, determines whether to report according to the uploaded state Success；Storage unit, if for not reporting success, by the acquired data storage to embedded data storehouse；Transmitting element, successful information is not reported to the management server for sending so that the management server according to Described information, which is issued warning signal and sent according to the pre-warning signal, re-calls instruction；The encapsulation unit, be additionally operable to receive described in re-call instruction, re-call instruction according to described and be called application The step of Program Interfaces API is packaged the gathered data.
- 10. the real-time data acquisition system according to any one of claim 6 to 9, it is characterised in thatThe gathered data includes：The daily record data of the real-time transaction data of each operation system and/or each operation system.
- 11. a kind of computer equipment, including memory, processor and it is stored on the memory and can be on the processor The computer program of operation, it is characterised in that the processor realizes such as claim 1 to 5 when performing the computer program Any one of real-time data acquisition method the step of.
- 12. a kind of computer-readable recording medium, is stored thereon with computer program, it is characterised in that the computer program Realized when being executed by processor as any one of claim 1 to 5 the step of real-time data acquisition method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711175515.5A CN107948092A (en) | 2017-11-22 | 2017-11-22 | Real-time data acquisition method and real-time data acquisition system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711175515.5A CN107948092A (en) | 2017-11-22 | 2017-11-22 | Real-time data acquisition method and real-time data acquisition system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107948092A true CN107948092A (en) | 2018-04-20 |
Family
ID=61930803
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711175515.5A Pending CN107948092A (en) | 2017-11-22 | 2017-11-22 | Real-time data acquisition method and real-time data acquisition system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107948092A (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109617941A (en) * | 2018-10-22 | 2019-04-12 | 中国平安财产保险股份有限公司 | Data push method, device, computer equipment and computer readable storage medium |
| CN109710400A (en) * | 2018-12-17 | 2019-05-03 | 平安普惠企业管理有限公司 | The method and device of thread resources grouping |
| CN109766253A (en) * | 2018-12-15 | 2019-05-17 | 平安证券股份有限公司 | A kind of performance data sending method, device, computer equipment and storage medium |
| CN110457312A (en) * | 2019-07-05 | 2019-11-15 | 中国平安财产保险股份有限公司 | Acquisition method, device, equipment and the readable storage medium storing program for executing of diversiform data |
| CN111813021A (en) * | 2020-07-15 | 2020-10-23 | 深圳市天磁科技有限公司 | RS485 address multiplexing multi-slave computer data acquisition system |
| CN112565023A (en) * | 2020-12-28 | 2021-03-26 | 广州西麦科技股份有限公司 | Traffic visualization system and method based on Telemetry traffic acquisition technology |
| CN113873037A (en) * | 2021-09-29 | 2021-12-31 | 四川长虹网络科技有限责任公司 | Data pushing method and device, computer equipment and storage medium |
| CN114615137A (en) * | 2022-03-25 | 2022-06-10 | 浙江捷创方舟数字技术有限公司 | 5G data transmission method and device |
| CN115643218A (en) * | 2022-09-28 | 2023-01-24 | 惠州市华达通气体制造股份有限公司 | Industrial production data transmission method and device and server |
| CN116560949A (en) * | 2023-07-10 | 2023-08-08 | 南瑞轨道交通技术有限公司 | Method, system, equipment and storage medium for realizing data acquisition and reception |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101091164A (en) * | 2004-05-20 | 2007-12-19 | Bea系统公司 | System and method for application server with self-tuned threading model |
| CN101403980A (en) * | 2008-11-12 | 2009-04-08 | 西安交通大学 | Multithreading processing method for electronic product code |
| CN102752158A (en) * | 2011-04-20 | 2012-10-24 | 中兴通讯股份有限公司 | Business flow monitoring method and device |
| CN202885100U (en) * | 2012-06-20 | 2013-04-17 | 天津泰铭热力装备股份有限公司 | Remote, centralized and intelligent control management system for heating supplying and hot water assemblies |
| CN105187233A (en) * | 2015-08-05 | 2015-12-23 | 广东长天思源环保科技股份有限公司 | System for reporting terminal data of IOT (Internet of Things) and working method thereof |
| US20160078576A1 (en) * | 2014-09-17 | 2016-03-17 | Fortress Systems International, Inc. | Cloud-based vehicle monitoring systems and methods |
| CN106530667A (en) * | 2016-11-09 | 2017-03-22 | 深圳云联讯数据科技有限公司 | Automatic address allocation serial port ammeter acquiring method and smart ammeter acquiring system |
| CN106714123A (en) * | 2016-12-08 | 2017-05-24 | 深圳市金立通信设备有限公司 | Message transmission method and communication device |
| CN107071006A (en) * | 2017-03-27 | 2017-08-18 | 广州数字方舟信息技术股份有限公司 | A kind of acquisition system and acquisition method towards navigation channel big data |
-
2017
- 2017-11-22 CN CN201711175515.5A patent/CN107948092A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101091164A (en) * | 2004-05-20 | 2007-12-19 | Bea系统公司 | System and method for application server with self-tuned threading model |
| CN101403980A (en) * | 2008-11-12 | 2009-04-08 | 西安交通大学 | Multithreading processing method for electronic product code |
| CN102752158A (en) * | 2011-04-20 | 2012-10-24 | 中兴通讯股份有限公司 | Business flow monitoring method and device |
| CN202885100U (en) * | 2012-06-20 | 2013-04-17 | 天津泰铭热力装备股份有限公司 | Remote, centralized and intelligent control management system for heating supplying and hot water assemblies |
| US20160078576A1 (en) * | 2014-09-17 | 2016-03-17 | Fortress Systems International, Inc. | Cloud-based vehicle monitoring systems and methods |
| CN105187233A (en) * | 2015-08-05 | 2015-12-23 | 广东长天思源环保科技股份有限公司 | System for reporting terminal data of IOT (Internet of Things) and working method thereof |
| CN106530667A (en) * | 2016-11-09 | 2017-03-22 | 深圳云联讯数据科技有限公司 | Automatic address allocation serial port ammeter acquiring method and smart ammeter acquiring system |
| CN106714123A (en) * | 2016-12-08 | 2017-05-24 | 深圳市金立通信设备有限公司 | Message transmission method and communication device |
| CN107071006A (en) * | 2017-03-27 | 2017-08-18 | 广州数字方舟信息技术股份有限公司 | A kind of acquisition system and acquisition method towards navigation channel big data |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109617941A (en) * | 2018-10-22 | 2019-04-12 | 中国平安财产保险股份有限公司 | Data push method, device, computer equipment and computer readable storage medium |
| CN109766253A (en) * | 2018-12-15 | 2019-05-17 | 平安证券股份有限公司 | A kind of performance data sending method, device, computer equipment and storage medium |
| CN109710400A (en) * | 2018-12-17 | 2019-05-03 | 平安普惠企业管理有限公司 | The method and device of thread resources grouping |
| CN110457312B (en) * | 2019-07-05 | 2023-07-07 | 中国平安财产保险股份有限公司 | Method, device, equipment and readable storage medium for collecting multi-type data |
| CN110457312A (en) * | 2019-07-05 | 2019-11-15 | 中国平安财产保险股份有限公司 | Acquisition method, device, equipment and the readable storage medium storing program for executing of diversiform data |
| CN111813021A (en) * | 2020-07-15 | 2020-10-23 | 深圳市天磁科技有限公司 | RS485 address multiplexing multi-slave computer data acquisition system |
| CN112565023A (en) * | 2020-12-28 | 2021-03-26 | 广州西麦科技股份有限公司 | Traffic visualization system and method based on Telemetry traffic acquisition technology |
| CN113873037A (en) * | 2021-09-29 | 2021-12-31 | 四川长虹网络科技有限责任公司 | Data pushing method and device, computer equipment and storage medium |
| CN114615137A (en) * | 2022-03-25 | 2022-06-10 | 浙江捷创方舟数字技术有限公司 | 5G data transmission method and device |
| CN114615137B (en) * | 2022-03-25 | 2024-05-28 | 浙江捷创方舟数字技术有限公司 | 5G data transmission method and device |
| CN115643218A (en) * | 2022-09-28 | 2023-01-24 | 惠州市华达通气体制造股份有限公司 | Industrial production data transmission method and device and server |
| CN116560949A (en) * | 2023-07-10 | 2023-08-08 | 南瑞轨道交通技术有限公司 | Method, system, equipment and storage medium for realizing data acquisition and reception |
| CN116560949B (en) * | 2023-07-10 | 2023-09-29 | 南瑞轨道交通技术有限公司 | Method, system, equipment and storage medium for realizing data acquisition and reception |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107948092A (en) | Real-time data acquisition method and real-time data acquisition system | |
| CN107390650B (en) | A kind of data collection system based on Internet of Things and the data compression method based on the system | |
| CN107707376B (en) | A kind of method and system of monitoring and alarm | |
| CN103019866B (en) | Distributed method and system based on message queue | |
| CN103152352B (en) | A kind of perfect information security forensics monitor method based on cloud computing environment and system | |
| CN106850710A (en) | A kind of safe data cloud storage system, client terminal, storage server and application process | |
| CN101656013A (en) | Vehicle-mounted monitoring alarm terminal, system and alarm method | |
| CN113596150B (en) | Message pushing method, device, computer equipment and storage medium | |
| CN102045192A (en) | Apparatus and system for estimating network configuration | |
| CN103795575B (en) | A kind of system monitoring method towards multiple data centers | |
| CN103699063A (en) | Device and method for acquiring off-line data of MES (Manufacturing Execution Method) system | |
| CN109981795B (en) | Resource request scheduling method and device | |
| CN113535518B (en) | Distributed real-time dynamic monitoring method and system for user behaviors | |
| CN107276857A (en) | A kind of method and device for monitoring flow | |
| CN101467132B (en) | Method and system for distributing data processing units in a communication network | |
| CN107908560A (en) | One kind is based on multiple target cross debugging system in Software Development Platform | |
| CN103455698A (en) | Medical monitoring method, device and system | |
| CN104270466B (en) | Data reporting method and relevant device | |
| CN113407374A (en) | Fault processing method and device, fault processing equipment and storage medium | |
| CN116095180B (en) | Log return routing method, device and storage medium | |
| CN107820270A (en) | GPRS interface monitoring system based on GSM-R network | |
| CN109510730A (en) | Distributed system and its monitoring method, device, electronic equipment and storage medium | |
| CN111294553B (en) | Method, device, equipment and storage medium for processing video monitoring service signaling | |
| CN108156061A (en) | Esb monitoring service platforms | |
| CN115987827B (en) | Equipment monitoring method and device, electronic equipment and readable medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180420 |