CN102497427A - Method and device for realizing data acquisition services of renewable energy source monitoring system - Google Patents

Method and device for realizing data acquisition services of renewable energy source monitoring system Download PDF

Info

Publication number
CN102497427A
CN102497427A CN2011104140500A CN201110414050A CN102497427A CN 102497427 A CN102497427 A CN 102497427A CN 2011104140500 A CN2011104140500 A CN 2011104140500A CN 201110414050 A CN201110414050 A CN 201110414050A CN 102497427 A CN102497427 A CN 102497427A
Authority
CN
China
Prior art keywords
data
client
native system
module
management
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2011104140500A
Other languages
Chinese (zh)
Other versions
CN102497427B (en
Inventor
李迪
李裕
李震
王薇薇
韩随旗
林茂多
蒋义新
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shandong construction engineering quality inspection and Testing Center Co.,Ltd.
Shandong Provincial Academy of Building Research
Original Assignee
Shandong Provincial Academy of Building Research
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shandong Provincial Academy of Building Research filed Critical Shandong Provincial Academy of Building Research
Priority to CN201110414050.0A priority Critical patent/CN102497427B/en
Publication of CN102497427A publication Critical patent/CN102497427A/en
Application granted granted Critical
Publication of CN102497427B publication Critical patent/CN102497427B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Computer And Data Communications (AREA)

Abstract

Disclosed are a method and a device for realizing data acquisition services of a renewable energy source monitoring system. The method is characterized by including the following steps: system configuration management, public data cache, log processing, communication management, data storage, data safety processing and UI (user interface) interaction, wherein the step of communication management is mainly used for completing communication processing process between the system and a data acquirer and has functions of managing connection of client sides, analyzing received data, communicating with and responding to the data acquirer and the like. By the aid of the method, performance and resources of the renewable energy source monitoring system can be optimized, so that the system can stably run for a long time.

Description

Realize regenerative resource monitoring system data acquisition service method and device
Technical field
The present invention relates to a kind of collecting method, relate in particular to a kind of realization regenerative resource monitoring system data acquisition service method.
Background technology
The service end of generally, carrying out data communication based on Transmission Control Protocol can adopt following two kinds of schemes that service end software is designed.Scheme one: use multithreading, all open a thread for each client connection (promptly connecting socket) and handle, thereby guarantee the ageing of service end.Analyze: the ageing of service end is improved though use multithreading to handle; But in case exist a large amount of clients to connect (being possible in the engineering reality); Service end will be opened a large amount of threads and handled, and certainly will will very high requirement be arranged to server performance; In case client connects unexpected the disconnection, if the thread resources of having opened can not get reclaiming timely, with the reduction of significant wastage that causes system resource and performance.Scheme two: set up one and connect the socket formation, adopt the method for poll that data read operation is carried out in each client connection in the formation.Analyze:, reduced the ageing of service end though this scheme has been avoided the spending of a large amount of thread resources.Whether send data because can't confirm each client connection, therefore must carry out read operation one time, can't in time carry out response process, reduced the system effectiveness of service end the client of sending data to each client.
In engineering reality, when using the TCP chain to receive and send data,, then can be sent by automatic segmentation if packet to be sent is long.If too short, then can be combined into long packet automatically and be redispatched.Particularly in data volume bigger and send continuously in more obvious.Therefore cause the problem to the processing data packets mistake easily, promptly when packet during by segmentation, deal with data is imperfect; Packet is handled as a packet by the compound tense mistake.
Summary of the invention
Technical problem to be solved by this invention is to be connected with the collector terminal through network on the one hand to obtain Monitoring Data; On the other hand the Monitoring Data of obtaining is carried out processing such as data parsing, preservation, for the data display system provides the data basis.
The present invention has also solved based on the Transmission Control Protocol client and has connected long-time online high-efficiency management problem; It is imperfect and wrong problem occurs handling also to have solved data that the automatic segmentation transmission in Network Transmission of big packet causes simultaneously.
Applied environment of the present invention is applicable to Windows Server 2003 above operating systems, disposes the operating system platform of Microsoft .NET Framework 3.5 frameworks and SQL Server 2005 above versions.
Native system can be applicable to use as the dynamic monitoring subsystem in the regenerative resource Application in Building demonstrative project data monitoring system.The main data communication function of accomplishing with data acquisition unit carries out the data that data acquisition unit reports AES deciphering, dissection process, writes operation such as database, for the data display subsystem provides the data support, is the important step that realizes data monitoring.
Native system has used the multithreading treatment technology, can accomplish a large amount of collection clients and connect simultaneously and accomplish data communication services.Native system is based on the network communication services end of Transmission Control Protocol; With keeping data acquisition unit to carry out data communication for a long time with as client; When communicating with client; Must set up one and connect socket (socket), have what clients what connection sockets are just arranged, therefore how a plurality of connection sockets managed directly having influence on service end performance and efficient as service end.
The technical measures that the present invention is adopted for the technical solution problem are: a kind of realization regenerative resource monitoring system data acquisition service method, it comprises the steps:
The system configuration management process is accomplished native system Basic Configuration Items information, comprises the functions such as setting, modification of database connection, TCP listening port, local ip address information;
Common data buffer memory step is the data buffer storage unit that native system is opened up, comprising system's constant and metadata cache two sub-steps.The data of storing in the common data buffer memory step are used as the global system variable of native system, for native system telecommunication management step, data safe processing functional module provide data, reduce the read-write operation of native system and external file, improve system effectiveness; Said common data buffer memory step comprises system's constant and metadata cache two sub-steps; System's constant is that each functional module of native system uses, the lower system variable of numerical value change frequency, from CONFIG.SYS or local data base, obtains assignment when after system start-up, carrying out initialization; Metadata cache is that each functional module of native system uses, the numerical value change system variable that frequency is higher, data volume is bigger, a large amount of swap data that in the laggard data transfer communication process of system start-up, produces.
The log processing step; The log processing step with the error message that produces in system's running, necessary information etc. through the UI interface display; And record in the journal file of system; Be convenient to running situation is monitored, when the system failure occurring, provide relevant information to be convenient to location and processing system failure reason.
The telecommunication management step is mainly accomplished communication process between native system and the data acquisition unit, comprises the management that client is connected, the data parsing that receives, communicates to data acquisition unit and function such as reply.The telecommunication management step comprises:
Connect the dispatching management substep, set up access to be connected such as monitoring that native system connects client, receive client and connect data sent, client connected carry out condition managing, whether client connected to have broken off detect etc.Connect for each TCP client, computer operating system all be that it produces a unique sign, in order to the identification of client connection and operation etc., and has opened this uniquely identified interface.Native system obtains the sign that client connects through this interface, discerns and manages thereby system can be connected client.
The communication protocol management substep is mainly used in completion when data acquisition unit is replied, and according to the xml format text of communication protocol formation standard, promptly meets the xml format text maker of communication protocol.
The data parsing step, according to the xml format specification, the data message that from the xml format text, reads respective attributes or mark is used for storage.
Thread pool task substep for improving system response time and performance, carries out data parsing through the mode of thread pool and handles, and the scheduling of data processing task and execution are given operating system and accomplished.
The storage step, the data that dissection process is good are carried out the write operation of database, and data are saved in the database, and pending data shows that subsystem calls.
The data safe processing step is accomplished the operation of data necessary encryption and decryption, makes data in transmission course, reach the purpose of data security.It comprises MD5 verification and AES encryption and decryption.The MD5 verification is calculated the MD5 sign indicating number of corresponding data according to the rule of formulating in the communication protocol, and accomplishes MD5 sign indicating number contrast verifying function.The data of receiving that mainly achieve a butt joint are carried out the AES deciphering and reply data are carried out the AES encryption function.
The UI interactive step.The UI interactive step is that native system offers the system manager, is convenient to accomplish necessary system configuration function operations boundary element module.Have submodules such as System menu, data demonstration, system message demonstration.System menu, the UI of native system provide clearly text definition (being the abbreviation of User Interface user interface) interface and according to the System menu mode function corresponding are carried out organization and administration, meet the operating habit of most of user to Windows.The collector configuration is carried out the operation interface that relevant configuration is provided with to what the system manager provided to the data collector.Client state shows, the part on the native system visual interface, and through the mode of data list, the information that client is connected is presented on the system interface, information such as the state that makes the system manager can get information about active client to connect, quantity.System message shows that the information of catching in the journal processing unit shows with the mode of system message, makes the keeper can intuitively obtain the information data that produces in the current system running.Real time data shows that in the interface of system, the data that directly current dissection process obtained are presented on the interface, are the embodiments directly perceived of native system internal data dissection process.
The packet segment transmissions is handled basic ideas: the data of utilizing the way of metadata cache at every turn to receive are kept in the system cache by the order that receives; In data cached, read out complete packet according to communication protocol; And the data that will read clean out the spending of minimizing system resource from buffer memory.Concrete workflow is as shown in Figure 6.After system receives data; Connection dispatching management substep in the telecommunication management step reads the metadata cache object that corresponding client connects in the common data buffer memory; Judge through reading corresponding metadata cache object whether the metadata cache object of clients corresponding connection exists; If the metadata cache object is also set up, system creation metadata cache then, and the data that receive are written in the metadata cache of common data unit; If the metadata cache object that has existed then arrives data cached end with the data supplementing that receives.After this communication protocol management subelement is then searched the beginning and the end mark of packet in data cached according to communication protocol, thereby reads out complete packet.
A kind of device of realizing regenerative resource monitoring system data acquisition service; It is characterized in that it comprises the steps: the system configuration administration module; Accomplish native system Basic Configuration Items information, comprise the functions such as setting, modification of database connection, TCP listening port, local ip address information; The common data cache module is the data buffer storage unit that native system is opened up, comprising system's constant and metadata cache two sub-module; The data of storing in the common data cache module are used as the global system variable of native system, for native system communication management module, data safe processing module provide data, reduce the read-write operation of native system and external file, improve system effectiveness; System's constant is that native system correlation function module uses, the lower system variable of numerical value change frequency, from CONFIG.SYS or local data base, obtains assignment when after system start-up, carrying out initialization; Metadata cache is that native system correlation function module uses, the numerical value change system variable that frequency is higher, data volume is bigger, a large amount of swap data that in the laggard data transfer communication process of system start-up, produces; Log processing module; Log processing module with the error message that produces in system's running, necessary information etc. through the UI interface display; And record in the journal file of system; Be convenient to running situation is monitored, when the system failure occurring, provide relevant information to be convenient to location and processing system failure reason; Communication management module is mainly accomplished communication process between native system and the data acquisition unit, comprises the management that client is connected, the data parsing that receives, communicates to data acquisition unit and function such as reply; Data memory module, the data that dissection process is good are carried out the write operation of database, and data are saved in the database, and pending data shows that subsystem calls; The data safe processing module is accomplished the operation of data necessary encryption and decryption, makes data in transmission course, reach the purpose of data security; It comprises MD5 verification and AES encryption and decryption; The MD5 verification is calculated the MD5 sign indicating number of corresponding data according to the rule of formulating in the communication protocol, and accomplishes MD5 sign indicating number contrast verifying function; The data of receiving that mainly achieve a butt joint are carried out the AES deciphering and reply data are carried out the AES encryption function; The UI interactive module; The UI interactive step is that native system offers the system manager, is convenient to accomplish necessary system configuration function operations boundary element module; Have submodules such as System menu, data demonstration, system message demonstration.
The concrete characteristics of this programme also have; Said communication management module comprises: connect the dispatching management submodule, set up access to be connected such as monitoring that native system connects client, receive client and connect data sent, client connected carry out condition managing, whether client connected to have broken off detect etc.; Connect for each TCP client, computer operating system all be that it produces a unique sign, in order to the identification of client connection and operation etc., and has opened this uniquely identified interface; Native system obtains the sign that client connects through this interface, discerns and manages thereby system can be connected client;
The communication protocol management submodule is mainly used in completion when data acquisition unit is replied, and according to the xml format text of communication protocol formation standard, promptly meets the xml format text maker of communication protocol;
The data parsing submodule, according to the xml format specification, the data message that from the xml format text, reads respective attributes or mark is used for storage;
Thread pool task submodule for improving system response time and performance, carries out data parsing through the mode of thread pool and handles, and the scheduling of data processing task and execution are given operating system and accomplished.
The invention has the beneficial effects as follows: the packet that in the regenerative resource monitoring system, communicates between data acquisition unit and the service end software is a formative packet of encrypting and increased data packet head and packet tail and check digit through AES; Along with the increase of monitoring point, the size of packet also increases accordingly; Data acquisition unit is the automation process between the equipment with communicating by letter of service end software; Do not rely on artificial auxiliary operation; And only otherwise the accident of communication disruption occurs causing, connection between the two will keep connection status for a long time between client and the server; Expansion along with monitoring range; The quantity of data acquisition unit also might increase thereupon; Thereby make the also corresponding increase of number of connection between server and the data acquisition unit; Each data acquisition unit is identical to the time that server sends data in addition, has caused the appearance of high concurrent connection, server software is handled the concurrent ability of multiple spot have higher requirement.Characteristics in the engineering reality of comprehensive above three aspects, service end software must be able to adapt to big data quantity, long-time unattended operation, the concurrent actual conditions of multiple spot, so the solution that native system has taked multithreading to combine with the formation poll.This scheme is not simply the two to be superposeed, but through to the control of client connection status in the formation, realizes the optimization to systematic function and system resource, thereby makes the system can long-time steady operation.
For native system is carried out the checking of performance and efficient, to build test environment and carry out actual test, hardware environment is following:
Through uninterrupted on-line testing in 30 days, communicate by letter between collector and the server, in proper working order, the data that correct dissection process receives, and correct reply data collector, the server CPU usage is 0% when not busy, when busy about 15%.
Description of drawings
Fig. 1 is system's vertical structure block diagram; Fig. 2 is system's transversary block diagram; Fig. 3 is a system flow chart; Fig. 4 is a Data Receiving deal with data flow graph; Fig. 5 is the thread process flow chart; Fig. 6 is a packet segment transmissions process chart.
Embodiment
In conjunction with accompanying drawing the mutual call relation between native system groundwork flow process and each functional module is described; The system works flow process is as shown in Figure 2; Native system starts the back and reads local system configuration item information through the system configuration administrative unit, and accomplishes the initialization operation of common data unit.Start communications management unit subsequently; Wait for the connection request of data acquisition unit; In case receive the connection request of collector; Connect the dispatching management unit and read the TCP connection identifier that is produced by operating system, communications management unit will be set up the data communication channel of Basing on network fluid simultaneously, and this network flow data passage is realized the transmission and the reception of data through the mode that writes data and reading of data; Communications management unit writes this channel information and TCP connection identifier in the data output buffers of common data unit subsequently, for the client state of UI interactive unit shows data is provided.When data acquisition unit when system sends data; Communications management unit reads the communication data data from the pairing network flow data passage of this collector; Communications management unit carries out the packet segment transmissions with the communication data that reads to be handled, and the data that receive is written in the metadata cache of common data unit.The communication protocol management subelement is then searched the beginning and the end mark of packet in data cached according to communication protocol; Thereby read out complete packet; And this packet is delivered in the thread pool TU task unit as parameter; The NET framework is the thread pool interface that program process provides, and makes that the thread in the thread pool also starts the thread task automatically by the computer operating system management.The thread pool TU task unit starts the thread task to processing data packets automatically; Call the data safe processing step and accomplish the AES deciphering of this packet; And the byte data after will obtaining deciphering is written in the system cache object; Common data buffer memory step is carried out character conversion to the byte data after deciphering, and obtains complete xml data file.The data parsing unit according to the xml format specification, reads the regenerative resource Monitoring Data that collector reports with the xml data file from the xml format text, give data storage cell and carry out the real time data display unit that the UI interface was preserved and offered to database.Above-mentioned Data Receiving deal with data flow graph is as shown in Figure 4.System mistake that occurs in system's running or data necessary information write down through log management unit and export to the system message display module at UI interface.
In this telecommunication management step, connecting long-time online high-efficiency management based on the Transmission Control Protocol client is one of concrete characteristics of the present invention.In the regenerative resource monitoring system, the data communication between collector client and the native system is continual, thereby makes collector and native system form the state of long-time online communication; In this simultaneously, native system possibly carry out data communication simultaneously with a plurality of collector clients, therefore, how high efficiency condition managing and scheduling is carried out in these communication connections, is the crucial part of native system.Thread and formation way of combining have been adopted in the design of native system and realization, give full play to advantage separately, not only guarantee that system is ageing but also improve system effectiveness.
Connection dispatching management substep in the telecommunication management step is that client is connected the main execution in step of managing, and its workflow is as shown in Figure 5.Native system will realize connecting the data handling procedure of dispatching management substep through 3 formations of 4 threads.At first set up three formation QueueWait (waiting list), QueueReceiver (reception formation), QueueData (data queue); That wherein preserve in waiting list and the reception formation is socket; The corresponding client of each socket connects; Wherein waiting list is used to preserve the client connection that does not receive data, and receiving formation then is to receive the client of data to connect; Deposit the client data sent in the data queue.Simultaneity factor is opened 4 worker thread ThreadWait (wait thread), ThreadListen (watcher thread), ThreadReceiver (receiving thread), ThreadDataHandle (data processing thread).Wherein, the main task of watcher thread is to monitor the client connection request, in case client is initiated connection request, watcher thread moves on to client socket and receives in the formation, carries out subsequent treatment by receiving thread.The data processing thread is responsible for the data queue that receives is carried out traversal, resolves, stores according to the processing method of confirming, data can be used.The groundwork of waiting for thread is that traversal is in the socket in the waiting list, if having data to receive for each socket, so just in waiting list, moves on to it in the reception formation; If there are not receivable data, just do not process, in addition; Treat in the ergodic process of formation in wait thread equity, also whether the socket client is connected still to survive and detect, when the client connection had been lost efficacy; To from formation, remove this connection, reduce taking of system resource, improve running efficiency of system and performance; The mechanism of monitoring is to not carrying out for a long time the connection of data communication; Communications management unit sends detectable signal to connecting, and does not break off if receive success response then be judged to be, and concrete observation process is that collector client and the last time of accomplishing data communication of native system are recorded in the common data buffer memory; When waiting for that thread carries out the traversal of waiting list; The time that system is current calculates with last call duration time, obtains the time interval, when this interval greater than or during the interval threshold that equals to be provided with in advance; System needs the active probe client to connect whether still survival; The system communication administrative unit is initiatively sent detectable signal to connecting client, and waits for that client connects the reception of returning and becomes function signal, does not break off if receive success response then be judged to be.Similarly, the receiving thread traversal receives the socket in the formation, receives client data.Receiving in the formation, judge each socket in the formation, if there are not receivable data; So it is moved on in the waiting list,, read the data of socket if receivable data are arranged; And give the data processing thread with packing data and carry out the processing of packet segment transmissions, the data that receive are written in the metadata cache of common data unit, judge whether that simultaneously data can receive in addition; If do not have data to receive, then it moved on in the waiting list.

Claims (4)

1. realize regenerative resource monitoring system data acquisition service method for one kind, it is characterized in that it comprises the steps:
The system configuration management process is accomplished native system Basic Configuration Items information, comprises the functions such as setting, modification of database connection, TCP listening port, local ip address information;
Common data buffer memory step is the data buffer storage unit that native system is opened up, comprising system's constant and metadata cache two sub-steps; The data of storing in the common data buffer memory step are used as the global system variable of native system, for native system telecommunication management step, data safe processing step provide data, reduce the read-write operation of native system and external file, improve system effectiveness; System's constant is that native system correlation function module uses, the lower system variable of numerical value change frequency, from CONFIG.SYS or local data base, obtains assignment when after system start-up, carrying out initialization; Metadata cache is that native system correlation function module uses, the numerical value change system variable that frequency is higher, data volume is bigger, a large amount of swap data that in the laggard data transfer communication process of system start-up, produces;
The log processing step; The log processing step with the error message that produces in system's running, necessary information etc. through the UI interface display; And record in the journal file of system; Be convenient to running situation is monitored, when the system failure occurring, provide relevant information to be convenient to location and processing system failure reason;
The telecommunication management step is mainly accomplished communication process between native system and the data acquisition unit, comprises the management that client is connected, the data parsing that receives, communicates to data acquisition unit and function such as reply;
The storage step, the data that dissection process is good are carried out the write operation of database, and data are saved in the database, and pending data shows that subsystem calls;
The data safe processing step is accomplished the operation of data necessary encryption and decryption, makes data in transmission course, reach the purpose of data security; It comprises MD5 verification and AES encryption and decryption; The MD5 verification is calculated the MD5 sign indicating number of corresponding data according to the rule of formulating in the communication protocol, and accomplishes MD5 sign indicating number contrast verifying function; The data of receiving that mainly achieve a butt joint are carried out the AES deciphering and reply data are carried out the AES encryption function;
The UI interactive step; The UI interactive step is that native system offers the system manager, is convenient to accomplish necessary system configuration function operations boundary element module; Have submodules such as System menu, data demonstration, system message demonstration.
2. realization regenerative resource monitoring system data acquisition service method according to claim 1 is characterized in that said telecommunication management step comprises:
Connect the dispatching management substep, set up access to be connected such as monitoring that native system connects client, receive client and connect data sent, client connected carry out condition managing, whether client connected to have broken off detect etc.; Connect for each TCP client, computer operating system all be that it produces a unique sign, in order to the identification of client connection and operation etc., and has opened this uniquely identified interface; Native system obtains the sign that client connects through this interface, discerns and manages thereby system can be connected client;
The communication protocol management substep is mainly used in completion when data acquisition unit is replied, and according to the xml format text of communication protocol formation standard, promptly meets the xml format text maker of communication protocol;
The data parsing substep, according to the xml format specification, the data message that from the xml format text, reads respective attributes or mark is used for storage;
Thread pool task substep for improving system response time and performance, carries out data parsing through the mode of thread pool and handles, and the scheduling of data processing task and execution are given operating system and accomplished.
3. a device of realizing regenerative resource monitoring system data acquisition service is characterized in that it comprises the steps:
The system configuration administration module is accomplished native system Basic Configuration Items information, comprises the functions such as setting, modification of database connection, TCP listening port, local ip address information;
The common data cache module is the data buffer storage unit that native system is opened up, comprising system's constant and metadata cache two sub-module; The data of storing in the common data cache module are used as the global system variable of native system, for native system communication management module, data safe processing module provide data, reduce the read-write operation of native system and external file, improve system effectiveness; System's constant is that native system correlation function module uses, the lower system variable of numerical value change frequency, from CONFIG.SYS or local data base, obtains assignment when after system start-up, carrying out initialization; Metadata cache is that native system correlation function module uses, the numerical value change system variable that frequency is higher, data volume is bigger, a large amount of swap data that in the laggard data transfer communication process of system start-up, produces;
Log processing module; Log processing module with the error message that produces in system's running, necessary information etc. through the UI interface display; And record in the journal file of system; Be convenient to running situation is monitored, when the system failure occurring, provide relevant information to be convenient to location and processing system failure reason;
Communication management module is mainly accomplished communication process between native system and the data acquisition unit, comprises the management that client is connected, the data parsing that receives, communicates to data acquisition unit and function such as reply;
Data memory module, the data that dissection process is good are carried out the write operation of database, and data are saved in the database, and pending data shows that subsystem calls;
The data safe processing module is accomplished the operation of data necessary encryption and decryption, makes data in transmission course, reach the purpose of data security; It comprises MD5 verification and AES encryption and decryption; The MD5 verification is calculated the MD5 sign indicating number of corresponding data according to the rule of formulating in the communication protocol, and accomplishes MD5 sign indicating number contrast verifying function; The data of receiving that mainly achieve a butt joint are carried out the AES deciphering and reply data are carried out the AES encryption function;
The UI interactive module; The UI interactive step is that native system offers the system manager, is convenient to accomplish necessary system configuration function operations boundary element module; Have submodules such as System menu, data demonstration, system message demonstration.
4. the device of realization regenerative resource monitoring system data acquisition service according to claim 3 is characterized in that said communication management module comprises:
Connect the dispatching management submodule, set up access to be connected such as monitoring that native system connects client, receive client and connect data sent, client connected carry out condition managing, whether client connected to have broken off detect etc.; Connect for each TCP client, computer operating system all be that it produces a unique sign, in order to the identification of client connection and operation etc., and has opened this uniquely identified interface; Native system obtains the sign that client connects through this interface, discerns and manages thereby system can be connected client;
The communication protocol management submodule is mainly used in completion when data acquisition unit is replied, and according to the xml format text of communication protocol formation standard, promptly meets the xml format text maker of communication protocol;
The data parsing submodule, according to the xml format specification, the data message that from the xml format text, reads respective attributes or mark is used for storage;
Thread pool task submodule for improving system response time and performance, carries out data parsing through the mode of thread pool and handles, and the scheduling of data processing task and execution are given operating system and accomplished.
CN201110414050.0A 2011-12-13 2011-12-13 Method and device for realizing data acquisition services of renewable energy source monitoring system Active CN102497427B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201110414050.0A CN102497427B (en) 2011-12-13 2011-12-13 Method and device for realizing data acquisition services of renewable energy source monitoring system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201110414050.0A CN102497427B (en) 2011-12-13 2011-12-13 Method and device for realizing data acquisition services of renewable energy source monitoring system

Publications (2)

Publication Number Publication Date
CN102497427A true CN102497427A (en) 2012-06-13
CN102497427B CN102497427B (en) 2014-02-05

Family

ID=46189212

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201110414050.0A Active CN102497427B (en) 2011-12-13 2011-12-13 Method and device for realizing data acquisition services of renewable energy source monitoring system

Country Status (1)

Country Link
CN (1) CN102497427B (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103945013A (en) * 2013-01-17 2014-07-23 方正宽带网络服务股份有限公司 Data transmission interface device and data transmission method
CN104038314A (en) * 2014-05-09 2014-09-10 中煤电气有限公司 Novel safety-monitoring networking real-time dynamic data transmission system and method
CN103647685B (en) * 2013-12-18 2017-01-04 中国电子科技集团公司第四十一研究所 A kind of test result information uploads receiving handling method
CN106612297A (en) * 2015-10-21 2017-05-03 北京国双科技有限公司 Data processing method and device
CN106790706A (en) * 2017-02-27 2017-05-31 深圳先进技术研究院 A kind of method of data resource optimization, platform and system
CN107565692A (en) * 2017-09-18 2018-01-09 合肥学院 Regenerative resource monitoring information real-time collecting method based on dispatch data net
CN109246235A (en) * 2018-09-30 2019-01-18 广州圣亚科技有限公司 Method of reseptance, device and the data monitoring system of monitoring data
CN109617654A (en) * 2018-12-14 2019-04-12 广东飞企互联科技股份有限公司 Industry internet big data service system data transmission method and data aggregate resolver
CN110933118A (en) * 2020-02-20 2020-03-27 深圳市城市交通规划设计研究中心股份有限公司 Edge computing gateway secure communication method, system, terminal equipment and server
CN112084095A (en) * 2020-09-18 2020-12-15 广州智云尚大数据科技有限公司 Energy network connection monitoring method and system based on block chain and storage medium
CN113361571A (en) * 2021-05-25 2021-09-07 华能曲阜热电有限公司 Automatic data acquisition method for fuel front-end chemical examination equipment

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101286895A (en) * 2008-05-22 2008-10-15 上海交通大学 Dynamic configurable data monitoring system and method for distributed network
US20100058052A1 (en) * 2003-07-01 2010-03-04 Andrew Bartels Methods, systems and devices for securing supervisory control and data acquisition (scada) communications
CN101808007A (en) * 2010-02-22 2010-08-18 烽火通信科技股份有限公司 Method for acquiring real-time performance data by network manager
CN102163231A (en) * 2011-04-13 2011-08-24 浪潮(北京)电子信息产业有限公司 Method and device for data collection

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100058052A1 (en) * 2003-07-01 2010-03-04 Andrew Bartels Methods, systems and devices for securing supervisory control and data acquisition (scada) communications
CN101286895A (en) * 2008-05-22 2008-10-15 上海交通大学 Dynamic configurable data monitoring system and method for distributed network
CN101808007A (en) * 2010-02-22 2010-08-18 烽火通信科技股份有限公司 Method for acquiring real-time performance data by network manager
CN102163231A (en) * 2011-04-13 2011-08-24 浪潮(北京)电子信息产业有限公司 Method and device for data collection

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103945013A (en) * 2013-01-17 2014-07-23 方正宽带网络服务股份有限公司 Data transmission interface device and data transmission method
CN103647685B (en) * 2013-12-18 2017-01-04 中国电子科技集团公司第四十一研究所 A kind of test result information uploads receiving handling method
CN104038314A (en) * 2014-05-09 2014-09-10 中煤电气有限公司 Novel safety-monitoring networking real-time dynamic data transmission system and method
CN104038314B (en) * 2014-05-09 2018-02-02 中煤电气有限公司 A kind of new safety supervision networking dynamic data RTTS and method
CN106612297A (en) * 2015-10-21 2017-05-03 北京国双科技有限公司 Data processing method and device
CN106790706A (en) * 2017-02-27 2017-05-31 深圳先进技术研究院 A kind of method of data resource optimization, platform and system
CN106790706B (en) * 2017-02-27 2019-11-19 深圳先进技术研究院 A kind of method, platform and the system of data resource optimization
CN107565692A (en) * 2017-09-18 2018-01-09 合肥学院 Regenerative resource monitoring information real-time collecting method based on dispatch data net
CN109246235B (en) * 2018-09-30 2021-12-10 广州圣亚科技有限公司 Method and device for receiving monitoring data and data monitoring system
CN109246235A (en) * 2018-09-30 2019-01-18 广州圣亚科技有限公司 Method of reseptance, device and the data monitoring system of monitoring data
CN109617654A (en) * 2018-12-14 2019-04-12 广东飞企互联科技股份有限公司 Industry internet big data service system data transmission method and data aggregate resolver
CN109617654B (en) * 2018-12-14 2021-03-05 广东飞企互联科技股份有限公司 Data transmission method and data aggregation analysis device for industrial internet big data service system
CN110933118B (en) * 2020-02-20 2020-09-11 深圳市城市交通规划设计研究中心股份有限公司 Edge computing gateway secure communication method, system, terminal equipment and server
CN110933118A (en) * 2020-02-20 2020-03-27 深圳市城市交通规划设计研究中心股份有限公司 Edge computing gateway secure communication method, system, terminal equipment and server
CN112084095A (en) * 2020-09-18 2020-12-15 广州智云尚大数据科技有限公司 Energy network connection monitoring method and system based on block chain and storage medium
CN112084095B (en) * 2020-09-18 2021-12-21 广域铭岛数字科技有限公司 Energy network connection monitoring method and system based on block chain and storage medium
CN113361571A (en) * 2021-05-25 2021-09-07 华能曲阜热电有限公司 Automatic data acquisition method for fuel front-end chemical examination equipment

Also Published As

Publication number Publication date
CN102497427B (en) 2014-02-05

Similar Documents

Publication Publication Date Title
CN102497427B (en) Method and device for realizing data acquisition services of renewable energy source monitoring system
WO2021203979A1 (en) Operation and maintenance processing method and apparatus, and computer device
CN103023857B (en) A kind of method and system of information resources remote deployment
CN104022902A (en) Method and system of monitoring server cluster
CN103856361A (en) Method and system for realizing remote debugging
CN107025222A (en) A kind of distributed information log acquisition method and device
CN103795762A (en) Reverse agent test system and method
CN107133231B (en) Data acquisition method and device
CN101388903A (en) Mobile enterprise IT standardization management platform
CN103441861A (en) Method and device for generating data records
CN102957568B (en) A kind of method for managing and monitoring of multi node server
CN103490978A (en) Terminal, server and message monitoring method
CN108123826B (en) Cross-region data interaction system and method
CN113127307A (en) Method for processing tracing request, related device, system and storage medium
CN105302486A (en) Virtual offline desktop block device storage synchronization method
CN106888264B (en) A kind of method for interchanging data and device
CN105607606B (en) A kind of data acquisition device and method based on double mainboard frameworks
CN112115016A (en) Application performance monitoring system
CN109800133A (en) A kind of method, one-stop monitoring alarm platform and the system of unified monitoring alarm
CN111431762B (en) Wireless network state monitoring and displaying system
CN113220481A (en) Request processing and feedback method and device, computer equipment and readable storage medium
CN108011870A (en) A kind of remote software online upgrading information automatic identification management method
CN104598202A (en) Command line management device and method
CN109921920A (en) A kind of failure information processing method and relevant apparatus
CN104038314A (en) Novel safety-monitoring networking real-time dynamic data transmission system and method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20200811

Address after: 250031 Shandong Province Flyover District of Ji'nan City Road 29.

Co-patentee after: Shandong construction engineering quality inspection and Testing Center Co.,Ltd.

Patentee after: Shandong Academy of Building Science Co.,Ltd.

Address before: 250031 Shandong Province Flyover District of Ji'nan City Road 29.

Patentee before: SHANDONG PROVINCIAL ACADEMY OF BUILDING RESEARCH

TR01 Transfer of patent right