CN105260285A - Method and system for data center to collect and upload data - Google Patents

Method and system for data center to collect and upload data Download PDF

Info

Publication number
CN105260285A
CN105260285A CN201510681900.1A CN201510681900A CN105260285A CN 105260285 A CN105260285 A CN 105260285A CN 201510681900 A CN201510681900 A CN 201510681900A CN 105260285 A CN105260285 A CN 105260285A
Authority
CN
China
Prior art keywords
data
center
collection station
acquisition
uploaded
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510681900.1A
Other languages
Chinese (zh)
Inventor
符长林
胡孝平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SHENZHEN XBROTHER TECHNOLOGY Co Ltd
Original Assignee
SHENZHEN XBROTHER TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SHENZHEN XBROTHER TECHNOLOGY Co Ltd filed Critical SHENZHEN XBROTHER TECHNOLOGY Co Ltd
Priority to CN201510681900.1A priority Critical patent/CN105260285A/en
Publication of CN105260285A publication Critical patent/CN105260285A/en
Pending legal-status Critical Current

Links

Abstract

The invention provides a method and a system for a data center to collect and upload data. The method specifically comprises the following steps: a data acquisition terminal of the data center collects current data; the data acquisition terminal compares the current data with stored previous data; and if a detection result shows that the current data and the stored previous data have different data, uploading the different data to an upper computer of the data center. On the basis of an original MODBUS protocol, when the bottom-layer data acquisition terminal collects the data, the collected data in advance is analyzed in advance, only the data which is different from the previous data is collected, so that data uploading speed and upper-layer software response time and analysis speed can be greatly improved, and convenience is brought for users.

Description

The data acquisition of a kind of data center the method and system uploaded
Technical field
The present invention relates to data center's technical field, particularly relate to the data acquisition of a kind of data center and the method and system uploaded.
Background technology
Current is MODBUS agreement to data center or IDC center monitoring device talk.Because in machine room, Information Monitoring amount is large, all data volumes need be uploaded when bottom image data, again by upper layer software (applications) to all data analysis, so former MODBUS agreement easily causes poll time long, also easily there is the problem that the data response time is long, Refresh Data frequency is slow in upper layer software (applications) interface, brings inconvenience to user.
It can thus be appreciated that prior art has yet to be improved and developed.
Summary of the invention
The technical problem to be solved in the present invention is, for the above-mentioned defect of prior art, there is provided the data acquisition of a kind of data center and the method and system uploaded, be intended to the data upload speed being improved data center or IDC machine room by the present invention, improve upper layer software (applications) response time and analysis speed simultaneously, thus provide convenience for user.
The technical scheme that technical solution problem of the present invention adopts is as follows:
Data center's data acquisition the method uploaded, wherein, comprise step:
The data collection station of S1, data center gathers current data;
The last data of described current data and storage contrast by S2, described data collection station;
If S3 detects that the last data of described current data and storage exist not identical data, then described not identical data is uploaded to the host computer of described data center.
Described data center's data acquisition the method uploaded, wherein, described data collection station comprises N number of, wherein N<255.
Described data center's data acquisition the method uploaded, wherein, the time that each data collection station gathers needed for current data is different.
Described data center's data acquisition the method uploaded, wherein, described N number of data collection station is communicated to connect by RS485 bus and described host computer.
Described data center's data acquisition the method uploaded, wherein, described step S3 specifically comprises step:
S31, each data collection station gather corresponding current data as required respectively;
Current data after having gathered is analyzed with the last data stored before by S32, each data terminal respectively;
If S33 detects that described current data exists not identical data with the last data stored before respectively, then described not identical data is gathered;
S34, by the data upload after gathering to the host computer of described data center.
Data center's data acquisition the system uploaded, wherein, comprising:
Data acquisition module, the data collection station for data center gathers current data;
Data Comparison module, contrasts for the last data of described data collection station by described current data and storage;
Data upload module, if for detecting that the last data of described current data and storage exist not identical data, be then uploaded to the host computer of described data center by described not identical data.
The data acquisition of described data center the system uploaded, wherein, described data collection station comprises N number of, wherein N<255.
The data acquisition of described data center the system uploaded, wherein, the time that each data collection station gathers needed for current data is different.
The data acquisition of described data center the system uploaded, wherein, described N number of data collection station is communicated to connect by RS485 bus and described host computer.
The data acquisition of described data center the system uploaded, wherein, described data upload module specifically comprises:
Data acquisition contrast unit, gathers corresponding current data respectively as required for each data collection station, the current data after having gathered is analyzed with the last data stored before respectively;
Data Detection collection unit, if for detecting that described current data exists not identical data with the last data stored before respectively, then gather described not identical data;
Data summarization uploading unit, for by the data upload after gathering to the host computer of described data center.
A kind of data center provided by the present invention data acquisition the method and system uploaded, described method specifically comprises: the data collection station of data center gathers current data; The last data of described current data and storage contrast by described data collection station; If detect there is not identical data in the last data of described current data and storage, then described not identical data is uploaded to the host computer of described data center.The present invention is on former MODBUS protocol basis, when bottom data acquisition terminal image data, in advance to the data analysis gathered, only upload and previous vicissitudinous data, substantially increase data upload speed and upper layer software (applications) response time and analysis speed, provide users with the convenient.
Accompanying drawing explanation
Tu1Shi data center of the present invention data acquisition the process flow diagram of the preferred embodiment of method for uploading.
Tu2Shi data center of the present invention data acquisition the Application Example schematic diagram of method for uploading.
Tu3Shi data center of the present invention data acquisition the functional block diagram of the preferred embodiment of uploading system.
Embodiment
The invention discloses the data acquisition of a kind of data center and the method and system uploaded, for making object of the present invention, technical scheme and advantage clearly, clearly, developing simultaneously referring to accompanying drawing, the present invention is described in more detail for embodiment.Should be appreciated that specific embodiment described herein only in order to explain the present invention, be not intended to limit the present invention.
Refer to Fig. 1, Tu1Shi data center of the present invention data acquisition the process flow diagram of the preferred embodiment of method for uploading.Data center's data acquisition shown in Fig. 1 the method uploaded, comprising:
The data collection station of step S101, data center gathers current data.
Described data collection station in the embodiment of the present invention comprises N number of, wherein N<255, and each data collection station is all communicated to connect by RS485 bus and described host computer.Each data collection station is different according to its effect, and the time gathered needed for current data is different.For example, assuming that have 3 acquisition terminals, acquisition terminal 1 has 128 packets needs to upload, time is about 300ms, acquisition terminal 2 has 64 data to wrap biography, time is about 150ms, and terminal 3 has 4096 data to wrap biography, and the time is about 12s, so, the data upload of 3 acquisition terminals once needs about 16s (latency period of each acquisition terminal is defaulted as 1s).If image data amount is large, the time is longer, and uplink time also can be longer.The acquisition terminal quantity that RS485 bus is hung is more, and the time of uploading also can be longer, and the speed causing upper layer software (applications) to gather can be slower.
The last data of described current data and storage contrast by step S102, described data collection station.
If step S103 detects that the last data of described current data and storage exist not identical data, then described not identical data is uploaded to the host computer of described data center.
In the embodiment of the present invention, described step S103 specifically comprises step:
S31, each data collection station gather corresponding current data as required respectively;
Current data after having gathered is analyzed with the last data stored before by S32, each data terminal respectively;
If S33 detects that described current data exists not identical data with the last data stored before respectively, then described not identical data is gathered;
S34, by the data upload after gathering to the host computer of described data center.
Namely, the embodiment of the present invention is on former MODBUS protocol basis, when bottom data acquisition terminal image data, in advance to the data analysis gathered, only upload and previous vicissitudinous data, then suppose that the data of 3 acquisition terminals all only have 16 packets to change, then each acquisition terminal only uploads 16 packets, total uplink time is about 3.2S, under comparing, substantially increases data upload speed and upper layer software (applications) response time and analysis speed.
Below by by concrete Application Example, the present invention will be further described.Specifically please refer to the Application Example shown in Fig. 2.Data collection station in this application embodiment comprises N number of, wherein N<255, and each data collection station is communicated to connect by RS485 bus and described host computer.Data are different according to the effect of terminal for detection time from acquisition terminal, and acquisition time is also each different, and as image data amount is large, the time is longer, and uplink time also can be longer; Or the acquisition terminal quantity that RS485 bus is hung is more, the time of uploading also can be longer, thus the speed causing upper layer software (applications) to gather can be slower.For example, assuming that have 3 acquisition terminals, acquisition terminal 1 has 128 packets needs to upload, time is about 300ms, acquisition terminal 2 has 64 data to wrap biography, time is about 150ms, terminal 3 has 4096 data to wrap biography, and the time is about 12s, and the data upload of 3 acquisition terminals once needs about 16s (latency period of each acquisition terminal is defaulted as 1s); On this basis, data collection station first does data analysis by after data acquisition in terminal, data as 3 acquisition terminals all only have 16 packets to change, each acquisition terminal just only uploads 16 packets, total uplink time is about 3.2S, fundamentally improves the real-time of data acquisition.During in view of data acquisition in center monitoring, relative to previous data, the data of change are relatively less, and high priority data when changing is processed, and greatly improve the efficiency of change information collection.
For another example, in machine room, in each rack, all there is asset detection equipment, online management is carried out to the main equipment in rack.Asset detection equipment passes through RS485 bus with 30 equipment networks, then uploads to host computer via after protocol conversion, carries out information management by host computer.Assuming that each equipment former uploading data time is 3S, the wait interval time between two equipment is 0.5S, then no matter whether 30 asset detection equipment network data change uplink time is 104.5S.When adopting the method in the present invention, only need to upload delta data, if assuming that only have the partial data in 2 equipment to create change in 30 equipment, the data upload time of change is 0.01S and 0.02S, then the uploading data time is 14.53S, obviously drastically increases response time and real-time.
Therefore, the present invention is on former MODBUS protocol basis, when bottom data acquisition terminal image data, in advance to the data analysis gathered, only upload and previous vicissitudinous data, substantially increase data upload speed and upper layer software (applications) response time and analysis speed, provide users with the convenient.
Based on above-described embodiment, the present invention also provides the data acquisition of a kind of data center and uploading system, as shown in Figure 3, comprising:
Data acquisition module 100, the data collection station for data center gathers current data; As detailed above.
Data Comparison module 200, contrasts for the last data of described data collection station by described current data and storage; As detailed above.
Data upload module 300, if for detecting that the last data of described current data and storage exist not identical data, be then uploaded to the host computer of described data center by described not identical data; As detailed above.
Further, described data collection station comprises N number of, wherein N<255.
Further, each data collection station gathers the time difference needed for current data.
Further, described N number of data collection station is communicated to connect by RS485 bus and described host computer.
Further, described data upload module 300 specifically comprises:
Data acquisition contrast unit, gathers corresponding current data respectively as required for each data collection station, the current data after having gathered is analyzed with the last data stored before respectively; As detailed above.
Data Detection collection unit, if for detecting that described current data exists not identical data with the last data stored before respectively, then gather described not identical data; As detailed above.
Data summarization uploading unit, for by the data upload after gathering to the host computer of described data center; As detailed above.
In sum, a kind of data center provided by the present invention data acquisition the method and system uploaded, described method specifically comprises: the data collection station of data center gathers current data; The last data of described current data and storage contrast by described data collection station; If detect there is not identical data in the last data of described current data and storage, then described not identical data is uploaded to the host computer of described data center.The present invention is on former MODBUS protocol basis, when bottom data acquisition terminal image data, in advance to the data analysis gathered, only upload and previous vicissitudinous data, substantially increase data upload speed and upper layer software (applications) response time and analysis speed, provide users with the convenient.
Should be understood that, application of the present invention is not limited to above-mentioned citing, for those of ordinary skills, can be improved according to the above description or convert, and all these improve and convert the protection domain that all should belong to claims of the present invention.

Claims (10)

1. data center's data acquisition the method uploaded, is characterized in that, comprise step:
The data collection station of S1, data center gathers current data;
The last data of described current data and storage contrast by S2, described data collection station;
If S3 detects that the last data of described current data and storage exist not identical data, then described not identical data is uploaded to the host computer of described data center.
2. data center according to claim 1 data acquisition the method uploaded, it is characterized in that, described data collection station comprises N number of, wherein N<255.
3. data center according to claim 2 data acquisition the method uploaded, is characterized in that, the time that each data collection station gathers needed for current data is different.
4. data center according to claim 2 data acquisition the method uploaded, it is characterized in that, described N number of data collection station is communicated to connect by RS485 bus and described host computer.
5. data center according to claim 4 data acquisition the method uploaded, it is characterized in that, described step S3 specifically comprises step:
S31, each data collection station gather corresponding current data as required respectively;
Current data after having gathered is analyzed with the last data stored before by S32, each data terminal respectively;
If S33 detects that described current data exists not identical data with the last data stored before respectively, then described not identical data is gathered;
S34, by the data upload after gathering to the host computer of described data center.
6. data center's data acquisition the system uploaded, is characterized in that, comprising:
Data acquisition module, the data collection station for data center gathers current data;
Data Comparison module, contrasts for the last data of described data collection station by described current data and storage;
Data upload module, if for detecting that the last data of described current data and storage exist not identical data, be then uploaded to the host computer of described data center by described not identical data.
7. data center's data acquisition the system uploaded according to claim 6, it is characterized in that, described data collection station comprises N number of, wherein N<255.
8. data center's data acquisition the system uploaded according to claim 7, it is characterized in that, the time that each data collection station gathers needed for current data is different.
9. data center's data acquisition the system uploaded according to claim 7, it is characterized in that, described N number of data collection station is communicated to connect by RS485 bus and described host computer.
10. data center's data acquisition the system uploaded according to claim 9, it is characterized in that, described data upload module specifically comprises:
Data acquisition contrast unit, gathers corresponding current data respectively as required for each data collection station, the current data after having gathered is analyzed with the last data stored before respectively;
Data Detection collection unit, if for detecting that described current data exists not identical data with the last data stored before respectively, then gather described not identical data;
Data summarization uploading unit, for by the data upload after gathering to the host computer of described data center.
CN201510681900.1A 2015-10-21 2015-10-21 Method and system for data center to collect and upload data Pending CN105260285A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510681900.1A CN105260285A (en) 2015-10-21 2015-10-21 Method and system for data center to collect and upload data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510681900.1A CN105260285A (en) 2015-10-21 2015-10-21 Method and system for data center to collect and upload data

Publications (1)

Publication Number Publication Date
CN105260285A true CN105260285A (en) 2016-01-20

Family

ID=55099985

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510681900.1A Pending CN105260285A (en) 2015-10-21 2015-10-21 Method and system for data center to collect and upload data

Country Status (1)

Country Link
CN (1) CN105260285A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106296553A (en) * 2016-08-22 2017-01-04 合肥德泰科通测控技术有限公司 A kind of method of railway administration cloud detection
CN106292591A (en) * 2016-08-20 2017-01-04 广州明珞汽车装备有限公司 A kind of equipment big data platform monitoring diagnosis system
CN108023788A (en) * 2017-11-29 2018-05-11 中国平安人寿保险股份有限公司 Monitoring data method for uploading, device, equipment, system and storage medium
CN108880952A (en) * 2018-03-28 2018-11-23 青岛海信智慧家居系统股份有限公司 A kind of household appliance reports the method, device and equipment of information
CN111787082A (en) * 2020-06-22 2020-10-16 珠海格力电器股份有限公司 Method, equipment and system for reporting multi-stage service data
CN114510345A (en) * 2021-12-28 2022-05-17 山东有人物联网股份有限公司 Data acquisition equipment, method and device and computer readable storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101042710A (en) * 2007-04-29 2007-09-26 深圳市高正软件有限公司 Method and system for implementing acquisition data sharing
CN101924785A (en) * 2010-04-28 2010-12-22 华为技术有限公司 Data uploading and downloading methods and system
CN102682585A (en) * 2012-04-11 2012-09-19 苏州爱博斯蒂低碳能源技术有限公司 Internet of things data acquirer
CN103489053A (en) * 2013-05-13 2014-01-01 湖南云控科技有限公司 Intelligent water resource control platform based on cloud computing and expert system
CN104468337A (en) * 2014-12-24 2015-03-25 北京奇艺世纪科技有限公司 Message transmission method and device, message management center device and data centers
CN104955042A (en) * 2015-04-17 2015-09-30 深圳市威矽星通信技术有限公司 Data central processing method and system applicable to Internet of Things

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101042710A (en) * 2007-04-29 2007-09-26 深圳市高正软件有限公司 Method and system for implementing acquisition data sharing
CN101924785A (en) * 2010-04-28 2010-12-22 华为技术有限公司 Data uploading and downloading methods and system
CN102682585A (en) * 2012-04-11 2012-09-19 苏州爱博斯蒂低碳能源技术有限公司 Internet of things data acquirer
CN103489053A (en) * 2013-05-13 2014-01-01 湖南云控科技有限公司 Intelligent water resource control platform based on cloud computing and expert system
CN104468337A (en) * 2014-12-24 2015-03-25 北京奇艺世纪科技有限公司 Message transmission method and device, message management center device and data centers
CN104955042A (en) * 2015-04-17 2015-09-30 深圳市威矽星通信技术有限公司 Data central processing method and system applicable to Internet of Things

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106292591A (en) * 2016-08-20 2017-01-04 广州明珞汽车装备有限公司 A kind of equipment big data platform monitoring diagnosis system
CN106296553A (en) * 2016-08-22 2017-01-04 合肥德泰科通测控技术有限公司 A kind of method of railway administration cloud detection
CN108023788A (en) * 2017-11-29 2018-05-11 中国平安人寿保险股份有限公司 Monitoring data method for uploading, device, equipment, system and storage medium
CN108023788B (en) * 2017-11-29 2020-04-10 中国平安人寿保险股份有限公司 Monitoring data uploading method, device, equipment, system and storage medium
CN108880952A (en) * 2018-03-28 2018-11-23 青岛海信智慧家居系统股份有限公司 A kind of household appliance reports the method, device and equipment of information
CN111787082A (en) * 2020-06-22 2020-10-16 珠海格力电器股份有限公司 Method, equipment and system for reporting multi-stage service data
CN114510345A (en) * 2021-12-28 2022-05-17 山东有人物联网股份有限公司 Data acquisition equipment, method and device and computer readable storage medium

Similar Documents

Publication Publication Date Title
CN105260285A (en) Method and system for data center to collect and upload data
CN108429637B (en) System and method for dynamically detecting process layer network topology of intelligent substation
CN103067529B (en) A kind of long distance control system
CN106851782B (en) Data transmission method and device
KR20140119561A (en) System and method for big data aggregaton in sensor network
CN102984757B (en) Gateway data processing method and gateway data processing device for Internet of Things
CN104572574A (en) GigE (gigabit Ethernet) vision protocol-based Ethernet controller IP (Internet protocol) core and method
CN103108051A (en) Synchronous file sharing method from cloud server
CN104301161A (en) Computing method, computing device and communication system for business quality index
CN104866528B (en) Multi-platform collecting method and system
CN108901035B (en) Identification method and device for terminal of Internet of things
CN102868755A (en) Remote medical communication system and working method of remote medical communication system
CN104144185A (en) Data communication method, device and terminal
CN101599857B (en) Method, device and network detection system for detecting number of host computers accessed to sharing
CN107483234B (en) Method and device for split backup of access point of Internet of things
CN109215326A (en) A kind of parallel meter register method and device
CN114039875B (en) Data acquisition method, device and system based on eBPF technology
US10225358B2 (en) Page push method, device, server and system
CN105635317A (en) Wireless communication method and system applied to bridge detection
CN102655474B (en) Method, device and system for identifying equipment-crossing traffic types
CN102929799B (en) Data acquisition storage means and system
TW201933909A (en) Network access method, client, network interaction method, and scheduling and network systems
CN103728961B (en) Collecting method, transferring equipment and electric-bag complex dust collector supervisory system
CN102148702A (en) Method for managing network by utilizing network configuration protocol
CN109274763B (en) Information synchronization method and dual-computer hot standby equipment

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: 518057 Nanshan District City, Guangdong Province, high tech in the middle of the road No. 2 Shenzhen Software Park, a phase of the seven floor of the four floor of the three

Applicant after: Shenzhen Polytron Technologies Inc

Address before: 518057 Nanshan District City, Guangdong Province, high tech in the middle of the road No. 2 Shenzhen Software Park, a phase of the seven floor of the four floor of the three

Applicant before: Shenzhen Xbrother Technology Co., Ltd.

COR Change of bibliographic data
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20160120