CN107404483A - Data processing method, device and data collecting system - Google Patents
Data processing method, device and data collecting system Download PDFInfo
- Publication number
- CN107404483A CN107404483A CN201710640934.5A CN201710640934A CN107404483A CN 107404483 A CN107404483 A CN 107404483A CN 201710640934 A CN201710640934 A CN 201710640934A CN 107404483 A CN107404483 A CN 107404483A
- Authority
- CN
- China
- Prior art keywords
- data
- gathered
- processing equipment
- acquisition
- data processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2308—Concurrency control
- G06F16/2315—Optimistic concurrency control
- G06F16/2322—Optimistic concurrency control using timestamps
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
- H04L63/0876—Network architectures or network communication protocols for network security for authentication of entities based on the identity of the terminal or configuration, e.g. MAC address, hardware or software configuration or device fingerprint
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/12—Applying verification of the received information
- H04L63/123—Applying verification of the received information received data contents, e.g. message integrity
Landscapes
- Engineering & Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computing Systems (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Power Engineering (AREA)
- Software Systems (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention provides a kind of data processing method, device and data collecting system, it is related to Internet of Things field.Methods described is applied to the data processing equipment in the data collecting system of the multi-energy data of collection building, and the system includes server, data processing equipment and the multiple data acquisition equipments for being arranged at building, and methods described includes：Acquisition time corresponding to the gathered data and each gathered data of the multiple data acquisition equipment of the data processing equipment acquisition；The data processing equipment verifies to the gathered data got, and is that effective acquired data storage is effective status data by check results, while stores the storage time and acquisition time of the effective status data；When the data processing equipment is in network connection state, by the number of significant condition of storage according to this and corresponding storage time, acquisition time are sent to the server.
Description
Technical field
The present invention relates to Internet of Things field, in particular to a kind of data processing method, device and data acquisition system
System.
Background technology
The data collecting system of multi-energy data for gathering building is a set of to use comprehensive monitoring for building energy
KXG, conventional public building can be covered, comprising office building (such as office building, office of government department),
Commercial building (such as market, financial building), tourism building (such as hotel, public place of entertainment), science, education, culture and hygiene's building (as educated,
Scientific research, medical treatment, health, sports building etc.).
Data collecting system can realize that energy consumption data obtains by automatic data collection with two ways is manually entered.For building
The preferable public building of automation condition or the public building for possessing information reform condition, can by smart instrumentation or other
The collecting device for possessing ability to communicate realizes energy device automatic data collection.For not possessing the public affairs of multi-energy data automatic data collection condition
Build together and build, multi-energy data can be manually entered multi-energy data information platform by way of manual operation.
Multi-energy data, which gathers, to be lost with Information application generally existing data in transmitting procedure or the problems such as corrupt data,
The data acquisition application of internet is particularly based on, because network path is longer and a variety of unstable disturbing factors be present, therefore
The data transfer of long-time stable and high accuracy is particularly important.And in existing multi-energy data collection and Information application, generally
Whether the data of transmission can not be determined has continuity.
The content of the invention
In view of this, the embodiments of the invention provide a kind of data processing method, device and data collecting system, by
Acquisition time is added in the data of collection, data storage is that storage time is stored, to improve above mentioned problem.
To achieve these goals, the technical solution adopted by the present invention is as follows：
A kind of data processing method, applied to the data processing in the data collecting system of the multi-energy data of collection building
Equipment, the system include server, data processing equipment and the multiple data acquisition equipments for being arranged at building, the side
Method includes：The data processing equipment obtains the gathered data of the multiple data acquisition equipment and each gathered data corresponds to
Acquisition time；The data processing equipment verifies to the gathered data got, and is effectively to adopt by check results
Integrate data storage as effective status data, while store the storage time and acquisition time of the effective status data；When described
Data processing equipment is in network connection state, by the number of significant condition of storage according to this and corresponding storage time, acquisition time
It is sent to the server.
A kind of data processing equipment, applied to the data processing in the data collecting system of the multi-energy data of collection building
Equipment, the system include server, data processing equipment and the multiple data acquisition equipments for being arranged at building, the dress
Put including：Data acquisition module, for the gathered data for obtaining the multiple data acquisition equipment and each gathered data pair
The acquisition time answered；Correction verification module, it is effective collection for being verified to the gathered data got, and by check results
Data storage is effective status data, while stores the storage time and acquisition time of the effective status data；Data are sent
Module, for being in network connection state when the data processing equipment, the number of significant condition of storage according to this and corresponding is deposited
Storage time, acquisition time timing are sent to the server.
A kind of data collecting system, the system include server, data processing equipment and for being arranged at building
Multiple data acquisition equipments, wherein, the multiple data acquisition equipment is respectively used to the collection of corresponding data in building；Institute
State data processing equipment be used for obtain the multiple data acquisition equipment gathered data and each gathered data corresponding to adopt
Collect the time；The data processing equipment is used to verify the gathered data got, and is effectively to adopt by check results
Integrate data storage as effective status data, while store the storage time and acquisition time of the effective status data；When described
Data processing equipment is in network connection state, for by the number of significant condition of storage according to this and corresponding storage time, collection
Time timing is sent to the server；The server is used to correspond respectively to every number to the effective status data received
Stored according to collecting device, and store acquisition time and storage time corresponding to each effective status data.
Data processing method, device and data collecting system provided in an embodiment of the present invention, data processing equipment is from multiple
It is effective by check results after data acquisition equipment gets acquisition time corresponding to gathered data and each gathered data
Acquired data storage is effective status data and is correspondingly stored the storage time for storing the effective status data, in data
When processing equipment is in network connection state, by number of significant condition according to this and corresponding storage time, acquisition time timing send
To server, server is set to get gathered data of the data acquisition equipment to building, and adopting according to gathered data
Collection time and storage time determine whether data have continuity.
To enable the above objects, features and advantages of the present invention to become apparent, preferred embodiment cited below particularly, and coordinate
Appended accompanying drawing, is described in detail below.
Brief description of the drawings
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with the embodiment of the present invention
In accompanying drawing, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is
Part of the embodiment of the present invention, rather than whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art
The every other embodiment obtained under the premise of creative work is not made, belongs to the scope of protection of the invention.
Fig. 1 shows the interaction schematic diagram of data collecting system provided in an embodiment of the present invention；
Fig. 2 shows the structured flowchart of data processing equipment provided in an embodiment of the present invention；
Fig. 3 shows the flow chart of data processing method provided in an embodiment of the present invention；
Fig. 4 shows the functional block diagram of data processing equipment provided in an embodiment of the present invention.
Embodiment
Below in conjunction with accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Ground describes, it is clear that described embodiment is only part of the embodiment of the present invention, rather than whole embodiments.Generally exist
The component of the embodiment of the present invention described and illustrated in accompanying drawing can be configured to arrange and design with a variety of herein.Cause
This, the detailed description of the embodiments of the invention to providing in the accompanying drawings is not intended to limit claimed invention below
Scope, but it is merely representative of the selected embodiment of the present invention.Based on embodiments of the invention, those skilled in the art are not doing
The every other embodiment obtained on the premise of going out creative work, belongs to the scope of protection of the invention.
It should be noted that：Similar label and letter represents similar terms in following accompanying drawing, therefore, once a certain Xiang Yi
It is defined, then it further need not be defined and explained in subsequent accompanying drawing in individual accompanying drawing.Meanwhile the present invention's
In description, term " first ", " second " etc. are only used for distinguishing description, and it is not intended that instruction or hint relative importance.
As shown in figure 1, it is the interaction schematic diagram of data collecting system 100 provided in an embodiment of the present invention.Within the system,
Including server 110, data processing equipment 120 and multiple data acquisition equipments 130 for being arranged at building, server
110 are communicated to connect with data processing equipment 120, and data processing equipment 120 is connected with multiple signals of data acquisition equipment 130.Should
Data collecting system 100 is used to gather the multi-energy data of building, wherein, the multi-energy data can include temperature in building,
The environmental datas such as humidity, cold, heat, the collection of the energy consumption data of each equipment in building can also be included, such as used
Electricity, water consumption etc..
Fig. 1 is referred to, within the system, server 110 is communicatively coupled by network and data processing equipment 120,
To enter row data communication or interaction, wherein, the system can be communicated by ICP/IP protocol.The server 110 can be one
Individual or multiple servers, such as web server (WebServer), client server, the webserver, database server.If
Server 110 is multiple servers, can be cooperated between the plurality of server 110, carries out data interaction.
In addition, multiple data acquisition equipments 130 can be the equipment for being respectively used to gather different energy sources data, as collection is built
The electric quantity acquisition equipment for building the electricity behaviour in service of electrical equipment in thing, the humiture collection for gathering humiture in building are set
The cold and hot amount collecting device of cold and hot amount in standby, collection building, or other are used to gather electric current, voltage, active power
The collecting device related to electricity, for gathering the collecting device of air conditioning pressure, flow, temperature etc., for gathering water consumption, combustion gas
Collecting device of usage amount etc., collection can be various equipment in various data or building in environment
Data.Specifically include which data acquisition equipment 130 is not intended to limit in the present embodiment, the setting tool of data acquisition equipment 130
Body position and the energy datum specifically gathered also do not limit in the present embodiment, also, for gathering each environment number
According to or the data acquisition equipment 130 of energy datum can be the existing collecting device that can gather relevant parameter, such as with temperature
Humidity sensor collection humiture, pressure sensor collection pressure etc., its specifically used equipment is in the present embodiment and unlimited
System.
The data that data processing equipment 120 is used to collect data acquisition equipment 130 are obtained, arranged and are sent to
The equipment of server 110, the data processing equipment 120 can be concentrate communication gate, there is communication function, as RS485,
WIFI, 3G/4G, LAN etc., it may have data processing function, such as active inquiry, data check, data merge, data report and
Data storage etc..Wherein, each data acquisition equipment 130 can be connected by 485 buses with the signal of data processing equipment 120.
Fig. 2 shows a kind of structured flowchart for the data processing equipment 120 that can be applied in the embodiment of the present invention.Such as Fig. 2
Shown, data processing equipment 120 includes memory 121, storage control 122, one or more (one is only shown in figure) places
Manage device 123, Peripheral Interface 124, radio frequency unit 125 etc..These components pass through the phase of one or more communication bus/signal wire 126
Mutually communication.
Memory 121 can be used for storage software program, module and various data, and processor 123 is used to perform various work(
It can apply and data processing.
Memory 121 may include high speed random access memory, may also include nonvolatile memory, such as one or more magnetic
Property storage device, flash memory or other non-volatile solid state memories.Processor 123 and other possible components are to storage
The access of device 121 can be carried out under the control of storage control 122.
Various input/output devices are coupled to processor 123 and memory 121 by Peripheral Interface 124.In some implementations
In example, Peripheral Interface 124, processor 123 and storage control 122 can be realized in one single chip.In some other reality
In example, they can be realized by independent chip respectively.
Radio frequency unit 125 is used to receiving and sending electromagnetic wave, realizes the mutual conversion of electromagnetic wave and electric signal, so that with
Communication network or other equipment are communicated.
In the present embodiment, there is provided a kind of data processing method, the multi-energy data applied to above-mentioned collection building
Data processing equipment 120 in data collecting system 100, refers to Fig. 3, and methods described includes：
Step S110：The data processing equipment 120 obtain the multiple data acquisition equipment 130 gathered data and
Acquisition time corresponding to each gathered data.
Multi-energy data corresponding to the real-time collection of data acquisition equipment 130, such as the real-time collecting temperature of temperature sensor, voltage passes
Real-time collection voltages of sensor etc..Data processing equipment 120 can get the gathered data of each data acquisition equipment 130, and
And acquisition time corresponding to each gathered data of acquisition can be got.
In the present embodiment, data processing equipment 120 can obtain the gathered data of data acquisition equipment 130 in real time,
Can periodically it obtain, the specific acquisition time cycle can set according to being actually needed.
Preferably, in the present embodiment, data processing equipment 120 can obtain data acquisition equipment by the way of poll
130 gathered data, that is to say, that data processing equipment 120 can be obtained by the multiple data acquisition equipments 130 of poll successively
Gathered data corresponding to multiple data acquisition equipments 130, the poll to each data acquisition equipment 130 can be automatic regular polling,
When data acquisition equipment 130 receives the poll of data processing equipment 120, gathered data is returned to data processing equipment 120.
Step S120：The data processing equipment 120 verifies to the gathered data got, and is by check results
Effective acquired data storage is effective status data, while when storing storage time and the collection of the effective status data
Between.
Data processing equipment 120 verifies the gathered data of each data acquisition equipment 130, to judge that each data acquisition is set
Being collected for 130 is whether data are normal datas, if normal data, then check results are effective.Therefore, if check results
To be effective, then illustrate that the data that collect are normal, are correct data, can be stored as effective status data, also, have for this
Effect status data stamps timestamp, that is to say, that while stored the storage time of the effective status data, in addition, having
Imitate the acquisition time also storage corresponding with the effective status data of status data.It should be understood that in the present embodiment, to effective
When status data is stored, associate and deposit after each effective status data are matched with corresponding data acquisition equipment 130
Storage, that is to say, that each collecting device corresponds to its data acquisition equipment 130 and stored.It is for example, it may be corresponding per number
Identity be present according to collecting device 130, the gathered data of each data acquisition equipment 130 is associated with its identity
Storage, to know the data acquisition equipment 130 corresponding to each gathered data.
In the present embodiment, the verification to gathered data can be gathered corresponding to each data acquisition equipment 130 of verification
Whether data are to should be in the range of the preset data of data acquisition equipment 130, if so, then judging that the gathered data is effective shape
State data.Wherein, corresponding each data acquisition equipment 130 is provided with preset data scope, that is, corresponds to each collection number
According to preset data scope is set, the preset data scope can be that the gathered data of the data acquisition equipment 130 corresponding to exists
In actual environment may empirical data range set or according to corresponding data acquisition equipment 130 itself may
The data area setting collected, such as sets the preset data scope according to the rated power of data acquisition equipment 130.
Specifically, in embodiments of the present invention, to the checking procedure of gathered data corresponding to each data acquisition equipment 130
It can include：
Step S121：Whether within a preset range the length of gathered data is judged, if so, next step is performed, if it is not, will
The gathered data abandons.
Corresponding each gathered data is previously provided with a data length, if the data length of gathered data is in the collection
Corresponding to data in the range of preset length, then illustrate that the gathered data may be correct, its check results may be effective, Ke Yijin
The next step that row verification includes, the next step is probably the verification operation of next step, if this step is the last of verification
One step, then the next step can be to judge that the gathered data is effective status data.If the length of gathered data is not default
In the range of, illustrate that the gathered data may be incorrect, the gathered data is abandoned.
Step S122：Data conversion is carried out to gathered data.
The data format that data acquisition equipment 130 collects may due to and undesirable data format or not be easy to
Handle, be easy to judgement be easy to contrast etc. reason and need to carry out it data conversion, therefore, in the present embodiment, can be to portion
Point or the gathered data that collects of all bus data acquisition equipment 130 carry out format conversion, be transformed into standard set in advance
Data format.For example, the data collected be by watt in units of, and the data format of standard set in advance for kilowatt, therefore
By the data conversion collected into kilowatt.
In the present embodiment, the data format of standard can determine according to actual conditions, not limit in the present embodiment,
As data that temperature acquisition equipment collects be converted to by degree Celsius in units of data, the data that current acquisition equipment collects
Be converted to the data in units of ampere.
Can be that gathered data corresponding to all data acquisition equipments 130 all carries out data turn in addition, in the present embodiment
Change or the gathered data of part data acquisition equipment 130 carries out data conversion, specific which data acquisition equipment 130
Corresponding gathered data carries out data conversion and not limited in the present embodiment, can be determined according to being actually needed.
Step S123：Enter row format judgement to gathered data, if the form of gathered data is correct data format, enter
The next step that row verification includes, is otherwise abandoned.
Gathered data corresponding to some data acquisition equipments 130 may have a fixed form, such as some data (such as
Power consumption) can not possibly be negative etc., its data format should be positive number or zero；Gathered data should be recognizable data, and
Data of non-unrecognizable data format etc..Therefore form corresponding to various gathered datas can be preset, to receiving
Collection number enter row format judgement, be probably effective status data if form is correct form, next step can be carried out
Processing, if mistake form, then may be incorrect data, can be abandoned.Wherein, the form root of every kind of data
It is determined according to the practical manifestation form of data, does not limit in the present embodiment.
In the present embodiment, can be all data acquisition equipments 130 corresponding to gathered data all enter row format judgement,
Can also be that the gathered data of part data acquisition equipment 130 enters row format judgement, the specific correspondence of which data acquisition equipment 130
Gathered data enter row format judge do not limit in the present embodiment, can according to be actually needed determination or data acquisition set
Standby 130 real data situation determines.
Step S124：Threshold decision is carried out to gathered data,.
To each gathered data given threshold.
Wherein,, can be with this for the gathered data of the equipment collected because each equipment has specified power
Equipment rated power determines that data acquisition equipment 130 collects the threshold value of the gathered data of the equipment as reference.Such as certain electricity consumption
The rated power of equipment is 10 watts, then threshold value corresponding to the power consumption of the electrical equipment collected is using this 10 watts as with reference in terms of
Calculate, specific calculate can be, if the gathered data that data acquisition equipment 130 collects is the power consumption of 1 hour, with 10
Watt power under work required for power consumption as threshold value.
When gathered data has big difference with corresponding threshold value, its difference is more than default threshold difference, and the data there is
It is abnormal, it is impossible to use, therefore cannot function as effective status data, can be abandoned.If gathered data and corresponding threshold value
Difference is less than or equal to predetermined threshold value, and the data may be normal data, can enter next checking procedure to the data,
The next step included into verification.In the present embodiment, the threshold difference between the corresponding threshold value of various gathered datas
Value can be different, and specific threshold difference size can determine according to the error of permission and the error of actual capabilities.
Step S125：Micro-judgment is carried out to gathered data.
The gathered data collected for some data acquisition equipments 130, it can be judged according to its corresponding empirical data
Whether it is normal data, if gathered data is less than or equal to default experience difference with the difference of corresponding empirical data,
The gathered data may be normal data, can enter the next step that the verification includes, if gathered data and corresponding warp
The difference for testing data is more than default experience difference, then the gathered data may be improper data, can be by the collection number
According to discarding.As described above, if last step of micro-judgment for verification gathered data is carried out to gathered data, when collection number
It is less than or equal to default experience difference according to the difference of corresponding empirical data, then the next step can judge the collection
The check results of data are effective.Wherein, the occurrence of the experience difference can according to the actual conditions of every kind of gathered data or
The actual installation situation of each data acquisition equipment 130 of person is determined.
In the present embodiment, it can judge whether it is just with the empirically data of historical data corresponding to gathered data
Normal data.For example, for equipment electricity consumption, there is its electricity consumption data in historical record, if the electricity consumption data and history that collect
Record has big difference, and data have exception, do not use, therefore cannot function as effective status data, can be abandoned；It is right
In indoor temperature, if the indoor temperature and the indoor temperature of historical record that collect have big difference, the temperature collected can
Can be abnormal.
In the present embodiment, above-mentioned steps S121 is not limited to the processing sequence between each steps of step S125, can
Be using said sequence as processing sequence or other be sequentially used as processing sequence.In addition, the verification to gathered data
During, above-mentioned steps S121 to step S125 all steps can be included, part steps therein can also be only included, its
Specifically include which step does not limit in the present embodiment, can determine according to the actual requirements.
In addition, the verification to data correctness can also be by other verification modes, above-mentioned steps S121 to step S125 is only
As an example, it is not intended as limiting.
Step S130：When the data processing equipment 120 is in network connection state, by the number of significant condition of storage according to this
And corresponding storage time, acquisition time are sent to the server 110.
In the present embodiment, whether network connection state can be in real-time judge data processing equipment 120, if at data
Reason equipment 120 is in network connection state, after it will be verified as effective acquired data storage as effective status data, can incite somebody to action
Effective status data are sent to server 110, also, send storage time corresponding to each effective status data simultaneously and adopt
Collect the time, it will of course be understood that, itself and data acquisition equipment 130 can be sent simultaneously during the effective status data of transmission
Corresponding relation, so that server 110 can know the data acquisition equipment 130 corresponding to each effective status data.
Further, data processing equipment 120 can timing by the number of significant condition of storage according to this and during corresponding storage
Between, acquisition time be sent to server 110, that is to say, that data processing equipment 120 can periodically send data, its send
Cycle does not limit in the present embodiment, can obtain data according to actual acquisition situation or from data acquisition equipment 130
Frequency determines.
In the present embodiment, can be by number of significant condition according to this and this has if data processing equipment 120 is in off-line state
Imitate the storage time of status data, acquisition time is stored as off-line data.In addition, data processing equipment 120 is under off-line state,
Network connection can in real time or be periodically asked, when data processing equipment 120 enters network connection state by off-line state
When, its off-line data can be sent to server 110.
Therefore, when the data processing equipment 120 is in network connection state, offline number can also be judged whether
According to if so, the off-line data is sent into the server 110.
Further, in the present embodiment, data processing equipment 120 will can also be sent to the data of server 110 from
The data processing equipment 120 is deleted, and its specific erasing time does not limit in the present embodiment, for example, it may be hair every time
Deleted after sending or several days delete once, or some months, deletion one was inferior, can be according to data processing equipment 120
Data processing needs, its data storage capacities etc. determine.
Further, in the present embodiment, check results can also be invalid gathered data by data processing equipment 120
It is stored as initial data and correspondingly stores the storage time and acquisition time of the initial data, and works as data processing equipment
120 when being in network connection state, and the initial data of storage and corresponding storage time, acquisition time timing are sent into institute
State server 110.That is, can be initial data by the data storage of above-mentioned discarding.If data processing equipment 120 is in
Off-line state, initial data and corresponding storage time, acquisition time can also be stored as off-line data, in data processing
After the network connection of equipment 120, server 110 is then forwarded to.
In the present embodiment, the data for being sent to server 110 can be according to self-defining communication protocol standard packaging into
Data, wherein, the self-defining communication protocol content composition in, successively including header, collection classification, gateway sequence number, equipment
Numbering, data length, data content, check value and mark eight content areas of tail.Data protocol is equivalent to the number existing equipment
Secondary encapsulation is carried out according to agreement, data content portion can be with the existing protocol format standard of compatible data collecting device 130.
Wherein, header and mark tail are customized numerals, are well known to server 110 and data processing equipment 120；Collection
Classification can represent corresponding gathered data generic, be correspondingly arranged numerical value as collection class in advance for each gathered data
Not；The sequence number of gateway Serial No. data processing equipment 120；Device numbering can be gathered data corresponding to the data sent
The numbering of corresponding data acquisition equipment 130；Data in data length and data content are the data for being actually subjected to send, such as
Effective status data., can be according to wherein after check value makes the data that server 110 receives the transmission of data processing equipment 120
Check value judge whether the data that receive and the data that data processing equipment 120 is sent consistent, for example, the check value is root
According to 120 known algorithm of certain server 110 and data processing equipment, obtained after calculating data content, then will encapsulation
After data afterwards are sent to server 110, server 110 can according to the algorithm to the data content in encapsulation of data with the calculation
Method is calculated, and sees whether the check value of calculating is equal to the check value in encapsulation of data, if so, then proving that server 110 receives
The data arrived are consistent with the data that data processing equipment 120 is sent.
In addition, data content portion includes built-in check value, server 110 is set to carry out secondary school on the whole
Test, can effectively ensure that the accuracy of data transfer.
In the present embodiment, the data that data processing equipment 120 passes to server 110 include adopting for effective status data
Collect time and storage time, therefore, whether have between the data that server 110 can determine to receive according to the time therein
There is continuity.
Second embodiment
Fig. 4 shows data processing equipment 200 provided in an embodiment of the present invention, the multi-energy data applied to collection building
Data collecting system 100 in data processing equipment 120, the system includes server, data processing equipment and setting
In multiple data acquisition equipments of building.Fig. 4 is referred to, described device 200 includes：
Data acquisition module 210, for obtaining the gathered data of the multiple data acquisition equipment and each gathering number
According to corresponding acquisition time.Correction verification module 220, it is to have for being verified to the gathered data got, and by check results
The acquired data storage of effect is effective status data, while stores the storage time and acquisition time of the effective status data.
Data transmission blocks 230, for being in network connection state when the data processing equipment, by the number of significant condition of storage according to this
And the timing of corresponding storage time, acquisition time is sent to the server.
Second embodiment
A kind of data collecting system 100 is present embodiments provided, as shown in figure 1, the system includes server 110, data
Processing equipment 120 and multiple data acquisition equipments 130 for being arranged at building, wherein,
The multiple data acquisition equipment 130 is respectively used to the collection of corresponding data in building；
The data processing equipment 120 is used for the gathered data for obtaining the multiple data acquisition equipment 130 and each
Acquisition time corresponding to gathered data；
The data processing equipment 120 is used to verify the gathered data got, and is effective by check results
Acquired data storage be effective status data, while store the storage time and acquisition time of the effective status data；
When the data processing equipment 120 is in network connection state, for the number of significant condition of storage is according to this and right
The storage time answered, acquisition time timing are sent to the server 110；
The server 110 is used to correspond respectively to each data acquisition equipment 130 to the effective status data received
Stored, and store acquisition time and storage time corresponding to each effective status data.
Further, the server 110 be used for by the data received be divided into latest data, historical data and
Three layers of difference between latest data and last data is stored.Wherein, latest data is last current reception
The effective status data arrived, historical data are the effective status data received before current time, and last data is most
An effective status data before new data.Furthermore it is possible to corresponding to each data storage has its acquisition time and storage
Time.
In the present embodiment, obtain the real time data of collecting device using the polling mechanism of data processing equipment 120 and lead to
The upload and storage of TCP/IP real-time performance data are crossed, using the data hierarchy and data checking mechanisms at the end of server 110, is rejected
The continuity and accuracy of data can be ensured while invalid data, to solve the problems, such as remote energy source Data acquisition and storage
Provide the solution method of system.
It should be noted that each embodiment in this specification is described by the way of progressive, each embodiment weight
Point explanation is all difference with other embodiment, between each embodiment identical similar part mutually referring to,
In same embodiment identical similar part also can mutually referring to.For device class embodiment, because it is real with method
Apply that example is substantially similar, so description is fairly simple, the relevent part can refer to the partial explaination of embodiments of method.
In several embodiments provided herein, it should be understood that disclosed apparatus and method, can also pass through
Other modes are realized.Device embodiment described above is only schematical, for example, flow chart and block diagram in accompanying drawing
Show the device of multiple embodiments according to the present invention, method and computer program product architectural framework in the cards,
Function and operation.At this point, each square frame in flow chart or block diagram can represent the one of a module, program segment or code
Part, a part for the module, program segment or code include one or more and are used to realize holding for defined logic function
Row instruction.It should also be noted that at some as in the implementation replaced, the function that is marked in square frame can also with different from
The order marked in accompanying drawing occurs.For example, two continuous square frames can essentially perform substantially in parallel, they are sometimes
It can perform in the opposite order, this is depending on involved function.It is it is also noted that every in block diagram and/or flow chart
The combination of individual square frame and block diagram and/or the square frame in flow chart, function or the special base of action as defined in performing can be used
Realize, or can be realized with the combination of specialized hardware and computer instruction in the system of hardware.
In addition, each functional module in each embodiment of the present invention can integrate to form an independent portion
Point or modules individualism, can also two or more modules be integrated to form an independent part.
If the function is realized in the form of software function module and is used as independent production marketing or in use, can be with
It is stored in a computer read/write memory medium.Based on such understanding, technical scheme is substantially in other words
The part to be contributed to prior art or the part of the technical scheme can be embodied in the form of software product, the meter
Calculation machine software product is stored in a storage medium, including some instructions are causing a computer equipment (can be
People's computer, server 110, or network equipment etc.) perform all or part of step of each embodiment methods described of the present invention
Suddenly.And foregoing storage medium includes：USB flash disk, mobile hard disk, read-only storage (ROM, Read-Only Memory), deposit at random
Access to memory (RAM, Random Access Memory), magnetic disc or CD etc. are various can be with the medium of store program codes.
It should be noted that herein, such as first and second or the like relational terms are used merely to an entity or behaviour
Make with another entity or operation make a distinction, and not necessarily require or imply these entities or operate between exist it is any this
Kind actual relation or order.Moreover, term " comprising ", "comprising" or its any other variant are intended to nonexcludability
Include so that process, method, article or equipment including a series of elements not only include those key elements, but also
Including the other element being not expressly set out, or also include for this process, method, article or equipment intrinsic want
Element.In the absence of more restrictions, the key element limited by sentence "including a ...", it is not excluded that wanted including described
Other identical element also be present in the process of element, method, article or equipment.
The preferred embodiments of the present invention are the foregoing is only, are not intended to limit the invention, for the skill of this area
For art personnel, the present invention can have various modifications and variations.Within the spirit and principles of the invention, that is made any repaiies
Change, equivalent substitution, improvement etc., should be included in the scope of the protection.It should be noted that：Similar label and letter exists
Similar terms is represented in following accompanying drawing, therefore, once being defined in a certain Xiang Yi accompanying drawing, is then not required in subsequent accompanying drawing
It is further defined and explained.
The foregoing is only a specific embodiment of the invention, but protection scope of the present invention is not limited thereto, any
Those familiar with the art the invention discloses technical scope in, change or replacement can be readily occurred in, should all be contained
Cover within protection scope of the present invention.Therefore, protection scope of the present invention described should be defined by scope of the claims.
Claims (10)
1. a kind of data processing method, it is characterised in that in the data collecting system applied to the multi-energy data of collection building
Data processing equipment, the system includes server, data processing equipment and the multiple data acquisitions for being arranged at building
Equipment, methods described include：
The data processing equipment is obtained corresponding to gathered data and each gathered data of the multiple data acquisition equipment
Acquisition time；
The data processing equipment verifies to the gathered data got, and is that effective gathered data is deposited by check results
Store up as effective status data, while store the storage time and acquisition time of the effective status data；
When the data processing equipment is in network connection state, by the number of significant condition of storage according to this and during corresponding storage
Between, acquisition time be sent to the server.
2. according to the method for claim 1, it is characterised in that the data processing equipment is the multiple by poll successively
Data acquisition equipment obtains gathered data corresponding to the multiple data acquisition equipment.
3. according to the method for claim 1, it is characterised in that by check results be that invalid acquired data storage is original
Data and the storage time and acquisition time for correspondingly storing the initial data；
The initial data of storage and corresponding storage time, acquisition time timing are sent to the server.
4. according to the method for claim 1, it is characterised in that when the data processing equipment is in internet off-line state,
By the number of significant condition according to this and the storage time of the effective status data, acquisition time are stored as off-line data；
When the data processing equipment is in network connection state, off-line data is judged whether, if so, will the offline number
According to being sent to the server.
5. according to the method described in any one of claims 1 to 3, it is characterised in that the data of server will be sent to from described
Data processing equipment is deleted.
6. according to the method for claim 1, it is characterised in that the data processing equipment enters to the gathered data got
Row verification includes, verify gathered data corresponding to each data acquisition equipment whether to should data acquisition equipment present count
In the range of, if so, then judging the gathered data for effective status data.
7. according to the method for claim 1, it is characterised in that the data processing equipment enters to the gathered data got
Row verification includes following at least one step：
Whether within a preset range the length of gathered data is judged, if so, performing the next step for verifying and including；
Data conversion is carried out to gathered data；
Enter row format judgement to gathered data, if the form of gathered data is correct data format, carry out the verification bag
The next step included；
Threshold decision is carried out to gathered data, if gathered data is less than or equal to default threshold difference with the difference of corresponding threshold value
Value, then carry out the next step for verifying and including；
Micro-judgment is carried out to gathered data, if gathered data is less than or equal to default warp with the difference of corresponding empirical data
Difference is tested, the next step that the verification includes can be carried out to the gathered data.
8. a kind of data processing equipment, it is characterised in that in the data collecting system applied to the multi-energy data of collection building
Data processing equipment, the system includes server, data processing equipment and the multiple data acquisitions for being arranged at building
Equipment, described device include：
Data acquisition module, for obtaining corresponding to gathered data and each gathered data of the multiple data acquisition equipment
Acquisition time；
Correction verification module, it is effective acquired data storage for being verified to the gathered data got, and by check results
For effective status data, while store the storage time and acquisition time of the effective status data；
Data transmission blocks, for being in network connection state when the data processing equipment, by the effective status data of storage
And the timing of corresponding storage time, acquisition time is sent to the server.
9. a kind of data collecting system, the system includes server, data processing equipment and for being arranged at building
Multiple data acquisition equipments, wherein,
The multiple data acquisition equipment is respectively used to the collection of corresponding data in building；
The data processing equipment is used to obtain the gathered data of the multiple data acquisition equipment and each gathered data pair
The acquisition time answered；
The data processing equipment is used to verify the gathered data got, and is effective collection number by check results
According to being stored as effective status data, while store the storage time and acquisition time of the effective status data；
When the data processing equipment is in network connection state, for by the number of significant condition of storage according to this and corresponding storage
Time, acquisition time timing are sent to the server；
The server stores for corresponding respectively to each data acquisition equipment to the effective status data received, and
Store acquisition time and storage time corresponding to each effective status data.
10. system according to claim 9, it is characterised in that the server is used for the number of significant condition that will be received
According to the difference be divided between latest data, historical data and latest data and last data, three layers are stored.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710640934.5A CN107404483A (en) | 2017-07-31 | 2017-07-31 | Data processing method, device and data collecting system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710640934.5A CN107404483A (en) | 2017-07-31 | 2017-07-31 | Data processing method, device and data collecting system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107404483A true CN107404483A (en) | 2017-11-28 |
Family
ID=60401774
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710640934.5A Pending CN107404483A (en) | 2017-07-31 | 2017-07-31 | Data processing method, device and data collecting system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107404483A (en) |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107911472A (en) * | 2017-12-01 | 2018-04-13 | 德阳源创能源科技有限公司 | Data processing method and device |
| CN108063775A (en) * | 2018-02-13 | 2018-05-22 | 广州云湾信息技术有限公司 | Communication protocol compatibility method, apparatus and system |
| CN108196797A (en) * | 2018-01-26 | 2018-06-22 | 江苏财会职业学院 | A kind of data processing system based on cloud computing |
| CN108595120A (en) * | 2018-04-11 | 2018-09-28 | 广东电网有限责任公司 | A kind of scada near-realtime datas storage method and system |
| CN109246210A (en) * | 2018-08-29 | 2019-01-18 | 山东网智物联网科技有限公司 | Internet of Things communication means and device |
| CN109660608A (en) * | 2018-12-07 | 2019-04-19 | 上海明牛云科技有限公司 | Data acquisition and transmission method, device and equipment based on local datastore |
| CN109979027A (en) * | 2019-02-20 | 2019-07-05 | 钛马信息网络技术有限公司 | A kind of processing method of vehicle status data, device, equipment and medium |
| CN110212519A (en) * | 2019-05-23 | 2019-09-06 | 山西金晖隆开关有限公司 | Data processing method for low and medium voltage distribution network |
| CN110718052A (en) * | 2019-10-21 | 2020-01-21 | 上海米尺网络技术有限公司 | Wireless acquisition device and data acquisition method |
| CN110958158A (en) * | 2019-11-22 | 2020-04-03 | 江苏百倍云信息科技有限公司 | Internet of things platform communication evaluation method |
| CN111078720A (en) * | 2019-11-06 | 2020-04-28 | 中国科学院计算机网络信息中心 | Identification-based entity object and data object association method and system |
| CN111524341A (en) * | 2020-03-19 | 2020-08-11 | 深圳市燃气集团股份有限公司 | RTU data acquisition method for gas industry |
| CN112290737A (en) * | 2020-11-03 | 2021-01-29 | 电子科技大学 | Environmental energy collector and early warning system and application method thereof |
| CN112306010A (en) * | 2019-07-31 | 2021-02-02 | 北京国双科技有限公司 | Data processing method and device |
| CN112419539A (en) * | 2019-08-23 | 2021-02-26 | 北京车和家信息技术有限公司 | Vehicle data acquisition method and device, cloud server and vehicle |
| CN112559520A (en) * | 2020-12-11 | 2021-03-26 | 珠海格力电器股份有限公司 | Data transmission method and system and air-conditioning group data transmission equipment |
| CN112784208A (en) * | 2021-01-19 | 2021-05-11 | 深圳市紫衡技术有限公司 | Building energy consumption calculation method and system, electronic equipment and storage medium |
| CN112860703A (en) * | 2021-03-04 | 2021-05-28 | 珠海格力电器股份有限公司 | Data processing method and device, energy information gateway and energy internet system |
| CN116644351A (en) * | 2023-06-13 | 2023-08-25 | 石家庄学院 | Data processing method and system based on artificial intelligence |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102568185A (en) * | 2012-02-01 | 2012-07-11 | 高鹤 | Building energy-saving monitoring data acquisition device |
| US20120197852A1 (en) * | 2011-01-28 | 2012-08-02 | Cisco Technology, Inc. | Aggregating Sensor Data |
| CN102638578A (en) * | 2012-03-29 | 2012-08-15 | 深圳市高正软件有限公司 | Data synchronization method and data synchronization system based on mobile devices |
| CN103369043A (en) * | 2013-07-11 | 2013-10-23 | 山东省计算中心 | Building heat loss data supplementing method based on wireless sensor network |
| CN103530825A (en) * | 2012-07-04 | 2014-01-22 | 广州科创节能科技服务有限公司 | Building energy consumption monitoring software system and realization method |
| CN106559431A (en) * | 2016-12-02 | 2017-04-05 | 北京奇虎科技有限公司 | A kind of visual analysis method and device for automotive safety detection |
| KR101744892B1 (en) * | 2016-03-17 | 2017-06-09 | 주식회사 젠시스템즈 | System and method for data searching using time series tier indexing |
-
2017
- 2017-07-31 CN CN201710640934.5A patent/CN107404483A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120197852A1 (en) * | 2011-01-28 | 2012-08-02 | Cisco Technology, Inc. | Aggregating Sensor Data |
| CN102568185A (en) * | 2012-02-01 | 2012-07-11 | 高鹤 | Building energy-saving monitoring data acquisition device |
| CN102638578A (en) * | 2012-03-29 | 2012-08-15 | 深圳市高正软件有限公司 | Data synchronization method and data synchronization system based on mobile devices |
| CN103530825A (en) * | 2012-07-04 | 2014-01-22 | 广州科创节能科技服务有限公司 | Building energy consumption monitoring software system and realization method |
| CN103369043A (en) * | 2013-07-11 | 2013-10-23 | 山东省计算中心 | Building heat loss data supplementing method based on wireless sensor network |
| KR101744892B1 (en) * | 2016-03-17 | 2017-06-09 | 주식회사 젠시스템즈 | System and method for data searching using time series tier indexing |
| CN106559431A (en) * | 2016-12-02 | 2017-04-05 | 北京奇虎科技有限公司 | A kind of visual analysis method and device for automotive safety detection |
Cited By (27)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107911472A (en) * | 2017-12-01 | 2018-04-13 | 德阳源创能源科技有限公司 | Data processing method and device |
| CN108196797B (en) * | 2018-01-26 | 2021-01-05 | 江苏财会职业学院 | Data processing system based on cloud computing |
| CN108196797A (en) * | 2018-01-26 | 2018-06-22 | 江苏财会职业学院 | A kind of data processing system based on cloud computing |
| CN108063775A (en) * | 2018-02-13 | 2018-05-22 | 广州云湾信息技术有限公司 | Communication protocol compatibility method, apparatus and system |
| CN108595120A (en) * | 2018-04-11 | 2018-09-28 | 广东电网有限责任公司 | A kind of scada near-realtime datas storage method and system |
| CN109246210A (en) * | 2018-08-29 | 2019-01-18 | 山东网智物联网科技有限公司 | Internet of Things communication means and device |
| CN109246210B (en) * | 2018-08-29 | 2021-05-04 | 山东网智物联网科技有限公司 | Internet of things communication method and device |
| CN109660608A (en) * | 2018-12-07 | 2019-04-19 | 上海明牛云科技有限公司 | Data acquisition and transmission method, device and equipment based on local datastore |
| CN109979027A (en) * | 2019-02-20 | 2019-07-05 | 钛马信息网络技术有限公司 | A kind of processing method of vehicle status data, device, equipment and medium |
| CN110212519B (en) * | 2019-05-23 | 2023-04-07 | 山西金晖隆开关股份有限公司 | Data processing method for medium and low voltage distribution network |
| CN110212519A (en) * | 2019-05-23 | 2019-09-06 | 山西金晖隆开关有限公司 | Data processing method for low and medium voltage distribution network |
| CN112306010A (en) * | 2019-07-31 | 2021-02-02 | 北京国双科技有限公司 | Data processing method and device |
| CN112419539A (en) * | 2019-08-23 | 2021-02-26 | 北京车和家信息技术有限公司 | Vehicle data acquisition method and device, cloud server and vehicle |
| CN110718052A (en) * | 2019-10-21 | 2020-01-21 | 上海米尺网络技术有限公司 | Wireless acquisition device and data acquisition method |
| CN111078720A (en) * | 2019-11-06 | 2020-04-28 | 中国科学院计算机网络信息中心 | Identification-based entity object and data object association method and system |
| CN110958158B (en) * | 2019-11-22 | 2022-02-25 | 百倍云(无锡)智能装备有限公司 | Internet of things platform communication evaluation method |
| CN110958158A (en) * | 2019-11-22 | 2020-04-03 | 江苏百倍云信息科技有限公司 | Internet of things platform communication evaluation method |
| CN111524341B (en) * | 2020-03-19 | 2020-11-17 | 深圳市燃气集团股份有限公司 | RTU data acquisition method for gas industry |
| CN111524341A (en) * | 2020-03-19 | 2020-08-11 | 深圳市燃气集团股份有限公司 | RTU data acquisition method for gas industry |
| CN112290737A (en) * | 2020-11-03 | 2021-01-29 | 电子科技大学 | Environmental energy collector and early warning system and application method thereof |
| CN112559520A (en) * | 2020-12-11 | 2021-03-26 | 珠海格力电器股份有限公司 | Data transmission method and system and air-conditioning group data transmission equipment |
| CN112784208A (en) * | 2021-01-19 | 2021-05-11 | 深圳市紫衡技术有限公司 | Building energy consumption calculation method and system, electronic equipment and storage medium |
| CN112784208B (en) * | 2021-01-19 | 2023-08-15 | 深圳市紫衡技术有限公司 | Building energy consumption calculation method, system, electronic equipment and storage medium |
| CN112860703A (en) * | 2021-03-04 | 2021-05-28 | 珠海格力电器股份有限公司 | Data processing method and device, energy information gateway and energy internet system |
| WO2022183739A1 (en) * | 2021-03-04 | 2022-09-09 | 珠海格力电器股份有限公司 | Data processing method and apparatus, energy information gateway, and internet of energy system |
| CN116644351A (en) * | 2023-06-13 | 2023-08-25 | 石家庄学院 | Data processing method and system based on artificial intelligence |
| CN116644351B (en) * | 2023-06-13 | 2024-04-02 | 石家庄学院 | Data processing method and system based on artificial intelligence |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107404483A (en) | Data processing method, device and data collecting system | |
| CN105790441B (en) | A kind of intelligent substation relay protection cruising inspection system | |
| CN104112345B (en) | data monitoring method of remote wireless meter reading system | |
| US20170078770A1 (en) | Collection of Telemetry Data Through A Meter Reading System | |
| WO2010057631A2 (en) | Measurement device, particularly energy counter and method for recognition of manipulations | |
| CN104168148A (en) | Multi-interface data collecting device and method | |
| CN110786021B (en) | Method and system for collecting sensor data | |
| CN101699298A (en) | One-phase digital current/voltage measuring instrument and measuring method thereof | |
| CN111830350B (en) | Energy consumption metering method and device and electric appliance | |
| CN109450094A (en) | A kind of substation relay protection method for inspecting and system | |
| KR101662705B1 (en) | Apparatus for verifying and managing of consumption electric power data in a green home electric power management system and method thereof | |
| CN103107914A (en) | Detection method and detection system for remote power acquisition terminal | |
| CN103605326A (en) | Real-time on-line energy monitoring and management system and energy management and optimization method | |
| CN102668454A (en) | A method of and an operating support system for providing performance management in a mobile telecommunications system | |
| CN207219047U (en) | The managing device and system of instrument and equipment | |
| CN106205093A (en) | A kind of environmental monitoring system based on wireless sensor network | |
| CN104392603B (en) | A kind of live power information collecting device intelligent diagnosis system | |
| CN103676669B (en) | The check method of a kind of telecontrol information and nucleus correcting system | |
| CN105379304A (en) | Data network management system, data network management device, data processing device, and data network management method | |
| US11770644B2 (en) | Modular data concentrator device for public utility metering systems and method for gathering and managing information | |
| CN107783073A (en) | Electric Energy Tariff Point Metering Device operation management system, data acquisition and alarm method | |
| CN106790474A (en) | A kind of energy data real-time acquisition system and acquisition method | |
| CN105678456B (en) | Method and system for automatically evaluating running state of electric energy metering device | |
| CN103499802A (en) | Transformer substation meter monitoring method and system | |
| CN104992288A (en) | Building energy consumption monitoring information system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171128 |