CN109218277A - A kind of multi-protocol data acquisition method and device - Google Patents
A kind of multi-protocol data acquisition method and device Download PDFInfo
- Publication number
- CN109218277A CN109218277A CN201710828904.7A CN201710828904A CN109218277A CN 109218277 A CN109218277 A CN 109218277A CN 201710828904 A CN201710828904 A CN 201710828904A CN 109218277 A CN109218277 A CN 109218277A
- Authority
- CN
- China
- Prior art keywords
- data
- data acquisition
- protocol
- protocol data
- unitized processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/18—Multiprotocol handlers, e.g. single devices capable of handling multiple protocols
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/566—Grouping or aggregating service requests, e.g. for unified processing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Computer And Data Communications (AREA)
Abstract
The invention discloses a kind of multi-protocol data acquisition methods, comprising: data collection steps, the data communication protocol according to used in automation equipment select corresponding data communication protocol to be acquired the data of the automation equipment；Unitized processing step carries out unitized processing to the data format of data collected, obtains data after unitized processing, wherein data have unified data format after the unitized processing.In addition, the invention also discloses a kind of multi-protocol data acquisition device, multi-protocol data acquisition system and storage mediums.
Description
Technical field
The present invention relates to data acquisition and technical field of data processing, in particular to a kind of multi-protocol data acquisition technologies.
Background technique
It is conventionally manufactured be transformed into intelligence manufacture during, numerically-controlled machine tool, robot, intelligent automobile, unmanned plane etc. number
Control equipment and system have become for manufacturing equipment most basic in manufacturing industry.Above-mentioned numerical control device is often mentioned by multiple producers
For without open not consistent, the acquisition real-time of communication interface, interaction protocol and Various types of data of homologous ray
It has differences, causes enterprise that must use different data acquisition plans to inhomogeneous numerical control device, or even due to different portions
It to the demand difference of same class data between door, also needs using different data collection and storage mode, so this all kinds of at present
" privatization " of data information, it is opaque, demand is various the features such as, form with practical application be guiding various industrial datas
The phenomenon that acquisition scheme is isolated and deposited leads to the management of numerical control device still so that above-mentioned field has a large amount of " information island "
It is so in discrete state, an organic whole can not be formed.
In response to the above problems, CN206115681U discloses a kind of multi-protocol data acquisition device, which uses
Several samplers are acquired the data of different agreement, only by multiple samplings for being used for the acquisition of different agreement data
Device is simply integrated, however it remains enterprise must use different data acquisition plans to inhomogeneous numerical control device, respectively
Kind industrial data collection scheme is still isolated and deposits.Therefore, multi-protocol data acquisition device disclosed in CN206115681U is still
Above-mentioned field can not so be solved and there is a large amount of " information island ", the management of numerical control device is caused to be still within discrete state, nothing
Method forms the technical issues of organic whole.
Summary of the invention
Aiming at the above defects or improvement requirements of the prior art, the present invention provides a kind of multi-protocol data acquisition method,
It include: data collection steps, the data communication protocol according to used in automation equipment selects corresponding data communication protocol pair
The data of the automation equipment are acquired；Unitized processing step, unitizes to the data format of acquired data
Processing obtains data after unitized processing, wherein data have unified data format after the unitized processing.Using above-mentioned
Embodiment can make same data acquisition equipment support the data acquisition of various protocols, can be to different numbers with realization
According to the progress data acquisition of the automatic equipment such as numerically-controlled machine tool, robot and other automatic equipments of communication protocol, and on
The data format for stating the data in embodiment carries out unitized processing, to further improve the compatibility of data acquisition.
Preferably, the multi-protocol data acquisition method further include: data after the unitized processing are written intermediate
Cache database is backed up.
Preferably, the multi-protocol data acquisition method further include: pre-treatment step, to number after the unitized processing
According to being pre-processed, data after being pre-processed.Data collected are pre-processed, the matter of data acquisition is substantially increased
Amount.
Preferably, the multi-protocol data acquisition method further include: intermediate buffer is written into data after the pretreatment
Database.Pretreated data are uniformly placed in intermediate buffer database and are stored, can be visited by network layer or directly
Ask that the mode of intermediate buffer database reads the data of high quality.
Preferably, in the pre-treatment step, data after the unitized processing are cleared up.
Preferably, in the pre-treatment step, the abnormal data in data after the unitized processing is cleared up.
Preferably, data check is carried out to data after the unitized processing, data are after determining the unitized processing
It is no to there is mistake and/or loss of data.
Preferably, if it is determined that data have mistake and/or loss of data after the unitized processing, then to the unification
Data provide the label there are error in data or loss after change processing.
Preferably, in the pre-treatment step, according to the integrality of message sequence stamp and the continuity of timestamp to institute
Data are verified after stating unitized processing.
Preferably, in the pre-treatment step, data after the unitized processing are corrected.
Preferably, in the pre-treatment step, those in data after the unitized processing are located in the intended manner
Obvious illogical data are managed to be corrected.
Preferably, in the pre-treatment step, data after the unitized processing are repaired.
Preferably, data are repaired after the unitized processing discontinuous to the time.
Preferably, in the pre-treatment step, data after the unitized processing are carried out looking into value.
Preferably, in the pre-treatment step, the characteristic value of data after the unitized processing is calculated.
Preferably, the characteristic value includes virtual value, standard deviation, average value, the coefficient of variation, the coefficient of skewness and coefficient of kurtosis
One of or it is a variety of.
Preferably, the multi-protocol data acquisition method further include: check that multi-protocol data acquisition device is in offline
State or working condition.
Preferably, the multi-protocol data acquisition method further include: receive self-defining data communication protocol.The embodiment party
Formula to use when nonstandardized technique data communication protocol used in automation equipment is not present in multi-protocol data acquisition device
Family can be added to multi-protocol data acquisition dress by self-defining data communication protocol, and by above-mentioned self-defining data communication protocol
It sets, so that multi-protocol data acquisition device is more compatible.
The present invention also provides a kind of multi-protocol data acquisition devices, comprising: at least one processor, it is described at least one
Reason device is able to carry out following operation: the data communication protocol according to used in automation equipment selects corresponding data communication to assist
View is acquired the data of the automation equipment；Unitized processing is carried out to the data format of acquired data, is united
Data after one change processing, wherein data have unified data format after the unitized processing.
Preferably, at least one described processor can also proceed as follows: data after the unitized processing are write
Enter intermediate buffer database to be backed up.
Preferably, at least one described processor can also proceed as follows: to data after the unitized processing into
Row pretreatment, data after being pre-processed.
Preferably, at least one described processor can also proceed as follows: by after the pretreatment data write-in in
Between cache database.
Preferably, at least one described processor can also proceed as follows: to data after the unitized processing into
Row cleaning.
Preferably, at least one described processor can also proceed as follows: in data after the unitized processing
Abnormal data cleared up.
Preferably, at least one described processor can also proceed as follows: to data after the unitized processing into
Row data check, data are with the presence or absence of mistake and/or loss of data after determining the unitized processing.
Preferably, at least one described processor can also proceed as follows: if it is determined that after the unitized processing
There is mistake and/or loss of data in data, then provide the mark there are error in data or loss to data after the unitized processing
Note.
Preferably, at least one described processor can also proceed as follows: according to message sequence stamp integrality and
The continuity of timestamp verifies data after the unitized processing.
Preferably, at least one described processor can also proceed as follows: to data after the unitized processing into
Row is corrected.
Preferably, at least one described processor can also proceed as follows: in data after the unitized processing
Those handle obvious illogical data in the intended manner and are corrected.
Preferably, at least one described processor can also proceed as follows: to data after the unitized processing into
Row repairing.
Preferably, at least one described processor can also proceed as follows: discontinuous to the time described unitized
Data are repaired after processing.
Preferably, at least one described processor can also proceed as follows: to data after the unitized processing into
Row looks into value.
Preferably, at least one described processor can also proceed as follows: to data after the unitized processing
Characteristic value is calculated.
Preferably, the characteristic value includes virtual value, standard deviation, average value, the coefficient of variation, the coefficient of skewness and coefficient of kurtosis
One of or it is a variety of.
Preferably, at least one described processor can also proceed as follows: check at multi-protocol data acquisition device
In off-line state or working condition.
Preferably, at least one described processor can also proceed as follows: receive self-defining data communication protocol.
Further, the present invention also provides a kind of multi-protocol data acquisition systems, comprising: multi-protocol data as described above
Acquisition device；Server passes through access institute for storing the multi-protocol data acquisition device data collected, and for user
It states server and reads the data.
Preferably, there are the server data to send service module and the readable service module of data, to provide to external
Data service.
Further, the present invention also provides a kind of storage medium, storage make at least one processor be able to carry out as
The program of the upper method.
Multi-protocol data acquisition technology of the invention can be adapted for the different enterprises and factory with different communication protocol
Family carries out data acquisition, improves distinct device or compatibility when system data acquisition, can be to distinct device or data source (such as
Sensor) data be acquired, and can according to actual needs, to system support agreement be extended.Of the invention is more
Protocol data acquisition technique carries out preliminary treatment to data by good program prepared in advance, when needing to use related data,
Network layer or intermediate buffer data base call treated data can directly be passed through.It is pre- that system is capable of providing general data
Processing service, realizes the function of data prediction, carries out data scrubbing to the data of acquisition, carries out data to the data after cleaning
Verification carries out data correction to the data after verification, and completes the work such as characteristic value calculating and status checkout using data.Net
Network layers can provide data and send service and the readable service of data, can provide data to external other application system.The frame
Frame has open and expandability, can provide support for the data prediction task under different background.Multi-protocols of the invention
Data acquisition technology can not only be acquired data by standardized agreement, can carry out data with custom protocol and adopt
Collection.
Detailed description of the invention
Fig. 1 is the structural schematic diagram of the multi-protocol data acquisition system of an embodiment of the present invention；
Fig. 2 is the structural block diagram of the data acquisition equipment of an embodiment of the present invention；
Fig. 3 is the structural block diagram of an embodiment of the present invention multi-protocol data acquisition system；
Fig. 4 is the flow chart of an embodiment of the present invention multi-protocol data acquisition；
Fig. 5 is the flow chart that an embodiment of the present invention data acquisition equipment selects communication protocol；
Fig. 6 is the pretreated flow chart of an embodiment of the present invention data acquisition equipment.
Specific embodiment
In order to make the objectives, technical solutions, and advantages of the present invention clearer, with reference to the accompanying drawings and embodiments, right
The present invention is further elaborated.It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, and
It is not used in the restriction present invention.As long as in addition, technical characteristic involved in the various embodiments of the present invention described below
Not constituting a conflict with each other can be combined with each other.
Fig. 1 is the structural schematic diagram of the multi-protocol data acquisition system of an embodiment of the present invention.As shown in Fig. 1, this hair
Bright multi-protocol data acquisition system includes: automation equipment 1, data acquisition equipment 2 and server 3, wherein above-mentioned automation
Carry out being in communication with each other connection respectively between equipment 1, above-mentioned data acquisition equipment 2 and above-mentioned server 3 so that relevant device it
Between be able to carry out data interaction.Above-mentioned communication connection includes but is not limited to the wire communications such as data line, computer communication network
One of communication, mobile communications network communication, radio frequency and bluetooth and other wireless communications etc. are any between them
Combination.
Above-mentioned automation equipment 1 can be the identical and/or different numerical control of multiple types with different communication protocol and set
Standby or system one or more.Wherein, all kinds of automation equipments can include but is not limited to numerically-controlled machine tool, machine tool, add
Work center, robot, intelligent automobile, unmanned plane etc., for example, all kinds of domestic automation equipments or system, FUNUC, SIEMENS,
Mazak etc..
Above-mentioned data acquisition equipment 2 can obtain each automatic from the above-mentioned automation equipment 1 with different communication protocol
Change the data such as process data of equipment, and data collected can be exported.Above-mentioned data acquisition equipment 2 can be one kind
Data acquisition box, PC, personal digital assistant (PDA), handheld computer, laptop computer, tablet computer, mobile electricity
Data collected can be transmitted on above-mentioned server 3 by words etc. by communicating to connect.
Above-mentioned server 3 can store above-mentioned data acquisition equipment 2 data collected, and pass through above-mentioned service for user
Device 3 reads and is further processed.Above-mentioned server 3 can be PC, handheld computer, laptop computer etc..
Fig. 2 is the structural block diagram of the data acquisition equipment of an embodiment of the present invention.As shown in Fig. 2, above-mentioned data acquisition
Equipment 2, mainly by including that CPU41, storage device 42, reading device 43 and communication interface 44 are constituted.CPU41, storage device 42,
Reading device 43 and communication interface 44 are connected with each other by bus 45, can receive and dispatch control signal and interaction data etc. mutually.
CPU41 can execute the computer program for being stored in storage device 42.
Storage device 42 stores the various computer programs for CPU41 execution and its executes used in the computer program
Data and each automation equipment collected the data such as process data.Multi-protocol data in present embodiment
Acquisition also is stored in this storage device 42 with application program 4a.
Reading device 43 is made of floppy drive, CD-ROM drive or DVD-ROM drive, USB interface etc., and storage can be read
In the computer program or data of pocket storage medium 4.Pocket storage medium 4 is stored with multi-protocol data acquisition application
Program 4a, above-mentioned data acquisition equipment 2 can read application program 4a from the pocket storage medium 4, be loaded into storage device
42。
Above-mentioned application program 4a can not only be provided by pocket storage medium 4, can also by electric communication line from this
It is downloaded in external mechanical that electric communication line (no matter wired, wireless) connects, being communicated with above-mentioned data acquisition equipment 2.
For example, above-mentioned application program 4a is stored in the hard disk of network server, above-mentioned data acquisition equipment 2 may have access to this server,
Application program 4a is downloaded, storage device 42 is packed into, application program 4a can also be read from USB flash disk by USB interface, be loaded into
Storage device 42.
It such as includes but is not limited to Ethernet (Ethernet, registered trademark) interface that communication interface 46, which can be,.Above-mentioned number
Certain communication protocol and above-mentioned automation equipment 1 and above-mentioned service can be used by the communication interface 44 according to acquisition equipment 2
Data are transmitted between device 3.
Multi-protocol data acquisition in storage device 42 is according to the number of being acquired with application program 4a major function
According to automation equipment 1 communication protocol carry out data acquisition and processing (DAP).
Fig. 3 is the structural block diagram of an embodiment of the present invention multi-protocol data acquisition system.As shown in figure 3, above-mentioned more associations
Discussing data collection system includes automation equipment 21 (i.e. automation equipment 1), data acquisition module 22, uniform data source module
23, data preprocessing module 24, intermediate buffer database 25, network layer 26 and outbound data interface 27.Wherein, above-mentioned data
Acquisition module 22, uniform data source module 23, data preprocessing module 24 and intermediate buffer database 25 can integrate above-mentioned
In data acquisition equipment 2；Above-mentioned network layer 26 can be such as local area network (Intranet), including above-mentioned server 3, and wherein data are sent out
Service module 261 and the readable service module 262 of data is sent to be arranged in above-mentioned server 3；Above-mentioned outbound data interface 27 can
To include XML/JSON file 29 and other application system interface 30 etc..
Above-mentioned automation equipment 21 can be the identical and/or different automation of multiple types with different communication protocol
The one or more of equipment.For example, it is Central China numerical control system, FUNUC (Fa Nake) number that above-mentioned automation equipment 21, which can use,
Control system, SI EMENS (Siemens) digital control system, Mazak (Mazak) digital control system etc..The biography of above-mentioned automation equipment 21
The sensor corresponding data of acquisition (not shown), and data collected are conveyed to above-mentioned data acquisition equipment.It is different types of
Automation equipment 21 may have different communication protocol acquisition data.For example, Central China numerical control system passes through customized agreement
It is logical that (8 type digital control system secondary development handbook of Central China) can acquire data, SI EMENS digital control system in Central China numerical control system
Cross the data latency in OPC UA communication protocol acquisition SI EMENS digital control system.
Above-mentioned data acquisition module 22 has multiple distributed communication agent modules, each communication agent module is corresponding
Modbus agreement, MTConnect communication agent are corresponded in different types of communication protocol, such as Modbus communication agent module
Module corresponds to MTConnect agreement, OPC UA communication agent module corresponds to OPC UA agreement, customized communication agent module is corresponding
Self-defining communication protocol etc. so that using different communication protocol above-mentioned automation equipment 21 data collection task different
It is carried out in communication agent module, i.e., system can be selected according to the difference of data source using suitable data acquisition protocol.It is above-mentioned
Data acquisition module 22 can have a variety of general standard communication protocols in the market, such as Modbus agreement, MTConnect association
View, OPC UA agreement etc., it is possible to have the customized communication protocol of user, such as used by Central China numerical control system it is customized
Agreement (8 type digital control system secondary development handbook of Central China).Above-mentioned data acquisition module 22 can integrate a variety of acquisition protocols, adopt
When collecting data, determine which kind of agreement to carry out data acquisition using by agreement (NCProtocol) field, such as: Central China numerical control
Custom protocol: 0；MTConnect:1；OPC UA agreement: 3.In present embodiment, do not deposited when in above-mentioned data acquisition module 22
Used in automation equipment 21 when nonstandardized technique data communication protocol, user can by self-defining data communication protocol,
And above-mentioned self-defining data communication protocol is added to above-mentioned data acquisition module 22, so that above-mentioned data acquisition equipment 2
It is more compatible.
Above-mentioned uniform data source module 23 be used for the data formats of above-mentioned data acquisition module 22 data collected into
The unitized processing of row, so that the data collected of above-mentioned data acquisition module 22 after processing have unified data format.
Above-mentioned uniform data source module 23 can be by providing a kind of general mode, such as can be united by the way of growth data
One data format.Timer has can be set in above-mentioned uniform data source module 23, and the mode of poll can be used by above-mentioned data
The data collected of acquisition module 22 are written in above-mentioned intermediate cache database 25, and data at this moment are backed up as source data
In above-mentioned intermediate cache database 25.
In the above-described embodiment, regardless of which kind of communication protocol is above-mentioned automation equipment 21 use, why is the data of generation
The data of kind format are transformed into the preset uniform data lattice of system after the processing of above-mentioned uniform data source module 23
Formula.
Above-mentioned data preprocessing module 24 has multiple distributed subprocessing modules, to through above-mentioned uniform data source module
23 it is unitized treated that data are pre-processed, and will treated that above-mentioned intermediate cache database 25 is written in data stores.
Above-mentioned subprocessing module include the data cleansing module that data are cleaned, the data check module that data are verified,
Data correction module that data are corrected, the data modification module that data are repaired, the number that data look into value
It is investigated that data the operation such as are cleaned, verify, correct, repair, look into value to realize by value module etc..Also, above-mentioned data are located in advance
Managing module 24 can also include customized processing module, can dynamically be extended to the processing mode of data as needed, from
Definition is to through above-mentioned uniform data source module 23, unitized treated that data pre-process.Above-mentioned data preprocessing module 24
By calling different subprocessing module to unitized treated that data pre-process through above-mentioned uniform data source module 23.
Above-mentioned data cleansing module can carry out abnormal data in above-mentioned data acquisition module 22 data collected clear
Reason.
Above-mentioned data check module can judge data, so that it is determined that above-mentioned data acquisition module 22 is acquired
Data with the presence or absence of mistake and/or loss of data.Preferably, integrality of the above-mentioned data check module according to message sequence stamp
Above-mentioned data acquisition module 22 data collected are verified with the continuity of timestamp.
Above-mentioned data correction module can handle in the intended manner those obvious illogical above-mentioned data acquisition
The data collected of module 22 are corrected.
Above-mentioned data modification module being capable of the progress of above-mentioned data acquisition module 22 discontinuous to time data collected
Data modification.
Above-mentioned data are looked into value module and can be calculated the characteristic value of above-mentioned data acquisition module 22 data collected.
Preferably, above-mentioned data look into value module can virtual value to above-mentioned data acquisition module 22 data collected, standard deviation, flat
The characteristic values such as mean value, the coefficient of variation, the coefficient of skewness, coefficient of kurtosis are calculated.
From above-mentioned intermediate cache database 25 is used to unitize from the reception of above-mentioned uniform data source module 23 through data format
Data after reason, and storage is backed up as source data, and for receiving from above-mentioned data preprocessing module 24 through above-mentioned
Treated the data of data preprocessing module 24, and stored.Above-mentioned intermediate cache database 25 is by the data format of acquisition
Unitized treated source data and pretreated data carry out unified storage, and pretreated data are written one by one
Corresponding database (not shown) in above-mentioned server 3.Above-mentioned intermediate cache database 25 can also pass through SD card or U disk etc.
File service interface 31 allows unitized treated the source data of above-mentioned data format and pretreated data to be read into for example
On the external world such as SD card or USB flash disk storage medium.
Above-mentioned network layer 26 can send service module 261 and the readable service of data by the data in above-mentioned server 3
Module 262 provides data service to external.
Above-mentioned outbound data interface 27 can be by pretreated data from above-mentioned network layer 26 or above-mentioned intermediate buffer
Database 25 is supplied to external call in the form of data-interface, or by external reading data to the above-mentioned of above-mentioned network layer 26
In server 3 or above-mentioned intermediate cache database 25, wherein the file of above-mentioned outbound data interface 27 can be XML file,
The file of JSON file or extended formatting can define data requirements format according to demand in advance.
In the above-described embodiment, it is preferable that above-mentioned data acquisition module 22 can also include the inspection of data acquisition state
Module is checked for the data acquisition state to above-mentioned data acquisition equipment 2.For example, above-mentioned data acquisition state inspection
Module can check that above-mentioned data acquisition equipment 2 is in off-line state or working condition etc..
Fig. 4 is the flow chart of an embodiment of the present invention multi-protocol data acquisition.As shown in figure 4, above-mentioned automation equipment
The 21 sensor acquisition corresponding operating parameter of above-mentioned automation equipment 21 (not shown), generates the number of above-mentioned automation equipment 21
According to (step S1).Above-mentioned data acquisition module 22 data communication protocol according to used in above-mentioned automation equipment 21 selects phase
The communication protocol answered is acquired (step S2) to the data of above-mentioned automation equipment 21.
Above-mentioned uniform data source module 23 unites to the data format of above-mentioned data acquisition module 22 data collected
One change processing, so that the data collected of above-mentioned data acquisition module 22 after processing have unified data format (step
S3)。
24 pairs of above-mentioned data preprocessing module is through unitized treated the number of above-mentioned 23 data format of uniform data source module
Above-mentioned intermediate cache database 25 (step S4) is written according to being pre-processed, and by pretreated data.Meanwhile above-mentioned system
One data source modules 23 will unitized treated that above-mentioned intermediate cache database 25 is written in source data carries out by data format
It backs up (step S5).Above-mentioned intermediate cache database 25 receives above-mentioned pretreated data and above-mentioned data format is unitized
Treated, and source data is stored (step S6)
The upper of above-mentioned network layer 26 is written in the above-mentioned pretreated data stored by above-mentioned intermediate cache database 25
It states in server 3 in corresponding database (step S7).When the corresponding data information of user's request, above-mentioned server 3
In data send service module 261 and the readable service module 262 of data and provide above-mentioned pretreated data to number to outside
According to.
Fig. 5 is the flow chart that an embodiment of the present invention data acquisition equipment selects communication protocol.It is above-mentioned as shown in Fig. 5
The above-mentioned data acquisition module 22 of data acquisition equipment 2 determines the communication protocol type (step of above-mentioned automation equipment 21
S21), judge whether above-mentioned data acquisition equipment 2 is integrated with corresponding communication protocol (step S22).If above-mentioned data acquisition
Equipment 2 is integrated with corresponding communication protocol (step S22: yes), and corresponding communication agent module is selected to utilize the corresponding communication
Agreement carries out data acquisition (step S23).For example, above-mentioned automation equipment 21 uses the customized communication protocols of Central China numerical control system
View then selects the customized communication agent module to carry out data acquisition using the self-defining communication protocol；Alternatively, above-mentioned automation
Equipment 21 is the Siemens CNC lathe using OPC UA agreement, then OPC UA communication agent module is selected to utilize OPC UA agreement
Carry out data acquisition.If above-mentioned data acquisition equipment 2 does not integrate corresponding communication protocol (step S22: no), terminate this
Secondary data acquire (step S24).
Fig. 6 is the pretreated flow chart of an embodiment of the present invention data acquisition equipment.As shown in fig. 6, above-mentioned data are adopted
Collect the above-mentioned data preprocessing module 24 of equipment 2 after the unitized processing of above-mentioned uniform data source module 23 reception data format
Data (step S41), (step S42) is cleared up to received data.In step S42, such as abnormal data is cleared up
Etc. data.
Above-mentioned data preprocessing module 24 carries out data check (step S43) to received data.In step S43,
Above-mentioned data preprocessing module 24 judges received data, so that it is determined that received data with the presence or absence of mistake or
It is loss of data.If it is determined that received data has mistake or loss of data, then received data is provided and connect
The label that the data of receipts have mistake and/or lose.Preferably, in step S43, according to message sequence stamp integrality and when
Between the continuity stabbed received data is verified.
Above-mentioned data preprocessing module 24 is corrected (step S44) to received data.It is above-mentioned in step S44
Data preprocessing module 24 handles in the intended manner those in received data obvious illogical data and entangles
Just.
Above-mentioned data preprocessing module 24 is repaired (step S45) to received data.It is above-mentioned in step S45
Data preprocessing module 24 repairs time discontinuous received data.
Above-mentioned data preprocessing module 24 carries out received data to look into value (step S46).It is above-mentioned in step S46
Data preprocessing module 24 calculates the characteristic value of received data.Preferably, above-mentioned data preprocessing module 24 is right
The characteristic values such as virtual value, standard deviation, average value, the coefficient of variation, the coefficient of skewness, the coefficient of kurtosis of received data are counted
It calculates.
In the above-described embodiment, in the flow chart of multi-protocol data acquisition shown in Fig. 4, advanced line number Data preprocess
Then source data is written above-mentioned intermediate cache database 25 and is backed up (step S5) by (step S4), this is intended merely to describe
Convenience, the present invention is not limited only to this, above-mentioned intermediate cache database 25 first can also be written in source data and backed up, then
Carry out data prediction perhaps above-mentioned backup and above-mentioned data prediction carry out simultaneously or only progress data prediction not into
Row backup.
In the above-described embodiment, in the pretreated flow chart of data acquisition equipment shown in Fig. 6, about data cleansing
(step S42), data check (step S43), data correction (step S44), data modification (step S45), data look into value (step
Rapid S46) etc. pretreatment operations, be hereinbefore described by according to priority, but be not intended to aforesaid operations by description sequence into
Row.Above-mentioned operation can be carried out each independently with any sequence, be also possible to carry out simultaneously.
In the present invention, user can step on according to the difference of permission from the network layer 26 of for example, Intranet or local area network
Above-mentioned server 3 is recorded to obtain source data and/or pretreated data, it can also be directly from above-mentioned intermediate cache database 25
Obtain source data and/or pretreated data.
As it will be easily appreciated by one skilled in the art that the foregoing is merely illustrative of the preferred embodiments of the present invention, not to
The limitation present invention, any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should all include
Within protection scope of the present invention.
Claims (39)
1. a kind of multi-protocol data acquisition method, comprising:
Data collection steps, the data communication protocol according to used in automation equipment select corresponding data communication protocol pair
The data of the automation equipment are acquired；
Unitized processing step carries out unitized processing to the data format of acquired data, obtains data after unitized processing,
Wherein data have unified data format after the unitized processing.
2. multi-protocol data acquisition method according to claim 1, further includes: data after the unitized processing are written
Intermediate buffer database is backed up.
3. multi-protocol data acquisition method according to claim 1, further includes: pre-treatment step, to the unitized place
Data are pre-processed after reason, data after being pre-processed.
4. multi-protocol data acquisition method according to claim 3, further includes: data after the pretreatment are written intermediate
Cache database.
5. multi-protocol data acquisition method according to claim 3, which is characterized in that right in the pre-treatment step
Data are cleared up after the unitized processing.
6. multi-protocol data acquisition method according to claim 5, which is characterized in that right in the pre-treatment step
Abnormal data after the unitized processing in data is cleared up.
7. according to multi-protocol data acquisition method described in claim 3~6 any one, which is characterized in that at the pre- place
It manages in step, data check is carried out to data after the unitized processing, data whether there is after determining the unitized processing
Mistake and/or loss of data.
8. multi-protocol data acquisition method according to claim 7, which is characterized in that if it is determined that the unitized processing
Afterwards there is mistake and/or loss of data in data, then data after the unitized processing are provided with there are error in data or loss
Label.
9. multi-protocol data acquisition method according to claim 7, which is characterized in that in the pre-treatment step, according to
Data after the unitized processing are verified according to the integrality of message sequence stamp and the continuity of timestamp.
10. according to multi-protocol data acquisition method described in claim 3~6 any one, which is characterized in that at the pre- place
It manages in step, data after the unitized processing is corrected.
11. multi-protocol data acquisition method according to claim 10, which is characterized in that in the pre-treatment step,
Obvious illogical data are handled in the intended manner to those in data after the unitized processing to correct.
12. according to multi-protocol data acquisition method described in claim 3~6 any one, which is characterized in that at the pre- place
It manages in step, data after the unitized processing is repaired.
13. multi-protocol data acquisition method according to claim 12, which is characterized in that the system discontinuous to the time
Data are repaired after one change processing.
14. according to multi-protocol data acquisition method described in claim 3~6 any one, which is characterized in that at the pre- place
It manages in step, data after the unitized processing is carried out looking into value.
15. multi-protocol data acquisition method according to claim 14, which is characterized in that in the pre-treatment step,
The characteristic value of data after the unitized processing is calculated.
16. multi-protocol data acquisition method according to claim 15, which is characterized in that the characteristic value includes effective
One of value, standard deviation, average value, the coefficient of variation, the coefficient of skewness and coefficient of kurtosis are a variety of.
17. multi-protocol data acquisition method described in any one according to claim 1~6, further includes: acquisition state inspection step
Suddenly, check that multi-protocol data acquisition device is in off-line state or working condition.
18. multi-protocol data acquisition method described in any one according to claim 1~6, further includes: receive self-defining data
Communication protocol.
19. a kind of multi-protocol data acquisition device, comprising: at least one processor, at least one described processor are able to carry out
Following operation:
The data communication protocol according to used in automation equipment selects corresponding data communication protocol to the automation equipment
Data be acquired；
Unitized processing is carried out to the data format of acquired data, obtains data after unitized processing, wherein described unitized
Data have unified data format after processing.
20. multi-protocol data acquisition device according to claim 19, which is characterized in that at least one described processor is also
It is able to carry out following operation: data write-in intermediate buffer database after the unitized processing is backed up.
21. multi-protocol data acquisition device according to claim 19, which is characterized in that at least one described processor is also
It is able to carry out following operation: data after the unitized processing being pre-processed, data after being pre-processed.
22. multi-protocol data acquisition device according to claim 21, which is characterized in that at least one described processor is also
It is able to carry out following operation: intermediate buffer database is written into data after the pretreatment.
23. multi-protocol data acquisition device according to claim 21, which is characterized in that at least one described processor is also
It is able to carry out following operation: data after the unitized processing is cleared up.
24. multi-protocol data acquisition device according to claim 23, which is characterized in that at least one described processor is also
It is able to carry out following operation: the abnormal data in data after the unitized processing is cleared up.
25. according to multi-protocol data acquisition device described in claim 21~24 any one, which is characterized in that it is described at least
One processor can also proceed as follows: carrying out data check to data after the unitized processing, determine the unification
Data are with the presence or absence of mistake and/or loss of data after change processing.
26. multi-protocol data acquisition device according to claim 25, which is characterized in that at least one described processor is also
It is able to carry out following operation: if it is determined that data have mistake and/or loss of data after the unitized processing, then to the system
Data provide the label there are error in data or loss after one change processing.
27. multi-protocol data acquisition device according to claim 25, which is characterized in that at least one described processor is also
It is able to carry out following operation: according to the integrality of message sequence stamp and the continuity of timestamp to data after the unitized processing
It is verified.
28. according to multi-protocol data acquisition device described in claim 21~24 any one, which is characterized in that it is described at least
One processor can also proceed as follows: correct to data after the unitized processing.
29. multi-protocol data acquisition device according to claim 28, which is characterized in that at least one described processor is also
It is able to carry out following operation: obvious illogical number is handled in the intended manner to those in data after the unitized processing
According to being corrected.
30. according to multi-protocol data acquisition device described in claim 21~24 any one, which is characterized in that it is described at least
One processor can also proceed as follows: repair to data after the unitized processing.
31. multi-protocol data acquisition device according to claim 30, which is characterized in that at least one described processor is also
Be able to carry out following operation: data are repaired after the unitized processing discontinuous to the time.
32. according to multi-protocol data acquisition device described in claim 21~24 any one, which is characterized in that it is described at least
One processor can also proceed as follows: carry out looking into value to data after the unitized processing.
33. multi-protocol data acquisition device according to claim 32, which is characterized in that at least one described processor is also
It is able to carry out following operation: the characteristic value of data after the unitized processing is calculated.
34. multi-protocol data acquisition device according to claim 33, which is characterized in that the characteristic value includes effective
One of value, standard deviation, average value, the coefficient of variation, the coefficient of skewness and coefficient of kurtosis are a variety of.
35. multi-protocol data acquisition device described in 9~34 any one according to claim 1, which is characterized in that it is described at least
One processor can also proceed as follows: check that multi-protocol data acquisition device is in off-line state or working condition.
36. multi-protocol data acquisition device described in 9~34 any one according to claim 1, which is characterized in that it is described at least
One processor can also proceed as follows: receive self-defining data communication protocol.
37. a kind of multi-protocol data acquisition system, comprising:
Multi-protocol data acquisition device as described in claim 19~36；
Server, for storing the multi-protocol data acquisition device data collected, and for user by accessing the clothes
Business device reads the data.
38. the multi-protocol data acquisition system according to claim 37, which is characterized in that the server is sent out with data
Service module and the readable service module of data are sent, to provide data service to external.
39. a kind of storage medium, storage makes at least one processor be able to carry out the program such as claim 1~18.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2017105521352 | 2017-07-07 | ||
| CN201710552135 | 2017-07-07 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109218277A true CN109218277A (en) | 2019-01-15 |
Family
ID=64991408
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710828904.7A Pending CN109218277A (en) | 2017-07-07 | 2017-09-14 | A kind of multi-protocol data acquisition method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109218277A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109799798A (en) * | 2019-01-23 | 2019-05-24 | 上海智共荟智能科技有限公司 | One kind being applied to industrial processing equipment large data sets into acquisition system and method |
| CN111427321A (en) * | 2020-04-17 | 2020-07-17 | 长春融成智能设备制造股份有限公司 | Multi-protocol-compatible MES data acquisition system and method thereof |
| CN111694828A (en) * | 2020-06-08 | 2020-09-22 | 山东伏羲智库互联网研究院 | Data processing method, device, system and storage medium |
| CN111914015A (en) * | 2020-08-25 | 2020-11-10 | 河北时代电子有限公司 | Multisource data gateway data analysis early warning system based on industrial protocol |
| CN116801128A (en) * | 2022-12-23 | 2023-09-22 | 慧之安信息技术股份有限公司 | Agricultural sensor data acquisition method and system based on OPC UA |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101853025A (en) * | 2009-03-31 | 2010-10-06 | 宝山钢铁股份有限公司 | Method and device for data acquisition and processing of multiple industrial-control system platforms |
| CN102915013A (en) * | 2012-10-19 | 2013-02-06 | 冶金自动化研究设计院 | Iron and steel enterprise quality information platform |
| CN103780689A (en) * | 2014-01-18 | 2014-05-07 | 苏州亿铂信息科技有限公司 | Automated production line equipment data acquisition method and system |
| CN104345717A (en) * | 2014-10-17 | 2015-02-11 | 武汉华大优能信息有限公司 | Intelligent remote data acquisition system based on Internet of Things |
| CN104426950A (en) * | 2013-08-28 | 2015-03-18 | 国家电网公司 | Electric power Internet of things intelligent communication method, system and gateway |
| CN105320085A (en) * | 2014-06-25 | 2016-02-10 | 中兴通讯股份有限公司 | Method, apparatus and system for acquiring industrial automation data |
| CN106534272A (en) * | 2016-10-21 | 2017-03-22 | 江苏方天电力技术有限公司 | System and method for processing parameters of coal-fired unit |
| CN106597991A (en) * | 2016-12-12 | 2017-04-26 | 北京兰光创新科技有限公司 | Numerically controlled machine tool remote monitoring method and device |
-
2017
- 2017-09-14 CN CN201710828904.7A patent/CN109218277A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101853025A (en) * | 2009-03-31 | 2010-10-06 | 宝山钢铁股份有限公司 | Method and device for data acquisition and processing of multiple industrial-control system platforms |
| CN102915013A (en) * | 2012-10-19 | 2013-02-06 | 冶金自动化研究设计院 | Iron and steel enterprise quality information platform |
| CN104426950A (en) * | 2013-08-28 | 2015-03-18 | 国家电网公司 | Electric power Internet of things intelligent communication method, system and gateway |
| CN103780689A (en) * | 2014-01-18 | 2014-05-07 | 苏州亿铂信息科技有限公司 | Automated production line equipment data acquisition method and system |
| CN105320085A (en) * | 2014-06-25 | 2016-02-10 | 中兴通讯股份有限公司 | Method, apparatus and system for acquiring industrial automation data |
| CN104345717A (en) * | 2014-10-17 | 2015-02-11 | 武汉华大优能信息有限公司 | Intelligent remote data acquisition system based on Internet of Things |
| CN106534272A (en) * | 2016-10-21 | 2017-03-22 | 江苏方天电力技术有限公司 | System and method for processing parameters of coal-fired unit |
| CN106597991A (en) * | 2016-12-12 | 2017-04-26 | 北京兰光创新科技有限公司 | Numerically controlled machine tool remote monitoring method and device |
Non-Patent Citations (1)
| Title |
|---|
| 锁刘佳: ""深水浮式平台集成监测技术研究"", 《中国优秀硕士学位论文全文数据库工程科技Ⅰ辑》 * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109799798A (en) * | 2019-01-23 | 2019-05-24 | 上海智共荟智能科技有限公司 | One kind being applied to industrial processing equipment large data sets into acquisition system and method |
| CN111427321A (en) * | 2020-04-17 | 2020-07-17 | 长春融成智能设备制造股份有限公司 | Multi-protocol-compatible MES data acquisition system and method thereof |
| CN111694828A (en) * | 2020-06-08 | 2020-09-22 | 山东伏羲智库互联网研究院 | Data processing method, device, system and storage medium |
| CN111914015A (en) * | 2020-08-25 | 2020-11-10 | 河北时代电子有限公司 | Multisource data gateway data analysis early warning system based on industrial protocol |
| CN116801128A (en) * | 2022-12-23 | 2023-09-22 | 慧之安信息技术股份有限公司 | Agricultural sensor data acquisition method and system based on OPC UA |
| CN116801128B (en) * | 2022-12-23 | 2024-09-27 | 慧之安信息技术股份有限公司 | Agricultural sensor data acquisition method and system based on OPC UA |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109218277A (en) | A kind of multi-protocol data acquisition method and device | |
| CN108549977B (en) | Multi-Agent-based order-oriented flexible production dynamic scheduling system | |
| CN102549971B (en) | Network performance estimating apparatus, network performance estimating method, network structure recognizing method, communication managing apparatus, and data communication method | |
| EP3187951B1 (en) | Delivery of automated notifications by an industrial asset | |
| CN1725242B (en) | Method for solving transferred error in automatic material processing system | |
| CN201374004Y (en) | Industrial automation system and industrial controller system | |
| TW514771B (en) | Computer integrated manufacturing techniques | |
| CN104339355B (en) | The management method of robot system, robot supervisory computer and robot system | |
| CN104049579A (en) | Background collection of diagnostic data from field instrumentation devices | |
| CN109993541A (en) | A kind of method, apparatus that smart machine independently reports for repairment, server and storage medium | |
| US9092958B2 (en) | Alarm processing systems and methods | |
| JP2012038304A (en) | Automatic reception, inspection, stock management and report using wireless communication | |
| CN104339353A (en) | Robot system, production management computer, and method of controlling production management computer | |
| JP2018063541A (en) | Management apparatus, management system, management method and computer program | |
| US12047257B2 (en) | Systems and methods for automated verification and reconfiguration of disconnected network devices | |
| US20090256682A1 (en) | Product managing system and method using rfid technology | |
| Prist et al. | Cyber-physical manufacturing systems: An architecture for sensor integration, production line simulation and cloud services | |
| US7613535B2 (en) | Independent, self-contained, risk isolated, sectional CIM design for extremely large scale factory operation | |
| CN117455358A (en) | Tool priority ex-warehouse control method based on radio frequency reading technology | |
| CN102540873B (en) | Plant control system, data to be equalized selection apparatus, and data to be equalized selection method | |
| CN109213077A (en) | A kind of lathe reports method and system, lathe, server for repairment | |
| CN108156061A (en) | Esb monitoring service platforms | |
| CN109641410A (en) | Handle the method and system of optical lens | |
| Ganesh et al. | Digital Twin framework for material handling and logistics in Manufacturing: Part 1 | |
| CN110766356A (en) | Intelligent tool management method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190115 |