CN108959438A - A kind of collecting method and system, a kind of server - Google Patents
A kind of collecting method and system, a kind of server Download PDFInfo
- Publication number
- CN108959438A CN108959438A CN201810603695.0A CN201810603695A CN108959438A CN 108959438 A CN108959438 A CN 108959438A CN 201810603695 A CN201810603695 A CN 201810603695A CN 108959438 A CN108959438 A CN 108959438A
- Authority
- CN
- China
- Prior art keywords
- information
- data
- data information
- primary data
- primary
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The present embodiments relate to a kind of collecting methods and system, a kind of server.Wherein, this method comprises: obtaining to the corresponding primary data information of every control equipment, multiple primary data information are obtained, wherein the corresponding primary data information of a control equipment；The device data table being pre-created is written in each primary data information that will acquire；Conversion process is carried out to each primary data information, obtains multiple target data informations, the corresponding target data information of a primary data information.Cross the present embodiment provides: in each primary data information write device tables of data that will acquire, conversion process is carried out to each primary data information in device data table, obtain the technical solution of multiple target data informations, it avoids in the prior art using polling mechanism, it is time-consuming more, it is not able to satisfy the technology drawback of industrial Internet of Things and big data project acquisition demand, realizes the technical effect for having saved time and resource.
Description
Technical field
The present embodiments relate to industrial data collection technical field more particularly to a kind of collecting method and system,
A kind of server.
Background technique
With the development of industrial technology, the data volume for controlling equipment is increasing.It is understood that when data volume increases
When, then influence will receive on the speed of data acquisition, so that the speed decline of data acquisition, time-consuming increase.
As industrial Internet of Things arrives, it is desirable that data acquisition software system can connect more control equipment, so as to from
Data are acquired in a large amount of control equipment.Such as: the data for controlling equipment to thousands of are acquired.And most of industry at present
Acquisition software is only capable of tens control equipment of connection, and the mode of polling mechanism is mostly used to carry out the acquisition of data, and time-consuming is more,
It is not able to satisfy industrial Internet of Things and big data project acquisition demand.
Summary of the invention
In order to solve the above technical problems, the embodiment of the invention provides a kind of collecting methods and system, a kind of service
Device.
According to an aspect of an embodiment of the present invention, the embodiment of the invention provides a kind of collecting method, the sides
Method includes:
The corresponding primary data information of every control equipment is obtained, obtains multiple primary data information, wherein one
The corresponding primary data information of control equipment described in platform；
The device data table being pre-created is written in each primary data information that will acquire；
Conversion process is carried out to each primary data information, obtains multiple target data informations, wherein an institute
State the corresponding target data information of primary data information.
It provides through this embodiment: in each primary data information write device tables of data that will acquire, to number of devices
Conversion process is carried out according to each primary data information in table, the technical solution of multiple target data informations is obtained, avoids
Polling mechanism is used in the prior art, it is time-consuming more, it is not able to satisfy the technology of industrial Internet of Things and big data project acquisition demand
Drawback realizes the efficiency for improving data acquisition, has saved the technical effect of time and resource.
Other side according to an embodiment of the present invention, the embodiment of the invention provides a kind of servers, comprising: storage
Device, one or more processors, wherein
The memory is used for: storing one or more programs；
When one or more of programs are executed by one or more of processors, so that one or more of processing
Device realizes method as described above.
Other side according to an embodiment of the present invention, it is described the embodiment of the invention provides a kind of data collection system
System includes: monitoring device and many motors control equipment, wherein the monitoring device includes: data storage device, operation data
Library, data server and Duo Tai communicate driving device；
Every communication driving device is used to: the primary data information of the corresponding control equipment is acquired,
And the primary data information is transmitted to the data storage device；
The data storage device is used for: the primary data information is written to the device data table being pre-created；
The operation data library is used for: the primary data information is obtained from the device data table, and to described first
Beginning data information carries out conversion process, obtains target data information, and the target data information is sent to the data and is taken
Business device；
Wherein, the corresponding control equipment of a communication driving device.
Detailed description of the invention
Fig. 1 is a kind of flow diagram of collecting method provided in an embodiment of the present invention；
Fig. 2 is a kind of structural schematic diagram of data collection system provided in an embodiment of the present invention.
Specific embodiment
In being described below, for illustration and not for limitation, propose such as specific system structure, interface, technology it
The detail of class, to understand thoroughly the present invention.However, it will be clear to one skilled in the art that there is no these specific
The present invention also may be implemented in the other embodiments of details.In other situations, it omits to well-known system and method
Detailed description, in order to avoid unnecessary details interfere description of the invention.
The embodiment of the invention provides a kind of collecting methods and system, a kind of server.
According to an aspect of an embodiment of the present invention, the embodiment of the invention provides a kind of collecting methods.
First embodiment:
Referring to Fig. 1, Fig. 1 is a kind of flow diagram of collecting method provided in an embodiment of the present invention.
As shown in Figure 1, this method comprises:
S100: obtaining the corresponding primary data information of every control equipment, obtain multiple primary data information,
In, the corresponding primary data information of a control equipment.
It is understood that data collection system connects into thousand up to a hundred control equipment, need to control equipment to every
Operation information is acquired, to know the running details of every control equipment.
S200: the device data table being pre-created is written in each primary data information that will acquire.
It in the prior art, is that the operation information for directly controlling equipment to every by data collection system is acquired.And
In the present embodiment, in the corresponding equal write device tables of data of primary data information of the every control equipment that will acquire.
S300: conversion process is carried out to each primary data information, obtains multiple target data informations, wherein one
Primary data information corresponds to a target data information.
In the prior art, when data collection system be collected by polling mechanism control equipment operation information, and
It is to be performed corresponding processing by polling mechanism to operation information after collecting operation information.
It and in this application, is that multiple primary data information are obtained by batch+concurrent form, and it will be more
A primary data information is converted to target data information.
That is, compared with the existing technology, the application realizes batch+concurrent form and data is obtained and handled
Technical effect.
It provides through this embodiment: in each primary data information write device tables of data that will acquire, to number of devices
Conversion process is carried out according to each primary data information in table, the technical solution of multiple target data informations is obtained, avoids
Polling mechanism is used in the prior art, it is time-consuming more, it is not able to satisfy the technology of industrial Internet of Things and big data project acquisition demand
Drawback realizes the efficiency for improving data acquisition, has saved the technical effect of time and resource.
Second embodiment:
The present embodiment is based on first embodiment, in the present embodiment, this method further include:
Obtain the original equipment information in each primary data information.
When there are 1,000 control equipment, and obtained to the corresponding primary data information of this control equipment,
After obtaining 1,000 primary data information, then the corresponding 1,000 original equipment information of 1,000 primary data information is obtained.
It is understood that original equipment information in primary data information, different control equipment correspond to it is different just
Beginning device number information.
The device data table being pre-created is written in each primary data information that will acquire, and specifically includes:
It will be in corresponding primary data information write device tables of data according to each original equipment information.
3rd embodiment:
The present embodiment is based on first or second embodiments, in the present embodiment, this method further include:
Device data table is created according to the facility information of control equipment, wherein facility information includes the equipment for controlling equipment
Number information.
Device data table is corresponding with the control facility information of equipment.That is, when the quantity for controlling equipment is 1,000, then
The facility information for controlling equipment according to 1,000 creates device data Table A.When the quantity for controlling equipment is 2,000, then basis
The facility information of 2000 control equipment creates device data table B.If in 2,000 control equipment including this controls
Equipment, then device data table B includes device data Table A.If in 2,000 control equipment, thering are 500 control equipment also to include
In 1,000 control equipment, then device data table B is identical as device data Table A part.
Certainly, in creation device data table, can even there was only 1,000 feelings in control equipment according to performance
Under condition, extended meeting connects corresponding device data table when 2,000 control equipment after possibility can also be pre-created.
Fourth embodiment:
The present embodiment is based on 3rd embodiment, in the present embodiment, will be with it according to each original equipment information
In corresponding primary data information write device tables of data, specifically include:
First device number information is matched with device number information, obtains matching result；
It will be in the target area of the first primary data information write device tables of data according to matching result.
Wherein, original equipment information include the first device number information, primary data information include the first initial number it is believed that
Breath, the first device number information are corresponding with the first primary data information.
In the present embodiment, it is illustrated for by the first primary data information write device tables of data.Specifically:
First primary data information is any one in primary data information, and the first device number information and first is initially
Data information is corresponding.Then the first device number information is matched with device number information.If the first device number information with set
A standby number information C matches, then by the corresponding position device number information C in the first primary data information write device tables of data.
That is, the corresponding position in device data table device number information C is target area.
5th embodiment:
The present embodiment is based on first to fourth embodiment, and in the present embodiment, S300 is specifically included:
The corresponding classification information of the second primary data information is determined according to the second primary data information.
It is understood that the corresponding corresponding classification information of different primary data information is not identical.
And, it should be noted that the second primary data information here may be the first primary data information.
Data processor is called according to classification information.
The second primary data information is handled by data processor, obtains target data information.
Wherein, primary data information includes the second primary data information.
After determining to obtain the classification information of the second primary data information, data processing journey is called according to category information
Sequence handles the second primary data information according to the data processor, obtains target data information.
To make technical solution and technical effect to the present embodiment have more thorough explanation, now in conjunction with the prior art, to this
The technical solution of embodiment is explained in detail in a manner of specific embodiment.
In the prior art, data collection system can only acquire tens corresponding data informations of control equipment.Due to existing
Have in technology, is the acquisition for carrying out data information by polling mechanism, so, it takes a long time, it is big not to be able to satisfy industrial Internet of Things
Data items data information acquisition demand.
And in the present embodiment, partial sharing memory is separated by data collection system, as basic primary data buffer area.
To create device data table.Device data table can be divided into 4000 device number information, and each device number information is one corresponding
Equipment is controlled, each device number information can support 1024 byte data elements.When device data table is divided into 4000 equipment
When number information, then it can support 4000 threads while be written and read access.By occupying few cpu resource, smooth no Caton
Realization data read-write.
That is, in the present embodiment, when getting 4000 primary data information, then can be achieved 4000 initially
Data information is written simultaneously, to realize the technical effect that " batch+concurrent " mechanism handles primary data information.It avoids
Polling mechanism is used in the prior art, it is time-consuming more, it is not able to satisfy the skill of industrial Internet of Things and big data project acquisition demand
Art drawback realizes the efficiency for improving data acquisition, has saved the technical effect of time and resource.
Other side according to an embodiment of the present invention, the embodiment of the invention provides a kind of servers, comprising: storage
Device, one or more processors, wherein
The memory is used for: storing one or more programs；
When one or more of programs are executed by one or more of processors, so that one or more of processing
Device realizes method described in any embodiment in embodiment as above.
Other side according to an embodiment of the present invention, the embodiment of the invention provides a kind of data collection systems.
Referring to Fig. 2, Fig. 2 is a kind of structural schematic diagram of data collection system provided in an embodiment of the present invention.
As shown in Fig. 2, the system includes: monitoring device and many motors control equipment, wherein monitoring device includes: that data are deposited
Storage device, operation data library, data server and Duo Tai communicate driving device；
Every communication driving device is used to: acquiring the primary data information of corresponding control equipment, and will be initial
Data information transfer is to data storage device；
Data storage device is used for: primary data information is written to the device data table being pre-created；
Operation data library is used for: being obtained primary data information from device data table, and is turned to primary data information
Processing is changed, obtains target data information, and target data information is sent to data server；
Wherein, the corresponding control equipment of a communication driving device.
In a kind of technical solution in the cards, data storage device is specifically used for:
The original equipment information in primary data information is obtained, is write primary data information according to original equipment information
Enter in device data table.
Wherein, data storage device also particularly useful for:
First device number information is matched with device number information, obtains matching result；
It will be in the target area of the first primary data information write device tables of data according to matching result；
Wherein, original equipment information include the first device number information, primary data information include the first initial number it is believed that
Breath, the first device number information are corresponding with the first primary data information.
In a kind of technical solution in the cards, data storage device is also used to:
Device data table is created according to the facility information of control equipment, wherein facility information includes the equipment for controlling equipment
Number information.
In a kind of technical solution in the cards, operation data library is specifically used for:
The corresponding classification information of primary data information is determined according to primary data information；
Data processor is called according to classification information；
Primary data information is handled by data processor, obtains target data information.
Reader should be understood that in the description of this specification reference term " one embodiment ", " is shown " some embodiments "
The description of example ", " specific example " or " some examples " etc. means specific features described in conjunction with this embodiment or example, structure
Or feature is included at least one embodiment or example of the invention.In the present specification, to the schematic of above-mentioned term
Statement need not be directed to identical embodiment or example.Moreover, specific features, structure or the feature of description can be any
It can be combined in any suitable manner in a or multiple embodiment or examples.In addition, without conflicting with each other, the technology of this field
The feature of different embodiments or examples described in this specification and different embodiments or examples can be combined by personnel
And combination.
It is apparent to those skilled in the art that for convenience of description and succinctly, the dress of foregoing description
The specific work process with unit is set, can refer to corresponding processes in the foregoing method embodiment, details are not described herein.
In several embodiments provided herein, it should be understood that disclosed device and method can pass through it
Its mode is realized.For example, the apparatus embodiments described above are merely exemplary, for example, the division of unit, only
A kind of logical function partition, there may be another division manner in actual implementation, for example, multiple units or components can combine or
Person is desirably integrated into another system, or some features can be ignored or not executed.
Unit may or may not be physically separated as illustrated by the separation member, shown as a unit
Component may or may not be physical unit, it can and it is in one place, or may be distributed over multiple networks
On unit.It can select some or all of unit therein according to the actual needs to realize the mesh of the embodiment of the present invention
's.
It, can also be in addition, the functional units in various embodiments of the present invention may be integrated into one processing unit
It is that each unit physically exists alone, is also possible to two or more units and is integrated in one unit.It is above-mentioned integrated
Unit both can take the form of hardware realization, can also realize in the form of software functional units.
It, can if integrated unit is realized in the form of SFU software functional unit and when sold or used as an independent product
To be stored in a computer readable storage medium.Based on this understanding, technical solution of the present invention substantially or
Say that all or part of the part that contributes to existing technology or the technical solution can embody in the form of software products
Out, which is stored in a storage medium, including some instructions are used so that a computer equipment
(can be personal computer, server or the network equipment etc.) executes all or part of each embodiment method of the present invention
Step.And storage medium above-mentioned include: USB flash disk, it is mobile hard disk, read-only memory (ROM, Read-Only Memory), random
Access various Jie that can store program code such as memory (RAM, Random Access Memory), magnetic or disk
Matter.
It should also be understood that magnitude of the sequence numbers of the above procedures are not meant to execute sequence in various embodiments of the present invention
It is successive, the execution of each process sequence should be determined by its function and internal logic, the implementation without coping with the embodiment of the present invention
Journey constitutes any restriction.
More than, only a specific embodiment of the invention, but scope of protection of the present invention is not limited thereto, and it is any to be familiar with
Those skilled in the art in the technical scope disclosed by the present invention, can readily occur in various equivalent modifications or substitutions,
These modifications or substitutions should be covered by the protection scope of the present invention.Therefore, protection scope of the present invention should be wanted with right
Subject to the protection scope asked.
Claims (10)
1. a kind of collecting method, which is characterized in that the described method includes:
The corresponding primary data information of every control equipment is obtained, obtains multiple primary data information, wherein an institute
State the corresponding primary data information of control equipment；
It each of will acquire the primary data information and the device data table being pre-created be written；
Conversion process is carried out to each primary data information, obtains multiple target data informations, wherein one described first
Beginning data information corresponds to a target data information.
2. a kind of collecting method according to claim 1, which is characterized in that the method also includes:
Obtain the original equipment information in each primary data information；
It is described each of to will acquire the primary data information device data table being pre-created is written, it specifically includes:
The device data table is written into the corresponding primary data information according to each original equipment information
In.
3. a kind of collecting method according to claim 1, which is characterized in that the method also includes:
The device data table is created according to the facility information of the control equipment, wherein the facility information includes the control
The device number information of control equipment.
4. a kind of collecting method according to claim 3, which is characterized in that described according to each original equipment
The corresponding primary data information is written in the device data table for number information, specifically includes:
First device number information is matched with the device number information, obtains matching result；
The first primary data information is written according to the matching result in the target area of the device data table；
Wherein, the original equipment information includes the first device number information, and the primary data information includes the first initial number
It is believed that breath, the first device number information are corresponding with the first primary data information.
5. a kind of collecting method described in any one of -4 according to claim 1, which is characterized in that described to each described
Primary data information carries out conversion process, obtains multiple target data informations, specifically includes:
The corresponding classification information of the second primary data information is determined according to the second primary data information；
Data processor is called according to the classification information；
The second primary data information is handled by the data processor, obtains the target data information；
Wherein, the primary data information includes the second primary data information.
6. a kind of server, comprising: memory, one or more processors, wherein
The memory is used for: storing one or more programs；
When one or more of programs are executed by one or more of processors, so that one or more of processors are real
Existing method according to any one of claims 1 to 5.
7. a kind of data collection system, which is characterized in that the system comprises: monitoring device and many motors control equipment, wherein institute
Stating monitoring device includes: data storage device, operation data library, data server and Duo Tai communication driving device；
Every communication driving device is used to: acquiring the primary data information of the corresponding control equipment, and will
The primary data information is transmitted to the data storage device；
The data storage device is used for: the primary data information is written to the device data table being pre-created；
The operation data library is used for: the primary data information is obtained from the device data table, and to the initial number
It is believed that breath carries out conversion process, target data information is obtained, and the target data information is sent to the data server；
Wherein, the corresponding control equipment of a communication driving device.
8. a kind of data collection system according to claim 7, which is characterized in that the data storage device is specifically used
In:
The original equipment information in the primary data information is obtained, according to the original equipment information by the initial number
It is believed that breath is written in the device data table.
9. a kind of data collection system according to claim 7, which is characterized in that the data storage device is also used to:
The device data table is created according to the facility information of the control equipment, wherein the facility information includes the control
The device number information of control equipment.
10. a kind of data collection system according to any one of claim 7-9, which is characterized in that the operation data
Library is specifically used for:
The corresponding classification information of the primary data information is determined according to the primary data information；
Data processor is called according to the classification information；
The primary data information is handled by the data processor, obtains the target data information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810603695.0A CN108959438A (en) | 2018-06-12 | 2018-06-12 | A kind of collecting method and system, a kind of server |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810603695.0A CN108959438A (en) | 2018-06-12 | 2018-06-12 | A kind of collecting method and system, a kind of server |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108959438A true CN108959438A (en) | 2018-12-07 |
Family
ID=64488707
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810603695.0A Pending CN108959438A (en) | 2018-06-12 | 2018-06-12 | A kind of collecting method and system, a kind of server |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108959438A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111611286A (en) * | 2020-06-10 | 2020-09-01 | 北京许继电气有限公司 | Streaming data processing method for industrial Internet of things scene |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101247589A (en) * | 2007-07-04 | 2008-08-20 | 华为技术有限公司 | Mobile terminal data conversion/backup method, device and system |
| CN101684999A (en) * | 2008-09-25 | 2010-03-31 | 比亚迪股份有限公司 | Conversion method of data format |
| US20130290281A1 (en) * | 2012-04-27 | 2013-10-31 | Hitachi, Ltd. | Storage apparatus and data management method |
| CN105975524A (en) * | 2016-04-28 | 2016-09-28 | 成都理工大学 | Data integration method and system used for geology monitoring |
| CN106980669A (en) * | 2017-03-23 | 2017-07-25 | 珠海格力电器股份有限公司 | A kind of storage of data, acquisition methods and device |
| CN107391744A (en) * | 2017-08-10 | 2017-11-24 | 东软集团股份有限公司 | Data storage, read method, device and its equipment |
-
2018
- 2018-06-12 CN CN201810603695.0A patent/CN108959438A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101247589A (en) * | 2007-07-04 | 2008-08-20 | 华为技术有限公司 | Mobile terminal data conversion/backup method, device and system |
| CN101684999A (en) * | 2008-09-25 | 2010-03-31 | 比亚迪股份有限公司 | Conversion method of data format |
| US20130290281A1 (en) * | 2012-04-27 | 2013-10-31 | Hitachi, Ltd. | Storage apparatus and data management method |
| CN105975524A (en) * | 2016-04-28 | 2016-09-28 | 成都理工大学 | Data integration method and system used for geology monitoring |
| CN106980669A (en) * | 2017-03-23 | 2017-07-25 | 珠海格力电器股份有限公司 | A kind of storage of data, acquisition methods and device |
| CN107391744A (en) * | 2017-08-10 | 2017-11-24 | 东软集团股份有限公司 | Data storage, read method, device and its equipment |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111611286A (en) * | 2020-06-10 | 2020-09-01 | 北京许继电气有限公司 | Streaming data processing method for industrial Internet of things scene |
| CN111611286B (en) * | 2020-06-10 | 2024-03-08 | 北京许继电气有限公司 | Streaming data processing method of industrial Internet of things scene |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8423605B2 (en) | Parallel distributed processing method and computer system | |
| CA3109481A1 (en) | Identification and application of hyperparameters for machine learning | |
| US9986018B2 (en) | Method and system for a scheduled map executor | |
| US9535743B2 (en) | Data processing control method, computer-readable recording medium, and data processing control device for performing a Mapreduce process | |
| JP2019075079A (en) | System and method for selecting proxy computer | |
| JP6382284B2 (en) | Data flow programming of computing devices with graph partitioning based on vector estimation | |
| DE112020005789T5 (en) | HIERARCHICAL PARTITIONING OF OPERATORS | |
| JP2020053013A (en) | Request processing method and device | |
| US11308396B2 (en) | Neural network layer-by-layer debugging | |
| CN111897660A (en) | Model deployment method, model deployment device and terminal equipment | |
| CN109800078B (en) | Task processing method, task distribution terminal and task execution terminal | |
| CN108959438A (en) | A kind of collecting method and system, a kind of server | |
| CN116600014B (en) | Server scheduling method and device, electronic equipment and readable storage medium | |
| CN106713163A (en) | Method and apparatus for deploying server load | |
| CN104598485B (en) | The method and apparatus for handling database table | |
| US11941519B2 (en) | Machine learning training platform | |
| CN109597673A (en) | Create the method and controlling equipment of virtual machine | |
| CN107193650B (en) | Method and device for scheduling display card resources in distributed cluster | |
| CN110334065A (en) | A kind of document handling method and system | |
| Yildirim et al. | Parallel versus distributed data access for gigapixel-resolution histology images: Challenges and opportunities | |
| CN112764897B (en) | Task request processing method, device and system and computer readable storage medium | |
| CN110309177B (en) | Data processing method and related device | |
| US11748622B1 (en) | Saving intermediate outputs of a neural network | |
| CN109783717B (en) | Query task processing method, system, server cluster, device and computer readable storage medium | |
| Merelli et al. | Porting bioinformatics applications from grid to cloud: A macromolecular surface analysis application case study |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181207 |
|
| RJ01 | Rejection of invention patent application after publication |