CN106649140A - Data processing method, apparatus and system - Google Patents
Data processing method, apparatus and system Download PDFInfo
- Publication number
- CN106649140A CN106649140A CN201611248259.3A CN201611248259A CN106649140A CN 106649140 A CN106649140 A CN 106649140A CN 201611248259 A CN201611248259 A CN 201611248259A CN 106649140 A CN106649140 A CN 106649140A
- Authority
- CN
- China
- Prior art keywords
- data processing
- data
- processing unit
- gathered
- release
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 29
- 238000012545 processing Methods 0.000 claims abstract description 169
- 238000000034 method Methods 0.000 claims abstract description 33
- 230000008569 process Effects 0.000 claims abstract description 18
- 238000012544 monitoring process Methods 0.000 claims abstract description 15
- 230000002159 abnormal effect Effects 0.000 claims description 4
- 230000001934 delay Effects 0.000 description 3
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000006399 behavior Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000004148 unit process Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
- G06F12/02—Addressing or allocation; Relocation
- G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
- G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
- G06F12/0806—Multiuser, multiprocessor or multiprocessing cache systems
- G06F12/0811—Multiuser, multiprocessor or multiprocessing cache systems with multilevel cache hierarchies
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
- G06F12/02—Addressing or allocation; Relocation
- G06F12/08—Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
- G06F12/0802—Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
- G06F12/0806—Multiuser, multiprocessor or multiprocessing cache systems
- G06F12/0842—Multiuser, multiprocessor or multiprocessing cache systems for multiprocessing or multitasking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/30—Arrangements for executing machine instructions, e.g. instruction decode
- G06F9/38—Concurrent instruction execution, e.g. pipeline or look ahead
- G06F9/3885—Concurrent instruction execution, e.g. pipeline or look ahead using a plurality of independent parallel functional units
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Debugging And Monitoring (AREA)
- Memory System Of A Hierarchy Structure (AREA)
Abstract
The invention discloses a data processing method, apparatus and system. The data processing method comprises the following steps: a cache queue caches the collected data collected by each acquisition device, and releases the cached collected data to each data processing unit according to a predetermined rule when the cache amount exceeds a predetermined number; and each data processing unit receives the released collected data and respectively initiates the respective data processing threads to process data to obtain the data processing result. It can be seen that the method can process the collected data collected by multiple acquisition devices in parallel, give full play to the CPU processing capacity, reduce the backlog of collected data and improve the overall data processing speed, so the monitoring real-time performance is high.
Description
Technical field
The present invention relates to technical field of data processing, more particularly to a kind of data processing method, apparatus and system.
Background technology
Data processing technique is widely used in industry-by-industry, such as, in agricultural planting industry, need substantial amounts of collecting device,
Such as sensor etc. carries out data acquisition to plantation scene, then fills the data for collecting by network transmission to data processing
In putting, the data processing work of correlation is carried out, result is sent to server by final data processing meanss, right so as to realize
The long-range monitoring at plantation scene.Due to plantation scene collecting device it is very many, therefore, the workload of data processing equipment is very
Greatly.
The flow chart of data processing of existing data processing equipment is：The data for collecting directly are processed, due to it
Tupe is serial process, therefore when pending data is very more, overstocking for data just occurs, if data above
Do not processed, then behind data just have to wait for, therefore the speed of data processing is very slow, it is impossible to carry to server in time
For result, cause real-time in monitoring process poor.
As can be seen here, the shortcoming of the data processing method of data processing equipment in prior art how is overcome, so as to improve
The real-time and processing speed of monitoring is those skilled in the art's problem demanding prompt solution.
The content of the invention
It is an object of the invention to provide a kind of data processing method, apparatus and system, for overcoming prior art in data
The shortcoming of the data processing method of processing meanss, so as to improve the real-time and processing speed of monitoring.
To solve above-mentioned technical problem, the present invention provides a kind of data processing method, including：
The gathered data caching that buffer queue collects each collecting device, and in buffer memory a predetermined level is exceeded, will
The gathered data for having cached is discharged to each data processing unit according to pre-defined rule；
Each data processing unit receives the gathered data of release, and being respectively started respective data processing threads is carried out at data
Manage to obtain data processed result.
Preferably, each data processing unit receives the gathered data of release, is respectively started respective data processing line
Cheng Jinhang data processings are specifically included with obtaining data processed result：
The gathered data of real-time reception release, and secondary caching；
Judge whether to reach respective release time；
If it is, the gathered data of secondary caching is all discharged, and start respective data processing threads and enter line number
According to processing obtaining data processed result；
If it is not, then continuing to determine whether to reach respective release time.
Preferably, the data processing threads in each data processing unit are multiple.
Preferably, the described gathered data for having cached is discharged to each data processing unit according to pre-defined rule is specially：
According to first in first out, enter the principle gathered data that cached of release for outing, it is current according to each data processing unit
Process the gathered data that state assignment has been cached.
Preferably, the gathered data tool that the process state assignment current according to each data processing unit has been cached
Body is：If available free data processing unit, the gathered data for having cached is distributed to into the data processing unit of free time, it is no
Then, it is randomly assigned.
Preferably, also include：The data processed result is sent to monitoring server by each data processing unit.
Preferably, also include：The corresponding data processing unit output when the data processed result occurs abnormal is reported to the police
Information, wherein including the identity information of collecting device in the gathered data, the prompt messages include correspondence
Collecting device identity information.
Preferably, also include：Memory cell stores the data processed result of each data processing unit.
To solve above-mentioned technical problem, the present invention provides a kind of data processing equipment, including：
Buffer queue, for the gathered data caching for collecting each collecting device, and in buffer memory a predetermined level is exceeded
When, the gathered data for having cached is discharged to each data processing unit according to pre-defined rule；
Multiple data processing units, each data processing unit is used to receive the gathered data of release, is respectively started respective
Data processing threads carry out data processing to obtain data processed result.
Preferably, each data processing unit is specifically included：
Time caches flow module, for the gathered data of real-time reception release, and secondary caching；Judge whether to reach release
Time；If it is, the gathered data of secondary caching is all discharged；If it is not, then continuing to determine whether to reach release time；
Stream process module, carries out data processing to obtain data processed result for starting the data processing threads of itself.
To solve above-mentioned technical problem, the present invention provides a kind of data handling system, including each collecting device, monitoring service
Device, also including data processing equipment described above.
Data processing method provided by the present invention, including buffer queue delays the gathered data that each collecting device is collected
Deposit, and in buffer memory a predetermined level is exceeded, the gathered data for having cached is discharged to each data processing list according to pre-defined rule
Unit；Each data processing unit receives the gathered data of release, be respectively started respective data processing threads carry out data processing with
Obtain data processed result.As can be seen here, the gathered data parallel processing that the method can be collected to multiple collecting devices, fills
The disposal ability of CPU is waved in distribution, reduces overstocking for gathered data, the speed of overall data processing is improve, so as to monitoring
Real-time is higher.Additionally, data processing equipment provided by the present invention and system, equally with above-mentioned beneficial effect.
Description of the drawings
In order to be illustrated more clearly that the embodiment of the present invention, the accompanying drawing to be used needed for embodiment will be done simply below
Introduce, it should be apparent that, drawings in the following description are only some embodiments of the present invention, for ordinary skill people
For member, on the premise of not paying creative work, can be with according to these other accompanying drawings of accompanying drawings acquisition.
Fig. 1 is a kind of flow chart of data processing method provided in an embodiment of the present invention；
Fig. 2 is a kind of structure chart of data processing equipment provided in an embodiment of the present invention；
Fig. 3 is the flow chart of another kind of data processing method provided in an embodiment of the present invention；
Fig. 4 is the structure chart of another kind of data processing equipment provided in an embodiment of the present invention；
Fig. 5 is a kind of structure chart of data handling system provided in an embodiment of the present invention.
Specific embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation is described, it is clear that described embodiment is only a part of embodiment of the invention, rather than whole embodiments.Based on this
Embodiment in invention, those of ordinary skill in the art are not under the premise of creative work is made, and what is obtained is every other
Embodiment, belongs to the scope of the present invention.
The present invention core be to provide a kind of data processing method, apparatus and system, for overcoming prior art in data
The shortcoming of processing method, so as to improve the real-time and processing speed of monitoring.
In order that those skilled in the art more fully understand the present invention program, with reference to the accompanying drawings and detailed description
The present invention is described in further detail.
Fig. 1 is a kind of flow chart of data processing method provided in an embodiment of the present invention.As shown in figure 1, data processing side
Method includes：
S10：The gathered data caching that buffer queue collects each collecting device, and in buffer memory a predetermined level is exceeded
When, the gathered data for having cached is discharged to each data processing unit according to pre-defined rule.
S11：Each data processing unit receives the gathered data of release, is respectively started respective data processing threads and enters line number
According to processing obtaining data processed result.
In order to become apparent from expressing the flow chart shown in Fig. 1, the present embodiment provides a kind of structure chart corresponding with the method.Figure
2 is a kind of structure chart of data processing equipment provided in an embodiment of the present invention.It should be noted that simply a kind of concrete in Fig. 2
Embodiment, the quantity at least two of the data processing unit 11 in data processing equipment 1.
As shown in Fig. 2 buffer queue 10 is used for caching the gathered data that each collecting device is collected, and cache, concrete
In enforcement, it is different that collecting device may have the frequency acquisition of hundreds of or even thousand of, different collecting device, and this is resulted in adopts
The amount of collection data does not have a fixed frequency, therefore, if according to the serial processing mode of prior art, carrying out a collection
Data processing one, then same time CPU (CPU is the hardcore of data processing equipment, and current CPU is generally multinuclear,
Such as double-core, four cores or more multinuclear, can the multiple data of parallel processing, and processing speed is without significantly reduction) can only locate
One data of reason, therefore the superior function of CPU cannot be played, ultimately result in substantial amounts of data and overstock, cause the speed of data processing
Degree is slowly.And the technical scheme that the present embodiment provides is adopted, gathered data is buffered in first in buffer queue 10, caches team
The capacity of row 10 is generally very big, can simultaneously cache substantial amounts of gathered data.Buffer queue 10 is the data for having cached according to pre-
Set pattern is then discharged in each data processing unit 11, and data processing unit 11 is called each after the gathered data for receiving release
From data processing threads so that CPU carries out data processing to gathered data.
It should be noted that pre-defined rule can be arranged flexibly, for example, pre-defined rule is first in first out, enter one goes out one, and
And according to the current process state assignment of each data processing unit, therefore as one kind preferred embodiment, by what is cached
Gathered data discharges to each data processing unit according to pre-defined rule and is specially：According to first in first out, enter one and go out one principle to release
The gathered data for having cached is put, according to the gathered data that the current process state assignment of each data processing unit has been cached.For example,
If the capacity of buffer queue is 100, after the 101st gathered data is come in, first gathered data will be released.
Preferably, the gathered data for having cached according to the current process state assignment of each data processing unit is concrete
For：If available free data processing unit, the gathered data for having cached is distributed to into the data processing unit of free time, it is no
Then, it is randomly assigned.By such treatment mechanism, the performance of each data processing unit can be given full play to so that data processing
Speed faster.
The data processing method that the present embodiment is provided, including buffer queue delays the gathered data that each collecting device is collected
Deposit, and in buffer memory a predetermined level is exceeded, the gathered data for having cached is discharged to each data processing list according to pre-defined rule
Unit；Each data processing unit receives the gathered data of release, be respectively started respective data processing threads carry out data processing with
Obtain data processed result.As can be seen here, the gathered data parallel processing that the method can be collected to multiple collecting devices, fills
The disposal ability of CPU is waved in distribution, reduces overstocking for gathered data, the speed of overall data processing is improve, so as to monitoring
Real-time is higher.
It is understood that in being embodied as, how to carry out data processing, that is, adopt which kind of data processing method can be with
Referring to the processing method of prior art, the present embodiment is repeated no more.Data processing equipment is completed after data processing, can be by data
Result is sent to monitoring server or is stored in the memory cell of itself, and embodiment is repeated no more.
In the above-described embodiments, although the speed of overall data processing can be improved, but such processing mode makes
Obtaining CPU needs to be constantly in armed state, and the impact of this performance to CPU is bigger than the impact for processing multiple data simultaneously to be obtained
It is many.Based on this problem, in the present embodiment, it is achieved through the following technical solutions.Fig. 3 is another kind provided in an embodiment of the present invention
The flow chart of data processing method.Preferably embodiment, step S11 is specifically included：
S110：The gathered data of real-time reception release, and secondary caching；
S111：Judge whether to reach respective release time；If it is, into step S112, otherwise, returning S111.
S112：The gathered data of secondary caching is all discharged, and starts respective data processing threads is carried out at data
Manage to obtain data processed result.
In order to more clearly illustrate the flow chart shown in Fig. 3, the present embodiment provides the structure of corresponding data processing equipment
Figure.Fig. 4 is the structure chart of another kind of data processing equipment provided in an embodiment of the present invention.
As shown in figure 4, each data processing unit 11 includes that the time caches flow module 110 and stream process module 111.For
The embodiment of buffer queue 10 is same as above, and the present embodiment is repeated no more.Each time caching flow module 110 real-time reception delays
The gathered data of the release of queue 10 is deposited, and is cached again.Each time stream cache module 110 has respective release time, its
Working method is that arrival release time just discharges data, otherwise caches always.It should be noted that each time flows cache module
110 release time can be with identical, can be with difference.When respective release time has been arrived, then the gathered data of caching is all released
Put to corresponding stream process module 111, to carry out data processing.The release time of each time stream cache module 10 is from the last time
The moment of release data starts to calculate, if the cycle is 5 seconds, the moment of last time release data is that then this is released if 10 seconds
The time of putting is exactly 15 seconds.Therefore, between 10-15 seconds when, time stream cache module 110 will not discharge data, then at stream
Reason module 111 is in idle condition, then CPU is just idled accordingly, and in the CPU idle stages other behaviour can be just performed
Make, it is obvious that can so improve the utilization rate of CPU.Illustrated with a specific example, time caching flow module can be set
110 deenergized period is 5 seconds, and stream process module 111 receives data, calls data processing threads to carry out needed for data processing
Time is that if 1 second, then CPU can go out time of 4 seconds with the free time.
Preferably embodiment, the data processing threads in each data processing unit are multiple.
It is understood that the number of data processing threads is more, then the data volume that the same time can be processed will be more
It is many, but the processing speed of CPU also can decline, therefore, data processing threads nor The more the better, and no more than
The disposal ability of CPU.
On the basis of above-described embodiment, preferably embodiment, also includes：When exception occurs in data processed result
When corresponding data processing unit export prompt messages, the identity information of collecting device is wherein included in gathered data,
Identity information of the prompt messages comprising corresponding collecting device.
It is understood that collecting device has multiple, when data processed result occurs abnormal, pointed out, but such as
Fruit does not know that, although can then play a part of alarm, positioning difficulty is very big if corresponding which collecting device.
By the present embodiment, the effect of alarm not only can be realized, and can be automatically positioned.Data described in the present embodiment
Result refers to gathered data extremely has deviation with data under normal circumstances, such as a temperature signal correspondence
Gathered data, result under normal circumstances should be 20 degrees Celsius -35 degrees Celsius, once indicate that more than this scope
It is 38 degrees Celsius that abnormal, such as current data processed result occurs in data processed result, then export prompt messages.
On the basis of above-described embodiment, preferably embodiment, also includes：Memory cell stores each data processing
The data processed result of unit.
Subsequently check for convenience, stored the data processed result of each data processing unit in the present embodiment.Can
To be understood by, can be same by the storage region storage of data processed result partitioned storage, i.e., according to data processing unit
The data processed result of individual data processing unit, or can also be stored entirely in same storage region.
It is above the corresponding embodiment of data processing method, the reality of the corresponding device part of the method is given below
Apply mode.
As shown in Fig. 2 data processing equipment 1, including：
Buffer queue 10, for the gathered data caching for collecting each collecting device, and exceedes predetermined number in buffer memory
During amount, the gathered data for having cached is discharged to each data processing unit 11 according to pre-defined rule；
Multiple data processing units 11, each data processing unit is used to receive the gathered data of release, is respectively started each
Data processing threads carry out data processing to obtain data processed result.
As shown in figure 4, used as preferred embodiment, each data processing unit 11 is specifically included：
Time caches flow module 110, for the gathered data of real-time reception release, and secondary caching；Judge whether to reach
Release time；If it is, the gathered data of secondary caching is all discharged；If it is not, then continuing to determine whether to reach release
Time；
Stream process module 111, carries out data processing to obtain data processing knot for starting the data processing threads of itself
Really.
Due to the embodiment of device part it is mutually corresponding with the embodiment of method part, therefore the embodiment of device part please
Referring to the description of the embodiment of method part, wouldn't repeat here.
The data processing equipment that the present embodiment is provided, including buffer queue, for the collection for collecting each collecting device
Data buffer storage, and in buffer memory a predetermined level is exceeded, the gathered data for having cached is discharged to each data according to pre-defined rule
Processing unit；Multiple data processing units, each data processing unit is used to receive the gathered data of release, is respectively started respective
Data processing threads carry out data processing to obtain data processed result.As can be seen here, the device can be to multiple collecting devices
The gathered data parallel processing for collecting, gives full play to the disposal ability of CPU, reduces overstocking for gathered data, improves entirety
Data processing speed, so as to monitoring real-time it is higher.
In addition, the present invention also provides a kind of system comprising above-mentioned data processing equipment, i.e. data handling system, the data
Processing system includes each collecting device 2, monitoring server 3, also including the data processing equipment 1 described in above-described embodiment.
Due to the embodiment of components of system as directed it is mutually corresponding with the embodiment of device part, therefore the embodiment of components of system as directed please
Referring to the description of the embodiment of device part, wouldn't repeat here.
The data handling system that the present embodiment is provided, including the data processing equipment described in above-described embodiment, at the data
Reason device includes buffer queue, for the gathered data caching for collecting each collecting device, and exceedes predetermined number in buffer memory
During amount, the gathered data for having cached is discharged to each data processing unit according to pre-defined rule；Multiple data processing units, each number
It is used to receive the gathered data of release according to processing unit, being respectively started respective data processing threads carries out data processing to obtain
Data processed result.As can be seen here, the gathered data parallel processing that the device can be collected to multiple collecting devices, fully sends out
The disposal ability of CPU is waved, overstocking for gathered data is reduced, the speed of overall data processing is improve, it is real-time so as to what is monitored
Property is higher.In sum, the data handling system that the present embodiment is provided also has corresponding advantage.
A kind of data processing method provided by the present invention, apparatus and system are described in detail above.Specification
In each embodiment described by the way of progressive, what each embodiment was stressed be it is different from other embodiment it
Place, between each embodiment identical similar portion mutually referring to.For device disclosed in embodiment, due to itself and reality
Apply that method disclosed in example is corresponding, so description is fairly simple, related part is referring to method part illustration.Should refer to
Go out, for those skilled in the art, under the premise without departing from the principles of the invention, can also be to the present invention
Some improvement and modification are carried out, these are improved and modification is also fallen in the protection domain of the claims in the present invention.
Also, it should be noted that in this manual, such as first and second or the like relational terms be used merely to by
One entity or operation make a distinction with another entity or operation, and not necessarily require or imply these entities or operation
Between there is any this actual relation or order.And, term " including ", "comprising" or its any other variant meaning
Covering including for nonexcludability, so that a series of process, method, article or equipment including key elements not only includes that
A little key elements, but also including other key elements being not expressly set out, or also include for this process, method, article or
The intrinsic key element of equipment.In the absence of more restrictions, the key element for being limited by sentence "including a ...", does not arrange
Except also there is other identical element in including the process of the key element, method, article or equipment.
Claims (11)
1. a kind of data processing method, it is characterised in that include：
The gathered data caching that buffer queue collects each collecting device, and in buffer memory a predetermined level is exceeded, will delay
The gathered data deposited is discharged to each data processing unit according to pre-defined rule；
Each data processing unit receives the gathered data of release, be respectively started respective data processing threads carry out data processing with
Obtain data processed result.
2. data processing method according to claim 1, it is characterised in that each data processing unit receives release
Gathered data, is respectively started respective data processing threads and carries out data processing and specifically included with obtaining data processed result：
The gathered data of real-time reception release, and secondary caching；
Judge whether to reach respective release time；
If it is, the gathered data of secondary caching is all discharged, and start respective data processing threads and carry out at data
Manage to obtain data processed result；
If it is not, then continuing to determine whether to reach respective release time.
3. data processing method according to claim 2, it is characterised in that at the data in each data processing unit
Reason thread is multiple.
4. data processing method according to claim 1, it is characterised in that it is described by the gathered data for having cached according to pre-
Set pattern then discharges to each data processing unit and is specially：According to first in first out, enter the principle collection that cached of release for outing
Data, according to the gathered data that the current process state assignment of each data processing unit has been cached.
5. data processing method according to claim 4, it is characterised in that described to work as according to each data processing unit
The gathered data that front process state assignment has been cached is specially：If available free data processing unit, by what is cached
Gathered data distributes to the data processing unit of free time, otherwise, is randomly assigned.
6. data processing method according to claim 1, it is characterised in that also include：Each data processing unit will
The data processed result is sent to monitoring server.
7. data processing method according to claim 1, it is characterised in that also include：When the data processed result goes out
Corresponding data processing unit exports prompt messages when now abnormal, wherein including collecting device in the gathered data
Identity information, identity information of the prompt messages comprising corresponding collecting device.
8. data processing method according to claim 1, it is characterised in that also include：Memory cell stores each number
According to the data processed result of processing unit.
9. a kind of data processing equipment, it is characterised in that include：
Buffer queue, for the gathered data caching for collecting each collecting device, and in buffer memory a predetermined level is exceeded, will
The gathered data for having cached is discharged to each data processing unit according to pre-defined rule；
Multiple data processing units, each data processing unit is used to receive the gathered data of release, is respectively started respective data
Processing thread carries out data processing to obtain data processed result.
10. data processing equipment according to claim 9, it is characterised in that each data processing unit is specifically included：
Time caches flow module, for the gathered data of real-time reception release, and secondary caching；When judging whether to reach release
Between；If it is, the gathered data of secondary caching is all discharged；If it is not, then continuing to determine whether to reach release time；
Stream process module, carries out data processing to obtain data processed result for starting the data processing threads of itself.
A kind of 11. data handling systems, including each collecting device, monitoring server, it is characterised in that also including claim 9
Or the data processing equipment described in 10.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611248259.3A CN106649140A (en) | 2016-12-29 | 2016-12-29 | Data processing method, apparatus and system |
| PCT/CN2017/090976 WO2018120705A1 (en) | 2016-12-29 | 2017-06-30 | Data processing method, apparatus and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611248259.3A CN106649140A (en) | 2016-12-29 | 2016-12-29 | Data processing method, apparatus and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106649140A true CN106649140A (en) | 2017-05-10 |
Family
ID=58836359
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611248259.3A Pending CN106649140A (en) | 2016-12-29 | 2016-12-29 | Data processing method, apparatus and system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN106649140A (en) |
| WO (1) | WO2018120705A1 (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2018120705A1 (en) * | 2016-12-29 | 2018-07-05 | 深圳前海弘稼科技有限公司 | Data processing method, apparatus and system |
| CN109460289A (en) * | 2018-08-21 | 2019-03-12 | 深圳市华力特电气有限公司 | A kind of building data processing system and method |
| WO2019140645A1 (en) * | 2018-01-19 | 2019-07-25 | 深圳市大疆创新科技有限公司 | Data processing method and device, controller and movable device |
| CN110413540A (en) * | 2019-06-28 | 2019-11-05 | 苏州浪潮智能科技有限公司 | A kind of method, system, equipment and the storage medium of FPGA data caching |
| CN110430229A (en) * | 2019-06-19 | 2019-11-08 | 特斯联（北京）科技有限公司 | Intelligence community Internet of Things heat transfer agent acquisition processing system and method based on cloud platform |
| CN114070718A (en) * | 2021-10-19 | 2022-02-18 | 深圳市有方科技股份有限公司 | Alarm method, alarm device and storage medium |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114338556A (en) * | 2022-01-07 | 2022-04-12 | 南昌济铃新能源科技有限责任公司 | Message forwarding method between CAN network and vehicle-mounted Ethernet and gateway system |
| CN115048149A (en) * | 2022-05-23 | 2022-09-13 | 杨正 | Application cache scalable processing method, device, equipment and medium |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7661036B1 (en) * | 2005-11-08 | 2010-02-09 | Oakley Networks | Cache for collecting events on a monitored computer |
| CN102831091A (en) * | 2012-07-31 | 2012-12-19 | 宁波成电泰克电子信息技术发展有限公司 | Serial port-based ship radar echo data collecting method |
| CN103207775A (en) * | 2013-03-11 | 2013-07-17 | 中国科学技术大学苏州研究院 | Processing method for adopting graphic processing unit (GPU) to accelerate real-time network flow application program |
| CN103384206A (en) * | 2012-05-02 | 2013-11-06 | 中国科学院计算机网络信息中心 | Concurrent processing method and system for mass data |
| CN103593307A (en) * | 2013-11-25 | 2014-02-19 | 湖南强军科技有限公司 | Method and device for processing collected data by means of electromagnetic method exploration system |
| CN103617592A (en) * | 2013-11-28 | 2014-03-05 | 中国科学院光电研究院 | Hyperspectral image high-speed parallel processing system and method based on FPGA and multiple DSPs |
| CN103678522A (en) * | 2013-11-28 | 2014-03-26 | 许继电气股份有限公司 | Method for acquiring and converting data of metering system of intelligent transformer substation |
| US20150032992A1 (en) * | 2013-07-29 | 2015-01-29 | Infineon Technologies Ag | Data processing arrangement and method for data processing |
| CN104683445A (en) * | 2015-01-26 | 2015-06-03 | 北京邮电大学 | Distributed real-time data fusion system |
| CN204496485U (en) * | 2015-04-14 | 2015-07-22 | 北京宏锐星通科技有限公司 | A kind of I/O assisted access device based on high-speed data acquisition storage system |
| CN106020777A (en) * | 2016-04-29 | 2016-10-12 | 杭州华橙网络科技有限公司 | Data processing method, device and system |
| CN106019395A (en) * | 2016-07-14 | 2016-10-12 | 中国地质大学（北京） | Electrical method receiving and processing system and method thereof based on correlation identification |
| CN106095832A (en) * | 2016-06-01 | 2016-11-09 | 东软集团股份有限公司 | Distributed parallel processing method and device |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6832329B2 (en) * | 2001-02-08 | 2004-12-14 | International Business Machines Corporation | Cache thresholding method, apparatus, and program for predictive reporting of array bit line or driver failures |
| CN101786384A (en) * | 2010-01-07 | 2010-07-28 | 浙江大学 | Interface conversion system for digital decorating machine and data transmission method |
| CN102542635A (en) * | 2012-02-09 | 2012-07-04 | 重庆长安汽车股份有限公司 | Car recorder combined with lane deviation alarming system |
| CN103678078B (en) * | 2012-09-25 | 2016-05-11 | 深圳市中兴微电子技术有限公司 | A kind of debug system and method |
| CN104422694A (en) * | 2013-09-11 | 2015-03-18 | 法国圣戈班玻璃公司 | Processing device and processing method of measured data as well as optical measurement system |
| CN106649140A (en) * | 2016-12-29 | 2017-05-10 | 深圳前海弘稼科技有限公司 | Data processing method, apparatus and system |
-
2016
- 2016-12-29 CN CN201611248259.3A patent/CN106649140A/en active Pending
-
2017
- 2017-06-30 WO PCT/CN2017/090976 patent/WO2018120705A1/en active Application Filing
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7661036B1 (en) * | 2005-11-08 | 2010-02-09 | Oakley Networks | Cache for collecting events on a monitored computer |
| CN103384206A (en) * | 2012-05-02 | 2013-11-06 | 中国科学院计算机网络信息中心 | Concurrent processing method and system for mass data |
| CN102831091A (en) * | 2012-07-31 | 2012-12-19 | 宁波成电泰克电子信息技术发展有限公司 | Serial port-based ship radar echo data collecting method |
| CN103207775A (en) * | 2013-03-11 | 2013-07-17 | 中国科学技术大学苏州研究院 | Processing method for adopting graphic processing unit (GPU) to accelerate real-time network flow application program |
| US20150032992A1 (en) * | 2013-07-29 | 2015-01-29 | Infineon Technologies Ag | Data processing arrangement and method for data processing |
| CN103593307A (en) * | 2013-11-25 | 2014-02-19 | 湖南强军科技有限公司 | Method and device for processing collected data by means of electromagnetic method exploration system |
| CN103678522A (en) * | 2013-11-28 | 2014-03-26 | 许继电气股份有限公司 | Method for acquiring and converting data of metering system of intelligent transformer substation |
| CN103617592A (en) * | 2013-11-28 | 2014-03-05 | 中国科学院光电研究院 | Hyperspectral image high-speed parallel processing system and method based on FPGA and multiple DSPs |
| CN104683445A (en) * | 2015-01-26 | 2015-06-03 | 北京邮电大学 | Distributed real-time data fusion system |
| CN204496485U (en) * | 2015-04-14 | 2015-07-22 | 北京宏锐星通科技有限公司 | A kind of I/O assisted access device based on high-speed data acquisition storage system |
| CN106020777A (en) * | 2016-04-29 | 2016-10-12 | 杭州华橙网络科技有限公司 | Data processing method, device and system |
| CN106095832A (en) * | 2016-06-01 | 2016-11-09 | 东软集团股份有限公司 | Distributed parallel processing method and device |
| CN106019395A (en) * | 2016-07-14 | 2016-10-12 | 中国地质大学（北京） | Electrical method receiving and processing system and method thereof based on correlation identification |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2018120705A1 (en) * | 2016-12-29 | 2018-07-05 | 深圳前海弘稼科技有限公司 | Data processing method, apparatus and system |
| WO2019140645A1 (en) * | 2018-01-19 | 2019-07-25 | 深圳市大疆创新科技有限公司 | Data processing method and device, controller and movable device |
| CN109460289A (en) * | 2018-08-21 | 2019-03-12 | 深圳市华力特电气有限公司 | A kind of building data processing system and method |
| CN110430229A (en) * | 2019-06-19 | 2019-11-08 | 特斯联（北京）科技有限公司 | Intelligence community Internet of Things heat transfer agent acquisition processing system and method based on cloud platform |
| CN110413540A (en) * | 2019-06-28 | 2019-11-05 | 苏州浪潮智能科技有限公司 | A kind of method, system, equipment and the storage medium of FPGA data caching |
| CN110413540B (en) * | 2019-06-28 | 2021-07-16 | 苏州浪潮智能科技有限公司 | Method, system, equipment and storage medium for FPGA data caching |
| CN114070718A (en) * | 2021-10-19 | 2022-02-18 | 深圳市有方科技股份有限公司 | Alarm method, alarm device and storage medium |
| CN114070718B (en) * | 2021-10-19 | 2023-11-21 | 深圳市有方科技股份有限公司 | Alarm method, alarm device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2018120705A1 (en) | 2018-07-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106649140A (en) | Data processing method, apparatus and system | |
| CN101753451B (en) | Network load balance track traffic signal equipment state collection method | |
| CN105897365B (en) | A kind of protecting against shock processing method and processing device of processor | |
| CN101547150B (en) | method and device for scheduling data communication input port | |
| CN112084016B (en) | Stream computing performance optimization system and method based on flink | |
| WO2016188187A1 (en) | Testing method and device for passive optical network alarm | |
| CN106294511B (en) | A kind of storage method and device of Hadoop distributed file system | |
| CN101114946A (en) | Method for collecting performance object data in telecommunication network management system | |
| CN104125013B (en) | Passive optical network performance data collecting device and passive optical network performance data processing method | |
| CN111131082A (en) | Charging facility data transmission dynamic control method and system | |
| CN107135088A (en) | The method and apparatus that daily record is handled in cloud computing system | |
| CN109379305A (en) | A kind of data distributing method, device, server and storage medium | |
| CN105337957A (en) | SDN network DDoS and DLDoS distributed space-time detection system | |
| CN108234189A (en) | A kind of alarm data treating method and apparatus | |
| CN101420419B (en) | Adaptive high-speed network flow layered sampling and collecting method | |
| CN103678522B (en) | A kind of data acquisition of intelligent substation metering system and conversion method | |
| CN114675983A (en) | Business data processing method and device, storage medium and electronic equipment | |
| CN105049115B (en) | A kind of dormancy method and system based on EPON | |
| CN101645736A (en) | Detection method and device of validity of historical performance data | |
| CN109245919A (en) | Mobile network comprehensive alarm management system | |
| CN108809716A (en) | A kind of method and apparatus of gathered data audit | |
| CN113590385A (en) | Automatic backup system for file uploading and backup method thereof | |
| CN113204464A (en) | Real-time service monitoring method, system, terminal and medium based on service scene | |
| CN105515842B (en) | A kind of general polling system and querying method based on network data | |
| CN102013996B (en) | Data acquisition management method and system and telecommunication network management system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 518052 Guangdong city of Shenzhen province Qianhai Shenzhen Hong Kong cooperation zone before Bay Road No. 1 building 201 room A (located in Shenzhen Qianhai business secretary Co. Ltd.) Applicant after: Shenzhen Chun Mu source Holdings Limited Address before: 518052 Guangdong city of Shenzhen province Qianhai Shenzhen Hong Kong cooperation zone before Bay Road No. 1 building 201 room A Applicant before: Shenzhen Qianhai Hong Jia Technology Co., Ltd. |
|
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170510 |