CN106649140A - Data processing method, apparatus and system - Google Patents

Data processing method, apparatus and system Download PDF

Info

Publication number
CN106649140A
CN106649140A CN201611248259.3A CN201611248259A CN106649140A CN 106649140 A CN106649140 A CN 106649140A CN 201611248259 A CN201611248259 A CN 201611248259A CN 106649140 A CN106649140 A CN 106649140A
Authority
CN
China
Prior art keywords
data processing
data
processing unit
gathered
release
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201611248259.3A
Other languages
Chinese (zh)
Inventor
王刚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Qianhai Hongjia Technology Co Ltd
Original Assignee
Shenzhen Qianhai Hongjia Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Qianhai Hongjia Technology Co Ltd filed Critical Shenzhen Qianhai Hongjia Technology Co Ltd
Priority to CN201611248259.3A priority Critical patent/CN106649140A/en
Publication of CN106649140A publication Critical patent/CN106649140A/en
Priority to PCT/CN2017/090976 priority patent/WO2018120705A1/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02Addressing or allocation; Relocation
    • G06F12/08Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/0802Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
    • G06F12/0806Multiuser, multiprocessor or multiprocessing cache systems
    • G06F12/0811Multiuser, multiprocessor or multiprocessing cache systems with multilevel cache hierarchies
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00Accessing, addressing or allocating within memory systems or architectures
    • G06F12/02Addressing or allocation; Relocation
    • G06F12/08Addressing or allocation; Relocation in hierarchically structured memory systems, e.g. virtual memory systems
    • G06F12/0802Addressing of a memory level in which the access to the desired data or data block requires associative addressing means, e.g. caches
    • G06F12/0806Multiuser, multiprocessor or multiprocessing cache systems
    • G06F12/0842Multiuser, multiprocessor or multiprocessing cache systems for multiprocessing or multitasking
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/30Arrangements for executing machine instructions, e.g. instruction decode
    • G06F9/38Concurrent instruction execution, e.g. pipeline or look ahead
    • G06F9/3885Concurrent instruction execution, e.g. pipeline or look ahead using a plurality of independent parallel functional units

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Debugging And Monitoring (AREA)
  • Memory System Of A Hierarchy Structure (AREA)

Abstract

The invention discloses a data processing method, apparatus and system. The data processing method comprises the following steps: a cache queue caches the collected data collected by each acquisition device, and releases the cached collected data to each data processing unit according to a predetermined rule when the cache amount exceeds a predetermined number; and each data processing unit receives the released collected data and respectively initiates the respective data processing threads to process data to obtain the data processing result. It can be seen that the method can process the collected data collected by multiple acquisition devices in parallel, give full play to the CPU processing capacity, reduce the backlog of collected data and improve the overall data processing speed, so the monitoring real-time performance is high.

Description

A kind of data processing method, apparatus and system
Technical field
The present invention relates to technical field of data processing, more particularly to a kind of data processing method, apparatus and system.
Background technology
Data processing technique is widely used in industry-by-industry, such as, in agricultural planting industry, need substantial amounts of collecting device, Such as sensor etc. carries out data acquisition to plantation scene, then fills the data for collecting by network transmission to data processing In putting, the data processing work of correlation is carried out, result is sent to server by final data processing meanss, right so as to realize The long-range monitoring at plantation scene.Due to plantation scene collecting device it is very many, therefore, the workload of data processing equipment is very Greatly.
The flow chart of data processing of existing data processing equipment is:The data for collecting directly are processed, due to it Tupe is serial process, therefore when pending data is very more, overstocking for data just occurs, if data above Do not processed, then behind data just have to wait for, therefore the speed of data processing is very slow, it is impossible to carry to server in time For result, cause real-time in monitoring process poor.
As can be seen here, the shortcoming of the data processing method of data processing equipment in prior art how is overcome, so as to improve The real-time and processing speed of monitoring is those skilled in the art's problem demanding prompt solution.
The content of the invention
It is an object of the invention to provide a kind of data processing method, apparatus and system, for overcoming prior art in data The shortcoming of the data processing method of processing meanss, so as to improve the real-time and processing speed of monitoring.
To solve above-mentioned technical problem, the present invention provides a kind of data processing method, including:
The gathered data caching that buffer queue collects each collecting device, and in buffer memory a predetermined level is exceeded, will The gathered data for having cached is discharged to each data processing unit according to pre-defined rule;
Each data processing unit receives the gathered data of release, and being respectively started respective data processing threads is carried out at data Manage to obtain data processed result.
Preferably, each data processing unit receives the gathered data of release, is respectively started respective data processing line Cheng Jinhang data processings are specifically included with obtaining data processed result:
The gathered data of real-time reception release, and secondary caching;
Judge whether to reach respective release time;
If it is, the gathered data of secondary caching is all discharged, and start respective data processing threads and enter line number According to processing obtaining data processed result;
If it is not, then continuing to determine whether to reach respective release time.
Preferably, the data processing threads in each data processing unit are multiple.
Preferably, the described gathered data for having cached is discharged to each data processing unit according to pre-defined rule is specially: According to first in first out, enter the principle gathered data that cached of release for outing, it is current according to each data processing unit Process the gathered data that state assignment has been cached.
Preferably, the gathered data tool that the process state assignment current according to each data processing unit has been cached Body is:If available free data processing unit, the gathered data for having cached is distributed to into the data processing unit of free time, it is no Then, it is randomly assigned.
Preferably, also include:The data processed result is sent to monitoring server by each data processing unit.
Preferably, also include:The corresponding data processing unit output when the data processed result occurs abnormal is reported to the police Information, wherein including the identity information of collecting device in the gathered data, the prompt messages include correspondence Collecting device identity information.
Preferably, also include:Memory cell stores the data processed result of each data processing unit.
To solve above-mentioned technical problem, the present invention provides a kind of data processing equipment, including:
Buffer queue, for the gathered data caching for collecting each collecting device, and in buffer memory a predetermined level is exceeded When, the gathered data for having cached is discharged to each data processing unit according to pre-defined rule;
Multiple data processing units, each data processing unit is used to receive the gathered data of release, is respectively started respective Data processing threads carry out data processing to obtain data processed result.
Preferably, each data processing unit is specifically included:
Time caches flow module, for the gathered data of real-time reception release, and secondary caching;Judge whether to reach release Time;If it is, the gathered data of secondary caching is all discharged;If it is not, then continuing to determine whether to reach release time;
Stream process module, carries out data processing to obtain data processed result for starting the data processing threads of itself.
To solve above-mentioned technical problem, the present invention provides a kind of data handling system, including each collecting device, monitoring service Device, also including data processing equipment described above.
Data processing method provided by the present invention, including buffer queue delays the gathered data that each collecting device is collected Deposit, and in buffer memory a predetermined level is exceeded, the gathered data for having cached is discharged to each data processing list according to pre-defined rule Unit;Each data processing unit receives the gathered data of release, be respectively started respective data processing threads carry out data processing with Obtain data processed result.As can be seen here, the gathered data parallel processing that the method can be collected to multiple collecting devices, fills The disposal ability of CPU is waved in distribution, reduces overstocking for gathered data, the speed of overall data processing is improve, so as to monitoring Real-time is higher.Additionally, data processing equipment provided by the present invention and system, equally with above-mentioned beneficial effect.
Description of the drawings
In order to be illustrated more clearly that the embodiment of the present invention, the accompanying drawing to be used needed for embodiment will be done simply below Introduce, it should be apparent that, drawings in the following description are only some embodiments of the present invention, for ordinary skill people For member, on the premise of not paying creative work, can be with according to these other accompanying drawings of accompanying drawings acquisition.
Fig. 1 is a kind of flow chart of data processing method provided in an embodiment of the present invention;
Fig. 2 is a kind of structure chart of data processing equipment provided in an embodiment of the present invention;
Fig. 3 is the flow chart of another kind of data processing method provided in an embodiment of the present invention;
Fig. 4 is the structure chart of another kind of data processing equipment provided in an embodiment of the present invention;
Fig. 5 is a kind of structure chart of data handling system provided in an embodiment of the present invention.
Specific embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete Site preparation is described, it is clear that described embodiment is only a part of embodiment of the invention, rather than whole embodiments.Based on this Embodiment in invention, those of ordinary skill in the art are not under the premise of creative work is made, and what is obtained is every other Embodiment, belongs to the scope of the present invention.
The present invention core be to provide a kind of data processing method, apparatus and system, for overcoming prior art in data The shortcoming of processing method, so as to improve the real-time and processing speed of monitoring.
In order that those skilled in the art more fully understand the present invention program, with reference to the accompanying drawings and detailed description The present invention is described in further detail.
Fig. 1 is a kind of flow chart of data processing method provided in an embodiment of the present invention.As shown in figure 1, data processing side Method includes:
S10:The gathered data caching that buffer queue collects each collecting device, and in buffer memory a predetermined level is exceeded When, the gathered data for having cached is discharged to each data processing unit according to pre-defined rule.
S11:Each data processing unit receives the gathered data of release, is respectively started respective data processing threads and enters line number According to processing obtaining data processed result.
In order to become apparent from expressing the flow chart shown in Fig. 1, the present embodiment provides a kind of structure chart corresponding with the method.Figure 2 is a kind of structure chart of data processing equipment provided in an embodiment of the present invention.It should be noted that simply a kind of concrete in Fig. 2 Embodiment, the quantity at least two of the data processing unit 11 in data processing equipment 1.
As shown in Fig. 2 buffer queue 10 is used for caching the gathered data that each collecting device is collected, and cache, concrete In enforcement, it is different that collecting device may have the frequency acquisition of hundreds of or even thousand of, different collecting device, and this is resulted in adopts The amount of collection data does not have a fixed frequency, therefore, if according to the serial processing mode of prior art, carrying out a collection Data processing one, then same time CPU (CPU is the hardcore of data processing equipment, and current CPU is generally multinuclear, Such as double-core, four cores or more multinuclear, can the multiple data of parallel processing, and processing speed is without significantly reduction) can only locate One data of reason, therefore the superior function of CPU cannot be played, ultimately result in substantial amounts of data and overstock, cause the speed of data processing Degree is slowly.And the technical scheme that the present embodiment provides is adopted, gathered data is buffered in first in buffer queue 10, caches team The capacity of row 10 is generally very big, can simultaneously cache substantial amounts of gathered data.Buffer queue 10 is the data for having cached according to pre- Set pattern is then discharged in each data processing unit 11, and data processing unit 11 is called each after the gathered data for receiving release From data processing threads so that CPU carries out data processing to gathered data.
It should be noted that pre-defined rule can be arranged flexibly, for example, pre-defined rule is first in first out, enter one goes out one, and And according to the current process state assignment of each data processing unit, therefore as one kind preferred embodiment, by what is cached Gathered data discharges to each data processing unit according to pre-defined rule and is specially:According to first in first out, enter one and go out one principle to release The gathered data for having cached is put, according to the gathered data that the current process state assignment of each data processing unit has been cached.For example, If the capacity of buffer queue is 100, after the 101st gathered data is come in, first gathered data will be released.
Preferably, the gathered data for having cached according to the current process state assignment of each data processing unit is concrete For:If available free data processing unit, the gathered data for having cached is distributed to into the data processing unit of free time, it is no Then, it is randomly assigned.By such treatment mechanism, the performance of each data processing unit can be given full play to so that data processing Speed faster.
The data processing method that the present embodiment is provided, including buffer queue delays the gathered data that each collecting device is collected Deposit, and in buffer memory a predetermined level is exceeded, the gathered data for having cached is discharged to each data processing list according to pre-defined rule Unit;Each data processing unit receives the gathered data of release, be respectively started respective data processing threads carry out data processing with Obtain data processed result.As can be seen here, the gathered data parallel processing that the method can be collected to multiple collecting devices, fills The disposal ability of CPU is waved in distribution, reduces overstocking for gathered data, the speed of overall data processing is improve, so as to monitoring Real-time is higher.
It is understood that in being embodied as, how to carry out data processing, that is, adopt which kind of data processing method can be with Referring to the processing method of prior art, the present embodiment is repeated no more.Data processing equipment is completed after data processing, can be by data Result is sent to monitoring server or is stored in the memory cell of itself, and embodiment is repeated no more.
In the above-described embodiments, although the speed of overall data processing can be improved, but such processing mode makes Obtaining CPU needs to be constantly in armed state, and the impact of this performance to CPU is bigger than the impact for processing multiple data simultaneously to be obtained It is many.Based on this problem, in the present embodiment, it is achieved through the following technical solutions.Fig. 3 is another kind provided in an embodiment of the present invention The flow chart of data processing method.Preferably embodiment, step S11 is specifically included:
S110:The gathered data of real-time reception release, and secondary caching;
S111:Judge whether to reach respective release time;If it is, into step S112, otherwise, returning S111.
S112:The gathered data of secondary caching is all discharged, and starts respective data processing threads is carried out at data Manage to obtain data processed result.
In order to more clearly illustrate the flow chart shown in Fig. 3, the present embodiment provides the structure of corresponding data processing equipment Figure.Fig. 4 is the structure chart of another kind of data processing equipment provided in an embodiment of the present invention.
As shown in figure 4, each data processing unit 11 includes that the time caches flow module 110 and stream process module 111.For The embodiment of buffer queue 10 is same as above, and the present embodiment is repeated no more.Each time caching flow module 110 real-time reception delays The gathered data of the release of queue 10 is deposited, and is cached again.Each time stream cache module 110 has respective release time, its Working method is that arrival release time just discharges data, otherwise caches always.It should be noted that each time flows cache module 110 release time can be with identical, can be with difference.When respective release time has been arrived, then the gathered data of caching is all released Put to corresponding stream process module 111, to carry out data processing.The release time of each time stream cache module 10 is from the last time The moment of release data starts to calculate, if the cycle is 5 seconds, the moment of last time release data is that then this is released if 10 seconds The time of putting is exactly 15 seconds.Therefore, between 10-15 seconds when, time stream cache module 110 will not discharge data, then at stream Reason module 111 is in idle condition, then CPU is just idled accordingly, and in the CPU idle stages other behaviour can be just performed Make, it is obvious that can so improve the utilization rate of CPU.Illustrated with a specific example, time caching flow module can be set 110 deenergized period is 5 seconds, and stream process module 111 receives data, calls data processing threads to carry out needed for data processing Time is that if 1 second, then CPU can go out time of 4 seconds with the free time.
Preferably embodiment, the data processing threads in each data processing unit are multiple.
It is understood that the number of data processing threads is more, then the data volume that the same time can be processed will be more It is many, but the processing speed of CPU also can decline, therefore, data processing threads nor The more the better, and no more than The disposal ability of CPU.
On the basis of above-described embodiment, preferably embodiment, also includes:When exception occurs in data processed result When corresponding data processing unit export prompt messages, the identity information of collecting device is wherein included in gathered data, Identity information of the prompt messages comprising corresponding collecting device.
It is understood that collecting device has multiple, when data processed result occurs abnormal, pointed out, but such as Fruit does not know that, although can then play a part of alarm, positioning difficulty is very big if corresponding which collecting device. By the present embodiment, the effect of alarm not only can be realized, and can be automatically positioned.Data described in the present embodiment Result refers to gathered data extremely has deviation with data under normal circumstances, such as a temperature signal correspondence Gathered data, result under normal circumstances should be 20 degrees Celsius -35 degrees Celsius, once indicate that more than this scope It is 38 degrees Celsius that abnormal, such as current data processed result occurs in data processed result, then export prompt messages.
On the basis of above-described embodiment, preferably embodiment, also includes:Memory cell stores each data processing The data processed result of unit.
Subsequently check for convenience, stored the data processed result of each data processing unit in the present embodiment.Can To be understood by, can be same by the storage region storage of data processed result partitioned storage, i.e., according to data processing unit The data processed result of individual data processing unit, or can also be stored entirely in same storage region.
It is above the corresponding embodiment of data processing method, the reality of the corresponding device part of the method is given below Apply mode.
As shown in Fig. 2 data processing equipment 1, including:
Buffer queue 10, for the gathered data caching for collecting each collecting device, and exceedes predetermined number in buffer memory During amount, the gathered data for having cached is discharged to each data processing unit 11 according to pre-defined rule;
Multiple data processing units 11, each data processing unit is used to receive the gathered data of release, is respectively started each Data processing threads carry out data processing to obtain data processed result.
As shown in figure 4, used as preferred embodiment, each data processing unit 11 is specifically included:
Time caches flow module 110, for the gathered data of real-time reception release, and secondary caching;Judge whether to reach Release time;If it is, the gathered data of secondary caching is all discharged;If it is not, then continuing to determine whether to reach release Time;
Stream process module 111, carries out data processing to obtain data processing knot for starting the data processing threads of itself Really.
Due to the embodiment of device part it is mutually corresponding with the embodiment of method part, therefore the embodiment of device part please Referring to the description of the embodiment of method part, wouldn't repeat here.
The data processing equipment that the present embodiment is provided, including buffer queue, for the collection for collecting each collecting device Data buffer storage, and in buffer memory a predetermined level is exceeded, the gathered data for having cached is discharged to each data according to pre-defined rule Processing unit;Multiple data processing units, each data processing unit is used to receive the gathered data of release, is respectively started respective Data processing threads carry out data processing to obtain data processed result.As can be seen here, the device can be to multiple collecting devices The gathered data parallel processing for collecting, gives full play to the disposal ability of CPU, reduces overstocking for gathered data, improves entirety Data processing speed, so as to monitoring real-time it is higher.
In addition, the present invention also provides a kind of system comprising above-mentioned data processing equipment, i.e. data handling system, the data Processing system includes each collecting device 2, monitoring server 3, also including the data processing equipment 1 described in above-described embodiment.
Due to the embodiment of components of system as directed it is mutually corresponding with the embodiment of device part, therefore the embodiment of components of system as directed please Referring to the description of the embodiment of device part, wouldn't repeat here.
The data handling system that the present embodiment is provided, including the data processing equipment described in above-described embodiment, at the data Reason device includes buffer queue, for the gathered data caching for collecting each collecting device, and exceedes predetermined number in buffer memory During amount, the gathered data for having cached is discharged to each data processing unit according to pre-defined rule;Multiple data processing units, each number It is used to receive the gathered data of release according to processing unit, being respectively started respective data processing threads carries out data processing to obtain Data processed result.As can be seen here, the gathered data parallel processing that the device can be collected to multiple collecting devices, fully sends out The disposal ability of CPU is waved, overstocking for gathered data is reduced, the speed of overall data processing is improve, it is real-time so as to what is monitored Property is higher.In sum, the data handling system that the present embodiment is provided also has corresponding advantage.
A kind of data processing method provided by the present invention, apparatus and system are described in detail above.Specification In each embodiment described by the way of progressive, what each embodiment was stressed be it is different from other embodiment it Place, between each embodiment identical similar portion mutually referring to.For device disclosed in embodiment, due to itself and reality Apply that method disclosed in example is corresponding, so description is fairly simple, related part is referring to method part illustration.Should refer to Go out, for those skilled in the art, under the premise without departing from the principles of the invention, can also be to the present invention Some improvement and modification are carried out, these are improved and modification is also fallen in the protection domain of the claims in the present invention.
Also, it should be noted that in this manual, such as first and second or the like relational terms be used merely to by One entity or operation make a distinction with another entity or operation, and not necessarily require or imply these entities or operation Between there is any this actual relation or order.And, term " including ", "comprising" or its any other variant meaning Covering including for nonexcludability, so that a series of process, method, article or equipment including key elements not only includes that A little key elements, but also including other key elements being not expressly set out, or also include for this process, method, article or The intrinsic key element of equipment.In the absence of more restrictions, the key element for being limited by sentence "including a ...", does not arrange Except also there is other identical element in including the process of the key element, method, article or equipment.

Claims (11)

1. a kind of data processing method, it is characterised in that include:
The gathered data caching that buffer queue collects each collecting device, and in buffer memory a predetermined level is exceeded, will delay The gathered data deposited is discharged to each data processing unit according to pre-defined rule;
Each data processing unit receives the gathered data of release, be respectively started respective data processing threads carry out data processing with Obtain data processed result.
2. data processing method according to claim 1, it is characterised in that each data processing unit receives release Gathered data, is respectively started respective data processing threads and carries out data processing and specifically included with obtaining data processed result:
The gathered data of real-time reception release, and secondary caching;
Judge whether to reach respective release time;
If it is, the gathered data of secondary caching is all discharged, and start respective data processing threads and carry out at data Manage to obtain data processed result;
If it is not, then continuing to determine whether to reach respective release time.
3. data processing method according to claim 2, it is characterised in that at the data in each data processing unit Reason thread is multiple.
4. data processing method according to claim 1, it is characterised in that it is described by the gathered data for having cached according to pre- Set pattern then discharges to each data processing unit and is specially:According to first in first out, enter the principle collection that cached of release for outing Data, according to the gathered data that the current process state assignment of each data processing unit has been cached.
5. data processing method according to claim 4, it is characterised in that described to work as according to each data processing unit The gathered data that front process state assignment has been cached is specially:If available free data processing unit, by what is cached Gathered data distributes to the data processing unit of free time, otherwise, is randomly assigned.
6. data processing method according to claim 1, it is characterised in that also include:Each data processing unit will The data processed result is sent to monitoring server.
7. data processing method according to claim 1, it is characterised in that also include:When the data processed result goes out Corresponding data processing unit exports prompt messages when now abnormal, wherein including collecting device in the gathered data Identity information, identity information of the prompt messages comprising corresponding collecting device.
8. data processing method according to claim 1, it is characterised in that also include:Memory cell stores each number According to the data processed result of processing unit.
9. a kind of data processing equipment, it is characterised in that include:
Buffer queue, for the gathered data caching for collecting each collecting device, and in buffer memory a predetermined level is exceeded, will The gathered data for having cached is discharged to each data processing unit according to pre-defined rule;
Multiple data processing units, each data processing unit is used to receive the gathered data of release, is respectively started respective data Processing thread carries out data processing to obtain data processed result.
10. data processing equipment according to claim 9, it is characterised in that each data processing unit is specifically included:
Time caches flow module, for the gathered data of real-time reception release, and secondary caching;When judging whether to reach release Between;If it is, the gathered data of secondary caching is all discharged;If it is not, then continuing to determine whether to reach release time;
Stream process module, carries out data processing to obtain data processed result for starting the data processing threads of itself.
A kind of 11. data handling systems, including each collecting device, monitoring server, it is characterised in that also including claim 9 Or the data processing equipment described in 10.
CN201611248259.3A 2016-12-29 2016-12-29 Data processing method, apparatus and system Pending CN106649140A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201611248259.3A CN106649140A (en) 2016-12-29 2016-12-29 Data processing method, apparatus and system
PCT/CN2017/090976 WO2018120705A1 (en) 2016-12-29 2017-06-30 Data processing method, apparatus and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611248259.3A CN106649140A (en) 2016-12-29 2016-12-29 Data processing method, apparatus and system

Publications (1)

Publication Number Publication Date
CN106649140A true CN106649140A (en) 2017-05-10

Family

ID=58836359

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611248259.3A Pending CN106649140A (en) 2016-12-29 2016-12-29 Data processing method, apparatus and system

Country Status (2)

Country Link
CN (1) CN106649140A (en)
WO (1) WO2018120705A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018120705A1 (en) * 2016-12-29 2018-07-05 深圳前海弘稼科技有限公司 Data processing method, apparatus and system
CN109460289A (en) * 2018-08-21 2019-03-12 深圳市华力特电气有限公司 A kind of building data processing system and method
WO2019140645A1 (en) * 2018-01-19 2019-07-25 深圳市大疆创新科技有限公司 Data processing method and device, controller and movable device
CN110413540A (en) * 2019-06-28 2019-11-05 苏州浪潮智能科技有限公司 A kind of method, system, equipment and the storage medium of FPGA data caching
CN110430229A (en) * 2019-06-19 2019-11-08 特斯联(北京)科技有限公司 Intelligence community Internet of Things heat transfer agent acquisition processing system and method based on cloud platform
CN114070718A (en) * 2021-10-19 2022-02-18 深圳市有方科技股份有限公司 Alarm method, alarm device and storage medium

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114338556A (en) * 2022-01-07 2022-04-12 南昌济铃新能源科技有限责任公司 Message forwarding method between CAN network and vehicle-mounted Ethernet and gateway system
CN115048149A (en) * 2022-05-23 2022-09-13 杨正 Application cache scalable processing method, device, equipment and medium

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7661036B1 (en) * 2005-11-08 2010-02-09 Oakley Networks Cache for collecting events on a monitored computer
CN102831091A (en) * 2012-07-31 2012-12-19 宁波成电泰克电子信息技术发展有限公司 Serial port-based ship radar echo data collecting method
CN103207775A (en) * 2013-03-11 2013-07-17 中国科学技术大学苏州研究院 Processing method for adopting graphic processing unit (GPU) to accelerate real-time network flow application program
CN103384206A (en) * 2012-05-02 2013-11-06 中国科学院计算机网络信息中心 Concurrent processing method and system for mass data
CN103593307A (en) * 2013-11-25 2014-02-19 湖南强军科技有限公司 Method and device for processing collected data by means of electromagnetic method exploration system
CN103617592A (en) * 2013-11-28 2014-03-05 中国科学院光电研究院 Hyperspectral image high-speed parallel processing system and method based on FPGA and multiple DSPs
CN103678522A (en) * 2013-11-28 2014-03-26 许继电气股份有限公司 Method for acquiring and converting data of metering system of intelligent transformer substation
US20150032992A1 (en) * 2013-07-29 2015-01-29 Infineon Technologies Ag Data processing arrangement and method for data processing
CN104683445A (en) * 2015-01-26 2015-06-03 北京邮电大学 Distributed real-time data fusion system
CN204496485U (en) * 2015-04-14 2015-07-22 北京宏锐星通科技有限公司 A kind of I/O assisted access device based on high-speed data acquisition storage system
CN106020777A (en) * 2016-04-29 2016-10-12 杭州华橙网络科技有限公司 Data processing method, device and system
CN106019395A (en) * 2016-07-14 2016-10-12 中国地质大学(北京) Electrical method receiving and processing system and method thereof based on correlation identification
CN106095832A (en) * 2016-06-01 2016-11-09 东软集团股份有限公司 Distributed parallel processing method and device

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6832329B2 (en) * 2001-02-08 2004-12-14 International Business Machines Corporation Cache thresholding method, apparatus, and program for predictive reporting of array bit line or driver failures
CN101786384A (en) * 2010-01-07 2010-07-28 浙江大学 Interface conversion system for digital decorating machine and data transmission method
CN102542635A (en) * 2012-02-09 2012-07-04 重庆长安汽车股份有限公司 Car recorder combined with lane deviation alarming system
CN103678078B (en) * 2012-09-25 2016-05-11 深圳市中兴微电子技术有限公司 A kind of debug system and method
CN104422694A (en) * 2013-09-11 2015-03-18 法国圣戈班玻璃公司 Processing device and processing method of measured data as well as optical measurement system
CN106649140A (en) * 2016-12-29 2017-05-10 深圳前海弘稼科技有限公司 Data processing method, apparatus and system

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7661036B1 (en) * 2005-11-08 2010-02-09 Oakley Networks Cache for collecting events on a monitored computer
CN103384206A (en) * 2012-05-02 2013-11-06 中国科学院计算机网络信息中心 Concurrent processing method and system for mass data
CN102831091A (en) * 2012-07-31 2012-12-19 宁波成电泰克电子信息技术发展有限公司 Serial port-based ship radar echo data collecting method
CN103207775A (en) * 2013-03-11 2013-07-17 中国科学技术大学苏州研究院 Processing method for adopting graphic processing unit (GPU) to accelerate real-time network flow application program
US20150032992A1 (en) * 2013-07-29 2015-01-29 Infineon Technologies Ag Data processing arrangement and method for data processing
CN103593307A (en) * 2013-11-25 2014-02-19 湖南强军科技有限公司 Method and device for processing collected data by means of electromagnetic method exploration system
CN103678522A (en) * 2013-11-28 2014-03-26 许继电气股份有限公司 Method for acquiring and converting data of metering system of intelligent transformer substation
CN103617592A (en) * 2013-11-28 2014-03-05 中国科学院光电研究院 Hyperspectral image high-speed parallel processing system and method based on FPGA and multiple DSPs
CN104683445A (en) * 2015-01-26 2015-06-03 北京邮电大学 Distributed real-time data fusion system
CN204496485U (en) * 2015-04-14 2015-07-22 北京宏锐星通科技有限公司 A kind of I/O assisted access device based on high-speed data acquisition storage system
CN106020777A (en) * 2016-04-29 2016-10-12 杭州华橙网络科技有限公司 Data processing method, device and system
CN106095832A (en) * 2016-06-01 2016-11-09 东软集团股份有限公司 Distributed parallel processing method and device
CN106019395A (en) * 2016-07-14 2016-10-12 中国地质大学(北京) Electrical method receiving and processing system and method thereof based on correlation identification

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018120705A1 (en) * 2016-12-29 2018-07-05 深圳前海弘稼科技有限公司 Data processing method, apparatus and system
WO2019140645A1 (en) * 2018-01-19 2019-07-25 深圳市大疆创新科技有限公司 Data processing method and device, controller and movable device
CN109460289A (en) * 2018-08-21 2019-03-12 深圳市华力特电气有限公司 A kind of building data processing system and method
CN110430229A (en) * 2019-06-19 2019-11-08 特斯联(北京)科技有限公司 Intelligence community Internet of Things heat transfer agent acquisition processing system and method based on cloud platform
CN110413540A (en) * 2019-06-28 2019-11-05 苏州浪潮智能科技有限公司 A kind of method, system, equipment and the storage medium of FPGA data caching
CN110413540B (en) * 2019-06-28 2021-07-16 苏州浪潮智能科技有限公司 Method, system, equipment and storage medium for FPGA data caching
CN114070718A (en) * 2021-10-19 2022-02-18 深圳市有方科技股份有限公司 Alarm method, alarm device and storage medium
CN114070718B (en) * 2021-10-19 2023-11-21 深圳市有方科技股份有限公司 Alarm method, alarm device and storage medium

Also Published As

Publication number Publication date
WO2018120705A1 (en) 2018-07-05

Similar Documents

Publication Publication Date Title
CN106649140A (en) Data processing method, apparatus and system
CN101753451B (en) Network load balance track traffic signal equipment state collection method
CN105897365B (en) A kind of protecting against shock processing method and processing device of processor
CN101547150B (en) method and device for scheduling data communication input port
CN112084016B (en) Stream computing performance optimization system and method based on flink
WO2016188187A1 (en) Testing method and device for passive optical network alarm
CN106294511B (en) A kind of storage method and device of Hadoop distributed file system
CN101114946A (en) Method for collecting performance object data in telecommunication network management system
CN104125013B (en) Passive optical network performance data collecting device and passive optical network performance data processing method
CN111131082A (en) Charging facility data transmission dynamic control method and system
CN107135088A (en) The method and apparatus that daily record is handled in cloud computing system
CN109379305A (en) A kind of data distributing method, device, server and storage medium
CN105337957A (en) SDN network DDoS and DLDoS distributed space-time detection system
CN108234189A (en) A kind of alarm data treating method and apparatus
CN101420419B (en) Adaptive high-speed network flow layered sampling and collecting method
CN103678522B (en) A kind of data acquisition of intelligent substation metering system and conversion method
CN114675983A (en) Business data processing method and device, storage medium and electronic equipment
CN105049115B (en) A kind of dormancy method and system based on EPON
CN101645736A (en) Detection method and device of validity of historical performance data
CN109245919A (en) Mobile network comprehensive alarm management system
CN108809716A (en) A kind of method and apparatus of gathered data audit
CN113590385A (en) Automatic backup system for file uploading and backup method thereof
CN113204464A (en) Real-time service monitoring method, system, terminal and medium based on service scene
CN105515842B (en) A kind of general polling system and querying method based on network data
CN102013996B (en) Data acquisition management method and system and telecommunication network management system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: 518052 Guangdong city of Shenzhen province Qianhai Shenzhen Hong Kong cooperation zone before Bay Road No. 1 building 201 room A (located in Shenzhen Qianhai business secretary Co. Ltd.)

Applicant after: Shenzhen Chun Mu source Holdings Limited

Address before: 518052 Guangdong city of Shenzhen province Qianhai Shenzhen Hong Kong cooperation zone before Bay Road No. 1 building 201 room A

Applicant before: Shenzhen Qianhai Hong Jia Technology Co., Ltd.

RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20170510