CN106570064A - Real time calculating system and method for general structural data - Google Patents
Real time calculating system and method for general structural data Download PDFInfo
- Publication number
- CN106570064A CN106570064A CN201610883247.1A CN201610883247A CN106570064A CN 106570064 A CN106570064 A CN 106570064A CN 201610883247 A CN201610883247 A CN 201610883247A CN 106570064 A CN106570064 A CN 106570064A
- Authority
- CN
- China
- Prior art keywords
- real time
- unit
- data
- data message
- real
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention discloses a real time calculating system and method for general structural data, and belongs to the technical field of data processing. The real time calculating system for general structural data includes an expansion unit, a basic processing unit, and a real time calculating unit. The real time calculating method for general structural data includes the steps: S1, utilizing a basic processing unit to analyze and process the data information collected from a business layer according to a processing model stored in an expansion unit, and outputting the analyzed data information; S2, utilizing a real time calculating unit to calculate the analyzed data information output from the basic processing unit in real time according to a query model in the expansion unit so as to obtain a calculating result; and S3, utilizing the real time calculating unit to feed back the calculating result to the basic processing unit. The real time calculating system and method for general structural data can quickly extract and obtain valid and useful data information from a bulk of big data through calculation, thus reducing the cost of calculating big data and improving the calculating efficiency.
Description
Technical field
The present invention relates to technical field of data processing, more particularly to a kind of universal architecture data real time computation system and
Method.
Background technology
With the fast development of Internet technology, Internet enterprises and various electric business platforms are all producing sea all the time
The data of amount, these tidal data recoverings together, for data processing and in real time calculating causes very big difficulty.
Traditional mode for being calculated magnanimity big data and being extracted typically has two kinds：
1. the data that pair history is produced carry out Multiple-Scan on a large scale, then scan data is screened and is calculated.The party
Method easily causes time and waste spatially than relatively time-consuming.
2. a set of single computing system is developed respectively according to each different service line, with to producing on single service line
Raw data are calculated in real time.It is that each service line develops respectively one because Internet enterprises generally have multiple service lines
Set computing system simultaneously carries out calculating in real time human and material resources and the financial resources for needing input more, and this is for Internet enterprises
A kind of very big waste.Also, the data volume on different service lines is unbalanced, and this results in different computing systems
Amount of calculation it is also different, the process resource of some computing systems can be wasted.
The content of the invention
According to the above-mentioned problems in the prior art, now provide a kind of universal architecture data real time computation system and
The technical scheme of method, it is intended to effectively useful data message is quickly extracted and be calculated from magnanimity big data, reduces big
The cost that data are calculated, lifts computational efficiency；
Above-mentioned technical proposal is specifically included：
A kind of real time computation system of universal architecture data, wherein, including：
Expanding element, there is provided process model for performing data processing is preset and preserved to user and for performing data
The interrogation model of inquiry；
Based process unit, connects the expanding element, right for according to the process model preserved in the expanding element
The data message collected from operation layer carries out dissection process, and exports the data message through parsing；
In real time computing unit, connects respectively the based process unit and the expanding element, for according to the expanding element
The interrogation model of middle preservation, the data message through parsing to exporting in the based process unit is carried out in real time
Calculate, obtain result of calculation and feed back to the based process unit.
Preferably, the real time computation system, wherein, also include：
Medium unit, connects respectively the expanding element and the based process unit, and the medium unit is used for：
The data message for carrying out real-time calculating is collected from operation layer；And
Collection feeds back to the result of calculation of the based process unit.
Preferably, the real time computation system, wherein, the interrogation model is self-defining structured query sentence.
Preferably, the real time computation system, wherein, the medium unit is the message-oriented middleware of system.
Preferably, the real time computation system, wherein, also include：
Service unit, connects the medium unit, for obtaining the result of calculation that the medium unit collects and exporting.
Preferably, the real time computation system, wherein, the service unit is in the way of restful services by the calculating
As a result externally expose.
Preferably, the real time computation system, wherein, also include：
Display unit, connects the service unit, for obtaining the result of calculation of the service unit output, and will be described
Result of calculation real-time exhibition is checked to user.
Preferably, the real time computation system, wherein, the based process unit includes：
At least one authentication module, is respectively used to verify the legitimacy of the data message；
At least one processing module, connects respectively each described authentication module, and each described processing module is respectively used to passing through
The data message of verification carries out the dissection process；
Management module, connects respectively each described authentication module and each described processing module, for respectively to testing each Suo Shu
The working condition of card module and each processing module is managed.
Preferably, the real time computation system, wherein, include respectively in each described processing module：
Filter, for filtering to the abnormal data in the data message of verification；
Resolver, connects the filter, for according to the process model, solving to the data message through filtering
Analysis, to obtain the analysis result；
Processor, connects respectively the filter and the resolver, normal for controlling the filter and the resolver
Operation.
Preferably, the real time computation system, wherein, the expanding element includes：
First definition module, there is provided the data model is preset to user；
Second definition module, there is provided the interrogation model is preset to user；
3rd definition module, there is provided the composition structure that needs are carried out with the real-time data message for calculating to user carries out pre-
If.
A kind of real-time computing technique of universal architecture data, wherein, there is provided preset to user and preserve for performing
The process model of data processing and the interrogation model for performing data query, also include：
Step S1, using a based process unit according to the process model preserved in the expanding element, to from operation layer
The data message collected carries out dissection process, and exports the data message through parsing；
Step S2, using a real-time computing unit according to the interrogation model preserved in the expanding element, to the basis
The data message through parsing exported in processing unit is calculated in real time, to obtain result of calculation；
Step S3, the based process unit is fed back to using the real-time computing unit by the result of calculation.
The beneficial effect of above-mentioned technical proposal is：
1）A kind of real time computation system is provided, effectively useful data quickly can be extracted and be calculated from magnanimity big data
Information, reduces the cost that big data is calculated, and lifts computational efficiency；
2）There is provided a kind of real-time computing technique, it would be preferable to support above-mentioned real time computation system normally runs.
Description of the drawings
Fig. 1 is a kind of general structure schematic diagram of real time computation system in the preferred embodiment of the present invention；
Fig. 2 is the structural representation of based process unit in the preferred embodiment of the present invention；
Fig. 3 is the structural representation of expanding element in the preferred embodiment of the present invention；
Fig. 4 is the application framework figure of real time computation system in the preferred embodiment of the present invention；
Fig. 5 is a kind of schematic flow sheet of real-time computing technique in the preferred embodiment of the present invention.
Specific embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation is described, it is clear that described embodiment is only a part of embodiment of the invention, rather than the embodiment of whole.It is based on
Embodiment in the present invention, those of ordinary skill in the art obtained on the premise of creative work is not made it is all its
His embodiment, belongs to the scope of protection of the invention.
It should be noted that in the case where not conflicting, the embodiment and the feature in embodiment in the present invention can phase
Mutually combination.
Below in conjunction with the accompanying drawings the invention will be further described with specific embodiment, but not as limiting to the invention.
In the preferred embodiment of the present invention, based on the above-mentioned problems in the prior art, a kind of general knot is now provided
The real time computation system of structure data.The real time computation system is applied to the real-time calculating of universal architecture data, so-called general
Structural data, refers to the conventional data being stored in certain storage form in data base.
Then the concrete structure of above-mentioned real time computation system as shown in fig. 1, including：
Expanding element 1, there is provided process model for performing data processing is preset and preserved to user and for performing number
It is investigated that the interrogation model ask；
Based process unit 2, connects expanding element 1, for according to the process model preserved in expanding element 1, to from operation layer
The data message collected carries out dissection process, and exports the data message through parsing；
In real time computing unit 3, connects respectively basic processing unit 2 and expanding element 1, for according to preservation in expanding element 1
Interrogation model, the data message through parsing to exporting in based process unit 2 is calculated in real time, obtains result of calculation simultaneously
Feed back to based process unit 2.
Specifically, in above-described embodiment, an expanding element 1 is provided first, the expanding element 1 supplies the self-defined establishment of user
For carrying out the process model of data filtering and parsing etc. reason mode, and create for carrying out data for user is self-defined
Real-time query and calculate interrogation model.It is available for users in above-mentioned expanding element 1 and presets and preserve multiple different data
Model, and multiple different interrogation models, different data model/interrogation model can be used to be constituted corresponding to different pieces of information
The data message of structure.
Then in above-described embodiment, the data mould preserved in above-mentioned expanding element 1 is obtained using a based process unit 2
Type, and according to the data model, the data message to producing in operation layer carries out real-time processing, exports the number through real-time processing
It is believed that breath.Specifically, the mode of above-mentioned real-time processing is that data message is filtered, and using above-mentioned data model logarithm
It is believed that breath is parsed.If the data model only one of which preset in above-mentioned expanding element 1 and preserve, based process unit
2 directly carry out the parsing of data message using the data model；If the data preset in above-mentioned expanding element 1 and preserve
Model has multiple, then based process unit 2 can as needed carry out the composition structure of the data message of real-time calculating, and it is right to select
The data model answered is filtered and parsed, in this case, process of the user in preset data model/interrogation model
In, need the composition structure of the data message of default each data model/interrogation model of correspondence simultaneously, that is, constitute above-mentioned a few classes pre-
If the incidence relation between model and composition structure, in order to based process unit 2 corresponding data model is selected.
In above-described embodiment, based process unit 2 can be defeated by data message after data message is filtered and parsed
Go out to above-mentioned real-time computing unit 3.In real time computing unit 3 is according to the interrogation model pair preset in above-mentioned expanding element 1 and preserve
Above-mentioned data message is calculated in real time, and exports final result of calculation.Similarly, if only preserving in above-mentioned expanding element 1
There is a default interrogation model, then the data letter that real-time computing unit 3 is directly calculated needs according to the interrogation model
Breath is calculated in real time；If preserving multiple queries model in above-mentioned expanding element 1, real-time computing unit 3 by need into
The corresponding interrogation model of composition structure choice of the data message that row is calculated in real time is simultaneously calculated in real time.
In above-described embodiment, most at last calculated result of calculation feeds back to based process to above-mentioned real-time computing unit 3
In unit 2, and by based process unit 2 result of calculation is exported by different approach and checked to user（Hereinafter can
Describe in detail）.
In the preferred embodiment of the present invention, still as shown in figure 1, above-mentioned real time computation system also includes：
Medium unit 4, connects respectively expanding element 1 and based process unit 2.Above-mentioned medium unit 4 is used for：
1）The data message for carrying out real-time calculating is collected from operation layer；And
2）Collection feeds back to the result of calculation of based process unit.
Specifically, in preferred embodiment of the invention, above-mentioned medium unit 4 has two effects, one act on be from
Operation layer collects the data message that the needs for producing in real time are calculated, then above-mentioned based process unit 2 is from above-mentioned medium unit 4
The middle data message collected, and reason is filtered and parsed etc. using default data model；Another effect is
The result of calculation of the above-mentioned feedback of real-time computing unit 3 is collected from based process unit 2, i.e., based process unit 2 is from meter in real time
Calculate and received after result of calculation in unit 3, the result of calculation is sent to medium unit 4.
In the preferred embodiment of the present invention, above-mentioned interrogation model is structured query sentence（Structured Query
Language, SQL）.Above-mentioned real-time computing unit by using person's SQL query statement set in advance, from the number through filtering
It is believed that inquiry obtains needing the data message for carrying out real-time calculating and carrying out calculating process in breath.
The present invention preferred embodiment in, above-mentioned medium unit 4 for system message-oriented middleware, i.e., above-mentioned medium unit
4 is message-oriented middleware unit.
In the preferred embodiment of the present invention, still as shown in figure 1, also including in above-mentioned real time computation system：
Service unit 5, connects medium unit 4, for obtaining result of calculation that medium unit 4 collects and exporting；
Display unit 6, Connection Service unit 5 is for obtaining the result of calculation of the output of service unit 5 and result of calculation is real-time
User is showed to check.
Specifically, in preferred embodiment of the invention, above-mentioned service unit 5 obtains the meter collected from medium unit 4
Result is calculated, and is externally exposed in the form of restful services.
Then above-mentioned display unit 6 obtains above-mentioned result of calculation from service unit 6 and goes forward side by side by corresponding restful services
Row real-time exhibition, in order to the variation tendency that user checks data in result of calculation.
In one preferred embodiment of the present invention, above-mentioned service unit 5 and display unit 6 may be located at one it is long-range
In service end（Not shown in figure）, and realize and the remote data transmission between medium unit 4.
In the preferred embodiment of the present invention, as shown in Fig. 2 above-mentioned based process unit 2 includes：
At least one authentication module 21, is respectively used to verify the legitimacy of data message；
At least one processing module 22, connects respectively each authentication module 21, and each processing module 22 is respectively used to through school
The data message tested carries out dissection process；
Management module 23, connects respectively each authentication module 21 and each processing module 22, for respectively to each authentication module
It is managed with the working condition of each processing module.
In order to make it easy to understand, only illustrating an authentication module 21 and a processing module 22 in Fig. 2.
Specifically, in preferred embodiment of the invention, above-mentioned authentication module 21 is used to enter the legitimacy of data message
Row verification, i.e., carry out data check to data message.The setting of at least one authentication module 21 can concomitantly process big data
The verifying work of the data message of amount.
Above-mentioned each processing module 22 is respectively used to carry out dissection process to data message.Specifically, different process moulds
Block 22 can adopt the different models that process to carry out dissection process to the data message that different needs are calculated in real time.Similarly,
Above-mentioned different processing module 22 can also process model and concomitantly carry out dissection process to data message using identical.
Above-mentioned management module 23 is used for unification and above-mentioned authentication module 31 and processing module 22 is managed, and monitors above-mentioned
The working condition of authentication module 21 and processing module 22.
In the preferred embodiment of the present invention, still as shown in Fig. 2 including respectively in each processing module 22：
Filter 221, for filtering to the abnormal data in the data message of verification；
Resolver 222, connects filter 221, for according to model is processed, parsing to the data message through filtering, with
Obtain analysis result；
Processor 223, connects respectively filter 221 and resolver 222, normally transports for controlling filter 221 and resolver 222
OK.
Specifically, in preferred embodiment of the invention, above-mentioned filter 221 is used for the abnormal data in data message
Filtered, will not be disturbed by abnormal data with the real-time calculating for ensureing follow-up, so as to ensure the degree of accuracy of real-time calculating.
Above-mentioned resolver 222 is used to parse the data message through filtering according to above-mentioned process model, so as to
The data message of real-time calculating is carried out to above-mentioned real-time computing unit 4 is suitable for.Above-mentioned resolving can include logarithm it is believed that
Breath carries out the conversion operation of data form, or operation etc. is decrypted to data message, and concrete operations can be by user certainly
The process model that definition is created is determined.
Above-mentioned processor 223 is used to controlling above-mentioned filter 221 and resolver 222 normally running, i.e., for managing and control
Make above-mentioned filter 221 and resolver 222.
Then in preferred embodiment of the invention, due to including at least one process mould in above-mentioned based process unit 2
Block 22, thus in above-mentioned based process unit 2 equally also include at least one filter 221, at least one resolver 222 with
And at least one processor 223.Due to only illustrating a processing module 22 in Fig. 2, therefore a correspondence is equally only shown respectively
Filter 221, resolver 222 and processor 223.
In the preferred embodiment of the present invention, as shown in Figure 3, above-mentioned expanding element 1 includes：
First definition module 11, there is provided data model is preset to user；
Second definition module 12, there is provided interrogation model is preset to user；
3rd definition module 13, there is provided the composition structure that needs are carried out with the real-time data message for calculating to user carries out pre-
If.
Specifically, in preferred embodiment of the invention：
Above-mentioned first definition module 11 supplies the self-defined establishment data model of user, i.e., to each process defined in resolver 222
Component is extended and edits, and data message can be parsed in order to resolver 222.
Above-mentioned second definition module 12 supplies the self-defined establishment interrogation model of user, i.e., self-defined establishment SQL query statement.
Above-mentioned 3rd definition module 13 is for the self-defined composition for creating the data message for needing to carry out real-time calculating of user
Structure.The composition structure can be associated with above-mentioned default data model and interrogation model, for follow-up real-time calculating
Use.
Then in a preferred embodiment of the invention, as shown in Figure 4, the method for operation bag of whole real time computation system
Include：
Medium unit 4 is from different business scenario 1-3（Different operation layers）Middle acquisition needs the data letter for carrying out real-time calculating
Breath, and transmit into based process unit 2.
Based process unit 2 is obtained by the data model of the self-defined establishment of user in expanding element 1, and according to this simultaneously
Data model is filtered and is parsed etc. reason, data letter of the output through parsing to the data message obtained from medium unit 4
Breath.
After in real time computing unit 3 receives the above-mentioned data message through parsing, equally obtain from expanding element 1 by making
The interrogation model of the self-defined establishment of user, and the above-mentioned data message through parsing is calculated in real time according to interrogation model,
Based process unit 2 is stated then up feeds back the result of calculation after calculating in real time.
Above-mentioned medium unit 4 is additionally operable to collect the result of calculation for feeding back to above-mentioned based process unit 2, and by above-mentioned meter
Calculate result to export to service unit 5.Service unit 5 is outwards exposed above-mentioned result of calculation by the way of restful services, example
As same exposure forms business scenario 1-3.
Above-mentioned display unit 6 can get result of calculation from service unit 5 and be shown, so that user is looked into
See.
In the preferred embodiment of the present invention, based on the above real time computation system, a kind of meter in real time is now provided
Calculation method, the method it is concrete as shown in figure 5, including：
Step S1, using a based process unit according to the process model preserved in expanding element, to what is collected from operation layer
Data message carries out dissection process, and exports the data message through parsing；
Step S2, using a real-time computing unit according to the interrogation model preserved in expanding element, to defeated in based process unit
The data message through parsing for going out is calculated in real time, to obtain result of calculation；
Step S3, based process unit is fed back to using real-time computing unit by result of calculation.
Preferred embodiments of the present invention are the foregoing is only, embodiments of the present invention and protection model is not thereby limited
Enclose, to those skilled in the art, should can appreciate that done by all utilization description of the invention and diagramatic content
Scheme obtained by equivalent and obvious change, should be included in protection scope of the present invention.
Claims (11)
1. a kind of real time computation system of universal architecture data, it is characterised in that include：
Expanding element, there is provided process model for performing data processing is preset and preserved to user and for performing data
The interrogation model of inquiry；
Based process unit, connects the expanding element, right for according to the process model preserved in the expanding element
The data message collected from operation layer carries out dissection process, and exports the data message through parsing；
In real time computing unit, connects respectively the based process unit and the expanding element, for according to the expanding element
The interrogation model of middle preservation, the data message through parsing to exporting in the based process unit is carried out in real time
Calculate, obtain result of calculation and feed back to the based process unit.
2. real time computation system as claimed in claim 1, it is characterised in that also include：
Medium unit, connects respectively the expanding element and the based process unit, and the medium unit is used for：
The data message for carrying out real-time calculating is collected from operation layer；And
Collection feeds back to the result of calculation of the based process unit.
3. real time computation system as claimed in claim 1, it is characterised in that the interrogation model is looked into for self-defining structuring
Ask sentence.
4. real time computation system as claimed in claim 2, it is characterised in that the medium unit for the message of system in the middle of
Part.
5. real time computation system as claimed in claim 2, it is characterised in that also include：
Service unit, connects the medium unit, for obtaining the result of calculation that the medium unit collects and exporting.
6. real time computation system as claimed in claim 5, it is characterised in that the side that the service unit is serviced with restful
Formula externally exposes the result of calculation.
7. real time computation system as claimed in claim 5, it is characterised in that also include：
Display unit, connects the service unit, for obtaining the result of calculation of the service unit output, and will be described
Result of calculation real-time exhibition is checked to user.
8. real time computation system as claimed in claim 1, it is characterised in that the based process unit includes：
At least one authentication module, is respectively used to verify the legitimacy of the data message；
At least one processing module, connects respectively each described authentication module, and each described processing module is respectively used to passing through
The data message of verification carries out the dissection process；
Management module, connects respectively each described authentication module and each described processing module, for respectively to testing each Suo Shu
The working condition of card module and each processing module is managed.
9. real time computation system as claimed in claim 8, it is characterised in that include respectively in each described processing module：
Filter, for filtering to the abnormal data in the data message of verification；
Resolver, connects the filter, for according to the process model, solving to the data message through filtering
Analysis, to obtain the analysis result；
Processor, connects respectively the filter and the resolver, normal for controlling the filter and the resolver
Operation.
10. real time computation system as claimed in claim 1, it is characterised in that the expanding element includes：
First definition module, there is provided the data model is preset to user；
Second definition module, there is provided the interrogation model is preset to user；
3rd definition module, there is provided the composition structure that needs are carried out with the real-time data message for calculating to user carries out pre-
If.
11. a kind of real-time computing techniques of universal architecture data, it is characterised in that being supplied to user to preset and preserving is used for
Perform data processing processes model and the interrogation model for performing data query, also includes：
Step S1, using a based process unit according to the process model preserved in the expanding element, to from operation layer
The data message collected carries out dissection process, and exports the data message through parsing；
Step S2, using a real-time computing unit according to the interrogation model preserved in the expanding element, to the basis
The data message through parsing exported in processing unit is calculated in real time, to obtain result of calculation；
Step S3, the based process unit is fed back to using the real-time computing unit by the result of calculation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610883247.1A CN106570064A (en) | 2016-10-10 | 2016-10-10 | Real time calculating system and method for general structural data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610883247.1A CN106570064A (en) | 2016-10-10 | 2016-10-10 | Real time calculating system and method for general structural data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106570064A true CN106570064A (en) | 2017-04-19 |
Family
ID=58531776
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610883247.1A Pending CN106570064A (en) | 2016-10-10 | 2016-10-10 | Real time calculating system and method for general structural data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106570064A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102063470A (en) * | 2010-12-14 | 2011-05-18 | 广州市香港科大霍英东研究院 | Node real-time data analyzing method suitable for wireless sensor network |
| CN104424229A (en) * | 2013-08-26 | 2015-03-18 | 腾讯科技（深圳）有限公司 | Calculating method and system for multi-dimensional division |
| CN104657502A (en) * | 2015-03-12 | 2015-05-27 | 浪潮集团有限公司 | System and method for carrying out real-time statistics on mass data based on Hadoop |
| CN105786950A (en) * | 2015-12-30 | 2016-07-20 | 北京锐安科技有限公司 | Method and device for processing data |
-
2016
- 2016-10-10 CN CN201610883247.1A patent/CN106570064A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102063470A (en) * | 2010-12-14 | 2011-05-18 | 广州市香港科大霍英东研究院 | Node real-time data analyzing method suitable for wireless sensor network |
| CN104424229A (en) * | 2013-08-26 | 2015-03-18 | 腾讯科技（深圳）有限公司 | Calculating method and system for multi-dimensional division |
| CN104657502A (en) * | 2015-03-12 | 2015-05-27 | 浪潮集团有限公司 | System and method for carrying out real-time statistics on mass data based on Hadoop |
| CN105786950A (en) * | 2015-12-30 | 2016-07-20 | 北京锐安科技有限公司 | Method and device for processing data |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104199725B (en) | A kind of service interface digital simulation method and system | |
| CN105005521B (en) | Method of testing and device | |
| GB0523995D0 (en) | Method,system and computer program product for access control | |
| CN101441557A (en) | Distributed parallel calculating system and method based on dynamic data division | |
| WO2005015440A3 (en) | Extending service-oriented business frameworks | |
| JP2010128877A (en) | Web system and method of collecting processing record | |
| CN107404431B (en) | A kind of the message transmission selection method and system of account universal retrievals more by all kinds of means | |
| CN112395643A (en) | Data privacy protection method and system of neural network | |
| CN110310090A (en) | Dynamic electron approval process generation method, device, equipment and medium based on modularization | |
| CN105184501A (en) | Efficient asynchronous order processing method | |
| CN110188268A (en) | A kind of personalized recommendation method based on label and temporal information | |
| CN112767113A (en) | Account checking data processing method, device and system based on block chain | |
| CN114553709A (en) | Topological relation display method and related equipment | |
| CN102541811B (en) | On-demand computing-based data analysis device and method for analysis factors | |
| CN105468589A (en) | Ranking list generation method and apparatus | |
| CN103399968B (en) | A kind of micro-blog information acquisition method and system | |
| CN104331512B (en) | A kind of BBS pages automatic acquiring method | |
| WO2004059480A3 (en) | Accessing computational grids | |
| CN106202470B (en) | The processing method and system of script | |
| CN108712306A (en) | A kind of information system automation inspection platform and method for inspecting | |
| CN106570064A (en) | Real time calculating system and method for general structural data | |
| CN106775784A (en) | A kind of acquisition methods of workflow flow path, device, medium and storage control | |
| CN106599244B (en) | General original log cleaning device and method | |
| CN105825447A (en) | Fast assessment system for creativity of patents, and fast assessment method thereof | |
| CN1794217A (en) | Network application system for calculating fluid mechanics |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170419 |
|
| RJ01 | Rejection of invention patent application after publication |