CN108388571A - It is a kind of to realize the method and system for customizing data - Google Patents
It is a kind of to realize the method and system for customizing data Download PDFInfo
- Publication number
- CN108388571A CN108388571A CN201810021483.1A CN201810021483A CN108388571A CN 108388571 A CN108388571 A CN 108388571A CN 201810021483 A CN201810021483 A CN 201810021483A CN 108388571 A CN108388571 A CN 108388571A
- Authority
- CN
- China
- Prior art keywords
- data
- data source
- template
- source
- customization
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2291—User-Defined Types; Storage management thereof
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Quality & Reliability (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The present embodiments relate to a kind of method and systems for realizing customization data, belong to technical field of data processing.Wherein, this method includes：Collected initial data source is pre-processed, data source is obtained；Data source is stored into the first data template corresponding with data source according to the implementation mode of data source；According to being customized of the data source configuration in the first data template of customization demand pair of data source, obtain customizing data.It provides through this embodiment：Data source is stored into the first data template according to the implementation mode of data source, according to being customized of the data source configuration in the first data template of customization demand pair, obtain customizing the technical solution of data, on the one hand, the technology drawback that cannot achieve configured to data source according to different types of service in the prior art is avoided；On the other hand, it realizes and meets the needs of users, the technique effect of corresponding formulationization configuration is realized to different data sources.
Description
Technical field
The present embodiments relate to technical field of data processing more particularly to a kind of method for realizing customization data and it is
System.
Background technology
With the continuous development of science and technology, the development and utilization of data are also in continuous update and progress.Wherein, big
Under data background, the demand based on every profession and trade multi-service type is growing day by day.In the prior art, mainly according to type of service pair
Different business are handled.However, due to variety classes overabundance of data, be easy to cause performance period generally it is impossible to meet with
The demand at family.
Invention content
In order to solve the above technical problems, an embodiment of the present invention provides a kind of method and systems for realizing customization data.
One side according to the ... of the embodiment of the present invention, an embodiment of the present invention provides a kind of sides realizing customization data
Method, this method include：
Collected initial data source is pre-processed, data source is obtained；
The data source is stored to the first data corresponding with the data source according to the implementation mode of the data source
In template；
Being customized of data source in first data template is configured according to the customization demand of the data source,
It obtains customizing data.
It provides through this embodiment：After being pre-processed to collected initial data source, data source is obtained, according to
The implementation mode of data source stores data source into the first data template, according in customization the first data template of demand pair
Being customized of data source configures, and obtains the technical solution for customizing data, on the one hand, avoid and cannot achieve in the prior art
The technology drawback that data source is configured according to different types of service；On the other hand, it realizes and meets the needs of users, it is right
Different data sources realizes the technique effect of corresponding formulationization configuration；In another aspect, realizing efficient and quickly according to user
Demand to data source carry out relevant operation, obtain user needs customization data technique effect.
Further, the method further includes：The data service demand information of user to getting is disassembled, and is obtained
Disassemble information；
The template library for including first data template and second data template is established according to the dismantling information.
It provides through this embodiment：By being disassembled to business demand information, dismantling information is obtained, is believed according to dismantling
Breath establishes the technical solution of template library, realizes and establishes template library according to the demand of user, meets user's need to further realize
It asks, realizes the customer satisfaction system technique effect for customizing data.
Further, after the data source is stored to its corresponding first data template, the method further includes：
The reference number of corresponding first data template of the data source is added into default fiducial value.
It provides through this embodiment：After storing data source to the first data template, the first data template is drawn
With the technical solution of number plus default fiducial value, realizes and know the number that the first data template is cited in time, to reinforce
Management and maintenance to database.
Further, the method further includes：According to preset time interval, to each data mould in the template library
The reference number of plate is counted；
When the reference number of third data template is less than preset value, then the third data template is deleted, wherein institute
It includes the third data template to state template library.
It provides through this embodiment：When the small Mr. Yu's value of the reference number of certain data template, then the data template is deleted
The technical solution removed realizes the dynamic for knowing database in time, to reinforce the management service to database, in database
The data template less than preset value deleted, discharge the shared memory of database, accelerate the speed of service of whole system
Technique effect.
Other side according to the ... of the embodiment of the present invention realizing that customizing data is an embodiment of the present invention provides a kind of
System, the system comprises：
Acquisition engine：For being pre-processed to collected initial data source, data source is obtained；
Data mart modeling engine：For according to the implementation mode of the data source by the data source store to the data
In corresponding first data template in source；
Format configurator：For according to the customization demand of the data source to the data source in first data template
Being customized configures, and obtains customizing data.
It provides through this embodiment：Collected initial data source is pre-processed by acquisition engine, obtains data
Data source is stored into the first data template by data mart modeling engine according to the implementation mode of data source, is configured by format by source
Device is configured according to being customized of data source in the first data template of customization demand pair, obtains the technical side for customizing data
Case, on the one hand, avoid the technology disadvantage that cannot achieve configured to data source according to different types of service in the prior art
End；On the other hand, it realizes and meets the needs of users, the technique effect of corresponding formulationization configuration is realized to different data sources；
In another aspect, realizing efficient and quickly carrying out relevant operation to data source according to the demand of user, user's needs are obtained
Customize the technique effect of data.
Further,
The acquisition engine is additionally operable to：The data service demand information of user to getting is disassembled, and is disassembled
Information；
The format configurator is additionally operable to：It is established comprising first data template and described the according to the dismantling information
The template library of two data templates.
It provides through this embodiment：Business demand information is disassembled by acquisition engine, dismantling information is obtained, leads to
The technical solution that format configurator establishes template library according to dismantling information is crossed, realizes and establishes template library according to the demand of user,
Meet user demand to further realize, realizes the customer satisfaction system technique effect for customizing data.
Further, the data mart modeling engine is additionally operable to：
The reference number of corresponding first data template of the data source is added into default fiducial value.
It provides through this embodiment：After storing data source to the first data template, pass through data mart modeling engine pair
The reference number of first data template adds the technical solution of default fiducial value, realizes and knows that the first data template is cited in time
Number, to reinforce the management to database and maintenance.
Further, the data mart modeling engine is additionally operable to：
According to preset time interval, unite to the reference number of each data template in the data template library
Meter；
When the reference number of third data template is less than preset value, then the third data template is deleted, wherein institute
It includes the third data template to state template library.
It provides through this embodiment：When the small Mr. Yu's value of the reference number of certain data template, data mart modeling engine should
The technical solution that data template is deleted realizes the dynamic for knowing database in time, to reinforce the management service to database,
The data template less than preset value in database is deleted, the shared memory of database is discharged, accelerates whole system
The technique effect of the speed of service.
Description of the drawings
Fig. 1 is a kind of flow diagram for realizing the method for customizing data provided in an embodiment of the present invention；
Fig. 2 is a kind of structural schematic diagram for realizing the system for customizing data provided in an embodiment of the present invention.
Specific implementation mode
In being described below, for illustration and not for limitation, it is proposed that such as specific system structure, interface, technology it
The detail of class understands the present invention to cut thoroughly.However, it will be clear to one skilled in the art that there is no these specific
The present invention can also be realized in the other embodiments of details.In other situations, it omits to well-known system and method
Detailed description, in order to avoid unnecessary details interfere description of the invention.
An embodiment of the present invention provides a kind of method and systems for realizing customization data.
One side according to the ... of the embodiment of the present invention, an embodiment of the present invention provides a kind of sides realizing customization data
Method.
Referring to Fig. 1, Fig. 1 is a kind of flow signal for realizing the method for customizing data provided in an embodiment of the present invention
Figure.
As shown in Figure 1, this method includes：
S100：Collected initial data source is pre-processed, data source is obtained；
Such as：Initial data source is A, is acquired to initial data source A, and is pre-processed to initial data source A.Its
In, specific pretreatment mode is：Cleaning treatment.After being started the cleaning processing to data source A, data source B is obtained.
In this step, by being started the cleaning processing to initial data source A, the de-redundancy to initial data source is realized,
Simplify the technique effect of subsequent service logic.
S200：Data source is stored into the first data template corresponding with data source according to the implementation mode of data source；
It is understood that the corresponding implementation mode of different data sources is different, wherein the implementation mode data
The classification information in source, for example, the data source may be assigned to database.
Data source B is stored into the first data template according to the classification information of data source B or its data characteristic information etc..
That is, the corresponding data template of a data source is unique, and still, the corresponding data of a data template
Source but may be multiple.
S300：According to being customized of the data source configuration in the first data template of customization demand pair of data source, obtain
To customization data.
To data source being customized of the B configuration in the first data template, obtain customizing data C.
It is understood that the corresponding customization demand of different data sources and differ, it is right directly by data template
Data source being customized of B configures, and obtains the customization data C of user demand.
It provides through this embodiment：After being pre-processed to collected initial data source, data source is obtained, according to
The implementation mode of data source stores data source into the first data template, according in customization the first data template of demand pair
Being customized of data source configures, and obtains the technical solution for customizing data, on the one hand, avoid and cannot achieve in the prior art
The technology drawback that data source is configured according to different types of service；On the other hand, it realizes and meets the needs of users, it is right
Different data sources realizes the technique effect of corresponding formulationization configuration；In another aspect, realizing efficient and quickly according to user
Demand to data source carry out relevant operation, obtain user needs customization data technique effect.
To make to understand more thorough to technical scheme of the present invention, in conjunction with the prior art, to the technical side of the present invention
Case is described in detail.
In the prior art, to meet the needs of users, the technical solution used for：According to the demand of user to single
Data source is handled, and the data of user demand are obtained.That is, in the prior art, often receiving the data of user transmission
Source must be handled accordingly according to the demand of user so that application range is narrow, does not have popularity, and multiplicity is high, effect
Rate is low.
And in the present invention, the processing such as de-redundancy first are carried out to collected initial data source, obtains simplifying and accurately counts
According to source.Data source is stored to the first data template according to the implementation mode (elements such as type of service, content information) of data source,
Rather than directly data source is handled, matched according to being customized of data source in the first data template of customization demand pair
It sets, obtains customizing data.
From the foregoing, it will be observed that first, technical scheme of the present invention need not directly carry out each identical or different data source
Processing, but after collecting initial data source, de-redundancy processing is carried out to initial data source, it is ensured that obtained data source
Simplification and accuracy more bring follow-up step simplified technique effect.
Second, each data source is divided to corresponding data template by the present invention by the characteristic information of each data source,
Rather than directly data source is handled, by the way that data template is used in combination, data source is executed and customizes configuration, to real
Show the wide in range property and popularity when the method application, and realized and economize on resources, saved the time, puies forward efficient technology effect
Fruit.
In a kind of possible technical solution, this method further includes：
Multi-data source data are determined according to multiple customization data；
It is configured according to load demand to customizing data and/or multi-data source data, obtains corresponding load data.
It is understood that data source can be single data source and multi-data source, wherein multi-data source is by multiple forms datas
Source forms.
Formulationization configuration is carried out to single data source according to customization demand, single data source is obtained and customizes data, according to more
A single data source customizes data and obtains a multi-data source data.
In a kind of possible technical solution, this method further includes：
According to load data dynamic adjustment thread, and load data are loaded according to the thread after adjustment.
It is understood that the corresponding dynamic of different load data may be identical, it is also possible to it is different, when dynamic is difference
When, then it is adjusted according to the dynamic alignment journey of load data, wherein thread herein is load thread.By adjusting after
Thread loads load data.
By the technical solution being adjusted in time to load thread according to the dynamic of load data, adjustment line in time is realized
Journey loads, in time to realize the accuracy and promptness of load.
In a kind of possible technical solution, to customize data configure, obtain customize data it is corresponding plus
Before carrying data, this method further includes：
Processing field is determined according to data to be loaded；
The processing rule for acting on formulationization data is chosen according to the processing field, wherein
The customization data are configured, obtains customizing the corresponding load data of data, specifically include：
When formulationization data are by handling the verification for verifying sub-rule in rule, according to load demand to customizing number
According to being configured, obtain customizing the corresponding load data of data.
In the present embodiment, processing field is determined from data to be loaded, data to be loaded are different, then processing field may
Also it and differs.But when two data to be loaded have common field, it is possible to which the processing field of two data to be loaded is
Identical processing field.
Each corresponding processing rule of processing field.It is understood that a processing field have and only there are one
Processing rule is corresponding to it, and still, a processing rule may correspond to one or multiple processing fields.
It is verified by verifying sub-rule to customizing data, when passing through verification, just according to load demand to customization
Change data to be configured, obtains load data.
In a kind of possible technical solution, this method further includes：
When not the first data template corresponding with data source, then the second corresponding data are established according to data source
Template.
In the present embodiment, when not depositing the first datum target, i.e., the data source is when first appearing, then directly basis should
Data source establishes the second data module, when the data source occurs again, then directly transfers the second data module.
In a kind of possible technical solution, this method further includes：
The data service demand information of user to getting is disassembled, and dismantling information is obtained；
The template library for including the first data template and the second data template is established according to dismantling information.
In the present embodiment, according to different types of data service demand, need format (content) that business provides etc. into
Row dismantling obtains dismantling information, and template library is established according to dismantling information.
It provides through this embodiment：By being disassembled to business demand information, dismantling information is obtained, is believed according to dismantling
Breath establishes the technical solution of template library, realizes and establishes template library according to the demand of user, meets user's need to further realize
It asks, realizes the customer satisfaction system technique effect for customizing data.
In a kind of possible technical solution, after data source to be stored to its corresponding first data template, this method
Further include：
The reference number of corresponding first data template of data source is added into default fiducial value.
In the present embodiment, when the first data template is cited, i.e., when the first data template is stored into data source, note
Record the reference number of the first data template.Physical record mode is：Add fiducial value on the number quoted.
Such as：First data template was stored 5 data sources, this time stored data source to the first data for the 6th time
In template, then data source is being stored to the first data template, reference number 5 is changed to 6.
It provides through this embodiment：After storing data source to the first data template, the first data template is drawn
With the technical solution of number plus default fiducial value, realizes and know the number that the first data template is cited in time, to reinforce
Management and maintenance to database.
In a kind of possible technical solution, this method further includes：
According to preset time interval, the reference number of each data template in template library is counted；
When the reference number of third data template is less than preset value, then third data template is deleted, wherein the mould
Plate library includes third data template.
In the present embodiment, it per at regular intervals, unites herein to the reference of each data template in template library
Meter, obtains statistical result, is handled accordingly each data template in template library according to statistical result.
Such as：200 data templates are shared in template library, wherein it is 0 to have the reference number of 1 data template, there are 5
The reference number of data template is 2, then will directly quote the data template that number is 0 and reference number is 2 and delete.
It provides through this embodiment：When the small Mr. Yu's value of the reference number of certain data template, then the data template is deleted
The technical solution removed realizes the dynamic for knowing database in time, to reinforce the management service to database, in database
The data template less than preset value deleted, discharge the shared memory of database, accelerate the speed of service of whole system
Technique effect.
Other side according to the ... of the embodiment of the present invention, an embodiment of the present invention provides one kind corresponding with the above method
Realize the system for customizing data.
Referring to Fig. 2, Fig. 2 is a kind of structural representation for realizing the system for customizing data provided in an embodiment of the present invention
Figure.
As shown in Fig. 2, the system includes：
Acquisition engine：For being pre-processed to collected initial data source, data source is obtained；
Data mart modeling engine：For data source to be stored to corresponding with data source first according to the implementation mode of data source
In data template；
Format configurator：It is customized for the data source in the first data template of customization demand pair according to data source
Change configuration, obtains customizing data.
Wherein, acquisition engine and data processing engine are made of multiple parts, and part is by different types of parts library
It is managed collectively.
It provides through this embodiment：Collected initial data source is pre-processed by acquisition engine, obtains data
Data source is stored into the first data template by data mart modeling engine according to the implementation mode of data source, is configured by format by source
Device is configured according to being customized of data source in the first data template of customization demand pair, obtains the technical side for customizing data
Case, on the one hand, avoid the technology disadvantage that cannot achieve configured to data source according to different types of service in the prior art
End；On the other hand, it realizes and meets the needs of users, the technique effect of corresponding formulationization configuration is realized to different data sources；
In another aspect, realizing efficient and quickly carrying out relevant operation to data source according to the demand of user, user's needs are obtained
Customize the technique effect of data.
In a kind of possible technical solution, which further includes：
Data cleansing processing engine：For determining multi-data source data according to multiple customization data, and according to load need
It asks and is configured to customizing data and/or multi-data source data, obtain corresponding load data.
It is understood that data source can be single data source and multi-data source, wherein multi-data source is by multiple forms datas
Source forms.
Formulationization configuration is carried out to single data source according to customization demand by data cleansing processing engine, obtains single data source
Data are customized, customizing data according to multiple single data sources obtains a multi-data source data.
In a kind of possible technical solution, which further includes：
Data load engine：For adjusting thread according to load data dynamic, and according to the thread after adjustment to loading number
According to being loaded.
It is understood that the corresponding dynamic of different load data may be identical, it is also possible to it is different, when dynamic is difference
When, then it is adjusted according to the dynamic alignment journey of load data, wherein thread herein is load thread.By adjusting after
Thread loads load data.
Engine is loaded by data by time according to the dynamic of load data to the technical solution that is adjusted of load thread,
It realizes adjustment thread in time, loads in time, to realize the accuracy and promptness of load.
In a kind of possible technical solution, data cleansing processing engine is specifically used for：
Processing field is determined according to target data；
The processing rule for acting on formulationization data is chosen according to processing field；
When formulationization data are by handling the verification sub-rule in rule, then configure, obtain to customizing data
The corresponding load data of formulationization data.
In the present embodiment, processing field is determined from data to be loaded, data to be loaded are different, then processing field may
Also it and differs.But when two data to be loaded have common field, it is possible to which the processing field of two data to be loaded is
Identical processing field.
Each corresponding processing rule of processing field.It is understood that a processing field have and only there are one
Processing rule is corresponding to it, and still, a processing rule may correspond to one or multiple processing fields.
It is verified by verifying sub-rule to customizing data, when passing through verification, data cleansing processing engine ability root
It is configured according to load demand to customizing data, obtains load data.
In a kind of possible technical solution, data mart modeling engine is additionally operable to：
When not the first data template corresponding with data source, then the second corresponding data are established according to data source
Template.
In the present embodiment, when not depositing the first datum target, i.e., the data source is when first appearing, then directly by data
Processing engine establishes the second data module according to the data source, when the data source occurs again, then directly transfers the second data
Module.
In a kind of possible technical solution, acquisition engine is additionally operable to：To the data service demand letter of the user got
Breath is disassembled, and dismantling information is obtained；
Format configurator is additionally operable to：It includes first data template and the second data template to be established according to dismantling information
Template library.
In the present embodiment, according to different types of data service demand, need format (content) that business provides etc. into
Row dismantling obtains dismantling information, and template library is established according to dismantling information.
It provides through this embodiment：Business demand information is disassembled by acquisition engine, dismantling information is obtained, leads to
The technical solution that format configurator establishes template library according to dismantling information is crossed, realizes and establishes template library according to the demand of user,
Meet user demand to further realize, realizes the customer satisfaction system technique effect for customizing data.
In a kind of possible technical solution, data mart modeling engine is additionally operable to：
The reference number of corresponding first data template of data source is added into default fiducial value.
In the present embodiment, when the first data template is cited, i.e., when the first data template is stored into data source, note
Record the reference number of the first data template.Physical record mode is：Add fiducial value on the number quoted.
Such as：First data template was stored 5 data sources, this time stored data source to the first data for the 6th time
In template, then data source is being stored to the first data template, reference number 5 is changed to 6.
It provides through this embodiment：After storing data source to the first data template, pass through data mart modeling engine pair
The reference number of first data template adds the technical solution of default fiducial value, realizes and knows that the first data template is cited in time
Number, to reinforce the management to database and maintenance.
In a kind of possible technical solution, data mart modeling engine is additionally operable to：
According to preset time interval, the reference number of each data template in template library is counted；
When the reference number of third data template is less than preset value, then third data template is deleted, wherein template library
It include third data template.
In the present embodiment, it per at regular intervals, unites herein to the reference of each data template in template library
Meter, obtains statistical result, is handled accordingly each data template in template library according to statistical result.
Such as：200 data templates are shared in template library, wherein it is 0 to have the reference number of 1 data template, there are 5
The reference number of data template is 2, then will directly quote the data template that number is 0 and reference number is 2 and delete.
It provides through this embodiment：When the small Mr. Yu's value of the reference number of certain data template, data mart modeling engine should
The technical solution that data template is deleted realizes the dynamic for knowing database in time, to reinforce the management service to database,
The data template less than preset value in database is deleted, the shared memory of database is discharged, accelerates whole system
The technique effect of the speed of service.
Reader should be understood that in the description of this specification reference term " one embodiment ", " is shown " some embodiments "
The description of example ", " specific example " or " some examples " etc. means specific features described in conjunction with this embodiment or example, structure
Or feature is included at least one embodiment or example of the invention.In the present specification, to the schematic of above-mentioned term
Statement need not be directed to identical embodiment or example.Moreover, specific features, structure or the feature of description can be any
It can be combined in any suitable manner in a or multiple embodiments or example.In addition, without conflicting with each other, the technology of this field
The feature of different embodiments or examples described in this specification and different embodiments or examples can be combined by personnel
And combination.
The unit illustrated as separating component may or may not be physically separated, and be shown as unit
Component may or may not be physical unit, you can be located at a place, or may be distributed over multiple networks
On unit.Some or all of unit therein can be selected according to the actual needs to realize the mesh of the embodiment of the present invention
's.
It should also be understood that in various embodiments of the present invention, size of the sequence numbers of the above procedures is not meant to execute sequence
Priority, each process execution sequence should be determined by its function and internal logic, without cope with the embodiment of the present invention implementation
Journey constitutes any restriction.
More than, specific implementation mode only of the invention, but scope of protection of the present invention is not limited thereto, and it is any to be familiar with
Those skilled in the art in the technical scope disclosed by the present invention, can readily occur in various equivalent modifications or substitutions,
These modifications or substitutions should be covered by the protection scope of the present invention.Therefore, protection scope of the present invention should be wanted with right
Subject to the protection domain asked.
Claims (10)
1. a kind of realizing the method for customizing data, which is characterized in that the method includes：
Collected initial data source is pre-processed, data source is obtained；
The data source is stored to the first data template corresponding with the data source according to the implementation mode of the data source
In；
Being customized of data source in first data template is configured according to the customization demand of the data source, is obtained
Customize data.
2. a kind of the method for customizing data is realized according to claim 1, which is characterized in that the method further includes：
Multi-data source data are determined according to multiple customization data；
The customization data and/or multi-data source data are configured according to load demand, obtain corresponding load data.
3. a kind of the method for customizing data is realized according to claim 2, which is characterized in that the method further includes：
According to load data dynamic adjustment thread, and the load data are loaded according to the thread after adjustment.
4. a kind of method for realizing customization data according to claim 2 or 3, which is characterized in that described to described fixed
Inhibition and generation data are configured, and before obtaining the corresponding load data of the customization data, the method further includes：
Processing field is determined according to data to be loaded；
The processing rule for acting on the formulationization data is chosen according to the processing field, wherein
It is described that the customization data are configured, the corresponding load data of the customization data are obtained, are specifically included：
When the formulationization data by it is described processing rule in verification sub-rule verification when, to the customization data into
Row configuration, obtains the corresponding load data of the customization data.
5. a kind of method for realizing customization data according to any one of claim 1-3, which is characterized in that the side
Method further includes：
When not first data template corresponding with the data source, then established according to the data source corresponding
Second data template.
6. a kind of realizing the system for customizing data, which is characterized in that the system comprises：
Acquisition engine：For being pre-processed to collected initial data source, data source is obtained；
Data mart modeling engine：For according to the implementation mode of the data source by the data source store to the data source pair
In the first data template answered；
Format configurator：For being carried out to the data source in first data template according to the customization demand of the data source
Configuration is customized, obtains customizing data.
7. a kind of system for realizing customization data according to claim 6, which is characterized in that the system also includes：
Data cleansing processing engine：For determining multi-data source data according to multiple customization data, and according to load need
It asks and the customization data and/or multi-data source data is configured, obtain corresponding load data.
8. a kind of system for realizing customization data according to claim 7, which is characterized in that the system also includes：
Data load engine：For adding to described according to load data dynamic adjustment thread, and according to the thread after adjustment
Data are carried to be loaded.
9. a kind of system for realizing customization data according to claim 7 or 8, which is characterized in that the data cleansing
Processing engine is specifically used for：
Processing field is determined according to target data；
The processing rule for acting on the formulationization data is chosen according to the processing field；
When the formulationization data are by the verification sub-rule handled in rule, then the customization data are matched
It sets, obtains the corresponding load data of the formulationization data.
10. a kind of system for realizing customization data according to any one of claim 6-9, which is characterized in that described
Data mart modeling engine is additionally operable to：
When not first data template corresponding with the data source, then established according to the data source corresponding
Second data template.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810021483.1A CN108388571A (en) | 2018-01-10 | 2018-01-10 | It is a kind of to realize the method and system for customizing data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810021483.1A CN108388571A (en) | 2018-01-10 | 2018-01-10 | It is a kind of to realize the method and system for customizing data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108388571A true CN108388571A (en) | 2018-08-10 |
Family
ID=63076935
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810021483.1A Pending CN108388571A (en) | 2018-01-10 | 2018-01-10 | It is a kind of to realize the method and system for customizing data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108388571A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109461044A (en) * | 2018-09-21 | 2019-03-12 | 南京林业大学 | Customize the mistake proofing checking method and its device of the board-like part processing hole location of household |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101141525A (en) * | 2007-10-10 | 2008-03-12 | 中兴通讯股份有限公司 | Information management system and information management method |
| CN101609610A (en) * | 2009-07-17 | 2009-12-23 | 中国民航大学 | A kind of Flight Information data acquisition unit and disposal route thereof |
| CN107103060A (en) * | 2017-04-14 | 2017-08-29 | 李长云 | The storage method and system of a kind of sensing data |
-
2018
- 2018-01-10 CN CN201810021483.1A patent/CN108388571A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101141525A (en) * | 2007-10-10 | 2008-03-12 | 中兴通讯股份有限公司 | Information management system and information management method |
| CN101609610A (en) * | 2009-07-17 | 2009-12-23 | 中国民航大学 | A kind of Flight Information data acquisition unit and disposal route thereof |
| CN107103060A (en) * | 2017-04-14 | 2017-08-29 | 李长云 | The storage method and system of a kind of sensing data |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109461044A (en) * | 2018-09-21 | 2019-03-12 | 南京林业大学 | Customize the mistake proofing checking method and its device of the board-like part processing hole location of household |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9442979B2 (en) | Data analysis using multiple systems | |
| CN105900064B (en) | The method and apparatus for dispatching data flow task | |
| CN110611623B (en) | Current limiting method and device | |
| CN110503408B (en) | Business process management system based on custom configuration | |
| CN108520471A (en) | It is overlapped community discovery method, device, equipment and storage medium | |
| CN111142749A (en) | Insurance product issuing method, system and terminal equipment | |
| US11423083B2 (en) | Transforming a specification into a persistent computer program | |
| CN108388571A (en) | It is a kind of to realize the method and system for customizing data | |
| CN107704566A (en) | Ticket centralized procurement preprocess method, system and re-scheduling, fractionation and combination system | |
| CN112364005A (en) | Data synchronization method and device, computer equipment and storage medium | |
| CN112348568A (en) | Centralized management platform and method for account number of advertisement putting platform | |
| CN114157662B (en) | Cloud platform parameter adaptation method, device, terminal equipment and storage medium | |
| CN110471968A (en) | Dissemination method, device, equipment and the storage medium of ETL task | |
| CN112764935B (en) | Big data processing method and device, electronic equipment and storage medium | |
| CN115062080A (en) | Data auditing method, device, equipment and storage medium | |
| CN114281549A (en) | Data processing method and device | |
| CN109727144A (en) | Insure Incidence calculus method, apparatus, equipment and computer readable storage medium | |
| US9992067B1 (en) | Communication network multiplexer grooming optimization | |
| CN113268490B (en) | Account book processing method, device, equipment and storage medium based on intelligent contract | |
| CN113239083A (en) | Data analysis method and device | |
| CN118608190A (en) | Real-time processing system and method for event combination decision of digital marketing | |
| US10965526B2 (en) | System and method for automatic transport connection of a network element | |
| CN118296007A (en) | Marking method and related device | |
| CN114281513A (en) | Task batch processing method and device and computer readable storage medium | |
| CN115860897A (en) | Service data processing method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180810 |
|
| RJ01 | Rejection of invention patent application after publication |