CN107832336A - Data processing method and its system - Google Patents

Data processing method and its system Download PDF

Info

Publication number
CN107832336A
CN107832336A CN201710941787.5A CN201710941787A CN107832336A CN 107832336 A CN107832336 A CN 107832336A CN 201710941787 A CN201710941787 A CN 201710941787A CN 107832336 A CN107832336 A CN 107832336A
Authority
CN
China
Prior art keywords
data
object table
target
module
reference data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710941787.5A
Other languages
Chinese (zh)
Inventor
颜博
王建辉
张磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Jingdong Century Trading Co Ltd
Beijing Jingdong Shangke Information Technology Co Ltd
Original Assignee
Beijing Jingdong Century Trading Co Ltd
Beijing Jingdong Shangke Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Jingdong Century Trading Co Ltd, Beijing Jingdong Shangke Information Technology Co Ltd filed Critical Beijing Jingdong Century Trading Co Ltd
Priority to CN201710941787.5A priority Critical patent/CN107832336A/en
Publication of CN107832336A publication Critical patent/CN107832336A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22Indexing; Data structures therefor; Storage structures
    • G06F16/2282Tablespace storage structures; Management thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • G06F16/217Database tuning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23Updating
    • G06F16/2358Change logging, detection, and notification

Abstract

Present disclose provides a kind of data processing method, this method includes:Obtain target data;Comparison object data and reference data, corresponding variance data is obtained, wherein, target data has identical Data Identification with reference data, and reference data storage is in object table;And variance data is stored in had with object table in the mapping table of mapping relations, to replace the storage to target data in itself.The disclosure additionally provides a kind of data handling system, a kind of non-volatile memory medium and a kind of computer system.

Description

Data processing method and its system
Technical field
It is open to be related to data processing field, it is non-more particularly, to a kind of data processing method and its system and one kind Volatile storage medium and a kind of computer system.
Background technology
With the rapid development of information technology, all trades and professions have accumulated substantial amounts of data, data warehouse applications are more and more wider It is general.Data zip mode stores, and is mainly used in the construction of data warehouse, for retaining the historic state of all data variations, Target data caused by new can be stored in the source data table of the target data before record changes, and overcome inline system and only remembered The defects of recording latest data, further, it is possible to be data snapshot by the state of a certain time data of query data repository storehouse acquisition.
During disclosure design is realized, inventor has found that at least there are the following problems in correlation technique:Use biography During zippered date storage method data storage of system, for any a data, as long as its any one field is sent out Changing, will the complete documentation data, database purchase is consumed it is larger, especially when certain a record only field warp When often changing, the consume to database purchase is especially serious.
For the above mentioned problem in correlation technique, effective solution is not proposed also at present.
The content of the invention
In view of this, present disclose provides a kind of data processing method and data handling system.
An aspect of this disclosure provides a kind of data processing method, including:Obtain target data;More above-mentioned target Data and reference data, corresponding variance data is obtained, wherein, above-mentioned target data has identical number with above-mentioned reference data According to mark, above-mentioned reference data storage is in object table;And above-mentioned variance data is stored in above-mentioned object table to have and reflected Penetrate in the mapping table of relation, to replace the storage to above-mentioned target data in itself.
In accordance with an embodiment of the present disclosure, the above method also includes:Above-mentioned reference data is updated in above-mentioned object table Above-mentioned target data.
In accordance with an embodiment of the present disclosure, more above-mentioned target data and reference data, obtaining corresponding variance data includes: Determine the first data content and the first data generation time of above-mentioned target data;Determine in the second data of above-mentioned reference data Hold and the second data generation time;And more above-mentioned first data content and above-mentioned second data content and more above-mentioned the One data generation time and above-mentioned second data generation time, obtain content deltas data and time difference data.
In accordance with an embodiment of the present disclosure, in more above-mentioned target data and reference data, obtain corresponding to variance data it Before, the above method also includes:Detect and whether there is above-mentioned reference data in above-mentioned object table;And if detect above-mentioned object table In above-mentioned reference data be present, then perform more above-mentioned target data and reference data, obtain corresponding to variance data operation.
In accordance with an embodiment of the present disclosure, the above method also includes:Above-mentioned reference is not present in above-mentioned object table if detecting Data, then by the storage of above-mentioned target data into above-mentioned object table.
In accordance with an embodiment of the present disclosure, the above method also includes:Receive the data for indicating the above-mentioned target data of inquiry Query statement;Above-mentioned object table is inquired about in the instruction instructed according to above-mentioned data query, obtains object table Query Result;According to above-mentioned Above-mentioned mapping table is inquired about in the instruction of data query instruction, obtains mapping table Query Result;And inquired about and tied according to above-mentioned mapping table Fruit and above-mentioned object table Query Result determine the above-mentioned target data to be inquired about.
Another aspect of the disclosure provides data handling system, including:Acquisition module, for obtaining target data; Comparison module, for more above-mentioned target data and reference data, corresponding variance data is obtained, wherein, above-mentioned target data There is identical Data Identification with above-mentioned reference data, above-mentioned reference data storage is in object table;And first memory module, Have for above-mentioned variance data to be stored in above-mentioned object table in the mapping table of mapping relations, to replace to above-mentioned number of targets According to the storage of itself.
In accordance with an embodiment of the present disclosure, update module, for being updated to above-mentioned reference data in above-mentioned object table State target data.
In accordance with an embodiment of the present disclosure, above-mentioned comparison module includes:First determining unit, for determining above-mentioned target data The first data content and the first data generation time;Second determining unit, for determining the second data of above-mentioned reference data Content and the second data generation time;And comparing unit, in more above-mentioned first data content and above-mentioned second data Appearance and more above-mentioned first data generation time and above-mentioned second data generation time, obtain content deltas data and time difference Heteromerism evidence.
In accordance with an embodiment of the present disclosure, said system also includes:Detection module, whether deposited for detecting in above-mentioned object table In above-mentioned reference data;And execution module, in the case where above-mentioned reference data be present in detecting above-mentioned object table, More above-mentioned target data and reference data are performed, obtains the operation of corresponding variance data.
In accordance with an embodiment of the present disclosure, said system also includes:Second memory module, for detecting above-mentioned object table In be not present above-mentioned reference data in the case of, by above-mentioned target data storage into above-mentioned object table.
In accordance with an embodiment of the present disclosure, said system also includes:Receiving module, it is used to indicate to inquire about above-mentioned mesh for receiving Mark the data query instruction of data;Above-mentioned target is inquired about in first enquiry module, the instruction for being instructed according to above-mentioned data query Table, obtain object table Query Result;Above-mentioned mapping is inquired about in second enquiry module, the instruction for being instructed according to above-mentioned data query Table, obtain mapping table Query Result;And determining module, for according to above-mentioned mapping table Query Result and the inquiry of above-mentioned object table As a result the above-mentioned target data to be inquired about is determined.
Another aspect of the present disclosure provides a kind of computer system, including:One or more processors;Storage device, For storing one or more programs, wherein, when one or more of programs are by one or more of computing devices, So that one or more of processors realize data processing method as described above.
Another aspect of the present disclosure provides computer-readable medium, is stored thereon with executable instruction, and the instruction is located Reason device makes processor realize data processing method as described above when performing.
By embodiment of the disclosure, due to during data slide fastener, using obtaining target data and reference data Variance data, variance data is stored in the mapping table with object table with mapping relations with replace to target data in itself Storage technical scheme, can overcome at least in part correlation technique provide scheme during data slide fastener is realized, Delta data is obtained, and records the full link of the data, causes storage space of database to consume serious technical problem, and Therefore can realize reduces storage space of database consume, discharges the technique effect of massive storage space.
Brief description of the drawings
By the description to the embodiment of the present disclosure referring to the drawings, the above-mentioned and other purposes of the disclosure, feature and Advantage will be apparent from, in the accompanying drawings:
Fig. 1 diagrammatically illustrate according to the embodiment of the present disclosure can be with the exemplary of application data processing method and its system System architecture;
Fig. 2 diagrammatically illustrates the flow chart of the data processing method according to the embodiment of the present disclosure;
Fig. 3 A diagrammatically illustrate the flow chart of the data processing method according to another embodiment of the disclosure;
Fig. 3 B diagrammatically illustrate the comparison object data and reference data according to the embodiment of the present disclosure, obtain corresponding difference The flow chart of heteromerism evidence;
Fig. 3 C diagrammatically illustrate the flow chart of the data processing method according to another embodiment of the disclosure;
Fig. 3 D diagrammatically illustrate the flow chart of the data processing method according to another embodiment of the disclosure;
Fig. 3 E diagrammatically illustrate the flow chart of the data processing method according to another embodiment of the disclosure;
Fig. 4 diagrammatically illustrates the block diagram of the data handling system according to the embodiment of the present disclosure;
Fig. 5 A diagrammatically illustrate the block diagram of the data handling system according to another embodiment of the disclosure;
Fig. 5 B diagrammatically illustrate the block diagram of the comparison module according to the embodiment of the present disclosure;
Fig. 5 C diagrammatically illustrate the block diagram of the data handling system according to another embodiment of the disclosure;
Fig. 5 D diagrammatically illustrate the block diagram of the data handling system according to another embodiment of the disclosure;
Fig. 5 E diagrammatically illustrate the block diagram of the data handling system according to another embodiment of the disclosure;And
Fig. 6 diagrammatically illustrates the frame of the computer system for being adapted for carrying out data processing method according to the embodiment of the present disclosure Figure.
Embodiment
Hereinafter, it will be described with reference to the accompanying drawings embodiment of the disclosure.However, it should be understood that these descriptions are simply exemplary , and it is not intended to limit the scope of the present disclosure.In addition, in the following description, the description to known features and technology is eliminated, with Avoid unnecessarily obscuring the concept of the disclosure.
Term as used herein is not intended to limit the disclosure just for the sake of description specific embodiment.Use herein Term " comprising ", "comprising" etc. indicate the presence of the feature, step, operation and/or part, but it is not excluded that in the presence of Or addition one or more other features, step, operation or parts.
All terms (including technology and scientific terminology) as used herein have what those skilled in the art were generally understood Implication, unless otherwise defined.It should be noted that term used herein should be interpreted that with consistent with the context of this specification Implication, without should by idealization or it is excessively mechanical in a manner of explain.
, in general should be according to this using in the case of being similar to that " in A, B and C etc. at least one " is such and stating Art personnel are generally understood that the implication of the statement to make an explanation (for example, " having system at least one in A, B and C " Should include but is not limited to individually with A, individually with B, individually with C, with A and B, with A and C, with B and C, and/or System with A, B, C etc.).Using in the case of being similar to that " in A, B or C etc. at least one " is such and stating, it is general come Say be generally understood that the implication of the statement to make an explanation (for example, " having in A, B or C at least according to those skilled in the art The system of one " should include but is not limited to individually with A, individually with B, individually with C, with A and B, with A and C, with B and C, and/or system etc. with A, B, C).It should also be understood by those skilled in the art that substantially arbitrarily represent two or more The adversative conjunction and/or phrase of optional project, either in specification, claims or accompanying drawing, shall be construed as Give including one of these projects, the possibility of these projects either one or two projects.For example, " A or B " should for phrase It is understood to include " A " or " B " or " A and B " possibility.
Embodiment of the disclosure provides a kind of data processing method and its system.This method includes:Obtain target data; Comparison object data and reference data, corresponding variance data is obtained, wherein, target data has identical number with reference data According to mark, reference data storage is in object table;And variance data is stored in the mapping for having mapping relations with object table In table, to replace the storage to target data in itself.
Fig. 1 diagrammatically illustrate according to the embodiment of the present disclosure can be with the exemplary of application data processing method and its system System architecture.
As shown in figure 1, terminal device 101,102,103, network can be included according to the system architecture 100 of the embodiment 104 and server 105.Network 104 is to the offer communication link between terminal device 101,102,103 and server 105 Medium.Network 104 can include various connection types, such as wired, wireless communication link or fiber optic cables etc..
User can be interacted with using terminal equipment 101,102,103 by network 104 with server 105, to receive or send out Send message etc..Various telecommunication customer end applications, such as the application of shopping class, net can be installed on terminal device 101,102,103 (merely illustrative) such as the application of page browsing device, searching class application, JICQ, mailbox client, social platform softwares.
Terminal device 101,102,103 can have a display screen and a various electronic equipments that supported web page browses, bag Include but be not limited to smart mobile phone, tablet personal computer, pocket computer on knee and desktop computer etc..
Server 105 can be to provide the server of various services, such as utilize terminal device 101,102,103 to user The website browsed provides the back-stage management server (merely illustrative) supported.Back-stage management server can be to the use that receives The data such as family request analyze etc. processing, and by result (such as according to user's acquisition request or the webpage of generation, believe Breath or data etc.) feed back to terminal device.
It should be noted that the data processing method that the embodiment of the present disclosure is provided can typically be performed by server 105. Correspondingly, the data handling system that the embodiment of the present disclosure is provided can be typically arranged in server 105.The embodiment of the present disclosure The data processing method provided can also by different from server 105 and can with terminal device 101,102,103 and/or clothes The server or server cluster that business device 105 communicates perform.Correspondingly, the data handling system that the embodiment of the present disclosure is provided It can be arranged at different from server 105 and the service that can be communicated with terminal device 101,102,103 and/or server 105 In device or server cluster.Or the data processing method that is provided of the embodiment of the present disclosure can also by terminal device 101, 102 or 103 perform, or can also be by the other-end equipment execution different from terminal device 101,102 or 103.Accordingly Ground, the data handling system that the embodiment of the present disclosure is provided can also be arranged in terminal device 101,102 or 103, or are set In the other-end equipment different from terminal device 101,102 or 103.
It should be understood that the number of the terminal device, network and server in Fig. 1 is only schematical.According to realizing need Will, can have any number of terminal device, network and server.
Embodiment of the disclosure provides a kind of data processing method.
Fig. 2 diagrammatically illustrates the flow chart of the data processing method according to the embodiment of the present disclosure.
As shown in Fig. 2 the data processing method can include operation S210~S230, wherein:
S210 is operated, obtains target data.
S220, comparison object data and reference data are operated, obtains corresponding variance data, wherein, target data and ginseng Examining data has identical Data Identification, and reference data storage is in object table.
S230 is operated, variance data is stored in be had in the mapping table of mapping relations with object table, to replace to target The storage of data in itself.
It should be noted that target data can be newest caused data, reference data can be stored in source data Data in table.For all data, it will usually which it is unique mark to define a major key to every a data, is had identical What the data of Data Identification represented record is same data, and the data content in tables of data generally includes at least one field.
In correlation technique, the method for data slide fastener is typically to contrast newest data and legacy data, data slide fastener when Waiting can contrast to the record of identical major key with original record, see whether each field is completely the same, finally by newest data meeting It is placed on efficient zoned, the record of historical variations can be put into expired subregion.
Such as:Record format in source data table is as shown in table 1, and the data that Data Identification (id) is 1 were in August 1 in 2016 Day enters database.
Table 1
id column1 column2 column3 type start_date end_date
1 c1.v1 c2.v1 c3.v1 active 2016-8-1 4712-12-31
, below will be using id in tables of data as 1 for the easy consideration of description, the data instance of 3 fields of storage, Ke Yili Solution, situation of the Field Count in practice more than 3 can in an identical manner be done and extended, do not limited herein.Such as the institute of table 1 Show, column1, column2 and column3 represent field names of the id as 1 data record respectively, c1.v1, c2.v1 and C3.v1 is the corresponding data being stored in column1, column2 and column3 field respectively, and type represents the shape of data State, active represent effective, and start_date represents that the data enter the time of database, and end_date is that the data become The time of change, when the time being recorded as an infinitely great date, represent that the data are never expired.By inquiring about start_ Date, end_date can obtain the data at each time point.
If the column1 of this record is changed, two records can be recorded, wherein expired a, record format It is as shown in table 2 below.
Table 2
id column1 column2 column3 type start_date end_date
1 c1.v1 c2.v1 c3.v1 expired 2016-8-1 2016-8-6
1 c1.v2 c2.v1 c3.v1 active 2016-8-6 4712-12-31
Type represents the state of data, except that can be that the effective status that active is represented can also be that expired is represented Expired state, if again change can again record one record.
Table 3
id column1 column2 column3 type start_date end_date
1 c1.v1 c2.v1 c3.v1 expired 2016-8-1 2016-8-6
1 c1.v2 c2.v1 c3.v1 expired 2016-8-6 2016-8-8
1 c1.v2 c2.v2 c3.v1 active 2016-8-8 4712-12-31
It should be noted that the data processing method provided in view of the embodiment of the present disclosure may apply to many data bins In storehouse, and the storage format of different Data Warehouses is not unified form, and specification length is limited, below will be with Embodiment of the disclosure is described in detail exemplified by data memory format in the tables of data referred in embodiment of the disclosure. It is worth noting that, the storage format of the data in each table is only schematical data format, it is not to the embodiment of the present disclosure Restriction, specifically can be depending on actual conditions.
Judge also not limit with the presence or absence of the method for difference, embodiment of the disclosure between target data and reference data Fixed, any may determine that whether there is algorithm/mode of difference all in the protection of the disclosure between target data and reference data Within the scope of.The disclosure provide it is a kind of by calculate the algorithm of MD5 (Message Digest Algorithm 5) check code come Judge whether to need to obtain variance data to store the embodiment of latest data.Specifically, for need perform slide fastener note The data record of (identical id) is recorded, is contrasted one by one, same id generates unique MD5 check codes using MD5 algorithms.
Such as:Reference data record one MD5 check codes MD5 (Source_Record) of generation;Target record generates one MD5 check codes MD5 (Target_Record);Whether consistent two MD5 check codes are contrasted, if unanimously, it was demonstrated that two have recorded Exactly the same, data do not change, and without carrying out slide fastener operation, terminate.If reference data and the MD5 verifications of target record generation Code is inconsistent, illustrate that two record inconsistent, target record and reference data are changed, it is necessary to carry out data slide fastener operation, i.e., Need to obtain corresponding variance data and record.
In comparison object data and reference data, obtain corresponding to after variance data, by the variance data be stored in Object table is present in the mapping table of mapping relations, and mapping table can be as shown in table 4.If Column1 data content becomes Change, be then that data content stores in the mapping table before Column1 can be changed, and Column2 and Column3 data Content is not changed, then will not store, and structure and the source data table of mapping table are consistent substantially, can be increased and be remembered at two Record content:
1st, the transformation period change_date of data is increased, the historical snapshot for carrying out data slide fastener is inquired about.
2nd, data variation details change_detail is increased, above-mentioned case is that C1 changes, then records C1, if Multiple fields change, then record C1 ..., Cn.
Table 4
id column1 column2 column3 change_date change_detail
1 c1.v1 2016-8-6 C1
1 c1.v2 c2.v1 2016-8-10 C1, C2
In accordance with an embodiment of the present disclosure,, can be in source after newest target data is got during data slide fastener The reference data that with the target data there is identical data to identify is searched in tables of data, between comparison object data and reference data Difference, corresponding variance data can be obtained, the variance data most obtained at last is stored in has mapping relations with object table Mapping table in, instead of the storage to target data in itself.
By embodiment of the disclosure, due to during data slide fastener, using obtaining target data and reference data Variance data, variance data is stored in the mapping table with object table with mapping relations with replace to target data in itself Storage technical scheme, can overcome at least in part correlation technique provide scheme during data slide fastener is realized, Delta data is obtained, and records the full link of the data, causes storage space of database to consume serious technical problem, and Therefore can realize reduces storage space of database consume, discharges the technique effect of massive storage space.
Below with reference to Fig. 3 A~Fig. 3 E, the data processing method shown in Fig. 2 is described further in conjunction with specific embodiments.
Fig. 3 A diagrammatically illustrate the flow chart of the data processing method according to another embodiment of the disclosure.
In this embodiment, the data processing method is except that can include retouching above with reference in the embodiment corresponding to Fig. 2 Outside the operation S210~S230 stated, operation S311 can also be included.For description for purpose of brevity, omit here and Fig. 2 is retouched Operation S210~the S230 stated description.As shown in Figure 3A, wherein:
S311 is operated, reference data is updated to target data in object table.
It should be noted that when target data changes with reference data relatively, target data can be replaced and joined Examine data so that retain newest data in object table all the time, and no longer retain the data message of history.
Table 5A and table 5B is the object table form signal table that embodiment of the disclosure provides, not to object table form Limit.Wherein, the data stored in table 5A can be reference data, if target data is relative to the column1 in reference data Data content become by c1.v1 and turn to c1.v2, and column2 and column3 data content is constant, is stored in object table Reference data is updated to target data;If target data does not change relative to reference data, object table does not update.Table The data stored in 5B can be the reference data after renewal.
Table 5A
id column1 column2 column3
1 c1.v1 c2.v1 c3.v1
Table 5B
id column1 column2 column3
1 c1.v2 c2.v1 c3.v1
By embodiment of the disclosure, for the data with same Data Identification, due to the mesh of this programme offer Data newest corresponding to the Data Identification are only stored in mark table, without retaining data corresponding to all Data Identifications Historical variations data so that data storage takes data warehouse storage space and effectively reduced, while reaches release magnanimity and deposit The technique effect in space is stored up, further expands the validity of the data storage of data warehouse, especially changes field quantity and gets over It is few, it is more obvious to the releasing effect of memory space.
Fig. 3 B diagrammatically illustrate the comparison object data and reference data according to the embodiment of the present disclosure, obtain corresponding difference The flow chart of heteromerism evidence.
In this embodiment, the data processing method is except that can include retouching above with reference in the embodiment corresponding to Fig. 2 Outside the operation S210~S230 stated, operation S321~S323 can also be included, specifically, operation S220 in Fig. 2 can be with Including operating S321~S323.For description for purpose of brevity, retouching to operation S210~S230 of Fig. 2 descriptions is omitted here State.As shown in Figure 3 B, wherein:
S321 is operated, determines the first data content and the first data generation time of target data.
S322 is operated, determines the second data content and the second data generation time of reference data.
Operate S323, compare the first data content and the second data content and compared with the first data generation time and second Data generation time, obtain content deltas data and time difference data.
It should be noted that after target data produces, it may be determined that caused by the data content and data of target data Time, data content and data generation time with reference also to data are also it is believed that by comparison object data and ginseng The data content and data generation time of data are examined, data content and change that target data is different from reference data can be obtained Target data data generation time.To the data of identical data mark, since first character section, one by one to data content It is compared, to the last a field, the data content of change can be obtained, while the data to change can also be obtained Corresponding field.
Time caused by data can be obtained by system and is recorded in source data table, include the production of reference data Raw time and target data are generation times, and the generation time of data can also be obtained by other known modes/method, This no longer illustrates.Data content can include but is not limited to field corresponding to the numerical value of data variation and the content of data variation.
As shown in above-mentioned table 5A and 5B, the data content stored in column1, column2 and column3 is contrasted one by one, It can be seen that the data content before column1 changes is c1.v1, the data content after change is c1.v2, while obtains change Field is column1.Similarly, if the also column2 and/or column3 that data content changes, can similarly be obtained The content of data variation and the field of change.
By embodiment of the disclosure, due to using the technical scheme for obtaining content deltas data and time difference data, By inquiring about content deltas data and time difference data, very intuitive and convenient the change procedures of data can be efficiently obtained, The change frequency of each field is intuitively obtained simultaneously.
Fig. 3 C diagrammatically illustrate the flow chart of the data processing method according to another embodiment of the disclosure.
In this embodiment, the data processing method is except that can include retouching above with reference in the embodiment corresponding to Fig. 2 Outside the operation S210~S230 stated, operation S331~S332 can also be included, specifically, operation S220 in Fig. 2 can be with Including operating S331~S332.For description for purpose of brevity, retouching to operation S210~S230 of Fig. 2 descriptions is omitted here State.As shown in Figure 3 C, wherein:
S331 is operated, detects in object table and whether there is reference data.
S332 is operated, if detecting reference data in object table be present, comparison object data and reference data is performed, obtains The operation of corresponding variance data.
Fig. 3 D diagrammatically illustrate the flow chart of the data processing method according to another embodiment of the disclosure.
In this embodiment, the data processing method is except that can include retouching above with reference in the embodiment corresponding to Fig. 3 C Outside the operation S331~S332 stated, it can also include operating S341 for description for purpose of brevity, omitting describe Fig. 2 here Operation S331~S332 description.As shown in Figure 3 D, wherein:
S341 is operated, reference data is not present in object table if detecting, by target data storage into object table.
It should be noted that in comparison object data and reference data, before obtaining the operation of corresponding variance data, need Detect and whether there is reference data in object table, may have reference data in object table, it is also possible to not yet have ginseng Data are examined, in the case of only reference data being present in object table, comparison object data and reference data can be just performed, obtain To the operation of corresponding variance data, in the case of reference data is not present in object table, target is arrived into target data storage In table.
By embodiment of the disclosure, due to performing comparison object data and reference data, corresponding variance data is obtained Operation can just carry out under certain condition, while in the case where reference data be present, variance data is obtained, not In the case of reference data being present, can directly systematic function be being effectively improved, in the case of saving system resources in computation, reached Target data preserves the technique effect of latest data all the time.
Fig. 3 E diagrammatically illustrate the flow chart of the data processing method according to another embodiment of the disclosure.
In this embodiment, the data processing method is except that can include retouching above with reference in the embodiment corresponding to Fig. 2 Outside the operation S210~S230 stated, operation S331~S332 can also be included, specifically, operation S220 in Fig. 2 can be with Including operating S351~S354.For description for purpose of brevity, retouching to operation S210~S230 of Fig. 2 descriptions is omitted here State.As shown in FIGURE 3 E, wherein:
S351 is operated, receives the data query instruction for indicating inquiry target data.
S352 is operated, object table is inquired about in the instruction instructed according to data query, obtains object table Query Result.
S353 is operated, mapping table is inquired about in the instruction instructed according to data query, obtains mapping table Query Result.
S354 is operated, the target data to be inquired about is determined according to mapping table Query Result and object table Query Result.
It should be noted that after data slide fastener is completed, the snapshot data at certain time point, concrete implementation can be inquired about Mode is:Data correlation is carried out by Data Identification to inquire about with mapping table using object table.Specifically it may determine that inputting date Parameter (needing certain time point inquired about) and the relation of the maximum time recorded in mapping table, according to the relative pass of two time System, has the following two kinds rule to obtain snapshot data, wherein:
If i.e. input_ outside the scope for the time that rule 1, the date parameter of query time point record in the mapping table Date > max (change_date), direct access is according to the data in table.
If rule 2, date change the date after inputting date in the data area of mapping table, in relationship maps table Data area, obtain result data.
Such as:Table 6A is object table, is stored with latest data.Table 6B is mapping table, be stored with data variation content and Time of data variation etc..
Table 6A
id column1 column2 column3
1 c1.v3 c2.v2 c3.v1
Table 6B
id column1 column2 column3 change_date change_detail
1 c1.v1 2016-8-6 C1
1 c1.v2 c2.v1 2016-8-10 C1, C2
Inputting date input_date is 2016-8-11, and change_date maximums are 2016-8-10, according to rule 1, 2016-8/11 > 2016-8-10, then newest data are obtained, i.e. snapshot data is shown in table 6C.
Table 6C
id column1 column2 column3
1 c1.v3 c2.v2 c3.v1
Inputting date input_date is 2016-8-9, according to rule 2:The delta data of association 10, column1 number Value is c1.v2, and column2 numerical value is c2.v1, i.e., snapshot data is shown in table 6D.
Table 6D
id column1 column2 column3
1 c1.v2 c2.v1 c3.v1
Inputting date input_date is 2016-8-5, according to rule 2:No. 6, the delta data of No. 10 are associated, obtains No. 5 Column1 numerical value is c1.v1, and column2 numerical value is c2.v1, i.e., snapshot data is shown in table 6E.
Table 6E
id column1 column2 column3
1 c1.v1 c2.v1 c3.v1
Further, the number occurred by inquiring about field in mapping table in change_detail, obtains the change of field Frequency.As inquired about the mapping table as shown in table 6B, C1 change frequencies are 2 times, and C2 change frequencies are 1 time.
By embodiment of the disclosure, when inquiring about the snapshot data at a certain moment, can be led to using object table with mapping table Cross Data Identification and carry out data correlation to inquire about, query process simple and fast, while the frequency that field changes can be inquired.
Embodiment of the disclosure provides a kind of data handling system.
Fig. 4 diagrammatically illustrates the block diagram of the data handling system according to the embodiment of the present disclosure.
In this embodiment, the data handling system 400 includes acquisition module 410, comparison module 420 and first stores mould Block 430.The data handling system 400 can perform the data processing method that above-mentioned reference chart 2 describes.As shown in figure 4, wherein:
Acquisition module 410 is used to obtain target data.
Comparison module 420 is used for comparison object data and reference data, obtains corresponding variance data, wherein, number of targets There is identical Data Identification according to reference data, reference data storage is in object table.
First memory module 430 is used to variance data being stored in have in the mapping table of mapping relations with object table, with Instead of the storage to target data in itself.
It is understood that acquisition module 410, the memory module 430 of comparison module 420 and first may be incorporated in a mould Realized in block, or any one module therein can be split into multiple modules.Or one or more in these modules At least part function of individual module can be combined with least part function phase of other modules, and be realized in a module.Root According to embodiments of the invention, at least one in acquisition module 410, the memory module 430 of comparison module 420 and first can be at least Be implemented partly as on hardware circuit, such as field programmable gate array (FPGA), programmable logic array (PLA), piece be System, the system on substrate, the system in encapsulation, application specific integrated circuit (ASIC), or can be to be integrated or be encapsulated to circuit The hardware such as any other rational method or firmware realize, or with software, three kinds of implementations of hardware and firmware it is suitable Realized when combination.Or at least one in acquisition module 410, the memory module 430 of comparison module 420 and first can be down to Computer program module is implemented partly as less, when the program is run by computer, can perform the function of corresponding module.
By embodiment of the disclosure, due to during data slide fastener, using obtaining target data and reference data Variance data, variance data is stored in the mapping table with object table with mapping relations with replace to target data in itself Storage technical scheme, can overcome at least in part correlation technique provide scheme during data slide fastener is realized, Delta data is obtained, and records the full link of the data, causes storage space of database to consume serious technical problem, and Therefore can realize reduces storage space of database consume, discharges the technique effect of massive storage space.
Below with reference to Fig. 5 A~Fig. 5 E, the data handling system shown in Fig. 4 is described further in conjunction with specific embodiments.
Fig. 5 A diagrammatically illustrate the block diagram of the data handling system according to another embodiment of the disclosure.
In this embodiment, the data handling system 400 is except that can include above with reference in the embodiment corresponding to Fig. 4 Outside the acquisition module 410 of description, the memory module 430 of comparison module 420 and first, update module 511 can also be included.In order to Description for purpose of brevity, omits the acquisition module 410 to Fig. 4 descriptions, comparison module 420 and first memory module 430 here Description.As shown in Figure 5A, wherein:Update module 511 is used to reference data is updated into target data in object table.
By embodiment of the disclosure, for the data with same Data Identification, due to the mesh of this programme offer Data newest corresponding to the Data Identification are only stored in mark table, are become without retaining history corresponding to all Data Identifications Change data so that data take data warehouse storage space and effectively reduced, while reach the skill of release massive storage space Art effect, the validity of the data storage of data warehouse is further expanded, especially change field quantity is fewer, empty to storage Between releasing effect it is more obvious.
Fig. 5 B diagrammatically illustrate the block diagram of the comparison module according to the embodiment of the present disclosure.
In this embodiment, in this embodiment, the data handling system 400 is except that can include above with reference to Fig. 4 institutes Outside acquisition module 410, the memory module 430 of comparison module 420 and first described in corresponding embodiment, wherein, compare mould Block 420 can also include the first determining unit 521, the second determining unit 522 and comparing unit 523.Succinct for description rises See, omit the description of the acquisition module 410, the memory module 430 of comparison module 420 and first to Fig. 4 descriptions here.Such as Fig. 5 B institutes Show, wherein:First determining unit 521 is used for the first data content and the first data generation time for determining target data.Second Determining unit 522 is used for the second data content and the second data generation time for determining reference data.Comparing unit 523 be used for than Compared with the first data content and the second data content and compared with the first data generation time and the second data generation time, obtain in Hold variance data and time difference data.
By embodiment of the disclosure, due to using the technical scheme for obtaining content deltas data and time difference data, By inquiring about content deltas data and time difference data, very intuitive and convenient the change procedures of data can be efficiently obtained, The change frequency of each field is intuitively obtained simultaneously.
Fig. 5 C diagrammatically illustrate the block diagram of the data handling system according to another embodiment of the disclosure.
In this embodiment, in this embodiment, the data handling system 400 is except that can include above with reference to Fig. 4 institutes Outside acquisition module 410, the memory module 430 of comparison module 420 and first described in corresponding embodiment, inspection can also be included Survey module 531 and execution module 532.For description for purpose of brevity, the acquisition module 410 to Fig. 4 descriptions is omitted here, is compared The description of the memory module 430 of module 420 and first.As shown in Figure 5 C, wherein:Detection module 531 is used to detect in object table It is no reference data to be present.Execution module 532 is used in the case where reference data be present in detecting object table, and mesh is compared in execution Data and reference data are marked, obtains the operation of corresponding variance data.
Fig. 5 D diagrammatically illustrate the block diagram of the data handling system according to another embodiment of the disclosure.
In this embodiment, in this embodiment, the data handling system 400 is except that can include above with reference to Fig. 5 C institutes Acquisition module 410, comparison module 420, the first memory module 430, detection module 531 and execution described in corresponding embodiment Outside module 532, the second memory module 541 can also be included.For description for purpose of brevity, omit here to Fig. 5 C descriptions The description of detection module 531 and execution module 532.As shown in Figure 5 D, wherein:Second memory module 541 is used to detect mesh Mark in the case of reference data is not present in table, by target data storage into object table.
By embodiment of the disclosure, due to performing comparison object data and reference data, corresponding variance data is obtained Operation can just carry out under certain condition, while in the case where reference data be present, variance data is obtained, not In the case of reference data being present, can directly systematic function be being effectively improved, in the case of saving system resources in computation, realized Target data preserves the technique effect of latest data.
Fig. 5 E diagrammatically illustrate the block diagram of the data handling system according to another embodiment of the disclosure.
In this embodiment, in this embodiment, the data handling system 400 is except that can include above with reference to Fig. 4 institutes Outside acquisition module 410, the memory module 430 of comparison module 420 and first described in corresponding embodiment, it can also include connecing Receive module 551, the first enquiry module 552, the second enquiry module 553 and determining module 554.For description for purpose of brevity, this In omit to Fig. 4 description acquisition module 410, the memory module 430 of comparison module 420 and first description.As shown in fig. 5e, its In:Receiving module 551, which is used to receive, is used for the data query instruction for indicating inquiry target data.First enquiry module 552 is used for Object table is inquired about in the instruction instructed according to data query, obtains object table Query Result.Second enquiry module 553 is used for according to number Mapping table is inquired about according to the instruction of query statement, obtains mapping table Query Result.Determining module 554, which is used to be inquired about according to mapping table, to be tied Fruit and object table Query Result determine the target data to be inquired about.
By embodiment of the disclosure, when inquiring about the snapshot data at a certain moment, can be led to using object table with mapping table Cross Data Identification and carry out data correlation to inquire about, query process simple and fast, while the frequency that field changes can be inquired.
It should be noted that the data processing method of the embodiment of the present disclosure is corresponding with data handling system, for The description of the data handling system may be referred to the description of the data processing method according to the embodiment of the present disclosure, no longer superfluous herein State.
Fig. 6 diagrammatically illustrates the side of the computer system for being adapted for carrying out data processing method according to the embodiment of the present disclosure Block diagram.Computer system shown in Fig. 6 is only an example, and the function and use range of the embodiment of the present disclosure should not be brought Any restrictions.
As shown in fig. 6, including processor 601 according to the computer system 600 of the embodiment of the present disclosure, it can be according to storage Program in read-only storage (ROM) 602 is loaded into random access storage device (RAM) 603 from storage part 608 Program and perform various appropriate actions and processing.Processor 601 can for example include general purpose microprocessor (such as CPU), refer to Make set processor and/or related chip group and/or special microprocessor (for example, application specific integrated circuit (ASIC)), etc..Processing Device 610 can also include being used for the onboard storage device for caching purposes.Processor 610 can include being used to perform with reference to figure 2, Fig. 3 A The single treatment unit of the different actions of the data processing method flow according to the embodiment of the present disclosure of~Fig. 3 E descriptions is either Multiple processing units.
In RAM 603, it is stored with system 600 and operates required various programs and data.Processor 601, ROM 602 with And RAM 603 is connected with each other by bus 604.Processor 601 is held by performing the program in ROM 602 and/or RAM 603 Various operations of the row above with reference to Fig. 2, Fig. 3 A~Fig. 3 E data processings described.It is noted that described program can also store In one or more memories in addition to ROM 602 and RAM 603.Processor 601 can also be stored in institute by performing The program in one or more memories is stated to perform above with reference to the data processing method with reference to figure 2, Fig. 3 A~Fig. 3 E descriptions Various operations.
In accordance with an embodiment of the present disclosure, system 600 can also include input/output (I/O) interface 605, input/output (I/O) interface 605 is also connected to bus 604.System 600 can also include be connected to I/O interfaces 605 with one in lower component Item is multinomial:Importation 606 including keyboard, mouse etc.;Including such as cathode-ray tube (CRT), liquid crystal display (LCD) Deng and loudspeaker etc. output par, c 607;Storage part 608 including hard disk etc.;And including such as LAN card, modulatedemodulate Adjust the communications portion 609 of the NIC of device etc..Communications portion 609 performs communication process via the network of such as internet. Driver 610 is also according to needing to be connected to I/O interfaces 605.Detachable media 611, such as disk, CD, magneto-optic disk, semiconductor Memory etc., it is arranged on as needed on driver 610, in order to which the computer program read from it is pacified as needed Load storage part 608.
In accordance with an embodiment of the present disclosure, it may be implemented as computer software journey above with reference to the method for flow chart description Sequence.For example, embodiment of the disclosure includes a kind of computer program product, it includes carrying meter on a computer-readable medium Calculation machine program, the computer program include the program code for being used for the method shown in execution flow chart.In such embodiments, The computer program can be downloaded and installed by communications portion 609 from network, and/or be pacified from detachable media 611 Dress.When the computer program is performed by processor 601, the above-mentioned function of being limited in the system of the embodiment of the present disclosure is performed.Root According to embodiment of the disclosure, system as described above, unit, module, unit etc. can by computer program module come Realize.
It should be noted that the computer-readable medium shown in the disclosure can be computer-readable signal media or meter Calculation machine readable storage medium storing program for executing either the two any combination.Computer-readable recording medium for example can be --- but not Be limited to --- electricity, magnetic, optical, electromagnetic, system, device or the device of infrared ray or semiconductor, or it is any more than combination.Meter The more specifically example of calculation machine readable storage medium storing program for executing can include but is not limited to:Electrical connection with one or more wires, just Take formula computer disk, hard disk, random access storage device (RAM), read-only storage (ROM), erasable type and may be programmed read-only storage Device (EPROM or flash memory), optical fiber, portable compact disc read-only storage (CD-ROM), light storage device, magnetic memory device, Or above-mentioned any appropriate combination.In the disclosure, computer-readable recording medium can any include or store journey The tangible medium of sequence, the program can be commanded the either device use or in connection of execution system, device.And at this In open, computer-readable signal media can be included in a base band or the data-signal as carrier wave part propagation, Wherein carry computer-readable program code.The data-signal of this propagation can take various forms, including but unlimited In electromagnetic signal, optical signal or above-mentioned any appropriate combination.Computer-readable signal media can also be that computer can Any computer-readable medium beyond storage medium is read, the computer-readable medium, which can send, propagates or transmit, to be used for By instruction execution system, device either device use or program in connection.Included on computer-readable medium Program code can be transmitted with any appropriate medium, be included but is not limited to:Wirelessly, electric wire, optical cable, RF etc., or it is above-mentioned Any appropriate combination.In accordance with an embodiment of the present disclosure, computer-readable medium can include above-described ROM 602 And/or one or more memories beyond RAM 603 and/or ROM 602 and RAM 603.
Flow chart and block diagram in accompanying drawing, it is illustrated that according to the system of the various embodiments of the disclosure, method and computer journey Architectural framework in the cards, function and the operation of sequence product.At this point, each square frame in flow chart or block diagram can generation The part of one module of table, program segment or code, a part for above-mentioned module, program segment or code include one or more For realizing the executable instruction of defined logic function.It should also be noted that some as replace realization in, institute in square frame The function of mark can also be with different from the order marked in accompanying drawing generation.For example, two square frames succeedingly represented are actual On can perform substantially in parallel, electricity can perform in the opposite order sometimes for they, and this is depending on involved function.Also It is noted that the combination of each square frame and block diagram in block diagram or flow chart or the square frame in flow chart, can use and perform rule Fixed function or the special hardware based system of operation are realized, or can use the group of specialized hardware and computer instruction Close to realize.
As on the other hand, the disclosure additionally provides a kind of computer-readable medium, and the computer-readable medium can be Included in equipment described in above-described embodiment;Can also be individualism, and without be incorporated the equipment in.Above-mentioned calculating Machine computer-readable recording medium carries one or more program, when said one or multiple programs are performed by the equipment, makes Obtain equipment execution:A kind of data processing method, this method include:Obtain target data;Comparison object data and reference data, Corresponding variance data is obtained, wherein, target data has identical Data Identification with reference data, and reference data storage is in mesh Mark in table;And variance data is stored in had with object table in the mapping table of mapping relations, to replace to target data sheet The storage of body.
Embodiment of the disclosure is described above.But the purpose that these embodiments are merely to illustrate that, and It is not intended to limit the scope of the present disclosure.Although respectively describing each embodiment more than, but it is not intended that each reality Use can not be advantageously combined by applying the measure in example.The scope of the present disclosure is defined by the appended claims and the equivalents thereof.Do not take off From the scope of the present disclosure, those skilled in the art can make a variety of alternatives and modifications, and these alternatives and modifications should all fall at this Within scope of disclosure.

Claims (14)

1. a kind of data processing method, including:
Obtain target data;
Compare the target data and reference data, obtain corresponding variance data, wherein, the target data and the reference Data have identical Data Identification, and the reference data storage is in object table;And
The variance data is stored in be had in the mapping table of mapping relations with the object table, to replace to the number of targets According to the storage of itself.
2. according to the method for claim 1, wherein, methods described also includes:
The reference data is updated to the target data in the object table.
3. according to the method for claim 1, wherein, the target data and reference data, obtain corresponding difference Data include:
Determine the first data content and the first data generation time of the target data;
Determine the second data content and the second data generation time of the reference data;And
Compare first data content and the first data generation time described in second data content and comparison with it is described Second data generation time, obtains content deltas data and time difference data.
4. according to the method for claim 1, wherein, in the target data and reference data, obtain corresponding difference Before heteromerism evidence, methods described also includes:
Detect and whether there is the reference data in the object table;And
The reference data in the object table be present if detecting, perform the target data and reference data, obtain To the operation of corresponding variance data.
5. according to the method for claim 4, wherein, methods described also includes:
The reference data is not present in the object table if detecting, the object table is arrived into target data storage In.
6. according to the method for claim 1, wherein, methods described also includes:
Receive for indicating that the data query for inquiring about the target data instructs;
The object table is inquired about in the instruction instructed according to the data query, obtains object table Query Result;
The mapping table is inquired about in the instruction instructed according to the data query, obtains mapping table Query Result;And
The target data to be inquired about is determined according to the mapping table Query Result and the object table Query Result.
7. a kind of data handling system, including:
Acquisition module, for obtaining target data;
Comparison module, for the target data and reference data, corresponding variance data is obtained, wherein, the target Data have identical Data Identification with the reference data, and the reference data storage is in object table;And
First memory module, have for the variance data to be stored in the object table in the mapping table of mapping relations, To replace the storage to the target data in itself.
8. system according to claim 7, wherein, the system also includes:
Update module, for the reference data to be updated into the target data in the object table.
9. system according to claim 7, wherein, the comparison module includes:
First determining unit, for determining the first data content and the first data generation time of the target data;
Second determining unit, for determining the second data content and the second data generation time of the reference data;And
Comparing unit, produced for the first data described in first data content and second data content and comparison Raw time and the second data generation time, obtain content deltas data and time difference data.
10. system according to claim 7, wherein, the system also includes:
Detection module, it whether there is the reference data in the object table for detecting;And
Execution module, in the case where the reference data be present in detecting the object table, performing the mesh Data and reference data are marked, obtains the operation of corresponding variance data.
11. system according to claim 10, wherein, the system also includes:
Second memory module, in detecting the object table be not present the reference data in the case of, by the mesh Mark in object table described in data Cun Chudao.
12. system according to claim 7, wherein, the system also includes:
Receiving module, it is used to indicate the data query instruction for inquiring about the target data for receiving;
The object table is inquired about in first enquiry module, the instruction for being instructed according to the data query, obtains object table inquiry As a result;
The mapping table is inquired about in second enquiry module, the instruction for being instructed according to the data query, obtains mapping table inquiry As a result;And
Determining module, for determining the mesh to be inquired about according to the mapping table Query Result and the object table Query Result Mark data.
13. a kind of computer system, including:
One or more processors;
Storage device, for storing one or more programs,
Wherein, when one or more of programs are by one or more of computing devices so that one or more of Processor realizes the data processing method any one of claim 1 to 6.
14. a kind of computer-readable medium, is stored thereon with executable instruction, the instruction makes processor real when being executed by processor Data processing method any one of existing claim 1 to 6.
CN201710941787.5A 2017-10-10 2017-10-10 Data processing method and its system Pending CN107832336A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710941787.5A CN107832336A (en) 2017-10-10 2017-10-10 Data processing method and its system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710941787.5A CN107832336A (en) 2017-10-10 2017-10-10 Data processing method and its system

Publications (1)

Publication Number Publication Date
CN107832336A true CN107832336A (en) 2018-03-23

Family

ID=61647834

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710941787.5A Pending CN107832336A (en) 2017-10-10 2017-10-10 Data processing method and its system

Country Status (1)

Country Link
CN (1) CN107832336A (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108959374A (en) * 2018-05-24 2018-12-07 北京三快在线科技有限公司 Date storage method, device and electronic equipment
CN109710702A (en) * 2018-12-28 2019-05-03 税友软件集团股份有限公司 A kind of tables of data processing method, device, equipment and medium
CN111222663A (en) * 2018-11-23 2020-06-02 北京京东尚科信息技术有限公司 Data processing method and system, computer system and computer readable medium
CN111641690A (en) * 2020-05-20 2020-09-08 北京字节跳动网络技术有限公司 Session message processing method and device and electronic equipment
CN111984293A (en) * 2020-08-17 2020-11-24 腾讯科技(上海)有限公司 Information processing method, device and storage medium
CN112199683A (en) * 2020-09-11 2021-01-08 深圳价值在线信息科技股份有限公司 Data detection method, device, terminal and storage medium
CN113160918A (en) * 2021-05-21 2021-07-23 山东健康医疗大数据有限公司 Unified processing method and tool for capturing change data

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100235335A1 (en) * 2009-03-11 2010-09-16 Heman Sandor Abc Column-store database architecture utilizing positional delta tree update system and methods
CN103605776A (en) * 2013-11-28 2014-02-26 北京国双科技有限公司 Method and device for processing data of information database
CN104679794A (en) * 2013-12-03 2015-06-03 中兴通讯股份有限公司 Data difference analysis method and device
CN106776773A (en) * 2016-11-11 2017-05-31 苏州华元世纪科技发展有限公司 A kind of Dynamic data display system and method
CN107145549A (en) * 2017-04-27 2017-09-08 深圳智高点知识产权运营有限公司 A kind of database caches control method and system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100235335A1 (en) * 2009-03-11 2010-09-16 Heman Sandor Abc Column-store database architecture utilizing positional delta tree update system and methods
CN103605776A (en) * 2013-11-28 2014-02-26 北京国双科技有限公司 Method and device for processing data of information database
CN104679794A (en) * 2013-12-03 2015-06-03 中兴通讯股份有限公司 Data difference analysis method and device
CN106776773A (en) * 2016-11-11 2017-05-31 苏州华元世纪科技发展有限公司 A kind of Dynamic data display system and method
CN107145549A (en) * 2017-04-27 2017-09-08 深圳智高点知识产权运营有限公司 A kind of database caches control method and system

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108959374A (en) * 2018-05-24 2018-12-07 北京三快在线科技有限公司 Date storage method, device and electronic equipment
CN108959374B (en) * 2018-05-24 2020-12-29 北京三快在线科技有限公司 Data storage method and device and electronic equipment
CN111222663A (en) * 2018-11-23 2020-06-02 北京京东尚科信息技术有限公司 Data processing method and system, computer system and computer readable medium
CN111222663B (en) * 2018-11-23 2023-12-08 北京京东尚科信息技术有限公司 Data processing method and system, computer system and computer readable medium
CN109710702A (en) * 2018-12-28 2019-05-03 税友软件集团股份有限公司 A kind of tables of data processing method, device, equipment and medium
CN111641690A (en) * 2020-05-20 2020-09-08 北京字节跳动网络技术有限公司 Session message processing method and device and electronic equipment
CN111984293A (en) * 2020-08-17 2020-11-24 腾讯科技(上海)有限公司 Information processing method, device and storage medium
CN111984293B (en) * 2020-08-17 2023-09-12 腾讯科技(上海)有限公司 Information processing method, device and storage medium
CN112199683A (en) * 2020-09-11 2021-01-08 深圳价值在线信息科技股份有限公司 Data detection method, device, terminal and storage medium
CN113160918A (en) * 2021-05-21 2021-07-23 山东健康医疗大数据有限公司 Unified processing method and tool for capturing change data

Similar Documents

Publication Publication Date Title
CN107832336A (en) Data processing method and its system
CN110880084A (en) Warehouse replenishment method and device
CN109658018B (en) Method and device for improving warehousing and ex-warehouse efficiency
CN110019087A (en) Data processing method and its system
CN107729399A (en) The method and apparatus of data processing
CN111523977A (en) Wave order set creating method and device, computing equipment and medium
CN110019258A (en) The method and apparatus for handling order data
CN107908442A (en) Resource loading method, device, terminal device and computer-readable recording medium based on spring
CN110019310A (en) Data processing method and system, computer system, computer readable storage medium
WO2019076001A1 (en) Information updating method and device
CN110019214A (en) The method and apparatus that data split result is verified
CN107798558A (en) User behavior data analysis method and server
CN107590248A (en) Searching method, device, terminal and computer-readable recording medium
CN108985805B (en) Method and device for selectively executing push task
CN110020112A (en) Object Push method and its system
CN109426998A (en) Information-pushing method and device
CN111612385A (en) Method and device for clustering to-be-delivered articles
CN107291923B (en) Information processing method and device
CN107832347A (en) Method of Data with Adding Windows, system and electronic equipment
CN110060075A (en) For predicting the method, apparatus, system and medium of sales volume
CN107066614A (en) Data creation method and device
CN110688355A (en) Method and device for changing container state
CN110033292A (en) Information output method and device
CN114048847A (en) Method, device and equipment for caching graph neural network data and storage medium
CN109947861A (en) The method, apparatus and computer-readable medium of object table are generated for data warehouse

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20180323