CN104268272A - Method and device for checking uniqueness of data - Google Patents

Method and device for checking uniqueness of data Download PDF

Info

Publication number
CN104268272A
CN104268272A CN201410541504.4A CN201410541504A CN104268272A CN 104268272 A CN104268272 A CN 104268272A CN 201410541504 A CN201410541504 A CN 201410541504A CN 104268272 A CN104268272 A CN 104268272A
Authority
CN
China
Prior art keywords
data
uniqueness
saved
index
target index
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201410541504.4A
Other languages
Chinese (zh)
Inventor
于忠清
洪普君
王金龙
翟伟伟
王友强
崔九梅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
QINGDAO RUIHONG TECHNOLOGY CO., LTD.
TungKong Co., Ltd.
Original Assignee
Qingdao Haiersoft Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Haiersoft Co Ltd filed Critical Qingdao Haiersoft Co Ltd
Priority to CN201410541504.4A priority Critical patent/CN104268272A/en
Publication of CN104268272A publication Critical patent/CN104268272A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2455Query execution
    • G06F16/24553Query execution of query operations
    • G06F16/24554Unary operations; Data partitioning operations
    • G06F16/24556Aggregation; Duplicate elimination

Abstract

The application provides a method and a device for checking uniqueness of data. The method comprises the steps of: when to-be-stored data are received, generating a target index based on the to-be-stored data and obtaining an index table preset in a primary database, wherein indexes of stored data in the primary database are stored in the index table, and the indexes are set as primary keys; performing target index writing operation on the index table to obtain writing results; determining that the to-be-stored data have no uniqueness if the writing results include primary key repeated information; determining that the to-be-stored data have uniqueness if no primary key repeated information exists in the writing results. What needs to be explained is that the embodiment of the invention is to perform the writing operation on the index table in the primary data and determine whether the to-be-stored data in the primary database have uniqueness based on whether the primary key repeated information is returned by the index table.

Description

A kind of data uniqueness inspection method and device
Technical field
The present invention relates to database technical field, especially a kind of data uniqueness inspection method and device.
Background technology
Database, is a kind ofly store the system of data according to certain data model tissue, is stored with mass data, therefore can be regarded as the warehouse of data.Usually, increase, deletion, amendment, query manipulation are comprised to the operation of database.Data volume greatly and data manipulation frequently, can affect the performance of database.Therefore, data base read-write isolation technics is arisen at the historic moment.
Particularly, the principle of data base read-write isolation technics arranges at least two databases, i.e. master data base and from database.Master data base process to the increasing of data, delete and change operation, look into query manipulation from database processing, effectively can alleviate the I/O interface pressure of database like this.Briefly, master data base primary responsibility be data write operation, only provide data query service from database.In order to ensure the synchronism of database, after write data in master data base, master data base by data syn-chronization to from database.We know, before the write operation of database, in order to reduce data redundancy, need to carry out uniqueness inspection to the data stored in database, namely check in database whether stored these data.
Conventional data uniqueness test mode arranges uniqueness field in a database, utilizes in uniqueness Field Inquiry database whether there are data to be written.But in the Database Systems of application data base read and write abruption technology, be written in a period of time before master data base completes to synchronous operation in data, the data in two databases are not identical.Now, when utilizing from data base querying data uniqueness, Query Result there will be error.
Summary of the invention
In view of this, the invention provides a kind of data uniqueness inspection method and device, in order to solve in prior art utilize from database carry out data uniqueness check time, there is the technical matters of error in check result.For realizing described goal of the invention, technical scheme provided by the invention is as follows:
A kind of data uniqueness inspection method, comprising:
When receiving data to be saved, according to described data genaration target index to be saved;
Obtain the concordance list pre-set in master data base; Wherein, in described concordance list, store the index having preserved data in described master data base, and described index is set to major key;
Perform the operation writing described target index to described concordance list, obtain and write result;
Write described in judgement in result and whether comprise major key duplicate message;
If so, determine that described data to be saved do not have uniqueness;
Otherwise, determine that described data to be saved have uniqueness.
Above-mentioned data uniqueness inspection method, preferably, described according to described data genaration target index to be saved, comprising:
When described packet to be saved is containing multiple field, obtains several preset field and splice, obtain target index; Wherein, several preset field described are multiple fields that acquiescence has the not reproducible constraint of associating.
Above-mentioned data uniqueness inspection method, preferably, writes result described in described foundation, after determining the uniqueness check result of described data to be saved, also comprises:
When described uniqueness check result is for having uniqueness, described data to be written are write in described master data base;
When described uniqueness check result is not for having uniqueness, reminder-data repeats.
Above-mentioned data uniqueness inspection method, preferably, described described data to be written are write in described master data base after, also comprise:
By extremely described from database for the data syn-chronization to be written write in described master data base.
Above-mentioned data uniqueness inspection method, preferably, described target index is index character string.
Present invention also provides a kind of data uniqueness testing fixture, comprising:
Target index generation unit, for when receiving data to be saved, according to described data genaration target index to be saved;
Concordance list acquiring unit, for obtaining the concordance list pre-set in master data base; Wherein, in described concordance list, store the index having preserved data in described master data base, and described index is set to major key;
Target index r/w cell, for performing the operation writing described target index to described concordance list, obtains and writes result;
Judging unit, writes in result whether comprise major key duplicate message described in judging; If so, the first result unit is triggered; Otherwise, trigger the second result unit;
First result unit, for determining that described data to be saved do not have uniqueness;
Second result unit, for determining that described data to be saved have uniqueness.
Above-mentioned data uniqueness testing fixture, preferably, described target index generation unit comprises:
Target index generates subelement, for when described packet to be saved is containing multiple field, obtains several preset field and splices, obtain target index; Wherein, several preset field described are multiple fields that acquiescence has the not reproducible constraint of associating.
Above-mentioned data uniqueness testing fixture, preferably, also comprises:
Described data to be written, for when described uniqueness check result is for having uniqueness, are write in described master data base by data write unit;
Miscue unit, for when described uniqueness check result is not for having uniqueness, reminder-data repeats.
Above-mentioned data uniqueness testing fixture, preferably, also comprises:
Data synchronisation unit, for described described data to be written are write in described master data base after, by the data syn-chronization to be written that writes in described master data base to described from database.
Above-mentioned data uniqueness testing fixture, preferably, the target index that described target index generation unit generates is index character string.
Data uniqueness inspection method provided by the invention and device, when receiving data to be saved, according to described data genaration target index to be saved, and obtain the concordance list pre-set in master data base; Wherein, the index having preserved data in described master data base is stored in described concordance list, and described index is set to major key, and the operation writing described target index is performed to described concordance list, result is write in acquisition, comprises major key duplicate message if write in result, determines that described data to be saved do not have uniqueness, if write in result and do not comprise major key duplicate message, determine that described data to be saved have uniqueness.Need explanation, the embodiment of the present invention carries out write operation to the concordance list in master data, whether return major key duplicate message according to concordance list and determine whether data to be saved have uniqueness in master data base, visible, the embodiment of the present invention only utilizes the write operation of master data base, do not carry out read operation to from database, uniqueness check result is more accurate.
Accompanying drawing explanation
In order to be illustrated more clearly in the embodiment of the present invention or technical scheme of the prior art, be briefly described to the accompanying drawing used required in embodiment or description of the prior art below, apparently, accompanying drawing in the following describes is only embodiments of the invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to the accompanying drawing provided.
The process flow diagram of the data uniqueness inspection method that Fig. 1 provides for the embodiment of the present invention;
Another process flow diagram of the data uniqueness inspection method that Fig. 2 provides for the embodiment of the present invention;
The structured flowchart of the data uniqueness testing fixture that Fig. 3 provides for the embodiment of the present invention;
Another structured flowchart of the data uniqueness testing fixture that Fig. 4 provides for the embodiment of the present invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, be clearly and completely described the technical scheme in the embodiment of the present invention, obviously, described embodiment is only the present invention's part embodiment, instead of whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art, not making the every other embodiment obtained under creative work prerequisite, belong to the scope of protection of the invention.
Use in the Database Systems of read and write abruption technology, when carrying out uniqueness and checking, there will be inspection error.Particularly, after writing data in master data, to before carrying out data syn-chronization operation from database, error can be there is because data are asynchronous to the uniqueness inquiry from database.Trace it to its cause, in master data base, first write data, need thereafter certain hour to from database synchronization data, in the mistiming, carry out uniqueness inspection then must cause error.
One of resolving ideas avoids this mistiming, specifically, is carry out uniqueness inspection in master data again to after database synchronization data.But, the invention provides another one resolving ideas, namely directly in master data base, carry out uniqueness inspection.But, we know, main logarithmic data storehouse provides transactional operation, namely increase, delete and revise, do not provide inquiry service, and the setting of master and slave database is exactly the on-stream pressure read to solve the write of individual data storehouse, therefore, the present invention, when utilizing above-mentioned thinking, needs to find a kind of effective inspection method.
With reference to Fig. 1, it illustrates the flow process of the data uniqueness inspection method that the embodiment of the present invention provides, specifically comprise the following steps:
Step S101: when receiving data to be saved, according to described data genaration target index to be saved.
Wherein, data to be saved are the data needing to be written in master data base.When receiving data to be saved, generate the index that these data to be saved are corresponding.Index has uniqueness, and this uniqueness index therefore can be utilized to check data.Wherein, the method for data genaration index to be saved is utilized to refer to hereafter.
Step S102: obtain the concordance list pre-set in master data base; Wherein, in described concordance list, store the index having preserved data in described master data base, and described index is set to major key.
In the present embodiment, in advance for the every bar data record in database all generates corresponding unique index, and by each index stores in the concordance list pre-set.That is, the index of the total data of having preserved in master data base is stored in concordance list.
Need to illustrate, in concordance list, the row storing index are set to major key.Reason is, because the Major key of bar data record every in tables of data all can not be identical, thus, arranges major key just in order to ensure that in concordance list to there is repeating data in concordance list.Due to the index that major key is data in master data base, thus, the uniqueness of data in master data base is namely ensured.
Step S103: perform the operation writing described target index to described concordance list, obtains and writes result.
Wherein, we know, database, before carrying out write operation to the data in tables of data, can carry out corresponding judgement according to every setting of tables of data.Wherein, tables of data is set to major key, then major key must be utilized to judge whether to there is repeating data, if existed, generates major key duplicate message, causes writing unsuccessfully.When by every inspection, write successfully.
That is, write the index of data to be saved to concordance list, concordance list automatically generates and writes result.Wherein, write in result and may include major key duplicate message.
Step S104: write in result whether comprise major key duplicate message described in judgement; If so, step S105 is performed; Otherwise, perform step S106.
Wherein, by judging to write in result whether comprise major key duplicate message, just can know whether data to be written have uniqueness in concordance list.Following two steps is performed respectively according to judged result.
Step S105: determine that described data to be saved do not have uniqueness.
Not there is uniqueness, that is, in concordance list, there are not the data identical with data to be written, because the major key in concordance list is the index of data in master data base, and then illustrate in master data base there are not the data identical with data to be written.
Step S106: determine that described data to be saved have uniqueness.
There is uniqueness, that is, in concordance list, there are the data identical with data to be written, and then illustrate in master data base to there is identical data.
From above technical scheme, the data uniqueness inspection method that the embodiment of the present invention provides, when receiving data to be saved, according to described data genaration target index to be saved, and obtains the concordance list pre-set in master data base; Wherein, the index having preserved data in described master data base is stored in described concordance list, and described index is set to major key, and the operation writing described target index is performed to described concordance list, result is write in acquisition, comprises major key duplicate message if write in result, determines that described data to be saved do not have uniqueness, if write in result and do not comprise major key duplicate message, determine that described data to be saved have uniqueness.Need explanation, the embodiment of the present invention carries out write operation to the concordance list in master data, whether return major key duplicate message according to concordance list and determine whether data to be saved have uniqueness in master data base, visible, the embodiment of the present invention only utilizes the write operation of master data base, do not carry out read operation to from database, uniqueness check result is more accurate.
In the above-described embodiments, step S101 is when receiving data to be saved, and the concrete mode according to described data genaration target index to be saved can be:
When receiving data to be saved and described packet to be saved contains multiple field, obtaining several preset field and splicing, obtain target index.Wherein, several preset field described are provided with the not reproducible constraint of associating in described master data base.
Particularly, the data record preserved in master data base, can give tacit consent to multiple field and have the character of combining not reproducible constraint, and namely the field value of joinirreducible bundle can not be simultaneously identical.Such as, the data record stored in master data base comprises six fields, is ID, CODE, NAME, GRADE, CLASS and AGE, represents major key, student number, name, grade, class and age respectively.Wherein, default na ME, GRADE and CLASS tri-fields are the not reproducible field of associating, that is, can not store identical two the data records of name, grade and class in a database.
In the present embodiment, data to be saved are identical with data in master data base, comprise same multiple fields, and then, generate unique index by arranging the field of combining not reproducible constraint.Preferably, described index is index character string.The method of generating indexes character string can have multiple, as the value of multiple preset field spliced successively, can use "-" character during splicing.Such as, data to be saved are as shown in table 1, and NAME, GRADE and CLASS tri-fields are the field being provided with joinirreducible bundle in master data base, therefore, utilize "-" to splice successively " Zhang San ", " senior class " and " six classes " three values, the target index of acquisition can be " Zhang San-senior class-six classes ".
Table 1
ID CODE NAME GRADE CLASS AGE
10002 S00123 Zhang San Senior class Six classes 10
Need to illustrate, the mode of above-mentioned generating indexes is a kind of example, is not limited thereto in the embodiment of the present invention.In real data storehouse, because field amount is different or field data types is different, the mode of generating indexes is not quite similar, and has the field value of combining not reproducible constraint character as long as can utilize to be spliced into the mode of index all passable.In addition, splicing index also necessarily uses the field having and combine not reproducible constraint, can also utilize multiple fields of associating major key or other unique constraints.
Need to illustrate, in each embodiment above-mentioned, in master data base, acquiescence has the field of combining not reproducible constraint character and does not arrange the not reproducible constraint of this associating, does not also arrange joint index.We know that the tables of data arranging joint index needs the index to having set up to upgrade after process write, amendment and deletion action, therefore, arrange the readwrite performance that joint index can affect database.Therefore, the present embodiment does not arrange joint index in tables of data, but concordance list is set separately, concordance list is utilized to preserve the index value generated by the not reproducible bind field of associating, this index value is set to major key, utilize the major key of concordance list to detect data uniqueness, like this, the uniqueness of data is detected more rapidly and efficiently.Certainly, in order to improve the efficiency of inspection further, this concordance list only can comprise index field one column data.
See Fig. 2, it illustrates another flow process of the data uniqueness inspection method that the embodiment of the present invention provides, comprising on the embodiment step basis shown in above-mentioned Fig. 1, further comprising the steps of:
Step S107: reminder-data repeats.
After step S105, perform this step, that is, when data to be saved do not have uniqueness in master data base, generate the prompting message of Data duplication, and point out to user.
Step S108: described data to be written are write in described master data base.
Perform this step after step s 106, that is, when data to be saved have uniqueness in master data base, in master data base, write data to be saved.
Further, on the basis of the embodiment shown in Fig. 2, can also comprise: by extremely described from database for the data syn-chronization to be written write in described master data base.So far, can complete and the data to be saved with uniqueness are as one man preserved in master data base and from database, also just accurately can inquire about from database.
Be introduced the data uniqueness testing fixture that the embodiment of the present invention provides below, need to illustrate, the explanation of relevant data uniqueness testing fixture see the explanation of each data uniqueness inspection method above, can not repeat below.
With reference to Fig. 3, it illustrates the structure of the data uniqueness testing fixture that the invention process provides, specifically comprise: target index generation unit 101, concordance list acquiring unit 102, target index r/w cell 103, judging unit 104, first result unit 105 and the second result unit 106.Wherein:
Target index generation unit 101, for when receiving data to be saved, according to described data genaration target index to be saved;
Concordance list acquiring unit 102, for obtaining the concordance list pre-set in master data base; Wherein, in described concordance list, store the index having preserved data in described master data base, and described index is set to major key;
Target index r/w cell 103, for performing the operation writing described target index to described concordance list, obtains and writes result;
Judging unit 104, writes in result whether comprise major key duplicate message described in judging; If so, the first result unit is triggered; Otherwise, trigger the second result unit;
First result unit 105, for determining that described data to be saved do not have uniqueness;
Second result unit 106, for determining that described data to be saved have uniqueness.
From the technical scheme of the present embodiment, target index generation unit 101 is when receiving data to be saved, and according to described data genaration target index to be saved, concordance list acquiring unit 102 obtains the concordance list pre-set in master data base, wherein, the index having preserved data in described master data base is stored in described concordance list, and described index is set to major key, target index r/w cell 103 performs the operation writing described target index to described concordance list, result is write in acquisition, judging unit 104 writes in result whether comprise major key duplicate message described in judging, major key duplicate message is comprised if write in result, first result unit 105 determines that described data to be saved do not have uniqueness, if write in result and do not comprise major key duplicate message, second result unit 106 determines that described data to be saved have uniqueness.Need explanation, the embodiment of the present invention carries out write operation to the concordance list in master data, whether return major key duplicate message according to concordance list and determine whether data to be saved have uniqueness in master data base, visible, the embodiment of the present invention only utilizes the write operation of master data base, do not carry out read operation to from database, uniqueness check result is more accurate.
Alternatively, above-mentioned target index generation unit 101 comprises:
Target index generates subelement, for when described packet to be saved is containing multiple field, obtains several preset field and splices, obtain target index; Wherein, several preset field described are multiple fields that acquiescence has the not reproducible constraint of associating.
See Fig. 4, on the data uniqueness testing fixture basis shown in above-mentioned Fig. 3, can also comprise:
Miscue unit 107, is connected with described first result unit 105, repeats for reminder-data.
Data write unit 108, is connected with described second result unit 106, for described data to be written being write in described master data base.
On the device basic shown in Fig. 4 alternatively, also comprise: data synchronisation unit, be connected with described data write unit 108, for described described data to be written are write in described master data base after, by the data syn-chronization to be written that writes in described master data base to described from database.
Alternatively, the target index that described target index generation unit generates is index character string.
It should be noted that, each embodiment in this instructions all adopts the mode of going forward one by one to describe, and what each embodiment stressed is the difference with other embodiments, between each embodiment identical similar part mutually see.
Also it should be noted that, in this article, the such as relational terms of first and second grades and so on is only used for an entity or operation to separate with another entity or operational zone, and not necessarily requires or imply the relation that there is any this reality between these entities or operation or sequentially.And, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thus make to comprise the process of a series of key element, method, article or equipment and not only comprise those key elements, but also comprise other key elements clearly do not listed, or also comprise by the intrinsic key element of this process, method, article or equipment.When not more restrictions, the key element limited by statement " comprising ... ", and be not precluded within process, method, article or the equipment comprising above-mentioned key element and also there is other identical element.
To the above-mentioned explanation of the disclosed embodiments, professional and technical personnel in the field are realized or uses the present invention.To be apparent for those skilled in the art to the multiple amendment of these embodiments, General Principle as defined herein can without departing from the spirit or scope of the present invention, realize in other embodiments.Therefore, the present invention can not be restricted to these embodiments shown in this article, but will meet the widest scope consistent with principle disclosed herein and features of novelty.

Claims (10)

1. a data uniqueness inspection method, is characterized in that, comprising:
When receiving data to be saved, according to described data genaration target index to be saved;
Obtain the concordance list pre-set in master data base; Wherein, in described concordance list, store the index having preserved data in described master data base, and described index is set to major key;
Perform the operation writing described target index to described concordance list, obtain and write result;
Write described in judgement in result and whether comprise major key duplicate message;
If so, determine that described data to be saved do not have uniqueness;
Otherwise, determine that described data to be saved have uniqueness.
2. data uniqueness inspection method according to claim 1, is characterized in that, described according to described data genaration target index to be saved, comprising:
When described packet to be saved is containing multiple field, obtains several preset field and splice, obtain target index; Wherein, several preset field described are multiple fields that acquiescence has the not reproducible constraint of associating.
3. data uniqueness inspection method according to claim 1, is characterized in that, described in described foundation, write result, after determining the uniqueness check result of described data to be saved, also comprises:
When described uniqueness check result is for having uniqueness, described data to be written are write in described master data base;
When described uniqueness check result is not for having uniqueness, reminder-data repeats.
4. data uniqueness inspection method according to claim 3, is characterized in that, described described data to be written are write in described master data base after, also comprise:
By extremely described from database for the data syn-chronization to be written write in described master data base.
5. data uniqueness inspection method according to claim 1, is characterized in that, described target index is index character string.
6. a data uniqueness testing fixture, is characterized in that, comprising:
Target index generation unit, for when receiving data to be saved, according to described data genaration target index to be saved;
Concordance list acquiring unit, for obtaining the concordance list pre-set in master data base; Wherein, in described concordance list, store the index having preserved data in described master data base, and described index is set to major key;
Target index r/w cell, for performing the operation writing described target index to described concordance list, obtains and writes result;
Judging unit, writes in result whether comprise major key duplicate message described in judging; If so, the first result unit is triggered; Otherwise, trigger the second result unit;
First result unit, for determining that described data to be saved do not have uniqueness;
Second result unit, for determining that described data to be saved have uniqueness.
7. data uniqueness testing fixture according to claim 6, is characterized in that, described target index generation unit comprises:
Target index generates subelement, for when described packet to be saved is containing multiple field, obtains several preset field and splices, obtain target index; Wherein, several preset field described are multiple fields that acquiescence has the not reproducible constraint of associating.
8. data uniqueness testing fixture according to claim 6, is characterized in that, also comprise:
Described data to be written, for when described uniqueness check result is for having uniqueness, are write in described master data base by data write unit;
Miscue unit, for when described uniqueness check result is not for having uniqueness, reminder-data repeats.
9. data uniqueness testing fixture according to claim 8, is characterized in that, also comprise:
Data synchronisation unit, for described described data to be written are write in described master data base after, by the data syn-chronization to be written that writes in described master data base to described from database.
10. data uniqueness testing fixture according to claim 6, is characterized in that, the target index that described target index generation unit generates is index character string.
CN201410541504.4A 2014-10-14 2014-10-14 Method and device for checking uniqueness of data Pending CN104268272A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410541504.4A CN104268272A (en) 2014-10-14 2014-10-14 Method and device for checking uniqueness of data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410541504.4A CN104268272A (en) 2014-10-14 2014-10-14 Method and device for checking uniqueness of data

Publications (1)

Publication Number Publication Date
CN104268272A true CN104268272A (en) 2015-01-07

Family

ID=52159793

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410541504.4A Pending CN104268272A (en) 2014-10-14 2014-10-14 Method and device for checking uniqueness of data

Country Status (1)

Country Link
CN (1) CN104268272A (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105740405A (en) * 2016-01-29 2016-07-06 华为技术有限公司 Data storage method and device
CN106156050A (en) * 2015-03-27 2016-11-23 阿里巴巴集团控股有限公司 A kind of data processing method and device
CN106708948A (en) * 2016-11-24 2017-05-24 广东网金控股股份有限公司 Method and apparatus for implementing transaction operation with primary key uniqueness
CN108121733A (en) * 2016-11-29 2018-06-05 北京国双科技有限公司 The querying method and device of a kind of data
CN108255867A (en) * 2016-12-29 2018-07-06 北京国双科技有限公司 Unique mark processing method and processing device
CN108763363A (en) * 2018-05-17 2018-11-06 阿里巴巴集团控股有限公司 A kind of method and device for examining record to be written
CN108958959A (en) * 2017-05-18 2018-12-07 北京京东尚科信息技术有限公司 The method and apparatus for detecting hive tables of data
CN108984660A (en) * 2018-06-28 2018-12-11 中译语通科技股份有限公司 A kind of MySQL database master-slave synchronisation data duplicate removal method
CN109726204A (en) * 2018-12-24 2019-05-07 深圳市奋源科技有限公司 A kind of data information management method and device based on self-defining data table
CN110569398A (en) * 2019-09-09 2019-12-13 广州虎牙科技有限公司 data processing method and device, computer equipment and readable storage medium
CN112395360A (en) * 2020-12-01 2021-02-23 中国联合网络通信集团有限公司 Data synchronization method, device, apparatus and medium based on non-relational database
CN113204468A (en) * 2021-05-13 2021-08-03 山东英信计算机技术有限公司 Method, system and storage medium for removing duplicate of server diagnosis information

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101350869A (en) * 2007-07-19 2009-01-21 中国电信股份有限公司 Method and apparatus for removing repeat of telecom charging based on index and hash
CN101382949A (en) * 2008-10-28 2009-03-11 阿里巴巴集团控股有限公司 Management method for database table and apparatus
US20100274771A1 (en) * 2009-04-24 2010-10-28 International Business Machines Corporation Information Processing Apparatus, and Information Processing Method, Program, and Recording Medium
CN102129458A (en) * 2011-03-09 2011-07-20 胡劲松 Method and device for storing relational database
CN103425672A (en) * 2012-05-17 2013-12-04 阿里巴巴集团控股有限公司 Method and device for creating indexes of database

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101350869A (en) * 2007-07-19 2009-01-21 中国电信股份有限公司 Method and apparatus for removing repeat of telecom charging based on index and hash
CN101382949A (en) * 2008-10-28 2009-03-11 阿里巴巴集团控股有限公司 Management method for database table and apparatus
US20100274771A1 (en) * 2009-04-24 2010-10-28 International Business Machines Corporation Information Processing Apparatus, and Information Processing Method, Program, and Recording Medium
CN102129458A (en) * 2011-03-09 2011-07-20 胡劲松 Method and device for storing relational database
CN103425672A (en) * 2012-05-17 2013-12-04 阿里巴巴集团控股有限公司 Method and device for creating indexes of database

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106156050A (en) * 2015-03-27 2016-11-23 阿里巴巴集团控股有限公司 A kind of data processing method and device
CN106156050B (en) * 2015-03-27 2020-01-10 阿里巴巴集团控股有限公司 Data processing method and device
CN105740405A (en) * 2016-01-29 2016-07-06 华为技术有限公司 Data storage method and device
CN105740405B (en) * 2016-01-29 2020-06-26 华为技术有限公司 Method and device for storing data
US11030178B2 (en) 2016-01-29 2021-06-08 Huawei Technologies Co., Ltd. Data storage method and apparatus
CN106708948A (en) * 2016-11-24 2017-05-24 广东网金控股股份有限公司 Method and apparatus for implementing transaction operation with primary key uniqueness
CN108121733A (en) * 2016-11-29 2018-06-05 北京国双科技有限公司 The querying method and device of a kind of data
CN108255867A (en) * 2016-12-29 2018-07-06 北京国双科技有限公司 Unique mark processing method and processing device
CN108958959A (en) * 2017-05-18 2018-12-07 北京京东尚科信息技术有限公司 The method and apparatus for detecting hive tables of data
CN108958959B (en) * 2017-05-18 2022-04-12 北京京东尚科信息技术有限公司 Method and device for detecting hive data table
CN108763363A (en) * 2018-05-17 2018-11-06 阿里巴巴集团控股有限公司 A kind of method and device for examining record to be written
CN108763363B (en) * 2018-05-17 2022-02-18 创新先进技术有限公司 Method and device for checking record to be written
CN108984660A (en) * 2018-06-28 2018-12-11 中译语通科技股份有限公司 A kind of MySQL database master-slave synchronisation data duplicate removal method
CN109726204A (en) * 2018-12-24 2019-05-07 深圳市奋源科技有限公司 A kind of data information management method and device based on self-defining data table
CN109726204B (en) * 2018-12-24 2023-01-31 深圳市奋源科技有限公司 Data management method and device based on user-defined data table
CN110569398A (en) * 2019-09-09 2019-12-13 广州虎牙科技有限公司 data processing method and device, computer equipment and readable storage medium
CN112395360A (en) * 2020-12-01 2021-02-23 中国联合网络通信集团有限公司 Data synchronization method, device, apparatus and medium based on non-relational database
CN112395360B (en) * 2020-12-01 2023-06-23 中国联合网络通信集团有限公司 Data synchronization method, device, apparatus and medium based on non-relational database
CN113204468A (en) * 2021-05-13 2021-08-03 山东英信计算机技术有限公司 Method, system and storage medium for removing duplicate of server diagnosis information

Similar Documents

Publication Publication Date Title
CN104268272A (en) Method and device for checking uniqueness of data
CN107807982B (en) Consistency checking method and device for heterogeneous database
US10067954B2 (en) Use of dynamic dictionary encoding with an associated hash table to support many-to-many joins and aggregations
CN102279749B (en) Method and equipment for merging codes
CN105138461A (en) Interface testing method and device for application program
CN107665171A (en) Automatic regression test method and device
CN103902698A (en) Data storage system and data storage method
CN102024046B (en) Data repeatability checking method and device as well as system
CN103176989B (en) Data base's table level comparative approach based on data dictionary and variable rules and system
CN103902702A (en) Data storage system and data storage method
CN103995908A (en) Method and device for importing data
CN102591855A (en) Data identification method and data identification system
CN108038175A (en) Multidimensional data dynamically associates querying method, device, computer equipment and medium
CN103902701A (en) Data storage system and data storage method
CN105354272B (en) A kind of index calculating method and system based on dimension combination
CN105354256A (en) Data pagination query method and apparatus
CN102981946B (en) ETL smoke test method
CN109165209B (en) Data verification method, device, equipment and medium for object types in database
CN105512017A (en) Database compatibility detection method and device
CN104778179A (en) Data migration test method and system
CN110222027A (en) The quantity method of calibration and computer readable storage medium of Data Migration
CN103810094B (en) Execution method, device and the testing tool of a kind of test cases
CN104484478A (en) Correlation clustered data slimming method and system
CN104463460B (en) Processing method and processing device for the waiting information that network data is launched
CN107766519B (en) Method for visually configuring data structure

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C41 Transfer of patent application or patent right or utility model
CB03 Change of inventor or designer information

Inventor after: Liu Hong

Inventor after: Di Weiwei

Inventor after: Wang Jinlong

Inventor after: Hong Pujun

Inventor before: Yu Zhongqing

Inventor before: Hong Pujun

Inventor before: Wang Jinlong

Inventor before: Di Weiwei

Inventor before: Wang Youqiang

Inventor before: Cui Jiumei

COR Change of bibliographic data
TA01 Transfer of patent application right

Effective date of registration: 20160415

Address after: 250100 Ji'nan, Shandong Province, North Hill Road, No. 23

Applicant after: TungKong Co., Ltd.

Applicant after: QINGDAO RUIHONG TECHNOLOGY CO., LTD.

Address before: Laoshan District Green Road 266071 Shandong city of Qingdao province No. 19 11 floor

Applicant before: Haiersoft Corporation

RJ01 Rejection of invention patent application after publication

Application publication date: 20150107

RJ01 Rejection of invention patent application after publication