CN102567528A - Method and device for reading mass data - Google Patents

Method and device for reading mass data Download PDF

Info

Publication number
CN102567528A
CN102567528A CN2011104531519A CN201110453151A CN102567528A CN 102567528 A CN102567528 A CN 102567528A CN 2011104531519 A CN2011104531519 A CN 2011104531519A CN 201110453151 A CN201110453151 A CN 201110453151A CN 102567528 A CN102567528 A CN 102567528A
Authority
CN
China
Prior art keywords
record
data
current
read
specific field
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2011104531519A
Other languages
Chinese (zh)
Other versions
CN102567528B (en
Inventor
马帅
邢铁军
张霞
房轶臣
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Neusoft Corp
Original Assignee
Neusoft Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Neusoft Corp filed Critical Neusoft Corp
Priority to CN201110453151.9A priority Critical patent/CN102567528B/en
Publication of CN102567528A publication Critical patent/CN102567528A/en
Application granted granted Critical
Publication of CN102567528B publication Critical patent/CN102567528B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The embodiment of the invention discloses a method and a device for reading mass data. The method comprises the following steps of: i) acquiring the mass data to be read; ii) acquiring the name of an appointed field and sequencing all records according to the appointed field; iii) acquiring an initial position and the number of records to be pre-read; iv) pre-reading the records with the number from the initial position and taking the records as the current data segment; v) traversing the value of the appointed field of each record in the current data segment from rear to front to acquire a final position, namely the position of the record about the change of the value of the appointed field; and vi) taking the record between the initial position and the final position as a data segment, officially reading, taking the position of the next record of the record at the final position as a new initial position, and performing the step iii). The initial position and the final position of each data segment can be dynamically adjusted when the mass data is read by segments, so that the integrity of each data segment is ensured.

Description

A kind of method and device that reads mass data
Technical field
The present invention relates to data processing field, especially relate to a kind of method and device that reads mass data.
Background technology
In productive life, often need to make various forms.In generation, when showing form; Inevitably can run into reading and the demonstration problem of mass data; In other words, related data are several ten thousand at least in the form, at most hundreds of thousands even up to a million; Data more than how inciting somebody to action so correctly read internal memory and then are presented on the interface, are the challenges that each form product is faced.
The related mass data of form generally all is to be stored in lane database.In the prior art; Normally the data database data being carried out segmentation (or claiming in batches) when generating form reads; The data of fixed qty in each reading database; Such as data to be read in the database is 100,000, reads 5000 and demonstration at every turn, then reads altogether can all data be read for 20 times to finish.The problem that the mode of using this segmentation to read can avoid the disposable internal memory that reads total data and cause to overflow.
The inventor is in realizing process of the present invention; Find that there is following shortcoming at least in prior art: when there is association in some data; This mode that reads by the fixed qty segmentation may be separated with these related data; Make the destroy integrity of data, thereby cause when processing such as adding up, gather, occurring mistake.For example, store many city records in the database, simultaneously each bar record is divided into groups according to affiliated area, as shown in table 1:
Table 1
The area The city Branch office The sales volume
North China Beijing BJ 3
Northeast Dalian DL 2
Northeast Shenyang SY 1
When reading first segment data, possibly only read preceding two records, obtain result as shown in table 2 when then carrying out subtotal:
Table 2
Figure BDA0000126764160000021
When reading second segment data, just read the 3rd record, obtain result as shown in table 3 when then carrying out subtotal:
Table 3
It is thus clear that in the prior art, when reading many records, will belong to the data of dividing into groups in northeast and force separately so not only subtotal have been carried out in the city of the Northeast twice, and because only added up a part of data at every turn, so the result of subtotal also is incorrect.
Again for example, store many salary records in the database, as shown in table 4:
Table 4
Name Kind The amount of money Month
Zhang San Wage 2000 November
Zhang San Bonus 800 November
Zhang San Meal is mended 200 November
Zhang San Traffic is mended 150 November
Li Si Wage 3000 November
Li Si Bonus 500 November
Li Si Meal is mended 250 November
Li Si Traffic is mended ?100 November
When reading first segment data, possibly only read the first six bar record, then can be intersected summary sheet (in this table many records in the corresponding original table of record), i.e. table 5 as follows by name:
Table 5
Figure BDA0000126764160000031
When reading second segment data, just read back two records, intersected summary sheet, i.e. table 6 as follows:
Table 6
Figure BDA0000126764160000032
It is thus clear that the wage of " Li Si " has been added up to twice, such result obviously is wrong, and the user can't accept.
Summary of the invention
The technical matters that the embodiment of the invention will solve is: when mass data is read in segmentation, and the problem of the destroy integrity of data.
The embodiment of the invention provides a kind of method that reads mass data, may further comprise the steps:
I) obtain mass data to be read, said mass data comprises many records, and every said record comprises some fields;
Ii) obtain the title of specific field in the said mass data, and all records in the said mass data are sorted by said specific field, so that the identical record of said designated word segment value is adjacent;
The quantity of reference position when iii) obtaining from said mass data reading of data and the record that will read in advance;
Iv) the said reference position from said mass data read said quantity in advance record as the current data section;
V) in said current data section, by from after forward order the value of the said specific field of each bar record is traveled through, obtaining end position, said end position is the position of the record that changes of the value of said specific field;
Vi) the record between said reference position and the said end position is formally read as one piece of data, and with the position of next bar record of the record at said end position place as new reference position, get into step I ii).
Preferably, step v) specifically comprises:
A, with the last item of said current data section record as current record;
B, judge whether the value of said specific field of a current record and a last record thereof identical, if identical, then with the last record of said current record as new current record, repeating step b; If different, the position of a last record that then obtains said current record is as end position.
Preferably, step I is v) afterwards further comprising the steps of:
Judge after the said current data section whether also have follow-up data, then continue to carry out,, then the current data section is formally read and withdraws from as one piece of data if do not have if having.
Preferably, judge that whether said current data section also has the step of follow-up data afterwards, specifically comprises:
A, read some records after the said current data section as redundant recording;
B, judge whether article one record of said redundant recording is empty, if then judging does not have trailer record, if not, then judging has trailer record.
Preferably, described in the steps A some be specially one.
The embodiment of the invention also provides a kind of device that reads mass data, comprising:
The data preparatory unit is used to obtain mass data to be read, and said mass data comprises many records, and every said record comprises some fields;
Pretreatment unit is used for obtaining the title of said mass data specific field, and all records in the said mass data are sorted by said specific field, so that the identical record of said designated word segment value is adjacent;
The starting point acquiring unit, the quantity of reference position when being used for obtaining and the record that will read in advance from said mass data reading of data;
Read the unit in advance, the record that is used for reading said quantity in advance from the said reference position of said mass data is as the current data section;
The ending acquiring unit is used in said current data section, by from after forward order the value of the said specific field of each bar record is traveled through, obtaining end position, said end position is the position of the record that changes of the value of said specific field;
Formal reading unit is used for the record between said reference position and the said end position is formally read as one piece of data, and the position that next bar of the record at said end position place is write down is as new reference position.
Preferably, said ending acquiring unit specifically comprises:
Initialization subelement: be used for the last item of said current data section is write down as current record;
The cycle criterion subelement: whether the value of said specific field that is used to judge a current record and a last record thereof is identical; If identical, then with the last record of said current record as new current record, continue to judge whether the value of said specific field of a current record and a last record thereof identical; If different, the position of a last record that then obtains said current record is as end position.
Preferred described device can also comprise:
The follow-up data judging unit is used to judge after the said current data section whether also have follow-up data, if then do not call end unit;
Said end unit is used for the current data section is formally read and withdraws from as one piece of data.
Preferably, said follow-up data judging unit specifically comprises:
Follow-up data reads subelement, is used to read said current data section some records afterwards as redundant recording;
The follow-up data judgment sub-unit is used to judge whether article one record of said redundant recording is empty, if not, then calls end unit.
Preferred said some are specially one.
The method and apparatus of the embodiment of the invention; When mass data is read in segmentation; Through using the integrity field technology dynamically to adjust the reference position and the end position of every segment data, thereby guaranteed the integrality of every segment data, made that processing such as adding up, gather can obtain correct result.In addition, solved and to have foreseen the follow-up problem that whether also has data through reading redundant recording.
Description of drawings
In order to be illustrated more clearly in the embodiment of the invention or technical scheme of the prior art; To do to introduce simply to the accompanying drawing of required use in embodiment or the description of the Prior Art below; Obviously, the accompanying drawing in describing below only is some embodiments of the present invention, for those of ordinary skills; Under the prerequisite of not paying creative work, can also obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 is the process flow diagram of the embodiment of the invention one method;
Fig. 2 is the process flow diagram of the embodiment of the invention two methods;
Fig. 3 is the embodiment of the invention three schematic representation of apparatus.
Embodiment
To combine the accompanying drawing in the embodiment of the invention below, the technical scheme in the embodiment of the invention is carried out clear, intactly description, obviously, described embodiment only is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, those of ordinary skills are not making the every other embodiment that is obtained under the creative work prerequisite, all belong to the scope of the present invention's protection.
Embodiment one
Fig. 1 is the process flow diagram of the embodiment of the invention one method, may further comprise the steps:
S101: obtain mass data to be read, said mass data comprises many records, and every said record comprises some fields;
S102: obtain the title of specific field in the said mass data, and all records in the said mass data are sorted by said specific field, so that the identical record of said designated word segment value is adjacent;
S103: the quantity of reference position when obtaining from said mass data reading of data and the record that will read in advance;
S104: the said reference position from said mass data reads the record of said quantity in advance as the current data section;
S105: in said current data section, by from after forward order the value of the said specific field of each bar record is traveled through, obtaining end position, said end position is the position of the record that changes of the value of said specific field;
S106: the record between said reference position and the said end position is formally read as one piece of data, and with the position of next bar record of the record at said end position place as new reference position, get into S103.
Embodiment two
Fig. 2 is the process flow diagram of the embodiment of the invention two methods, may further comprise the steps:
S201: obtain mass data.Obtaining mass data specifically can be the position that obtains mass data, for example address on disk etc.Mass data is the earning record data of the magnanimity of lane database storage in the present embodiment, and every earning record comprises fields such as " name ", " wage ", " bonus ".
S202: select " name " field as integrity field.Integrity field is a specific field.
S203: sort by " name ".Make all names be one group on the record record next-door neighbour composition form of " Li Si " for one group on the record of " Zhang San " the next-door neighbour composition form, all names, or the like.After ordering, be equivalent to divide into groups by name, only guaranteed otherwise this component is cut then each bar record of this name just can not cut apart.
S204: establish x=1, m=500.The effect of this step is that x and m are carried out initialization.M is the quantity of each record that reads in advance in the present embodiment, and promptly the length of each pre-reading data section is fixed value.The position of article one record that x reads when reading in advance at every turn in advance also is the reference position of each pre-reading data section, simultaneously also as the reference position of the data segment that formally reads.
S205: the record of the m bar between the x to y is read in internal memory in advance as the pre-reading data section, and as current data section, wherein y=x-m+1.It should be noted that under situation about having begin to read m bar when record from x, the data of possible x back are the m bar not enough, m becomes the bar number of the actual record that reads at this moment.
S206: judge after the y whether also have follow-up data,, then get into S208 if having if then do not get into S207.This step is an optional step.In other embodiment of the present invention, can when reading the sky data segment in advance, withdraw from flow process in this case automatically and get final product not to whether also having follow-up data to judge after the y.
S207: the record between the x to y is formally read and withdraw from flow process as one piece of data.
S208: obtain the value a of " name " field of y bar record, for example a=Li Si.
S209:i=1, wherein i is an interim counting variable.The effect of this step is that i is carried out initialization.
S210: obtain the value b of " name " field of y-i bar record, for example b=Zhang San.
S211: judge whether b equals a.If then get into S212.If not, then change has taken place in the value of representative " name " field herein, and the end position of the data segment that y-i promptly need formally read gets into S213.Noting, in the present embodiment y and y-i " name " field are compared, in other embodiment of the present invention, is 0 in the time of can also making i initial, searches the position of having sent out change through y-i and y-i-1 are compared at every turn.
S212:i=i+1 continues to carry out S210.
S213: the record between the x to y-i is formally read.After formally reading, can also have the record between this x to y-i outputed on the screen to show, or export the medium step of other storeies to.
S214:x=y-i+1。Be about to the reference position of the position of next bar record of y-i as next pre-reading data section, S205 is carried out in circulation then.
In addition, preferred step S206 can specifically may further comprise the steps:
S2061: read said current data section n bar record afterwards as redundant recording, promptly read y+1~y+n bar and write down, wherein n >=1 as redundant recording.Preferred n=1 in the present embodiment.
S2062: article one record of judging said redundant recording is whether y+1 bar record is empty, if then judging does not have trailer record, if not, then judging has trailer record.
Embodiment three
Fig. 3 is the embodiment of the invention three schematic representation of apparatus, comprising:
Data preparatory unit 301 is used to obtain mass data to be read, and said mass data comprises many records, and every said record comprises some fields;
Pretreatment unit 302 is used for obtaining the title of said mass data specific field, and all records in the said mass data are sorted by said specific field, so that the identical record of said designated word segment value is adjacent;
Starting point acquiring unit 303, the quantity of reference position when being used for obtaining and the record that will read in advance from said mass data reading of data;
Read unit 304 in advance, the record that is used for reading said quantity in advance from the said reference position of said mass data is as the current data section;
Ending acquiring unit 305 is used in said current data section, by from after forward order the value of the said specific field of each bar record is traveled through, obtaining end position, said end position is the position of the record that changes of the value of said specific field;
Formal reading unit 306 is used for the record between said reference position and the said end position is formally read as one piece of data, and the position that next bar of the record at said end position place is write down is as new reference position.
Preferably, said ending acquiring unit 305 specifically comprises:
Initialization subelement: be used for the last item of said current data section is write down as current record;
The cycle criterion subelement: whether the value of said specific field that is used to judge a current record and a last record thereof is identical; If identical, then with the last record of said current record as new current record, continue to judge whether the value of said specific field of a current record and a last record thereof identical; If different, the position of a last record that then obtains said current record is as end position.
Preferred said device can also comprise:
The follow-up data judging unit is used to judge after the said current data section whether also have follow-up data, if then do not call end unit;
End unit is used for the current data section is formally read and withdraws from as one piece of data.
Preferably, said follow-up data judging unit specifically can comprise:
Follow-up data reads subelement, is used to read said current data section some records afterwards as redundant recording;
The follow-up data judgment sub-unit is used to judge whether article one record of said redundant recording is empty, if not, then calls end unit.
Preferred said some are specially one.
For device embodiment, because it is basically similar in appearance to method embodiment, so description is fairly simple, relevant part gets final product referring to the part explanation of method embodiment.
Need to prove; In this article; Relational terms such as first and second grades only is used for an entity or operation are made a distinction with another entity or operation, and not necessarily requires or hint relation or the order that has any this reality between these entities or the operation.And; Term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability; Thereby make and comprise that process, method, article or the equipment of a series of key elements not only comprise those key elements; But also comprise other key elements of clearly not listing, or also be included as this process, method, article or equipment intrinsic key element.Under the situation that do not having much more more restrictions, the key element that limits by statement " comprising ... ", and be not precluded within process, method, article or the equipment that comprises said key element and also have other identical element.
One of ordinary skill in the art will appreciate that all or part of step that realizes in the said method embodiment is to instruct relevant hardware to accomplish through program; Described program can be stored in the computer read/write memory medium; Here the alleged storage medium that gets, as: ROM/RAM, magnetic disc, CD etc.
The above is merely preferred embodiment of the present invention, is not to be used to limit protection scope of the present invention.All any modifications of within spirit of the present invention and principle, being done, be equal to replacement, improvement etc., all be included in protection scope of the present invention.

Claims (10)

1. a method that reads mass data is characterized in that, may further comprise the steps:
I) obtain mass data to be read, said mass data comprises many records, and every said record comprises some fields;
Ii) obtain the title of specific field in the said mass data, and all records in the said mass data are sorted by said specific field, so that the identical record of said designated word segment value is adjacent;
The quantity of reference position when iii) obtaining from said mass data reading of data and the record that will read in advance;
Iv) the said reference position from said mass data read said quantity in advance record as the current data section;
V) in said current data section, by from after forward order the value of the said specific field of each bar record is traveled through, obtaining end position, said end position is the position of the record that changes of the value of said specific field;
Vi) the record between said reference position and the said end position is formally read as one piece of data, and with the position of next bar record of the record at said end position place as new reference position, get into step I ii).
2. method according to claim 1 is characterized in that step v) specifically comprises:
A, with the last item of said current data section record as current record;
B, judge whether the value of said specific field of a current record and a last record thereof identical, if identical, then with the last record of said current record as new current record, repeating step b; If different, the position of a last record that then obtains said current record is as end position.
3. method according to claim 1 is characterized in that, step I is v) afterwards further comprising the steps of:
Judge after the said current data section whether also have follow-up data, then continue to carry out,, then the current data section is formally read and withdraws from as one piece of data if do not have if having.
4. method according to claim 3 is characterized in that, judges that whether said current data section also has the step of follow-up data afterwards, specifically comprises:
A, read some records after the said current data section as redundant recording;
B, judge whether article one record of said redundant recording is empty, if then judging does not have trailer record, if not, then judging has trailer record.
5. method according to claim 4 is characterized in that, some are specially one described in the steps A.
6. a device that reads mass data is characterized in that, comprising:
The data preparatory unit is used to obtain mass data to be read, and said mass data comprises many records, and every said record comprises some fields;
Pretreatment unit is used for obtaining the title of said mass data specific field, and all records in the said mass data are sorted by said specific field, so that the identical record of said designated word segment value is adjacent;
The starting point acquiring unit, the quantity of reference position when being used for obtaining and the record that will read in advance from said mass data reading of data;
Read the unit in advance, the record that is used for reading said quantity in advance from the said reference position of said mass data is as the current data section;
The ending acquiring unit is used in said current data section, by from after forward order the value of the said specific field of each bar record is traveled through, obtaining end position, said end position is the position of the record that changes of the value of said specific field;
Formal reading unit is used for the record between said reference position and the said end position is formally read as one piece of data, and the position that next bar of the record at said end position place is write down is as new reference position.
7. device according to claim 6 is characterized in that, said ending acquiring unit specifically comprises:
Initialization subelement: be used for the last item of said current data section is write down as current record;
The cycle criterion subelement: whether the value of said specific field that is used to judge a current record and a last record thereof is identical; If identical, then with the last record of said current record as new current record, continue to judge whether the value of said specific field of a current record and a last record thereof identical; If different, the position of a last record that then obtains said current record is as end position.
8. device according to claim 6 is characterized in that, also comprises:
The follow-up data judging unit is used to judge after the said current data section whether also have follow-up data, if then do not call end unit;
Said end unit is used for the current data section is formally read and withdraws from as one piece of data.
9. device according to claim 8 is characterized in that, said follow-up data judging unit specifically comprises:
Follow-up data reads subelement, is used to read said current data section some records afterwards as redundant recording;
The follow-up data judgment sub-unit is used to judge whether article one record of said redundant recording is empty, if not, then calls end unit.
10. device according to claim 9 is characterized in that said some are specially one.
CN201110453151.9A 2011-12-29 2011-12-29 Method and device for reading mass data Active CN102567528B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201110453151.9A CN102567528B (en) 2011-12-29 2011-12-29 Method and device for reading mass data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201110453151.9A CN102567528B (en) 2011-12-29 2011-12-29 Method and device for reading mass data

Publications (2)

Publication Number Publication Date
CN102567528A true CN102567528A (en) 2012-07-11
CN102567528B CN102567528B (en) 2014-01-29

Family

ID=46412927

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201110453151.9A Active CN102567528B (en) 2011-12-29 2011-12-29 Method and device for reading mass data

Country Status (1)

Country Link
CN (1) CN102567528B (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106777378A (en) * 2017-02-13 2017-05-31 北京小米移动软件有限公司 The method and apparatus for accessing user data
CN107395701A (en) * 2017-07-11 2017-11-24 携程旅游网络技术(上海)有限公司 Data processing method based on FTP server and data compression
CN110750303A (en) * 2019-09-25 2020-02-04 支付宝(杭州)信息技术有限公司 Pipelined instruction reading method and device based on FPGA
CN110908972A (en) * 2019-11-19 2020-03-24 加和(北京)信息科技有限公司 Log data preprocessing method and device, electronic equipment and storage medium
CN111178101A (en) * 2019-12-31 2020-05-19 展讯通信(上海)有限公司 Recording reading method, recording reading device and storage medium
CN111444023A (en) * 2020-04-13 2020-07-24 中国银行股份有限公司 Data processing method, device, equipment and readable storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003075173A2 (en) * 2002-03-01 2003-09-12 Software Engineering Gmbh Sorting data with long sort fields
US6651067B1 (en) * 2000-05-05 2003-11-18 Sagent Technology Method and apparatus for creating a data set with pending results
US20040001161A1 (en) * 2002-07-01 2004-01-01 Microsoft Corporation System and method for providing user control over repeating objects embedded in a stream
CN101119302A (en) * 2007-09-06 2008-02-06 华中科技大学 Method for digging frequency mode in the lately time window of affair data flow
CN101303877A (en) * 2007-05-11 2008-11-12 索尼株式会社 Replay apparatus and management information acquiring method
CN102142031A (en) * 2011-03-18 2011-08-03 南京邮电大学 Rough set-based mass data partitioning method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6651067B1 (en) * 2000-05-05 2003-11-18 Sagent Technology Method and apparatus for creating a data set with pending results
WO2003075173A2 (en) * 2002-03-01 2003-09-12 Software Engineering Gmbh Sorting data with long sort fields
US20040001161A1 (en) * 2002-07-01 2004-01-01 Microsoft Corporation System and method for providing user control over repeating objects embedded in a stream
CN101303877A (en) * 2007-05-11 2008-11-12 索尼株式会社 Replay apparatus and management information acquiring method
CN101119302A (en) * 2007-09-06 2008-02-06 华中科技大学 Method for digging frequency mode in the lately time window of affair data flow
CN102142031A (en) * 2011-03-18 2011-08-03 南京邮电大学 Rough set-based mass data partitioning method

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106777378A (en) * 2017-02-13 2017-05-31 北京小米移动软件有限公司 The method and apparatus for accessing user data
CN107395701A (en) * 2017-07-11 2017-11-24 携程旅游网络技术(上海)有限公司 Data processing method based on FTP server and data compression
CN107395701B (en) * 2017-07-11 2021-01-29 携程旅游网络技术(上海)有限公司 Data processing method based on FTP server and data compression
CN110750303A (en) * 2019-09-25 2020-02-04 支付宝(杭州)信息技术有限公司 Pipelined instruction reading method and device based on FPGA
CN110750303B (en) * 2019-09-25 2020-10-20 支付宝(杭州)信息技术有限公司 Pipelined instruction reading method and device based on FPGA
CN110908972A (en) * 2019-11-19 2020-03-24 加和(北京)信息科技有限公司 Log data preprocessing method and device, electronic equipment and storage medium
CN111178101A (en) * 2019-12-31 2020-05-19 展讯通信(上海)有限公司 Recording reading method, recording reading device and storage medium
CN111178101B (en) * 2019-12-31 2023-02-21 展讯通信(上海)有限公司 Recording reading method, recording reading device and storage medium
CN111444023A (en) * 2020-04-13 2020-07-24 中国银行股份有限公司 Data processing method, device, equipment and readable storage medium

Also Published As

Publication number Publication date
CN102567528B (en) 2014-01-29

Similar Documents

Publication Publication Date Title
CN102567528B (en) Method and device for reading mass data
US7805439B2 (en) Method and apparatus for selecting data records from versioned data
CN104239301B (en) A kind of data comparison method and device
US20140310245A1 (en) Partition level backup and restore of a massively parallel processing database
TW201741906A (en) Page resource delivery method and apparatus
US10528680B2 (en) Partitioned joins in analytical databases
CN103995908A (en) Method and device for importing data
CN102567408A (en) Method and device for recommending search keyword
CN113778295B (en) Book recommendation method and device, computer equipment and storage medium
CN110688349B (en) Document sorting method, device, terminal and computer readable storage medium
CN101751406A (en) Method and device for realizing column storage based relational database
CN106486167B (en) Improve the method and system that flash memory is removed
CN106709851B (en) Big data retrieval method and device
CN113342750A (en) File data comparison method, device, equipment and storage medium
CN106649412B (en) Data processing method and equipment
CN103902701A (en) Data storage system and data storage method
CN102521713B (en) Data processing equipment and data processing method
CN102867134A (en) System and method for splicing gene sequence fragments
CN103064908A (en) Method for rapidly removing repeated list through a memory
CN109543113B (en) Method and device for determining click recommendation words, storage medium and electronic equipment
CN108205576A (en) A kind of method and system for using and analyzing data based on Tool for Data Warehouse HIVE partitioned storages
US20070050396A1 (en) Fast algorithm for building multimedia library database
CN107665116A (en) Page resource position information processing method and device
CN105550347B (en) Data processing method and device
CN106779909A (en) Material matching process and device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant