CN109522273A - A kind of method and device for realizing data write-in - Google Patents
A kind of method and device for realizing data write-in Download PDFInfo
- Publication number
- CN109522273A CN109522273A CN201811360321.7A CN201811360321A CN109522273A CN 109522273 A CN109522273 A CN 109522273A CN 201811360321 A CN201811360321 A CN 201811360321A CN 109522273 A CN109522273 A CN 109522273A
- Authority
- CN
- China
- Prior art keywords
- data
- write
- aggregate file
- affairs
- packaged
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the present application discloses a kind of method and device for realizing data write-in, time-consuming for reducing data write-in, this method comprises: obtaining current database affairs, parsing obtains action type and data from current database affairs；When the writing mode that action type is write operation and data is write-in aggregate file, the writing position of action type, the mark of aggregate file and aggregate file is packaged into affairs to be processed；The mark of aggregate file, the writing position of aggregate file and data are packaged into data item, and data item is cached in data list；Affairs to be processed are packaged into log, log and data list are packaged into write-in item structure, write-in item structure is submitted in journal queue；Write-in item structure is obtained, aggregate file is written into the data in data list, log system is written into log.
Description
Technical field
This application involves technical field of data processing, and in particular to a kind of method and device for realizing data write-in.
Background technique
With the sharp increase of information age data scale and the continuous promotion of data value, storage system must have good
Good scalability simultaneously takes effective measures to guarantee the reliability of user data and the high-performance of access.In order to adapt to store
Demand for services, it is existing integrate file storage, object storage, block storage, four kinds of storage services of big data distribution deposit
Store up framework, by high efficient and reliable data be automatically repaired with automatic O&M mechanism, significantly reduce the burden of storage management.But
When being that data are written toward storage system in mass data, usually secondary write-in is first written log system, bottom is then written again
Layer storage equipment causes write-in time-consuming very long, and problem more highlights when being especially concurrently written.
Summary of the invention
In view of this, the embodiment of the present application provides a kind of method and device for realizing data write-in, to solve the prior art
The technical issues of middle data write-in takes a long time.
To solve the above problems, technical solution provided by the embodiments of the present application is as follows:
A method of realizing data write-in, which comprises
Current database affairs are obtained, parsing obtains action type and data from the current database affairs；
When the writing mode that the action type is write operation and the data is write-in aggregate file, by the behaviour
The writing position for making type, the mark of aggregate file and the aggregate file is packaged into affairs to be processed；
The mark of the aggregate file, the writing position of the aggregate file and the data are packaged into data item,
And the data item is cached in data list；
The affairs to be processed are packaged into log, the log and the data list are packaged into write-in item knot
Said write item structure is submitted in journal queue by structure；
Said write item structure is obtained, the aggregate file is written into the data in the data list, by the day
Log system is written in will.
In one possible implementation, the method also includes:
It is determined whether to enable write-ins to optimize function, if so, triggering execute the acquisition current database affairs and after
Continuous step.
In one possible implementation, the write-in optimization function of whether opening is arranged by interface operation.
In one possible implementation, the write-in optimization function of whether opening is arranged by command line mode.
In one possible implementation, described by the action type, the mark of aggregate file and the polymerization
The writing position of file is packaged into affairs to be processed, comprising:
Writable aggregate file is judged whether there is, if so, the writable aggregate file is determined as described
The aggregate file of data write-in, if not, applying for new aggregate file and being determined as the aggregate file of the data write-in；
The mark for the aggregate file that the action type, the data are written and the writing position of the aggregate file
It is packaged into affairs to be processed.
A kind of device for realizing data write-in, described device include:
Acquiring unit, for obtaining current database affairs, parsing obtains operation class from the current database affairs
Type and data；
First encapsulation unit, for being that write-in is poly- when the writing mode that the action type is write operation and the data
When closing file, the writing position of the action type, the mark of aggregate file and the aggregate file is packaged into be processed
Affairs；
Second encapsulation unit, for by the writing position of the mark of the aggregate file, the aggregate file and described
Data are packaged into data item, and the data item is cached in data list；
Unit is submitted, for the affairs to be processed to be packaged into log, the log and the data list are encapsulated
At write-in item structure, said write item structure is submitted in journal queue；
For obtaining said write item structure the polymerization is written in data in the data list by writing unit
Log system is written in the log by file.
In one possible implementation, described device further include:
Judging unit, for it is determined whether to enable write-ins to optimize function；
The acquiring unit is specifically used for, if the judging result of the judging unit is yes, acquisition current database thing
Business, parsing obtains action type and data from the current database affairs.
In one possible implementation, the write-in optimization function of whether opening is arranged by interface operation.
In one possible implementation, the write-in optimization function of whether opening is arranged by command line mode.
In one possible implementation, first encapsulation unit includes:
Judgment sub-unit, for being write-in polymerization when the writing mode that the action type is write operation and the data
When file, writable aggregate file is judged whether there is；
Determine subelement, if the judging result for the judgment sub-unit be it is yes, by the writable polymerization text
Part is determined as the aggregate file of data write-in, if the judging result of the judgment sub-unit be it is no, apply for new polymerization
File and the aggregate file for being determined as the data write-in；
Subelement is encapsulated, for by the mark of the action type, the aggregate file of data write-in and described poly-
The writing position for closing file is packaged into affairs to be processed.
It can be seen that the embodiment of the present application has the following beneficial effects:
The embodiment of the present application when needing to write data into aggregate file, by action type, the mark of aggregate file and
The writing position of aggregate file is packaged into affairs to be processed, which is packaged into log, meanwhile, it will be by aggregate file
Mark, aggregate file writing position and data be packaged into data item and be added in data list, log and data list
Be packaged into jointly write-in item structure, in writing log thread, can according to write-in item structure simultaneously will be in data list
Aggregate file is written in data, and log system is written in log, realizes the write-once of data, reduces the time-consuming of data write-in.
Detailed description of the invention
Fig. 1 is a kind of flow chart of method for realizing data write-in provided by the embodiments of the present application；
Fig. 2 is the flow chart of another method for realizing data write-in provided by the embodiments of the present application；
Fig. 3 is a kind of schematic diagram of device for realizing data write-in provided by the embodiments of the present application.
Specific embodiment
In order to make the above objects, features, and advantages of the present application more apparent, with reference to the accompanying drawing and it is specific real
Mode is applied to be described in further detail the embodiment of the present application.
In Ceph distributed memory system, in data write-in, log can be write in log system, guarantee to break down
When data can be from journal recovery.Object polymerization, which refers to, aggregates into one large amount of small documents (file less than 1M calls small documents)
The big file of a 64M writes data into aggregate file less than 64M then zero padding, then aggregate file is stored to bottom and is stored
Cluster, can reduce the read-write input and output (IO) of storage cluster in this way, and raising writes bandwidth and reduces time-consuming.In the prior art,
When aggregate file is written in data, needs to be written twice, take a long time.
Based on this, the embodiment of the present application is optimized for object polymerization, keeps data written only once, realizes that data are same
When write-in log system and write-in aggregate file, greatly reduce read-write input and output, improve client write-in bandwidth, subtract
The time-consuming of data write-in is lacked.
Below in conjunction with attached drawing, the method and device of realization data write-in provided by the embodiments of the present application is carried out specifically
It is bright.
It is shown in Figure 1, a kind of flow chart of method for realizing data write-in provided by the embodiments of the present application is shown, it can
With the following steps are included:
Step 101: obtaining current database affairs, parsing obtains action type and number from current database affairs
According to.
In some possible implementations, before executing step 101 can first it is determined whether to enable write-in optimize function
Can, if so, triggering executes step 101 and subsequent step, if it is not, then original data write-in process is executed, to data
It is written twice.
Whether unlatching write-in optimization function can have user's self-setting, if boundary can be passed through by opening write-in optimization function
Face operation setting can also be arranged by command line mode.
The option for whether opening write-in optimization function can be set in interface, opened or closed and write by interface operation
Enter to optimize function；Alternatively, can by input order line to whether open write-in optimization function be configured.
After determining that opening write-in optimizes function, available current all database affairs (Transaction), parsing
Action type and corresponding data in every affairs out.Action type represents which kind of behaviour Current transaction needs to carry out data
Make, such as write operation, read operation etc..When action type is for write operation, the letter such as writing mode of data can also be obtained
Breath, e.g. write-in current catalogue, or write-in aggregate file etc..
Step 102: when the writing mode that action type is write operation and data is write-in aggregate file, class will be operated
The writing position of type, the mark of aggregate file and aggregate file is packaged into affairs to be processed.
If data need that aggregate file is written, in some possible implementations, can first judge whether there is can
The aggregate file of write-in, if so, writable aggregate file to be determined as to the aggregate file of data write-in, if not, application
New aggregate file is simultaneously determined as the aggregate file that data are written；Then the mark for aggregate file action type, data being written
Know and the writing position of aggregate file is packaged into affairs to be processed.
Aggregate file is generally the file of 64M, when data need that aggregate file is written, it is first determined whether has polymerization text
Part, if representing not writable aggregate file without if.When there are aggregate file, judgement aggregate file be written is remained
Whether covolume amount can be written into data, if not writable aggregate file cannot be represented also.When the aggregate file being written
Residual capacity can be written into data, then represent there are writable aggregate files.When not writable aggregate file, need
Apply for new aggregate file and be determined as the aggregate file of data write-in, when there are writable aggregate file, then this is writeable
The aggregate file entered is the aggregate file of data write-in.
Data write-in aggregate file have mark and writing position, by action type, the mark of aggregate file and
The writing position of aggregate file is packaged into affairs to be processed.
Step 103: the mark of aggregate file, the writing position of aggregate file and data being packaged into data item, and will
Data item is cached in data list.
Step 104: affairs to be processed are packaged into log, log and data list are packaged into write-in item structure, it will
Write-in item structure is submitted in journal queue.
Affairs to be processed are packaged into log, log and data list are packaged into write-in item (write_item) knot
Write-in item structure is submitted in journal queue by structure.
Step 105: obtaining write-in item structure, aggregate file is written into the data in data list, day is written into log
Aspiration system.
In writing log thread, first according to the content in data item, write data into corresponding aggregate file, and remember
The mark of aggregate file is recorded, when aggregate file is written into completion, batch sync (synchronization) aggregate file makes data rule, finally will
Log system and sync rule is written in log.
In addition, in the application stage of log, it is only necessary to object and the relevant metadata of aggregate file are updated storage,
Periodically metadata is submitted in the database of storage metadata in sync_thread thread, and sync file system makes data
Rule.
In this way, the embodiment of the present application is when needing to write data into aggregate file, by action type, the mark of aggregate file
And the writing position of aggregate file is packaged into affairs to be processed, which is packaged into log, meanwhile, it will will polymerize
The mark of file, the writing position of aggregate file and data are packaged into data item and are added in data list, log and data
List is packaged into write-in item structure jointly, can be according to write-in item structure simultaneously by data list in writing log thread
In data be written aggregate file, log system is written into log, realizes the write-once of data, reduce data write-in consumption
When.
Below again by taking practical application scene as an example, to it is provided by the embodiments of the present application it is a kind of realize data write-in method into
Row explanation, this method may include:
Step 201: it is determined whether to enable write-ins to optimize function, if so, 203 are entered step, if not, entering step
202。
Step 202: executing legacy data and process is written.
Step 203: obtaining current database affairs, parsing obtains action type and number from current database affairs
According to.
Step 204: when action type be write operation, judge data writing mode whether be write-in aggregate file, such as
Fruit is to execute step 206, if not, executing step 205.
Step 205: executing original log Optimizing Flow.
If data will be written under current catalogue, original log Optimizing Flow is executed, i.e. data first write temp
Under catalogue, then in application stage rename to the current catalogue of log.
Step 206: the aggregate file of request for data write-in.
Step 207: the writing position of action type, the mark of aggregate file and aggregate file is packaged into thing to be processed
Business.
Step 208: the mark of aggregate file, the writing position of aggregate file and data being packaged into data item, and will
Data item is cached in data list.
Step 209: affairs to be processed are packaged into log, log and data list are packaged into write-in item structure, it will
Write-in item structure is submitted in journal queue.
Step 210: obtaining write-in item structure, aggregate file is written into the data in data list, day is written into log
Aspiration system.
In this way, the embodiment of the present application opens write-in optimization function, it is written only once that client writes data into storage cluster,
It optimizes data write-in and needs the problem of being written twice.Read-write IO is greatly reduced, client write-in bandwidth is improved, reduces
The time-consuming of data write-in, the significant increase competitiveness of product under big data, the cloud computing scene.
It is shown in Figure 3, a kind of device for realizing data write-in provided by the embodiments of the present application is shown, may include:
Acquiring unit 301 is parsed from the current database affairs and is operated for obtaining current database affairs
Type and data；
First encapsulation unit 302, for being to write when the writing mode that the action type is write operation and the data
When entering aggregate file, by the writing position of the action type, the mark of aggregate file and the aggregate file be packaged into
Handle affairs；
Second encapsulation unit 303, for by the writing position of the mark of the aggregate file, the aggregate file and institute
It states data and is packaged into data item, and the data item is cached in data list；
Unit 304 is submitted, for the affairs to be processed to be packaged into log, the log and the data list are sealed
Write-in item structure is dressed up, said write item structure is submitted in journal queue；
Writing unit 305, it is for obtaining said write item structure, the data write-in in the data list is described poly-
File is closed, log system is written into the log.
In one possible implementation, described device further include:
Judging unit, for it is determined whether to enable write-ins to optimize function；
The acquiring unit is specifically used for, if the judging result of the judging unit is yes, acquisition current database thing
Business, parsing obtains action type and data from the current database affairs.
In one possible implementation, the write-in optimization function of whether opening is arranged by interface operation.
In one possible implementation, the write-in optimization function of whether opening is arranged by command line mode.
In one possible implementation, first encapsulation unit includes:
Judgment sub-unit, for being write-in polymerization when the writing mode that the action type is write operation and the data
When file, writable aggregate file is judged whether there is；
Determine subelement, if the judging result for the judgment sub-unit be it is yes, by the writable polymerization text
Part is determined as the aggregate file of data write-in, if the judging result of the judgment sub-unit be it is no, apply for new polymerization
File and the aggregate file for being determined as the data write-in；
Subelement is encapsulated, for by the mark of the action type, the aggregate file of data write-in and described poly-
The writing position for closing file is packaged into affairs to be processed.
In this way, the embodiment of the present application is when needing to write data into aggregate file, by action type, the mark of aggregate file
And the writing position of aggregate file is packaged into affairs to be processed, which is packaged into log, meanwhile, it will will polymerize
The mark of file, the writing position of aggregate file and data are packaged into data item and are added in data list, log and data
List is packaged into write-in item structure jointly, can be according to write-in item structure simultaneously by data list in writing log thread
In data be written aggregate file, log system is written into log, realizes the write-once of data, reduce data write-in consumption
When.
It should be noted that each embodiment in this specification is described in a progressive manner, each embodiment emphasis is said
Bright is the difference from other embodiments, and the same or similar parts in each embodiment may refer to each other.For reality
For applying system or device disclosed in example, since it is corresponded to the methods disclosed in the examples, so being described relatively simple, phase
Place is closed referring to method part illustration.
It should be appreciated that in this application, " at least one (item) " refers to one or more, and " multiple " refer to two or two
More than a."and/or" indicates may exist three kinds of relationships, for example, " A and/or B " for describing the incidence relation of affiliated partner
It can indicate: only exist A, only exist B and exist simultaneously tri- kinds of situations of A and B, wherein A, B can be odd number or plural number.Word
Symbol "/" typicallys represent the relationship that forward-backward correlation object is a kind of "or"." at least one of following (a) " or its similar expression, refers to
Any combination in these, any combination including individual event (a) or complex item (a).At least one of for example, in a, b or c
(a) can indicate: a, b, c, " a and b ", " a and c ", " b and c ", or " a and b and c ", and wherein a, b, c can be individually, can also
To be multiple.
It should also be noted that, herein, relational terms such as first and second and the like are used merely to one
Entity or operation are distinguished with another entity or operation, without necessarily requiring or implying between these entities or operation
There are any actual relationship or orders.Moreover, the terms "include", "comprise" or its any other variant are intended to contain
Lid non-exclusive inclusion, so that the process, method, article or equipment including a series of elements is not only wanted including those
Element, but also including other elements that are not explicitly listed, or further include for this process, method, article or equipment
Intrinsic element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that
There is also other identical elements in process, method, article or equipment including the element.
The step of method described in conjunction with the examples disclosed in this document or algorithm, can directly be held with hardware, processor
The combination of capable software module or the two is implemented.Software module can be placed in random access memory (RAM), memory, read-only deposit
Reservoir (ROM), electrically programmable ROM, electrically erasable ROM, register, hard disk, moveable magnetic disc, CD-ROM or technology
In any other form of storage medium well known in field.
The foregoing description of the disclosed embodiments makes professional and technical personnel in the field can be realized or use the application.
Various modifications to these embodiments will be readily apparent to those skilled in the art, as defined herein
General Principle can be realized in other embodiments without departing from the spirit or scope of the application.Therefore, the application
It is not intended to be limited to the embodiments shown herein, and is to fit to and the principles and novel features disclosed herein phase one
The widest scope of cause.
Claims (10)
1. a kind of method for realizing data write-in, which is characterized in that the described method includes:
Current database affairs are obtained, parsing obtains action type and data from the current database affairs；
When the writing mode that the action type is write operation and the data is write-in aggregate file, by the operation class
The writing position of type, the mark of aggregate file and the aggregate file is packaged into affairs to be processed；
The mark of the aggregate file, the writing position of the aggregate file and the data are packaged into data item, and will
The data item is cached in data list；
The affairs to be processed are packaged into log, the log and the data list are packaged into write-in item structure, it will
Said write item structure is submitted in journal queue；
Said write item structure is obtained, the aggregate file is written into the data in the data list, by the log write
Enter log system.
2. the method according to claim 1, wherein the method also includes:
It is determined whether to enable write-ins to optimize function, if so, triggering executes the acquisition current database affairs and subsequent step
Suddenly.
3. according to the method described in claim 2, it is characterized in that, the write-in optimization function of whether opening passes through interface operation
Setting.
4. according to the method described in claim 2, it is characterized in that, the write-in optimization function of whether opening passes through order line side
Formula setting.
5. the method according to claim 1, wherein it is described by the action type, the mark of aggregate file with
And the writing position of the aggregate file is packaged into affairs to be processed, comprising:
Writable aggregate file is judged whether there is, if so, the writable aggregate file is determined as the data
The aggregate file of write-in, if not, applying for new aggregate file and being determined as the aggregate file of the data write-in；
The mark for the aggregate file that the action type, the data are written and the writing position encapsulation of the aggregate file
At affairs to be processed.
6. a kind of device for realizing data write-in, which is characterized in that described device includes:
Acquiring unit, for obtaining current database affairs, from the current database affairs parsing obtain action type with
And data；
First encapsulation unit, for being write-in polymerization text when the writing mode that the action type is write operation and the data
When part, the writing position of the action type, the mark of aggregate file and the aggregate file is packaged into affairs to be processed；
Second encapsulation unit, for by the writing position of the mark of the aggregate file, the aggregate file and the data
It is packaged into data item, and the data item is cached in data list；
Submit unit that the log and the data list are packaged into and are write for the affairs to be processed to be packaged into log
Enter item structure, said write item structure is submitted in journal queue；
For obtaining said write item structure the aggregate file is written in data in the data list by writing unit,
Log system is written into the log.
7. device according to claim 6, which is characterized in that described device further include:
Judging unit, for it is determined whether to enable write-ins to optimize function；
The acquiring unit is specifically used for, if the judging result of the judging unit is yes, acquisition current database affairs, from
Parsing obtains action type and data in the current database affairs.
8. device according to claim 7, which is characterized in that the write-in optimization function of whether opening passes through interface operation
Setting.
9. device according to claim 7, which is characterized in that the write-in optimization function of whether opening passes through order line side
Formula setting.
10. device according to claim 6, which is characterized in that first encapsulation unit includes:
Judgment sub-unit, for being write-in aggregate file when the writing mode that the action type is write operation and the data
When, judge whether there is writable aggregate file；
Determine subelement, if the judging result for the judgment sub-unit be it is yes, the writable aggregate file is true
Be set to the aggregate file of data write-in, if the judging result of the judgment sub-unit be it is no, apply for new aggregate file
And it is determined as the aggregate file of the data write-in；
Subelement is encapsulated, for the action type, the mark of the aggregate file of data write-in and the polymerization is literary
The writing position of part is packaged into affairs to be processed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811360321.7A CN109522273B (en) | 2018-11-15 | 2018-11-15 | Method and device for realizing data writing |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811360321.7A CN109522273B (en) | 2018-11-15 | 2018-11-15 | Method and device for realizing data writing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109522273A true CN109522273A (en) | 2019-03-26 |
| CN109522273B CN109522273B (en) | 2022-02-18 |
Family
ID=65777824
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811360321.7A Active CN109522273B (en) | 2018-11-15 | 2018-11-15 | Method and device for realizing data writing |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109522273B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110399101A (en) * | 2019-07-19 | 2019-11-01 | 苏州浪潮智能科技有限公司 | A kind of Write-operation process method of disk, device, system and storage medium |
| CN110781133A (en) * | 2019-10-25 | 2020-02-11 | 深信服科技股份有限公司 | ROW snapshot method, system, equipment and computer readable storage medium |
| CN113779083A (en) * | 2021-01-29 | 2021-12-10 | 北京京东拓先科技有限公司 | Data processing method, device, server and storage medium |
| CN113821519A (en) * | 2020-11-26 | 2021-12-21 | 北京沃东天骏信息技术有限公司 | Data processing method and field-driven design architecture |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102693312A (en) * | 2012-05-28 | 2012-09-26 | 清华大学 | Flexible transaction management method in key-value store data storage |
| CN105183868A (en) * | 2015-09-15 | 2015-12-23 | 浪潮(北京)电子信息产业有限公司 | Storage method and device for logs of file system |
| CN106293491A (en) * | 2015-05-13 | 2017-01-04 | 华为技术有限公司 | The processing method of write request and Memory Controller Hub |
| US20180047002A1 (en) * | 2014-09-19 | 2018-02-15 | Amazon Technologies, Inc. | Cross-data-store operations in log-coordinated storage systems |
-
2018
- 2018-11-15 CN CN201811360321.7A patent/CN109522273B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102693312A (en) * | 2012-05-28 | 2012-09-26 | 清华大学 | Flexible transaction management method in key-value store data storage |
| US20180047002A1 (en) * | 2014-09-19 | 2018-02-15 | Amazon Technologies, Inc. | Cross-data-store operations in log-coordinated storage systems |
| CN106293491A (en) * | 2015-05-13 | 2017-01-04 | 华为技术有限公司 | The processing method of write request and Memory Controller Hub |
| CN105183868A (en) * | 2015-09-15 | 2015-12-23 | 浪潮(北京)电子信息产业有限公司 | Storage method and device for logs of file system |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110399101A (en) * | 2019-07-19 | 2019-11-01 | 苏州浪潮智能科技有限公司 | A kind of Write-operation process method of disk, device, system and storage medium |
| CN110399101B (en) * | 2019-07-19 | 2023-01-10 | 苏州浪潮智能科技有限公司 | Write operation processing method, device and system of disk and storage medium |
| CN110781133A (en) * | 2019-10-25 | 2020-02-11 | 深信服科技股份有限公司 | ROW snapshot method, system, equipment and computer readable storage medium |
| CN110781133B (en) * | 2019-10-25 | 2023-03-21 | 深信服科技股份有限公司 | ROW snapshot method, system, equipment and computer readable storage medium |
| CN113821519A (en) * | 2020-11-26 | 2021-12-21 | 北京沃东天骏信息技术有限公司 | Data processing method and field-driven design architecture |
| CN113821519B (en) * | 2020-11-26 | 2024-10-18 | 北京沃东天骏信息技术有限公司 | Data processing method and domain drive design architecture |
| CN113779083A (en) * | 2021-01-29 | 2021-12-10 | 北京京东拓先科技有限公司 | Data processing method, device, server and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109522273B (en) | 2022-02-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12056583B2 (en) | Target variable distribution-based acceptance of machine learning test data sets | |
| US20210374610A1 (en) | Efficient duplicate detection for machine learning data sets | |
| CN109522273A (en) | A kind of method and device for realizing data write-in | |
| CA2953969C (en) | Interactive interfaces for machine learning model evaluations | |
| CN106164865B (en) | The method and system of the affairs batch processing of dependence perception for data duplication | |
| US10452992B2 (en) | Interactive interfaces for machine learning model evaluations | |
| EP2946333B1 (en) | Efficient query processing using histograms in a columnar database | |
| CN104239501B (en) | Mass video semantic annotation method based on Spark | |
| CN110383319A (en) | Large scale scale heterogeneous data intake and user's parsing | |
| CN105095247B (en) | symbol data analysis method and system | |
| US10417265B2 (en) | High performance parallel indexing for forensics and electronic discovery | |
| US11487714B2 (en) | Data replication in a data analysis system | |
| CN104715041B (en) | A kind of database restoring method and system | |
| US11144424B2 (en) | System and method for recording the beginning and ending of job level activity in a mainframe computing environment | |
| CA2934280A1 (en) | Long string pattern matching of aggregated account data | |
| US8560499B2 (en) | Data reduction for optimizing and testing | |
| CN107451138A (en) | A kind of distributed file system storage method and system | |
| US7653663B1 (en) | Guaranteeing the authenticity of the data stored in the archive storage | |
| Jain et al. | Refreshing datawarehouse in near real-time | |
| CN104050057B (en) | Historical sensed data duplicate removal fragment eliminating method and system | |
| JP5773493B2 (en) | Information processing device | |
| CN107506466A (en) | A kind of small documents storage method and system | |
| CN113934713A (en) | Order data indexing method, system, computer equipment and storage medium | |
| US8095768B2 (en) | VSAM smart reorganization | |
| US20070130227A1 (en) | Apparatus and method for journaling database changes using minimized journal entries that may be output in human-readable form |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |