CN107808313A - Data merging treatment method, apparatus and system - Google Patents

Data merging treatment method, apparatus and system Download PDF

Info

Publication number
CN107808313A
CN107808313A CN201610811675.3A CN201610811675A CN107808313A CN 107808313 A CN107808313 A CN 107808313A CN 201610811675 A CN201610811675 A CN 201610811675A CN 107808313 A CN107808313 A CN 107808313A
Authority
CN
China
Prior art keywords
pond
injection
data record
data
record
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610811675.3A
Other languages
Chinese (zh)
Other versions
CN107808313B (en
Inventor
赵光伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Jingdong Century Trading Co Ltd
Beijing Jingdong Shangke Information Technology Co Ltd
Original Assignee
Beijing Jingdong Century Trading Co Ltd
Beijing Jingdong Shangke Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Jingdong Century Trading Co Ltd, Beijing Jingdong Shangke Information Technology Co Ltd filed Critical Beijing Jingdong Century Trading Co Ltd
Priority to CN201610811675.3A priority Critical patent/CN107808313B/en
Publication of CN107808313A publication Critical patent/CN107808313A/en
Application granted granted Critical
Publication of CN107808313B publication Critical patent/CN107808313B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • G06Q30/0633Lists, e.g. purchase orders, compilation or processing

Landscapes

  • Business, Economics & Management (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Strategic Management (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

A kind of data merging treatment method, apparatus of disclosure and system, this method include:Receive a plurality of data record;In a preset time, the injection of locking one pond, and by a plurality of data record injection injection pond received during locking;In pond is injected, the attribute information of a plurality of data record is recorded, and the data record with same alike result information is merged according to attribute information and is stored as different data record sets;And after injection pond is unlocked, the data record set is extracted from injection pond according to the attribute information of record.This method can merge processing to the order data with general character, so as to improve dispatching efficiency, reduce distribution cost.

Description

Data merging treatment method, apparatus and system
Technical field
The present invention relates to technical field of data processing, in particular to a kind of data merging treatment method, apparatus and is System.
Background technology
With flourishing for ecommerce, increasing electronic business transaction website produces therewith, while more and more Consumer selects net purchase.In shopping process, some data records (such as order data) can be produced, web server system can incite somebody to action Data record is often collected and uniformly handled at regular intervals on these lines.For example user may carry within a period of time Multiple orders are handed over, these orders are separate, according to the normal logistics logic of prior art, then need individually to be matched somebody with somebody Send, dispatching efficiency is low.
Above- mentioned information is only used for strengthening the understanding of the background to the present invention, therefore it disclosed in the background section It can include not forming the information to prior art known to persons of ordinary skill in the art.
The content of the invention
In view of this, the present invention provides a kind of data merging treatment method, apparatus and system, can be to being ordered with general character Forms data merges processing, so as to improve dispatching efficiency, reduces distribution cost.
Other characteristics and advantage of the present invention will be apparent from by following detailed description, or partially by the present invention Practice and acquistion.
According to an aspect of the present invention, there is provided a kind of data merging treatment method, including:Receive a plurality of data record; In one preset time, the injection of locking one pond, and by a plurality of data record injection injection pond received during locking; In pond is injected, the attribute information of a plurality of data record is recorded, and according to attribute information by the data with same alike result information Record, which merges, is stored as different data record sets;And after injecting pond and being unlocked, according to the attribute information of record from note Enter and the data record set is extracted in pond.
According to an embodiment of the present invention, the above method also includes:From default multiple injection ponds, injection is chosen Pond.
According to an embodiment of the present invention, the above method also includes:The pond number in currently locked injection pond is recorded In injection is locked, to lock injection pond;And after preset time, from injection is locked, the pond number in injection pond is deleted, to unlock note Enter pond.
According to an embodiment of the present invention, the above method also includes:The pond number in currently locked injection pond is recorded In auxiliary lock is injected;And after injection pond is unlocked, the pond number in injection pond of the stored record in auxiliary lock is injected.
According to an embodiment of the present invention, after injection pond is unlocked, according to the attribute information of record from injection pond Extraction data record set includes:All injection ponds being unlocked of storage are locked successively;For each injection pond being unlocked, Whether data record is stored with the injection pond for judging to be unlocked during locking;And it is stored with data record when injecting in pond When, for each attribute information of record, data record set of the extraction with the attribute information from injection pond.
According to an embodiment of the present invention, before a plurality of data record is received, the above method also includes:Cache a plurality of Data record.
According to another aspect of the present invention, there is provided a kind of data merging treatment device, including:Data reception module, it is used for Receive a plurality of data record;Data recordin module, in a preset time, pond to be injected in locking one, and will during locking In a plurality of data record injection injection pond received;Data combiners block, in pond is injected, recording a plurality of data record Attribute information, and according to attribute information by with same alike result information data record merge be stored as different data records Set;And set extraction module, for after injection pond is unlocked, number to be extracted from injection pond according to the attribute information of record According to set of records ends.
According to an embodiment of the present invention, said apparatus also includes:Inject pond and choose module, for from default multiple Inject in pond, choose injection pond.
According to an embodiment of the present invention, said apparatus also includes:Pond locking module is injected, for will currently be locked Injection pond pond number be recorded in injection lock in, with lock injection pond;And injection pond unlocked state, in preset time Afterwards, from injection is locked, the pond number in injection pond is deleted, to unlock injection pond.
According to an embodiment of the present invention, said apparatus also includes:Pond logging modle is injected, for will currently be locked The pond number in fixed injection pond is recorded in injection auxiliary lock;And after injection pond is unlocked, stored record is in injection auxiliary lock In injection pond pond number.
According to an embodiment of the present invention, set extraction module includes:Pond locking submodule is injected, for locking successively All injection ponds being unlocked of storage;Data judging submodule, for for each injection pond being unlocked, during locking Whether data record is stored with the injection pond for judging to be unlocked;And set extracting sub-module, for being stored when in injection pond When having data record, for each attribute information of record, data record set of the extraction with attribute information from injection pond.
According to an embodiment of the present invention, said apparatus also includes:Data cache module, for caching a plurality of number According to record.
In accordance with a further aspect of the present invention, there is provided a kind of data merging treatment system, including:Processor;And memory, For storing the executable instruction of processor;Wherein processor is configured to perform following operation via executable instruction is performed: Receive a plurality of data record;In a preset time, the injection of locking one pond, and remember the more datas received during locking In record injection injection pond;In pond is injected, the attribute information of a plurality of data record is recorded, and will be had according to attribute information identical The data record of attribute information, which merges, is stored as different data record sets;And after injection pond is unlocked, according to record Attribute information from injection pond in extract data record set.
According to the data merging treatment method, apparatus and system of the present invention, timesharing current data record is locked Processing, the data record with same alike result information is merged and is stored among different set, so as to realize to general character Order data merge processing, can improve dispatching efficiency, reduce distribution cost.
It should be appreciated that the general description and following detailed description of the above are only exemplary, this can not be limited Invention.
Brief description of the drawings
Its example embodiment is described in detail by referring to accompanying drawing, above and other target of the invention, feature and advantage will Become more fully apparent.
Fig. 1 is a kind of flow chart of data merging treatment method according to an illustrative embodiments.
Fig. 2 is the flow chart of another data merging treatment method according to an illustrative embodiments.
Fig. 3 is the flow chart of another data merging treatment method according to an illustrative embodiments.
Fig. 4 is a kind of block diagram of data merging treatment device according to an illustrative embodiments.
Fig. 5 is the block diagram of another data merging treatment device according to an illustrative embodiments.
Embodiment
Example embodiment is described more fully with referring now to accompanying drawing.However, example embodiment can be with a variety of shapes Formula is implemented, and is not understood as limited to example set forth herein;On the contrary, these embodiments are provided so that the present invention will more Fully and completely, and by the design of example embodiment comprehensively it is communicated to those skilled in the art.Accompanying drawing is only the present invention Schematic illustrations, be not necessarily drawn to scale.Identical reference represents same or similar part in figure, thus Repetition thereof will be omitted.
In addition, described feature, structure or characteristic can be incorporated in one or more implementations in any suitable manner In mode.In the following description, there is provided many details fully understand so as to provide to embodiments of the present invention.So And it will be appreciated by persons skilled in the art that technical scheme can be put into practice and omit one in the specific detail Or more, or other methods, constituent element, device, step etc. can be used.In other cases, it is not shown in detail or describes Known features, method, apparatus, realization or operation are to avoid that a presumptuous guest usurps the role of the host and so that each aspect of the present invention thickens.
Fig. 1 is a kind of flow chart of data merging treatment method according to an illustrative embodiments.Party's rule It can such as be realized by a memory database.As shown in figure 1, this method 10 includes:
In step s 102, a plurality of data record is received.
During e-commerce purchases, some data records can be produced, such as user's shopping places an order caused order Data.Electric business system for example generally by user in shopping process caused mass data record storage in HBASE database, Therefore the data record of its storage can be received from HBASE database, and is stored into above-mentioned memory database.
In step S104, in a preset time, the injection of locking one pond, and it is described more by what is received during locking Data record is injected in the injection pond.
One injection pond for being used for injecting data record of locking, and remember the data being currently received in a preset time Record is all injected in the injection pond.The preset time for example be could be arranged to 5 minutes, but the present invention is not limited, in reality In, it can set according to the actual requirements.
In step s 106, in pond is injected, the attribute information of a plurality of data record is recorded, and will have according to attribute information The data record for having same alike result information, which merges, is stored as different data record sets.
For example, the attribute information of pieces of data, the category that above-mentioned pieces of data is recorded can be recorded by an attribute linked-list Property information is stored in the attribute linked-list, can also be stored such as array using other storage forms in addition.The attribute linked-list In the only attribute information of data storage record rather than data storage record in itself, effect is performed so as to improve the chained list Rate.And the data record with same alike result information is merged and is stored as different data record sets.Attribute information for example may be used With the storage information (such as warehouse information) including order owning user, order order goods.For example, there will be the first attribute letter All data records of breath are stored in first set, and all data records with the second attribute information are stored in into second set Deng.
In step S108, after injection pond is unlocked, data note is extracted from injection pond according to the attribute information of record Record set.
After above-mentioned preset time, injection pond is unlocked.After injecting pond and being unlocked according to the attribute information of record from Inject and data record set corresponding to attribute information is extracted in pond.For example, when attribute information is stored in above-mentioned attribute linked-list When, then the different pieces of information set of records ends of each attribute information is had according to each attribute information stored in attribute linked-list, respectively extraction.
The data merging treatment method of embodiment of the present invention, timesharing current data is recorded and carries out locking processing, will Data record with same alike result information, which merges, to be stored among different set, so as to realize to the order numbers with general character According to processing is merged, dispatching efficiency can be improved, reduces distribution cost.
It will be clearly understood that the present disclosure describe how formation and using particular example, but the principle of the present invention is not limited to Any details of these examples.On the contrary, the teaching based on present disclosure, these principles can be applied to many other Embodiment.
Fig. 2 is the flow chart of another data merging treatment method according to an illustrative embodiments.This method A memory database be again may be by realize.As shown in Fig. 2 this method 20 includes:
In step S202, a plurality of data record is received.
The step is identical with the step S102 in the method 10 shown in Fig. 1, will not be repeated here.
In step S204, from default multiple injection ponds, an injection pond is chosen.
For example, several empty injection ponds can be pre-set, and an empty pond chained list is established, the pond number for injecting pond is put Enter in the chained list of sky pond.Every time from empty pond chained list, an injection pond is randomly selected, as current injection pond.
In step S206, the pond number in the currently selected injection pond taken is recorded in injection lock, to lock the injection Pond, and after above-mentioned preset time, the pond number in the injection pond is deleted from injection lock, to unlock injection pond.
Such as the injection can be locked by storing the pond number in the currently selected injection pond taken in the injection lock of foundation Pond;And after preset time, the injection pond is unlocked by deleting the pond number stored in injection lock.
In step S208, by the pond number in the currently selected injection pond taken while it is recorded in an injection auxiliary lock, and works as After the injection pond is unlocked, the pond number in injection pond of the stored record in the injection auxiliary lock.
For example, the pond number in discrepancy pond of the stored record in the injection auxiliary lock can be come by establishing a full pond chained list. Or it can also be stored with modes such as injection chained lists.
In step S210, all injection ponds being unlocked of storage are locked successively;For each injection pond being unlocked, Whether data record is stored with the injection pond for judging to be unlocked during locking;When inject be stored with data record in pond when, For each attribute information of record, data record set of the extraction with above-mentioned attribute information from injection pond.
By taking the injection pond being unlocked above by full pond storage of linked list as an example, processing lock is established, with a predeterminated frequency (such as Once per second) the full pond chained list is traveled through, locking is stored in all ponds number in the full pond chained list successively, and judges to be locked by the processing Whether there is data record in the injection pond of locking;When having data record in the injection pond, believe for each attribute of record Breath, data record set of the extraction with the attribute information from the injection pond.Wherein attribute information is for example recorded in above-mentioned In attribute linked-list.
Data record be merged the injection pond handled revert to again sky injection pond, and by its pond number store again to In above-mentioned empty pond chained list.
In certain embodiments, after the injection pond pond number in injection lock is deleted, can be selected again from above-mentioned empty pond chained list The pond number in a new injection pond is taken to be recorded in injection lock, new data record will be injected in new injection pond, and will note Enter the pond number stored in auxiliary lock to store to after full pond chained list, auxiliary is injected in the new pond number stored in locking using injection to update Lock.
Fig. 3 is the flow chart of another data merging treatment method according to an illustrative embodiments.With Fig. 1 and The difference of method 10 and 20 shown in Fig. 2 is that the method 30 shown in Fig. 3 also includes after a plurality of data record is received:
In step s 302, above-mentioned a plurality of data record is cached.
For example, a memory queue can be set between HBASE database and memory database, for caching from HBASE The a plurality of data record that database receives.In above-mentioned data merging treatment is carried out in memory database and is operated, if can not Timely processing, data record is cached using memory queue, to prevent the big data of burst from being rushed to memory database Hit.In addition, when being gone wrong when memory database is in processing data, data record can also be temporarily stored in memory queue.
The data merging treatment method of embodiment of the present invention, it is further provided the caching work(to receiving data record Can, so as to influence of the big data to system that avoid happening suddenly.
It will be appreciated by those skilled in the art that realize that all or part of step of above-mentioned embodiment is implemented as being held by CPU Capable computer program.When the computer program is performed by CPU, perform the above method provided by the invention limited it is above-mentioned Function.Described program can be stored in a kind of computer-readable recording medium, and the storage medium can be read-only storage, Disk or CD etc..
Further, it should be noted that above-mentioned accompanying drawing is only according to included by the method for exemplary embodiment of the invention Processing schematically illustrates, rather than limitation purpose.It can be readily appreciated that above-mentioned processing shown in the drawings is not intended that or limits these The time sequencing of processing.In addition, being also easy to understand, these processing can for example either synchronously or asynchronously be performed in multiple modules 's.
Following is apparatus of the present invention embodiment, can be used for performing the inventive method embodiment.It is real for apparatus of the present invention The details not disclosed in example is applied, refer to the inventive method embodiment.
Fig. 4 is a kind of block diagram of data merging treatment device according to an illustrative embodiments.As shown in figure 4, The device 40 includes:Data reception module 402, data recordin module 404, data combiners block 406 and set extraction module 408。
Wherein, data reception module 402 is used to receive a plurality of data record.
Data recordin module 404 is used in the preset time, the injection of locking one pond, and will be received during locking In a plurality of data record injection injection pond.
Data combiners block 406 is used in pond is injected, and records the attribute information of a plurality of data record, and believe according to attribute Breath, which merges the data record with same alike result information, is stored as different data record sets.
Set extraction module 408 is used to after injection pond is unlocked, be extracted from injection pond according to the attribute information of record Data record set.
The data merging treatment device of the embodiment of the present invention, timesharing current data is recorded and carries out locking processing, will be had The data record for having same alike result information, which merges, to be stored among different set, so as to realize to the order data with general character Processing is merged, dispatching efficiency can be improved, reduces distribution cost.
Fig. 5 is the block diagram of another data merging treatment device according to an illustrative embodiments.Such as Fig. 5 institutes Show, the device 50 includes:Data reception module 502, injection pond choose module 504, injection pond locking module 506, data record Module 508, data combiners block 510, injection pond unlocked state 512, injection pond logging modle 514 and set extraction module 516。
Wherein, data reception module 502 is used to receive a plurality of data record.
Inject pond and choose module 504 for from default multiple injection ponds, choosing injection pond.
Injection pond locking module 506 is used to the pond number in the currently selected injection pond taken being recorded in injection lock, with locking The injection pond.
Data recordin module 508 is used in a preset time, and a plurality of data record received is injected into this and is locked Injection pond in.
Data combiners block 510 is used in pond is injected, and records the attribute information of a plurality of data record, and believe according to attribute Breath, which merges the data record with same alike result information, is stored as different data record sets.
Inject pond unlocked state 512 to be used for after preset time, from injection is locked, the pond number in injection pond is deleted, with unblock Inject pond.
Injection pond logging modle 514 is used to the pond number in currently locked injection pond being recorded in injection auxiliary lock; And after injection pond is unlocked, the pond number in injection pond of the stored record in auxiliary lock is injected.
Set extraction module 516 is used to after injection pond is unlocked, be extracted from injection pond according to the attribute information of record Data record set.
In certain embodiments, set extraction module 516 includes:Injection pond locking submodule 5162, data judge submodule Block 5164 and set extracting sub-module 5166.Locking submodule 5162 in injection pond, which is used to successively locking all of storage, to be unlocked Inject pond.Data judging submodule 5164 is used for for each injection pond being unlocked, and the note being unlocked is judged during locking Enter in pond and whether be stored with data record.Set extracting sub-module 5166 be used for when inject be stored with data record in pond when, it is right In each attribute information of record, data record set of the extraction with attribute information from injection pond.
In addition, the device 50 shown in device 40 and Fig. 5 shown in Fig. 4 can also include data cache module, for caching The a plurality of data record received.The data cache module for example can be a memory queue.
The present invention also provides a kind of data merging treatment system, including:Processor;And memory, handled for storage The executable instruction of device;Wherein processor is configured to perform following operation via executable instruction is performed:Receive more datas Record;In a preset time, the injection of locking one pond, and a plurality of data record received is injected into injection pond during locking In;In pond is injected, the attribute information of a plurality of data record is recorded, and according to attribute information by the number with same alike result information Merge according to record and be stored as different data record sets;And when inject pond be unlocked after, according to the attribute information of record from Injection extracts data record set in pond.
It should be noted that the block diagram shown in above-mentioned accompanying drawing is functional entity, not necessarily must with physically or logically Independent entity is corresponding.These functional entitys can be realized using software form, or in one or more hardware modules or These functional entitys are realized in integrated circuit, or are realized in heterogeneous networks and/or processor device and/or microcontroller device These functional entitys.
Through the above description of the embodiments, those skilled in the art is it can be readily appreciated that example described herein is implemented Mode can be realized by software, can also be realized by way of software combines necessary hardware.Therefore, according to the present invention The technical scheme of embodiment can be embodied in the form of software product, the software product can be stored in one it is non-volatile Property storage medium (can be CD-ROM, USB flash disk, mobile hard disk etc.) in or network on, including some instructions are to cause a calculating Equipment (can be personal computer, server, mobile terminal or network equipment etc.) is performed according to embodiment of the present invention Method.
The illustrative embodiments of the present invention are particularly shown and described above.It should be appreciated that the present invention is unlimited In detailed construction described herein, set-up mode or implementation method;On the contrary, it is intended to cover included in appended claims Spirit and scope in various modifications and equivalence setting.

Claims (13)

  1. A kind of 1. data merging treatment method, it is characterised in that including:
    Receive a plurality of data record;
    In a preset time, the injection of locking one pond, and a plurality of data record received is injected into institute during locking State in injection pond;
    In the injection pond, the attribute information of a plurality of data record is recorded, and phase will be had according to the attribute information Data record merging with attribute information is stored as different data record sets;And
    After the injection pond is unlocked, the data record is extracted from the injection pond according to the attribute information of record Set.
  2. 2. according to the method for claim 1, it is characterised in that also include:From default multiple injection ponds, described in selection Inject pond.
  3. 3. according to the method for claim 2, it is characterised in that also include:
    The pond number in the currently locked injection pond is recorded in injection lock, to lock the injection pond;And
    After the preset time, from the injection lock, the pond number in the injection pond is deleted, to unlock the injection pond.
  4. 4. according to the method for claim 3, it is characterised in that also include:
    The pond number in the currently locked injection pond is recorded in injection auxiliary lock;And
    After the injection pond is unlocked, the pond number in the injection pond of the stored record in the injection auxiliary lock.
  5. 5. according to the method for claim 4, it is characterised in that after the injection pond is unlocked, according to record Attribute information extracts the data record set from the injection pond to be included:
    All injection ponds being unlocked of storage are locked successively;
    For each injection pond being unlocked, data note whether is stored with the injection pond being unlocked during locking described in judgement Record;And
    When being stored with the data record in the injection pond, for each attribute information of record, from the injection pond Data record set of the extraction with the attribute information.
  6. 6. according to the method described in claim any one of 1-5, it is characterised in that before a plurality of data record is received, Also include:Cache a plurality of data record.
  7. A kind of 7. data merging treatment device, it is characterised in that including:
    Data reception module, for receiving a plurality of data record;
    Data recordin module, in a preset time, pond to be injected in locking one, and described more by what is received during locking In the data record injection injection pond;
    Data combiners block, in the injection pond, recording the attribute information of a plurality of data record, and according to described Attribute information, which merges the data record with same alike result information, is stored as different data record sets;And
    Gather extraction module, for after the injection pond is unlocked, according to the attribute information of record from the injection pond The middle extraction data record set.
  8. 8. device according to claim 7, it is characterised in that also include:Inject pond and choose module, for from default more In individual injection pond, the injection pond is chosen.
  9. 9. device according to claim 8, it is characterised in that also include:
    Pond locking module is injected, for the pond number in the currently locked injection pond to be recorded in injection lock, to lock State injection pond;And
    Pond unlocked state is injected, for after the preset time, from the injection lock, deleting the pond number in the injection pond, To unlock the injection pond.
  10. 10. device according to claim 9, it is characterised in that also include:
    Pond logging modle is injected, for the pond number in the currently locked injection pond to be recorded in injection auxiliary lock;With And
    After the injection pond is unlocked, the pond number in the injection pond of the stored record in the injection auxiliary lock.
  11. 11. device according to claim 10, it is characterised in that the set extraction module includes:
    Pond locking submodule is injected, for locking all injection ponds being unlocked of storage successively;
    Data judging submodule, for the injection being unlocked described in for each injection pond being unlocked, judging during locking Whether data record is stored with pond;And
    Gather extracting sub-module, for when it is described injection pond in be stored with the data record when, for each attribute of record Information, data record set of the extraction with the attribute information from the injection pond.
  12. 12. according to the device described in claim any one of 7-11, it is characterised in that also include:Data cache module, for delaying Deposit a plurality of data record.
  13. A kind of 13. data merging treatment system, it is characterised in that including:
    Processor;And
    Memory, for storing the executable instruction of the processor;
    Wherein described processor is configured to perform following operation via the executable instruction is performed:
    Receive a plurality of data record;
    In a preset time, the injection of locking one pond, and a plurality of data record received is injected into institute during locking State in injection pond;
    In the injection pond, the attribute information of a plurality of data record is recorded, and phase will be had according to the attribute information Data record merging with attribute information is stored as different data record sets;And
    After the injection pond is unlocked, the data record is extracted from the injection pond according to the attribute information of record Set.
CN201610811675.3A 2016-09-08 2016-09-08 Data merging processing method, device and system Active CN107808313B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610811675.3A CN107808313B (en) 2016-09-08 2016-09-08 Data merging processing method, device and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610811675.3A CN107808313B (en) 2016-09-08 2016-09-08 Data merging processing method, device and system

Publications (2)

Publication Number Publication Date
CN107808313A true CN107808313A (en) 2018-03-16
CN107808313B CN107808313B (en) 2022-02-01

Family

ID=61576306

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610811675.3A Active CN107808313B (en) 2016-09-08 2016-09-08 Data merging processing method, device and system

Country Status (1)

Country Link
CN (1) CN107808313B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113486018A (en) * 2021-07-23 2021-10-08 北京京东振世信息技术有限公司 Production data storage method, storage device, electronic device and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101499017A (en) * 2009-03-02 2009-08-05 南京联创科技股份有限公司 Method for real-time tracing projects
CN104462169A (en) * 2013-09-16 2015-03-25 西门子公司 Method and a system for merging data into a database table
CN104636895A (en) * 2013-11-07 2015-05-20 阿里巴巴集团控股有限公司 Data processing method and system thereof
CN104899778A (en) * 2015-06-30 2015-09-09 程强 Order updating method during order information updating and ordering system
US20160012525A1 (en) * 2014-07-14 2016-01-14 Alibaba Group Holding Limited Method and system for managing residual value in distributed processing of transactions
CN105741065A (en) * 2016-01-25 2016-07-06 上海万琛电子商务有限公司 Warehouse management system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101499017A (en) * 2009-03-02 2009-08-05 南京联创科技股份有限公司 Method for real-time tracing projects
CN104462169A (en) * 2013-09-16 2015-03-25 西门子公司 Method and a system for merging data into a database table
CN104636895A (en) * 2013-11-07 2015-05-20 阿里巴巴集团控股有限公司 Data processing method and system thereof
US20160012525A1 (en) * 2014-07-14 2016-01-14 Alibaba Group Holding Limited Method and system for managing residual value in distributed processing of transactions
CN104899778A (en) * 2015-06-30 2015-09-09 程强 Order updating method during order information updating and ordering system
CN105741065A (en) * 2016-01-25 2016-07-06 上海万琛电子商务有限公司 Warehouse management system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113486018A (en) * 2021-07-23 2021-10-08 北京京东振世信息技术有限公司 Production data storage method, storage device, electronic device and storage medium
CN113486018B (en) * 2021-07-23 2023-09-26 北京京东振世信息技术有限公司 Production data storage method, storage device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN107808313B (en) 2022-02-01

Similar Documents

Publication Publication Date Title
CN103473230B (en) Service area determines that method, logistics service provider recommend method and related device
CN111339427B (en) Book information recommendation method, device and system and storage medium
US8751458B2 (en) Method and system for saving database storage space
US9361343B2 (en) Method for parallel mining of temporal relations in large event file
US20160188723A1 (en) Cloud website recommendation method and system based on terminal access statistics, and related device
EP3321819A1 (en) Device, method and program for securely reducing an amount of records in a database
CN105187242B (en) A kind of user's anomaly detection method excavated based on variable-length pattern
CN109558538B (en) Input association word construction method and device, storage medium and electronic equipment
CN105912698A (en) Deletion method and system of data file in disk
JP6947185B2 (en) Anomaly detectors, control methods, and programs
CN115292612A (en) Information and financial information recommendation method and device based on privacy protection
CN109446235B (en) Multidimensional high-utility sequence mode processing method and device and computer equipment
CN107808313A (en) Data merging treatment method, apparatus and system
JP2012507767A5 (en)
CN110851708B (en) Negative sample extraction method, device, computer equipment and storage medium
CN106484691A (en) The date storage method of mobile terminal and device
CN106257449A (en) A kind of information determines method and apparatus
CN105589683B (en) Sample extraction method and device
CN113326405B (en) Park entrance recommendation method and system based on BIM technology
US20140325378A1 (en) Method and apparatus for generating a personalized page
CN113592529A (en) Potential customer recommendation method and device for bond products
CN106909665A (en) A kind of patent retrieval method based on body
CN108073712A (en) Master data delet method, device and computer equipment in information system
CN113489742A (en) Login method based on block chain and related product
CN110287753B (en) Method, device and server for updating article information

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant