CN107402982A - Data write-in, data matching method, device and computing device - Google Patents
Data write-in, data matching method, device and computing device Download PDFInfo
- Publication number
- CN107402982A CN107402982A CN201710552945.8A CN201710552945A CN107402982A CN 107402982 A CN107402982 A CN 107402982A CN 201710552945 A CN201710552945 A CN 201710552945A CN 107402982 A CN107402982 A CN 107402982A
- Authority
- CN
- China
- Prior art keywords
- data
- category feature
- feature
- buffer zone
- reservation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
This specification provides a kind of data write-in, data matching method, device and computing device, this method is configured with buffer zone and storage region, for data to be written, the present embodiment makes a distinction the feature in data with renewal frequency, can be according to default feature classification, determine faster first category feature of renewal frequency in the data to be written, and the second category feature that renewal frequency is relatively low, relatively stable, therefore, first category feature of data to be written can be write to buffer zone, to realize the quick renewal of data.And the second category feature in data to be written can be write to storage region, to carry out the maintenance of persistence.And when needing to carry out Data Matching, for the feature cached in buffer zone, the quick search of data can be carried out.
Description
Technical field
This specification is related to technical field of data processing, more particularly to data write-in, data matching method, device and calculating
Equipment.
Background technology
In data processing field, in some scenarios, it might have as the demand of the another kind of data of a kind of Data Matching.
Existing data generally use relevant database is safeguarded, persistent storage is carried out to data based on databases such as MySQL,
And safeguarded using being updated etc. based on MySQL, and corresponding match query operates.For hundred million grades of mass data renewals, look into
Ask or match, it is desirable to provide more quick data processing scheme.
The content of the invention
To overcome problem present in correlation technique, present description provides data write-in, data matching method, device and
Computing device.
A kind of method for writing data, methods described include：
Obtain data to be written；
According to default feature classification, the first category feature and the second category feature of the data to be written are determined, described
The renewal frequency of one category feature is more than the renewal frequency of the second category information；
First category feature of the data to be written is write to buffer zone, by the second class in the data to be written
Feature is write to storage region.
A kind of data matching method, for the first data in the first data set, counted for first Data Matching second
According to one or more of collection the second data；
Methods described is configured with buffer zone and storage region, the first category feature of the first data intensive data and
The first kind characteristic storage of the second data intensive data is in the buffer zone, and the second of the first data intensive data
Category feature and the second category feature of the second data intensive data are stored in the storage region, first category feature
Renewal frequency is more than the second category feature；
Methods described includes：
For the first data to be matched, according to storing first data in the buffer zone and the storage region
The first category feature and the second category feature, and the buffer zone and storage region in the second data intensive data that stores
First category feature and the second category feature, inquiry and the second data of first Data Matching.
A kind of data matching method, methods described are configured with buffer zone and storage region, and reservation data concentrates reservation number
According to the first category feature and product data concentrate product data first kind characteristic storage in the buffer zone, the reservation
The second category feature of reservation data and the product data concentrate the second category feature of product data to be stored in institute in data set
Storage region is stated, the renewal frequency of first category feature is more than the second category feature；
Methods described includes：
For reservation data to be matched, according to storing the reservation to be matched in the buffer zone and the storage region
The first category feature and the second category feature of data, and the Product Data Set stored in the buffer zone and the storage region
The first category feature and the second category feature of middle product data, inquire about the product data matched with the reservation data to be matched.
A kind of data transfer apparatus, described device include：
Data acquisition module, for obtaining data to be written；
Characteristic determination module, for according to default feature classification, determine the data to be written the first category feature and
Second category feature, the renewal frequency of first category feature are more than the renewal frequency of the second category information；
Writing module, will be described to be written for the first category feature of the data to be written to be write to buffer zone
The second category feature in data is write to storage region.
A kind of data matching device, for the first data in the first data set, counted for first Data Matching second
According to one or more of collection the second data；
Described device is configured with buffer zone and storage region, the first category feature of the first data intensive data and
The first kind characteristic storage of the second data intensive data is in the buffer zone, and the second of the first data intensive data
Category feature and the second category feature of the second data intensive data are stored in the storage region, first category feature
Renewal frequency is more than the second category feature；
Described device includes matching module, is used for：
For the first data to be matched, according to storing first data in the buffer zone and the storage region
The first category feature and the second category feature, and the buffer zone and storage region in the second data intensive data that stores
First category feature and the second category feature, inquiry and the second data of first Data Matching.
A kind of data matching device, described device are configured with buffer zone and storage region, and reservation data concentrates reservation number
According to the first category feature and product data concentrate product data first kind characteristic storage in the buffer zone, the reservation
The second category feature of reservation data and the product data concentrate the second category feature of product data to be stored in institute in data set
Storage region is stated, the renewal frequency of first category feature is more than the second category feature；
Described device includes matching module, is used for：
For reservation data to be matched, according to storing the reservation to be matched in the buffer zone and the storage region
The first category feature and the second category feature of data, and the Product Data Set stored in the buffer zone and the storage region
The first category feature and the second category feature of middle product data, inquire about the product data matched with the reservation data to be matched.
A kind of computing device, including：
Processor；
For storing the memory of processor-executable instruction；
Wherein, the processor is configured as：
Obtain data to be written；
According to default feature classification, the first category feature and the second category feature of the data to be written are determined, described
The renewal frequency of one category feature is more than the renewal frequency of the second category information；
First category feature of the data to be written is write to buffer zone, by the second class in the data to be written
Feature is write to storage region.
A kind of computing device, it is the data set of the first Data Matching second for the first data in the first data set
One or more of the second data；The computing device is configured with buffer zone and storage region, in first data set
The first kind characteristic storage of first category feature of data and the second data intensive data is in the buffer zone, and described
Second category feature of one data intensive data and the second category feature of the second data intensive data are stored in the storage
Region, the renewal frequency of first category feature are more than the second category feature；The computing device includes：
Processor；
For storing the memory of processor-executable instruction；
Wherein, the processor is configured as：
For the first data to be matched, according to storing first data in the buffer zone and the storage region
The first category feature and the second category feature, and the buffer zone and storage region in the second data intensive data that stores
First category feature and the second category feature, inquiry and the second data of first Data Matching.
A kind of computing device, is configured with buffer zone and storage region, and reservation data concentrates the first kind of reservation data special
Sign and product data concentrate the first kind characteristic storage of product data to concentrate reservation in the buffer zone, the reservation data
Second category feature of data and the product data concentrate the second category feature of product data to be stored in the storage region, institute
The renewal frequency for stating the first category feature is more than the second category feature；The computing device includes：
Processor；
For storing the memory of processor-executable instruction；
Wherein, the processor is configured as：
For reservation data to be matched, according to storing the reservation to be matched in the buffer zone and the storage region
The first category feature and the second category feature of data, and the Product Data Set stored in the buffer zone and the storage region
The first category feature and the second category feature of middle product data, inquire about the product data matched with the reservation data to be matched.
The technical scheme that the embodiment of this specification provides can include the following benefits：
In this specification, the feature in data is made a distinction with renewal frequency, it is faster for first kind renewal frequency
Feature, it can write to buffer zone and be safeguarded, to realize the quick renewal of data, for the second relatively low class of renewal frequency
Feature, then it can write to the storage region of routine and carry out persistence maintenance.Based on above-mentioned data writing mode, the present embodiment can
Quickly to be updated to the first category feature, quick match query can also be carried out.
It should be appreciated that the general description and following detailed description of the above are only exemplary and explanatory, not
This specification can be limited.
Brief description of the drawings
Accompanying drawing herein is merged in specification and forms the part of this specification, shows the reality for meeting this specification
Apply example, and be used for together with specification the principle for explaining the application.
Fig. 1 is a kind of signal of the runtime framework of data processing of this specification according to an exemplary embodiment
Figure.
Fig. 2 is a kind of flow chart of method for writing data of this specification according to an exemplary embodiment.
Fig. 3 A are a kind of flow charts of data matching method of this specification according to an exemplary embodiment.
Fig. 3 B are component architecture schematic diagram of this specification according to an exemplary embodiment.
Fig. 3 C are the schematic diagrames of another data matching method of this specification according to an exemplary embodiment.
Fig. 4 is a kind of hardware structure diagram of computing device where this specification data transfer apparatus/data matching device.
Fig. 5 is a kind of block diagram of data transfer apparatus of this specification according to an exemplary embodiment.
Fig. 6 is a kind of block diagram of data matching device of this specification according to an exemplary embodiment.
Fig. 7 is the block diagram of another data matching device of this specification according to an exemplary embodiment.
Embodiment
Here exemplary embodiment will be illustrated in detail, its example is illustrated in the accompanying drawings.Following description is related to
During accompanying drawing, unless otherwise indicated, the same numbers in different accompanying drawings represent same or analogous key element.Following exemplary embodiment
Described in embodiment do not represent all embodiments consistent with this specification.On the contrary, they are only and such as institute
The example of the consistent apparatus and method of some aspects be described in detail in attached claims, this specification.
It is only merely for the purpose of description specific embodiment in the term that this specification uses, and is not intended to be limiting this explanation
Book." one kind " of used singulative, " described " and "the" are also intended to bag in this specification and in the appended claims
Most forms are included, unless context clearly shows that other implications.It is also understood that term "and/or" used herein is
Refer to and any or all may be combined comprising the associated list items purpose of one or more.
It will be appreciated that though various information may be described using term first, second, third, etc. in this specification, but
These information should not necessarily be limited by these terms.These terms are only used for same type of information being distinguished from each other out.For example, do not taking off
In the case of this specification scope, the first information can also be referred to as the second information, and similarly, the second information can also be claimed
For the first information.Depending on linguistic context, word as used in this " if " can be construed to " ... when " or
" when ... " or " in response to determining ".
A kind of runtime framework of this specification scheme is illustrated first.It is shown in Figure 1, this specification scheme
The entity being related to includes：First data providing, data processing side and the second data providing.Wherein match somebody with somebody in data processing side
It is equipped with the storage region including routine and buffer zone.In the present embodiment, illustrated by taking two data providings as an example, it is actual
In, in different scenes, the quantity of data providing can also have a variety of possibility, and the present embodiment is not construed as limiting to this.
Wherein, those skilled in the art will be appreciated that " buffer zone " of the present embodiment is one relative to " conventional
Data storage areas " concept.Conventional data storage areas includes being arranged on depositing for the persistent storages such as disk or hard disk
Storage region in storage media, and buffer zone can be directed to different scenes, may have different concrete meanings, or correspondingly
Different hardware resources.For example, the built-in cachings of CPU, the built-in caching of hard disk etc., belong to hardware and carry resource in itself, and data
Banked cache, browser rs cache etc., then it is (such as interior to be that software operationally needs operating system for it to distribute a part of hardware resource
Deposit space, or hard drive space etc.) etc. as caching.The scheme that this specification is provided, it is to be directed to specific data application demand
It is proposed, and and hardware resource corresponding to " caching " reality need not be defined.
The basic functional principle of system shown in Figure 1 is：First data providing and the second data providing can be to numbers
Data are provided according to processing side, data processing is carried out by data processing side.First data providing and the second data providing are carried
The data of confession, may carry various features, and the renewal frequencies of some features may be very fast, it is necessary to continually read, and some
Feature possibility is relatively stable, renewal frequency is relatively low.
Based on this, the scheme that this specification is provided is to write the faster category feature of renewal frequency in data to slow
Region is deposited, other features in data are write to storage region.It is shown in Figure 2, it is this specification according to an exemplary reality
A kind of flow chart of the method for writing data exemplified is applied, is comprised the following steps：
In step 202, data to be written are obtained.
In step 204, according to default feature classification, the first category feature and the second class of the data to be written are determined
Feature, the renewal frequency of first category feature are more than the renewal frequency of the second category information.
In step 206, the first category feature of the data to be written is write to buffer zone, by the number to be written
The second category feature in is write to storage region.
Wherein, data to be written can be newly-increased data or the renewal to data storage.The present embodiment
In, one or more features may be included in data, feature is made a distinction using renewal frequency, and renewal frequency is a kind of faster
Feature is referred to as the first category feature, and stable, renewal frequency is relatively low another category feature is referred to as into the second category feature.Feature is carried out
Class discrimination, it is in order to which inhomogeneous feature is write to different storage regions, carries out the characteristics of with for different category features
It is corresponding to safeguard.For the faster feature of first kind renewal frequency, then it can write to buffer zone and be safeguarded, to realize number
According to quick renewal.For the second category feature, then can write to the storage region of routine, to carry out the maintenance of persistence.
In actual applications, hundred million grades of mass data processing may be faced, therefore, buffer zone can include internal memory number
According to storehouse, it that is to say using internal memory as hardware resource, data be placed on to the database directly operated in internal memory.Deposited relative to persistence
The storage medium of storage, the reading and writing data speed of internal memory will be several orders of magnitude higher, and saved the data in internal memory and compared from disk
Upper access can be greatly enhanced the performance of application, data processing speed than traditional database data processing speed faster.And
For writing to the second category feature of conventional storage region, the storage mode based on file storage can be used, in storage region
In, index etc. can be established to write-in data, to improve data processing speed when needed.
For data processing side, in addition to being updated to data, it may face and be carried by the first data providing
The data of confession, the demand that the data provided with the second data providing are matched.The present embodiment additionally provides a kind of data
Matching process, the present embodiment method include the first data in the first data set, and the second data in the second data set,
First data set and the second data set can be provided by identical data providing or by embodiment as shown in Figure 1
In provided by different data providing.
The present embodiment method is configured with buffer zone and storage region, the first category feature of the first data intensive data
And the first kind characteristic storage of the second data intensive data is in the buffer zone, the first data intensive data
Second category feature and the second category feature of the second data intensive data are stored in the storage region, and the first kind is special
The renewal frequency of sign is more than the second category feature.
As shown in Figure 3A, Fig. 3 A are a kind of stream of data matching method of this specification according to an exemplary embodiment
Cheng Tu, the first data that can be directed in the first data set, it is one or more of described data set of first Data Matching second
Second data；This method comprises the following steps：
In step 302, for the first data to be matched, stored according in the buffer zone and the storage region
First data the first category feature and the second category feature, and the buffer zone and storage region in store second
The first category feature and the second category feature of data intensive data, inquiry and the second data of first Data Matching.
Wherein, it can include memory database in face of hundred million grades of mass data processing, buffer zone, that is to say and made with internal memory
For hardware resource, data are placed on to the database directly operated in internal memory.It is real due to being related to the first data set and the second data set
In the application of border, the second category feature of the first category feature of the first data intensive data and the second data intensive data can store
From in same memory database, the memory database that can also to be configuration different, store data in two datasets with corresponding
First category feature, it can also be using distributed memory database etc..
When carrying out Data Matching, second with first Data Matching can be inquired about based on search engine inquiry technology
Data, efficiency data query can be improved based on search engine inquiry technology, specifically, can be that data to be checked are divided
Word, index and match query etc., to carry out quick search matching treatment.
As can be seen here, in the present embodiment, the feature in data is made a distinction with renewal frequency, updates frequency for the first kind
The faster feature of rate, can write to buffer zone and be safeguarded, relatively low for renewal frequency to realize the quick renewal of data
The second category feature, then can write to routine storage region carry out persistence maintenance.Based on above-mentioned data writing mode, sheet
Embodiment can quickly be updated to the first category feature, and can be based on internal memory and be carried out quick match query.
In data processing field, in some scenarios, it might have as the demand of the another kind of data of a kind of Data Matching.
Such as some third-party platforms, can be permissible as the intermediate between product demand side and product provider, product demand side
Its demand is submitted to third-party platform, product provides direction third-party platform and submits its product, and third-party platform can be product
Party in request matches the product for meeting its demand.Based on this, the present embodiment is also provided with another data matching method, specific available
In the scene matched to reservation data with product data, methods described is configured with buffer zone and storage region, reservation
The first category feature of reservation data and product data concentrate the first kind characteristic storage of product data described slow in data set
Region is deposited, the reservation data concentrates the second category feature of reservation data and the product data to concentrate the second of product data
Category feature is stored in the storage region, and the renewal frequency of first category feature is more than the second category feature.
Methods described includes：
For reservation data to be matched, according to storing the reservation to be matched in the buffer zone and the storage region
The first category feature and the second category feature of data, and the Product Data Set stored in the buffer zone and the storage region
The first category feature and the second category feature of middle product data, inquire about the product data matched with the reservation data to be matched.
By taking finance product service platform as an example, the user as product provider can provide product number to the service platform
According to one or more features can be included in the product data, and each feature indicates product key element, product possessed by the product
Key element can be included such as product classification, borrower's information, Product Status, stock, product time limit, product earning rate or limitation amount
Etc..
User as product demand side can provide the reservation data for indicating the user's request to the service platform, and this is pre-
One or more features can about be included in data, each feature indicates one or more products of user's desirable product
Key element.Product key element in reservation data indicated by feature includes product earning rate, product time limit, stock (such as matching total value
Degree, amount to be matched have matched amount) etc..
As shown in Figure 3 B, it is component architecture schematic diagram of this specification according to an exemplary embodiment, including one uses
In carry out reservation data maintenance reservation unimodule (component), one be used for carry out product data maintenance product component, one
Engine module is brought together for what is matched for reservation product with product data, and one is used to create single group under the brining together for brining order together
Part.It should be noted that said modules framework simply illustrates, can be needed flexibly to match somebody with somebody according to concrete scene in practical application
Put.
In data procedures are safeguarded, the possible renewal frequency of some features of reservation data and product data is very fast, such as in advance
Stock's feature (such as having matched amount, remaining amount to be matched) or state feature about in data, the storehouse in product data
Deposit feature (such as having matched amount, amount to be matched) or state feature.Therefore this category feature can be used as the first category feature,
Preserved and safeguarded using memory database.For in cluster environment, if brining engine together in confirmation slip and product data
First category feature has the accuracy requirement of high real-time, can be preserved using centralized memory database.And other features,
Such as product earning rate or product time limit may not be needed renewal or the relatively low feature of renewal frequency, then as the second category feature,
It is stored in conventional storage region.Bring together and search engine is configured with engine server, in favor of the Rapid matching of mass data
Search.
As shown in Figure 3 C, it is the signal of another data matching method of this specification according to an exemplary embodiment
Figure, can include following Data Matching flow：
1：For product demand side, user can provide client and access the reservation page that service platform is provided, at this
In reservation page, user can set its desired product key element.Client or service platform are this reservation generation reservation
Single, in reservation data corresponding to the confirmation slip, the second category feature such as feature such as product classification, earning rate can be stored in service side
Safeguarded in the conventional storage region such as the search engine server configured.
2：The first category feature in reservation data can be write to the memory database of centralization.
3：For product provider, product data can be supplied to service platform by user, and service platform is basic by product
Attribute, such as product classification, borrower, product time limit, product earning rate information are stored in search engine.
4：The first category feature in product data, such as product inventory information feature are write to centralized memory database；
5：Timed task can be used by brining engine together, with uninterrupted log-on data matching task., can be with each start
The confirmation slip of product to be matched is first inquired from search engine, and the first kind spy of the reservation data is obtained from memory database
Sign, such as current does not match amount feature, the reservation data for being more than 0 for not matching amount, can be looked into by search engine
Ask its product list that can be matched.
6：For the one or more products inquired in previous step, including can obtaining the product from memory database
The first category feature in deposit data storehouse, such as newest inventory information feature；By each category feature of acquired product data,
Product is screened, finally determines the product data matched with reservation data.
7：For the product data of the matching of determination, it may be determined that bring success together, bring engine together and can create and bring data together,
And the first category feature of corresponding reservation data and the first category feature of product data are updated in memory database.
8：For matching reservation data and product data, when receiving the product data that product provider newly provides, go back
Matching operation can be again started up, reservation data of the amount to be matched more than zero is looked into again with the product data newly provided
Matching is ask, the reservation data that can be matched by the product inquiry newly issued, bring together placing an order after order matching.
Corresponding with the embodiment of aforementioned data write-in, data matching method, this specification additionally provides data write-in dress
Put, the embodiment of data matching device and its computing device applied.
The embodiment of the data transfer apparatus/data matching device of this specification can be applied on the computing device, such as
Server or terminal device.Device embodiment can be realized by software, can also pass through hardware or the side of software and hardware combining
Formula is realized.It is by data write-in/Data Matching where it as the device on a logical meaning exemplified by implemented in software
Processor corresponding computer program instructions in nonvolatile memory are read in internal memory what operation was formed.From hardware layer
For face, as shown in figure 4, a kind of hardware knot for computing device where this specification data transfer apparatus/data matching device
Composition, it is real in addition to the processor 410 shown in Fig. 4, internal memory 430, network interface 420 and nonvolatile memory 440
The computing device where device 431 in example is applied, generally according to the actual functional capability of the computing device, other hardware can also be included,
This is repeated no more.
As shown in figure 5, Fig. 5 is a kind of frame of data transfer apparatus of this specification according to an exemplary embodiment
Figure, described device include：
Data acquisition module 51, for obtaining data to be written.
Characteristic determination module 52, for according to default feature classification, determining the first category feature of the data to be written
With the second category feature, the renewal frequency of first category feature is more than the renewal frequency of the second category information.
Writing module 53, will be described to be written for the first category feature of the data to be written to be write to buffer zone
The second category feature entered in data is write to storage region.
Optionally, the buffer zone includes memory database.
As shown in fig. 6, Fig. 6 is a kind of frame of data matching device of this specification according to an exemplary embodiment
Figure, it is one or more of described data set of first Data Matching second second for the first data in the first data set
Data；
Described device is configured with buffer zone and storage region, the first category feature of the first data intensive data and
The first kind characteristic storage of the second data intensive data is in the buffer zone, and the second of the first data intensive data
Category feature and the second category feature of the second data intensive data are stored in the storage region, first category feature
Renewal frequency is more than the second category feature；
Described device includes matching module 61, is used for：
For the first data to be matched, according to storing first data in the buffer zone and the storage region
The first category feature and the second category feature, and the buffer zone and storage region in the second data intensive data that stores
First category feature and the second category feature, inquiry and the second data of first Data Matching.
Optionally, the buffer zone includes memory database.
Optionally, the matching module, is additionally operable to：Based on the inquiry of search engine inquiry technology and first Data Matching
The second data.
As shown in fig. 7, Fig. 7 is a kind of frame of data matching device of this specification according to an exemplary embodiment
Figure, described device are configured with buffer zone and storage region, and reservation data concentrates the first category feature and product of reservation data
The first kind characteristic storage of product data concentrates the second of reservation data in the buffer zone, the reservation data in data set
Category feature and the product data concentrate the second category feature of product data to be stored in the storage region, and the first kind is special
The renewal frequency of sign is more than the second category feature；
Described device includes matching module 71, is used for：
For reservation data to be matched, according to storing the reservation to be matched in the buffer zone and the storage region
The first category feature and the second category feature of data, and the Product Data Set stored in the buffer zone and the storage region
The first category feature and the second category feature of middle product data, inquire about the product data matched with the reservation data to be matched.
Optionally, the buffer zone includes：The data storage areas being arranged in internal memory.
Optionally, the matching module, is additionally operable to：
The product data matched based on the inquiry of search engine inquiry technology with the reservation data to be matched.
Optionally, the first category feature of the reservation data includes following one or more features：The stock of reservation data
The state feature of feature or reservation data；
First category feature of the product data includes following one or more features：Stock's feature of product data or production
The state feature of product data.
Optionally, described device also includes order creation module, is used for：
Create the reservation data to be matched and its product data of matching brings order data together.
Accordingly, this specification additionally provides a kind of computing device, including：Processor；It can perform for storing processor
The memory of instruction；Wherein, the processor is configured as：
Obtain data to be written；
According to default feature classification, the first category feature and the second category feature of the data to be written are determined, described
The renewal frequency of one category feature is more than the renewal frequency of the second category information；
First category feature of the data to be written is write to buffer zone, by the second class in the data to be written
Feature is write to storage region.
Accordingly, this specification additionally provides a kind of computing device, is described for the first data in the first data set
One or more of first the second data set of Data Matching the second data；The computing device is configured with buffer zone and storage
The first kind characteristic storage of region, the first category feature of the first data intensive data and the second data intensive data
In the buffer zone, the second of the second category feature of the first data intensive data and the second data intensive data
Category feature is stored in the storage region, and the renewal frequency of first category feature is more than the second category feature；The computing device
Including：Processor；For storing the memory of processor-executable instruction；Wherein, the processor is configured as：
For the first data to be matched, according to storing first data in the buffer zone and the storage region
The first category feature and the second category feature, and the buffer zone and storage region in the second data intensive data that stores
First category feature and the second category feature, inquiry and the second data of first Data Matching.
Accordingly, this specification additionally provides a kind of computing device, is configured with buffer zone and storage region, reservation data
The first category feature of reservation data and product data are concentrated to concentrate the first kind characteristic storage of product data in the buffer area
Domain, the reservation data concentrate the second category feature of reservation data and the product data to concentrate the second class of product data special
Sign is stored in the storage region, and the renewal frequency of first category feature is more than the second category feature；The computing device includes：
Processor；For storing the memory of processor-executable instruction；Wherein, the processor is configured as：
For reservation data to be matched, according to storing the reservation to be matched in the buffer zone and the storage region
The first category feature and the second category feature of data, and the Product Data Set stored in the buffer zone and the storage region
The first category feature and the second category feature of middle product data, inquire about the product data matched with the reservation data to be matched.
The function of modules and the implementation process of effect specifically refer in above-mentioned data transfer apparatus/data matching device
The implementation process of step is corresponded in above-mentioned data transfer apparatus/data matching method, will not be repeated here.
For device embodiment, because it corresponds essentially to embodiment of the method, so related part is real referring to method
Apply the part explanation of example.Device embodiment described above is only schematical, wherein described be used as separating component
The module of explanation can be or may not be physically separate, can be as the part that module is shown or can also
It is not physical module, you can with positioned at a place, or can also be distributed on multiple mixed-media network modules mixed-medias.Can be according to reality
Need to select some or all of module therein to realize the purpose of this specification scheme.Those of ordinary skill in the art are not
In the case of paying creative work, you can to understand and implement.
It is above-mentioned that this specification specific embodiment is described.Other embodiments are in the scope of the appended claims
It is interior.In some cases, the action recorded in detail in the claims or step can be come according to different from the order in embodiment
Perform and still can realize desired result.In addition, the process described in the accompanying drawings not necessarily require show it is specific suitable
Sequence or consecutive order could realize desired result.In some embodiments, multitasking and parallel processing be also can
With or be probably favourable.
Those skilled in the art will readily occur to this specification after considering specification and putting into practice the invention applied here
Other embodiments.This specification is intended to any modification, purposes or adaptations of this specification, these modifications,
Purposes or adaptations follow the general principle of this specification and not applied in the art including this specification
Common knowledge or conventional techniques.Description and embodiments be considered only as it is exemplary, the true scope of this specification and
Spirit is pointed out by following claim.
It should be appreciated that the precision architecture that this specification is not limited to be described above and is shown in the drawings,
And various modifications and changes can be being carried out without departing from the scope.The scope of this specification is only limited by appended claim
System.
The preferred embodiment of this specification is the foregoing is only, it is all in this explanation not to limit this specification
Within the spirit and principle of book, any modification, equivalent substitution and improvements done etc., the model of this specification protection should be included in
Within enclosing.
Claims (23)
1. a kind of method for writing data, methods described include：
Obtain data to be written；
According to default feature classification, the first category feature and the second category feature of the data to be written, the first kind are determined
The renewal frequency of feature is more than the renewal frequency of the second category information；
First category feature of the data to be written is write to buffer zone, by the second category feature in the data to be written
Write to storage region.
2. according to the method for claim 1, the buffer zone includes memory database.
3. a kind of data matching method, it is the data of the first Data Matching second for the first data in the first data set
One or more of collection the second data；
Methods described is configured with buffer zone and storage region, the first category feature of the first data intensive data and described
The first kind characteristic storage of second data intensive data is special in the buffer zone, the second class of the first data intensive data
Second category feature of sign and the second data intensive data is stored in the storage region, the renewal of first category feature
Frequency is more than the second category feature；
Methods described includes：
For the first data to be matched, according to first data stored in the buffer zone and the storage region
The of the second data intensive data stored in first category feature and the second category feature, and the buffer zone and storage region
One category feature and the second category feature, inquiry and the second data of first Data Matching.
4. according to the method for claim 3, the buffer zone includes memory database.
5. according to the method for claim 3, the inquiry and the second data of first Data Matching, including：
The second data based on the inquiry of search engine inquiry technology with first Data Matching.
6. a kind of data matching method, methods described is configured with buffer zone and storage region, and reservation data concentrates reservation data
The first category feature and product data concentrate product data first kind characteristic storage in the buffer zone, the reservation number
The second category feature of product data is concentrated to be stored according to the second category feature and the product data of concentrating reservation data described
Storage region, the renewal frequency of first category feature are more than the second category feature；
Methods described includes：
For reservation data to be matched, according to the reservation number to be matched stored in the buffer zone and the storage region
According to the first category feature and the second category feature, and the product data that are stored in the buffer zone and the storage region concentrate
The first category feature and the second category feature of product data, inquire about the product data matched with the reservation data to be matched.
7. according to the method for claim 6, the buffer zone includes memory database.
8. according to the method for claim 6, described inquire about the product data matched with the reservation data to be matched：
The product data matched based on the inquiry of search engine inquiry technology with the reservation data to be matched.
9. according to the method for claim 6, the first category feature of the reservation data includes following one or more features：
Stock's feature of reservation data or the state feature of reservation data；
First category feature of the product data includes following one or more features：The stock's feature or product number of product data
According to state feature.
10. according to the method for claim 6, methods described also includes：
Create the reservation data to be matched and its product data of matching brings order data together.
11. a kind of data transfer apparatus, described device include：
Data acquisition module, for obtaining data to be written；
Characteristic determination module, for according to default feature classification, determining the first category feature and second of the data to be written
Category feature, the renewal frequency of first category feature are more than the renewal frequency of the second category information；
Writing module, for the first category feature of the data to be written to be write to buffer zone, by the data to be written
In the second category feature write to storage region.
12. device according to claim 11, the buffer zone includes memory database.
13. a kind of data matching device, it is the data of the first Data Matching second for the first data in the first data set
One or more of collection the second data；
Described device is configured with buffer zone and storage region, the first category feature of the first data intensive data and described
The first kind characteristic storage of second data intensive data is special in the buffer zone, the second class of the first data intensive data
Second category feature of sign and the second data intensive data is stored in the storage region, the renewal of first category feature
Frequency is more than the second category feature；
Described device includes matching module, is used for：
For the first data to be matched, according to storing the of first data in the buffer zone and the storage region
The first of the second data intensive data stored in one category feature and the second category feature, and the buffer zone and storage region
Category feature and the second category feature, inquiry and the second data of first Data Matching.
14. device according to claim 13, the buffer zone includes memory database.
15. device according to claim 13, the matching module, are additionally operable to：Inquired about based on search engine inquiry technology
With the second data of first Data Matching.
16. a kind of data matching device, described device is configured with buffer zone and storage region, and reservation data concentrates reservation data
The first category feature and product data concentrate product data first kind characteristic storage in the buffer zone, the reservation number
The second category feature of product data is concentrated to be stored according to the second category feature and the product data of concentrating reservation data described
Storage region, the renewal frequency of first category feature are more than the second category feature；
Described device includes matching module, is used for：
For reservation data to be matched, according to the reservation number to be matched stored in the buffer zone and the storage region
According to the first category feature and the second category feature, and the product data that are stored in the buffer zone and the storage region concentrate
The first category feature and the second category feature of product data, inquire about the product data matched with the reservation data to be matched.
17. device according to claim 16, the buffer zone includes memory database.
18. device according to claim 16, the matching module, are additionally operable to：
The product data matched based on the inquiry of search engine inquiry technology with the reservation data to be matched.
19. device according to claim 16, the first category feature of the reservation data includes following one or more spies
Sign：Stock's feature of reservation data or the state feature of reservation data；
First category feature of the product data includes following one or more features：The stock's feature or product number of product data
According to state feature.
20. device according to claim 16, described device also includes order creation module, is used for：
Create the reservation data to be matched and its product data of matching brings order data together.
21. a kind of computing device, including：
Processor；
For storing the memory of processor-executable instruction；
Wherein, the processor is configured as：
Obtain data to be written；
According to default feature classification, the first category feature and the second category feature of the data to be written, the first kind are determined
The renewal frequency of feature is more than the renewal frequency of the second category information；
First category feature of the data to be written is write to buffer zone, by the second category feature in the data to be written
Write to storage region.
22. a kind of computing device, it is in the data set of the first Data Matching second for the first data in the first data set
The data of one or more second；The computing device is configured with buffer zone and storage region, is counted in first data set
According to the first category feature and the second data intensive data first kind characteristic storage in the buffer zone, described first
Second category feature of data intensive data and the second category feature of the second data intensive data are stored in the memory block
Domain, the renewal frequency of first category feature are more than the second category feature；The computing device includes：
Processor；
For storing the memory of processor-executable instruction；
Wherein, the processor is configured as：
For the first data to be matched, according to storing the of first data in the buffer zone and the storage region
The first of the second data intensive data stored in one category feature and the second category feature, and the buffer zone and storage region
Category feature and the second category feature, inquiry and the second data of first Data Matching.
23. a kind of computing device, is configured with buffer zone and storage region, reservation data concentrates the first category feature of reservation data
And product data concentrate the first kind characteristic storage of product data to concentrate reservation number in the buffer zone, the reservation data
According to the second category feature and the product data concentrate product data the second category feature be stored in the storage region, it is described
The renewal frequency of first category feature is more than the second category feature；The computing device includes：
Processor；
For storing the memory of processor-executable instruction；
Wherein, the processor is configured as：
For reservation data to be matched, according to storing the reservation data to be matched in the buffer zone and the storage region
The first category feature and the second category feature, and the product data that are stored in the buffer zone and the storage region concentrate production
The first category feature and the second category feature of product data, inquire about the product data matched with the reservation data to be matched.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710552945.8A CN107402982A (en) | 2017-07-07 | 2017-07-07 | Data write-in, data matching method, device and computing device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710552945.8A CN107402982A (en) | 2017-07-07 | 2017-07-07 | Data write-in, data matching method, device and computing device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107402982A true CN107402982A (en) | 2017-11-28 |
Family
ID=60404926
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710552945.8A Pending CN107402982A (en) | 2017-07-07 | 2017-07-07 | Data write-in, data matching method, device and computing device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107402982A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108009245A (en) * | 2017-11-30 | 2018-05-08 | 平安养老保险股份有限公司 | Value of the product acquisition methods, device, computer equipment and storage medium |
| CN108833494A (en) * | 2018-05-24 | 2018-11-16 | 国家电网有限公司 | A kind of distributed data storage method and system |
| CN108874903A (en) * | 2018-05-24 | 2018-11-23 | 中国平安人寿保险股份有限公司 | Method for reading data, device, computer equipment and computer readable storage medium |
| CN116339561A (en) * | 2023-03-29 | 2023-06-27 | 郑州裕中能源有限责任公司 | Three-dimensional visualization method, system and equipment for boiler monitoring |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1831824A (en) * | 2006-04-04 | 2006-09-13 | 浙江大学 | Buffer data base data organization method |
| CN103019958A (en) * | 2012-10-31 | 2013-04-03 | 香港应用科技研究院有限公司 | Method for managing data in solid state memory through data attribute |
| CN103309894A (en) * | 2012-03-15 | 2013-09-18 | 阿里巴巴集团控股有限公司 | User attribute-based search realization method and system |
| CN103425658A (en) * | 2012-05-15 | 2013-12-04 | 阿里巴巴集团控股有限公司 | Commodity information storing and searching method, mobile terminal and server |
| CN103593460A (en) * | 2013-11-25 | 2014-02-19 | 方正国际软件有限公司 | Data hierarchical storage system and data hierarchical storage method |
| CN104461935A (en) * | 2014-11-27 | 2015-03-25 | 华为技术有限公司 | Method, device and system for data storage |
| US20150142735A1 (en) * | 2012-06-06 | 2015-05-21 | Tencent Technology (Shenzhen) Company Limited | Memory searching system and method, real-time searching system and method, and computer storage medium |
| CN104751257A (en) * | 2013-12-25 | 2015-07-01 | 携程计算机技术（上海）有限公司 | Management system of hotel data |
| CN104794190A (en) * | 2015-04-16 | 2015-07-22 | 成都睿峰科技有限公司 | Method and device for effectively storing big data |
| CN106294202A (en) * | 2015-06-12 | 2017-01-04 | 联想(北京)有限公司 | A kind of date storage method and device |
| CN106874336A (en) * | 2016-03-28 | 2017-06-20 | 阿里巴巴集团控股有限公司 | Data match method, data query method and device |
-
2017
- 2017-07-07 CN CN201710552945.8A patent/CN107402982A/en active Pending
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1831824A (en) * | 2006-04-04 | 2006-09-13 | 浙江大学 | Buffer data base data organization method |
| CN103309894A (en) * | 2012-03-15 | 2013-09-18 | 阿里巴巴集团控股有限公司 | User attribute-based search realization method and system |
| CN103425658A (en) * | 2012-05-15 | 2013-12-04 | 阿里巴巴集团控股有限公司 | Commodity information storing and searching method, mobile terminal and server |
| US20150142735A1 (en) * | 2012-06-06 | 2015-05-21 | Tencent Technology (Shenzhen) Company Limited | Memory searching system and method, real-time searching system and method, and computer storage medium |
| CN103019958A (en) * | 2012-10-31 | 2013-04-03 | 香港应用科技研究院有限公司 | Method for managing data in solid state memory through data attribute |
| CN103593460A (en) * | 2013-11-25 | 2014-02-19 | 方正国际软件有限公司 | Data hierarchical storage system and data hierarchical storage method |
| CN104751257A (en) * | 2013-12-25 | 2015-07-01 | 携程计算机技术（上海）有限公司 | Management system of hotel data |
| CN104461935A (en) * | 2014-11-27 | 2015-03-25 | 华为技术有限公司 | Method, device and system for data storage |
| CN104794190A (en) * | 2015-04-16 | 2015-07-22 | 成都睿峰科技有限公司 | Method and device for effectively storing big data |
| CN106294202A (en) * | 2015-06-12 | 2017-01-04 | 联想(北京)有限公司 | A kind of date storage method and device |
| CN106874336A (en) * | 2016-03-28 | 2017-06-20 | 阿里巴巴集团控股有限公司 | Data match method, data query method and device |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108009245A (en) * | 2017-11-30 | 2018-05-08 | 平安养老保险股份有限公司 | Value of the product acquisition methods, device, computer equipment and storage medium |
| CN108833494A (en) * | 2018-05-24 | 2018-11-16 | 国家电网有限公司 | A kind of distributed data storage method and system |
| CN108874903A (en) * | 2018-05-24 | 2018-11-23 | 中国平安人寿保险股份有限公司 | Method for reading data, device, computer equipment and computer readable storage medium |
| CN116339561A (en) * | 2023-03-29 | 2023-06-27 | 郑州裕中能源有限责任公司 | Three-dimensional visualization method, system and equipment for boiler monitoring |
| CN116339561B (en) * | 2023-03-29 | 2024-03-15 | 郑州裕中能源有限责任公司 | Three-dimensional visualization method, system and equipment for boiler monitoring |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9740706B2 (en) | Management of intermediate data spills during the shuffle phase of a map-reduce job | |
| US9367574B2 (en) | Efficient query processing in columnar databases using bloom filters | |
| CN107968818B (en) | Data storage method and device and server cluster | |
| US10417265B2 (en) | High performance parallel indexing for forensics and electronic discovery | |
| CN107402982A (en) | Data write-in, data matching method, device and computing device | |
| CN109033292A (en) | A kind of database distributed caching system and method | |
| CN105843841A (en) | Small file storing method and system | |
| CN105095247B (en) | symbol data analysis method and system | |
| Dhyani et al. | Big data analytics using Hadoop | |
| CN106933511B (en) | Space data storage organization method and system considering load balance and disk efficiency | |
| CN106970958A (en) | A kind of inquiry of stream file and storage method and device | |
| US20110179013A1 (en) | Search Log Online Analytic Processing | |
| CN109325055A (en) | The screening of business association tables of data and checking method, device, electronic equipment | |
| CN112181902A (en) | Database storage method and device and electronic equipment | |
| CN109727030A (en) | Account data storage method in a kind of block chain | |
| CN109325011A (en) | Data storage, processing, sharing method and system based on block chain | |
| CN107506466A (en) | A kind of small documents storage method and system | |
| CN114281855A (en) | Data request method, data request device, computer equipment, storage medium and program product | |
| Dunning et al. | Real-world hadoop | |
| CN107844592A (en) | A kind of method and apparatus of query metadata | |
| CN107102900A (en) | A kind of management method of shared memory space | |
| CN116401270A (en) | Data query method, device, computer equipment and storage medium | |
| CN111324776A (en) | Method and device for training graph embedding model, computing equipment and readable medium | |
| CN110874360A (en) | Ordered queue caching method and device based on fixed capacity | |
| CN108256064A (en) | A kind of data search method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171128 |
|
| RJ01 | Rejection of invention patent application after publication |