CN102591864A - Data updating method and device in comparison system - Google Patents
Data updating method and device in comparison system Download PDFInfo
- Publication number
- CN102591864A CN102591864A CN2011100018567A CN201110001856A CN102591864A CN 102591864 A CN102591864 A CN 102591864A CN 2011100018567 A CN2011100018567 A CN 2011100018567A CN 201110001856 A CN201110001856 A CN 201110001856A CN 102591864 A CN102591864 A CN 102591864A
- Authority
- CN
- China
- Prior art keywords
- data
- information
- characteristic
- item
- local disk
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a data updating method in a comparison system, which comprises the steps of: creating an internal memory cache region in a physical internal memory, and loading updated data and information items thereof in the internal memory cache region; and looking up a corresponding current index in a local disk according to the information items, and performing an updating operation. In order to realize the data updating method in comparison system, the invention also provides a data updating device in comparison system, which comprises a creating unit used for creating the internal memory cache region in the physical internal memory; a loading unit used for loading the updated data and the information items thereof in the internal memory cache region; a searching unit used for looking up the corresponding current index in the local disk according to the information items; and an updating unit used for performing the updating operation. The data updating method in comparison system and the data updating device in comparison system have the advantages of avoiding large scale data updating delay, and comparing the updated data in real time so as to obtain a more accurate comparison result.
Description
Technical field
The present invention relates to the comparison system, relate in particular to data-updating method and device in the comparison system.
Background technology
Along with development of technology, needs of society, comparison system are used in the every profession and trade field gradually widely.Because mainly based on the support of data, therefore mostly present comparison system is to compare on a large scale system or even ultra-large comparison system in the comparison system, like the fingerprint characteristic comparison system in the comparison of the face characteristic in Identification of Images system system, the system of fingerprints.The data of said comparison system are stored in the database usually, and memory space generally can reach 1,000,000 even tens million of, more than one hundred million, the size of every data generally at number KB between tens of KB, so the data total amount in the comparison system generally can reach several GB to hundreds of GB.
Be to improve the precision of comparison result, can constantly add new data in the said database, and also might make amendment to data with existing, operation is upgraded in deletion etc.So the data of magnanimity not only can impact the comparison operation if upgrade operation simultaneously, lower the precision of comparison result, but also can prolong the time of renewal, cause updating delay.
Application number is 200710096870.3 application for a patent for invention, discloses a kind of method of Data Update, is applied to client and server stores synchronization of data and upgrades.But delay how to avoid large-scale data to upgrade makes the data after the renewal can in time participate in comparison, and obtaining more accurately, comparison result becomes one of those skilled in the art's problem demanding prompt solution.
Summary of the invention
The problem that the present invention solves provides a kind of data-updating method and device of comparing in the system, with the delay of avoiding large-scale data to upgrade, makes the data after the renewal can in time participate in comparison, obtains comparison result more accurately.
The invention provides a kind of data-updating method of comparing in the system for addressing the above problem, comprising:
In physical memory, create the memory cache district, data updated and item of information thereof are loaded in the said memory cache district;
In local disk, search corresponding current index according to said item of information, upgrade operation.
Optional, said data updated is a characteristic newly-increased in the database, and then said renewal is operating as the data in the said memory cache district and item of information thereof be loaded in the said local disk becomes characteristic, and creates current index again.
Optional, said data updated is an amended characteristic in the said local disk, then said renewal is operating as the data in the said memory cache district is substituted the former characteristic in the said local disk.
Optional, said data updated is a characteristic to be deleted in the said local disk, then said renewal is operating as characteristic and item of information thereof to be deleted in the said local disk of deletion, and creates current index again.
Optional, said current index is created according to following step:
Convert the item of information of data into the numeric type information data;
According to said numeric type information data said data are sorted;
The concordance list of creating the data after correspondence sorts is current index.
Optional, saidly create current index again and comprise:
Convert the item of information of said newly-increased characteristic into the numeric type information data;
Said numeric type information data is inserted in the current index.
Optional, saidly create current index again and comprise:
Convert the item of information of characteristic said to be deleted into the numeric type information data;
In said current index, search the corresponding key assignments of said numeric type information data, and delete said key assignments corresponding in the current index.
Optional, said renewal operation timing is carried out once.
Optional, the said quantity that Updates Information reaches predetermined value, carries out once said renewal operation.
Optional, said data-updating method also is included in creates the disk buffering district in the said local disk, and data updated and item of information thereof are loaded in the said disk buffering district, and the data in the said disk buffering district are identical with data in the said memory cache district.
Optional, said local disk is the hard disk of comparison server, said physical memory is the internal memory of said comparison server.
Optional, said data behaviour face characteristic or fingerprint characteristic data, the item of information of said data comprises sex, age and zone.
For addressing the above problem, the present invention also provides a kind of data update apparatus of comparing in the system, comprising:
Create the unit, in order in physical memory, to create the memory cache district;
Loading unit is in order to be loaded into data updated and item of information thereof in the said memory cache district;
Search unit is in order to search corresponding current index in local disk according to said item of information;
Updating block is in order to upgrade operation.
Optional, said data updated is a characteristic newly-increased in the database, and then said updating block is loaded into the data in the said memory cache district and item of information thereof in the said local disk becomes characteristic.
Optional, said data updated is an amended characteristic in the said local disk, then said updating block substitutes the former characteristic in the said local disk with the data in the said memory cache district.
Optional, said data updated is a characteristic to be deleted in the said local disk, then said updating block is deleted characteristic to be deleted in the said local disk and item of information thereof.
Optional, said data update apparatus also comprises:
Converting unit converts the numeric type information data in order to the item of information with data;
Sequencing unit is in order to sort to said data according to said numeric type information data;
Operating unit is current index in order to the concordance list of creating the data after correspondence sorts.
Optional, said data updated is a characteristic newly-increased in the database, then:
Said converting unit also converts the numeric type information data in order to the item of information with said newly-increased characteristic;
Said operating unit is also in order to insert said numeric type information data in the current index.
Optional, said data updated is a characteristic to be deleted in the said local disk, then:
Said converting unit also converts the numeric type information data in order to the item of information with characteristic said to be deleted;
Said operating unit also in order in said current index, searching the corresponding key assignments of said numeric type information data, and is deleted said key assignments corresponding in the current index.
Optional, said data update apparatus also comprises control module, regularly carries out once said renewal operation in order to control said updating block.
Optional, said data update apparatus also comprises control module, in order to when the said quantity that Updates Information reaches predetermined value, controls said updating block and carries out once said renewal operation.
Optional; Said data update apparatus also is included in and creates the disk buffering district in the said local disk; Said loading unit is loaded into data updated and item of information thereof in the said disk buffering district, and the data in the said disk buffering district are identical with data in the said memory cache district.
Optional, said local disk is the hard disk of comparison server, said physical memory is the internal memory of said comparison server.
Optional, said data behaviour face characteristic or fingerprint characteristic data, the item of information of said data comprises sex, age and zone.
Compared with prior art, the present invention has the following advantages:
In physical memory, create the memory cache district, data updated and item of information thereof are loaded in the said memory cache district, this can quicken to read the speed of said data, shortens comparison time.In local disk, search corresponding current index according to said item of information, upgrade operation, this not only can protect to Update Information and not be destroyed, and makes things convenient for updating data.
To dissimilar Updating Information, take different renewal operations: newly-increased data, take plug-type renewal operation; Amended data are taked the renewal operation of the formula that substitutes; Data to be deleted are taked the renewal operation of the formula of deleting.So not only can accomplish rapidly and upgrade operation, and can not destroy the integrality of former data.
The method of creating said current index generally is: convert said item of information into the numeric type information data; According to said numeric type information data said data are sorted; The concordance list of creating the data after correspondence sorts is current index.Time according to the current index of said method foundation is not only created is short, and said current cable ejectment is shown preface, easy-to-look-up data.
In order to shorten the time of upgrading operation and to improve the speed that Updates Information, to different Updating Information, the mode of creating current index again is slightly different.Newly-increased data are taked following mode: convert the item of information of said data into the numeric type information data, said numeric type information data is inserted in the former current index.This mode only need be rebuild the current index of part can create new current index, has saved the time.The following mode of The data to be deleted: convert the item of information of said data into the numeric type information data; In said former current index, search the corresponding key assignments of said numeric type information data, and delete said key assignments corresponding in the former current index.This mode also is that the current index of local modification forms new current index, saves time, and reduces the wasting of resources.
Said renewal operation timing is carried out once, and the perhaps said quantity that Updates Information reaches a certain predetermined value, carries out once.This not only can prevent the data obstruction, avoids real-time update data influence comparison result, and has improved the physical memory utilization of space, prevents data redundancy.
Be protected data safety, in said local disk, create the disk buffering district, data updated and item of information thereof are loaded in the said disk buffering district, the data in the said disk buffering district are identical with data in the said memory cache district.This has guaranteed the backup that Updates Information to prevent loss of data, has caused the consequence that is difficult to recover.
Said local disk is the hard disk of comparison server, and said physical memory is the internal memory of said comparison server.This can make things convenient for the control of comparison system, and data storing is on the contrast server hard disc, and the comparison system is management data directly, need not carry out data-switching.Said physical memory is the internal memory of said comparison server, and the comparison system directly reads the data in the internal memory, shortens comparison time, raises the efficiency.
Said comparison system is generally portrait comparison system or fingerprint comparison system, therefore said characteristic behaviour face characteristic or fingerprint characteristic data, and the item of information of said characteristic comprises sex, age and zone.
The present invention also provides a kind of data update apparatus of comparing in the system, has realized the data-updating method in the above-mentioned comparison system.Through said data update apparatus, the delay of avoiding large-scale data to upgrade makes the data after the renewal can in time participate in comparison, obtains comparison result more accurately.
Description of drawings
Fig. 1 is the process flow diagram of a kind of embodiment of data-updating method provided by the invention;
Fig. 2 is a process flow diagram of setting up a kind of embodiment of index in the data-updating method provided by the invention;
Fig. 3 is the structural representation of a kind of embodiment of data update apparatus provided by the invention.
Embodiment
The invention provides a kind of data-updating method and device of comparing in the system thereof, reached the delay of avoiding large-scale data to upgrade, make the data after the renewal can in time participate in comparison, obtain comparison result more accurately.
For make above-mentioned purpose of the present invention, feature and advantage can be more obviously understandable, does detailed explanation below in conjunction with the accompanying drawing specific embodiments of the invention.
Set forth detail in the following description so that make much of the present invention.But the present invention can be different from alternate manner described here and implements with multiple, and those skilled in the art can do similar popularization under the situation of intension of the present invention.Therefore the present invention does not receive the restriction of following disclosed embodiment.
Because the comparison system need just can better accomplish the comparison task based on the support of mass data, reaches higher comparison result.Therefore mostly present comparison system is to compare on a large scale system or even ultra-large comparison system.The memory data output of said comparison system generally can reach 1,000,000 even tens million of, more than one hundred million, the size of every data generally at number KB between tens of KB, so the data total amount in the comparison system generally can reach several GB to hundreds of GB.
In order to improve the precision of comparison result, the updating data frequency is very fast in the comparison system, if can not data updated in time be participated in the comparison, occurs the inaccurate situation of comparison result easily.In view of the foregoing the invention provides a kind of data-updating method of comparing in the system, Fig. 1 is the process flow diagram of a kind of embodiment of data-updating method provided by the invention, below in conjunction with specifying like Fig. 1.
Step S101 creates the memory cache district in physical memory, data updated and item of information thereof are loaded in the said memory cache district.
Step S102 searches corresponding current index according to said item of information in local disk, upgrade operation.
Because the comparison system mostly is installed on the equipment such as mainframe computer or data processor, obtains data through hardware such as central processing units, accomplish the comparison request.Therefore this to sentence the Identification of Images system that is installed on the computing machine be example, specify the method for Data Update in the present embodiment, but be not limited to the following description of content for example, can do adaptability revision.
The comparison system generally is installed on a certain the outside master server, for example on the more excellent mainframe computer of performance.Said master server is connected with one or more comparison servers again, realizes parallel work-flow completion comparison request.Compare server from the above and mostly be computing machine, said local disk refers generally to compare the hard disk of server, and said physical memory is generally the internal memory of said comparison server.
Because data volume is huge in the comparison system, the real-time update data can clash with the comparison request, are easy to like this comparison result is caused harmful effect.If the interior unification of section sometime that operates in of Data Update is carried out, then cause updating delay easily, that is to say that Update Information earlier and compare, this need just can be reflected in the comparison result through after a while.Among the step S101, data updated is put into buffer area then improved above-mentioned situation.
Buffer area is the buffer zone of exchanges data, when a certain hardware of computing machine is wanted reading of data, can at first from buffer area, search the data that need; If found then directly execution; The words that can not find are then looked for from internal memory, if can not find in the internal memory, get in hard disk or other storage mediums and seek.That is to say, data updated is stored in the buffer area that computing machine can read Updating Information of buffer area earlier; Read in the internal memory other data again; So not only can not incur loss through delay comparison time, and data updated also comparison process can be participated in timely, the comparison error can be do not caused.Hence one can see that, and the data in the buffer area are read at first, among the step S101; In internal memory, create buffer area and deposit data updated and item of information thereof, can significantly improve the reading speed of data, shorten comparison time; Improve comparison efficiency; And, can not influence comparison result because data updated can in time be participated in comparison, improve the precision of comparison result on the contrary.
For guaranteeing the information security of the mass data in the comparison system, prevent the data loss, said data generally are stored in the external data base, for explaining that conveniently the data that occur in the following content except that specifying, are characteristic.For improving the utilization factor of data, reduce data redundancy, generally depositing data of database in is characteristic.For face characteristic comparison system, said characteristic generally is meant the face characteristic data, for example the shape of face such as shape of face, ocular form, lip.Said characteristic can also comprise other tangible distinguishing characteristicss, and whether the information such as position of mole, mole are for example arranged.
Said characteristic is stored in the database, and classification and storage that is to say that the said characteristic that will have same characteristics reduces one type, and with the item of information of above-mentioned same characteristics as said characteristic, deposits in the database jointly usually.In general, said item of information is the field name in the database, can be sex, age, zone etc., and said zone is often referred to ground domain informations such as birthplace, residence.The comparison system generally all has corresponding comparison condition, and said comparison condition and the mostly corresponding setting of said item of information that is to say that said comparison condition and said item of information are basic identical, and comparison condition described herein is sex, age, zone etc.
Different comparison systems, said characteristic, said item of information, said comparison condition generally are not quite similar, and for the fingerprint comparison system, said characteristic is a fingerprint characteristic data, for example fingerprint line type.Because fingerprint comparison system and face characteristic are compared system all with artificial object of reference, so the said item of information in the fingerprint comparison system, said comparison condition can be information such as sex, age, zone.Only illustrate here,, confirm above-mentioned characteristic, item of information and comparison condition with reference to the function of comparison system to different comparison systems.
Characteristic in the said database is loaded in the local disk usually.Guarantee said database and the said local disk data that can backup each other so on the one hand, prevent loss of data,, cause the data disappearance, can remedy each other if said database or said local disk break down; On the other hand, the safety of protected data prevents that said characteristic from being distorted.
When said local disk loads said characteristic, can load the item of information of said characteristic usually in the lump, and can create index according to said item of information and store.Said characteristic is loaded together with said item of information, prevent the data disappearance on the one hand, the convenient on the other hand index of making.Said characteristic and said item of information according to certain organizational form, generally are man-to-man mapping relations, are combined into one or more files, are loaded in the said local disk.According to file, form current index according to the content of said item of information with said item of information like upper type combination.
Data updated and item of information thereof are loaded in the said memory cache district among the step S101, in step S102, in local disk, search corresponding current index by said item of information, upgrade operation.From the above, the current index of answering in the local disk is to set up according to the item of information of data, therefore by the item of information of data in the said memory cache district; Not only can find corresponding said current index easily, save time raising speed; Be convenient to the operation of Data Update; And the item of information symmetry, reduce the situation of searching error in data, reduce the occurrence probability of error.
Said renewal operation generally is divided into the increase new data, revises data, and three kinds of deleted datas according to the type that Updates Information, carry out different operation.
If said data updated is a characteristic newly-increased in the database, then said renewal is operating as the data in the said memory cache district and item of information thereof be loaded in the said local disk becomes characteristic, and creates current index again.
If said data updated is an amended characteristic in the said local disk, then said renewal is operating as the data in the said memory cache district is substituted the former characteristic in the said local disk.
If said data updated is a characteristic to be deleted in the said local disk, then said renewal is operating as characteristic and item of information thereof to be deleted in the said local disk of deletion, and creates current index again.
Above-mentioned renewal operation is all carried out in the comparison server, that is to say in local disk and carries out.In the data comparison process, sometimes data are carried out the modification of aforesaid three kinds of forms, tamper said characteristic; Can impact follow-up comparison; Therefore raw data archive needed in the said database is loaded into said characteristic in the said local disk, if distort; Can compare with the raw data in the said database, guarantee the correctness of data.
Because data change, so index also can do accommodation, and Fig. 2 is a process flow diagram of setting up a kind of embodiment of index in the data-updating method provided by the invention, specifies detailed process below in conjunction with Fig. 2.
Step S1 converts the item of information of data into the numeric type information data;
Step S2 sorts to said data according to said numeric type information data;
Step S3, the concordance list of creating the data after correspondence sorts is current index.
As everyone knows, the data speed of computing machine reading numerical values type is the fastest, when therefore creating current index according to the item of information of said data, converts said item of information into the numeric type information data.Therefore in addition, the data sorting of numeric type is the simplest, according to said numeric type information data characteristic is sorted, and creates the concordance list of the characteristic after the corresponding ordering, the speed of raising data load that can be by a relatively large margin.Said numeric type is generally integer, unsigned int or enumeration type, and numeric type is a preferred version, also can be the data of computer-readable other types.
The visioning procedure of above-mentioned concordance list is applicable to most index creation, that is to say, index creation mode shown in Figure 2 is not only applicable in the process of Updating Information, and also is used for other data load processes, is a kind of use index creation mode comparatively widely.Because the item of information that Updates Information is little to the influence of concordance list, therefore, shorten the time of creating index in order to increase work efficiency, can also can take different establishment modes according to different update modes.
If said data updated is a characteristic newly-increased in the database, then the item of information with said data converts the numeric type information data into; Said numeric type information data is inserted in the former current index.Generally speaking; The characteristic that increases newly has corresponding index information in said local disk, therefore find corresponding information data, after the item of information change data type with newly-increased characteristic; Insert former current index and just can form new index, and can not impact other data.
If said data updated is a characteristic to be deleted in the said local disk, then the item of information with said data converts the numeric type information data into; In said former current index, search the corresponding key assignments of said numeric type information data, and delete said key assignments corresponding in the former current index.Because the characteristic in the said local disk of deletion; Its item of information can be deleted in the lump; To other not influence of data, therefore in said former current index, search the corresponding information of item of information of this characteristic, and delete said information creating index corresponding in the former current index.
If said data updated is an amended characteristic in the said local disk, owing to be that the characteristic in the said local disk is made an amendment only, do not influence its item of information, so generally can not influence the change of index.If the characteristic in the said local disk of modification relates to the modification of its item of information, can create new index according to flow process shown in Figure 2, also can create according to the mode that newly-increased characteristic is created index, can also create through the mode of deletion.The mode of above-mentioned establishment index can be carried out adaptability revision as required in actual design, be not limited to the foregoing description content.
The running of generally can starting shooting for a long time of comparison server, so the situation of power down or fault might take place.If above-mentioned situation takes place; Data in the internal memory are lost through regular meeting; For preventing loss of data; Also in said local disk, create the disk buffering district, data updated and item of information thereof are loaded in the said disk buffering district, the data in the said disk buffering district are identical with data in the said memory cache district.Even the power down of comparison server is perhaps broken down like this, can also guarantee there is Backup Data in the hard disk, guarantee data security.
Because large-scale Data Update can be brought time delay, therefore said renewal operation timing is carried out once, and the perhaps said quantity that Updates Information reaches predetermined value, carries out once said renewal operation.General 24 hours of update time, said predetermined range is generally 10,000 to 100,000.Above-mentioned update time and predetermined value can be changed as required, not limited by foregoing.
For realizing the data-updating method in the said comparison system, the present invention also provides a kind of data update apparatus of comparing in the system.Fig. 3 is the structural representation of a kind of embodiment of data update apparatus provided by the invention, comprising:
Create unit A1, in order in physical memory, to create the memory cache district;
Loading unit A2 is in order to be loaded into data updated and item of information thereof in the said memory cache district;
Search unit A3 is in order to search corresponding current index in local disk according to said item of information;
Updating block A4 is in order to upgrade operation.
Said updating block A4 timing, the perhaps said quantity that Updates Information reaches predetermined value, carries out once said renewal operation.Said predetermined range is generally at 10,000 to 100,000, and said update cycle and said predetermined value can be arranged among the said updating block A4 in advance, also can manual work be provided with at any time as required, does not receive the restriction of foregoing.
Wherein create unit A1, loading unit A2, search unit A3, updating block A4 connects successively.Because the function and the effect of every kind of comparison system are not quite similar; Therefore the above-mentioned treating apparatus of enumerating is a kind of embodiment, can do adaptability revision according to different comparison systems, for example increases timing unit; Signal processing unit, and the quantity of device is also unrestricted.
Loading unit A2 goes into said local disk with data load, so loading unit A2 can also be connected with said local disk A100, and general loading unit A2 is connected with said local disk A100 through Serial Port Line, also can adopt other mode.Search unit A3 searches corresponding current index according to said item of information in local disk A100; Updating block A4 upgrades operation in said local disk A100, therefore said local disk A100 also is connected with search unit A3, updating block A4 respectively.In computing machine, exist data communication between disk and the internal memory, therefore also there is annexation between said local disk A100 and the physical memory A200.Said physical memory A200 also is connected with said establishment unit A1, said updating block A4 respectively.
In addition; Characteristic described in the present embodiment is perhaps quantitative being loaded among the said local domain A100 regularly; Therefore said data update apparatus also comprises control module (not indicating among the figure), and A4 is connected with updating block, and said updating block A4 once upgrades operation in order to timing controlled; Perhaps, in order to when the quantity that Updates Information reaches predetermined value, control said updating block A4 and once upgrade operation.
During the timing loading data, can also increase timing unit (indicating among the figure), in order to timing, full 24 hours of cumulative time, send load signal or message to said control module, once upgrade operation by said control module control updating block A4 again; Quantitatively during loading data; Can also increase metering units (among the figure indicate), the quantity that Updates Information in order to calculating is when reaching predetermined value; Send load signal or message to said control module, once upgrade operation by said control module control loaded unit A2 again.Said predetermined range is generally at 10,000 to 100,000, and this number can be changed and can not influence the loading effect.
In the process of data load and Data Update, big city relates to the step of creating index, so said apparatus also comprises:
Converting unit (not indicating among the figure) converts the numeric type information data in order to the item of information with data;
Sequencing unit (not indicating among the figure) is in order to sort to said data according to said numeric type information data;
Operating unit (indicating among the figure) is current index in order to the concordance list of creating the data after correspondence sorts.
Generally connect in order between the said units, because function needs also can connect according to other modes.Can be known that by aforementioned content said units is created index based on the item of information of data, and said data being not limited to data updated, also can be raw data or other data.Said units has versatility, is not limited to specific data type, also is not limited to specific environment for use, also can be in order to create index in the common data load process.
Because said local disk regularly or quantitatively once upgrades operation, therefore each data updated might be not quite similar.Owing to Update Information at every turn, all can create said concordance list again, the process of therefore creating index is dynamic.That is to say that Update Information the said current index of creating not necessarily can be identical at every turn.If data are simple, change not quite, may create the one-level index in addition; If data are complicated, contain much information, then might create multiple index, and each index progression of creating is also not necessarily identical.Can adapt to the form of said characteristic like this, different index is set, convenient follow-up storage and arrangement, and comparison work.
Converting unit, the data type of the item of information of translation data, sequencing unit sorts to said data, operating unit, the concordance list of the data after the corresponding ordering is current index.Process flow diagram is identical among the method for above-mentioned establishment index and Fig. 2, and no longer here doing given unnecessary details more.Because different types of data, the mode of creating index is slightly different, so above-mentioned converting unit, sequencing unit, and operating unit can increase and decrease as required, for example removes sequencing unit, keeps converting unit and operating unit.
When said data updated is a characteristic newly-increased in the database, then: said converting unit also converts the numeric type information data in order to the item of information with said newly-increased characteristic; Said operating unit is also in order to insert said numeric type information data in the current index.
When said data updated is a characteristic to be deleted in the said local disk, then: said converting unit also converts the numeric type information data in order to the item of information with data said to be deleted; Said operating unit also in order in said current index, searching the corresponding key assignments of said numeric type information data, and is deleted said key assignments corresponding in the current index.
Can be known that by foregoing said converting unit is responsible for the conversion of data type, said operating unit inserts operation or deletion action, when concrete design, can do accommodation.So not only can improve the step of index creation, save time, and the consume of minimizing equipment, cost practiced thrift.
The work of above-mentioned converting unit, sequencing unit and operating unit also can be accomplished by said loading unit; Be that said loading unit is when carrying out data loading operations; Also can create the operation of index; And each loading data can carry out corresponding index creation operation according to data type.When Updating Information, then can notify said loading unit to create current index again by said updating block.
The annexation of said apparatus does not receive the restriction of content for example, and is general through the circuit connection between the device, and possibility wireless connections sometimes are perhaps through network remote control, signal controlling.The value volume and range of product of said device does not receive the restriction of foregoing yet, according to actual conditions, can be provided with flexibly.
Though the present invention with specific embodiment openly as above; But it is not to be used for limiting the present invention; Any those skilled in the art are not breaking away from the spirit and scope of the present invention; Can utilize the method and the technology contents of above-mentioned announcement that technical scheme of the present invention is made possible change and modification, therefore, every content that does not break away from technical scheme of the present invention; To any simple modification, equivalent variations and modification that above embodiment did, all belong to the protection domain of technical scheme of the present invention according to technical spirit of the present invention.
Claims (24)
1. a data-updating method of comparing in the system is characterized in that, comprising:
In physical memory, create the memory cache district, data updated and item of information thereof are loaded in the said memory cache district;
In local disk, search corresponding current index according to said item of information, upgrade operation.
2. data-updating method as claimed in claim 1; It is characterized in that; Said data updated is a characteristic newly-increased in the database; Then said renewal is operating as the data in the said memory cache district and item of information thereof be loaded in the said local disk becomes characteristic, and creates current index again.
3. data-updating method as claimed in claim 1; It is characterized in that; Said data updated is an amended characteristic in the said local disk, and then said renewal is operating as the data in the said memory cache district are substituted the former characteristic in the said local disk.
4. data-updating method as claimed in claim 1; It is characterized in that; Said data updated is a characteristic to be deleted in the said local disk, and then said renewal is operating as characteristic and item of information thereof to be deleted in the said local disk of deletion, and creates current index again.
5. like each described data-updating method of claim 1-4, it is characterized in that said current index is created according to following step:
Convert the item of information of data into the numeric type information data;
According to said numeric type information data said data are sorted;
The concordance list of creating the data after correspondence sorts is current index.
6. data-updating method as claimed in claim 2 is characterized in that, saidly creates current index again and comprises:
Convert the item of information of said newly-increased characteristic into the numeric type information data;
Said numeric type information data is inserted in the current index.
7. data-updating method as claimed in claim 4 is characterized in that, saidly creates current index again and comprises:
Convert the item of information of characteristic said to be deleted into the numeric type information data;
In said current index, search the corresponding key assignments of said numeric type information data, and delete said key assignments corresponding in the current index.
8. like each described data-updating method of claim 1-4, it is characterized in that said renewal operation timing is carried out once.
9. like each described data-updating method of claim 1-4, it is characterized in that the said quantity that Updates Information reaches predetermined value, carry out once said renewal operation.
10. data-updating method as claimed in claim 1; It is characterized in that; Also be included in the said local disk and create the disk buffering district, data updated and item of information thereof are loaded in the said disk buffering district, the data in the said disk buffering district are identical with data in the said memory cache district.
11. data-updating method as claimed in claim 1 is characterized in that, said local disk is the hard disk of comparison server, and said physical memory is the internal memory of said comparison server.
12. data-updating method as claimed in claim 1 is characterized in that, said data behaviour face characteristic or fingerprint characteristic data, and the item of information of said data comprises sex, age and zone.
13. a data update apparatus of comparing in the system is characterized in that, comprising:
Create the unit, in order in physical memory, to create the memory cache district;
Loading unit is in order to be loaded into data updated and item of information thereof in the said memory cache district;
Search unit is in order to search corresponding current index in local disk according to said item of information;
Updating block is in order to upgrade operation.
14. data update apparatus as claimed in claim 13; It is characterized in that; Said data updated is a characteristic newly-increased in the database, and then said updating block is loaded into the data in the said memory cache district and item of information thereof in the said local disk becomes characteristic.
15. data update apparatus as claimed in claim 13; It is characterized in that; Said data updated is an amended characteristic in the said local disk, and then said updating block substitutes the former characteristic in the said local disk with the data in the said memory cache district.
16. data update apparatus as claimed in claim 13 is characterized in that, said data updated is a characteristic to be deleted in the said local disk, and then said updating block is deleted characteristic to be deleted in the said local disk and item of information thereof.
17. like each described data update apparatus of claim 13-16, it is characterized in that, also comprise:
Converting unit converts the numeric type information data in order to the item of information with data;
Sequencing unit is in order to sort to said data according to said numeric type information data;
Operating unit is current index in order to the concordance list of creating the data after correspondence sorts.
18. data update apparatus as claimed in claim 14 is characterized in that, said data updated is a characteristic newly-increased in the database, then:
Said converting unit also converts the numeric type information data in order to the item of information with said newly-increased characteristic;
Said operating unit is also in order to insert said numeric type information data in the current index.
19. data update apparatus as claimed in claim 16 is characterized in that, said data updated is a characteristic to be deleted in the said local disk, then:
Said converting unit also converts the numeric type information data in order to the item of information with characteristic said to be deleted;
Said operating unit also in order in said current index, searching the corresponding key assignments of said numeric type information data, and is deleted said key assignments corresponding in the current index.
20., it is characterized in that like each described data update apparatus of claim 13-16, also comprise control module, regularly carry out once said renewal operation in order to control said updating block.
21., it is characterized in that like each described data update apparatus of claim 13-16, also comprise control module, in order to when the said quantity that Updates Information reaches predetermined value, control said updating block and carry out once said renewal operation.
22. data update apparatus as claimed in claim 13; It is characterized in that; Also be included in and create the disk buffering district in the said local disk; Said loading unit is loaded into data updated and item of information thereof in the said disk buffering district, and the data in the said disk buffering district are identical with data in the said memory cache district.
23. data update apparatus as claimed in claim 13 is characterized in that, said local disk is the hard disk of comparison server, and said physical memory is the internal memory of said comparison server.
24. data update apparatus as claimed in claim 13 is characterized in that, said data behaviour face characteristic or fingerprint characteristic data, and the item of information of said data comprises sex, age and zone.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110001856.7A CN102591864B (en) | 2011-01-06 | 2011-01-06 | Data updating method and device in comparison system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201110001856.7A CN102591864B (en) | 2011-01-06 | 2011-01-06 | Data updating method and device in comparison system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102591864A true CN102591864A (en) | 2012-07-18 |
| CN102591864B CN102591864B (en) | 2015-03-25 |
Family
ID=46480533
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201110001856.7A Expired - Fee Related CN102591864B (en) | 2011-01-06 | 2011-01-06 | Data updating method and device in comparison system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102591864B (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104021161A (en) * | 2014-05-27 | 2014-09-03 | 华为技术有限公司 | Cluster storage method and device |
| CN104978344A (en) * | 2014-04-09 | 2015-10-14 | 华为技术有限公司 | Data operation method and device |
| CN106021301A (en) * | 2016-05-05 | 2016-10-12 | 北京思特奇信息技术股份有限公司 | Comparing system and method for data having different file formats |
| CN106570036A (en) * | 2015-10-13 | 2017-04-19 | 北京国双科技有限公司 | Data adding method and device based on HBase database |
| CN104008067B (en) * | 2013-02-21 | 2017-05-31 | 联动优势科技有限公司 | A kind of method and device of data storage |
| CN108205543A (en) * | 2016-12-16 | 2018-06-26 | 北京酷我科技有限公司 | A kind of song information storage method and system |
| CN108647269A (en) * | 2018-04-28 | 2018-10-12 | 郑州云海信息技术有限公司 | A method of management storage device data variation |
| CN110109954A (en) * | 2018-01-22 | 2019-08-09 | 腾讯科技（深圳）有限公司 | Data processing method, system, electronic equipment and storage medium |
| CN110168532A (en) * | 2017-05-09 | 2019-08-23 | 华为技术有限公司 | Data-updating method and storage device |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101110088A (en) * | 2007-04-17 | 2008-01-23 | 南京中兴软创科技有限责任公司 | Database access interface method based on caching technology |
| US20080201140A1 (en) * | 2001-07-20 | 2008-08-21 | Gracenote, Inc. | Automatic identification of sound recordings |
| CN101350030A (en) * | 2007-07-20 | 2009-01-21 | 株式会社东芝 | Method and apparatus for caching data |
-
2011
- 2011-01-06 CN CN201110001856.7A patent/CN102591864B/en not_active Expired - Fee Related
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080201140A1 (en) * | 2001-07-20 | 2008-08-21 | Gracenote, Inc. | Automatic identification of sound recordings |
| CN101110088A (en) * | 2007-04-17 | 2008-01-23 | 南京中兴软创科技有限责任公司 | Database access interface method based on caching technology |
| CN101350030A (en) * | 2007-07-20 | 2009-01-21 | 株式会社东芝 | Method and apparatus for caching data |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104008067B (en) * | 2013-02-21 | 2017-05-31 | 联动优势科技有限公司 | A kind of method and device of data storage |
| CN104978344A (en) * | 2014-04-09 | 2015-10-14 | 华为技术有限公司 | Data operation method and device |
| CN104978344B (en) * | 2014-04-09 | 2018-11-20 | 华为技术有限公司 | A kind of data operating method and device |
| CN104021161A (en) * | 2014-05-27 | 2014-09-03 | 华为技术有限公司 | Cluster storage method and device |
| US10817258B2 (en) | 2014-05-27 | 2020-10-27 | Huawei Technologies Co., Ltd. | Clustering storage method and apparatus |
| CN106570036A (en) * | 2015-10-13 | 2017-04-19 | 北京国双科技有限公司 | Data adding method and device based on HBase database |
| CN106570036B (en) * | 2015-10-13 | 2019-11-12 | 北京国双科技有限公司 | Data adding method and device based on HBase database |
| CN106021301A (en) * | 2016-05-05 | 2016-10-12 | 北京思特奇信息技术股份有限公司 | Comparing system and method for data having different file formats |
| CN108205543A (en) * | 2016-12-16 | 2018-06-26 | 北京酷我科技有限公司 | A kind of song information storage method and system |
| CN110168532A (en) * | 2017-05-09 | 2019-08-23 | 华为技术有限公司 | Data-updating method and storage device |
| CN110168532B (en) * | 2017-05-09 | 2021-08-20 | 华为技术有限公司 | Data updating method and storage device |
| CN110109954A (en) * | 2018-01-22 | 2019-08-09 | 腾讯科技（深圳）有限公司 | Data processing method, system, electronic equipment and storage medium |
| CN110109954B (en) * | 2018-01-22 | 2023-05-26 | 腾讯科技（深圳）有限公司 | Data processing method, system, electronic device and storage medium |
| CN108647269A (en) * | 2018-04-28 | 2018-10-12 | 郑州云海信息技术有限公司 | A method of management storage device data variation |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102591864B (en) | 2015-03-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102591864A (en) | Data updating method and device in comparison system | |
| US11474972B2 (en) | Metadata query method and apparatus | |
| CN107003935B (en) | Apparatus, method and computer medium for optimizing database deduplication | |
| CN102541927B (en) | Method and device for realizing data cache | |
| CN102629247B (en) | Method, device and system for data processing | |
| CN111949710B (en) | Data storage method, device, server and storage medium | |
| CN103902623A (en) | Method and system for accessing files on a storage system | |
| US8225060B2 (en) | Data de-duplication by predicting the locations of sub-blocks within the repository | |
| CN104268159A (en) | Real-time data warehouse data pre-storage and pre-access method based on dynamic mirrors | |
| CN104794228A (en) | Search result providing method and device | |
| CN113901279B (en) | Graph database retrieval method and device | |
| US11507277B2 (en) | Key value store using progress verification | |
| CN104156396A (en) | Method and system for improving database performance in big-data environment | |
| CN104933051A (en) | File storage space recovery method and device | |
| EP3343395B1 (en) | Data storage method and apparatus for mobile terminal | |
| US11080239B2 (en) | Key value store using generation markers | |
| CN104598652A (en) | Database inquiry method and database inquiry device | |
| CN110633318A (en) | Data extraction processing method, device, equipment and storage medium | |
| CN108205559B (en) | Data management method and equipment thereof | |
| CN116450607A (en) | Data processing method, device and storage medium | |
| CN103354926B (en) | Memory controller | |
| CN114297196A (en) | Metadata storage method and device, electronic equipment and storage medium | |
| CN113157716A (en) | Data processing method, device, equipment and medium | |
| CN107622124B (en) | Data query method and system based on block data | |
| CN113297202B (en) | Data type change processing method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20150325 Termination date: 20200106 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |