CN106815267A - Date storage method and device - Google Patents
Date storage method and device Download PDFInfo
- Publication number
- CN106815267A CN106815267A CN201510870576.8A CN201510870576A CN106815267A CN 106815267 A CN106815267 A CN 106815267A CN 201510870576 A CN201510870576 A CN 201510870576A CN 106815267 A CN106815267 A CN 106815267A
- Authority
- CN
- China
- Prior art keywords
- field
- data
- stored
- conversion
- character map
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2455—Query execution
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Computational Linguistics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The present invention relates to a kind of date storage method, including：Obtain character map, character map stores index field and corresponding conversion field and each conversion field is unique, converts the length of the length less than index field of field；Judge in character map with the presence or absence of the target index field with the first Data Matching to be stored, if, the corresponding targeted transformation field of target index field is then obtained, the partial replacement that the first data to be stored are matched with target index field is stored in database for targeted transformation field；If in the absence of the index field with the first Data Matching to be stored in character map, then obtain first and convert field, set up the first data to be stored and be stored in character map with the corresponding relation of the first conversion field, first conversion field is stored in database, improve the storage performance of data, additionally, additionally providing a kind of data storage device.
Description
Technical field
The present invention relates to technical field of data storage, more particularly to a kind of date storage method and device.
Background technology
With the development of computer communication technology, the application of every field is required for entering substantial amounts of data message
Row storage, storage is in database typically in the form of tables of data.Such as core network element management system (Element
Management System, abbreviation EMS) substantial amounts of network element performance data are stored by performance data table.
Tables of data generally constitutes index by multiple String fields long in practical work, takes a large amount of storages empty
Between.And when in database manipulation, such as inquiring about, insert, deleting, updating, it is necessary to index is read
Take and update, produce large-scale input and export, consume Installed System Memory, cause systematic function bottleneck.
The content of the invention
Based on this, it is necessary to for above-mentioned technical problem, there is provided a kind of date storage method and device, improve
The storage performance of data.
A kind of date storage method, methods described includes：
Obtain character map, the character map stores index field and corresponding conversion field and each
Individual conversion field is unique, the length of the length less than the index field of the conversion field；
Judge with the presence or absence of the target index field with the first Data Matching to be stored in the character map,
If it is, the corresponding targeted transformation field of the target index field is obtained, by the described first number to be stored
According to the partial replacement matched with target index field for the targeted transformation field is stored in database；
If obtained in the absence of the index field with the first Data Matching to be stored in the character map
First conversion field, set up the first data to be stored be stored in the corresponding relation of the described first conversion field it is described
Character map, database is stored in by the described first conversion field.
Wherein in one embodiment, the conversion field is numeric type.
Wherein in one embodiment, methods described also includes：
Obtain the second data to be stored, corresponding second preset attribute of the data to be stored of acquisition described second；
If existed in generating the preset attribute of the conversion field in the character map default with described second
Attribute identical objective attribute target attribute, the then corresponding index field of conversion field for generating the objective attribute target attribute updates
It is the described second data to be stored.
Wherein in one embodiment, the index field is the overall identification of network element, and the preset attribute is
The IP drawn games number of network element.
Wherein in one embodiment, methods described also includes：
When data are inquired about, judge to whether there is the search index with Data Matching to be checked in character map
Field, if it is, the corresponding inquiry conversion field of the search index field is obtained, will be described to be checked
Data are inquired about with the partial replacement of search index fields match for the inquiry converts field.
A kind of data storage device, described device includes：
Acquisition module, for obtaining character map, the character map store index field with it is corresponding
Conversion field and each conversion field is unique, the length of the length less than the index field of the conversion field
Degree；
Judge module, for judging to whether there is and the first Data Matching to be stored in the character map
Target index field, if it is, into the first memory module, otherwise, into the second memory module；
First memory module, for obtaining the corresponding targeted transformation field of the target index field, will be described
The partial replacement that first data to be stored are matched with target index field is stored in data for the targeted transformation field
Storehouse；
Second memory module, field is converted for obtaining first, sets up the first data to be stored and described first
The corresponding relation for converting field is stored in the character map, and the described first conversion field is stored in into database.
Wherein in one embodiment, the conversion field is numeric type.
Wherein in one embodiment, the first conversion field is corresponding pre- by the described first data to be stored
If attribute is generated by preset rules, described device also includes：
Update module, for obtaining the second data to be stored, obtains second data to be stored corresponding the
Two preset attributes, if exist in generating the preset attribute of the conversion field in the character map with it is described
Second preset attribute identical objective attribute target attribute, the then corresponding index of conversion field for generating the objective attribute target attribute
Field is updated to the described second data to be stored.
Wherein in one embodiment, the index field is the overall identification of network element, and the preset attribute is
The IP drawn games number of network element.
Wherein in one embodiment, described device also includes：
Enquiry module, for when data are inquired about, judging to whether there is and data to be checked in character map
The search index field of matching, if it is, the corresponding inquiry conversion field of the search index field is obtained,
The data to be checked are looked into the partial replacement of search index fields match for the inquiry converts field
Ask.
Above-mentioned date storage method and device, by storing each, to convert field different, index field with turn
Change the corresponding character map of field, first judge to whether there is and the first data to be stored in character map
The target index field matched somebody with somebody, if it is, obtain the corresponding targeted transformation field of target index field, by the
The partial replacement that one data to be stored are matched with target index field is stored in database for targeted transformation field, such as
In the absence of the index field with the first Data Matching to be stored in fruit character map, then obtain first and convert word
Section, sets up the first data to be stored and is stored in the character map with the corresponding relation of the first conversion field, will
First conversion field is stored in database, because the length of targeted transformation field is less than target index field, so
The data length for being stored in database is short, greatly reduces memory space, improves the performance of data storage.
Brief description of the drawings
Fig. 1 is the flow chart of date storage method in one embodiment；
Fig. 2 is the schematic diagram of data storage procedure in one embodiment；
Fig. 3 is the flow chart updated the data in one embodiment；
Fig. 4 is the schematic diagram of inquiry data procedures in one embodiment；
Fig. 5 is the structured flowchart of data storage device in one embodiment；
Fig. 6 is the structured flowchart of data storage device in another embodiment；
Fig. 7 is the structured flowchart of data storage device in further embodiment.
Specific embodiment
In one embodiment, as shown in Figure 1, there is provided a kind of date storage method, including：
Step S110, obtains character map, and character map stores index field with corresponding conversion word
Section and each conversion field is unique, converts the length of the length less than index field of field.
Specifically, when application system starts, the existing character map of character string maps module loading is stored in
Index field and corresponding conversion field are have recorded in caching, in character map, index field can be character
String, numerical string, conversion field can be character string, numerical value smaller than index field length etc..Character map
In each conversion field it is different, be all unique, it is ensured that uniqueness and accuracy during data query.
In one embodiment, conversion field is numeric type, using numerical value as conversion field, numeric type number
It is small according to memory space and search efficiency is high.When the corresponding relation between index field and conversion field is set up,
The mode that can be incremented by according to numerical value generates conversion field.
Step S120, judges to be indexed with the presence or absence of the target with the first Data Matching to be stored in character map
Field, if it is, into step S130, otherwise into step S140.
Specifically, matching includes that matching completely and part match, completely matching refer to the first data to be stored with
Certain target index field in character map is identical, during part matching refers to the first data to be stored
Part continuation field it is identical with target index field, such as the first data to be stored prefix or suffix with
Target index field is identical.
Step S130, obtains the corresponding targeted transformation field of target index field, by the first data to be stored with
The partial replacement of target index field matching is stored in database for targeted transformation field.
If specifically, there is target index field and the first Data Matching to be stored in character map,
Corresponding relation according to index field and conversion field obtains the corresponding targeted transformation field of target index field,
When data loading is carried out, the partial replacement that will be matched with target index field in the first data to be stored is mesh
Mark conversion field is stored in database.If matched completely with target index field in the first data to be stored,
When the first data to be stored are stored, directly target index field is stored in.If the first number to be stored
Matched with target index field part in, then the partial replacement that will be matched is target index field, remaining
Part keeps constant and is stored in database.In one embodiment, the position to be stored of the first data to be stored is judged
Put, when position to be stored meets pre-conditioned, be just replaced, if be unsatisfactory for it is pre-conditioned, no
It is replaced.Such as relating to the NEDN (overall identification of network element) in the tables of data of resource packet and resource authentication
It is not replaced in storage with MODN (overall identification of measurement object), directly stores initial data.
Step S140, if in the absence of the index field with the first Data Matching to be stored in character map,
Then obtain first and convert field, set up the first data to be stored and be stored in word with the corresponding relation of the first conversion field
Symbol mapping table, database is stored in by the first conversion field.
Specifically, the create-rule of the first conversion field can be self-defined as needed, such as when the first conversion field
During for letter, generation can be in alphabetical order arranged in order.The generation of the first conversion field can be with number to be stored
According to preset attribute it is related.Such as when data to be stored are network element ID or measurement object is identified, preset attribute
Can be the corresponding IP of network element (Internet Protocol, the agreement interconnected between network) and/or office number, wherein
IP refers to IP address.When the corresponding relation of the first data to be stored and the first conversion field is set up, can set
Default set up the condition, judges whether the first data to be stored are to meet pre-conditioned corresponding relation to be set up
Data, if it is not, then directly being stored, default set up the condition may be defined as string length and exceed in advance
If length, or the first packet to be stored is defined containing default character string etc..Only meet default set up the condition
Data to be stored can just set up corresponding relation, for directly storage will not also occupy too many resource in the case of,
Such as the data that length is shorter or numeric type occupies little space, it is not necessary to set up corresponding relation, improve and set up right
The validity that should be related to.In one embodiment, if the first data to be stored have the character of preset format
String, then extract the character string of preset format in the first data to be stored, the word of the preset format that foundation is extracted
The corresponding relation of symbol string and the first conversion field, the character string of preset format can in tables of data occurrence number compared with
Many character strings, extracting part preset format character string carries out setting up corresponding relation, on the one hand reduces word
Accord with mapping table occupies space, on the other hand because the preset format character string frequency of occurrences is high so that character reflects
The availability of firing table is higher.When setting up corresponding relation for extracting partial data, in storage, will carry
Take partial data and replaced by the first conversion field and be stored in database, other parts keep that initial data is constant to deposit
Enter database.
In the present embodiment, field difference is converted by storing each, index field is corresponding with conversion field
Character map, first judges to be indexed with the presence or absence of the target with the first Data Matching to be stored in character map
Field, if it is, the corresponding targeted transformation field of target index field is obtained, by the first data to be stored
The partial replacement matched with target index field is stored in database for targeted transformation field, if character map
In in the absence of index field with the first Data Matching to be stored, then obtain first and convert field, set up first
Data to be stored are stored in the character map with the corresponding relation of the first conversion field, and field is converted by first
Database is stored in, because the length of targeted transformation field is less than target index field, so being stored in database
Data length is short, greatly reduces memory space, improves the performance of data storage.
In a specific embodiment, shown in storing process combination Fig. 2, index field in character map
It is character string, conversion field is numerical value, when data loading is carried out, first loads character map slow to application
The conversion word that there is corresponding relation is searched whether in depositing, then in incoming character string to be stored to character map
Section, if there is then returning to numerical value, and is stored in application database by numerical value.If it does not exist, then will wait to deposit
The character string of storage is corresponding with the new numerical value of generation, and corresponding relation is stored in caching into simultaneously persistence.
In one embodiment, the first conversion field by the corresponding preset attribute of the first data to be stored by pre-
If rule generation, as shown in figure 3, method also includes：
Step S210, obtains the second data to be stored, obtains the second data to be stored corresponding second and presets category
Property.
Specifically, preset attribute can be self-defined as needed, such as when having identical between different data to be stored
Corresponding preset attribute when, the size of conversion field is determined according to preset attribute, can by preset attribute,
When updating the data storage of identical preset attribute, without changing the tables of data of storage, only with modification number to be stored
The storage of new data storage can be completed according to the corresponding relation with conversion field.Conversion field is by number to be stored
According to corresponding preset attribute by preset rules generate, different data storages if identical preset attribute,
Then their conversion field is identical.
Step S220, if in the presence of pre- with second in the preset attribute of conversion field in generation character map
If attribute identical objective attribute target attribute, then the corresponding index field of conversion field that objective attribute target attribute is generated is updated to
Second data to be stored.
If specifically, the second preset attribute with generation character map in conversion field preset attribute in
There is identical, then need not update the data the tables of data in storehouse, it is only necessary to by the conversion in character map
Index corresponding with the conversion field of second preset attribute identical that attribute generation in the preset attribute of field
Field is updated to the second data to be stored, just completes the renewal of data.In generation character map is judged
Conversion field preset attribute in whether there is during with the second preset attribute identical objective attribute target attribute, can first root
Field is converted according to preset rules generation second according to the second preset attribute, then is searched and the in character map
Two conversion field identical conversion fields, if identical, illustrate to generate the preset attribute of this conversion field
It is identical with the second preset attribute.
In one embodiment, index field is the overall identification of network element, and preset attribute is the IP drawn games of network element
Number.
Specifically, core network element management system (Element Management System, EMS) is each
In network element performance table data store, typically there is an overall identification (NEDN) of network element, the time started, granularity,
The public fields such as the overall identification (MODN) of measurement object, and some countings of each measurement type correspondence
The proprietary field composition of device.NEDN and MODN is for character string and length is more long, and MODN is by NE
The parts of DN+ object type ID+ measurement objects ID tri- are constituted, and such as the actual value of NEDN is cn.wcn:OMM
OID=ig1tbavh-e:Elementid=1, and the actual value of MODN is cn.wcn:OMMOID=ig1tbavh
-e:Elementid=1, motype=cn.wcn.cs.50221:Moid=1.Other fields are usually numerical value in tables of data
Type or date type, for some field less data tables, NEDN and MODN may account for one record
More than 30% memory space.The joint index field of performance data table is generally NEDN, MODN, beginning
Time, granularity and the less field composition of other width, at this moment NEDN and MODN memory spaces account for rope
Draw more than the 60% of memory space.And have a large amount of NEDN and MODN for repeating in performance data table.So
The overall identification (NEDN) of network element is set to index field, when storage NEDN is needed, it is only necessary to
Search whether there is corresponding conversion field in tables of data is mapped, if it is present will directly convert field
Tables of data is stored in, such as conversion field is 1, then be stored in the data of database just by cn.wcn:OMMOID=ig1t
bavh-e:Elementid=1 replaces with 1, greatly reduces the memory space of occupancy.And for needing storage
MODN is NEDN due to its prefix, then can first extract NEDN in storage, then in mapping data
Search whether there is corresponding conversion field in table, if it is present will be corresponding with NEDN with MODN
Partial replacement be corresponding conversion field, other parts by initial data store.
Preset attribute is the IP drawn games number of network element, because usually needing to the NEDN in History Performance Data table
It is updated with MODN and is migrated, and in renewal and migration, in many cases NEDN and MODN
Do not changed after the IP drawn games number before the update of corresponding network element, so the IP drawn games number of network element are set
It is preset attribute, conversion field is generated according to the IP drawn games number of network element, changes in NEDN and MODN
In the case of, because the IP drawn games number of network element are not changed, so when table is updated the data, data can be kept
Conversion field in table is constant, it is only necessary to the corresponding index word of conversion field for generating the IP drawn games number of network element
Section is updated to new NEDN by old NEDN.
The situation for being updated and migrating with reference to 3 kinds of NEDN and MODN is specifically described：
Situation 1, network element supports the change of subtype, with the function meeting that the exploitation of Network Element Function, network element are supported
It is more and more, the network element subtype of network element may be changed, cause network management system to have to connect network element again
Enter.
Situation 2, EMS system dilatation and EMS edition upgradings, user's network element system increase cause network management system
Dilatation is needed, NM server originally needs more resources, such as internal memory, CPU and hard disk, and original
Server limited due to mainboard, it is impossible to carry out dilatation, it is necessary to which new clothes configure machine higher, if EMS
System need not upgrade, then can use cold standby, and EMS system file and oracle data files are replicated
Onto new engine, but majority of case needs EMS and could support that more network elements are accessed while upgrading, at this moment
Generally require and EMS is reinstalled on new engine, carry out basic data recovery, original performance data is carried out
Data Migration.
Situation 3, each specialty net EMS merges, and the EMS system of each specialty net is merged into a unification
EMS system centralized management, have to migrate for History Performance Data.
Three cases above must all be deleted existing network element on EMS and accessed again, but the history of user
Performance data can not lose.Network element is once accessed again, and NEDN will change, it is necessary to by after change
NEDN and MODN replaces the NEDN and MODN before changing.But data volume is larger, individual table may
It is several ten million bars record, typically there are a few thousand sheets tables, if may be needed using traditional whole transition process of method
Continue one week or so.
The IP drawn games number of network element are set to preset attribute, then in migrating data, first obtain new NEDN
The IP drawn games number of corresponding network element, judge that new NEDN needs the position of storage, if in being related to resource
In the tables of data of packet and resource authentication, then directly stored.If it is not, then first according to the IP of network element
Drawn game number generates corresponding conversion field according to preset rules, is such as 1, then lookup value is in character map
1 conversion field, is updated to the original corresponding index field of conversion field that value is 1 new NEDN and builds
Vertical new corresponding relation.If new NEDN is cn.wcn:OMMOID=ig1tbavh-e:Elementid=1,
Then by cn.wcn:OMMOID=ig1tbavh-e:Elementid=1 carries out corresponding with 1.New MODN is cn.
wcn:OMMOID=ig1tbavh-e:Elementid=1, motype=cn.wcn.cs.50221:Moid=1, then in number
The part repeated with NEDN is directly set to 1 according in the table of storehouse, other parts are only stored.Can manage
Solution, after new character mapping relations are established, can carry out persistence by new character mapping, such as deposit
Enter non-volatile memory medium so that in data query or when powering off, can also get character map.It is logical
The migration that this method is carried out is crossed, when the IP drawn games number of network element do not change, it is only necessary to set up new mapping and close
System, and the conversion field in raw data table does not change, greatly reduces the data of migration, both saves
Performance data files memory space about 20%-30%, performance data index file memory space about 60%, and energy
Improve data loading efficiency and search efficiency.When being migrated, the instrument that directly can be carried with oracle
First the History Performance Data table before migration is derived, then is introduced directly into order and imported in present EMS tables of data,
Such as imp cn_pm/xxx@ems_yyyy tables=zzz ignore=y, efficiency is drastically increased.
In one embodiment, method also includes：When data are inquired about, judge whether deposited in character map
In the search index field with Data Matching to be checked, if it is, obtaining, search index field is corresponding to be looked into
Conversion field is ask, data to be checked are entered with the partial replacement of search index fields match for inquiry converts field
Row inquiry.
Specifically, matching includes that matching completely and part match, matching refers to data to be checked and character completely
Certain index field in mapping table is identical, and part matching is the part continuation field in data to be checked
Identical with index field, the prefix or suffix of such as data to be checked is identical with search index field.
If there is the search index field of matching, then corresponding inquiry conversion field is obtained, because being stored in database
What Shi Shiji was stored in is conversion field, so be also first to obtain inquiry conversion field when being inquired about, then
Inquired about according to inquiry conversion field.If matching completely, then field is directly converted by corresponding inquiry
Inquired about, if part matches, then inquiry conversion field generation is used in the part that will be matched in data to be checked
Replace, other data are constant to be inquired about.Because the length for converting field is less than index field, so after conversion
Search index length it is shorter, can improve inquiry efficiency.
In a specific embodiment, the process of data is inquired about as shown in figure 4, first incoming word to be checked
In symbol string to application cache, search whether there is corresponding conversion field in the character map of application cache,
If there is numerical value is then returned, with the numerical value for returning as the index field in querying condition in application database
Middle inquiry obtains corresponding Query Result.
In one embodiment, as shown in Figure 5, there is provided a kind of data storage device, including：
Acquisition module 310, for obtaining character map, character map store index field with it is corresponding
Convert field and each conversion field is unique, convert the length of the length less than the index field of field.
Judge module 320, for judging in character map with the presence or absence of the mesh with the first Data Matching to be stored
Mark index field, if it is, into the first memory module, otherwise, into the second memory module.
First memory module 330, for obtaining the corresponding targeted transformation field of target index field, first is treated
The partial replacement that data storage is matched with target index field is stored in database for targeted transformation field.
Second memory module 340, field is converted for obtaining first, sets up the first data to be stored with first turn
The corresponding relation for changing field is stored in character map, and the first conversion field is stored in into database.
In one embodiment, conversion field is numeric type.
In one embodiment, the first conversion field by the corresponding preset attribute of the first data to be stored by pre-
If rule generation, as shown in fig. 6, device also includes：
Update module 350, for obtaining the second data to be stored, obtains the second data to be stored corresponding second
Preset attribute, if existed in the preset attribute of conversion field in generation character map and second default belongs to
Property identical objective attribute target attribute, then by objective attribute target attribute generate the corresponding index field of conversion field be updated to second
Data to be stored.
In one embodiment, index field is the overall identification of network element, and the preset attribute is the IP of network element
Drawn game number.
In one embodiment, as shown in fig. 7, device also includes：
Enquiry module 360, for when data are inquired about, judging to whether there is and number to be checked in character map
According to the search index field of matching, if it is, the corresponding inquiry conversion field of search index field is obtained,
Data to be checked are inquired about with the partial replacement of search index fields match for inquiry converts field.
One of ordinary skill in the art will appreciate that all or part of flow in realizing above-described embodiment method,
Computer program be can be by instruct the hardware of correlation to complete, described program can be stored in a computer
In read/write memory medium, such as in the embodiment of the present invention, the storage that the program can be stored in computer system is situated between
In matter, and by least one of computer system computing device, to realize including such as above-mentioned each method
Embodiment flow.Wherein, the storage medium can be magnetic disc, CD, read-only memory
(Read-Only Memory, ROM) or random access memory (Random Access Memory, RAM)
Deng.
Each technical characteristic of embodiment described above can be combined arbitrarily, not right to make description succinct
The all possible combination of each technical characteristic in above-described embodiment is all described, as long as however, these skills
The combination of art feature does not exist contradiction, is all considered to be the scope of this specification record.
Embodiment described above only expresses several embodiments of the invention, and its description is more specific and detailed,
But can not therefore be construed as limiting the scope of the patent.It should be pointed out that for this area
For those of ordinary skill, without departing from the inventive concept of the premise, some deformations can also be made and changed
Enter, these belong to protection scope of the present invention.Therefore, the protection domain of patent of the present invention should be with appended power
Profit requires to be defined.
Claims (10)
1. a kind of date storage method, methods described includes：
Obtain character map, the character map stores index field and corresponding conversion field and each
Individual conversion field is unique, the length of the length less than the index field of the conversion field；
Judge with the presence or absence of the target index field with the first Data Matching to be stored in the character map,
If it is, the corresponding targeted transformation field of the target index field is obtained, by the described first number to be stored
According to the partial replacement matched with target index field for the targeted transformation field is stored in database；
If obtained in the absence of the index field with the first Data Matching to be stored in the character map
First conversion field, set up the first data to be stored be stored in the corresponding relation of the described first conversion field it is described
Character map, database is stored in by the described first conversion field.
2. method according to claim 1, it is characterised in that the conversion field is numeric type.
3. method according to claim 1, it is characterised in that the first conversion field is by described the
The corresponding preset attribute of one data to be stored is generated by preset rules, and methods described also includes：
Obtain the second data to be stored, corresponding second preset attribute of the data to be stored of acquisition described second；
If existed in generating the preset attribute of the conversion field in the character map default with described second
Attribute identical objective attribute target attribute, the then corresponding index field of conversion field for generating the objective attribute target attribute updates
It is the described second data to be stored.
4. method according to claim 3, it is characterised in that the index field is the overall situation of network element
Mark, the preset attribute is the IP drawn games number of network element.
5. method according to claim 1, it is characterised in that methods described also includes：
When data are inquired about, judge to whether there is the search index with Data Matching to be checked in character map
Field, if it is, the corresponding inquiry conversion field of the search index field is obtained, will be described to be checked
Data are inquired about with the partial replacement of search index fields match for the inquiry converts field.
6. a kind of data storage device, it is characterised in that described device includes：
Acquisition module, for obtaining character map, the character map store index field with it is corresponding
Conversion field and each conversion field is unique, the length of the length less than the index field of the conversion field
Degree；
Judge module, for judging to whether there is and the first Data Matching to be stored in the character map
Target index field, if it is, into the first memory module, otherwise, into the second memory module；
First memory module, for obtaining the corresponding targeted transformation field of the target index field, will be described
The partial replacement that first data to be stored are matched with target index field is stored in data for the targeted transformation field
Storehouse；
Second memory module, field is converted for obtaining first, sets up the first data to be stored and described first
The corresponding relation for converting field is stored in the character map, and the described first conversion field is stored in into database.
7. device according to claim 6, it is characterised in that the conversion field is numeric type.
8. device according to claim 6, it is characterised in that the first conversion field is by described the
The corresponding preset attribute of one data to be stored is generated by preset rules, and described device also includes：
Update module, for obtaining the second data to be stored, obtains second data to be stored corresponding the
Two preset attributes, if exist in generating the preset attribute of the conversion field in the character map with it is described
Second preset attribute identical objective attribute target attribute, the then corresponding index of conversion field for generating the objective attribute target attribute
Field is updated to the described second data to be stored.
9. device according to claim 8, it is characterised in that the index field is the overall situation of network element
Mark, the preset attribute is the IP drawn games number of network element.
10. device according to claim 6, it is characterised in that described device also includes：
Enquiry module, for when data are inquired about, judging to whether there is and data to be checked in character map
The search index field of matching, if it is, the corresponding inquiry conversion field of the search index field is obtained,
The data to be checked are looked into the partial replacement of search index fields match for the inquiry converts field
Ask.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510870576.8A CN106815267A (en) | 2015-12-01 | 2015-12-01 | Date storage method and device |
| PCT/CN2016/098453 WO2017092470A1 (en) | 2015-12-01 | 2016-09-08 | Data storage method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510870576.8A CN106815267A (en) | 2015-12-01 | 2015-12-01 | Date storage method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106815267A true CN106815267A (en) | 2017-06-09 |
Family
ID=58796205
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510870576.8A Withdrawn CN106815267A (en) | 2015-12-01 | 2015-12-01 | Date storage method and device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN106815267A (en) |
| WO (1) | WO2017092470A1 (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108388598A (en) * | 2018-02-01 | 2018-08-10 | 平安科技（深圳）有限公司 | Electronic device, date storage method and storage medium |
| CN109558404A (en) * | 2018-10-19 | 2019-04-02 | 中国平安人寿保险股份有限公司 | Date storage method, device, computer equipment and storage medium |
| CN111078682A (en) * | 2019-10-17 | 2020-04-28 | 贝壳技术有限公司 | Service data index construction method and system |
| WO2020215558A1 (en) * | 2019-04-26 | 2020-10-29 | 平安科技（深圳）有限公司 | Data storage method, data query method, apparatus and device and storage medium |
| CN111897818A (en) * | 2020-07-31 | 2020-11-06 | 平安普惠企业管理有限公司 | Data storage method and device, electronic equipment and storage medium |
| CN112256691A (en) * | 2019-07-22 | 2021-01-22 | 珠海金山办公软件有限公司 | Data mapping method and device and electronic equipment |
| CN112579623A (en) * | 2019-09-29 | 2021-03-30 | 北京国双科技有限公司 | Method, device, storage medium and equipment for storing data |
| CN112597248A (en) * | 2020-12-26 | 2021-04-02 | 中国农业银行股份有限公司 | Big data partition storage method and device |
| CN113722286A (en) * | 2020-05-26 | 2021-11-30 | 杭州海康威视数字技术股份有限公司 | Space-time data compression method, device, server and storage medium |
| CN114491137A (en) * | 2022-02-15 | 2022-05-13 | 平安科技（深圳）有限公司 | Data storage method, related device and medium |
| CN114513552A (en) * | 2022-01-06 | 2022-05-17 | 中信百信银行股份有限公司 | Data processing method, device, equipment and storage medium |
Families Citing this family (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111274586B (en) * | 2018-12-04 | 2024-04-05 | 北京京东尚科信息技术有限公司 | Method and device for storing data |
| CN110222048B (en) * | 2019-05-06 | 2023-06-23 | 平安科技（深圳）有限公司 | Sequence generation method, device, computer equipment and storage medium |
| CN111599420B (en) * | 2020-04-27 | 2023-09-26 | 苏州创腾软件有限公司 | Database storage and retrieval method, device and system for axial chiral compounds |
| CN113704346B (en) * | 2020-05-20 | 2024-06-04 | 杭州海康威视数字技术股份有限公司 | Hbase table cold-hot data conversion method and device and electronic equipment |
| CN112395293B (en) * | 2020-11-27 | 2024-03-01 | 浙江诺诺网络科技有限公司 | Database and table dividing method, database and table dividing device, database and table dividing equipment and storage medium |
| CN113902368A (en) * | 2021-10-12 | 2022-01-07 | 上海寻梦信息技术有限公司 | Information processing method, device, equipment and storage medium |
| CN115563187B (en) * | 2022-10-17 | 2023-08-04 | 中航信移动科技有限公司 | Data conversion method, storage medium and electronic equipment |
| CN115617819B (en) * | 2022-12-19 | 2023-03-14 | 思创数码科技股份有限公司 | Data storage method, system, computer device and storage medium |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040133581A1 (en) * | 2002-05-21 | 2004-07-08 | High-Speed Engineering Laboratory, Inc. | Database management system, data structure generating method for database management system, and storage medium therefor |
| CN1928850B (en) * | 2006-08-11 | 2011-04-13 | 白杰 | Method and apparatus for compressing data based on digital dictionary |
| CN102332030A (en) * | 2011-10-17 | 2012-01-25 | 中国科学院计算技术研究所 | Data storing, managing and inquiring method and system for distributed key-value storage system |
| CN104408192B (en) * | 2014-12-15 | 2017-12-19 | 北京国双科技有限公司 | The compression processing method and device of character string type row |
-
2015
- 2015-12-01 CN CN201510870576.8A patent/CN106815267A/en not_active Withdrawn
-
2016
- 2016-09-08 WO PCT/CN2016/098453 patent/WO2017092470A1/en active Application Filing
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108388598A (en) * | 2018-02-01 | 2018-08-10 | 平安科技（深圳）有限公司 | Electronic device, date storage method and storage medium |
| CN108388598B (en) * | 2018-02-01 | 2022-04-22 | 平安科技（深圳）有限公司 | Electronic device, data storage method, and storage medium |
| CN109558404A (en) * | 2018-10-19 | 2019-04-02 | 中国平安人寿保险股份有限公司 | Date storage method, device, computer equipment and storage medium |
| CN109558404B (en) * | 2018-10-19 | 2023-12-01 | 中国平安人寿保险股份有限公司 | Data storage method, device, computer equipment and storage medium |
| WO2020215558A1 (en) * | 2019-04-26 | 2020-10-29 | 平安科技（深圳）有限公司 | Data storage method, data query method, apparatus and device and storage medium |
| CN112256691A (en) * | 2019-07-22 | 2021-01-22 | 珠海金山办公软件有限公司 | Data mapping method and device and electronic equipment |
| CN112579623A (en) * | 2019-09-29 | 2021-03-30 | 北京国双科技有限公司 | Method, device, storage medium and equipment for storing data |
| CN111078682A (en) * | 2019-10-17 | 2020-04-28 | 贝壳技术有限公司 | Service data index construction method and system |
| CN113722286A (en) * | 2020-05-26 | 2021-11-30 | 杭州海康威视数字技术股份有限公司 | Space-time data compression method, device, server and storage medium |
| CN111897818A (en) * | 2020-07-31 | 2020-11-06 | 平安普惠企业管理有限公司 | Data storage method and device, electronic equipment and storage medium |
| CN112597248A (en) * | 2020-12-26 | 2021-04-02 | 中国农业银行股份有限公司 | Big data partition storage method and device |
| CN112597248B (en) * | 2020-12-26 | 2024-04-12 | 中国农业银行股份有限公司 | Big data partition storage method and device |
| CN114513552A (en) * | 2022-01-06 | 2022-05-17 | 中信百信银行股份有限公司 | Data processing method, device, equipment and storage medium |
| CN114513552B (en) * | 2022-01-06 | 2024-04-02 | 中信百信银行股份有限公司 | Data processing method, device, equipment and storage medium |
| CN114491137A (en) * | 2022-02-15 | 2022-05-13 | 平安科技（深圳）有限公司 | Data storage method, related device and medium |
| CN114491137B (en) * | 2022-02-15 | 2024-03-26 | 平安科技（深圳）有限公司 | Data storage method, related equipment and medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2017092470A1 (en) | 2017-06-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106815267A (en) | Date storage method and device | |
| CN104067216B (en) | System and method for implementing expansible data storage service | |
| CN102122285B (en) | Data cache system and data inquiry method | |
| EP2069979B1 (en) | Dynamic fragment mapping | |
| US9871727B2 (en) | Routing lookup method and device and method for constructing B-tree structure | |
| CN108009008A (en) | Data processing method and system, electronic equipment | |
| CN109977077A (en) | Model file storage method, device, readable storage medium storing program for executing and computer equipment | |
| CN104794123A (en) | Method and device for establishing NoSQL database index for semi-structured data | |
| WO2007041290A1 (en) | Method and system for creating an index arrangement for a directory | |
| CN101727502A (en) | Data query method, data query device and data query system | |
| CN107247734A (en) | A kind of distributed data base major key generation method and system | |
| JP3570323B2 (en) | How to store prefixes for addresses | |
| CN106407224A (en) | Method and device for file compaction in KV (Key-Value)-Store system | |
| US8015195B2 (en) | Modifying entry names in directory server | |
| CN104111924A (en) | Database system | |
| CN102298633A (en) | Method and system for investigating repeated data in distributed mass data | |
| CN106933836A (en) | A kind of date storage method and system based on point table | |
| CN106326040A (en) | Method and device for managing snapshot metadata | |
| CN102567419B (en) | Mass data storage device and method based on tree structure | |
| CN101963993B (en) | Method for fast searching database sheet table record | |
| CN105912696A (en) | DNS (Domain Name System) index creating method and query method based on logarithm merging | |
| KR100999408B1 (en) | Method for searching an ??? using hash tree | |
| CN111241090B (en) | Method and device for managing data index in storage system | |
| CN103220355B (en) | Multi-user configuration method in content distributing network | |
| CN103902554B (en) | Data access method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20170609 |