CN103761251A - Storing and finding method for large-data-volume client information - Google Patents
Storing and finding method for large-data-volume client information Download PDFInfo
- Publication number
- CN103761251A CN103761251A CN201310727976.4A CN201310727976A CN103761251A CN 103761251 A CN103761251 A CN 103761251A CN 201310727976 A CN201310727976 A CN 201310727976A CN 103761251 A CN103761251 A CN 103761251A
- Authority
- CN
- China
- Prior art keywords
- data
- information
- identification information
- index file
- storage
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
- G06F16/2264—Multidimensional index structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2282—Tablespace storage structures; Management thereof
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to a storing and finding method for large-data-volume client information. The storing and finding method for large-data-volume client information includes: (1) storing data, to be more specific, storing the acquired client information data in a multidimensional table structure, and constructing a unique data mark information for each data item; (2) constructing an index file, to be more specific, using the mark information as the index and using the position parameters which are corresponding to the mark information as value to generate the index file; (3) finding data: finding the mark information in the client information index file according to the mark information of the data to be found to acquire the position parameters corresponding to the mark information; acquiring data elements from the multidimensional table structure according to the position parameters. According to the storing and finding method for large-data-volume client information, the client information data is stored in the multidimensional table structure, the index file with client mark and position information is constructed according to the requirement, the client information data is stored and inquired through index file instead of database manner, the data content can be found and acquired quickly, and the finding speed is improved.
Description
Technical field
The present invention relates to be applied to the customer information system of the every profession and trades such as ecommerce, traditional retail industry, specifically a kind of storage of big data quantity customer information and lookup method.
Background technology
In the customer profile data work for the treatment of of customer information system, unavoidable is the problem of storage and inquiry, and particularly the importance of the customer profile data in current E-commerce field embodies all the more.
The existing customer profile data work for the treatment of database mode that adopt, efficiency and the flexibility ratio of the storage to data and inquiry work are brought certain restriction more.When carrying out query actions, the workload size of inquiring about all needs to be first about to database and is written into, and the efficiency of inquiry is had a certain impact.In addition, database mode cannot be formulated the sign definition rule for inquiring about according to the otherness of data; Meanwhile, user adopts after database mode, and the storage organization of data also can not be adjusted as required, like this flexibility ratio of storage is also brought to certain influence.
Summary of the invention
The present invention is directed to the problems referred to above, storage and the lookup method of the big data quantity customer information that a kind of search efficiency is high is provided.
Technical scheme of the present invention is: a kind of storage of big data quantity customer information and lookup method, and the method is for the situation of not setting up index file, comprises the following steps:
(1) data storage: according to the rule pre-establishing, obtained customer profile data is deposited in multidimensional list structure; Determine the field information of the data that need storage, for each data item is set up unique Data Identification information;
(2) set up index file: this multidimensional list structure file is traveled through, collect identification information and identification information positional information pointed in file; Take identification information as index, take location parameter corresponding to identification information as value generating indexes file;
(3) data search: customer profile data search program is received after data search order, extracted the identification information of data to be found from this order; Data search program is searched this identification information in customer information index file, obtains the location parameter that this identification information is corresponding; According to described location parameter, from described multidimensional list structure, obtain data element.
Further, described index file is deposited in same physical location with customer profile data storage organization; Or described index file is a part for customer profile data storage organization, be placed in front portion or the rear portion of described data store organisation.
Further, when customer profile data storage organization changes, existing index file is upgraded.
Further, when customer profile data is newly-increased, carry out following steps:
(1) newly-increased data storage: according to the rule pre-establishing, obtained newly-increased customer profile data is deposited in multidimensional list structure; Determine the field information of the data that need storage, for newly-increased data item is set up unique Data Identification information;
(2) upgrade index file: ergodic data storage organization, collect Data Identification information and position information, to the newly-increased directory entry of already present index file, take identification information as index, take location parameter corresponding to identification information as value, index file is upgraded.
Technique effect of the present invention is: the present invention is with multidimensional list structure storage customer profile data, set up as required the index file by customer ID and positional information, by index file, realize the non-database mode storage of customer profile data and inquiry, can obtain data content by fast finding, promote seek rate; The customized rules of the sign of multidimensional table storage organization can be adjusted according to the difference of customer information, and flexibility ratio is high.
Accompanying drawing explanation
Fig. 1 is process flow diagram of the present invention.
Fig. 2 is the process flow diagram that upgrades index file after the newly-increased customer information of the present invention.
Embodiment
Below in conjunction with accompanying drawing, the specific embodiment of the present invention is further described.
As shown in Figure 1, be storage and the lookup method of a kind of big data quantity customer information of the present invention, comprise the following steps:
(1) data storage: according to the rule pre-establishing, obtained customer profile data is deposited in multidimensional list structure; Determine the field information of the data that need storage, for each data item is set up unique Data Identification information;
(2) set up index file: this multidimensional list structure file is traveled through, collect identification information and identification information positional information pointed in file; Take identification information as index, take location parameter corresponding to identification information as value generating indexes file; Described index file is deposited in same physical location with customer profile data storage organization; Or described index file is a part for customer profile data storage organization, be placed in front portion or the rear portion of described data store organisation.
(3) data search: customer profile data search program is received after data search order, extracted the identification information of data to be found from this order; Data search program is searched this identification information in customer information index file, obtains the location parameter that this identification information is corresponding; According to described location parameter, from described multidimensional list structure, obtain data element.
When customer profile data storage organization changes, existing index file is upgraded.
As shown in Figure 2, when customer profile data is newly-increased, carry out following steps:
(1) newly-increased data storage: according to the rule pre-establishing, obtained newly-increased customer profile data is deposited in multidimensional list structure; Determine the field information of the data that need storage, for newly-increased data item is set up unique Data Identification information;
(2) upgrade index file: ergodic data storage organization, collect Data Identification information and position information, to the newly-increased directory entry of already present index file, take identification information as index, take location parameter corresponding to identification information as value, index file is upgraded.
Principle of the present invention is with multidimensional list structure storage customer profile data, set up as required the index file by customer ID and positional information, index file is independent of multidimensional table storage organization, by index file, realizes the non-database mode storage of customer profile data and inquiry.
The present invention has realized by identification information and has searched corresponding data content, can be in the situation that structure information storage not being written into internal data structure, with textual form, resolve, fast finding obtains data content, when Information Organization not being built into file structure, also can carry out searching of data content, thereby reach the object that promotes seek rate.
With an example, illustrate from setting up multidimensional table data store organisation to the overall process of searching action below.Information can be stored in multiple forms as required, for example, sets up client's Basic Information Table and client's consumption information table is as follows:
Client's Basic Information Table
| ID | Customer name | Unit | Address |
| ID1 | Open XX | XX company | No. XX, XX street, XX district, XX city |
| ID2 | King XX | XX company | No. XX, XX street, XX district, XX city |
| ID3 | King XX | XX company | No. XX, XX street, XX district, XX city |
Client's consumption information table
| ID | Customer name | The goods number of purchasing | Trade name | Buy the time |
| ID1 | Open XX | Goods number 1 | Commodity 1 | On September 1st, 2013 |
| ID2 | King XX | Goods number 2 | Commodity 2 | On September 2nd, 2013 |
| ID3 | King XX | Goods number 3 | Commodity 3 | On September 3rd, 2013 |
Foundation is as follows for the indexed file structure of inquiring about:
Positional information is the concrete character position of locator data content, and this position is the reference position with respect to whole storage organization.By positional information, can be directly targeted to corresponding data.
From above-mentioned example, according to the difference of customer profile data, the customized rules of the sign of its multidimensional table storage organization may be different, as adopted character, symbol or key word etc., specifically can adjust according to the difference of customer information, and flexibility ratio is high.
Claims (5)
1. the storage of big data quantity customer information and a lookup method, is characterized in that, comprises the following steps:
(1) data storage: according to the rule pre-establishing, obtained customer profile data is deposited in multidimensional list structure; Determine the field information of the data that need storage, for each data item is set up unique Data Identification information;
(2) set up index file: this multidimensional list structure file is traveled through, collect identification information and identification information positional information pointed in file; Take identification information as index, take location parameter corresponding to identification information as value generating indexes file;
(3) data search: customer profile data search program is received after data search order, extracted the identification information of data to be found from this order; Data search program is searched this identification information in customer information index file, obtains the location parameter that this identification information is corresponding; According to described location parameter, from described multidimensional list structure, obtain data element.
2. according to the storage of big data quantity customer information claimed in claim 1 and lookup method, it is characterized in that: described index file is deposited in same physical location with customer profile data storage organization.
3. according to the storage of big data quantity customer information claimed in claim 1 and lookup method, it is characterized in that: described index file is a part for customer profile data storage organization, be placed in front portion or the rear portion of described data store organisation.
4. according to the storage of big data quantity customer information claimed in claim 1 and lookup method, it is characterized in that: when customer profile data storage organization changes, existing index file is upgraded.
5. according to the storage of big data quantity customer information claimed in claim 4 and lookup method, it is characterized in that: when customer profile data is newly-increased, carry out following steps:
(1) newly-increased data storage: according to the rule pre-establishing, obtained newly-increased customer profile data is deposited in multidimensional list structure; Determine the field information of the data that need storage, for newly-increased data item is set up unique Data Identification information;
(2) upgrade index file: ergodic data storage organization, collect Data Identification information and position information, to the newly-increased directory entry of already present index file, take identification information as index, take location parameter corresponding to identification information as value, index file is upgraded.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310727976.4A CN103761251A (en) | 2013-12-26 | 2013-12-26 | Storing and finding method for large-data-volume client information |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310727976.4A CN103761251A (en) | 2013-12-26 | 2013-12-26 | Storing and finding method for large-data-volume client information |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103761251A true CN103761251A (en) | 2014-04-30 |
Family
ID=50528489
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310727976.4A Pending CN103761251A (en) | 2013-12-26 | 2013-12-26 | Storing and finding method for large-data-volume client information |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103761251A (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105335857A (en) * | 2014-08-08 | 2016-02-17 | 国家电网公司 | Data search method and apparatus |
| CN109545000A (en) * | 2018-11-09 | 2019-03-29 | 中国航空无线电电子研究所 | Forward sight landform alerts boundary calculation method |
| CN109816534A (en) * | 2018-12-17 | 2019-05-28 | 平安国际融资租赁有限公司 | Financing lease Products Show method, apparatus, computer equipment and storage medium |
| CN110321325A (en) * | 2019-06-21 | 2019-10-11 | 腾讯科技（深圳）有限公司 | File inode lookup method, terminal, server, system and storage medium |
| CN110910975A (en) * | 2019-10-10 | 2020-03-24 | 江苏盖睿健康科技有限公司 | Data processing method and device for medical information |
| CN111797098A (en) * | 2020-06-30 | 2020-10-20 | 北京经纬恒润科技有限公司 | Message parsing method and device and vehicle-mounted terminal |
| CN111796810A (en) * | 2020-07-03 | 2020-10-20 | 福建天晴在线互动科技有限公司 | Method and system for configurable rapid generation of Mysql database codes |
| CN112328275A (en) * | 2020-10-10 | 2021-02-05 | 岭东核电有限公司 | Data updating method and device for nuclear power plant, terminal equipment and storage medium |
| CN112445822A (en) * | 2019-08-30 | 2021-03-05 | 拉扎斯网络科技（上海）有限公司 | Data query method and device, electronic equipment and computer readable storage medium |
| CN116954745A (en) * | 2023-05-25 | 2023-10-27 | 成都融见软件科技有限公司 | Target file partial loading system |
-
2013
- 2013-12-26 CN CN201310727976.4A patent/CN103761251A/en active Pending
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105335857A (en) * | 2014-08-08 | 2016-02-17 | 国家电网公司 | Data search method and apparatus |
| CN109545000A (en) * | 2018-11-09 | 2019-03-29 | 中国航空无线电电子研究所 | Forward sight landform alerts boundary calculation method |
| CN109545000B (en) * | 2018-11-09 | 2021-09-24 | 中国航空无线电电子研究所 | Forward-looking terrain warning boundary calculation method |
| CN109816534A (en) * | 2018-12-17 | 2019-05-28 | 平安国际融资租赁有限公司 | Financing lease Products Show method, apparatus, computer equipment and storage medium |
| CN110321325A (en) * | 2019-06-21 | 2019-10-11 | 腾讯科技（深圳）有限公司 | File inode lookup method, terminal, server, system and storage medium |
| CN110321325B (en) * | 2019-06-21 | 2024-05-10 | 腾讯科技（深圳）有限公司 | File index node searching method, terminal, server, system and storage medium |
| CN112445822A (en) * | 2019-08-30 | 2021-03-05 | 拉扎斯网络科技（上海）有限公司 | Data query method and device, electronic equipment and computer readable storage medium |
| CN110910975B (en) * | 2019-10-10 | 2020-11-27 | 江苏盖睿健康科技有限公司 | Data processing method and device for medical information |
| CN110910975A (en) * | 2019-10-10 | 2020-03-24 | 江苏盖睿健康科技有限公司 | Data processing method and device for medical information |
| CN111797098A (en) * | 2020-06-30 | 2020-10-20 | 北京经纬恒润科技有限公司 | Message parsing method and device and vehicle-mounted terminal |
| CN111797098B (en) * | 2020-06-30 | 2024-01-19 | 北京经纬恒润科技股份有限公司 | Message analysis method and device and vehicle-mounted terminal |
| CN111796810A (en) * | 2020-07-03 | 2020-10-20 | 福建天晴在线互动科技有限公司 | Method and system for configurable rapid generation of Mysql database codes |
| CN112328275A (en) * | 2020-10-10 | 2021-02-05 | 岭东核电有限公司 | Data updating method and device for nuclear power plant, terminal equipment and storage medium |
| CN116954745A (en) * | 2023-05-25 | 2023-10-27 | 成都融见软件科技有限公司 | Target file partial loading system |
| CN116954745B (en) * | 2023-05-25 | 2024-02-09 | 成都融见软件科技有限公司 | Target file partial loading system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103761251A (en) | Storing and finding method for large-data-volume client information | |
| CN107145496B (en) | Method for matching image with content item based on keyword | |
| CN104685498B (en) | The hardware implementation mode of polymerization/division operation：Hash table method | |
| CN104123374B (en) | The method and device of aggregate query in distributed data base | |
| JP5721818B2 (en) | Use of model information group in search | |
| CN104216992B (en) | A kind of information processing method and device | |
| CN104252456B (en) | A kind of weight method of estimation, apparatus and system | |
| CN106033416A (en) | A string processing method and device | |
| CN101706820A (en) | Storing method and device and query method and device of bill of materials | |
| CN103703467A (en) | Method and apparatus for storing data | |
| JP6165955B1 (en) | Method and system for matching images and content using whitelist and blacklist in response to search query | |
| CN102314654A (en) | Information push method and information push server | |
| CN107145497B (en) | Method for selecting image matched with content based on metadata of image and content | |
| CN108228657B (en) | Method and device for realizing keyword retrieval | |
| CN102567329A (en) | Data query method and data query system | |
| CN103294790A (en) | Spatiotemporal semantic meaning indexing and retrieving method aiming at GPS (global positioning system) trajectory data | |
| US20200334266A1 (en) | Method and device for processing user portrait and server | |
| CN105512143A (en) | Method and device for web page classification | |
| CN106294418B (en) | Search method and searching system | |
| CN109145110A (en) | Information classification processing, tag queries method and apparatus based on label | |
| CN103123650A (en) | Extensible markup language (XML) data bank full-text indexing method based on integer mapping | |
| CN103164424A (en) | Method and device for acquiring time-efficient words | |
| CN105630813A (en) | Keyword recommendation method and system based on user-defined template | |
| CN102411617A (en) | Method for storing and inquiring a large quantity of URLs | |
| CN104778284A (en) | Spatial image inquiring method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20140430 |