CN102521306A - Application method for data storage system - Google Patents

Application method for data storage system Download PDF

Info

Publication number
CN102521306A
CN102521306A CN2011103924756A CN201110392475A CN102521306A CN 102521306 A CN102521306 A CN 102521306A CN 2011103924756 A CN2011103924756 A CN 2011103924756A CN 201110392475 A CN201110392475 A CN 201110392475A CN 102521306 A CN102521306 A CN 102521306A
Authority
CN
China
Prior art keywords
data
file
storage system
data storage
index
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2011103924756A
Other languages
Chinese (zh)
Inventor
何泽华
胡斌
彭宝
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SUZHOU MAIKE NETWORK SAFETY TECHNOLOGY Co Ltd
Original Assignee
SUZHOU MAIKE NETWORK SAFETY TECHNOLOGY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SUZHOU MAIKE NETWORK SAFETY TECHNOLOGY Co Ltd filed Critical SUZHOU MAIKE NETWORK SAFETY TECHNOLOGY Co Ltd
Priority to CN2011103924756A priority Critical patent/CN102521306A/en
Publication of CN102521306A publication Critical patent/CN102521306A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses an application method for a data storage system. The data storage system organizes and stores data in a table mode. A method for creating a data storage file in the data storage system comprises the following steps of: firstly, creating a data storage main table file and derivative files of the data storage main table file in the data storage system; secondly, compressing the combined key information of each record of the data storage main table file, and establishing subsidiary table files of the data storage main table file; thirdly, recording the basic information of the data storage main table file and data record structure information to be stored in a dictionary file; and fourthly, buffering the basic information of the data storage main table file and the data record structure information in a computer memory to improve the subsequent operation efficiency of the table. The application method for the data storage system has the advantages of large data storage amount, simple functions, simple operation flow and high read-write speed rate, and data updating speed and system response speed are increased.

Description

A kind of application method of data storage system
Technical field
The present invention relates to a kind of application method of data storage system, especially relate to a kind of CPD (Common Performance Database) application method of data storage system.
Background technology
The data base management system (DBMS) of existing main flow, in the confidentiality of data, the security of operation, aspects such as the restorability of data cause the computing machine Limited resources to be tied up, and can not more be used for data storage, and increase user cost.Big for those fundamental characteristics amounts of being, security does not need too high, even there is low volume data to lose; Can not cause the data of traffic lost yet; Patented claim CN 101853278A has proposed a kind of CPD (Common Performance Database) data-storage system, relates to the aspect such as storage, retrieval of data, and memory data output is big; It is fast that storage speed is wanted, and can read easily and fast.Along with the raising of customer demand, need improve data processing speed further.
Summary of the invention
The objective of the invention is to propose a kind of improved a kind of application method of data storage system, accelerate Data Update speed and system response time further based on the CPD data-storage system.
The object of the invention will be achieved through following technical scheme:
A kind of application method of data storage system, this data-storage system is organized the storage data with the mode of " table ", and the establishment of data storage file may further comprise the steps in the said data-storage system:
The first step, in said data-storage system, create the data storage master meter file and the file of deriving thereof; Be provided for setting up the headspace of the index information of data in this document in the starting position of said master meter file; Said headspace comprises: top of file; Begin length at file, and write down actual index block number in attribute information and the file of each row of time range, file type, file logging of whole file logging with spatial registration this document head of 2 bytes; The index area; The space of 32 bytes reserved in each index; In order to the time span that writes down each record in this index, reference position and content space length hereof, the space that said index area is reserved calculates by the time span of predefined file storage data, the time span of each index;
Second step, the combination key information of every record of said master meter file is compressed, set up the attached table file of data storage master meter file, each key only need store once, in system with the saving hard drive space; Each the master meter file and the attached table file of file sharing of deriving thereof; Said attached table file is in the medium-term and long-term existence of internal memory, and each content of attached table file all has a unique numerical coding; To each the operation in the said attached table file, all only use said numerical coding in the total system;
The 3rd goes on foot, in dictionary file, writes down the essential information of master meter file and the data recording structural information that will store;
The 4th the step, in calculator memory buffer memory master meter file essential information and data recording structural information, to increase follow-up operating efficiency to this table.
Further, above-mentioned application method of data storage system, wherein: in the process of creating said data-storage system, the data recording structure in each file is all consistent; Define type (key row, numerical value row), classification (sum, character type row), the numerical value row storage mode (only the numeric type row being suitable for) of each row of this interrecord structure; Said numerical value row storage mode comprises fixing row and variable row, and said fixedly row are that each element of row stores in the hard disk with fixing length, and this mode can be wasted some hard drive spaces; Said variable row are that each element of row is divided into dissimilarly by actual size, and variant type is stored with different byte lengths, and wherein each unit have 1 byte and writes down the length type that it adopts.
Further; Above-mentioned application method of data storage system; Wherein: the said file of deriving be by system according to master meter file specified message when creating, operation is automatically termly carried out the mathematic(al) representation operation of specified type and the new file that generates to raw data; Said file and the original master meter file of deriving has on all four interrecord structure.
Further, above-mentioned application method of data storage system, wherein: the storage of data comprises the steps: in the said data-storage system
Whether the record of 1) judging this a collection of storage finishes receiving (CPD has limited the internal memory restriction of every batch of transmission data, if a batch data surpasses this restriction, the transmission of unpacking); If do not accomplish, then buffer memory; If accomplish, then start the write data flow process;
2) the corresponding attached table file of coupling, whether detect has non-existent new key train value in the attached table file; If any new key train value, new key train value is generated new unique encoding, and said new key train value is stored in the attached table file;
3) organize data according to each Column Properties of record, the byte stream behind the tissue is write hard disk, for this batch data makes up an index, detect the time range of this batch data then, accomplish the establishment of this index;
4) relevant information that writes down in the master meter file in the adjustment dictionary file comprises record strip number and time range, the relevant information of said adjustment is synchronized in the internal memory, with convenient inquiry;
5) call the buffer memory program, detect this batch data of buffer memory,, from buffer memory, remove the data of not used at most by inquiry simultaneously according to scheduling strategy to " write data buffer memory ".
Further, above-mentioned application method of data storage system, wherein: the inquiry of data comprises the steps: in the said data-storage system
1) receives the data query statement,, detect " write data buffer memory " according to the time range of data query; If the suitable data piece is arranged, then extract said data block; If said data block not in " write data buffer memory ", then reads and satisfies index time range, physical file;
2) resolve query statement, the execution sequence by expression formula filters each data block respectively, if the data block in " write data buffer memory ", direct filtration; If the data in the physical file then according to the file area of index appointment, read corresponding data block, filter then; Filter expression formula earlier, filter according to the relation between each expression formula then;
3) find out the data block of maximum time span, other data block contents are gathered merging by said time range, the mode that gathers is undertaken by the mathematic(al) representation of master meter file appointment, thereby forms new data block;
4) the corresponding unique coding of key with new data block record replaces with content corresponding in the attached table file, returns to caller.
Outstanding effect of the present invention is: the present invention has increased the file of deriving of master meter file newly; And be provided for setting up the headspace of the index information of data in this document in the starting position of master meter file; Kept that former memory data output is big, function is simple, workflow is succinct; Characteristics such as read-write speed height are further accelerated Data Update speed and system response time.
Following constipation closes the embodiment accompanying drawing, and specific embodiments of the invention is done further to detail, so that technical scheme of the present invention is easier to understand, grasp.
Description of drawings
Fig. 1 creates the schematic flow sheet of a data storage list for data-storage system of the present invention;
Fig. 2 is the schematic flow sheet of a data storage list of data-storage system storage of the present invention;
Fig. 3 is the schematic flow sheet of a data storage list of data-storage system inquiry of the present invention.
Embodiment
Data-storage system of the present invention is with the mode of " table " (one " table " corresponding file) tissue data, so just allows read-write operation that can be concurrent between the difference " table ".Lock file not when it reads " list file " in execution; When writing " list file ", a zone, lock part, the data that read in this document other that make that the user can be concurrent.In data-storage system of the present invention, the reading and writing operation of data in " list file " is base unit with " data block " (piece is the set of all data recording with same format in a time span scope) all.The periphery record of this record is read in the internal memory simultaneously, has reduced the expense of frequent reading disk file, accelerated the speed of subsequent read operations; When writing stored record; With the metadata cache in the time range (being worth by user's fixed time) together, once writing in batches reduced the expense of frequently writing disk file; Also avoid " list file " regular being locked, accelerated the concurrent fast reading of writing disk.
In addition, in data-storage system of the present invention, any data all are directly to write " list file " with the mode of " byte stream ", the encryption measures that has no, and making it data can parse easily.Need not to support parsing, the executable operations of standard SQL language.
Data-storage system of the present invention comprises data storage master meter file, attached table file, dictionary file and the file of deriving.Wherein, each master meter file has and has only an attached table file (not being the list file that must exist).Data in each data storage master meter file only provide the function that writes, inquires about, and can revise retrieving information, index information, status information etc.Be independent of each other between the data storage master meter, do not support incidence relation.
The essential information and the data recording structural information of each data storage master meter file in the dictionary file minute book invention data-storage system, the attached table file needn't have record at this.Information in the dictionary file can be added, can be inquired about, and also can revise, delete.Outer incidence relation is arranged between several dictionary files, characteristics such as major key unique constraints are arranged.
Derive file and attached table file of master meter file sharing of master meter file; Its data are according to the type of master meter file and build mathematic(al) representation given when showing; Time range is moved the tables of data of generation voluntarily by system, is a kind of statistics table again to the master meter file.
Each dictionary file, data storage master meter file, attached table file, the file of deriving have a unique physical file corresponding with it.
As shown in Figure 1, this data-storage system is organized the storage data with the mode of " table ", and the establishment of data storage file may further comprise the steps in the data-storage system:
The first step, in data-storage system, create the data storage master meter file and the file of deriving thereof; Be provided for setting up the headspace of the index information of data in this document in the starting position of master meter file; Headspace comprises: top of file; Begin length at file, and write down actual index block number in attribute information and the file of each row of time range, file type, file logging of whole file logging with spatial registration this document head of 2 bytes; The index area; The space of 32 bytes reserved in each index; In order to the time span that writes down each record in this index, reference position and content space length hereof, the space that the index area is reserved calculates by the time span of predefined file storage data, the time span of each index;
Second step, the combination key information of every record of master meter file is compressed, set up the attached table file of data storage master meter file, each key only need store once, in system with the saving hard drive space; Each the master meter file and the attached table file of file sharing of deriving thereof; The attached table file is in the medium-term and long-term existence of internal memory, and each content of attached table file all has a unique numerical coding; To each the operation in the attached table file, all only use numerical coding in the total system; The file of deriving be by system according to master meter file specified message when creating, operation is automatically termly carried out the mathematic(al) representation operation of specified type and the new file that generates to raw data; Derive file and original master meter file has on all four interrecord structure;
The 3rd goes on foot, in dictionary file, writes down the essential information of master meter file and the data recording structural information that will store;
The 4th the step, in calculator memory buffer memory master meter file essential information and data recording structural information, to increase follow-up operating efficiency to this table.
Difference with the prior art point of the present invention just has been to increase newly the file of deriving of master meter file; And be provided for setting up the headspace of the index information of data in this document in the starting position of master meter file; Kept that former memory data output is big, function is simple, workflow is succinct; Characteristics such as read-write speed height are further accelerated Data Update speed and system response time.
In the process of creating data-storage system, the data recording structure in each file is all consistent; Define type (key row, numerical value row), classification (sum, character type row), the numerical value row storage mode (only the numeric type row being suitable for) of each row of this interrecord structure; Numerical value row storage mode comprises fixing row and variable row, and fixedly row are that each element that is listed as stores in the hard disk with fixing length, and this mode can be wasted some hard drive spaces; Variable row are that each element of row is divided into dissimilarly by actual size, and variant type is stored with different byte lengths, and wherein each unit have 1 byte and writes down the length type that it adopts.
As shown in Figure 2, the storage of data comprises the steps: in this data-storage system
Whether the record of 1) judging this a collection of storage finishes receiving (CPD has limited the internal memory restriction of every batch of transmission data, if a batch data surpasses this restriction, the transmission of unpacking); If do not accomplish, then buffer memory; If accomplish, then start the write data flow process;
2) the corresponding attached table file of coupling, whether detect has non-existent new key train value in the attached table file; If any new key train value, new key train value is generated new unique encoding, and new key train value is stored in the attached table file;
3) organize data according to each Column Properties of record, the byte stream behind the tissue is write hard disk, for this batch data makes up an index, detect the time range of this batch data then, accomplish the establishment of this index;
4) relevant information that writes down in the master meter file in the adjustment dictionary file comprises record strip number and time range, the relevant information of adjusting is synchronized in the internal memory, with convenient inquiry;
5) call the buffer memory program, detect this batch data of buffer memory,, from buffer memory, remove the data of not used at most by inquiry simultaneously according to scheduling strategy to " write data buffer memory ".
For inquiry, to have adopted with the demand of a string character representation data query, its expression is regular as follows:
1) query statement begins with query, and the back is immediately following the surface that will inquire about (can only be " master meter file " name), like query tableName here;
2) filtration of data is represented with filter, support and (with), or (or) the combination filter operation; Support in operation, not no operation, rule as follows:
Expression formula in a pair of braces " { } " lining is carried out together;
Each expression formula comprises with a pair of bracket " [] ";
Only allow between the expression formula and (with), or (or) character, space-separated;
3 generic operations are arranged in the expression formula, are respectively:
Relatively (only be suitable for and sum) :==, ,=, ,=,!=;
【eg:?[cname1?==?5]?】
Comprise (being to use and numerical value row, character row simultaneously): in, not in;
[eg: [cname1 in (1,3,6)]] (row cname1 value is that 1,3,6 record meets)
[eg: [cname1, cname2 in (< 1,2 >, < 4,6 >; < 8.10 >)]] (the row cname1 of every record, cname2 is < 1,2 >, < 4,6 >; < 8,10>meet, here two of same record row to the value in <>be and (with) relation, the value in different <>is to being or (or) relation)
(character row): equals, equalsIgnoreCase (ignorecase) judged in character;
【eg:?filter?{[cname1?==?1]?or?[cname2?==?2]}?and?{[cname3?==?4]?or?[cname4?==?5]}?or?[cname5,cname6?in?(<1,2>,<4,6>,<8.10>)]】
3) to the ordering of data with gather statement, same sql.
As shown in Figure 3, the inquiry of data comprises the steps: in this data-storage system
1) receives the data query statement,, detect " write data buffer memory " according to the time range of data query; If the suitable data piece is arranged, then extract data block; If data block not in " write data buffer memory ", then reads and satisfies index time range, physical file;
2) resolve query statement, the execution sequence by expression formula filters each data block respectively, if the data block in " write data buffer memory ", direct filtration; If the data in the physical file then according to the file area of index appointment, read corresponding data block, filter then; Filter expression formula earlier, filter according to the relation between each expression formula then;
3) find out the data block of maximum time span, other data block contents are gathered merging by the time scope, the mode that gathers is undertaken by the mathematic(al) representation of master meter file appointment, thereby forms new data block;
4) the corresponding unique coding of key with new data block record replaces with content corresponding in the attached table file, returns to caller.
The pressure testing data contrast that the data base management system (DBMS) keeping records of data-storage system of the present invention and existing other types is carried out under same test environment; See from the testing efficiency of record; The data base management system (DBMS) speed of the existing other types of data-storage system average specific is wanted fast about 3.5 times, can meet consumers' demand.
The present invention still has numerous embodiments, and all employing equivalents or equivalent transformation and all technical schemes of forming all drop within protection scope of the present invention.

Claims (5)

1. application method of data storage system, this data-storage system is organized the storage data with the mode of " table ", it is characterized in that, and the establishment of data storage file may further comprise the steps in the said data-storage system:
The first step, in said data-storage system, create the data storage master meter file and the file of deriving thereof; Be provided for setting up the headspace of the index information of data in this document in the starting position of said master meter file; Said headspace comprises: top of file; Begin length at file, and write down actual index block number in attribute information and the file of each row of time range, file type, file logging of whole file logging with spatial registration this document head of 2 bytes; The index area; The space of 32 bytes reserved in each index; In order to the time span that writes down each record in this index, reference position and content space length hereof, the space that said index area is reserved calculates by the time span of predefined file storage data, the time span of each index;
Second step, the combination key information of every record of said master meter file is compressed, set up the attached table file of data storage master meter file; Each the master meter file and the attached table file of file sharing of deriving thereof; Said attached table file is in the medium-term and long-term existence of internal memory, and each content of attached table file all has a unique numerical coding; To each the operation in the said attached table file, all only use said numerical coding in the total system;
The 3rd goes on foot, in dictionary file, writes down the essential information of master meter file and the data recording structural information that will store;
The 4th the step, in calculator memory buffer memory master meter file essential information and data recording structural information.
2. a kind of application method of data storage system as claimed in claim 1 is characterized in that: in the process of creating said data-storage system, the data recording structure in each file is all consistent; Define type, classification, the numerical value row storage mode of each row of this interrecord structure; Said numerical value row storage mode comprises fixing row and variable row, and said fixedly row are that each element of row stores in the hard disk with fixing length; Said variable row are that each element of row is divided into dissimilarly by actual size, and variant type is stored with different byte lengths, and wherein each unit have 1 byte and writes down the length type that it adopts.
3. a kind of application method of data storage system as claimed in claim 1; It is characterized in that: the said file of deriving is according to master meter file specified message when creating by system; Automatically operation is termly carried out the mathematic(al) representation of specified type and is operated and the new file of generation to raw data; Said file and the original master meter file of deriving has on all four interrecord structure.
4. a kind of application method of data storage system as claimed in claim 1 is characterized in that: the storage of data comprises the steps: in the said data-storage system
Whether the record of 1) judging this a collection of storage finishes receiving; If do not accomplish, then buffer memory; If accomplish, then start the write data flow process;
2) the corresponding attached table file of coupling, whether detect has non-existent new key train value in the attached table file; If any new key train value, new key train value is generated new unique encoding, and said new key train value is stored in the attached table file;
3) organize data according to each Column Properties of record, the byte stream behind the tissue is write hard disk, for this batch data makes up an index, detect the time range of this batch data then, accomplish the establishment of this index;
4) relevant information that writes down in the master meter file in the adjustment dictionary file comprises record strip number and time range, and the relevant information of said adjustment is synchronized in the internal memory;
5) call the buffer memory program, detect this batch data of buffer memory, from buffer memory, remove the data of not used at most by inquiry to " write data buffer memory ".
5. a kind of application method of data storage system as claimed in claim 1 is characterized in that: the inquiry of data comprises the steps: in the said data-storage system
1) receives the data query statement,, detect " write data buffer memory " according to the time range of data query; If the suitable data piece is arranged, then extract said data block; If said data block not in " write data buffer memory ", then reads and satisfies index time range, physical file;
2) resolve query statement, the execution sequence by expression formula filters each data block respectively, if the data block in " write data buffer memory ", direct filtration; If the data in the physical file then according to the file area of index appointment, read corresponding data block, filter then; Filter expression formula earlier, filter according to the relation between each expression formula then;
3) find out the data block of maximum time span, other data block contents are gathered merging by said time range, the mode that gathers is undertaken by the mathematic(al) representation of master meter file appointment, thereby forms new data block;
4) the corresponding unique coding of key with new data block record replaces with content corresponding in the attached table file, returns to caller.
CN2011103924756A 2011-12-01 2011-12-01 Application method for data storage system Pending CN102521306A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2011103924756A CN102521306A (en) 2011-12-01 2011-12-01 Application method for data storage system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2011103924756A CN102521306A (en) 2011-12-01 2011-12-01 Application method for data storage system

Publications (1)

Publication Number Publication Date
CN102521306A true CN102521306A (en) 2012-06-27

Family

ID=46292227

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2011103924756A Pending CN102521306A (en) 2011-12-01 2011-12-01 Application method for data storage system

Country Status (1)

Country Link
CN (1) CN102521306A (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103678638A (en) * 2013-12-20 2014-03-26 厦门雅迅网络股份有限公司 Object caching method based on disk
CN104715039A (en) * 2015-03-23 2015-06-17 星环信息科技(上海)有限公司 Column-based storage and research method and equipment based on hard disk and internal storage
CN105009091A (en) * 2012-12-26 2015-10-28 西部数据技术公司 Dynamic overprovisioning for data storage systems
CN106202121A (en) * 2015-05-07 2016-12-07 阿里巴巴集团控股有限公司 Data storage and the method and apparatus derived
CN103678519B (en) * 2013-11-29 2017-03-29 中国科学院计算技术研究所 It is a kind of to support the enhanced mixing storage systems of Hive DML and its method
CN108717509A (en) * 2018-06-05 2018-10-30 厦门安胜网络科技有限公司 A kind of method, apparatus, equipment and the readable medium of the extraction procedure derivative in sandbox
CN109147091A (en) * 2018-08-29 2019-01-04 百度在线网络技术(北京)有限公司 Processing method, device, equipment and the storage medium of unmanned car data
CN105607870B (en) * 2015-12-17 2019-05-21 北京奇虎科技有限公司 The method and device of game data bundling processing
CN113377721A (en) * 2021-07-02 2021-09-10 电信科学技术第五研究所有限公司 File table design method for storing files in database

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101055589A (en) * 2007-05-30 2007-10-17 北京航空航天大学 Embedded database storage management method
CN101853278A (en) * 2010-05-19 2010-10-06 苏州迈科网络安全技术有限公司 Application method of data storage system
CN101923498A (en) * 2009-06-11 2010-12-22 升东网络科技发展(上海)有限公司 Database full-volume automatic backup system and method
CN102043795A (en) * 2009-10-13 2011-05-04 上海新华控制技术(集团)有限公司 Establishing method for process control historical data file structure and data read-write method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101055589A (en) * 2007-05-30 2007-10-17 北京航空航天大学 Embedded database storage management method
CN101923498A (en) * 2009-06-11 2010-12-22 升东网络科技发展(上海)有限公司 Database full-volume automatic backup system and method
CN102043795A (en) * 2009-10-13 2011-05-04 上海新华控制技术(集团)有限公司 Establishing method for process control historical data file structure and data read-write method
CN101853278A (en) * 2010-05-19 2010-10-06 苏州迈科网络安全技术有限公司 Application method of data storage system

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105009091A (en) * 2012-12-26 2015-10-28 西部数据技术公司 Dynamic overprovisioning for data storage systems
CN103678519B (en) * 2013-11-29 2017-03-29 中国科学院计算技术研究所 It is a kind of to support the enhanced mixing storage systems of Hive DML and its method
CN103678638B (en) * 2013-12-20 2018-10-19 厦门雅迅网络股份有限公司 A kind of target cache method based on disk
CN103678638A (en) * 2013-12-20 2014-03-26 厦门雅迅网络股份有限公司 Object caching method based on disk
CN104715039A (en) * 2015-03-23 2015-06-17 星环信息科技(上海)有限公司 Column-based storage and research method and equipment based on hard disk and internal storage
CN104715039B (en) * 2015-03-23 2018-10-19 星环信息科技(上海)有限公司 Based on the storage of the column of hard disk and memory and querying method and equipment
CN106202121A (en) * 2015-05-07 2016-12-07 阿里巴巴集团控股有限公司 Data storage and the method and apparatus derived
CN106202121B (en) * 2015-05-07 2019-06-28 阿里巴巴集团控股有限公司 Data storage and derived method and apparatus
CN105607870B (en) * 2015-12-17 2019-05-21 北京奇虎科技有限公司 The method and device of game data bundling processing
CN108717509A (en) * 2018-06-05 2018-10-30 厦门安胜网络科技有限公司 A kind of method, apparatus, equipment and the readable medium of the extraction procedure derivative in sandbox
CN109147091A (en) * 2018-08-29 2019-01-04 百度在线网络技术(北京)有限公司 Processing method, device, equipment and the storage medium of unmanned car data
CN109147091B (en) * 2018-08-29 2022-04-19 百度在线网络技术(北京)有限公司 Method, device and equipment for processing data of unmanned vehicle and storage medium
CN113377721A (en) * 2021-07-02 2021-09-10 电信科学技术第五研究所有限公司 File table design method for storing files in database
CN113377721B (en) * 2021-07-02 2023-03-24 电信科学技术第五研究所有限公司 File table design method for storing files in database

Similar Documents

Publication Publication Date Title
CN102521306A (en) Application method for data storage system
CN103366015B (en) A kind of OLAP data based on Hadoop stores and querying method
CN103605805B (en) A kind of storage method of magnanimity time series data
KR102005831B1 (en) Managing storage of data for range-based searching
US7689574B2 (en) Index and method for extending and querying index
US8886617B2 (en) Query-based searching using a virtual table
CN103020204B (en) A kind of method and its system carrying out multi-dimensional interval query to distributed sequence list
CN101667205B (en) Method for memorizing real time measure point data for quick review
CN105373541B (en) The processing method and system of the data operation request of database
CN101799783A (en) Data storing and processing method, searching method and device thereof
CN102880685A (en) Method for interval and paging query of time-intensive B/S (Browser/Server) with large data size
CN102693286B (en) Method for organizing and managing file content and metadata
CN109241072A (en) Buffering updating method and system based on Canal
CN107526550B (en) Two-stage merging method based on log structure merging tree
CN102968464B (en) A kind of search method of the local resource quick retrieval system based on index
JP2014197425A (en) Method of managing storage of individually accessible data units
CN102402617A (en) Easily compressed database index storage system using fragments and sparse bitmap, and corresponding construction, scheduling and query processing methods
CN102779138A (en) Hard disk access method of real time data
CN108319608A (en) The method, apparatus and system of access log storage inquiry
CN108182244B (en) A kind of time series data storage method based on multi-level column storage organization
CN108804594A (en) A kind of construction method and device of news content full-text search engine
CN101853278A (en) Application method of data storage system
CN103778064B (en) A kind of data managing method and device
CN107273403A (en) A kind of history data collection and the method for storage
CN101963993A (en) Method for fast searching database sheet table record

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20120627