CN104881481A - Method and device for accessing mass time sequence data - Google Patents
Method and device for accessing mass time sequence data Download PDFInfo
- Publication number
- CN104881481A CN104881481A CN201510300297.8A CN201510300297A CN104881481A CN 104881481 A CN104881481 A CN 104881481A CN 201510300297 A CN201510300297 A CN 201510300297A CN 104881481 A CN104881481 A CN 104881481A
- Authority
- CN
- China
- Prior art keywords
- data
- file
- time
- time series
- inquiry request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 27
- 238000012163 sequencing technique Methods 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
- G06F16/2474—Sequence data queries, e.g. querying versioned data
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
- G06F16/2255—Hash tables
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Software Systems (AREA)
- Fuzzy Systems (AREA)
- Mathematical Physics (AREA)
- Probability & Statistics with Applications (AREA)
- Computational Linguistics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to the technical field of data cloud storage, in particular to a method and a device for accessing mass time sequence data. The method includes: receiving time sequence data which include a data source identity, data time and data information; enabling the data source identity to generate a plurality of bytes through a Hash algorithm, and creating a plurality of catalogs corresponding to the bytes in a one-to-one manner; storing the time sequence data into the catalogs in a form of a data file which includes a data section and an index section, wherein a file name of the data file is generated by the data time; receiving an inquiry request which includes the data source identity and the data time, and reading corresponding time sequence data from the catalogs according to the inquiry request and the index section. The time sequence data are accessed by combining a means of the data file and index information, so that access efficiency is improved.
Description
Technical field
The present invention relates to data cloud technical field of memory, be specifically related to a kind of method and the device that access magnanimity time series data.
Background technology
Along with Internet of Things, the broad development of the methods such as cloud storage and application, the data how storing and retrieve magnanimity and time correlation become the difficult problem that system is applied, time series data refers to the data be closely related with the time, the access of data except the key word with data itself mutually outside the Pass also closely related with the time, the structure stored is usually according to time-sequencing, usually retrieve according to data key words and time during retrieval, at specific area, magnanimity time data has himself feature: data and time height correlation, data are usually according to time order and function sequential delivery and storage, data itself are little, but data volume is huge, and storage time is long, and storing frequencies is high, usually mass data is had to need to store all the time, but retrieve data only has when service needed just triggers, this just causes the operation of retrieve data much smaller than the operation storing data, time series data generally comprises: Data Identification, time and numerical value, in actual applications, time series data adopts the mode of database to access usually, has certain limitation.
Summary of the invention
The object of the invention is to propose a kind of method and the device that access magnanimity time series data, in conjunction with index information, time series data can be accessed by the mode of data file, improve access efficiency.
For reaching this object, the present invention by the following technical solutions:
Access a method for magnanimity time series data, comprising:
S10, time of reception sequence data, described time series data comprises data source identification, data time and data message;
S20, described data source identification is generated several bytes by hash algorithm, set up and several bytes described some layers of catalogue one to one;
S30, be stored in described catalogue by described time series data with the form of data file, described data file comprises data segment and index segment, and the filename of described data file is generated by described data time;
S40, reception inquiry request, described inquiry request comprises data source identification and data time, reads corresponding time series data according to described inquiry request and index segment from described catalogue.
Preferably, described data segment is used for recording described data message, and described index segment is used for essential information and the index information of recording data files.
Preferably, described essential information comprises data file start time, end of data file time and data source identification, described index information comprises the first index information and the second index information, described first index information records start time corresponding to each data segment and data file deviation post in order, and described second index information comprises wall scroll index data size, the total size of index segment information, end-of-file position and file overall length.
Preferably, described step S20 is specially:
Described data source identification is generated the shape data of four bytes by hash algorithm, by last byte of described four bytes, successively forward, set up and described four bytes root directory, one deck catalogue, two layers of catalogue and three layers of catalogue one to one.
Preferably, described step S30 comprises:
S31, search in catalogue all with the data file of .data ending, and the data file that locating file name is maximum, if do not exist with the data file of .data ending, then newdata file, the file of described newdata file is called: data time .data;
If S32 finds with the data file of .data ending, file reading tail information, described end-of-file packets of information is containing write side-play amount;
S33, be written in described data file by described time series data, the write reference position of described time series data is said write side-play amount;
S34, write index information, be written to described first index information in data segment index corresponding to end-of-file, be written in the secondary index of end-of-file by described second index information.
Preferably, also comprise after described step S34:
If the described data file of step S35 reaches data segment maximum length, close described data file, set up new data file and write.
Preferably, described step S40 comprises:
S41, reception inquiry request, described inquiry request comprises data source identification and data time;
S42, the data source identification of described inquiry request is generated several bytes by hash algorithm, each byte is converted into the character string of 16 systems, and searches corresponding catalogue;
S43, the filename under described catalogue to be sorted according to inverted order, find out first filename less than the data time of described inquiry request;
S44, open data file corresponding to described filename, and the index information at file reading end;
S55, read the data message of the time series data of inquiry request according to described index information.
As another aspect of the present invention, a kind of device accessing magnanimity time series data provided, comprising:
Receiver module, for time of reception sequence data, described time series data comprises data source identification, data time and data message;
Modular converter, for described data source identification is generated several bytes by hash algorithm, sets up and several bytes described some layers of catalogue one to one;
Memory module, for being stored in described catalogue by described time series data with the form of data file, described data file comprises data segment and index segment, and the filename of described data file is generated by described data time;
Read module, for receiving inquiry request, described inquiry request comprises data source identification and data time, reads corresponding time series data according to described inquiry request and index segment from described catalogue.
Preferably, described memory module comprises:
Data file sets up unit, all with the data file of .data ending for searching in catalogue, and the data file that locating file name is maximum, if do not exist with the data file of .data ending, then newdata file, the file of described newdata file is called: data time .data;
Side-play amount writing unit, for finding with after the data file of .data ending, file reading tail information, described end-of-file packets of information is containing write side-play amount;
Data message writing unit, for being written in described data file by described time series data, the write reference position of described time series data is said write side-play amount;
Index information writing unit, for writing index information, being written to described first index information in data segment index corresponding to end-of-file, being written in the secondary index of end-of-file by described second index information.
Preferably, described read module comprises:
Inquiry request receiving element, for receiving inquiry request, described inquiry request comprises data source identification and data time;
Inquiry request converting unit, for the data source identification of described inquiry request is generated several bytes by hash algorithm, is converted into the character string of 16 systems, and searches corresponding catalogue by each byte;
Sequencing unit, for sorting according to inverted order to the filename under described catalogue, finds out first filename less than the data time of described inquiry request;
Index information reading unit, for opening data file corresponding to described filename, and the index information at file reading end;
Data message reading unit, for reading the data message of the time series data of inquiry request according to described index information.
Beneficial effect of the present invention is: a kind of method and device accessing magnanimity time series data, and the method comprises: time of reception sequence data, and described time series data comprises data source identification, data time and data message; Described data source identification is generated several bytes by hash algorithm, sets up and several bytes described some layers of catalogue one to one; Be stored in described catalogue by described time series data with the form of data file, described data file comprises data segment and index segment, and the filename of described data file is generated by described data time; Receive inquiry request, described inquiry request comprises data source identification and data time, from described catalogue, corresponding time series data is read according to described inquiry request and index segment, the present invention is by the mode of data file and access time series data in conjunction with index information, improves access efficiency.
Accompanying drawing explanation
Fig. 1 is a kind of process flow diagram accessing the method for magnanimity time series data that the embodiment of the present invention one provides
Fig. 2 is a kind of process flow diagram accessing the method for magnanimity time series data that the embodiment of the present invention two provides
Fig. 3 is a kind of process flow diagram accessing the method for magnanimity time series data that the embodiment of the present invention three provides
Fig. 4 is a kind of structural drawing accessing the device of magnanimity time series data that the embodiment of the present invention four provides.
Fig. 5 is the structural drawing of the device of the memory module that the embodiment of the present invention five provides.
Fig. 6 is the structural drawing of the device of the read module that the embodiment of the present invention six provides.
Embodiment
Technical scheme of the present invention is further illustrated by embodiment below in conjunction with Fig. 1-Fig. 6.
Embodiment one
Fig. 1 is a kind of process flow diagram accessing the method for magnanimity time series data that the present embodiment provides.
Access a method for magnanimity time series data, comprising:
S10, time of reception sequence data, described time series data comprises data source identification DKey, data time Time and data message Value;
S20, described data source identification is generated several bytes by hash algorithm, set up and several bytes described some layers of catalogue one to one;
S30, be stored in described catalogue by described time series data with the form of data file DFile, described data file comprises data segment and index segment, and the filename of described data file is generated by described data time;
S40, reception inquiry request, described inquiry request comprises data source identification and data time, reads corresponding time series data according to described inquiry request and index segment from described catalogue.
In the present embodiment, in conjunction with index information, time series data is accessed by the mode of data file, be no longer dependent on database of the prior art, improve access efficiency.
In the present embodiment, described data segment is used for recording described data message, and described index segment is used for essential information and the index information of recording data files.
In the present embodiment, shown data segment information comprises:
Data segment maximum length maxsize, according to actual conditions configuration, such as 1GB, when file storage is greater than this value, closes this file, creates new file and stores.
Data block size: BlockSize, by configuration setting, acquiescence 1MB.
Data block maximum number: MaxBlockNum is calculated by maxsize/BlockSize, acquiescence position 1K.
The Offset that data block sequence number: BlockSeqno writes by current data calculates (BlockSeqno=Offset*MaxBlockNum/maxsize).
In the present embodiment, described essential information comprises data file start time, end of data file time and data source identification, described index information comprises the first index information and the second index information, data bin data is divided into MaxBlockNum block by described first index information, record start time corresponding to each data segment and data file deviation post in order, described second index information chooses 4 records in MaxBlockNum record of Part I, comprises wall scroll index data size, the total size of index segment information, end-of-file position and file overall length.
In the present embodiment, wall scroll index data size: BIndexSize=ST (8byte)+Offset (32byte)=40byte;
The total size of index segment information: MaxBIndexSize=(MaxBlockNum+4) * BIndexSize;
End-of-file position: tailOffset=maxsize+MaxBIndexSize;
File overall length: TotalFileSize=tailOffset+ST (8byte)+ET (8byte)+offset (32byte).
In the present embodiment, described step S20 is specially:
Described data source identification is generated the shape data of four bytes by hash algorithm, by last byte of described four bytes, successively forward, set up and described four bytes root directory, one deck catalogue, two layers of catalogue and three layers of catalogue one to one.
In the present embodiment, the start time .data of filename=this file record of shown data file.
Embodiment two
As shown in Figure 2, in the present embodiment, described step S30 comprises:
S31, search in catalogue all with .data ending data file, and the data file that locating file name is maximum, if do not exist with the data file of .data ending, then newdata file, the file of described newdata file is called: data time time.data; In end-of-file tailOffset position log file essential information, { wherein, the start time is data time for startTime, 0,0}, and the end time is that 0 expression does not terminate, current data section writing position 0, and is recorded in the data structure of the file handle in internal memory.
If S32 finds with the data file of .data ending, file reading tail information, described end-of-file packets of information is containing write side-play amount offset; File reading tail recorded information { startTime, 0, offset}, wherein, the start time is data time, and the end time is that 0 expression does not terminate, current data section writing position offset, and file is write side-play amount be set to offset, and be recorded in the data structure of the file handle in internal memory.
S33, be written in described data file by described time series data, the write reference position of described time series data is said write side-play amount offset;
S34, write index information, be written to described first index information in data segment index corresponding to end-of-file, be written in the secondary index of end-of-file by described second index information.
In the present embodiment, also comprise after described step S34:
If the described data file of step S35 reaches data segment maximum length, close described data file, set up new data file and write.
Embodiment three
As shown in Figure 3, in the present embodiment, described step S40 comprises:
S41, reception inquiry request, described inquiry request comprises data source identification and data time;
S42, the data source identification of described inquiry request is generated several bytes by hash algorithm, each byte is converted into the character string of 16 systems, and searches corresponding catalogue;
S43, the filename under described catalogue to be sorted according to inverted order, find out first filename less than the data time of described inquiry request;
S44, open data file corresponding to described filename, and the index information at file reading end;
S55, read the data message of the time series data of inquiry request according to described index information.
Embodiment four
As shown in Figure 4, a kind of device accessing magnanimity time series data, comprising:
Receiver module 10, for time of reception sequence data, described time series data comprises data source identification, data time and data message;
Modular converter 20, for described data source identification is generated several bytes by hash algorithm, sets up and several bytes described some layers of catalogue one to one;
Memory module 30, for being stored in described catalogue by described time series data with the form of data file, described data file comprises data segment and index segment, and the filename of described data file is generated by described data time;
Read module 40, for receiving inquiry request, described inquiry request comprises data source identification and data time, reads corresponding time series data according to described inquiry request and index segment from described catalogue.
Embodiment five
As shown in Figure 5, in the present embodiment, described memory module 30 comprises:
Data file sets up unit 31, all with the data file of .data ending for searching in catalogue, and the data file that locating file name is maximum, if do not exist with the data file of .data ending, then newdata file, the file of described newdata file is called: data time .data;
Side-play amount writing unit 32, for finding with after the data file of .data ending, file reading tail information, described end-of-file packets of information is containing write side-play amount offset;
Data message writing unit 33, for being written in described data file by described time series data, the write reference position of described time series data is said write side-play amount offset;
Index information writing unit 34, for writing index information, being written to described first index information in data segment index corresponding to end-of-file, being written in the secondary index of end-of-file by described second index information.
Embodiment six
As shown in Figure 6, in the present embodiment, described read module 40 comprises:
Inquiry request receiving element 41, for receiving inquiry request, described inquiry request comprises data source identification and data time;
Inquiry request converting unit 42, for the data source identification of described inquiry request is generated several bytes by hash algorithm, is converted into the character string of 16 systems, and searches corresponding catalogue by each byte;
Sequencing unit 43, for sorting according to inverted order to the filename under described catalogue, finds out first filename less than the data time of described inquiry request;
Index information reading unit 44, for opening data file corresponding to described filename, and the index information at file reading end;
Data message reading unit 45, for reading the data message of the time series data of inquiry request according to described index information.
The foregoing is only the specific embodiment of the present invention, these describe just in order to explain principle of the present invention, and can not be interpreted as limiting the scope of the invention by any way.Based on explanation herein, those skilled in the art does not need to pay performing creative labour can associate other specific implementation method of the present invention, and these modes all will fall within protection scope of the present invention.
Claims (10)
1. access a method for magnanimity time series data, it is characterized in that, comprising:
S10, time of reception sequence data, described time series data comprises data source identification, data time and data message;
S20, described data source identification is generated several bytes by hash algorithm, set up and several bytes described some layers of catalogue one to one;
S30, be stored in described catalogue by described time series data with the form of data file, described data file comprises data segment and index segment, and the filename of described data file is generated by described data time;
S40, reception inquiry request, described inquiry request comprises data source identification and data time, reads corresponding time series data according to described inquiry request and index segment from described catalogue.
2. a kind of method accessing magnanimity time series data according to claim 1, is characterized in that, described data segment is used for recording described data message, and described index segment is used for essential information and the index information of recording data files.
3. a kind of method accessing magnanimity time series data according to claim 2, it is characterized in that, described essential information comprises data file start time, end of data file time and data source identification, described index information comprises the first index information and the second index information, described first index information records start time corresponding to each data segment and data file deviation post in order, and described second index information comprises wall scroll index data size, the total size of index segment information, end-of-file position and file overall length.
4. a kind of method accessing magnanimity time series data according to claim 3, it is characterized in that, described step S20 is specially:
Described data source identification is generated the shape data of four bytes by hash algorithm, by last byte of described four bytes, successively forward, set up and described four bytes root directory, one deck catalogue, two layers of catalogue and three layers of catalogue one to one.
5. a kind of method accessing magnanimity time series data according to claim 4, it is characterized in that, described step S30 comprises:
S31, search in catalogue all with the data file of .data ending, and the data file that locating file name is maximum, if do not exist with the data file of .data ending, then newdata file, the file of described newdata file is called: data time .data;
If S32 finds with the data file of .data ending, file reading tail information, described end-of-file packets of information is containing write side-play amount;
S33, be written in described data file by described time series data, the write reference position of described time series data is said write side-play amount;
S34, write index information, be written to described first index information in data segment index corresponding to end-of-file, be written in the secondary index of end-of-file by described second index information.
6. a kind of method accessing magnanimity time series data according to claim 5, is characterized in that, also comprise after described step S34:
If the described data file of step S35 reaches data segment maximum length, close described data file, set up new data file and write.
7. a kind of method accessing magnanimity time series data according to claim 1, it is characterized in that, described step S40 comprises:
S41, reception inquiry request, described inquiry request comprises data source identification and data time;
S42, the data source identification of described inquiry request is generated several bytes by hash algorithm, each byte is converted into the character string of 16 systems, and searches corresponding catalogue;
S43, the filename under described catalogue to be sorted according to inverted order, find out first filename less than the data time of described inquiry request;
S44, open data file corresponding to described filename, and the index information at file reading end;
S55, read the data message of the time series data of inquiry request according to described index information.
8. access a device for magnanimity time series data, it is characterized in that, comprising:
Receiver module, for time of reception sequence data, described time series data comprises data source identification, data time and data message;
Modular converter, for described data source identification is generated several bytes by hash algorithm, sets up and several bytes described some layers of catalogue one to one;
Memory module, for being stored in described catalogue by described time series data with the form of data file, described data file comprises data segment and index segment, and the filename of described data file is generated by described data time;
Read module, for receiving inquiry request, described inquiry request comprises data source identification and data time, reads corresponding time series data according to described inquiry request and index segment from described catalogue.
9. a kind of device accessing magnanimity time series data according to claim 8, it is characterized in that, described memory module comprises:
Data file sets up unit, all with the data file of .data ending for searching in catalogue, and the data file that locating file name is maximum, if do not exist with the data file of .data ending, then newdata file, the file of described newdata file is called: data time .data;
Side-play amount writing unit, for finding with after the data file of .data ending, file reading tail information, described end-of-file packets of information is containing write side-play amount;
Data message writing unit, for being written in described data file by described time series data, the write reference position of described time series data is said write side-play amount;
Index information writing unit, for writing index information, being written to described first index information in data segment index corresponding to end-of-file, being written in the secondary index of end-of-file by described second index information.
10. a kind of device accessing magnanimity time series data according to claim 8, it is characterized in that, described read module comprises:
Inquiry request receiving element, for receiving inquiry request, described inquiry request comprises data source identification and data time;
Inquiry request converting unit, for the data source identification of described inquiry request is generated several bytes by hash algorithm, is converted into the character string of 16 systems, and searches corresponding catalogue by each byte;
Sequencing unit, for sorting according to inverted order to the filename under described catalogue, finds out first filename less than the data time of described inquiry request;
Index information reading unit, for opening data file corresponding to described filename, and the index information at file reading end;
Data message reading unit, for reading the data message of the time series data of inquiry request according to described index information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510300297.8A CN104881481B (en) | 2015-06-03 | 2015-06-03 | A kind of method and device for accessing magnanimity time series data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510300297.8A CN104881481B (en) | 2015-06-03 | 2015-06-03 | A kind of method and device for accessing magnanimity time series data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104881481A true CN104881481A (en) | 2015-09-02 |
| CN104881481B CN104881481B (en) | 2018-05-01 |
Family
ID=53948974
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510300297.8A Active CN104881481B (en) | 2015-06-03 | 2015-06-03 | A kind of method and device for accessing magnanimity time series data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104881481B (en) |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106776823A (en) * | 2016-11-25 | 2017-05-31 | 华为技术有限公司 | A kind of time series data management method, equipment and device |
| CN107590157A (en) * | 2016-07-08 | 2018-01-16 | 腾讯科技（深圳）有限公司 | A kind of date storage method, data query method and relevant device |
| CN108399263A (en) * | 2018-03-15 | 2018-08-14 | 北京大众益康科技有限公司 | The storage of time series data and querying method and storage and processing platform |
| CN108664664A (en) * | 2018-05-22 | 2018-10-16 | 电子科技大学 | A kind of magnanimity educational documentation associated storage method |
| CN108877899A (en) * | 2018-03-20 | 2018-11-23 | 青岛海信医疗设备股份有限公司 | The processing method and server of DICOM image |
| CN109143342A (en) * | 2018-08-23 | 2019-01-04 | 成都爱为贝思科技有限公司 | A kind of seismic prospecting wireless collection data fusion method |
| CN109164980A (en) * | 2018-08-03 | 2019-01-08 | 北京涛思数据科技有限公司 | A kind of optimizing polymerization processing method of time series data |
| WO2019057081A1 (en) * | 2017-09-21 | 2019-03-28 | 杭州海康威视系统技术有限公司 | Data storage method, data query method, computer device, and storage medium |
| CN111061684A (en) * | 2019-12-31 | 2020-04-24 | 成都科来软件有限公司 | Data packet file time sequence recovery system |
| CN111078153A (en) * | 2019-12-20 | 2020-04-28 | 同方知网(北京)技术有限公司 | Distributed storage method based on files |
| CN111400266A (en) * | 2019-01-02 | 2020-07-10 | 阿里巴巴集团控股有限公司 | Data processing method and system, and diagnosis processing method and device of operation event |
| CN111566627A (en) * | 2017-11-09 | 2020-08-21 | 日本电信电话株式会社 | Information accumulation device, data processing system, and program |
| CN111563024A (en) * | 2020-07-15 | 2020-08-21 | 北京升鑫网络科技有限公司 | Method and device for monitoring container process on host machine and computing equipment |
| CN114185934A (en) * | 2021-12-15 | 2022-03-15 | 广州辰创科技发展有限公司 | Indexing and query method and system based on Tiandun database column storage |
| CN115905122A (en) * | 2023-02-20 | 2023-04-04 | 成都九洲电子信息系统股份有限公司 | Flight track data storage and retrieval system, method and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1545660A (en) * | 2001-06-22 | 2004-11-10 | ��� | Method and system for collecting and retrieving time-series, real-time and non-real-time data |
| CN102446184A (en) * | 2010-10-12 | 2012-05-09 | 上海可鲁系统软件有限公司 | Industrial data storage and index method based on time series |
| CN104090987A (en) * | 2014-07-28 | 2014-10-08 | 华中科技大学 | Historical data storage and indexing method |
| CN104156385A (en) * | 2014-06-24 | 2014-11-19 | 北京京东尚科信息技术有限公司 | Method and device for processing time series data |
-
2015
- 2015-06-03 CN CN201510300297.8A patent/CN104881481B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1545660A (en) * | 2001-06-22 | 2004-11-10 | ��� | Method and system for collecting and retrieving time-series, real-time and non-real-time data |
| CN102446184A (en) * | 2010-10-12 | 2012-05-09 | 上海可鲁系统软件有限公司 | Industrial data storage and index method based on time series |
| CN104156385A (en) * | 2014-06-24 | 2014-11-19 | 北京京东尚科信息技术有限公司 | Method and device for processing time series data |
| CN104090987A (en) * | 2014-07-28 | 2014-10-08 | 华中科技大学 | Historical data storage and indexing method |
Cited By (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107590157A (en) * | 2016-07-08 | 2018-01-16 | 腾讯科技（深圳）有限公司 | A kind of date storage method, data query method and relevant device |
| CN106776823A (en) * | 2016-11-25 | 2017-05-31 | 华为技术有限公司 | A kind of time series data management method, equipment and device |
| WO2018095299A1 (en) * | 2016-11-25 | 2018-05-31 | 华为技术有限公司 | Time sequence data management method, device and apparatus |
| US11269902B2 (en) | 2016-11-25 | 2022-03-08 | Huawei Technologies Co., Ltd. | Time series data management method, device, and apparatus |
| CN106776823B (en) * | 2016-11-25 | 2018-12-07 | 华为技术有限公司 | A kind of time series data management method, equipment and device |
| WO2019057081A1 (en) * | 2017-09-21 | 2019-03-28 | 杭州海康威视系统技术有限公司 | Data storage method, data query method, computer device, and storage medium |
| CN109542330A (en) * | 2017-09-21 | 2019-03-29 | 杭州海康威视系统技术有限公司 | Date storage method, data query method and device |
| CN111566627B (en) * | 2017-11-09 | 2023-07-21 | 日本电信电话株式会社 | Information accumulation device, data processing system, and recording medium |
| CN111566627A (en) * | 2017-11-09 | 2020-08-21 | 日本电信电话株式会社 | Information accumulation device, data processing system, and program |
| CN108399263A (en) * | 2018-03-15 | 2018-08-14 | 北京大众益康科技有限公司 | The storage of time series data and querying method and storage and processing platform |
| CN108399263B (en) * | 2018-03-15 | 2022-03-01 | 北京大众益康科技有限公司 | Time sequence data storage and query method and storage and processing platform |
| CN108877899A (en) * | 2018-03-20 | 2018-11-23 | 青岛海信医疗设备股份有限公司 | The processing method and server of DICOM image |
| CN108664664A (en) * | 2018-05-22 | 2018-10-16 | 电子科技大学 | A kind of magnanimity educational documentation associated storage method |
| CN109164980B (en) * | 2018-08-03 | 2024-02-02 | 北京涛思数据科技有限公司 | Aggregation optimization processing method for time sequence data |
| CN109164980A (en) * | 2018-08-03 | 2019-01-08 | 北京涛思数据科技有限公司 | A kind of optimizing polymerization processing method of time series data |
| CN109143342A (en) * | 2018-08-23 | 2019-01-04 | 成都爱为贝思科技有限公司 | A kind of seismic prospecting wireless collection data fusion method |
| CN111400266A (en) * | 2019-01-02 | 2020-07-10 | 阿里巴巴集团控股有限公司 | Data processing method and system, and diagnosis processing method and device of operation event |
| CN111400266B (en) * | 2019-01-02 | 2023-05-02 | 阿里巴巴集团控股有限公司 | Data processing method and system, and diagnosis processing method and device for operation event |
| CN111078153A (en) * | 2019-12-20 | 2020-04-28 | 同方知网(北京)技术有限公司 | Distributed storage method based on files |
| CN111061684B (en) * | 2019-12-31 | 2023-04-07 | 科来网络技术股份有限公司 | Data packet file time sequence recovery system |
| CN111061684A (en) * | 2019-12-31 | 2020-04-24 | 成都科来软件有限公司 | Data packet file time sequence recovery system |
| CN111563024A (en) * | 2020-07-15 | 2020-08-21 | 北京升鑫网络科技有限公司 | Method and device for monitoring container process on host machine and computing equipment |
| CN114185934A (en) * | 2021-12-15 | 2022-03-15 | 广州辰创科技发展有限公司 | Indexing and query method and system based on Tiandun database column storage |
| CN115905122A (en) * | 2023-02-20 | 2023-04-04 | 成都九洲电子信息系统股份有限公司 | Flight track data storage and retrieval system, method and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104881481B (en) | 2018-05-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104881481A (en) | Method and device for accessing mass time sequence data | |
| CN103902623B (en) | Method and system for the accessing file in storage system | |
| CN105069048A (en) | Small file storage method, query method and device | |
| CN107918612B (en) | The implementation method and device of key assignments memory system data structure | |
| CN106874348B (en) | File storage and index method and device and file reading method | |
| US7761648B2 (en) | Caching method for NAND flash translation layer | |
| CN104462141B (en) | Method, system and the storage engines device of a kind of data storage and inquiry | |
| CN108255408A (en) | Date storage method and system | |
| CN106649627B (en) | A kind of method and apparatus that log is searched | |
| CN102968422B (en) | System and method for controlling streaming data storage | |
| CN102467572B (en) | Data block inquiring method for supporting data de-duplication program | |
| CN107045531A (en) | A kind of system and method for optimization HDFS small documents access | |
| CN103678491A (en) | Method based on Hadoop small file optimization and reverse index establishment | |
| CN101464901B (en) | Object search method in object storage device | |
| CN105468642A (en) | Data storage method and apparatus | |
| CN102375853A (en) | Distributed database system, method for building index therein and query method | |
| WO2013152678A1 (en) | Method and device for metadata query | |
| CN103488709A (en) | Method and system for building indexes and method and system for retrieving indexes | |
| CN106227677B (en) | A kind of method of elongated cache metadata management | |
| CN105653592A (en) | Small file merging tool and method based on HDFS | |
| US20110040761A1 (en) | Estimation of postings list length in a search system using an approximation table | |
| CN103186617A (en) | Data storage method and device | |
| CN109189772A (en) | File management method and system for no file system storage medium | |
| CN102346783B (en) | Data retrieval method and device | |
| CN104021223A (en) | Method and device for accessing survey point of cluster database |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 518054 Futian District, Guangdong, Shennan Road, Press Plaza, room, room 1306 Applicant after: ANKE ROBOT CO.,LTD. Address before: 518054 Futian District, Guangdong, Shennan Road, Press Plaza, room, room 1306 Applicant before: ANKE SMART CITY TECHNOLOGY (PRC) Co.,Ltd. |
|
| TA01 | Transfer of patent application right |
Effective date of registration: 20171212 Address after: 325200 Ruian city Ruian Economic Development Zone on the East Road in Wenzhou, Zhejiang Applicant after: Long Jianghui Address before: 518054 Futian District, Guangdong, Shennan Road, Press Plaza, room, room 1306 Applicant before: ANKE ROBOT CO.,LTD. |
|
| TA01 | Transfer of patent application right | ||
| CB03 | Change of inventor or designer information | ||
| CB03 | Change of inventor or designer information |
Inventor after: Li Feng Inventor after: Ye Weiqiang Inventor after: Chen Yu Inventor after: Zhong Ming Inventor after: Chen Guozhen Inventor before: Xu Jun |
|
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20180404 Address after: 510000 Golden Eagle building, No. 316, Yuexiu District Ring Road, Guangzhou City, Guangdong Province, eleven Applicant after: Guangdong mechanical and Electrical Equipment Tendering Co.,Ltd. Address before: 325200 Ruian city Ruian Economic Development Zone on the East Road in Wenzhou, Zhejiang Applicant before: Long Jianghui |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |