CN112131433B - Interval counting query method and device - Google Patents

Interval counting query method and device Download PDF

Info

Publication number
CN112131433B
CN112131433B CN202010844843.5A CN202010844843A CN112131433B CN 112131433 B CN112131433 B CN 112131433B CN 202010844843 A CN202010844843 A CN 202010844843A CN 112131433 B CN112131433 B CN 112131433B
Authority
CN
China
Prior art keywords
counting
query
interval
time offset
storage space
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010844843.5A
Other languages
Chinese (zh)
Other versions
CN112131433A (en
Inventor
刘文昱
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Seashell Housing Beijing Technology Co Ltd
Original Assignee
Seashell Housing Beijing Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Seashell Housing Beijing Technology Co Ltd filed Critical Seashell Housing Beijing Technology Co Ltd
Priority to CN202010844843.5A priority Critical patent/CN112131433B/en
Publication of CN112131433A publication Critical patent/CN112131433A/en
Application granted granted Critical
Publication of CN112131433B publication Critical patent/CN112131433B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/901Indexing; Data structures therefor; Storage structures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/903Querying
    • G06F16/90335Query processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0201Market modelling; Market analysis; Collecting market data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Systems or methods specially adapted for specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/16Real estate

Abstract

The embodiment of the invention provides a method and a device for inquiring interval counting, wherein the method comprises the following steps: and acquiring a starting time offset and an ending time offset corresponding to the counting query interval from the storage space by determining the storage space of the counting result of the counting object, so as to determine the counting result of the counting object in the counting query interval according to the starting time offset and the ending time offset. The embodiment of the invention realizes the quick positioning of the user-defined time interval by acquiring the starting time offset and the ending time offset corresponding to the counting query interval from the storage space, thereby accurately obtaining the counting result of the counting object in the counting query interval through the acquired starting time offset and ending time offset.

Description

Interval counting query method and device
Technical Field
The invention relates to the technical field of internet, in particular to a method and a device for inquiring interval counting.
Background
In the second-hand house transaction service, a plurality of behaviors such as access, collection, praise and the like need to be counted, and the counting values are not only applied to the display page of the information, but also applied to offline analysis scenes such as list, recommendation and the like.
The technical scheme adopted by the current counting method comprises the following steps: the multi-KEY value memory accumulation scheme only records historical total values and cannot provide a custom interval counting function, but in many scenarios, a user cares about the values in a certain interval, so that an offline analysis scenario is not friendly to a cold start entity, and the most appropriate decision basis cannot be provided for the user; and the analysis scheme based on the statistical fact of the logs needs to search all the logs for statistical analysis and counting, so that the counting efficiency is low.
Therefore, how to provide a method to realize fast counting query of the user-defined time interval becomes a problem to be solved urgently.
Disclosure of Invention
Aiming at the problems in the prior art, the embodiment of the invention provides a method and a device for inquiring interval counting, which are used for solving the defect of low interval counting efficiency in the prior art and realizing quick counting inquiry of a user-defined time interval.
The embodiment of the invention provides an interval counting query method, which comprises the following steps:
determining a storage space of a counting result for the counting object;
according to the counting query interval, acquiring a starting time offset and an ending time offset corresponding to the counting query interval from the storage space; the storage space is stored with the time offset of each counting of the counting object;
and determining the counting result of the counting object in the counting query interval according to the starting time offset and the ending time offset.
According to an interval count query method of an embodiment of the present invention, before determining a storage space of a count result for a count object, the method further includes:
mapping the key values of the counting objects and establishing an addressing query index file; the addressing query index file stores the corresponding relation between the key values of the counting objects and the storage space of the counting results;
accordingly, determining a storage space of the counting result for the counting object includes:
and querying the addressing query index file according to the key value of the counting object to obtain a storage space for storing the counting result of the counting object.
According to the interval counting query method of one embodiment of the invention, key frames are marked in the storage space at intervals of a preset number of time offsets;
correspondingly, according to the counting query interval, obtaining the start time offset and the end time offset corresponding to the counting query interval from the storage space, including:
and acquiring a starting time offset and an ending time offset corresponding to the counting query interval from the storage space by utilizing the key frames in the storage space and adopting a binary search method according to the counting query interval.
According to an embodiment of the present invention, a method for querying a counting interval according to a starting time offset and an ending time offset, which determines a counting result of a counting object in the counting query interval, includes:
determining a corresponding starting offset address and a corresponding ending offset address according to the starting time offset and the ending time offset;
and determining a counting result of the counting object in the counting query interval according to the difference value of the starting offset address and the ending offset address.
The interval counting query method according to an embodiment of the present invention further includes:
determining a habitual counting query interval for a counting object;
determining a starting time offset and an ending time offset corresponding to the habitual counting query interval;
storing the starting time offset and the ending time offset corresponding to the conventional counting query interval into the addressing query index file;
correspondingly, when the counting query interval is judged and known to be the conventional counting query interval, acquiring a starting time offset and an ending time offset corresponding to the conventional counting query interval from the addressing query index file, and determining a starting offset address and an ending offset address corresponding to the conventional counting query interval according to the starting time offset and the ending time offset corresponding to the conventional counting query interval;
and determining the counting result of the counting object in the conventional counting query interval according to the starting offset address and the ending offset address corresponding to the conventional counting query interval.
According to the interval counting query method of one embodiment of the invention, the addressing query index file carries length information of a storage space;
correspondingly, according to the counting query interval, obtaining a start time offset and an end time offset corresponding to the counting query interval from the storage space, and according to the start time offset and the end time offset, determining a counting result of the counting object in the counting query interval, including:
and if the counting query interval is the full interval recorded by the storage space, outputting the length value of the storage space as the counting result of the counting query interval.
An embodiment of the present invention further provides an interval counting query device, including:
a first query unit for determining a storage space of a counting result for the counting object;
the second query unit is used for acquiring a starting time offset and an ending time offset corresponding to the counting query interval from the storage space according to the counting query interval; the storage space is stored with the time offset of each counting of the counting object;
and the counting unit is used for determining the counting result of the counting object in the counting inquiry interval according to the starting time offset and the ending time offset.
The section count query device according to an embodiment of the present invention further includes:
the index unit is used for mapping the key values of the counting objects before determining the storage space of the counting results aiming at the counting objects, and establishing an addressing query index file; the addressing query index file stores the corresponding relation between the key values of the counting objects and the storage space of the counting results;
correspondingly, the first query unit is specifically configured to:
and querying the addressing query index file according to the key value of the counting object to obtain a storage space for storing the counting result of the counting object.
According to the interval counting query device of one embodiment of the invention, key frames are marked in the storage space at intervals of a preset number of time offsets;
correspondingly, the second query unit is specifically configured to:
and acquiring a starting time offset and an ending time offset corresponding to the counting query interval from the storage space by utilizing the key frames in the storage space and adopting a binary search method according to the counting query interval.
According to an embodiment of the present invention, the counting unit is specifically configured to:
determining a corresponding starting offset address and a corresponding ending offset address according to the starting time offset and the ending time offset;
and determining a counting result of the counting object in the counting query interval according to the difference value of the starting offset address and the ending offset address.
The section count query device according to an embodiment of the present invention further includes: a third query unit, specifically configured to:
determining a habitual counting query interval for a counting object;
determining a starting time offset and an ending time offset corresponding to the habitual counting query interval;
storing the starting time offset and the ending time offset corresponding to the conventional counting query interval into the addressing query index file;
correspondingly, when the counting query interval is judged and known to be the conventional counting query interval, acquiring a starting time offset and an ending time offset corresponding to the conventional counting query interval from the addressing query index file, and determining a starting offset address and an ending offset address corresponding to the conventional counting query interval according to the starting time offset and the ending time offset corresponding to the conventional counting query interval;
and determining the counting result of the counting object in the conventional counting query interval according to the starting offset address and the ending offset address corresponding to the conventional counting query interval.
According to the interval counting query device of one embodiment of the invention, the addressing query index file carries length information of a storage space;
correspondingly, if the counting query interval in the second query unit is the full interval recorded in the storage space, the counting unit outputs the length value of the storage space as the counting result of the counting query interval.
The embodiment of the present invention further provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and capable of running on the processor, wherein the processor implements any of the above steps of the interval count query method when executing the program.
Embodiments of the present invention further provide a non-transitory computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the steps of the interval count query method according to any one of the above.
According to the interval counting query method and device provided by the embodiment of the invention, the time offset for each counting of the counting object is stored in the designated storage space, so that the start time offset and the end time offset corresponding to the counting query interval can be obtained from the storage space according to the start time offset and the end time offset corresponding to the counting query interval, and further, the counting result of the counting object in the corresponding counting query interval can be determined according to the start time offset and the end time offset. Therefore, the embodiment of the invention generates and stores one corresponding time offset for each counting behavior of the counting object, so that the counting result of the counting object in the corresponding counting query interval can be queried subsequently according to the starting time offset and the ending time offset corresponding to the counting query interval.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
Fig. 1 is a schematic flowchart of an interval counting query method according to an embodiment of the present invention;
FIG. 2 is a diagram illustrating a structure of an index file for addressing query according to an embodiment of the present invention;
FIG. 3 is a diagram illustrating a data file structure provided by an embodiment of the present invention;
fig. 4 is a schematic structural diagram of an interval counting query apparatus according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a schematic flow chart of a method for querying an interval count according to an embodiment of the present invention, and as shown in fig. 1, the method for querying an interval count according to an embodiment of the present invention includes:
step 110, determining a storage space of the counting result for the counting object.
In this step, the storage space stores the time shift amount corresponding to each counting of the counting target. It is understood that the counting object herein may be a certain house source access condition, a certain house source collection condition, a certain house source approval condition, a certain cell access condition, a certain cell collection condition, a certain cell approval condition, and the like. For example, in second-hand business such as house property transaction, it is necessary to count a plurality of behaviors such as access, collection, praise, and the like, and a conventional method only records a historical total Value by using a Key-Value (hereinafter, abbreviated as "KV") counting scheme, and cannot query the count of any time interval. Therefore, in order to query the count of any time interval, the embodiment of the present invention stores the time offset corresponding to each counting of the counting object in the corresponding storage space, so that the counting result of any time interval can be obtained from the storage space according to the actual demand, for example, the time offset corresponding to each access of the room source a of the counting object is stored in the corresponding storage space, and then the access amount data of the room source a in any time interval can be obtained according to the storage space.
The advantages of this embodiment over the conventional method using KV counting scheme are: in this embodiment, the time offset for each counting of the counting object is stored in the designated storage space, so that the start time offset and the end time offset corresponding to the counting query interval can be obtained from the storage space according to the start time offset and the end time offset corresponding to the counting query interval, and further, the counting result of the counting object in the corresponding counting query interval can be determined according to the start time offset and the end time offset. Therefore, the embodiment can make up for the defects that the traditional method only can record historical total numerical values and cannot inquire the counting of any time interval in the service function.
In this step, the storage space stores the time offset amount corresponding to each count of the counting target, for example, if the house source a has 5 access records at the time a (assuming that the timestamp corresponding to the time a is 1), 2 access records at the time b (assuming that the timestamp corresponding to the time b is 2), and 3 records at the time c (assuming that the timestamp corresponding to the time c is 3), the house source a access amount storage space records are "1, 1, 1, 1, 1, 2, 2, 3, 3, 3", the time offset amount corresponding to the time b is 6, and the time offset amount corresponding to the time c is 8. Therefore, in the embodiment, the time offset corresponding to each counting of the counting object is stored in the storage space, and compared with the method of recording the actual numerical value of each counting based on the log statistical fact analysis scheme in the conventional method, the value range of the stored time offset is small, so that not only is the occupied storage space reduced, but also the counting result of the counting query interval can be rapidly and accurately obtained by counting the start time offset and the end time offset corresponding to the query interval.
Step 120, according to the counting query interval, obtaining a starting time offset and an ending time offset corresponding to the counting query interval from a storage space; the storage space stores the time offset of each counting of the counting object.
In this step, when the counting object counts every time, the corresponding time offset can be stored in the storage space, wherein the time offset can adopt a timestamp recording method, each time the updating operation corresponds to a 4-byte complete timestamp, and according to the start time and the end time contained in the counting query interval, the start time offset corresponding to the start time and the end time offset corresponding to the end time can be obtained from the storage space corresponding to the counting object.
For example, the time offset corresponding to each access is recorded and stored in the access amount storage space of the house source a, and if the access amount of the house source a in the time intervals a to b needs to be queried, the time offset corresponding to the time a and the time offset corresponding to the time b need only be acquired from the storage space, and then the access amount of the house source a in the time intervals a to b can be determined according to the time offset corresponding to the time a and the time offset corresponding to the time b.
And step 130, determining a counting result of the counting object in the counting query interval according to the starting time offset and the ending time offset.
In this step, according to the start time offset and the end time offset obtained in step 120, the counting result of the counting object in the counting query interval can be determined. For example, the access amount of the house source a in the time intervals a to b needs to be queried, the time offset corresponding to the time a and the time offset corresponding to the time b can be obtained from the access amount storage space of the house source a, and then the access amount of the house source a in the time intervals a to b can be determined according to the time offset corresponding to the time a and the time offset corresponding to the time b.
It should be noted that, in the conventional method, based on the log statistical fact analysis scheme, all logs need to be searched for statistical analysis counting, and the counting efficiency is low, for example, if the counting results at time 1 to 3 are to be queried, the counting results at time 1, time 2 and time 3 need to be counted respectively, and then the counting results at time 1 to 3 are obtained. However, in the embodiment of the present invention, only the time offset corresponding to the time 1 and the time offset corresponding to the time 3 need to be queried from the storage space, and then the counting result in the time interval 1-3 can be determined according to the time offset corresponding to the time 1 and the time offset corresponding to the time 3, and query statistics on the intermediate time 2 is not needed, so that not only the query interval can be quickly and accurately located, but also the counting query efficiency is greatly improved.
Therefore, compared with the traditional method based on the log statistical fact analysis scheme, the counting result interval of the counting object in the counting query interval can be determined only by acquiring the starting time offset and the ending time offset corresponding to the query interval without counting the counting result corresponding to each moment in the query interval, so that the query interval can be quickly and accurately positioned, and the counting query efficiency is greatly improved.
In the interval counting query method provided by the embodiment of the invention, the time offset for each counting of the counting object is stored in the designated storage space, so that the start time offset and the end time offset corresponding to the counting query interval can be acquired from the storage space according to the start time offset and the end time offset corresponding to the counting query interval, and further, the counting result of the counting object in the corresponding counting query interval can be determined according to the start time offset and the end time offset. Therefore, the embodiment of the invention generates and stores one corresponding time offset for each counting behavior of the counting object, so that the counting result of the counting object in the corresponding counting query interval can be queried subsequently according to the starting time offset and the ending time offset corresponding to the counting query interval.
Based on the content of the foregoing embodiment, as an optional embodiment, before determining the storage space of the counting result for the counting object, the method further includes:
mapping the key values of the counting objects and establishing an addressing query index file; addressing and inquiring a corresponding relation between a key value of a counting object and a storage space of a counting result stored in an index file;
accordingly, determining a storage space of the counting result for the counting object includes:
and inquiring the addressing query index file according to the key value of the counting object to obtain a storage space for storing the counting result of the counting object.
In this embodiment, it can be understood that there are many counting objects that need to perform counting statistics, that is, a storage space is needed for each counting object to store a time offset of each counting of the corresponding counting object. Therefore, an addressing query index file is required to be established for storing the corresponding relation between the key values of the counting objects and the storage space of the counting result, so that the storage space for storing the counting result of the corresponding counting object is determined according to the key value of any counting object.
Specifically, the key values of the counting objects can be mapped, and an addressing query index file is established; and then querying the addressing query index file according to the key values of the counting objects to obtain a storage space for storing the counting results of the counting objects. Therefore, according to the embodiment, the storage space corresponding to the counting can be quickly and accurately found according to the key value of any counting object, and then the corresponding counting result can be obtained from the storage space.
It can be understood that the addressing query index file is used for maintaining the location information of the storage space corresponding to the key value of the counting object, and the storage space of the counting object can be quickly located by inputting the key value of the counting object and querying the addressing query index file, so as to obtain the corresponding counting result. For example: if the access amount data information of the house source A needs to be inquired, the addressing inquiry index file stores the corresponding relation between the house source A number and the house source A access amount storage space, so that the access amount storage space of the house source A can be positioned and corresponding data information can be acquired only by inputting the house source A number and inquiring the addressing inquiry index file.
Fig. 2 is a schematic diagram of a structure of an address query index file according to an embodiment of the present invention, and as shown in fig. 2, a key value, i.e., a key value, of a counting object according to an embodiment of the present invention is a continuous number type by default, and if the key value required by a service does not meet the rule, an escape through alloc service and kv mapping is required. Setting the upper limit of the key value to realize the initialized occupation, opening up the continuous space of the memory/disk at one time, ensuring that the operations such as space application and the like are not involved when the index file is searched by addressing, and realizing the O (1) time complexity; for any key, the index information position is key length. Basic information such as the position, the length and the capacity of a data file block corresponding to the key maintained by the index file is addressed, meanwhile, pointer positions of a plurality of caches of control information such as meta types and the like are reserved, and pointers in pointer storage intervals (common modes such as last layer/month/day) are reserved, so that reading acceleration is realized. According to the embodiment of the invention, the index data position can be calculated for each key value, enough space is reserved to increase a newly-added query interval in real time, the data files are aggregated according to the keys, the time increment of the next counting action is recorded according to bytes, and the recording of high compression ratio is realized.
According to the interval counting query method provided by the embodiment of the invention, the storage space of the counting result of the counting object is obtained by establishing the addressing query index file and querying the addressing query index file according to the key value of the counting object, so that the storage space of the counting result can be quickly and accurately positioned, and corresponding data information is obtained.
Based on the content of the above embodiment, as an optional embodiment, the storage space is marked with key frames every preset number of time offsets;
correspondingly, according to the counting query interval, obtaining the starting time offset and the ending time offset corresponding to the counting query interval from the storage space, including:
and acquiring a starting time offset and an ending time offset corresponding to the counting query interval from the storage space by utilizing the key frames in the storage space and adopting a binary search method according to the counting query interval.
In this step, key frames are marked in the storage space at intervals of a preset number of time offsets, and according to the counting query interval, the start time offset and the end time offset corresponding to the counting query interval are acquired from the storage space by using the key frames in the storage space and adopting a binary search method.
For example, if the house source a has 5 access records at the time a (assuming that the timestamp corresponding to the time a is 1), 2 access records at the time b (assuming that the timestamp corresponding to the time b is 2), 3 access records at the time c (assuming that the timestamp corresponding to the time c is 3), if the fixed position is adopted to set the key frame, the record of the access amount storage space of the house source a is "1, 0, 0, 0, 0, 0, 2, 0, 3, 0, 0", and one key frame is set in the access amount storage space of the house source a at every preset number of time offsets, and if the key frame at the middle position of the access amount storage space of the house source a corresponds to the time 2, if the time offset corresponding to the time 3 needs to be searched, the time corresponding to the key frame at the time 2 is first compared with the time 3, and the time 3 is judged to be after the time 2, the search is continued after the key frame corresponding to the time 2, and the search is not required to be performed in the key frame before the time 2, so that the query of the counting result in any interval can be further accelerated. Meanwhile, compared with a complete time stamp recording method, due to the fact that the key frame is set, the access record at the same moment as the moment a can be recorded as '1, 0, 0, 0, 0', and the '0' is small in value range, occupied storage space is small, and storage of the data file is further compressed.
Therefore, the key frames are set at the fixed positions, the rapid positioning of the time points is supported, meanwhile, the key frames of the data files are positioned by utilizing the binary system, the rapid query of any interval is realized, the cache of the corresponding offset is added into the index structure, and the next query only needs to be carried out to further speed up the query.
It should be noted that, according to the embodiment of the present invention, the timestamp recording or the key frame setting at the fixed position may be selected according to the sparsity of the service. For example, for a sparse update service, for example, the number of updates per month is less than a preset threshold, the data file may use a timestamp recording method, each update operation corresponds to a complete timestamp of 4 bytes, and for a frequent update service, for example, the number of updates per month is greater than the preset threshold, the data file may use a fixed location to set a key frame, so as to further compress the storage space of the data file.
Fig. 3 is a schematic diagram of a data file structure provided in an embodiment of the present invention, and as shown in fig. 3, a whole data file block is a fully-incremented array, and a fast positioning in a fast time interval can be performed through a binary search scheme, and in a scene where updating is sparse, a default data file length is limited, and space occupation is not considered in a critical manner. For frequent update services, for example, if the monthly update frequency is greater than a preset threshold, compression of the data file needs to be considered in correspondence to more count request records, so that a fixed position is adopted to identify a key frame timestamp, a difference value between each subsequent byte record and the last time timestamp is counted, and 75% compression is realized, and compression of the data file can also be realized by adopting a higher or lower ratio according to the service frequency, which is not specifically limited in the embodiment of the present invention. Therefore, the structure of the data file can reduce the occupation of space and the time consumption of query under the principle that the record length corresponds to the size of the count value.
It should be noted that, because the data file is structured by using the size of the count value corresponding to the record length, if the counting query interval is a full interval (i.e., all history records), the length value recorded in the data file is the counting result of the query interval, and it is not necessary to calculate the counting result based on the start time offset and the end time offset in the above steps, so as to further accelerate the acquisition of the counting result of the query interval.
In addition, the key value corresponding to the record in the addressing query index file can be regarded as sparse service, the complete timestamp record is adopted, then the sparsity of data writing can be judged when the capacity of the later file is expanded, whether the frequent service is converted is determined, and the fixed position identification key frame timestamp is adopted.
The data files are initially distributed in a default value reservation mode, M bytes are distributed to newly added keys in a configuration mode, the distribution of new data nodes is triggered at the on-write time, keys updated by data are distributed, the keys without updating do not occupy storage space, and the data files are unordered. When the reserved space is full (for example, the remaining a bytes start triggering to avoid locking the write request when used up), the capacity expansion operation is performed on the data file: applying for the original 2 times space at the tail part of the data file, carrying out complete copy on the data, and updating key value index meta information after the copy is finished to point to the information such as the address, the length, the capacity and the like of the new data file; recovering the released data file space, and writing all 0 values; because the release space is kM (integral multiple of M), the release space is divided into k blocks to be provided for a new key of on-write, and the position and the length can also be recorded to be used for capacity expansion operation with enough capacity.
According to the interval counting query method provided by the embodiment of the invention, the start time offset and the end time offset corresponding to the counting query interval are obtained from the storage space by utilizing the key frames in the storage space according to the counting query interval and adopting a binary search method, so that not only can the high compression ratio of the data file be realized, the storage space be saved, but also the quick query of any interval can be realized according to the key frames.
Based on the content of the foregoing embodiment, as an optional embodiment, determining a counting result of the counting object in the counting query interval according to the start time offset and the end time offset includes:
determining a corresponding starting offset address and a corresponding ending offset address according to the starting time offset and the ending time offset;
and determining the counting result of the counting object in the counting inquiry interval according to the difference value of the starting offset address and the ending offset address.
In this step, according to the counting query interval, the query start time and the query end time can be determined, and the start time offset and the end time offset can be obtained from the storage space, so that the start offset address corresponding to the start time offset and the end offset address corresponding to the end time offset can be determined, and according to the difference value between the start offset address and the end offset address, the counting result of the counting object in the counting query interval can be determined.
It should be noted that, since the counting result obtained according to the difference between the start offset address and the end offset address is an 8-bit address, and the timestamp is a 32-bit address, the difference between the start offset address and the end offset address can be converted, that is, the difference between the start offset address and the end offset address is divided by 4, so as to obtain the required counting result.
Similarly, according to the counting query interval, the start time offset and the end time offset can be determined, the start time offset and the end time offset respectively correspond to a closest key frame, and according to the closest key frame, a binary search method is adopted to search the key frame closest to the start time offset and the key frame closest to the end time offset, so that the start time offset and the end time offset corresponding to the counting query interval can be obtained.
According to the interval counting query method provided by the embodiment of the invention, the counting result of the counting object in the counting query interval is determined according to the starting time offset and the ending time offset, so that the counting result of the interval can be rapidly and accurately queried.
Based on the content of the foregoing embodiment, as an optional embodiment, the method further includes: determining a habitual counting query interval for a counting object;
determining a starting time offset and an ending time offset corresponding to the habitual counting query interval;
storing the starting time offset and the ending time offset corresponding to the familiar counting query interval into an addressing query index file;
correspondingly, when the counting query interval is judged and known to be the familiar counting query interval, acquiring a starting time offset and an ending time offset corresponding to the familiar counting query interval from the addressing query index file, and determining a starting offset address and an ending offset address corresponding to the familiar counting query interval according to the starting time offset and the ending time offset corresponding to the familiar counting query interval;
and determining the counting result of the counting object in the habitual counting query interval according to the starting offset address and the ending offset address corresponding to the habitual counting query interval.
In this step, when a certain query interval is a conventional count query interval, if the query is frequent in the last year or month, the start time offset and the end time offset corresponding to the conventional count query interval are stored in the corresponding address query index file, so that when the count result of the conventional count query interval is queried again, the corresponding start time offset and end time offset can be directly obtained from the corresponding address query index file, the position of the storage space does not need to be obtained through the address query index file, and the start time offset and the end time offset are obtained from the storage space, thereby greatly saving the query time.
On the basis of obtaining the starting time offset and the ending time offset, the corresponding starting offset address and the corresponding ending offset address can be determined, so that the counting result of the counting object in the familiar counting query interval can be determined.
According to the interval counting query method provided by the embodiment of the invention, the starting time offset and the ending time offset corresponding to the conventional counting query interval are stored in the addressing query index file, so that the starting time offset and the ending time offset can be directly obtained, and the query of the counting result of the conventional counting query interval is further accelerated.
In addition, due to the single-process limitation of disk IO, most operations in the embodiment of the present invention are performed in a memory, and hard backup of data is required to support the occurrence of abnormal states such as restart or shutdown, power failure, and the like. By adopting an asynchronous writing scheme, an independent thread carries out sequential updating from 0 to max, a data file is written firstly, and then the addressing inquiry index file is updated (the updating of the addressing inquiry index file is delayed, so that only the count value after the last synchronization is lost, and if the data file is lost, the non-incrementability of the data file is caused, and serious results are caused). When restarting, it needs to judge whether the Max value of key changes (the ratio of the size of the addressing inquiry index file to the Max value in the configuration), if not, the addressing inquiry index file is loaded into the memory fixedly, if the change is general expansion operation (capacity can be reduced, the overflowed data file content is discarded immediately during loading), a new Max value space is applied, and then the addressing inquiry index file is used to cover the value from 0 to the length part of the addressing inquiry index file. The data file is read through a configured loading strategy, and can be completely loaded (on mem scheme) or completely read when in use (on disk scheme).
The embodiment of the invention provides a counting value query function supporting a plurality of user-defined time intervals, ensures stable reading and writing efficiency, and solves the problems of insufficient functions, poor writing efficiency, low OLAP query efficiency and the like of the traditional KV counting scheme. According to the embodiment of the invention, only one copy of the counting log is reserved, the user-defined interval is increased without increasing data redundancy, meanwhile, the high compression ratio (the space occupation is only 1% based on an OLAP scheme) is realized through the fixed position key frame setting, the O (1) level writing speed is provided, and the query efficiency is basically the same as that of the KV counting scheme.
Based on the content of the above embodiment, as an optional embodiment, the length information of the storage space is carried in the addressing query index file;
correspondingly, according to the counting query interval, obtaining the starting time offset and the ending time offset corresponding to the counting query interval from the storage space, and according to the starting time offset and the ending time offset, determining the counting result of the counting object in the counting query interval, including:
and if the counting query interval is the full interval recorded in the storage space, outputting the length value of the storage space as the counting result of the counting query interval.
In this step, since the storage space records the timestamp of each access of the counting object on each byte, the length corresponding to the storage space is the time offset corresponding to the whole interval, that is, the length value of the storage space is the counting result of the whole interval. Therefore, in the embodiment, the length information of the corresponding storage space is stored in the address query index file, so that when the counting result of the whole interval needs to be queried, the length value of the storage space in the address query index file can be directly output as the counting result of the whole interval, and the starting time offset and the ending time offset of the whole interval do not need to be queried, so that the query of the counting result of the whole interval can be further accelerated.
According to the interval counting query method provided by the embodiment of the invention, the length information of the storage space is carried in the query index file by addressing, and if the counting query interval is the whole interval recorded by the storage space, the length value of the storage space is output as the counting result of the counting query interval, so that the query of the counting result of the whole interval can be further accelerated.
The following describes the interval count query device according to the embodiment of the present invention, and the interval count query device described below and the interval count query method described above may be referred to in correspondence with each other.
Fig. 4 is a schematic structural diagram of an interval count query device according to an embodiment of the present invention, and as shown in fig. 4, an interval count query device according to an embodiment of the present invention includes:
a first querying unit 410 for determining a storage space of the counting result for the counting object.
In this scheme, in order to query the count of any time interval, the first query unit 410 stores the count result of the counting object at each time into the corresponding storage space, so that the count result of any time can be obtained from the storage space according to the actual requirement.
Compared with the KV counting scheme adopted in the traditional method, the counting result of the counting object is stored in the corresponding storage space, so that the counting result of the counting object at any time can be inquired, and the defect that the traditional method only can record historical total numerical values and cannot inquire the counting of any time interval in service function is overcome.
A second query unit 420, configured to obtain, according to the counting query interval, a start time offset and an end time offset corresponding to the counting query interval from the storage space; the storage space stores the time offset of each counting of the counting object.
In this scheme, when the counting object counts every time, the corresponding time offset is stored in the storage space, where the time offset may be a time stamp recording method, and each update operation corresponds to a 4-byte complete time stamp, and the second query unit 420 may obtain the start time offset corresponding to the start time and the end time offset corresponding to the end time from the storage space corresponding to the counting object according to the start time and the end time included in the counting query interval.
The counting unit 430 is configured to determine a counting result of the counting object in the counting query interval according to the start time offset and the end time offset.
In this embodiment, the counting unit 430 may determine a counting result of the counting object in the counting query interval according to the start time offset and the end time offset acquired in the second query unit 420.
In the interval counting query device provided in the embodiment of the present invention, since the time offset for each counting of the counting object is stored in the designated storage space, the start time offset and the end time offset corresponding to the counting query interval can be obtained from the storage space according to the start time offset and the end time offset corresponding to the counting query interval, and further, the counting result of the counting object in the corresponding counting query interval can be determined according to the start time offset and the end time offset. Therefore, the embodiment of the invention generates and stores one corresponding time offset for each counting behavior of the counting object, so that the counting result of the counting object in the corresponding counting query interval can be queried subsequently according to the starting time offset and the ending time offset corresponding to the counting query interval.
Based on the content of the foregoing embodiment, as an optional embodiment, the method further includes:
the index unit is used for mapping the key values of the counting objects before determining the storage space of the counting results aiming at the counting objects, and establishing an addressing query index file; addressing and inquiring a corresponding relation between a key value of a counting object and a storage space of a counting result stored in an index file;
accordingly, the first querying unit 410 is specifically configured to:
and inquiring the addressing query index file according to the key value of the counting object to obtain a storage space for storing the counting result of the counting object.
In this scheme, if a counting result of a counting object is to be obtained, a query needs to be performed from a corresponding storage space. In the embodiment of the invention, in order to quickly and accurately obtain the counting result in the corresponding storage space, the index unit maps the key values of the counting object and establishes the addressing query index file, the addressing query index file stores the corresponding relation between the key values of the counting object and the storage space of the counting result, namely the addressing query index file is responsible for maintaining the position information of the storage space corresponding to the key values of the counting object, and the first query unit 410 queries the addressing query index file by inputting the key values of the counting object, so that the storage space of the counting object can be quickly positioned, and the corresponding data information can be obtained.
The interval counting query device provided by the embodiment of the invention can quickly and accurately locate the storage space of the counting result and acquire corresponding data information by establishing the addressing query index file and querying the addressing query index file according to the key value of the counting object to obtain the storage space of the counting result of the counting object.
Based on the content of the above embodiments, as an alternative embodiment, the storage space is marked with key frames every preset number of time offsets.
Correspondingly, the second querying unit 420 is specifically configured to:
and acquiring a starting time offset and an ending time offset corresponding to the counting query interval from the storage space by utilizing the key frames in the storage space and adopting a binary search method according to the counting query interval.
Based on the content of the foregoing embodiment, as an optional embodiment, the counting unit 430 is specifically configured to:
determining a corresponding starting offset address and a corresponding ending offset address according to the starting time offset and the ending time offset;
and determining the counting result of the counting object in the counting inquiry interval according to the difference value of the starting offset address and the ending offset address.
Based on the content of the foregoing embodiment, as an optional embodiment, the method further includes: a third query unit, specifically configured to:
determining a habitual counting query interval for a counting object;
determining a starting time offset and an ending time offset corresponding to the habitual counting query interval;
storing the starting time offset and the ending time offset corresponding to the familiar counting query interval into an addressing query index file;
correspondingly, when the counting query interval is judged and known to be the familiar counting query interval, acquiring a starting time offset and an ending time offset corresponding to the familiar counting query interval from the addressing query index file, and determining a starting offset address and an ending offset address corresponding to the familiar counting query interval according to the starting time offset and the ending time offset corresponding to the familiar counting query interval;
and determining the counting result of the counting object in the habitual counting query interval according to the starting offset address and the ending offset address corresponding to the habitual counting query interval.
Based on the content of the foregoing embodiment, as an optional embodiment, the length information of the storage space is carried in the addressing query index file.
Accordingly, if the counting query interval in the second query unit 420 is the full interval of the storage space record, the counting unit 430 outputs the length value of the storage space as the counting result of the counting query interval.
The interval count query device according to the above embodiment may be used to execute the interval count query method according to the above first embodiment, and the principle and technical effects are similar, and will not be described in detail here.
Fig. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present invention, and as shown in fig. 5, the electronic device may include: a processor (processor)510, a communication Interface (Communications Interface)520, a memory (memory)530 and a communication bus 540, wherein the processor 510, the communication Interface 520 and the memory 530 communicate with each other via the communication bus 540. Processor 510 may invoke logic instructions in memory 530 to perform an interval count lookup method comprising: determining a storage space of a counting result for the counting object; acquiring a starting time offset and an ending time offset corresponding to the counting query interval from a storage space according to the counting query interval; the storage space stores the time offset of each counting of the counting object; and determining the counting result of the counting object in the counting query interval according to the starting time offset and the ending time offset.
Furthermore, the logic instructions in the memory 530 may be implemented in the form of software functional units and stored in a computer readable storage medium when the software functional units are sold or used as independent products. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
In another aspect, an embodiment of the present invention further provides a computer program product, where the computer program product includes a computer program stored on a non-transitory computer-readable storage medium, the computer program includes program instructions, and when the program instructions are executed by a computer, the computer can execute the interval count query method provided by the above-mentioned method embodiments, where the method includes: determining a storage space of a counting result for the counting object; acquiring a starting time offset and an ending time offset corresponding to the counting query interval from a storage space according to the counting query interval; the storage space stores the time offset of each counting of the counting object; and determining the counting result of the counting object in the counting query interval according to the starting time offset and the ending time offset.
In another aspect, an embodiment of the present invention further provides a non-transitory computer-readable storage medium, on which a computer program is stored, where the computer program is implemented to perform the interval count query method provided in the foregoing embodiments when executed by a processor, where the method includes: determining a storage space of a counting result for the counting object; acquiring a starting time offset and an ending time offset corresponding to the counting query interval from a storage space according to the counting query interval; the storage space stores the time offset of each counting of the counting object; and determining the counting result of the counting object in the counting query interval according to the starting time offset and the ending time offset.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (12)

1. An interval counting query method is characterized by comprising the following steps:
determining a storage space of a counting result for the counting object;
according to the counting query interval, acquiring a starting time offset and an ending time offset corresponding to the counting query interval from the storage space; the storage space is stored with the time offset of each counting of the counting object;
determining a counting result of the counting object in the counting query interval according to the starting time offset and the ending time offset; before determining the storage space of the counting result for the counting object, the method further comprises:
mapping the key values of the counting objects and establishing an addressing query index file; the addressing query index file stores the corresponding relation between the key values of the counting objects and the storage space of the counting results;
accordingly, determining a storage space of the counting result for the counting object includes:
and querying the addressing query index file according to the key value of the counting object to obtain a storage space for storing the counting result of the counting object.
2. The interval count query method according to claim 1, wherein the storage space is marked with key frames every predetermined number of time offsets;
correspondingly, according to the counting query interval, obtaining the start time offset and the end time offset corresponding to the counting query interval from the storage space, including:
and acquiring a starting time offset and an ending time offset corresponding to the counting query interval from the storage space by utilizing the key frames in the storage space and adopting a binary search method according to the counting query interval.
3. The interval counting query method according to claim 1, wherein determining the counting result of the counting object in the counting query interval according to the start time offset and the end time offset comprises:
determining a corresponding starting offset address and a corresponding ending offset address according to the starting time offset and the ending time offset;
and determining a counting result of the counting object in the counting query interval according to the difference value of the starting offset address and the ending offset address.
4. The interval count query method according to claim 1, further comprising:
determining a habitual counting query interval for a counting object;
determining a starting time offset and an ending time offset corresponding to the habitual counting query interval;
storing the starting time offset and the ending time offset corresponding to the conventional counting query interval into the addressing query index file;
correspondingly, when the counting query interval is judged and known to be the conventional counting query interval, acquiring a starting time offset and an ending time offset corresponding to the conventional counting query interval from the addressing query index file, and determining a starting offset address and an ending offset address corresponding to the conventional counting query interval according to the starting time offset and the ending time offset corresponding to the conventional counting query interval;
and determining the counting result of the counting object in the conventional counting query interval according to the starting offset address and the ending offset address corresponding to the conventional counting query interval.
5. The interval counting query method according to claim 1, wherein the addressing query index file carries length information of a storage space;
correspondingly, according to the counting query interval, obtaining a start time offset and an end time offset corresponding to the counting query interval from the storage space, and according to the start time offset and the end time offset, determining a counting result of the counting object in the counting query interval, including:
and if the counting query interval is the full interval recorded by the storage space, outputting the length value of the storage space as the counting result of the counting query interval.
6. An interval count inquiry apparatus, comprising:
a first query unit for determining a storage space of a counting result for the counting object;
the second query unit is used for acquiring a starting time offset and an ending time offset corresponding to the counting query interval from the storage space according to the counting query interval; the storage space is stored with the time offset of each counting of the counting object;
the counting unit is used for determining the counting result of the counting object in the counting inquiry interval according to the starting time offset and the ending time offset;
the index unit is used for mapping the key values of the counting objects before determining the storage space of the counting results aiming at the counting objects, and establishing an addressing query index file; the addressing query index file stores the corresponding relation between the key values of the counting objects and the storage space of the counting results;
correspondingly, the first query unit is specifically configured to:
and querying the addressing query index file according to the key value of the counting object to obtain a storage space for storing the counting result of the counting object.
7. The interval count query device according to claim 6, wherein the storage space is marked with key frames every predetermined number of time offsets;
correspondingly, the second query unit is specifically configured to:
and acquiring a starting time offset and an ending time offset corresponding to the counting query interval from the storage space by utilizing the key frames in the storage space and adopting a binary search method according to the counting query interval.
8. The apparatus according to claim 6, wherein the counting unit is specifically configured to:
determining a corresponding starting offset address and a corresponding ending offset address according to the starting time offset and the ending time offset;
and determining a counting result of the counting object in the counting query interval according to the difference value of the starting offset address and the ending offset address.
9. The interval count query device according to claim 6, further comprising: a third query unit, specifically configured to:
determining a habitual counting query interval for a counting object;
determining a starting time offset and an ending time offset corresponding to the habitual counting query interval;
storing the starting time offset and the ending time offset corresponding to the conventional counting query interval into the addressing query index file;
correspondingly, when the counting query interval is judged and known to be the conventional counting query interval, acquiring a starting time offset and an ending time offset corresponding to the conventional counting query interval from the addressing query index file, and determining a starting offset address and an ending offset address corresponding to the conventional counting query interval according to the starting time offset and the ending time offset corresponding to the conventional counting query interval;
and determining the counting result of the counting object in the conventional counting query interval according to the starting offset address and the ending offset address corresponding to the conventional counting query interval.
10. The interval count query device according to claim 6, wherein the addressing query index file carries length information of a storage space;
correspondingly, if the counting query interval in the second query unit is the full interval recorded in the storage space, the counting unit outputs the length value of the storage space as the counting result of the counting query interval.
11. An electronic device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the steps of the interval count query method according to any one of claims 1 to 5 when executing the program.
12. A non-transitory computer readable storage medium, having stored thereon a computer program, wherein the computer program, when executed by a processor, implements the steps of the interval count query method according to any one of claims 1 to 5.
CN202010844843.5A 2020-08-20 2020-08-20 Interval counting query method and device Active CN112131433B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010844843.5A CN112131433B (en) 2020-08-20 2020-08-20 Interval counting query method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010844843.5A CN112131433B (en) 2020-08-20 2020-08-20 Interval counting query method and device

Publications (2)

Publication Number Publication Date
CN112131433A CN112131433A (en) 2020-12-25
CN112131433B true CN112131433B (en) 2021-10-29

Family

ID=73851389

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010844843.5A Active CN112131433B (en) 2020-08-20 2020-08-20 Interval counting query method and device

Country Status (1)

Country Link
CN (1) CN112131433B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105045851A (en) * 2015-07-07 2015-11-11 福建天晴数码有限公司 Method and system for automatically creating database index according to log analysis
CN106648446A (en) * 2015-10-30 2017-05-10 阿里巴巴集团控股有限公司 Time series data storage method and apparatus, and electronic device
CN107391600A (en) * 2017-06-30 2017-11-24 北京百度网讯科技有限公司 Method and apparatus for accessing time series data in internal memory
CN108509592A (en) * 2018-03-30 2018-09-07 贵阳朗玛信息技术股份有限公司 Date storage method, read method based on Redis and device
CN111046240A (en) * 2019-11-26 2020-04-21 金蝶软件(中国)有限公司 Gateway flow statistical method, device, computer equipment and storage medium
CN111353127A (en) * 2018-12-24 2020-06-30 顺丰科技有限公司 Single variable point detection method, system, equipment and storage medium

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102740156B (en) * 2011-04-11 2014-12-10 深圳创维数字技术股份有限公司 Program playback realization method for set-top box, set-top box, server and system
US10606856B2 (en) * 2016-09-26 2020-03-31 Splunk Inc. Techniques for ingesting metrics data
US20180285479A1 (en) * 2017-04-03 2018-10-04 Superna Inc. Scalable audit analytics
CN110209887A (en) * 2019-05-08 2019-09-06 国电南瑞三能电力仪表(南京)有限公司 The dynamic memory and search method and system of a kind of diversiform data record
CN110263014A (en) * 2019-05-15 2019-09-20 广州致链科技有限公司 Block chain storage system and method towards timing type data
CN110598053A (en) * 2019-08-16 2019-12-20 上海爱数信息技术股份有限公司 Metadata management method and management system based on object tree

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105045851A (en) * 2015-07-07 2015-11-11 福建天晴数码有限公司 Method and system for automatically creating database index according to log analysis
CN106648446A (en) * 2015-10-30 2017-05-10 阿里巴巴集团控股有限公司 Time series data storage method and apparatus, and electronic device
CN107391600A (en) * 2017-06-30 2017-11-24 北京百度网讯科技有限公司 Method and apparatus for accessing time series data in internal memory
CN108509592A (en) * 2018-03-30 2018-09-07 贵阳朗玛信息技术股份有限公司 Date storage method, read method based on Redis and device
CN111353127A (en) * 2018-12-24 2020-06-30 顺丰科技有限公司 Single variable point detection method, system, equipment and storage medium
CN111046240A (en) * 2019-11-26 2020-04-21 金蝶软件(中国)有限公司 Gateway flow statistical method, device, computer equipment and storage medium

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
基于时标分层技术的时序数据存储引擎研究与实现;郑晓露等;《计算机应用》;20170615;第246-249页 *

Also Published As

Publication number Publication date
CN112131433A (en) 2020-12-25

Similar Documents

Publication Publication Date Title
CN107133234B (en) Method, device and system for updating cache data
US11636083B2 (en) Data processing method and apparatus, storage medium and electronic device
US20140359233A1 (en) Read-write control method for memory, and corresponding memory and server
CN111309720A (en) Time sequence data storage method, time sequence data reading method, time sequence data storage device, time sequence data reading device, electronic equipment and storage medium
CN106951375B (en) Method and device for deleting snapshot volume in storage system
CN110555001B (en) Data processing method, device, terminal and medium
EP3788505B1 (en) Storing data items and identifying stored data items
CN113568582B (en) Data management method, device and storage equipment
CN110647514B (en) Metadata updating method and device and metadata server
CN111061752B (en) Data processing method and device and electronic equipment
CN110147203B (en) File management method and device, electronic equipment and storage medium
CN113608701A (en) Data management method in storage system and solid state disk
CN112131433B (en) Interval counting query method and device
CN111913913A (en) Access request processing method and device
CN111694806A (en) Transaction log caching method, device, equipment and storage medium
WO2023071367A1 (en) Processing method and apparatus for communication service data, and computer storage medium
CN110795031A (en) Data deduplication method, device and system based on full flash storage
CN113297278B (en) Time sequence database, data processing method, storage device and computer program product
CN106998436B (en) Video backup method and device
CN114327942A (en) Shared memory management method and cache service assembly
CN111435342B (en) Poster updating method, poster updating system and poster management system
CN111190549A (en) Method, device, equipment and medium for acquiring available capacity of shared volume
CN110955639A (en) Data processing method and device
CN115827508B (en) Data processing method, system, equipment and storage medium
CN115328878B (en) Log data storage system, method, device and medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20210316

Address after: 100085 Floor 101 102-1, No. 35 Building, No. 2 Hospital, Xierqi West Road, Haidian District, Beijing

Applicant after: Seashell Housing (Beijing) Technology Co.,Ltd.

Address before: Unit 05, room 112, 1st floor, office building, Nangang Industrial Zone, economic and Technological Development Zone, Binhai New Area, Tianjin 300457

Applicant before: BEIKE TECHNOLOGY Co.,Ltd.

GR01 Patent grant
GR01 Patent grant