CN109656474A - Date storage method, device, computer equipment and storage medium - Google Patents
Date storage method, device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN109656474A CN109656474A CN201811361623.6A CN201811361623A CN109656474A CN 109656474 A CN109656474 A CN 109656474A CN 201811361623 A CN201811361623 A CN 201811361623A CN 109656474 A CN109656474 A CN 109656474A
- Authority
- CN
- China
- Prior art keywords
- data
- segment
- section part
- storage
- file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0608—Saving storage space on storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0638—Organizing or formatting or addressing of data
- G06F3/0644—Management of space entities, e.g. partitions, extents, pools
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0655—Vertical data movement, i.e. input-output transfer; data movement between one or more hosts and one or more storage devices
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
This application involves a kind of date storage method, device, computer equipment and storage mediums.The described method includes: obtaining the file to be stored including multiple data segments；Each data segment is successively read according to data segment sequence in file to be stored；When recognizing in data segment there are when effective data segment portion, the data bulk of valid data section part is counted；Valid data section part in storing data section, and the corresponding storage offset in valid data section part of record storage；According to the data bulk of the valid data section part of the storage offset of record and statistics, the corresponding index segment in valid data section part of storage is generated, until the data segment in file to be stored is read and finishes；The corresponding index file of file to be stored is generated according to the index segment of generation.When carrying out data storage using this method, only the valid data section part in storing data section, has saved memory space.
Description
Technical field
This application involves technical field of data processing, more particularly to a kind of date storage method, device, computer equipment
And storage medium.
Background technique
With the development of data processing technique, needs often to store some data, bitmap technology occur.Pass through
Bitmap technology can store a large amount of data in the form of a bitmap, each in bitmap can indicate a data.
However, traditional bitmap technology can store the corresponding bitmap of all data.When there are a large amount of nothings in data
When the case where imitating data, still the corresponding bitmap of a large amount of invalid datas can be stored, occupy more memory space, make
At the waste of memory space.
Summary of the invention
Based on this, it is necessary in view of the above technical problems, provide a kind of date storage method that can save memory space,
Device, computer equipment and storage medium.
A kind of date storage method, which comprises
Obtain the file to be stored including multiple data segments；
Each data segment is successively read according to data segment sequence in the file to be stored；
When recognizing in the data segment read, there are when effective data segment portion, count valid data section portion
The data bulk divided；
Valid data section part in the data segment read described in storage, and the valid data section part of record storage is right
The storage offset answered；
According to the data bulk of the valid data section part of the storage offset of record and statistics, the significant figure of storage is generated
According to the corresponding index segment in section part, until the data segment in the file to be stored is read and finishes；
The corresponding index file of the file to be stored is generated according to the index segment of generation.
A kind of data storage device, which is characterized in that described device includes:
File acquisition module, for obtaining the file to be stored including multiple data segments；
Data read module, for being successively read each data segment according to data segment sequence in the file to be stored；
Quantity statistics module, for uniting when recognizing in the data segment read there are when effective data segment portion
Count the data bulk of valid data section part；
Data memory module, for storing the valid data section part in the data segment read, and record storage
The corresponding storage offset in valid data section part；
Index segment generation module, for the data number according to the valid data section part of the storage offset and statistics of record
Amount, generates the corresponding index segment in valid data section part of storage, until the data segment in the file to be stored has been read
Finish；
Generation module is indexed, for generating the corresponding index file of the file to be stored according to the index segment of generation.
A kind of computer equipment can be run on a memory and on a processor including memory, processor and storage
Computer program, the processor perform the steps of when executing the computer program
Obtain the file to be stored including multiple data segments；
Each data segment is successively read according to data segment sequence in the file to be stored；
When recognizing in the data segment read, there are when effective data segment portion, count valid data section portion
The data bulk divided；
Valid data section part in the data segment read described in storage, and the valid data section part of record storage is right
The storage offset answered；
According to the data bulk of the valid data section part of the storage offset of record and statistics, the significant figure of storage is generated
According to the corresponding index segment in section part, until the data segment in the file to be stored is read and finishes；
The corresponding index file of the file to be stored is generated according to the index segment of generation.
A kind of computer readable storage medium, is stored thereon with computer program, and the computer program is held by processor
It is performed the steps of when row
Obtain the file to be stored including multiple data segments；
Each data segment is successively read according to data segment sequence in the file to be stored；
When recognizing in the data segment read, there are when effective data segment portion, count valid data section portion
The data bulk divided；
Valid data section part in the data segment read described in storage, and the valid data section part of record storage is right
The storage offset answered；
According to the data bulk of the valid data section part of the storage offset of record and statistics, the significant figure of storage is generated
According to the corresponding index segment in section part, until the data segment in the file to be stored is read and finishes；
The corresponding index file of the file to be stored is generated according to the index segment of generation.
Above-mentioned date storage method, device, computer equipment and storage medium, by obtain include multiple data segments to
Storage file is successively read each data segment according to data segment sequence in file to be stored, when recognizing the data segment read
In there are when effective data segment portion, count the data bulk of valid data section part, store the valid data section portion recognized
Point, invalid data section part generates corresponding index file without storage, by only storing effective data segment portion, subtracts
The data volume for having lacked storage, saves data space.
Detailed description of the invention
Fig. 1 is the applied environment figure of date storage method in one embodiment；
Fig. 2 is the flow diagram of date storage method in one embodiment；
The flow diagram for the step of Fig. 3 is statistical data quantity in one embodiment；
Fig. 4 is flow diagram the step of storing effective data segment portion in one embodiment；
Fig. 5 is flow diagram the step of generating index segment in one embodiment；
Fig. 6 is flow diagram the step of inquiring data in one embodiment；
Fig. 7 is the schematic diagram of data storage in one embodiment；
Fig. 8 is the structural block diagram of data storage device in one embodiment；
Fig. 9 is the structural block diagram of data storage device in another embodiment；
Figure 10 is the internal structure chart of computer equipment in one embodiment.
Specific embodiment
It is with reference to the accompanying drawings and embodiments, right in order to which the objects, technical solutions and advantages of the application are more clearly understood
The application is further elaborated.It should be appreciated that specific embodiment described herein is only used to explain the application, not
For limiting the application.
Date storage method provided by the present application can be applied in application environment as shown in Figure 1.Wherein, terminal 102
It is communicated with server 104 by network by network.Wherein, terminal 102 can be, but not limited to be various personal computers,
Laptop, smart phone, tablet computer and portable wearable device, server 104 can with independent server or
Person is the server cluster of multiple server compositions to realize.
In one embodiment, as shown in Fig. 2, providing a kind of date storage method, it is applied in Fig. 1 in this way
It is illustrated for server, comprising the following steps:
Step 202, the file to be stored including multiple data segments is obtained.
Wherein, file to be stored, which can be, needs stored bitmap.Data segment is logically to draw file to be stored
It is divided into isometric part.Each data segment includes the integer data of identical preset quantity, each integer data includes
The bitmap data of same predetermined number.
Specifically, terminal obtains the file store instruction of user's triggering and the file to be stored of user's input, and file is deposited
Storage instruction and file to be stored are sent to server.Server receives file store instruction and file to be stored, prepares to reception
To file to be stored stored.
Step 204, each data segment is successively read according to data segment sequence in file to be stored.
Specifically, server is successively read each data segment according to putting in order for data segment in file to be stored.Service
Device is successively read each integer data when reading each data segment, according to putting in order for integer data in data segment.
Step 206, when recognizing in the data segment read there are when effective data segment portion, valid data section portion is counted
The data bulk divided.
Wherein, valid data section part is the partial data section in data segment comprising at least one effective integer data, is had
First, the head integer data and the integer data of tail portion first for imitating data segment portion are effective integer data, are had in data segment
Imitating no longer includes effective integer data except data segment portion.Effective integer data is the integer data that index value is not 0.
Specifically, server is successively read each integer data according to putting in order for integer data in data segment, works as reading
When getting effective integer data, determine that there are effective data segment portions in data segment.Server, which obtains first read, to be had
Position number of the integer data in file to be stored is imitated, first position serial number is labeled as, when reading again effective integer
According to when, obtain the position number of effective integer data for reading again in file to be stored, be labeled as second position serial number,
Server updates the numerical value of second position serial number with effective integer data is read.Server has read a data segment
Bi Hou determines the data bulk of valid data section part according to second position serial number and first position serial number, and determines and first
Data segment between the corresponding effective integer data of position number and effective integer data corresponding with second position serial number is to have
Imitate data segment portion.
In one embodiment, server only reads an effective integer data in data segment, determines valid data
The data bulk of section part is 1.
In one embodiment, the part in data segment except valid data section part is invalid data section part.In vain
Data segment portion can at least one position in the head and tail portion of data segment.Entire data segment can be valid data section
Part is also possible to invalid data section part.
Step 208, the valid data section part in the data segment read, and the valid data section portion of record storage are stored
Divide corresponding storage offset.
Wherein, storage offset is the head of stored valid data section part to the byte number on storage file head
Mesh, storage file are made of stored valid data section part.
Specifically, server obtains the corresponding index segment in valid data section part of previous storage, from the index got
The data bulk and storage offset of the valid data section part of previous storage are extracted in section.Server is effective according to what is extracted
The data bulk and storage offset of data segment portion, calculate the corresponding storage offset of the currently active data segment portion.Service
Device determines the initial address of storage according to the corresponding storage offset of the currently active data segment portion, is deposited according to initial address inquiry
Space is stored up, the currently active data segment portion is stored into the memory space inquired, the valid data of server record storage
The corresponding storage offset in section part.
In one embodiment, the corresponding index segment in valid data section part of previous storage has not been obtained in server, obtains
Preset storage initial address is taken, memory space is inquired according to preset storage initial address, by determining valid data section portion
Divide and store into the memory space inquired, storage offset is denoted as 0.
Step 210, according to the data bulk of the valid data section part of the storage offset of record and statistics, storage is generated
The corresponding index segment in valid data section part, until the data segment in file to be stored is read and finishes.
Wherein, index segment is the data of data bin data structure belonging to the valid data section part for record storage
Section.
Specifically, server is deviated after the storage of valid data section part according to the corresponding storage in valid data section part
The data bulk of the valid data section part of amount and statistics, generates the corresponding index segment in valid data section part of storage.Service
After device every time stores the valid data section part in a data segment, the valid data section part for generating storage is corresponding
Index segment, until in file to be stored data segment reading finish, obtain storage file.
In one embodiment, server it is unidentified into the data segment read there are when effective data segment portion, no
The data segment read is stored, does not generate corresponding index segment.
Step 212, the corresponding index file of file to be stored is generated according to the index segment of generation.
Wherein, the file that index file is made of all index segments.
Specifically, after server generates the corresponding index segment in valid data section part stored, the head of index segment is spelled
It is connected to the tail portion of the corresponding index segment in valid data section part of previous storage.After server reads all data segments,
Generate the corresponding index file of file to be stored.
In the present embodiment, by obtaining the file to be stored including multiple data segments, according to data segment in file to be stored
Sequence is successively read each data segment, and when recognizing there are when effective data segment portion in the data segment read, statistics is effective
The data bulk of data segment portion stores the valid data section part recognized, and invalid data section part is without storing, and life
Reduce the data volume of storage by only storing effective data segment portion at corresponding index file, it is empty to save data storage
Between.
As shown in figure 3, in one embodiment, step 206 specifically further includes the steps that statistical data quantity, step tool
Body includes the following steps:
Step 302, integer data is successively identified according to data arrangement sequence in the data segment read.
Specifically, it when server reads each data segment, puts in order according to integer data in data segment, successively identifies
The numerical value of integer data in data segment.
In one embodiment, the bitmap data in data segment is by row storage, the bitmap data composition of same predetermined number
One integer data.Server puts in order according to integer data in data segment, knows from front to back from the head of data segment
The numerical value of not each integer data.
Step 304, when the integer data recognized is effective integer data, effective integer data is obtained in text to be stored
Position number in part.
Wherein, position number is arrangement serial number of effective integer data in file to be stored.
Specifically, when it is 0 integer data that server, which recognizes numerical value not, determine that the integer data recognized is effective
Integer data, server triggers position number acquisition instruction obtain the effective integer recognized according to position number acquisition instruction
Position number of the data in file to be stored.
Step 306, when the integer data recognized is first effective integer data in the data segment read, root
According to the position number got, the data bulk of invalid data section part in the data segment read is determined.
Wherein, invalid data section part is the partial data section in data segment comprising at least one invalid integer data, nothing
Imitating data segment portion only includes invalid integer data.
Specifically, invalid data section part is the head invalid data section part in data segment.It is recognized when server
When integer data is first effective integer data in the data segment read, trigger position serial number acquisition instruction, according to position
It sets serial number acquisition instruction and obtains first effective position number of the integer data in file to be stored recognized.Server root
According to first recognized effective integer data in the position number and data segment in file to be stored integer data it is default
Quantity numerical value calculates the data segment of reading head invalid data section part in the segment number and data segment in file to be stored
Data bulk.Head invalid data section part is in data segment, and server is before reading first effective integer data
Invalid data section part.
In one embodiment, server obtains first position of effective integer data in file to be stored recognized
After setting serial number, calculate first effective integer data in position number and data segment in file to be stored integer data it is pre-
If quotient and the remainder of quantity numerical value, compiled the quotient value being calculated as section of the data segment read in file to be stored
Number, using remainder value as the data bulk of head invalid data section part in data segment.
For example, the preset quantity numerical value of integer data is 256 in each data segment.Server obtains the recognized
One effective Position Number of the integer data in file to be stored is 4.Server is used as divisor for 4, and 256 are used as and is removed
Number, it is 0 that quotient, which is calculated, remainder 4, then segment number of the data segment read in file to be stored is 0, head in data segment
The data bulk of portion invalid data section part is 4.
Step 308, according to the data bulk of the position number and invalid data section part that get, valid data section is counted
Partial data bulk.
Specifically, server is to the effective integer data got in position number and data segment in file to be stored
The data bulk of head invalid data section part carries out linear operation, obtains the data bulk of valid data section part.
For example, the position number that server is got is 6, the data bulk of head invalid data section part is 4, then
The data bulk of valid data section part is 6-4+1=3 in data segment.
In the present embodiment, integer data is successively identified according to data arrangement sequence in the data segment read, when recognizing
Integer data when being effective integer data, position number of effective integer data in file to be stored is obtained, when recognizing
Integer data when being first effective integer data in the data segment read, according to the position number got, determine
The data bulk of invalid data section part in the data segment read improves the standard for obtaining invalid data section partial data quantity
True property counts valid data section part according to the data bulk of the position number and invalid data section part that get
Data bulk improves the accuracy for obtaining the data bulk of valid data section part.
As shown in figure 4, in one embodiment, step 208 specifically further includes the steps that storing effective data segment portion, it should
Step specifically comprises the following steps:
Step 402, the corresponding index segment in valid data section part of previous storage is obtained.
Specifically, server is indexing before storing to the valid data section part in the data segment read
The corresponding index segment in valid data section part that previous storage is inquired in file, extracts the valid data of the previous storage inquired
The corresponding index segment in section part.
Step 404, data bulk corresponding to the valid data section part of previous storage is extracted from the index segment of acquisition
With storage offset.
Specifically, after server gets the corresponding index segment in valid data section part of previous storage, in previous storage
The corresponding index segment in valid data section part in inquire data bulk and storage corresponding to the valid data section part of record
Offset extracts data bulk corresponding to the valid data section part of the previous storage inquired and storage offset.
Step 406, according to the data bulk and storage offset extracted, determine that the currently active data segment portion is corresponding
Store offset.
Specifically, after server extracts the data bulk of valid data section part and stores offset, according to significant figure
The storage mode that the valid data section part of previous storage is determined according to the data bulk of section part, according to determining storage mode,
It is inclined that the data bulk of valid data section part and storage offset calculate the corresponding storage in currently stored valid data section part
Shifting amount.
Step 408, according to the corresponding storage offset of the currently active data segment portion, storing in the data segment read has
Imitate data segment portion, and the corresponding storage offset in valid data section part of record storage.
Specifically, in server statistics valid data section part effective integer data quantity, according to statistics obtain have
The quantity of effect integer data determines storage mode.Server is according to the corresponding storage offset of the currently active data segment portion, really
Initial address when settled preceding valid data section part is stored inquires memory space according to initial address, by what is read
Valid data section part is stored according to determining storage mode in data segment, and the valid data section part of record storage is right
The storage offset answered.
In one embodiment, when the quantity of integer data effective in valid data section part is less than or equal to predetermined threshold
When, server uses a kind of Sparse Storage Modes, generates the storage unit of each effective integer data.The storage of effective integer data
Unit includes the bitmap data of effective integer data position number and effective integer data in the section in data segment.Server according to
Effective integer data quantity, the storage unit of each effective integer data in the secondary effective data segment portion of storage, wherein each effectively whole
The storage unit of type data is continuously stored according to the ascending sequence of position number in storage unit middle section.At one
In storage unit, position number indicates the bitmap data of integer data rear preceding in section.
In one embodiment, when the quantity of integer data effective in valid data section part is greater than predetermined threshold, clothes
Device be engaged in using bitmap storage mode, directly the valid data section part in data segment is stored.
In one embodiment, integer data can be signless long data (long), include 64 bitmap datas.Data segment
It may include 256 signless long datas, predetermined threshold can be 128.When server uses sparse storage, stored using 1 byte
Effective integer data quantity in valid data section part.One storage unit is stored using 9 bytes, position-order in middle section
It number is stored using 1 byte, the bitmap data of signless long data is stored using 8 bytes.Server is stored using bitmap
When mode, each integer data is stored using 8 bytes in valid data section part.
In the present embodiment, the corresponding index segment in valid data section part of previous storage is obtained, from the index segment of acquisition
The data bulk and storage offset for extracting the valid data section part of previous storage, according to the valid data section part extracted
Data bulk and storage offset, the currently stored corresponding storage offset in valid data section part is determined, according to current
The corresponding storage offset in valid data section part of storage, stores valid data section part in the data segment read, and remember
The corresponding storage offset in valid data section part of address book stored.It is corresponding by the currently stored valid data section part of determination
Offset is stored, accurately valid data section part can be stored, effective data segment portion is only stored, saved storage
Space.
As shown in figure 5, in one embodiment, step 210 specifically further includes the steps that generating index segment, and the step is specific
Include the following steps:
Step 502, the data bulk for reading head invalid data section part in data segment is obtained.
Specifically, after server is completed to the reading of a data segment, acquisition is calculated during reading data segment
Head invalid data section part data bulk.
Step 504, it deviates and counts according to the storage of the data bulk of the head invalid data section part of acquisition, record
The data bulk of valid data section part generates the corresponding index segment in valid data section part of storage, until file to be stored
In data segment be read and finish.
Specifically, server is read in calculating data segment while the data bulk of head invalid data section part
Segment number of the data segment taken in file to be stored.Server is compiled according to section of the data segment of reading in file to be stored
Number, obtain head invalid data section part data bulk, record storage offset and statistics valid data section part
Data bulk, generate the corresponding index segment in valid data section part of storage.Server is every time to having in a data segment
After effect data segment portion is stored, the corresponding index segment in valid data section part of storage is generated, until treating storage text
Data segment reading in part finishes.
In the present embodiment, the data bulk for reading head invalid data section part in data segment is obtained, according to acquisition
The data bulk of the valid data section part of the storage offset and statistics of the data bulk, record of head invalid data section part,
The corresponding index segment in valid data section part of storage is generated, until the data segment in file to be stored is read and finishes.It is depositing
After containing effect data segment portion, the data knot of data segment belonging to the valid data section part of storage is had recorded by index segment
Structure ensure that the accuracy of storage.
As shown in fig. 6, in one embodiment, specifically further including the steps that inquiring data, step tool after step 212
Body includes the following steps:
Step 602, data query instruction is obtained.
Wherein, data query instruction is the finger that the integer data in each valid data section part to storage is inquired
It enables.
Specifically, server obtains the data query instruction that terminal is sent, and prepares to be instructed according to data query from storage
Each valid data section inquires specified integer data in part.
Step 604, the corresponding segment number of position number in data query instruction is determined.
Specifically, server parses data query instruction, obtains the position of data to be checked in data query instruction
Set serial number.Preset quantity numerical value of the server according to integer data in position number and data segment, the instruction of determining and data query
In the corresponding segment number of position number.
In one embodiment, in server calculating position serial number and data segment the preset quantity numerical value of integer data quotient
And remainder, using the numerical value for the quotient being calculated as corresponding segment number.
Step 606, indexed file extracts index segment corresponding with segment number.
Specifically, after the determining segment number corresponding with the position number in data query instruction of server, index segment is triggered
Instruction is extracted, according to inquiry index segment corresponding with segment number in index segment extraction instruction indexed file, and extracts and inquires
The corresponding index segment of the segment number arrived.
In one embodiment, after server triggers index segment extracts instruction, using in binary chop indexed file
Index segment corresponding with segment number is inquired, and extracts index segment corresponding with the segment number inquired.
In one embodiment, index segment corresponding with segment number is inquired in the non-indexed file of server, to terminal
Return to numerical value 0.
Step 608, according to the index segment inquired, detect whether the corresponding data portion of position number is invalid data section
Part.
Specifically, after server extracts index segment corresponding with segment number, head invalid data is extracted from index segment
The data bulk of section part, the data bulk of valid data section part and storage offset.Server is by position number and data
The preset quantity numerical value of integer data compares obtained remainder as data to be checked position-order in section in data segment in section
Number.When position number is greater than head in the data bulk numerical value or section that position number is less than head invalid data section part in section
The data bulk numerical value of the data bulk numerical value and valid data section part of invalid data section part and when, server determines position
Setting the corresponding data portion of serial number is invalid data section part, and server returns to numerical value 0 to terminal.When position number is greater than in section
Equal to the data bulk numerical value of head invalid data section part, and it is less than or equal to the data bulk number of head invalid data section part
Value and valid data section part data bulk numerical value and when, server determines that the corresponding data portion of position number is effective
Data segment portion.
Step 610, when the corresponding data portion of position number is not invalid data section part, according to the index inquired
Section and the position number extract the valid data section part of storage.
Specifically, when server determines that the corresponding data portion of position number is not invalid data section part, server
The storage mode that valid data section part is determined according to the data bulk of valid data section part, according to determining storage mode,
The data bulk of head invalid data section part, the data bulk of valid data section part and storage offset are from the effective of storage
Valid data section part is inquired in data segment portion, and extracts the valid data section part inquired.
In the present embodiment, data query instruction is obtained, determines the corresponding segment number of position number in data query instruction,
Indexed file extracts index segment corresponding with segment number, according to the index segment inquired, detects the corresponding data of position number
Whether part is invalid data section part, when the corresponding data portion of position number is not invalid data section part, according to looking into
The index segment and position number ask extract the valid data section part of storage.When carrying out data query, pass through index file
Data can be rapidly and accurately inquired with the information recorded in index segment, improve the efficiency of data query.
Fig. 7 is the schematic diagram of data storage in one embodiment.Referring to Fig. 7, server is according to the number in file to be stored
Being successively read data segment 0,1,2,3,4,5 ... according to section sequence, wherein there is no valid data section portions in data segment 0 and data segment 3
Point, server not storing data section 0 and data segment 3 do not generate corresponding index segment yet.Exist in data segment 1,2,4 and 5 effective
The invalid data section part of data segment portion, data segment 1,2,4 and 5 can be on the head of data segment, can also be in data segment
Tail portion.Server obtains segment number of the data segment in file to be stored, the head invalid data section part in statistical data section
Data bulk and valid data section part data bulk, calculate data segment in valid data section part storage offset.
There are the valid data section parts in the data segment 1,2,4 and 5 of effective data segment portion for server storage, according to each data segment
Segment number, the data bulk of head invalid data section part, the data bulk of valid data section part and storage offset, it is raw
At the corresponding index segment in valid data section part of storage.Server reads data segment and finishes, and is generated according to the index segment of generation
The corresponding index file of file to be stored.
It should be understood that although each step in the flow chart of Fig. 2-6 is successively shown according to the instruction of arrow,
These steps are not that the inevitable sequence according to arrow instruction successively executes.Unless expressly stating otherwise herein, these steps
Execution there is no stringent sequences to limit, these steps can execute in other order.Moreover, at least one in Fig. 2-6
Part steps may include that perhaps these sub-steps of multiple stages or stage are not necessarily in synchronization to multiple sub-steps
Completion is executed, but can be executed at different times, the execution sequence in these sub-steps or stage is also not necessarily successively
It carries out, but can be at least part of the sub-step or stage of other steps or other steps in turn or alternately
It executes.
In one embodiment, as shown in figure 8, providing a kind of data storage device 800, comprising: file acquisition module
802, data read module 804, quantity statistics module 806, data memory module 808, index segment generation module 810 and index life
At module 812, in which:
File acquisition module 802, for obtaining the file to be stored including multiple data segments.
Data read module 804, for being successively read each data segment according to data segment sequence in file to be stored.
Quantity statistics module 806, for counting when recognizing in the data segment read there are when effective data segment portion
The data bulk of valid data section part.
Data memory module 808, for storing the valid data section part in the data segment read, and record storage
The corresponding storage offset in valid data section part.
Index segment generation module 810, for the number according to the valid data section part of the storage offset and statistics of record
Data bulk generates the corresponding index segment in valid data section part of storage, until the data segment in file to be stored has been read
Finish.
Generation module 812 is indexed, for generating the corresponding index file of file to be stored according to the index segment of generation.
In the present embodiment, by obtaining the file to be stored including multiple data segments, according to data segment in file to be stored
Sequence is successively read each data segment, and when recognizing there are when effective data segment portion in the data segment read, statistics is effective
The data bulk of data segment portion stores the valid data section part recognized, and invalid data section part is without storing, and life
Reduce the data volume of storage by only storing effective data segment portion at corresponding index file, it is empty to save data storage
Between.
In one embodiment, quantity statistics module 806 includes: data identification module, serial number acquisition module, determines in vain
Module and effective statistical module, in which:
Data identification module, for successively identifying integer data according to data arrangement sequence in the data segment read.
Serial number obtains module, for obtaining effective integer data when the integer data recognized is effective integer data
Position number in file to be stored.
Invalidity determination module, for being first effective integer in the data segment read when the integer data recognized
When data, according to the position number got, the data bulk of invalid data section part in the data segment read is determined.
Effective statistical module, for the data bulk according to the position number and invalid data section part got, statistics
The data bulk of valid data section part.
In the present embodiment, integer data is successively identified according to data arrangement sequence in the data segment read, when recognizing
Integer data when being effective integer data, position number of effective integer data in file to be stored is obtained, when recognizing
Integer data when being first effective integer data in the data segment read, according to the position number got, determine
The data bulk of invalid data section part in the data segment read improves the standard for obtaining invalid data section partial data quantity
True property counts valid data section part according to the data bulk of the position number and invalid data section part that get
Data bulk improves the accuracy for obtaining the data bulk of valid data section part.
In one embodiment, data memory module 808 includes: that index segment obtains module, extraction module, deviates determining mould
Block and effective memory module, in which:
Index segment obtains module, for obtaining the corresponding index segment in valid data section part of previous storage.
Extraction module, for extracting data corresponding to the valid data section part of previous storage from the index segment of acquisition
Quantity and storage offset.
Deflection determination module, for determining the currently active data segment according to the data bulk and storage offset extracted
The corresponding storage offset in part.
Effective memory module is stored and is read for according to the corresponding storage offset of the currently active data segment portion
Valid data section part in data segment, and the corresponding storage offset in valid data section part of record storage.
In the present embodiment, the corresponding index segment in valid data section part of previous storage is obtained, from the index segment of acquisition
The data bulk and storage offset for extracting the valid data section part of previous storage, according to the valid data section part extracted
Data bulk and storage offset, the currently stored corresponding storage offset in valid data section part is determined, according to current
The corresponding storage offset in valid data section part of storage, stores valid data section part in the data segment read, and remember
The corresponding storage offset in valid data section part of address book stored.It is corresponding by the currently stored valid data section part of determination
Offset is stored, accurately valid data section part can be stored, effective data segment portion is only stored, saved storage
Space.
In one embodiment, index segment generation module 810, which is also used to obtain, reads head invalid data in data segment
The data bulk of section part；It is deviated and is counted according to the storage of the data bulk of the head invalid data section part of acquisition, record
Valid data section part data bulk, the corresponding index segment in valid data section part of storage is generated, until text to be stored
Data segment in part, which is read, to be finished.
In the present embodiment, the data bulk for reading head invalid data section part in data segment is obtained, according to acquisition
The data bulk of the valid data section part of the storage offset and statistics of the data bulk, record of head invalid data section part,
The corresponding index segment in valid data section part of storage is generated, until the data segment in file to be stored is read and finishes.It is depositing
After containing effect data segment portion, the data knot of data segment belonging to the valid data section part of storage is had recorded by index segment
Structure ensure that the accuracy of storage.
As shown in figure 9, in one embodiment, data storage device 800 further includes instruction acquisition module 814, numbers really
Cover half block 816, index extraction module 818, data detection module 820 and data extraction module 822, in which:
Instruction acquisition module 814, for obtaining data query instruction.
Number determining module 816, for determining the corresponding segment number of position number in data query instruction.
Extraction module 818 is indexed, extracts index segment corresponding with segment number for indexed file.
Data detection module 820, for according to the index segment inquired, whether the corresponding data portion of detection position number
For invalid data section part.
Data extraction module 822, for when the corresponding data portion of position number is not invalid data section part, according to
The index segment and position number inquired extracts the valid data section part of storage.
In the present embodiment, data query instruction is obtained, determines the corresponding segment number of position number in data query instruction,
Indexed file extracts index segment corresponding with segment number, according to the index segment inquired, detects the corresponding data of position number
Whether part is invalid data section part, when the corresponding data portion of position number is not invalid data section part, according to looking into
The index segment and position number ask extract the valid data section part of storage.When carrying out data query, pass through index file
Data can be rapidly and accurately inquired with the information recorded in index segment, improve the efficiency of data query.
Specific about data storage device limits the restriction that may refer to above for date storage method, herein not
It repeats again.Modules in above-mentioned data storage device can be realized fully or partially through software, hardware and combinations thereof.On
Stating each module can be embedded in the form of hardware or independently of in the processor in computer equipment, can also store in a software form
In memory in computer equipment, the corresponding operation of the above modules is executed in order to which processor calls.
In one embodiment, a kind of computer equipment is provided, which can be server, internal junction
Composition can be as shown in Figure 10.The computer equipment include by system bus connect processor, memory, network interface and
Database.Wherein, the processor of the computer equipment is for providing calculating and control ability.The memory packet of the computer equipment
Include non-volatile memory medium, built-in storage.The non-volatile memory medium is stored with operating system, computer program and data
Library.The built-in storage provides environment for the operation of operating system and computer program in non-volatile memory medium.The calculating
The database of machine equipment is used to store valid data section part and the index file of each data segment.The network of the computer equipment connects
Mouth with external terminal by network connection for being communicated.To realize that a kind of data are deposited when the computer program is executed by processor
Method for storing.
It will be understood by those skilled in the art that structure shown in Figure 10, only part relevant to application scheme
The block diagram of structure, does not constitute the restriction for the computer equipment being applied thereon to application scheme, and specific computer is set
Standby may include perhaps combining certain components or with different component layouts than more or fewer components as shown in the figure.
In one embodiment, a kind of computer equipment is provided, including memory, processor and storage are on a memory
And the computer program that can be run on a processor, processor performs the steps of acquisition when executing computer program include more
The file to be stored of a data segment；Each data segment is successively read according to data segment sequence in file to be stored；It is read when recognizing
There are when effective data segment portion in the data segment got, the data bulk of valid data section part is counted；What storage was read
Valid data section part in data segment, and the corresponding storage offset in valid data section part of record storage；According to record
Storage offset and statistics valid data section part data bulk, generate the corresponding rope in valid data section part of storage
Draw section, until the data segment in file to be stored is read and finishes；It is corresponding that file to be stored is generated according to the index segment of generation
Index file.
In one embodiment, when recognizing there are when effective data segment portion in the data segment read, statistics is effective
The data bulk of data segment portion includes: successively to identify integer data according to data arrangement sequence in the data segment read；When
When the integer data recognized is effective integer data, position number of effective integer data in file to be stored is obtained；When
When the integer data recognized is first effective integer data in the data segment read, according to the position-order got
Number, determine the data bulk of invalid data section part in the data segment read；According to the position number and invalid number got
According to the data bulk of section part, the data bulk of valid data section part is counted.
In one embodiment, the valid data section part in the data segment read is stored, and record storage is effective
The corresponding storage offset of data segment portion includes: the corresponding index segment in valid data section part for obtaining previous storage；From obtaining
Data bulk corresponding to the valid data section part of previous storage and storage offset are extracted in the index segment taken；According to extraction
The data bulk and storage offset arrived, determines the corresponding storage offset of the currently active data segment portion；According to the currently active
The corresponding storage offset of data segment portion, stores valid data section part in the data segment read, and record storage has
Imitate the corresponding storage offset of data segment portion.
In one embodiment, according to the data bulk of the valid data section part of the storage offset of record and statistics,
The corresponding index segment in valid data section part of storage is generated, until the data segment in file to be stored is read to finish and includes:
Obtain the data bulk for reading invalid data section in head in data segment；According to the data number of the head invalid data section of acquisition
The data bulk of the valid data section part of amount, the storage offset of record and statistics, the valid data section part for generating storage are right
The index segment answered, until the data segment in file to be stored is read and finishes.
In one embodiment, after generating the corresponding index file of file to be stored according to the index segment of generation, processing
Device also performs the steps of when executing computer program obtains data query instruction；Determine the position-order in data query instruction
Number corresponding segment number；Indexed file extracts index segment corresponding with segment number；According to the index segment inquired, position is detected
Whether the corresponding data portion of serial number is invalid data section part；When the corresponding data portion of position number is not invalid data section
When part, the valid data section part of storage is extracted according to the index segment and position number inquired.
In the present embodiment, by obtaining the file to be stored including multiple data segments, according to data segment in file to be stored
Sequence is successively read each data segment, and when recognizing there are when effective data segment portion in the data segment read, statistics is effective
The data bulk of data segment portion stores the valid data section part recognized, and invalid data section part is without storing, and life
Reduce the data volume of storage by only storing effective data segment portion at corresponding index file, it is empty to save data storage
Between.
In one embodiment, a kind of computer readable storage medium is provided, computer program is stored thereon with, is calculated
Machine program performs the steps of when being executed by processor obtains the file to be stored including multiple data segments；According to text to be stored
Data segment sequence is successively read each data segment in part；When recognizing in the data segment read, there are effective data segment portions
When, count the data bulk of valid data section part；The valid data section part in the data segment read is stored, and records and deposits
The corresponding storage offset in valid data section part of storage；According to the valid data section part of the storage offset of record and statistics
Data bulk, generate the corresponding index segment in valid data section part of storage, until file to be stored in data segment read
It takes complete；The corresponding index file of file to be stored is generated according to the index segment of generation.
In one embodiment, when recognizing there are when effective data segment portion in the data segment read, statistics is effective
The data bulk of data segment portion includes: successively to identify integer data according to data arrangement sequence in the data segment read；When
When the integer data recognized is effective integer data, position number of effective integer data in file to be stored is obtained；When
When the integer data recognized is first effective integer data in the data segment read, according to the position-order got
Number, determine the data bulk of invalid data section part in the data segment read；According to the position number and invalid number got
According to the data bulk of section part, the data bulk of valid data section part is counted.
In one embodiment, the valid data section part in the data segment read is stored, and record storage is effective
The corresponding storage offset of data segment portion includes: the corresponding index segment in valid data section part for obtaining previous storage；From obtaining
Data bulk corresponding to the valid data section part of previous storage and storage offset are extracted in the index segment taken；According to extraction
The data bulk and storage offset arrived, determines the corresponding storage offset of the currently active data segment portion；According to the currently active
The corresponding storage offset of data segment portion, stores valid data section part in the data segment read, and record storage has
Imitate the corresponding storage offset of data segment portion.
In one embodiment, according to the data bulk of the valid data section part of the storage offset of record and statistics,
The corresponding index segment in valid data section part of storage is generated, until the data segment in file to be stored is read to finish and includes:
Obtain the data bulk for reading head invalid data section part in data segment；According to the head invalid data section part of acquisition
The data bulk of the valid data section part of data bulk, the storage offset of record and statistics, generates the valid data section of storage
The corresponding index segment in part, until the data segment in file to be stored is read and finishes.
In one embodiment, it after generating the corresponding index file of file to be stored according to the index segment of generation, calculates
It is also performed the steps of when machine program is executed by processor and obtains data query instruction；Determine the position in data query instruction
The corresponding segment number of serial number；Indexed file extracts index segment corresponding with segment number；According to the index segment inquired, check bit
Set whether the corresponding data portion of serial number is invalid data section part；When the corresponding data portion of position number is not invalid data
When section part, the valid data section part of storage is extracted according to the index segment and position number inquired.
In the present embodiment, by obtaining the file to be stored including multiple data segments, according to data segment in file to be stored
Sequence is successively read each data segment, and when recognizing there are when effective data segment portion in the data segment read, statistics is effective
The data bulk of data segment portion stores the valid data section part recognized, and invalid data section part is without storing, and life
Reduce the data volume of storage by only storing effective data segment portion at corresponding index file, it is empty to save data storage
Between.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with
Relevant hardware is instructed to complete by computer program, the computer program can be stored in a non-volatile computer
In read/write memory medium, the computer program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein,
To any reference of memory, storage, database or other media used in each embodiment provided herein,
Including non-volatile and/or volatile memory.Nonvolatile memory may include read-only memory (ROM), programming ROM
(PROM), electrically programmable ROM (EPROM), electrically erasable ROM (EEPROM) or flash memory.Volatile memory may include
Random access memory (RAM) or external cache.By way of illustration and not limitation, RAM is available in many forms,
Such as static state RAM (SRAM), dynamic ram (DRAM), synchronous dram (SDRAM), double data rate sdram (DDRSDRAM), enhancing
Type SDRAM (ESDRAM), synchronization link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM
(RDRAM), direct memory bus dynamic ram (DRDRAM) and memory bus dynamic ram (RDRAM) etc..
Each technical characteristic of above embodiments can be combined arbitrarily, for simplicity of description, not to above-described embodiment
In each technical characteristic it is all possible combination be all described, as long as however, the combination of these technical characteristics be not present lance
Shield all should be considered as described in this specification.
The several embodiments of the application above described embodiment only expresses, the description thereof is more specific and detailed, but simultaneously
It cannot therefore be construed as limiting the scope of the patent.It should be pointed out that coming for those of ordinary skill in the art
It says, without departing from the concept of this application, various modifications and improvements can be made, these belong to the protection of the application
Range.Therefore, the scope of protection shall be subject to the appended claims for the application patent.
Claims (10)
1. a kind of date storage method, which comprises
Obtain the file to be stored including multiple data segments；
Each data segment is successively read according to data segment sequence in the file to be stored；
When recognizing in the data segment read, there are when effective data segment portion, count valid data section part
Data bulk；
Valid data section part in the data segment read described in storage, and the valid data section part of record storage is corresponding
Store offset；
According to the data bulk of the valid data section part of the storage offset of record and statistics, the valid data section of storage is generated
The corresponding index segment in part, until the data segment in the file to be stored is read and finishes；
The corresponding index file of the file to be stored is generated according to the index segment of generation.
2. the method according to claim 1, wherein described ought recognize exists in the data segment read
When valid data section part, the data bulk for counting valid data section part includes:
Integer data is successively identified according to data arrangement sequence in the data segment read；
When the integer data recognized is effective integer data, effective integer data is obtained in the file to be stored
Position number；
When the integer data recognized is first effective integer data in the data segment read, according to getting
Position number, determine described in the data segment that reads invalid data section part data bulk；
According to the data bulk of the position number got and invalid data section part, valid data section part is counted
Data bulk.
3. the method according to claim 1, wherein the significant figure in the data segment read described in the storage
The corresponding storage offset in valid data section part according to section part, and record storage includes:
Obtain the corresponding index segment in valid data section part of previous storage；
Data bulk corresponding to the valid data section part of the previous storage is extracted from the index segment of acquisition and storage is inclined
Shifting amount；
According to the data bulk and storage offset extracted, the corresponding storage offset of the currently active data segment portion is determined；
According to the corresponding storage offset of the currently active data segment portion, significant figure in the data segment that is read described in storage
According to section part, and the corresponding storage offset in valid data section part of record storage.
4. the method according to claim 1, wherein the storage offset and statistics according to record is effective
The data bulk of data segment portion generates the corresponding index segment in valid data section part of storage, until the file to be stored
In data segment be read to finish and include:
The data bulk of head invalid data section part in data segment is read described in acquisition；
According to the data bulk of the head invalid data section part of acquisition, the valid data section of the storage offset of record and statistics
Partial data bulk generates the corresponding index segment in valid data section part of storage, until the number in the file to be stored
It is read and finishes according to section.
5. the method according to claim 1, wherein described generate the text to be stored according to the index segment of generation
After the corresponding index file of part, further includes:
Obtain data query instruction；
Determine the corresponding segment number of position number in the data query instruction；
Index segment corresponding with the segment number is extracted in the index file；
According to the index segment inquired, detect whether the corresponding data portion of the position number is invalid data section part；
When the corresponding data portion of the position number is not invalid data section part, according to the index segment inquired and
The position number extracts the valid data section part of storage.
6. a kind of data storage device, which is characterized in that described device includes:
File acquisition module, for obtaining the file to be stored including multiple data segments；
Data read module, for being successively read each data segment according to data segment sequence in the file to be stored；
Quantity statistics module, for counting institute when recognizing in the data segment read there are when effective data segment portion
State the data bulk of valid data section part；
Data memory module, for storing the valid data section part in the data segment read, and record storage has
Imitate the corresponding storage offset of data segment portion；
Index segment generation module, for the data bulk according to the valid data section part of the storage offset and statistics of record,
The corresponding index segment in valid data section part of storage is generated, until the data segment in the file to be stored is read and finishes；
Generation module is indexed, for generating the corresponding index file of the file to be stored according to the index segment of generation.
7. device according to claim 6, which is characterized in that the quantity statistics module includes:
Data identification module, for successively identifying integer data according to data arrangement sequence in the data segment read；
Serial number obtains module, for obtaining effective integer data when the integer data recognized is effective integer data
Position number in the file to be stored；
Invalidity determination module, for being first effective integer in the data segment read when the integer data recognized
When data, according to the position number got, determine described in the data segment that reads invalid data section part data bulk；
Effective statistical module, the data bulk of position number and invalid data section part for being got according to,
Count the data bulk of valid data section part.
8. device according to claim 6, which is characterized in that the data memory module includes:
Index segment obtains module, for obtaining the corresponding index segment in valid data section part of previous storage；
Extraction module, for extracting data corresponding to the valid data section part of the previous storage from the index segment of acquisition
Quantity and storage offset；
Deflection determination module, for determining the currently active data segment portion according to the data bulk and storage offset extracted
Corresponding storage offset；
Effective memory module, for storing the reading according to the corresponding storage offset of the currently active data segment portion
To data segment in valid data section part, and the corresponding storage offset in valid data section part of record storage.
9. a kind of computer equipment including memory, processor and stores the meter that can be run on a memory and on a processor
Calculation machine program, which is characterized in that the processor realizes any one of claims 1 to 5 institute when executing the computer program
The step of stating method.
10. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer program
The step of method described in any one of claims 1 to 5 is realized when being executed by processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811361623.6A CN109656474B (en) | 2018-11-15 | 2018-11-15 | Data storage method and device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811361623.6A CN109656474B (en) | 2018-11-15 | 2018-11-15 | Data storage method and device, computer equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109656474A true CN109656474A (en) | 2019-04-19 |
| CN109656474B CN109656474B (en) | 2022-02-15 |
Family
ID=66111238
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811361623.6A Active CN109656474B (en) | 2018-11-15 | 2018-11-15 | Data storage method and device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109656474B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110262752A (en) * | 2019-05-16 | 2019-09-20 | 罗普特科技集团股份有限公司 | A kind of method, apparatus for stored stream media data, storage medium |
| CN110297836A (en) * | 2019-07-11 | 2019-10-01 | 杭州云梯科技有限公司 | User tag storage method and search method based on compress bitmap mode |
| WO2022142616A1 (en) * | 2020-12-28 | 2022-07-07 | 深圳壹账通智能科技有限公司 | Data storage method and apparatus based on redis, and device and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102084332A (en) * | 2008-04-06 | 2011-06-01 | 弗森-艾奥公司 | Apparatus, system, and method for converting a storage request into an append data storage command |
| CN103995887A (en) * | 2014-05-30 | 2014-08-20 | 上海达梦数据库有限公司 | Bitmap index compressing method and bitmap index decompressing method |
| US20150178336A1 (en) * | 2013-07-18 | 2015-06-25 | Tencent Technology (Shenzhen) Company Limited | Method, device and storage medium for providing data statistics |
| US20150370839A1 (en) * | 2014-06-18 | 2015-12-24 | International Business Machines Corporation | Built-in search indexing for nas systems |
| CN107015985A (en) * | 2016-01-27 | 2017-08-04 | 阿里巴巴集团控股有限公司 | A kind of data storage and acquisition methods and device |
-
2018
- 2018-11-15 CN CN201811361623.6A patent/CN109656474B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102084332A (en) * | 2008-04-06 | 2011-06-01 | 弗森-艾奥公司 | Apparatus, system, and method for converting a storage request into an append data storage command |
| US20150178336A1 (en) * | 2013-07-18 | 2015-06-25 | Tencent Technology (Shenzhen) Company Limited | Method, device and storage medium for providing data statistics |
| CN103995887A (en) * | 2014-05-30 | 2014-08-20 | 上海达梦数据库有限公司 | Bitmap index compressing method and bitmap index decompressing method |
| US20150370839A1 (en) * | 2014-06-18 | 2015-12-24 | International Business Machines Corporation | Built-in search indexing for nas systems |
| CN107015985A (en) * | 2016-01-27 | 2017-08-04 | 阿里巴巴集团控股有限公司 | A kind of data storage and acquisition methods and device |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110262752A (en) * | 2019-05-16 | 2019-09-20 | 罗普特科技集团股份有限公司 | A kind of method, apparatus for stored stream media data, storage medium |
| CN110262752B (en) * | 2019-05-16 | 2020-08-11 | 罗普特科技集团股份有限公司 | Method, device and storage medium for storing streaming media data |
| CN110297836A (en) * | 2019-07-11 | 2019-10-01 | 杭州云梯科技有限公司 | User tag storage method and search method based on compress bitmap mode |
| WO2022142616A1 (en) * | 2020-12-28 | 2022-07-07 | 深圳壹账通智能科技有限公司 | Data storage method and apparatus based on redis, and device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109656474B (en) | 2022-02-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109656474A (en) | Date storage method, device, computer equipment and storage medium | |
| CN105159777B (en) | The method for recovering internal storage and device of process | |
| CN105630955B (en) | A kind of data acquisition system member management method of high-efficiency dynamic | |
| CN110457302B (en) | Intelligent structured data cleaning method | |
| CN109597571B (en) | Data storage method, data reading method, data storage device, data reading device and computer equipment | |
| CN109086456B (en) | Data indexing method and device | |
| CN110442752A (en) | Organizational structure drawing generating method, device, computer equipment and storage medium | |
| CN110377276B (en) | Source code file management method and device | |
| CN106844721A (en) | Date storage method, device, system, computer-readable recording medium and storage control | |
| CN110516220B (en) | Report data input method, system and related equipment | |
| CN111723097A (en) | Application program interface configuration method and device, computer equipment and storage medium | |
| CN113763034B (en) | Advertisement data processing method and device | |
| CN112559482B (en) | Binary data classification processing method and system based on distribution | |
| CN109359176A (en) | Data extraction method, device, computer equipment and storage medium | |
| CN115617255A (en) | Management method and management device for cache files | |
| CN109446336A (en) | Method, apparatus, computer equipment and the storage medium of news screening | |
| CN112579454A (en) | Task data processing method, device and equipment | |
| CN109271383B (en) | Dynamic label processing method and device, computer equipment and storage medium | |
| CN110515974A (en) | Data pick-up method, apparatus, computer equipment and storage medium | |
| CN111913913A (en) | Access request processing method and device | |
| CN112231342A (en) | Multi-condition paging query optimization method, system, terminal and storage medium | |
| CN110335110A (en) | Sort method, device, computer equipment and the storage medium of product | |
| CN111858590B (en) | Storage system metadata organization method, system, terminal and storage medium | |
| CN109634955A (en) | Date storage method, data retrieval method and device | |
| CN113077344B (en) | Block chain-based transaction method, device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |