CN112214458B - Data transfer and storage method and device - Google Patents

Data transfer and storage method and device Download PDF

Info

Publication number
CN112214458B
CN112214458B CN202011120115.6A CN202011120115A CN112214458B CN 112214458 B CN112214458 B CN 112214458B CN 202011120115 A CN202011120115 A CN 202011120115A CN 112214458 B CN112214458 B CN 112214458B
Authority
CN
China
Prior art keywords
data
data block
file
transfer
dump
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011120115.6A
Other languages
Chinese (zh)
Other versions
CN112214458A (en
Inventor
程安来
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhuhai Kingsoft Digital Network Technology Co Ltd
Original Assignee
Zhuhai Kingsoft Digital Network Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhuhai Kingsoft Digital Network Technology Co Ltd filed Critical Zhuhai Kingsoft Digital Network Technology Co Ltd
Priority to CN202011120115.6A priority Critical patent/CN112214458B/en
Publication of CN112214458A publication Critical patent/CN112214458A/en
Application granted granted Critical
Publication of CN112214458B publication Critical patent/CN112214458B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/16File or folder operations, e.g. details of user interfaces specifically adapted to file systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/17Details of further file system functions
    • G06F16/172Caching, prefetching or hoarding of files
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10File systems; File servers
    • G06F16/17Details of further file system functions
    • G06F16/178Techniques for file synchronisation in file systems
    • G06F16/1794Details of file format conversion
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

The specification provides a data transfer and storage method and device, wherein the data transfer and storage method comprises the following steps: acquiring data to be transferred in at least one target data group of a first file; storing the data to be restored belonging to the same target data group into a data block to obtain at least one restored data block, wherein the restored data block corresponds to the target data group one by one; storing at least one transfer data block into a second file, and recording the storage position of the at least one transfer data block in the second file and the corresponding relation between each transfer data block in the at least one transfer data block and the target data group in the second file. Therefore, when the data acquisition request is received, only the needed dump data block can be acquired, and the data in the second file is not required to be acquired completely, so that the occupied amount of the storage space is reduced, the data acquisition efficiency is improved, and the data updating efficiency is further improved.

Description

Data transfer and storage method and device
Technical Field
The present disclosure relates to the field of data processing technologies, and in particular, to a method and an apparatus for transferring and storing data.
Background
With the development of computer technology, games are a very common recreation mode in daily life of people. In order for a player to have a better gaming experience, a worker may update the data of the game by operating a computing device on which the game software is installed.
In the prior art, the data of the game may be stored in a first file, for example, the first file may be an xls format file, i.e. the second file may be an Excel table. When updating the data of the game, if the data of a certain row in the Excel table is required to be used, the computing device cannot directly acquire the data of the certain row from the Excel table, so that all the data in the Excel table where the data are located is required to be acquired, and then the data are acquired from all the acquired data in the Excel table, thereby updating the data of the game.
However, more data are stored in a single Excel table, and under the condition that only data of a certain line in the Excel table are used, the data in the whole Excel table are obtained, so that not only is the storage space occupied, but also time is wasted, the efficiency of data updating is reduced, and further, a simpler and more convenient method is needed for carrying out data storage operation or processing, so that the efficiency of data obtaining can be improved, and further, the efficiency of data updating is improved.
Disclosure of Invention
In view of this, the embodiments of the present disclosure provide a data transfer and storage method. The present disclosure also relates to a data transfer and storage device, a computing device, and a computer-readable storage medium, which solve the technical drawbacks of the prior art.
According to a first aspect of embodiments of the present disclosure, there is provided a data transfer and storage method, including:
acquiring data to be transferred in at least one target data group of a first file;
storing the data to be restored belonging to the same target data group into a data block to obtain at least one restored data block, wherein the restored data block corresponds to the target data group one by one;
storing the at least one transfer data block into a second file, and recording the storage position of the at least one transfer data block in the second file and the corresponding relation between each transfer data block in the at least one transfer data block and a target data group in the second file.
Optionally, the recording, in the second file, a storage location of the at least one dump data block in the second file includes:
determining a start storage position and an end storage position of each of the at least one dump data block;
determining a start storage position and an end storage position of each dump data block as storage positions of each dump data block in the second file;
and recording the storage position of each dump data block in the second file.
Optionally, the determining a start storage location and an end storage location of each of the at least one dump data block includes:
recording a starting storage position of a first dump data block in the at least one dump data block, wherein the first dump data block is used for storing data of a target data group for data dump storage of a first one of the first files;
determining the storage space of each dump data block in the at least one dump data block according to the data type of the data stored by each dump data block;
and determining an end storage position of each transfer data block and a start storage position of other transfer data blocks except the first transfer data block in the at least one transfer data block based on the start storage position of the first transfer data block and the storage space of each transfer data block.
Optionally, the determining a start storage location and an end storage location of each of the at least one dump data block includes:
recording a starting storage position of each of the at least one dump data block;
determining a storage space of a second dump data block according to the data type of data stored in the second dump data block in the at least one dump data block, wherein the second dump data block is used for storing the data of the last target data group for data dump storage in the first file;
Determining an end storage location of the second dump data block based on a start storage location of the second dump data block and a storage space of the second dump data block, and determining an end storage location of other dump data blocks of the at least one dump data block other than the second dump data block based on the start storage location of each dump data block.
Optionally, if the first file includes a data name and/or a data type, the data name and/or the data type is stored in the second file.
Optionally, the method further comprises:
receiving a data acquisition request, wherein the data acquisition request comprises a target data group identifier, and the target data group identifier is used for indicating a target data group;
determining a corresponding transfer data block of the target data group indicated by the target data group identification based on the corresponding relation between each transfer data block and the target data group;
determining a storage position of the determined transfer data block in the second file;
data is retrieved from the determined storage location.
Optionally, the recording, in the second file, the storage location of the at least one dump data block in the second file and the correspondence between each dump data block in the at least one dump data block and the target data group includes:
And recording the storage position of the at least one dump data block in the second file and the corresponding relation between each dump data block in the at least one dump data block and the target data group in the file header of the second file.
Optionally, the second file is a binary file.
According to a second aspect of embodiments of the present disclosure, there is provided a data transfer storage device, including:
the acquisition module is used for acquiring data to be transferred in at least one target data group of the first file;
the first storage module is used for storing the data to be restored belonging to the same target data group into a data block to obtain at least one restored data block, wherein the restored data block corresponds to the target data group one by one;
and the second storage module is used for storing the at least one transfer data block into a second file, and recording the storage position of the at least one transfer data block in the second file and the corresponding relation between each transfer data block in the at least one transfer data block and the target data group in the second file.
Optionally, the second storage module is configured to:
determining a start storage position and an end storage position of each of the at least one dump data block;
Determining a start storage position and an end storage position of each dump data block as storage positions of each dump data block in the second file;
and recording the storage position of each dump data block in the second file.
Optionally, the second storage module is configured to:
recording a starting storage position of a first dump data block in the at least one dump data block, wherein the first dump data block is used for storing data of a target data group for data dump storage of a first one of the first files;
determining the storage space of each dump data block in the at least one dump data block according to the data type of the data stored by each dump data block;
and determining an end storage position of each transfer data block and a start storage position of other transfer data blocks except the first transfer data block in the at least one transfer data block based on the start storage position of the first transfer data block and the storage space of each transfer data block.
Optionally, the second storage module is configured to:
recording a starting storage position of each of the at least one dump data block;
Determining a storage space of a second dump data block according to the data type of data stored in the second dump data block in the at least one dump data block, wherein the second dump data block is used for storing the data of the last target data group for data dump storage in the first file;
determining an end storage location of the second dump data block based on a start storage location of the second dump data block and a storage space of the second dump data block, and determining an end storage location of other dump data blocks of the at least one dump data block other than the second dump data block based on the start storage location of each dump data block.
Optionally, if the first file includes a data name and/or a data type, the data name and/or the data type is stored in the second file.
Optionally, the apparatus further comprises:
the receiving module is used for receiving a data acquisition request, wherein the data acquisition request comprises a target data group identifier, and the target data group identifier is used for indicating a target data group;
the first determining module is used for determining the corresponding transfer data block of the target data group indicated by the target data group identification based on the corresponding relation between each transfer data block and the target data group;
The second determining module is used for determining the storage position of the determined transfer data block in the second file;
and the acquisition module is used for acquiring data from the determined storage position.
Optionally, the second storage module is configured to:
and recording the storage position of the at least one dump data block in the second file and the corresponding relation between each dump data block in the at least one dump data block and the target data group in the file header of the second file.
Optionally, the second file is a binary file.
According to a third aspect of embodiments of the present specification, there is provided a computing device comprising:
a memory and a processor;
the memory is for storing computer-executable instructions, and the processor is for executing the computer-executable instructions:
acquiring data to be transferred in at least one target data group of a first file;
storing the data to be restored belonging to the same target data group into a data block to obtain at least one restored data block, wherein the restored data block corresponds to the target data group one by one;
storing the at least one transfer data block into a second file, and recording the storage position of the at least one transfer data block in the second file and the corresponding relation between each transfer data block in the at least one transfer data block and a target data group in the second file.
According to a fourth aspect of embodiments of the present description, there is provided a computer-readable storage medium storing computer-executable instructions which, when executed by a processor, implement the steps of the data transfer storage method.
According to the data transfer storage method, data to be transferred in at least one target data set of a first file are obtained, the data to be transferred belonging to the same target data set are stored in one data block, at least one transfer data block is obtained, and the transfer data blocks are in one-to-one correspondence with the target data set. Storing at least one transfer data block into a second file, and recording the storage position of the at least one transfer data block in the second file and the corresponding relation between each transfer data block in the at least one transfer data block and the target data group in the second file. Therefore, when the data acquisition request is received, the computing device can determine the data block where the data to be acquired is located according to the corresponding relation between the data block and the target data group, and only acquire the determined data block from the storage position, without acquiring all the data in the second file, and because the storage space of one data block is smaller, the occupied amount of the storage space is reduced, the data acquisition efficiency is improved, and the data updating efficiency is further improved.
Drawings
FIG. 1 is a flow chart of a data transfer and storage method according to an embodiment of the present disclosure;
FIG. 2A is a schematic diagram of a first document according to one embodiment of the present disclosure;
FIG. 2B is a schematic diagram of a data storage of a second file according to an embodiment of the present disclosure;
FIG. 3 is a flow chart of a data storage method applied to game configuration data according to an embodiment of the present disclosure;
FIG. 4 is a schematic diagram of a data transfer and storage device according to an embodiment of the present disclosure;
fig. 5 is a block diagram of a computing device according to an embodiment of the present disclosure.
Detailed Description
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present description. This description may be embodied in many other forms than described herein and similarly generalized by those skilled in the art to whom this disclosure pertains without departing from the spirit of the disclosure and, therefore, this disclosure is not limited by the specific implementations disclosed below.
The terminology used in the one or more embodiments of the specification is for the purpose of describing particular embodiments only and is not intended to be limiting of the one or more embodiments of the specification. As used in this specification, one or more embodiments and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used in one or more embodiments of the present specification refers to and encompasses any or all possible combinations of one or more of the associated listed items.
It should be understood that, although the terms first, second, etc. may be used in one or more embodiments of this specification to describe various information, these information should not be limited by these terms. These terms are only used to distinguish one type of information from another. For example, a first may also be referred to as a second, and similarly, a second may also be referred to as a first, without departing from the scope of one or more embodiments of the present description. The word "if" as used herein may be interpreted as "at … …" or "at … …" or "responsive to a determination", depending on the context.
First, terms related to one or more embodiments of the present specification will be explained.
Data block: the data block is also referred to as a memory block for storing data.
In the present specification, a data transfer and storage method is provided, and the present specification relates to a data transfer and storage device, a computing apparatus, and a computer-readable storage medium, which are described in detail in the following embodiments one by one.
Fig. 1 shows a flowchart of a data transfer and storage method according to an embodiment of the present disclosure, which specifically includes the following steps:
step 102: and acquiring data to be transferred in at least one target data group of the first file.
The file format of the first file may be xls format, xml format, txt format, csv format, etc. For example, the first file may be an Excel table, a txt text file, a csv text file, or the like.
In the embodiment of the present specification, taking the first file as an Excel table as an example, the data storage method provided in the present specification is described.
In some embodiments, the target data set may be a set of data stored in the first file. As an example, if the first file is an Excel table, the target data set may include a column of data or include a row of data. For example, referring to fig. 2A, if the first file is an Excel table, and the first row in the Excel table stores the data name of the data, the second row stores the data type of the data, and the third row and the fourth row store the data, the target data set is the third row and/or the fourth row.
As an example, if the first file is a txt text file, the target data set may be partitioned with tabs.
As one example, the computing device may parse the data in the first file, determine whether each data set stores data, and determine the data set storing the data as the target data set.
As another example, the target data set may be set by the user according to actual needs. That is, the user can select which data sets in the first file to transfer and store according to the actual requirement, and the operation mode is more flexible.
In some embodiments, the number of at least one target data set may be one or more, and the at least one target data set may be all of the sets in the first file.
In some embodiments, the data to be restored is data that needs to be restored in the first file. Continuing with the above example, referring to fig. 2A, if the target data set is the third row and the fourth row in the first file, which indicates that the data of the third row and the data of the fourth row need to be restored, the data to be restored is all the data stored in the third row and all the data stored in the fourth row.
As an example, all data in the first file may be loaded, and the data to be restored in at least one target data group is marked, where the mark corresponds to the target data group to which the data to be restored belongs one by one, and the marks of the data to be restored in the same target data group are the same, and the marks of the data to be restored in different target data groups are different from each other. Thus, the data to be dumped in the at least one target data set can be acquired from all the data loaded based on the mark.
Step 104: and storing the data to be restored which belong to the same target data group into a data block to obtain at least one restored data block, wherein the restored data block corresponds to the target data group one by one.
The second file may be a text file or a binary file. In case the second file is a binary file, the data to be transferred of the at least one target data set needs to be converted into data in binary form.
The data transfer block is used for storing data to be transferred of the target data set, and corresponds to the target data set one by one. Therefore, the data block can be determined to be transferred based on the target data group, and the aim of directly positioning to a certain target data group in the first file can be fulfilled.
As an example, after the data to be transferred of at least one target data group is acquired, the data to be transferred belonging to the same target data group may be determined according to the flag of the data to be transferred, the data to be transferred belonging to the same target data group may be stored in the same data block, and the data blocks to be transferred having the same number as the at least one target data group may be obtained.
For example, referring to fig. 2A, if the target data set includes a third row and a fourth row, the data to be restored in the acquired at least one target data set includes 1, 2, haha, 2, 3 and test, since the data of the third row includes 1, 2 and ha, and the data of the fourth row includes 2, 3 and test, 1, 2 and ha are stored in the same data block, and 2, 3 and test are stored in the same data block. For example, referring to FIG. 2B, FIG. 2B is a schematic diagram of a data store for a second file. Data corresponding to the third row in the first file 201 and data corresponding to the fourth row in the second file 202 are stored in data block a corresponding to 211, and data corresponding to 202 is stored in data block B corresponding to 212, so that two dump data blocks can be obtained.
It should be noted that, when the data to be restored belonging to the same target data group is stored in one data block, only the data in the data block can be acquired when the data is required to be acquired in data updating.
Step 106: storing at least one transfer data block into a second file, and recording the storage position of the at least one transfer data block in the second file and the corresponding relation between each transfer data block in the at least one transfer data block and the target data group in the second file.
In implementations, at least one of the transferred data blocks corresponding to a first file may be stored in a second file. That is, the second file is in one-to-one correspondence with the first file.
In an implementation, recording, in the second file, a storage location of the at least one dump data block in the second file may include: a start storage location and an end storage location of each of the at least one dump data block are determined. And determining the initial storage position and the end storage position of each data block to be stored as the storage position of each data block in the second file. And recording the storage position of each dump data block in the second file.
Since all data in a certain transfer data block needs to be acquired when data is acquired later, the starting storage position and the ending storage position of each transfer data block need to be determined, and then the storage position of each transfer data block in the second file is determined and recorded, so that all data in each transfer data block can be acquired according to the information when the data is acquired later.
In one possible implementation, determining the start storage location and the end storage location of each of the at least one dump data block may include: and recording a starting storage position of a first transfer data block in at least one transfer data block, wherein the first transfer data block is used for storing data of a first target data group for data transfer storage in the first file. And determining the storage space of each dump data block in at least one dump data block according to the data type of the data stored in each dump data block. And determining the end storage position of each transfer data block and the initial storage position of other transfer data blocks except the first transfer data block in at least one transfer data block based on the initial storage position of the first transfer data block and the storage space of each transfer data block.
Among them, data types include int (basic integer), float (floating point type), string (string type), and the like.
That is, a starting storage location of the first dump data block may be determined, and a storage space of each dump data block may be determined, with an ending storage location of each dump data block and starting storage locations of other dump data blocks being determined based on the starting storage location of the first dump data block and the storage space of each dump data block.
As an example, referring to fig. 2A, the first file shown in fig. 2A includes 4 rows, the target data group includes a third row and a fourth row, and the time for storing the data block corresponding to the third row into the second file is earlier than the time for storing the data block corresponding to the fourth row into the second file, the data block corresponding to the third row may be determined as the first data block.
In an implementation, the starting storage location of the first transfer data block may be recorded during the storing of the first transfer data block into the second file.
In an implementation, the size of bytes occupied by the data stored in each of the dump data blocks is determined according to the data type of the data stored in each of the dump data blocks, i.e. the storage space of each of the dump data blocks is determined.
It should be noted that the storage space occupied by different data types is different, and the storage space occupied by the same data type in different computing devices may also be different. Taking x86 as an example, the storage space occupied by int-type data is 4 bytes, the storage space occupied by float-type data is 4 bytes, the storage space occupied by each character in string-type data is 1 byte, and one more trailing/0 is calculated for string-type data.
For example, referring to fig. 2A, for the dump data block corresponding to the third row in the second file, the data types of the dump data block are integer, floating point and string, and the data of the third row is 1, 2 and ha, it may be determined that the storage space of the dump data block corresponding to the third row is 4+4+4+5=17.
In implementations, an ending storage location of the first spool data block may be determined based on a starting storage location of the first spool data block and a storage space of the first spool data block. For example, assuming that the start storage location of the first dump data block is 1 st byte and the storage space of the first dump data block is 17 th byte, the end storage location of the first dump data block is 17 th byte.
As an example, the start storage location and the end storage location of each of the at least one spool may be determined sequentially according to the order in which the at least one spool is stored in the second file.
For example, assuming that the third row corresponds to the first dump data block and the end storage location of the first dump data block is the 17 th byte, the start storage location of the dump data block corresponding to the fourth row is the 18 th byte. Assuming that the storage space of the data block corresponding to the fourth row is 17 bytes, the end storage position of the data block corresponding to the fourth row is 34 th byte.
In another possible implementation manner, determining a start storage location and an end storage location of each of the at least one dump data block may include: the starting storage location of each of the at least one dump data block is recorded. And determining the storage space of a second transfer data block according to the data type of the data stored in the second transfer data block in at least one transfer data block, wherein the second transfer data block is used for storing the data of the last target data group for data transfer storage in the first file. An ending storage location of the second dump data block is determined based on the starting storage location of the second dump data block and the storage space of the second dump data block, and an ending storage location of other dump data blocks in the at least one dump data block other than the second dump data block is determined based on the starting storage location of each dump data block.
That is, a starting storage location of the first dump data block may be determined, and a storage space of each dump data block may be determined, with an ending storage location of each dump data block and starting storage locations of other dump data blocks being determined based on the starting storage location of the first dump block and the storage space of each dump data block.
As an example, referring to fig. 2A, the first file shown in fig. 2A includes 4 rows, the target data set includes a third row and a fourth row, and the time for storing the data block corresponding to the third row into the second file is earlier than the time for storing the data block corresponding to the fourth row into the second file, and the data block corresponding to the fourth row may be determined as the second data block.
In an implementation, the starting storage location of each of the transferred data blocks may be recorded during the storing of the at least one transferred data block in the second file.
In implementation, for the second dump data block, the byte size occupied by the data stored in the second dump data block may be determined according to the data type of the data stored in the second dump data block, that is, the storage space of the second dump data block is determined.
In an implementation, an ending storage location of the second dump data block may be determined based on a starting storage location of the second dump data block and a storage space of the second dump data block.
As one example, at least one of the dump data blocks may be ordered according to a starting storage location of each of the dump data blocks. For any one of the transfer data blocks, subtracting 1 from the start storage position of the transfer data block subsequent to the any one of the transfer data blocks, so as to obtain the end storage position of the any one of the transfer data blocks, and thus, the end storage positions of the transfer data blocks except the second transfer data block in at least one of the transfer data blocks can be determined.
In implementation, the correspondence between each dump data block and the target data group may be represented as a correspondence between the dump data block identifier and the target data group identifier. Wherein the transfer data block identifier is used for uniquely indicating one transfer data block, and the target data group identifier is used for uniquely indicating one target data group. For example, the dump data block 211 corresponds to the target data group 201, and the dump data block 212 corresponds to the target data group 202.
In some embodiments, if the first file includes a data name and/or data type, the data name and/or data type is stored in the second file.
For example, referring to fig. 2A, the first row in the first file shown in fig. 2A stores data names corresponding to the data of each column, and the second row stores data types corresponding to the data of each column.
As an example, to facilitate quick searching, a storage location of at least one dump data block in the second file and a correspondence between each of the at least one dump data block and the target data group may be recorded in a file header of the second file. For example, referring to fig. 2B, in fig. 2B, the storage location of the data block a recorded in the header of the second file is 1 st byte to 17 th byte, the storage location of the data block B is 18 th byte to 34 th byte, the data block a corresponds to the target data group 201, and the data block B corresponds to the target data group 202.
It should be noted that, based on the above method, the data transfer and storage method set forth in the present specification may be implemented. Next, a process of acquiring data after storing the data based on the data transfer storage method of the present specification will be described.
In implementations, a data acquisition request may be received, the data acquisition request including a target data set identifier, the target data set identifier indicating a target data set. And determining the corresponding transfer data blocks of the target data group indicated by the target data group identification based on the corresponding relation between each transfer data block and the target data group. And determining the storage position of the determined transfer data block in the second file. Data is retrieved from the determined storage location.
That is, the data acquisition request received by the computing device includes the target data group identifier, and since the correspondence between the target data group and the dump data block is stored in the second file, and the target data group identifier may be used to uniquely indicate one target data group, the dump data block corresponding to the target data group indicated by the target data group identifier may be determined. The storage location of the transferred data block in the second file is then determined so that data can be retrieved from the storage location.
As an example, from the storage location of each of the dump data blocks recorded in the second file, the start storage location and the end storage location of the dump data block may be determined, and the data stored between the start storage location and the end storage location and the data stored at the start storage location and the end storage location may be acquired, so that all the data in the dump data block may be acquired.
According to the data transfer storage method, data to be transferred in at least one target data set of a first file are obtained, the data to be transferred belonging to the same target data set are stored in one data block, at least one transfer data block is obtained, and the transfer data blocks are in one-to-one correspondence with the target data set. Storing at least one transfer data block into a second file, and recording the storage position of the at least one transfer data block in the second file and the corresponding relation between each transfer data block in the at least one transfer data block and the target data group in the second file. Therefore, when the data acquisition request is received, the computing device can determine the data block where the data to be acquired is located according to the corresponding relation between the data block and the target data group, and only acquire the determined data block from the storage position, without acquiring all the data in the second file, and because the storage space of one data block is smaller, the occupied amount of the storage space is reduced, the data acquisition efficiency is improved, and the data updating efficiency is further improved.
Taking the application of the data storage method provided in the present specification in game configuration data as an example, the data storage method will be further described. Fig. 3 shows a flowchart of a data storage method applied to game configuration data acquisition according to an embodiment of the present disclosure, which specifically includes the following steps:
step 302: game configuration data in at least one row of an Excel table is obtained.
Referring to fig. 2A, the Excel table shown in fig. 2A includes four rows, the first row storing data names of game configuration data, and the second row storing data types of game configuration data. The third and fourth rows store game configuration data.
For example, name 1 (nID), name 1 (nValue 1), name 3 (fValue 2) and name 4 (szValue 3) are defined in the first row of the Excel table. In the second row of the Excel table, four data types of integer, floating point, and character string type are defined, and correspond to game configuration data of name 1, name 2, name 3, and name 4, respectively. And storing 1, 2 and haha in the third row of the Excel table, wherein the third row stores 2, 3 and test, which are all actual game configuration data, so that the game configuration data in the third row and/or the fourth row can be acquired.
Specifically, in the data transfer storage program, data for parsing an Excel table may be configured, and it is possible to distinguish between a row storing game configuration data, a row storing a data type, and a row storing a data name in the Excel table. In this way, game configuration data can be obtained from the Excel table.
Step 304: and storing the game configuration data belonging to the same row into a data block to obtain at least one dump data block, wherein the dump data block corresponds to the row in the Excel table one by one.
In the process of acquiring the game configuration data, the acquired game configuration data may be marked, and the same mark may be set for the game configuration data belonging to the same line, whereby the game configuration data belonging to the same line may be determined according to the mark.
For example, in the process of acquiring game configuration data of the third row and the fourth row, a flag 1 may be set for four game configuration data of 1, 2, and haha of the third row, and a flag 2 may be set for 2, 3, and test of the four game configuration data of the fourth row. By querying the flag corresponding to each game configuration data, it can be determined that the four game configuration data 1, 2 and ha, which are marked as flag 1, belong to the same row, and the four game configuration data 2, 3, which belong to the third row, which are marked as flag 2, belong to the same row, and the test belongs to the fourth row. It follows that 1, 2 and ha may be stored in the same data block and the data block corresponds to the third row, 2, 3 and test may be stored in the same data block and the data block corresponds to the fourth row.
As one example, the data format of the game configuration data may be converted to a binary format, with the game configuration data in the binary format being stored in the data block.
Step 306: storing at least one dump data block into a binary file, and recording the corresponding relation between each dump data block and the row in the at least one dump data block in the binary file.
The game configuration data of the third row in the Excel table is stored in the transfer data block A, the game configuration data of the fourth row is stored in the transfer data block B, the game configuration data of the third row and the game configuration data of the fourth row come from the same Excel table, and the transfer data block A corresponding to the third row and the transfer data block B corresponding to the fourth row can be stored in the same binary file. And, a third row corresponding to the dump data block a and a fourth row corresponding to the dump data block B are recorded in the binary file.
The Excel table shown in fig. 2A includes data names and data types, and the data names and the data types may also be stored in a binary file. That is, four data names of name 1 (nID), name 1 (nValue 1), name 3 (fValue 2) and name 4 (szValue 3) are stored in the binary file, and four data types of integer (int), floating point (float) and string (string) are stored in the binary file.
In order to facilitate the query, the data name, the data type, and the correspondence between each dump data block and the target data set may be stored in the header of the binary file.
Step 308: the storage location of at least one of the dump data blocks in the binary file is recorded in the binary file.
Since all game configuration data in a certain transfer data block need to be acquired when the game configuration data is acquired later, the starting storage position and the ending storage position of each transfer data block need to be determined, and then the storage position of each transfer data block in a binary file is determined and recorded, so that all game configuration data in each transfer data block can be acquired according to the information when the game configuration data is acquired later.
In implementation, a start storage position and an end storage position of the transfer data block a and the transfer data block B in the binary file may be determined respectively, the start storage position and the end storage position of the transfer data block a are determined as storage positions of the transfer data block a in the binary file, the start storage position and the end storage position of the transfer data block B are determined as storage positions of the transfer data block B in the binary file, and the storage positions of the transfer data block a and the transfer data block B in the binary file are recorded in the binary file.
In one possible implementation, the starting storage location of the data block a may be determined, the storage space of the data block a may be determined based on the data type of the data stored by the data block a, and the storage space of the data block B may be determined based on the data type of the data stored by the data block B. And determining the end storage positions of the transfer data block A and the transfer data block B and the start storage position of the transfer data block B based on the start storage position of the transfer data block A and the storage space of the transfer data block B.
In an implementation, the starting storage location of the dump data block a may be recorded during the process of storing the dump data block a into the binary file.
As an example, assuming that the data types of the four game configuration data stored in the transfer data block a corresponding to the third row are integer, floating point, and character string type, respectively, and the game configuration data of the third row is 1, 2, and ha, it can be determined that the storage space of the transfer data block a corresponding to the third row is 4+4+4+5=17. Similarly, the storage space of the dump data block B corresponding to the fourth line may be determined to be 17.
From this, it can be determined that the start storage position of the transferred data block B corresponding to the fourth row is 17+1=18, that is, the end storage position is 18 th byte, and the end storage position of the transferred data block B is 18+17-1=34, that is, the end storage position is 34 th byte.
In another possible implementation manner, the initial storage positions of the dump data block a and the dump data block B may be recorded separately, and the storage space of the dump data block B is determined according to the data type of the data stored by the dump data block B. The end storage position of the transfer data block B is determined based on the start storage position of the transfer data block B and the storage space of the transfer data block B, and the end storage position of the transfer data block a can be determined based on the start storage positions of the transfer data block a and the transfer data block B.
In implementation, the initial storage positions of the dump data block a and the dump data block B may be recorded during the process of storing the dump data block a and the dump data block B into the binary file.
As an example, assuming that the data types of the four game configuration data stored in the transfer data block a corresponding to the third row are integer, floating point, and character string type, respectively, and the game configuration data of the third row is 1, 2, and ha, it can be determined that the storage space of the transfer data block a corresponding to the third row is 4+4+4+5=17.
Therefore, the end storage position of the data block a corresponding to the third row can be determined to be the 17 th byte, the start storage position of the data block B can be determined to be the 18 th byte, the end storage position of the data block B is 18+17-1=34, that is, the end storage position is the 34 th byte. It may further be determined that the storage location of the transferred data block a is 1 st byte to 17 th byte and the storage location of the transferred data block B is 18 th byte to 34 th byte.
For ease of querying, the storage location of the dump data block a and the storage location of the dump data block B may be recorded in the header of the binary file.
It should be noted that, based on the above method, the data transfer and storage method set forth in the present specification may be implemented. Next, a description will be given of a process of acquiring game configuration data after storing the game configuration data based on the data transfer storage method of the present specification.
In an implementation, a data acquisition request may be received, where the data acquisition request includes a row identifier, and the computing device may determine, based on a correspondence between each of the dump data blocks and a row, a dump data block corresponding to a row indicated by the row identifier, determine a storage location of the dump data block in the binary file, and acquire game configuration data from the determined storage location.
For example, the row is identified as 3, it may be determined that the data of the third row is required, and the third row corresponds to the transferred data block a in the binary file, and it may be determined that the storage location of the transferred data block a is 1 st byte to 17 th byte, so that the game configuration data stored in 1 st byte to 17 th byte in the binary file may be acquired.
It should be noted that, the steps 306 and 308 are based on storing at least one of the transferred data blocks in the binary file, and recording the storage location of the at least one transferred data block in the binary file and the correspondence between each of the at least one transferred data block and the row in the binary file.
According to the data transfer storage method, data to be transferred in at least one target data set of a first file are obtained, the data to be transferred belonging to the same target data set are stored in one data block, at least one transfer data block is obtained, and the transfer data blocks are in one-to-one correspondence with the target data set. Storing at least one transfer data block into a second file, and recording the storage position of the at least one transfer data block in the second file and the corresponding relation between each transfer data block in the at least one transfer data block and the target data group in the second file. Therefore, when the data acquisition request is received, the computing device can determine the data block where the data to be acquired is located according to the corresponding relation between the data block and the target data group, and only acquire the determined data block from the storage position, without acquiring all the data in the second file, and because the storage space of one data block is smaller, the occupied amount of the storage space is reduced, the data acquisition efficiency is improved, and the data updating efficiency is further improved.
Corresponding to the method embodiment, the present disclosure further provides an embodiment of a data transfer storage device, and fig. 3 shows a schematic structural diagram of the data transfer storage device according to an embodiment of the present disclosure. As shown in fig. 3, the apparatus includes:
An obtaining module 402, configured to obtain data to be transferred in at least one target data set of the first file;
a first storage module 404, configured to store the data to be restored belonging to the same target data set into a data block, so as to obtain at least one restored data block, where the restored data block corresponds to the target data set one to one;
and a second storage module 406, configured to store the at least one dump data block in a second file, and record, in the second file, a storage location of the at least one dump data block in the second file and a correspondence between each dump data block in the at least one dump data block and a target data group.
Optionally, the second storage module 406 is configured to:
determining a start storage position and an end storage position of each of the at least one dump data block;
determining a start storage position and an end storage position of each dump data block as storage positions of each dump data block in the second file;
and recording the storage position of each dump data block in the second file.
Optionally, the second storage module 406 is configured to:
Recording a starting storage position of a first dump data block in the at least one dump data block, wherein the first dump data block is used for storing data of a target data group for data dump storage of a first one of the first files;
determining the storage space of each dump data block in the at least one dump data block according to the data type of the data stored by each dump data block;
and determining an end storage position of each transfer data block and a start storage position of other transfer data blocks except the first transfer data block in the at least one transfer data block based on the start storage position of the first transfer data block and the storage space of each transfer data block.
Optionally, the second storage module 406 is configured to:
recording a starting storage position of each of the at least one dump data block;
determining a storage space of a second dump data block according to the data type of data stored in the second dump data block in the at least one dump data block, wherein the second dump data block is used for storing the data of the last target data group for data dump storage in the first file;
Determining an end storage location of the second dump data block based on a start storage location of the second dump data block and a storage space of the second dump data block, and determining an end storage location of other dump data blocks of the at least one dump data block other than the second dump data block based on the start storage location of each dump data block.
Optionally, if the first file includes a data name and/or a data type, the data name and/or the data type is stored in the second file.
Optionally, the apparatus further comprises:
the receiving module is used for receiving a data acquisition request, wherein the data acquisition request comprises a target data group identifier, and the target data group identifier is used for indicating a target data group;
the first determining module is used for determining the corresponding transfer data block of the target data group indicated by the target data group identification based on the corresponding relation between each transfer data block and the target data group;
the second determining module is used for determining the storage position of the determined transfer data block in the second file;
and the acquisition module is used for acquiring data from the determined storage position.
Optionally, the second storage module 406 is configured to:
and recording the storage position of the at least one dump data block in the second file and the corresponding relation between each dump data block in the at least one dump data block and the target data group in the file header of the second file.
Optionally, the second file is a binary file.
According to the data transfer storage method, data to be transferred in at least one target data set of a first file are obtained, the data to be transferred belonging to the same target data set are stored in one data block, at least one transfer data block is obtained, and the transfer data blocks are in one-to-one correspondence with the target data set. Storing at least one transfer data block into a second file, and recording the storage position of the at least one transfer data block in the second file and the corresponding relation between each transfer data block in the at least one transfer data block and the target data group in the second file. Therefore, when the data acquisition request is received, the computing device can determine the data block where the data to be acquired is located according to the corresponding relation between the data block and the target data group, and only acquire the determined data block from the storage position, without acquiring all the data in the second file, and because the storage space of one data block is smaller, the occupied amount of the storage space is reduced, the data acquisition efficiency is improved, and the data updating efficiency is further improved.
The foregoing is a schematic solution of a data transfer storage device according to this embodiment. It should be noted that, the technical solution of the data transfer and storage device and the technical solution of the data transfer and storage method belong to the same concept, and details of the technical solution of the data transfer and storage device, which are not described in detail, can be referred to the description of the technical solution of the data transfer and storage method.
Fig. 5 illustrates a block diagram of a computing device 500 provided in accordance with an embodiment of the present specification. The components of the computing device 500 include, but are not limited to, a memory 510 and a processor 520. Processor 420 is coupled to memory 510 via bus 530 and database 550 is used to hold data.
Computing device 500 also includes access device 540, access device 540 enabling computing device 500 to communicate via one or more networks 560. Examples of such networks include the Public Switched Telephone Network (PSTN), a Local Area Network (LAN), a Wide Area Network (WAN), a Personal Area Network (PAN), or a combination of communication networks such as the internet. The access device 540 may include one or more of any type of network interface, wired or wireless (e.g., a Network Interface Card (NIC)), such as an IEEE802.11 Wireless Local Area Network (WLAN) wireless interface, a worldwide interoperability for microwave access (Wi-MAX) interface, an ethernet interface, a Universal Serial Bus (USB) interface, a cellular network interface, a bluetooth interface, a Near Field Communication (NFC) interface, and so forth.
In one embodiment of the present description, the above-described components of computing device 500, as well as other components not shown in FIG. 5, may also be connected to each other, such as by a bus. It should be understood that the block diagram of the computing device shown in FIG. 5 is for exemplary purposes only and is not intended to limit the scope of the present description. Those skilled in the art may add or replace other components as desired.
Computing device 500 may be any type of stationary or mobile computing device, including a mobile computer or mobile computing device (e.g., tablet, personal digital assistant, laptop, notebook, netbook, etc.), mobile phone (e.g., smart phone), wearable computing device (e.g., smart watch, smart glasses, etc.), or other type of mobile device, or a stationary computing device such as a desktop computer or PC. Computing device 500 may also be a mobile or stationary server.
The processor 520 is configured to execute the following computer-executable instructions:
acquiring data to be transferred in at least one target data group of a first file;
storing the data to be restored belonging to the same target data group into a data block to obtain at least one restored data block, wherein the restored data block corresponds to the target data group one by one;
Storing the at least one transfer data block into a second file, and recording the storage position of the at least one transfer data block in the second file and the corresponding relation between each transfer data block in the at least one transfer data block and a target data group in the second file.
The foregoing is a schematic illustration of a computing device of this embodiment. It should be noted that, the technical solution of the computing device and the technical solution of the data transfer and storage method belong to the same concept, and details of the technical solution of the computing device, which are not described in detail, can be referred to the description of the technical solution of the data transfer and storage method.
An embodiment of the present disclosure also provides a computer-readable storage medium storing computer instructions that, when executed by a processor, are configured to:
acquiring data to be transferred in at least one target data group of a first file;
storing the data to be restored belonging to the same target data group into a data block to obtain at least one restored data block, wherein the restored data block corresponds to the target data group one by one;
storing the at least one transfer data block into a second file, and recording the storage position of the at least one transfer data block in the second file and the corresponding relation between each transfer data block in the at least one transfer data block and a target data group in the second file.
The above is an exemplary version of a computer-readable storage medium of the present embodiment. It should be noted that, the technical solution of the storage medium and the technical solution of the data transfer storage method belong to the same concept, and details of the technical solution of the storage medium which are not described in detail can be referred to the description of the technical solution of the data transfer storage method.
The foregoing describes specific embodiments of the present disclosure. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims can be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
The computer instructions include computer program code that may be in source code form, object code form, executable file or some intermediate form, etc. The computer readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer memory, a Read-only memory (ROM), a random access memory (RAM, randomAccessMemory), an electrical carrier signal, a telecommunication signal, a software distribution medium, and so forth. It should be noted that the computer readable medium contains content that can be appropriately scaled according to the requirements of jurisdictions in which such content is subject to legislation and patent practice, such as in certain jurisdictions in which such content is subject to legislation and patent practice, the computer readable medium does not include electrical carrier signals and telecommunication signals.
It should be noted that, for the sake of simplicity of description, the foregoing method embodiments are all expressed as a series of combinations of actions, but it should be understood by those skilled in the art that the present description is not limited by the order of actions described, as some steps may be performed in other order or simultaneously in accordance with the present description. Further, those skilled in the art will appreciate that the embodiments described in the specification are all preferred embodiments, and that the acts and modules referred to are not necessarily all necessary in the specification.
In the foregoing embodiments, the descriptions of the embodiments are emphasized, and for parts of one embodiment that are not described in detail, reference may be made to the related descriptions of other embodiments.
The preferred embodiments of the present specification disclosed above are merely used to help clarify the present specification. Alternative embodiments are not intended to be exhaustive or to limit the invention to the precise form disclosed. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the disclosure and the practical application, to thereby enable others skilled in the art to best understand and utilize the disclosure. This specification is to be limited only by the claims and the full scope and equivalents thereof.

Claims (10)

1. A method of data transfer storage, the method comprising:
acquiring data to be transferred in at least one target data group of a first file;
storing the data to be restored belonging to the same target data group into a data block to obtain at least one restored data block, wherein the restored data block corresponds to the target data group one by one;
storing the at least one transfer data block into a second file, and recording the storage position of the at least one transfer data block in the second file and the corresponding relation between each transfer data block in the at least one transfer data block and a target data group in the second file;
after storing the at least one dump data block in the second file, the method further comprises:
receiving a data acquisition request, wherein the data acquisition request comprises a target data group identifier, and the target data group identifier is used for indicating a target data group;
determining a corresponding transfer data block of the target data group indicated by the target data group identification based on the corresponding relation between each transfer data block and the target data group;
determining a storage position of the determined transfer data block in the second file;
Data is retrieved from the determined storage location.
2. The data transfer storage method according to claim 1, wherein said recording, in the second file, a storage location of the at least one transfer data block in the second file includes:
determining a start storage position and an end storage position of each of the at least one dump data block;
determining a start storage position and an end storage position of each dump data block as storage positions of each dump data block in the second file;
and recording the storage position of each dump data block in the second file.
3. The data transfer storage method according to claim 2, wherein determining a start storage location and an end storage location of each of the at least one transfer data block comprises:
recording a starting storage position of a first dump data block in the at least one dump data block, wherein the first dump data block is used for storing data of a target data group for data dump storage of a first one of the first files;
determining the storage space of each dump data block in the at least one dump data block according to the data type of the data stored by each dump data block;
And determining an end storage position of each transfer data block and a start storage position of other transfer data blocks except the first transfer data block in the at least one transfer data block based on the start storage position of the first transfer data block and the storage space of each transfer data block.
4. The data transfer storage method according to claim 2, wherein determining a start storage location and an end storage location of each of the at least one transfer data block comprises:
recording a starting storage position of each of the at least one dump data block;
determining a storage space of a second dump data block according to the data type of data stored in the second dump data block in the at least one dump data block, wherein the second dump data block is used for storing the data of the last target data group for data dump storage in the first file;
determining an end storage location of the second dump data block based on a start storage location of the second dump data block and a storage space of the second dump data block, and determining an end storage location of other dump data blocks of the at least one dump data block other than the second dump data block based on the start storage location of each dump data block.
5. The data transfer and storage method according to claim 1, wherein if the first file includes a data name and/or a data type, the data name and/or the data type is stored in the second file.
6. The data transfer storage method as claimed in any one of claims 1 to 4, wherein the recording, in the second file, the storage location of the at least one transfer data block in the second file and the correspondence between each transfer data block in the at least one transfer data block and the target data group includes:
and recording the storage position of the at least one dump data block in the second file and the corresponding relation between each dump data block in the at least one dump data block and the target data group in the file header of the second file.
7. The data transfer storage method as claimed in any one of claims 1 to 5, wherein the second file is a binary file.
8. A data transfer storage device, comprising:
the acquisition module is used for acquiring data to be transferred in at least one target data group of the first file;
the first storage module is used for storing the data to be restored belonging to the same target data group into a data block to obtain at least one restored data block, wherein the restored data block corresponds to the target data group one by one;
The second storage module is used for storing the at least one transfer data block into a second file, and recording the storage position of the at least one transfer data block in the second file and the corresponding relation between each transfer data block in the at least one transfer data block and a target data group in the second file;
the receiving module is used for receiving a data acquisition request, wherein the data acquisition request comprises a target data group identifier, and the target data group identifier is used for indicating a target data group;
the first determining module is used for determining the corresponding transfer data block of the target data group indicated by the target data group identification based on the corresponding relation between each transfer data block and the target data group;
the second determining module is used for determining the storage position of the determined transfer data block in the second file;
and the acquisition module is used for acquiring data from the determined storage position.
9. A computing device, comprising:
a memory and a processor;
the memory is configured to store computer-executable instructions and the processor is configured to execute the computer-executable instructions to implement the method of:
acquiring data to be transferred in at least one target data group of a first file;
Storing the data to be restored belonging to the same target data group into a data block to obtain at least one restored data block, wherein the restored data block corresponds to the target data group one by one;
storing the at least one transfer data block into a second file, and recording the storage position of the at least one transfer data block in the second file and the corresponding relation between each transfer data block in the at least one transfer data block and a target data group in the second file;
after storing the at least one dump data block in the second file, further comprising:
receiving a data acquisition request, wherein the data acquisition request comprises a target data group identifier, and the target data group identifier is used for indicating a target data group;
determining a corresponding transfer data block of the target data group indicated by the target data group identification based on the corresponding relation between each transfer data block and the target data group;
determining a storage position of the determined transfer data block in the second file;
data is retrieved from the determined storage location.
10. A computer readable storage medium storing computer instructions which, when executed by a processor, implement the steps of the data transfer storage method of any one of claims 1 to 7.
CN202011120115.6A 2020-10-19 2020-10-19 Data transfer and storage method and device Active CN112214458B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011120115.6A CN112214458B (en) 2020-10-19 2020-10-19 Data transfer and storage method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011120115.6A CN112214458B (en) 2020-10-19 2020-10-19 Data transfer and storage method and device

Publications (2)

Publication Number Publication Date
CN112214458A CN112214458A (en) 2021-01-12
CN112214458B true CN112214458B (en) 2023-08-11

Family

ID=74055920

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011120115.6A Active CN112214458B (en) 2020-10-19 2020-10-19 Data transfer and storage method and device

Country Status (1)

Country Link
CN (1) CN112214458B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2821914A1 (en) * 2013-07-02 2015-01-07 Hitachi Data Systems Engineering UK Limited Method and apparatus for migration of a virtualized file system, data storage system for migration of a virtualized file system, and file server for use in a data storage system
CN104750815A (en) * 2015-03-30 2015-07-01 浪潮集团有限公司 Lob data storing method and device based on HBase
CN107633088A (en) * 2017-09-29 2018-01-26 深圳市金证科技股份有限公司 A kind of file management method and device
CN107807794A (en) * 2017-10-31 2018-03-16 新华三技术有限公司 A kind of date storage method and device
US10649852B1 (en) * 2017-07-14 2020-05-12 EMC IP Holding Company LLC Index metadata for inode based backups

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6981005B1 (en) * 2000-08-24 2005-12-27 Microsoft Corporation Partial migration of an object to another storage location in a computer system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2821914A1 (en) * 2013-07-02 2015-01-07 Hitachi Data Systems Engineering UK Limited Method and apparatus for migration of a virtualized file system, data storage system for migration of a virtualized file system, and file server for use in a data storage system
CN104750815A (en) * 2015-03-30 2015-07-01 浪潮集团有限公司 Lob data storing method and device based on HBase
US10649852B1 (en) * 2017-07-14 2020-05-12 EMC IP Holding Company LLC Index metadata for inode based backups
CN107633088A (en) * 2017-09-29 2018-01-26 深圳市金证科技股份有限公司 A kind of file management method and device
CN107807794A (en) * 2017-10-31 2018-03-16 新华三技术有限公司 A kind of date storage method and device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
面向HDFS的批量文件存储性能的研究与优化;苏义超;中国优秀硕士学位论文全文数据库 (信息科技辑);第12卷;I137-25 *

Also Published As

Publication number Publication date
CN112214458A (en) 2021-01-12

Similar Documents

Publication Publication Date Title
CN110321387A (en) Method of data synchronization, equipment and terminal device
JP2017062792A (en) System and method for updating dataset versions resident on wireless device
JP2009246983A (en) Method, software and apparatus for performing actions on wireless device using action lists and versioning
CN111949324A (en) Distributed serial number generation method and device
JP2007535757A (en) Preserve time-date information for synchronizing low fidelity devices
CN111144402A (en) OCR recognition accuracy calculation method, device, equipment and storage medium
CN112214458B (en) Data transfer and storage method and device
CN112306748B (en) Data recovery method, device and storage medium
CN114253553A (en) Data processing method and device
CN110609967B (en) List generation method and device and storage medium
CN111930395A (en) Program downloading method of intelligent terminal and intelligent terminal
CN116756253A (en) Data storage and query methods, devices, equipment and media of relational database
CN111556127A (en) Wearable device upgrading method and related device
CN114817151A (en) Data processing method and device, computer equipment and storage medium
CN115390847A (en) Log processing method and device, computer readable storage medium and terminal
CN113486025B (en) Data storage method, data query method and device
CN109657209A (en) Replacement method, device, equipment and the computer storage medium of content of text
CN112486465A (en) Code updating method and device
CN109616156B (en) Gene sequencing data storage method and device
GB2452534A (en) Database updates in mobile radio communications device stored in a removable memory device
CN110888863A (en) State field optimization method and device, electronic equipment and storage medium
CN111078632A (en) File data management method and device
CN112657194B (en) Game skill modification method and device
CN112230983B (en) Information processing method, electronic device, and medium
CN117111905A (en) Identifier code generation method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: 519000 Room 102, 202, 302 and 402, No. 325, Qiandao Ring Road, Tangjiawan Town, high tech Zone, Zhuhai City, Guangdong Province, Room 102 and 202, No. 327 and Room 302, No. 329

Applicant after: Zhuhai Jinshan Digital Network Technology Co.,Ltd.

Address before: 519000 Room 102, 202, 302 and 402, No. 325, Qiandao Ring Road, Tangjiawan Town, high tech Zone, Zhuhai City, Guangdong Province, Room 102 and 202, No. 327 and Room 302, No. 329

Applicant before: ZHUHAI KINGSOFT ONLINE GAME TECHNOLOGY Co.,Ltd.

CB02 Change of applicant information
GR01 Patent grant
GR01 Patent grant