CN111435342A - Poster updating method, poster updating system and poster management system - Google Patents
Poster updating method, poster updating system and poster management system Download PDFInfo
- Publication number
- CN111435342A CN111435342A CN201910030958.8A CN201910030958A CN111435342A CN 111435342 A CN111435342 A CN 111435342A CN 201910030958 A CN201910030958 A CN 201910030958A CN 111435342 A CN111435342 A CN 111435342A
- Authority
- CN
- China
- Prior art keywords
- poster
- new
- data
- target file
- storage path
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 230000008569 process Effects 0.000 claims abstract description 22
- 230000014759 maintenance of location Effects 0.000 claims description 15
- 230000007246 mechanism Effects 0.000 claims description 9
- 238000012217 deletion Methods 0.000 claims description 6
- 230000037430 deletion Effects 0.000 claims description 6
- 238000007726 management method Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 5
- 230000003993 interaction Effects 0.000 description 2
- 238000013500 data storage Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
Images
Abstract
The invention discloses a poster updating method, a poster updating system and a poster management system, which aim to solve the problem that the poster updating step is too complicated. The invention replaces the storage path of the original poster data stored in the target file with the storage path of the new poster data without changing the storage path of the target file, thereby realizing the update of the poster, effectively simplifying the update step of the poster and improving the update efficiency of the poster. In addition, in the reading process, the storage path of the target file is not updated, so that if the required target file read by the business system is called once, the storage path of the target file does not need to be searched in the database system, and the storage path of the required target file can be determined directly through the calling record saved by the database system, so that the process of reading the poster is simplified.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a poster updating method, a poster updating system and a poster management system.
Background
With the rapid development of video websites, poster updating methods are also continuously advanced, and nowadays poster updating methods are greatly developed and can meet the requirement of processing a large amount of data.
At present, a poster updating method is that a distributed storage system stores received new poster data in a new logic block allocated by the distributed storage system, then the distributed storage system stores a storage path of the new poster data in a new target file, finally, the distributed storage system returns the storage path of the new target file to a medium resource system, and the medium resource system updates the storage path of the new target file to a database to replace the storage path of the original target file.
However, the existing poster updating method causes the poster data updating step to be too tedious, the poster data updating efficiency is reduced, and the expense of file management is increased.
Disclosure of Invention
In view of this, embodiments of the present invention provide a poster updating method, a poster updating system, and a poster management system, so as to solve the problem that the poster updating procedure is too complicated.
In order to achieve the above purpose, the embodiments of the present invention provide the following technical solutions:
the invention discloses a poster updating method in a first aspect, which comprises the following steps:
the medium resource system determines a storage path of the target file from the database system; the target file is a file of a storage path for storing original poster data;
the media resource system opens the target file in a replacement writing state in a distributed storage system through a storage path of the target file, so that the distributed storage system marks the target file in the replacement writing state;
the media resource system uploads new poster data;
the distributed storage system receives and stores the new poster data, generates a storage path of the new poster data, updates the storage path of the original poster data into the storage path of the new poster data, and updates the capacity of the target file into the size of the new poster data; the storage path of the new poster data comprises a storage path of at least one new logic block and an internal offset address of the new poster data in the new logic block.
Optionally, the process of receiving and storing the new poster data by the distributed storage system and generating a storage path of the new poster data includes:
the distributed storage system receiving the new poster data;
the distributed storage system reallocates N new logical blocks which have the same capacity and are not on the same server or the same disk, generates a storage path of each new logical block, and marks each new logical block in a writing-in state; wherein N is an integer greater than 1, and the value of N depends on the backup mechanism adopted; the storage path of the new logic block comprises a link address of a server or a disk and a logic number of the new logic block on the corresponding server or disk;
and the distributed storage system stores the new poster data into each new logic block and generates an internal offset address of the new poster data in each new logic block.
Optionally, after the updating, by the distributed storage system, the size of the target file to the size of the new poster data, the method further includes:
and deleting the original poster data by the distributed storage system.
Optionally, the deleting, by the distributed storage system, the original poster data includes:
the distributed storage system puts the original logic block into a deletion task list and sets retention time; the original logic block stores the original poster data;
and after the retention time is over, the distributed storage system restores each original logic block to the initial value.
A second aspect of the present invention discloses a poster updating system, comprising: a medium resource system, a database system and a distributed storage system; wherein:
the database system is used for storing a storage path of the target file;
the medium resource system is used for determining a storage path of the target file from the database system, and then opening the target file in a replacement writing state in the distributed storage system through the storage path of the target file, so that the distributed storage system marks the target file in the replacement writing state; then, the medium resource system uploads new poster data; the target file is a file of a storage path for storing original poster data;
the distributed storage system is used for receiving and storing the new poster data, generating a storage path of the new poster data, updating the storage path of the original poster data into the storage path of the new poster data, and updating the capacity of the target file into the size of the new poster data; the storage path of the new poster data comprises a storage path of a new logic block and an internal offset address of the new poster data in the new logic block.
Optionally, the distributed storage system is configured to receive and store the new poster data, and when a storage path of the new poster data is generated, the distributed storage system is specifically configured to:
receiving the new poster data;
redistributing N new logical blocks with the same capacity but not on the same server or the same disk, generating a storage path of each new logical block, and marking each new logical block in a writing state; wherein N is an integer greater than 1, and the value of N depends on the backup mechanism adopted; the storage path of the new logic block comprises a link address of a server or a disk and a logic number of the new logic block on the corresponding server or disk;
and storing the new poster data into each new logic block, and generating an internal offset address of each new poster data in the new logic block.
Optionally, the distributed storage system is further configured to delete the original poster data after updating the size of the capacity of the target file to the size of the new poster data.
Optionally, when the distributed storage system is used to delete the original poster data, the distributed storage system is specifically configured to:
putting the original logic block into a task deletion list, and setting retention time; each original logic block stores the original poster data;
and after the retention time is over, restoring the initial value of each original logic block.
A third aspect of the present invention discloses a poster management system, comprising: business system and above-mentioned poster renewal system; wherein:
the business system is used for determining a storage path of a required target file in the database system; then, through the storage path of the required target file, if the required target file can be opened in the distributed storage system, reading required source data or required poster data; the desired target file holds a storage path for the desired source data or the desired poster data.
Optionally, the business system is configured to pass through a storage path of a desired target file, and if the desired target file can be opened in the distributed storage system, when reading the desired source data or the desired poster data, the business system is specifically configured to:
acquiring a storage path of required source data or required poster data and the size of the required source data or the required poster data in a required target file;
and reading the required source data or the required poster data through a storage path of the required source data or the required poster data.
Compared with the prior art, the method and the device have the advantages that the storage path of the original poster data stored in the target file is replaced without changing the storage path of the target file, and the storage path of the new poster data is changed, so that the poster data is updated, the poster updating steps are effectively simplified, and the poster updating efficiency is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a schematic diagram of a poster updating method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a data storage structure in the distributed storage system;
FIG. 3 is a diagram illustrating an implementation manner of step S104 according to another embodiment of the present invention;
FIG. 4 is a schematic illustration of a poster update method according to another embodiment of the present invention;
FIG. 5 is a diagram illustrating an implementation manner of step S105 according to another embodiment of the present invention;
FIG. 6 is a schematic illustration of a poster renewal system according to another embodiment of the present invention;
fig. 7 is a schematic diagram of a poster management system according to another embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.
In this application, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
In order to solve the problem that the poster updating step is too complicated, the embodiment of the invention provides a poster updating method which is applied to a poster management system shown in fig. 7; the management system includes: a medium resource system 401, a database system 402, a distributed storage system 403 and a service system 404; wherein:
the media resource system 401 writes the source data and the poster data into the distributed storage system 403, the distributed storage system stores the source data and the poster data, returns the storage path of the target file to the media resource system 401, and the media resource system 401 stores the storage path of the returned target file into the database; wherein, the storage path of the source data or poster data is saved in the target file.
The business system 404 determines a storage path of the target file in the database system, and reads corresponding source data or poster data in the distributed storage system through the storage path of the target file.
The specific flow of the poster updating method is shown in fig. 1, and comprises the following steps:
s101, determining a storage path of the target file from the database system by the media resource system.
Wherein the target file is a file of a storage path for storing original poster data.
If the original poster is not opened by the business system before the updating operation, namely the business system does not read the original poster data from the distributed storage system, the media resource system is required to search the storage path of the target file in the database system to determine the storage path of the target file of the original poster in the distributed storage system.
If the business system opens the original poster before the updating operation, namely the business system reads the original poster data from the distributed storage system, the media resource system does not need to search the storage path of the target file in the database system, and the media resource system can directly determine the storage path of the target file of the original poster in the distributed storage system through the calling record because the database system stores the calling record of the original poster.
For example, the media asset system wants to update a poster of a "name of people" in a tv series, and if a client terminal has not clicked the poster of the "name of people" before, that is, if the business system has not read poster data of the "name of people", when updating the poster of the "name of people", the media asset system needs to search a storage path of a target file in a database system to determine a storage path of a target file of an original poster of the "name of people". If the customer terminal clicks the poster of the 'name of people' before, namely the business system reads the poster data of the 'name of people', the media resource system can directly determine the storage path of the target file of the original poster of the 'name of people' through the calling record stored by the database system before updating.
S102, the media resource system opens the target file in a replacement writing state in the distributed storage system through the storage path of the target file, so that the distributed storage system marks the target file in the replacement writing state.
Through the storage path of the target file of the original poster obtained in the step S101, the media resource system opens the target file in the distributed storage system in the replacement write state, that is, the media resource system sends an update instruction to the distributed storage system, and after the media resource system sends the update instruction, the distributed storage system marks the target file as the replacement write file state, that is, the distributed storage system is ready for updating and ready to execute an update operation.
For example, the media resource system prepares to update a poster of "name of people", the media resource system first obtains a storage path of a target file of an original poster of "name of people" through step S101, then opens the target file in a replacement writing state, that is, sends an update instruction to the distributed system, and the distributed storage system marks the target file in the replacement writing state after receiving the update instruction, that is, the distributed storage system is ready to update and is ready to execute an update operation.
And S103, uploading new poster data by the media resource system.
S104, the distributed storage system receives and stores the new poster data, generates a storage path of the new poster data, updates the storage path of the original poster data into the storage path of the new poster data, and updates the capacity of the target file into the size of the new poster data.
Because the new poster data is generated by the media resource system, but the update of the new poster data is completed in the distributed storage system, the media resource system and the distributed storage system need to interact to enable the distributed storage system to obtain the new poster data.
The uploading of the new poster data by the medium resource system in step S103 and the receiving of the new poster data by the distributed storage system in step S104 are the interactions between the medium resource system and the distributed storage system.
In addition, both the new poster data and the original poster data are stored in a server or in a logical block on a disk in a distributed storage system. The distributed storage system is randomly allocated as to which server or disk and in which logical block. And the original poster data or the new poster data of a certain logic block stored in a certain server or disk can be represented by a storage node, as shown in fig. 2. In addition, the distributed storage system may also allocate a file node record, i.e., a target file, as shown in fig. 2, to store a storage path of a storage node, i.e., a storage path of new poster data or original poster data; therefore, as long as the storage path of the original poster data stored in the target file is replaced by the storage path of the new poster data, the read data can be ensured to be the new poster data when the business system reads again, and the poster is updated.
Therefore, the distributed storage system is updated by storing the new data in the new logic block to obtain the storage path of the new poster data and replacing the storage path of the original poster data with the storage path of the new poster data.
Wherein the storage path of the new poster data comprises a storage path of at least one new logic block and an internal offset address of the new poster data in the new logic block.
For example, after the step 102, the distributed storage system is ready to update a poster on the name of a person, but since the new poster data is generated by the media resource system, the media resource system and the distributed storage system need to perform interactive operation first, so that the distributed storage system obtains the new poster data; then, storing the new poster data of the name of people to obtain a storage path; and replacing the storage path of the original poster data of the name of people in the target file with the storage path of the new poster data of the name of people, and updating the size of the new poster data of the name of people to the size of the target file to finish the updating operation.
The invention replaces the storage path of the original poster data stored in the target file with the storage path of the new poster data without changing the storage path of the target file, thereby realizing the update of the poster data, effectively simplifying the update steps of the poster data and improving the efficiency of the update of the poster data. In the reading process, if the data read once is read, the storage path of the required target file can be determined directly through the calling record saved by the database system, so that the poster reading step is simplified.
Optionally, as shown in fig. 3, in another embodiment of the present invention, a specific implementation manner of the distributed storage system receiving and storing the new poster data in step S104 and generating a storage path of the new poster data includes:
s201, the distributed storage system receives the new poster data.
Step S201 is a process of interacting with the media asset system, and new poster data generated by the media asset system is obtained through the interaction with the media asset system.
S202, the distributed storage system reallocates N new logic blocks which have the same capacity and are not on the same server or the same disk, generates a storage path of each new logic block, and marks each new logic block in a write-in state.
Wherein N is an integer greater than 1, and a value of N depends on a backup mechanism adopted by the distributed storage system.
The distributed storage system of the invention adopts a three-backup mechanism, and the value of N is 3, namely, one data can be stored in three different servers or three different disks; when data of one server or one disk is lost, the data can be acquired from the other two servers or the two disks;
it should be noted that the present invention is described by taking the example that the distributed storage system adopts three backup mechanisms, and the distributed storage system may also adopt other backup mechanisms according to the actual situation, which is not described herein again.
In addition, a logical block refers to one logical number for all data blocks on a disk block, and the number starts from 0; wherein the size of all data blocks on a disk block is the same. In other words, a logical block corresponds to an actual data block on a disk.
Therefore, in the updating process, when the distributed storage system allocates a new logical block, for convenience of searching, a link address of a server or a disk where the allocated new logical block is located and a logical number of the allocated new logical block in the server or the disk are generated; when the next search is needed, the corresponding new logic block can be found according to the storage address of the new logic block.
And the storage path of the new logic block comprises a link address of the disk or the server and a logic number of the new logic block on the corresponding disk or the server.
It should be noted that a logical block refers to a logical number for all data blocks on a disk block, and the number starts from 0; wherein the size of all data blocks on a disk block is the same. In other words, a logical block is an actual data block on a disk.
For example, during the process of updating the poster of the name of people by the media asset system, the distributed storage system reallocates three new logic blocks to store the new poster data of the name of people, wherein the three new logic blocks are respectively from the 3 rd logic block of the first disk, the 4 th logic block of the third disk and the 7 th logic block of the fourth disk. When the business system reads the poster of the 'name of people' next time, the three new logic blocks can be found according to the storage paths of the new logic blocks, namely the 3 rd logic block of the first disk, the 4 th logic block of the third disk and the 7 th logic block of the fourth disk, and the poster data can be read from any one of the three new logic blocks.
S203, the distributed storage system stores the new poster data into each new logic block, and generates an internal offset address of the new poster data in each new logic block.
In the updating process, after the distributed storage system allocates new logic blocks, new poster data can be stored in each new logic block, but the new poster data is not stored backwards from the initial part of the new logic block, but has a certain offset, so that after the new poster data is stored in the corresponding new logic block, the internal offset address of the new poster data in each new logic block is generated.
During the reading process, the business system can know the position of the new logic block from which to start reading data and how much data to read according to the internal offset address of the new poster data in each new logic block and the size of the new poster data.
For example, in the process of updating the poster of the "name of people", after the distributed storage system allocates a new logical block, the distributed storage system stores the obtained new poster data into three allocated new logical blocks, and obtains the internal offset addresses of the new poster data respectively.
The rest steps are the same as the above embodiments, and are not described herein again.
Optionally, as shown in fig. 4, on the basis of the foregoing embodiment, in another embodiment of the present invention, the method for updating the poster further includes, after step S104:
and S105, deleting the original poster data by the distributed storage system.
After the steps of the above embodiment, the storage path of the new poster data has already completed the replacement of the original poster data, but the original poster data is still in the distributed storage system, so at this time, the original poster data needs to be deleted, that is, the logic block storing the original poster data is restored to the initial value, and then, the logic block can participate in the storage of the data again.
Specifically, the specific implementation manner of step S105 may include, as shown in fig. 5:
s301, the distributed storage system puts the original logic block into a deletion task list and sets retention time.
Wherein, the original logic block stores the original poster data.
Because the operation on the target file is an atomicity operation, namely only one operation can be performed on the target file in the same time, the operation can be a reading operation or a replacing writing operation, namely an updating operation; therefore, if the business system operates the target file, the reading process is performed; if the media resource system operates the target file, the updating process is carried out.
Because the reading time problem is involved in the reading process of the business system, if the business system is poster data read before updating operation, the poster data is read from the original logic block; if the business system is poster data read after an update operation, the poster data is read from the new logical block.
After step S104, the data of the original logical block may be deleted, but if the data of the original logical block is deleted, the service system reads the data from the original logical block, which may result in the failure of the service system to read the data, and therefore the service system is required to read the data again; when reading again, the service system reads data from the new logic block; although reading can be achieved, the workload of the service system is increased, and the user experience is reduced. Therefore, it is possible to select to set a retention time for the data in the original logical block.
And setting retention time for the data in the original logic block, and if the business system reads the storage path of the original poster data, reading the data from the original logic block by the business system, so that the completeness of the poster data reading by the business system can be ensured, the speed of the business system for reading the poster data can be ensured, and the use experience of a user can be improved.
In addition, it should be noted that the length of the retention time setting may be determined according to the specific application environment, and since the service system will read the data to the user terminal in a short time, the setting without affecting the reading process is within the protection scope of the present application.
S302, after the retention time is over, the distributed storage system restores the original logic blocks to the initial values.
And restoring the original logic block to a default initial value, namely deleting the original poster content stored in the original logic block.
The rest steps are the same as the above embodiments, and are not described herein again.
In order to solve the problem that the poster updating step is too complicated, an embodiment of the present invention further provides a poster updating system, as shown in fig. 6, which has a specific structure including: a medium resource system 401, a database system 402 and a distributed storage system 403, wherein:
The media resource system 401 is configured to determine a storage path of the target file from the database system 402, and then open the target file in the distributed storage system in a replacement write state through the storage path of the target file, so that the distributed storage system 403 marks the target file as a replacement write state; then, the medium resource system uploads new poster data; the target file is a file of a storage path for storing original poster data.
The distributed storage system 403 is configured to receive and store the new poster data, generate a storage path of the new poster data, update the storage path of the original poster data to the storage path of the new poster data, and update the size of the target file to the size of the new poster data;
the storage path of the new poster data comprises a storage path of a new logic block and an internal offset address of the new poster data in the new logic block.
Optionally, the distributed storage system 403 is configured to receive and store new poster data, and when a storage path of the new poster data is generated, specifically configured to:
receiving the new poster data.
Redistributing N new logical blocks with the same capacity but not on the same server or the same disk, generating a storage path of each new logical block, and marking each new logical block in a writing state; wherein, N is an integer greater than 1, and the value of N depends on the backup mechanism adopted; the storage path of the new logical block comprises a link address of the server or the disk and a logical number of the new logical block on the corresponding server or the disk.
And storing the new poster data into each new logic block, and generating an internal offset address of each new poster data in the new logic block.
Optionally, the distributed storage system 403 is further configured to delete the original poster data after updating the size of the capacity of the target file to the size of the new poster data.
Optionally, the distributed storage system 403 is configured to, when deleting the original poster, specifically:
putting the original logic block into a task deletion list, and setting retention time; and each original logic block stores the original poster data.
And after the retention time is over, restoring the initial value of each original logic block.
The rest of the principle is the same as the above embodiment, and the description is omitted here.
Compared with the prior art, the method and the device have the advantages that the storage path of the original poster data stored in the target file is replaced without changing the storage path of the target file, and the storage path of the new poster data is changed, so that the poster is updated, the poster updating step is effectively simplified, and the poster updating efficiency is improved. In the reading process, if the poster which is read once is read, the storage path of the required target file can be determined directly through the calling record saved by the database system, so that the poster reading step is simplified.
An embodiment of the present invention further provides a poster management system, as shown in fig. 7, which includes: business system 404 and poster update systems as described in the above embodiments; wherein:
the business system 404 is used for determining a storage path of a required target file in the database system; thereafter, through the storage path of the desired target file, if the desired target file can be opened in the distributed storage system 403, the desired source data or the desired poster data is read; the desired target file holds a storage path for the desired source data or the desired poster data.
Optionally, the business system 404 is configured to pass through a storage path of the required target file, and if the required target file can be opened in the distributed storage system 403, when reading the required source data or the required poster data, specifically, the business system is configured to:
acquiring a storage path of required source data or required poster data and the size of the required source data or the required poster data in a required target file; and reading the required source data or the required poster data through a storage path of the required data.
In the reading process, if the read required target file is called before, the business system can directly determine the storage path of the required target file through the calling record stored in the database system; if the read required target file is not called before, the business system searches the storage path of the target file in the database system to determine the storage path of the required target file.
After determining the storage path of the required target file, the business system needs to determine whether the required target file exists according to the storage path of the required target file, and if the required target file does not exist, the business system reads the default poster to the client terminal; if the required target file exists, the required target file can be opened, and the business system reads the information in the target file.
Stored in the desired target file is a storage path of the desired source data or the desired poster data, and a size of the desired source data or the desired poster data. Wherein the storage path of the required source data or the required poster data comprises a storage path of a logic block for storing the required source data or the required poster data and an internal offset address of the required source data or the required poster data in the logic block. When reading the required source data or the required poster data, the business system 404 selects a logic block optionally, and finds the logic block through the storage path of the logic block; and reading the required video or the required poster data from the logic block through the internal offset address of the required source data or the required poster data in the logic block and the size of the poster data, and finally transmitting the read required source data or the required poster data to the client terminal.
The poster update system is the same as the above embodiments and will not be described in detail here.
The invention replaces the storage path of the original poster data stored in the target file with the storage path of the new poster data without changing the storage path of the target file, thereby realizing the update of the poster, effectively simplifying the update step of the poster and improving the update efficiency of the poster. In addition, in the reading process, the storage path of the target file is not updated, so that if the required target file read by the business system is called once, the storage path of the target file does not need to be searched in the database system, the storage path of the required target file can be determined directly through the calling record saved by the database system, the condition that the storage path of the target file needs to be searched from the database system when the poster is read every time is avoided, and the poster reading process is simplified.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A method of updating a poster, comprising:
the medium resource system determines a storage path of the target file from the database system; the target file is a file of a storage path for storing original poster data;
the media resource system opens the target file in a replacement writing state in a distributed storage system through a storage path of the target file, so that the distributed storage system marks the target file in the replacement writing state;
the media resource system uploads new poster data;
the distributed storage system receives and stores the new poster data, generates a storage path of the new poster data, updates the storage path of the original poster data into the storage path of the new poster data, and updates the capacity of the target file into the size of the new poster data; the storage path of the new poster data comprises a storage path of at least one new logic block and an internal offset address of the new poster data in the new logic block.
2. The poster updating method of claim 1, wherein the process of receiving and storing the new poster data by the distributed storage system and generating a storage path for the new poster data comprises:
the distributed storage system receiving the new poster data;
the distributed storage system reallocates N new logical blocks which have the same capacity and are not on the same server or the same disk, generates a storage path of each new logical block, and marks each new logical block in a writing-in state; wherein N is an integer greater than 1, and the value of N depends on the backup mechanism adopted; the storage path of the new logic block comprises a link address of a server or a disk and a logic number of the new logic block on the corresponding server or disk;
and the distributed storage system stores the new poster data into each new logic block and generates an internal offset address of the new poster data in each new logic block.
3. The poster updating method of claim 1, wherein after the distributed storage system updates the size of the target file to the size of the new poster data, further comprising:
and deleting the original poster data by the distributed storage system.
4. A poster updating method as claimed in claim 3, wherein said distributed storage system deleting the original poster data comprises:
the distributed storage system puts the original logic block into a deletion task list and sets retention time; the original logic block stores the original poster data;
and after the retention time is over, the distributed storage system restores each original logic block to the initial value.
5. A poster renewal system, comprising: a medium resource system, a database system and a distributed storage system; wherein:
the database system is used for storing a storage path of the target file;
the medium resource system is used for determining a storage path of the target file from the database system, and then opening the target file in a replacement writing state in the distributed storage system through the storage path of the target file, so that the distributed storage system marks the target file in the replacement writing state; then, the medium resource system uploads new poster data; the target file is a file of a storage path for storing original poster data;
the distributed storage system is used for receiving and storing the new poster data, generating a storage path of the new poster data, updating the storage path of the original poster data into the storage path of the new poster data, and updating the capacity of the target file into the size of the new poster data; the storage path of the new poster data comprises a storage path of a new logic block and an internal offset address of the new poster data in the new logic block.
6. The poster updating system of claim 5, wherein the distributed storage system is configured to receive and store the new poster data, and when a storage path of the new poster data is generated, the distributed storage system is specifically configured to:
receiving the new poster data;
redistributing N new logical blocks with the same capacity but not on the same server or the same disk, generating a storage path of each new logical block, and marking each new logical block in a writing state; wherein, N is an integer greater than 1, and the value of N depends on the backup mechanism adopted; the storage path of the new logic block comprises a link address of a server or a disk and a logic number of the new logic block on the corresponding server or disk;
and storing the new poster data into each new logic block, and generating an internal offset address of each new poster data in the new logic block.
7. The poster updating system of claim 5, wherein the distributed storage system is further configured to delete the original poster data after updating the size of the target file to the size of the new poster data.
8. A poster updating system as claimed in claim 7, wherein the distributed storage system, when being used to delete the original poster data, is specifically configured to:
putting the original logic block into a task deletion list, and setting retention time; each original logic block stores the original poster data;
and after the retention time is over, restoring the initial value of each original logic block.
9. A system for managing a poster, comprising: a business system and an update system for a poster as claimed in any of claims 5-8; wherein:
the business system is used for determining a storage path of a required target file in the database system; then, through the storage path of the required target file, if the required target file can be opened in the distributed storage system, reading required source data or required poster data; the desired target file holds a storage path for the desired source data or the desired poster data.
10. A poster management system as claimed in claim 9, wherein the business system is configured to pass through a storage path of a desired target file, and if the desired target file can be opened in the distributed storage system, when reading the desired source data or the desired poster data, is specifically configured to:
acquiring a storage path of required source data or required poster data and the size of the required source data or the required poster data in a required target file;
and reading the required source data or the required poster data through a storage path of the required source data or the required poster data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910030958.8A CN111435342B (en) | 2019-01-14 | 2019-01-14 | Poster updating method, poster updating system and poster management system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910030958.8A CN111435342B (en) | 2019-01-14 | 2019-01-14 | Poster updating method, poster updating system and poster management system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111435342A true CN111435342A (en) | 2020-07-21 |
| CN111435342B CN111435342B (en) | 2023-12-05 |
Family
ID=71580524
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910030958.8A Active CN111435342B (en) | 2019-01-14 | 2019-01-14 | Poster updating method, poster updating system and poster management system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111435342B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113673212A (en) * | 2021-08-20 | 2021-11-19 | 西安数拓网络科技有限公司 | Poster processing method, server and merchant client equipment |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100088335A1 (en) * | 2008-10-07 | 2010-04-08 | Yasuyuki Mimatsu | Method and apparatus for improving file access performance of distributed storage system |
| CN103279543A (en) * | 2013-05-13 | 2013-09-04 | 清华大学 | Path mode inquiring system for massive image data |
| CN104951243A (en) * | 2014-03-28 | 2015-09-30 | 伊姆西公司 | Storage expansion method and device in virtualized storage system |
| CN105893447A (en) * | 2015-12-28 | 2016-08-24 | 乐视网信息技术（北京）股份有限公司 | File synchronization method, device and system |
| CN105912687A (en) * | 2016-04-19 | 2016-08-31 | 江苏物联网研究发展中心 | Mass distributed database memory cell |
| CN106681724A (en) * | 2016-12-29 | 2017-05-17 | 东软集团股份有限公司 | Method and device for processing intelligent terminal system application |
| CN107341070A (en) * | 2017-06-30 | 2017-11-10 | 长江大学 | A kind of random write method and system based on correcting and eleting codes |
| CN108519861A (en) * | 2018-04-02 | 2018-09-11 | 广东能龙教育股份有限公司 | Dynamic storage method based on large-scale parallel access |
| CN109063103A (en) * | 2018-07-27 | 2018-12-21 | 郑州云海信息技术有限公司 | A kind of non-volatile file system of distribution |
-
2019
- 2019-01-14 CN CN201910030958.8A patent/CN111435342B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100088335A1 (en) * | 2008-10-07 | 2010-04-08 | Yasuyuki Mimatsu | Method and apparatus for improving file access performance of distributed storage system |
| CN103279543A (en) * | 2013-05-13 | 2013-09-04 | 清华大学 | Path mode inquiring system for massive image data |
| CN104951243A (en) * | 2014-03-28 | 2015-09-30 | 伊姆西公司 | Storage expansion method and device in virtualized storage system |
| CN105893447A (en) * | 2015-12-28 | 2016-08-24 | 乐视网信息技术（北京）股份有限公司 | File synchronization method, device and system |
| CN105912687A (en) * | 2016-04-19 | 2016-08-31 | 江苏物联网研究发展中心 | Mass distributed database memory cell |
| CN106681724A (en) * | 2016-12-29 | 2017-05-17 | 东软集团股份有限公司 | Method and device for processing intelligent terminal system application |
| CN107341070A (en) * | 2017-06-30 | 2017-11-10 | 长江大学 | A kind of random write method and system based on correcting and eleting codes |
| CN108519861A (en) * | 2018-04-02 | 2018-09-11 | 广东能龙教育股份有限公司 | Dynamic storage method based on large-scale parallel access |
| CN109063103A (en) * | 2018-07-27 | 2018-12-21 | 郑州云海信息技术有限公司 | A kind of non-volatile file system of distribution |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113673212A (en) * | 2021-08-20 | 2021-11-19 | 西安数拓网络科技有限公司 | Poster processing method, server and merchant client equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111435342B (en) | 2023-12-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110554834B (en) | File system data access method and file system | |
| US8843454B2 (en) | Elimination of duplicate objects in storage clusters | |
| JP5081631B2 (en) | Method and apparatus for managing data deletion | |
| US10235244B2 (en) | Block level backup of virtual machines for file name level based file search and restoration | |
| US10127243B2 (en) | Fast recovery using self-describing replica files in a distributed storage system | |
| US9031906B2 (en) | Method of managing data in asymmetric cluster file system | |
| EP3076307A1 (en) | Method and device for responding to a request, and distributed file system | |
| JP6388339B2 (en) | Distributed caching and cache analysis | |
| CN113672175A (en) | Distributed object storage method, device and equipment and computer storage medium | |
| US11397749B2 (en) | Asynchronous replication of in-scope table data | |
| US11157456B2 (en) | Replication of data in a distributed file system using an arbiter | |
| US11429311B1 (en) | Method and system for managing requests in a distributed system | |
| CN107493309B (en) | File writing method and device in distributed system | |
| CN111435286A (en) | Data storage method, device and system | |
| US20210326271A1 (en) | Stale data recovery using virtual storage metadata | |
| CN111435342B (en) | Poster updating method, poster updating system and poster management system | |
| CN107357691B (en) | Method and device for processing mirror image file | |
| CN115756955A (en) | Data backup and data recovery method and device and computer equipment | |
| CN113204520B (en) | Remote sensing data rapid concurrent read-write method based on distributed file system | |
| CN115840731A (en) | File processing method, computing device and computer storage medium | |
| US11416468B2 (en) | Active-active system index management | |
| GB2524073A (en) | Communication method and system for accessing media data | |
| CN111190549A (en) | Method, device, equipment and medium for acquiring available capacity of shared volume | |
| CN107168645B (en) | Storage control method and system of distributed system | |
| US11816088B2 (en) | Method and system for managing cross data source data access requests |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |