CN111435342B - Poster updating method, poster updating system and poster management system - Google Patents
Poster updating method, poster updating system and poster management system Download PDFInfo
- Publication number
- CN111435342B CN111435342B CN201910030958.8A CN201910030958A CN111435342B CN 111435342 B CN111435342 B CN 111435342B CN 201910030958 A CN201910030958 A CN 201910030958A CN 111435342 B CN111435342 B CN 111435342B
- Authority
- CN
- China
- Prior art keywords
- poster
- new
- data
- storage path
- target file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 45
- 230000008569 process Effects 0.000 claims abstract description 23
- 230000014759 maintenance of location Effects 0.000 claims description 15
- 230000007246 mechanism Effects 0.000 claims description 9
- 238000012217 deletion Methods 0.000 claims description 6
- 230000037430 deletion Effects 0.000 claims description 6
- 238000007726 management method Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 230000003993 interaction Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application discloses a poster updating method, a poster updating system and a poster management system, which are used for solving the problem that the steps of poster updating are too complicated. The application replaces the storage path of the original poster data stored in the target file without changing the storage path of the target file, and changes the storage path of the new poster data, thereby not only realizing the updating of the poster, but also effectively simplifying the updating step of the poster and improving the updating efficiency of the poster. In addition, in the reading process, since the storage path of the target file is not updated, if the required target file read by the service system is called, the storage path of the target file does not need to be searched in the database system, and the storage path of the required target file can be determined directly through the calling record stored in the database system, so that the process of reading the poster is simplified.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to a method for updating a poster, an updating system, and a management system.
Background
Along with the rapid development of video websites, the method for updating the poster is also continuously advancing, and the method for updating the poster is greatly developed nowadays, so that the processing requirement of a large amount of data can be met.
At present, the method for updating the poster includes that the distributed storage system stores received new poster data in a new logic block distributed by the distributed storage system, then the distributed storage system stores a storage path of the new poster data in a new target file, finally, the distributed storage system returns the storage path of the new target file to the media resource system, and the media resource system updates the storage path of the new target file into the database to replace the storage path of the original target file.
However, the current method for updating the poster causes complicated steps for updating the poster data, reduces the efficiency of updating the poster data, and increases the cost for file management.
Disclosure of Invention
In view of the above, the embodiments of the present application provide a method, a system and a system for updating a poster, so as to solve the problem that the steps for updating the poster are too complicated.
In order to achieve the above object, the embodiment of the present application provides the following technical solutions:
the first aspect of the application discloses a poster updating method, comprising the following steps:
the media resource system determines a storage path of the target file from the database system; the target file is a file for storing a storage path of the original poster data;
the media resource system opens the target file in a replacement writing state in the distributed storage system through a storage path of the target file, so that the distributed storage system marks the target file as the replacement writing state;
the media resource system uploads new poster data;
the distributed storage system receives and stores the new poster data, generates a storage path of the new poster data, updates the storage path of the original poster data into the storage path of the new poster data, and updates the capacity size of the target file into the size of the new poster data; the storage path of the new poster data comprises at least one storage path of a new logic block and an internal offset address of the new poster data in the new logic block.
Optionally, the process of the distributed storage system receiving and storing the new poster data and generating a storage path of the new poster data includes:
the distributed storage system receives the new poster data;
the distributed storage system reallocates N new logic blocks which have the same capacity and are not on the same server or the same disk, generates a storage path of each new logic block, and marks each new logic block as being in a writing state; wherein N is an integer greater than 1, and the value of N depends on the backup mechanism adopted; the storage path of the new logic block comprises a link address of a server or a disk and a logic number of the new logic block on the corresponding server or disk;
the distributed storage system stores the new poster data into each new logic block, and generates an internal offset address of the new poster data in each new logic block.
Optionally, after updating the size of the capacity of the target file to the size of the new poster data, the distributed storage system further includes:
and deleting the original poster data by the distributed storage system.
Optionally, the deleting the original poster data by the distributed storage system includes:
the distributed storage system puts the original logic block into a deletion task list and sets retention time; the original logic block stores the original poster data;
after the retention time is over, the distributed storage system restores each of the original logical blocks to an initial value.
The second aspect of the present application discloses a poster updating system, comprising: the system comprises a media resource system, a database system and a distributed storage system; wherein:
the database system is used for storing a storage path of the target file;
the media resource system is used for determining a storage path of the target file from the database system, and then opening the target file in a replacement writing state in the distributed storage system through the storage path of the target file, so that the distributed storage system marks the target file as the replacement writing state; then, the media resource system uploads new poster data; the target file is a file for storing a storage path of the original poster data;
the distributed storage system is used for receiving and storing the new poster data, generating a storage path of the new poster data, updating the storage path of the original poster data into the storage path of the new poster data, and updating the capacity size of the target file into the size of the new poster data; the storage path of the new poster data comprises a storage path of a new logic block and an offset address of the new poster data in the new logic block.
Optionally, the distributed storage system is configured to receive and store the new poster data, and when generating a storage path of the new poster data, the distributed storage system is specifically configured to:
receiving the new poster data;
reassigning N new logic blocks which have the same capacity and are not on the same server or the same disk, generating a storage path of each new logic block, and marking each new logic block as being in a writing state; wherein N is an integer greater than 1, and the value of N depends on the backup mechanism adopted; the storage path of the new logic block comprises a link address of a server or a disk and a logic number of the new logic block on the corresponding server or disk;
and storing the new poster data into each new logic block, and generating an internal offset address of each new poster data in the new logic block.
Optionally, the distributed storage system is further configured to delete the original poster data after updating the size of the capacity of the target file to the size of the new poster data.
Optionally, when the distributed storage system is used for deleting the original poster data, the distributed storage system is specifically used for:
placing the original logic block into a deletion task list, and setting retention time; each original logic block stores the original poster data;
and after the retention time is over, restoring the original logic blocks to the initial values.
A third aspect of the present application discloses a management system for a poster, comprising: a business system and an updating system of the poster; wherein:
the business system is used for determining the storage path of the required target file in the database system; then, through the storage path of the required target file, if the required target file can be opened in the distributed storage system, the required source data or the required poster data is read; the desired target file holds a storage path of desired source data or desired poster data.
Optionally, the service system is configured to read the required source data or the required poster data if the required target file can be opened in the distributed storage system through a storage path of the required target file, and is specifically configured to:
acquiring a storage path of required source data or required poster data and the size of the required source data or the required poster data in a required target file;
and reading the required source data or the required poster data through a storage path of the required source data or the required poster data.
Compared with the prior art, the method and the device for updating the poster data replace the storage path of the original poster data stored in the target file without changing the storage path of the target file, and change the storage path of the original poster data into the storage path of the new poster data, so that not only is the update of the poster data realized, but also the updating step of the poster is effectively simplified, and the updating efficiency of the poster is improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required to be used in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are only embodiments of the present application, and that other drawings can be obtained according to the provided drawings without inventive effort for a person skilled in the art.
Fig. 1 is a schematic diagram of a method for updating a poster according to an embodiment of the present application;
FIG. 2 is a schematic diagram of a data storage structure in the distributed storage system;
FIG. 3 is a schematic diagram showing a specific implementation of step S104 according to another embodiment of the present application;
fig. 4 is a schematic diagram of a method for updating a poster according to another embodiment of the present application;
FIG. 5 is a schematic diagram showing a specific implementation of step S105 according to another embodiment of the present application;
FIG. 6 is a schematic diagram of a poster update system according to another embodiment of the present application;
fig. 7 is a schematic diagram of a poster management system according to another embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
In order that the above-recited objects, features and advantages of the present application will become more readily apparent, a more particular description of the application will be rendered by reference to the appended drawings and appended detailed description.
In the present disclosure, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
In order to solve the problem that the update steps of the poster are too complicated, the embodiment of the application provides a method for updating the poster, which is applied to a management system of the poster shown in fig. 7; the management system includes: a media asset system 401, a database system 402, a distributed storage system 403, and a business system 404; wherein:
the media resource system 401 writes the source data and the poster data into the distributed storage system 403, the distributed storage system stores the source data and the poster data, and returns the storage path of the target file to the media resource system 401, and the media resource system 401 stores the returned storage path of the target file into the database; and storing the storage path of the source data or the poster data in the target file.
The business system 404 determines a storage path of the target file in the database system, and reads corresponding source data or poster data in the distributed storage system through the storage path of the target file.
The specific flow of the poster updating method is shown in fig. 1, and comprises the following steps:
s101, the media resource system determines a storage path of the target file from the database system.
The target file is a file for storing a storage path of the original poster data.
If the service system does not open the original poster before the updating operation, that is, the service system does not read the original poster data from the distributed storage system, the media resource system is required to search the storage path of the target file in the database system to determine the storage path of the target file of the original poster in the distributed storage system.
If the service system opens the original poster before the updating operation, that is, the service system reads the original poster data from the distributed storage system, the media resource system does not need to search the storage path of the target file in the database system, and because the database system stores the calling record of the original poster, the media resource system can directly determine the storage path of the target file of the original poster in the distributed storage system through the calling record.
For example, if the media asset system wants to update the poster of the tv drama "people's name", if the client terminal has not clicked on the poster of "people's name" before, that is, the service system has not read the poster data of "people's name", then when updating the poster of "people's name", the media asset system needs to search the storage path of the target file in the database system first to determine the storage path of the target file of the original poster of "people's name". If the client terminal clicks the poster of ' people ' name ', namely the business system reads the poster data of ' people ' name ', the media resource system can directly determine the storage path of the target file of the original poster of ' people ' name ' through the call record stored by the database system before updating.
S102, the media resource system opens the target file in a replacement writing state in the distributed storage system through the storage path of the target file, so that the distributed storage system marks the target file as the replacement writing file state.
Through the storage path of the target file of the original poster obtained in step S101, the media resource system opens the target file in the distributed storage system in a replacement writing state, that is, the media resource system sends an update instruction to the distributed storage system, and after the media resource system sends the update instruction, the distributed storage system marks the target file as a replacement writing file state, that is, the distributed storage system is ready for update preparation, and update operation is ready to be executed.
For example, the media resource system prepares to update the poster of "people 'S name", the media resource system obtains the storage path of the target file of the original poster of "people' S name" through step S101, then opens the target file in a replacement writing state, that is, sends an update instruction to the distributed system, and when the distributed storage system receives the update instruction, marks the target file as a replacement writing file state, that is, the distributed storage system is ready for update, and prepares to execute the update operation.
S103, uploading new poster data by the media resource system.
And S104, the distributed storage system receives and stores the new poster data, generates a storage path of the new poster data, updates the storage path of the original poster data into the storage path of the new poster data, and updates the capacity size of the target file into the size of the new poster data.
Because the new poster data is generated by the media asset system, but the updating of the new poster data is done in the distributed storage system, the media asset system and the distributed storage system need to interact to cause the distributed storage system to obtain the new poster data.
The media asset system uploads the new poster data in step S103 and the distributed storage system receives the new poster data in step S104, which is the interaction between the media asset system and the distributed storage system.
In addition, both the new poster data and the original poster data are stored in a server in the distributed storage system or in logical blocks on disk. As to which server or disk is stored in which logical block, it is randomly allocated by the distributed storage system. Whereas the original poster data or the new poster data of a certain logical block stored in a certain server or disk may be represented by one storage node, as shown in fig. 2. In addition, the distributed storage system also distributes a file node record, namely a target file, as shown in fig. 2, to store the storage path of the storage node, namely the storage path of the new poster data or the original poster data; therefore, only the storage path of the original poster data stored in the target file is replaced by the storage path of the new poster data, and when the service system reads again, the read data is the new poster data, namely the updating of the poster is completed.
Therefore, the update of the distributed storage system is to store new data in the new logic block to obtain the storage path of the new poster data, and replace the storage path of the original poster data with the storage path of the new poster data.
The storage path of the new poster data comprises at least one storage path of a new logic block and an offset address of the new poster data in the new logic block.
For example, after step 102, the distributed storage system is ready for updating, but since the new poster data is generated by the media asset system, the media asset system and the distributed storage system need to perform interactive operation first, so that the distributed storage system obtains the new poster data; then, storing the new poster data of the name of people to obtain a storage path; and replacing the storage path of the original poster data of the ' people ' name ' in the target file with the storage path of the new poster data of the ' people ' name ' and updating the size of the new poster data of the ' people ' name ' into the size of the target file to finish updating operation.
The application replaces the storage path of the original poster data stored in the target file without changing the storage path of the target file, and changes the storage path of the new poster data, thereby not only realizing the update of the poster data, but also effectively simplifying the update step of the poster data and improving the update efficiency of the poster data. In addition, in the reading process, if the data which is once read is read, the storage path of the required target file can be determined directly through the call record stored in the database system, so that the step of reading the poster is simplified.
Optionally, as shown in fig. 3, in another embodiment of the present application, the specific implementation manner of the distributed storage system in step S104 to receive and store the new poster data and generate the storage path of the new poster data includes:
s201, the distributed storage system receives the new poster data.
Step S201 is a process of interacting with the media asset system, and obtaining new poster data generated by the media asset system through interaction with the media asset system.
S202, the distributed storage system reallocates N new logic blocks which have the same capacity and are not on the same server or the same disk, generates a storage path of each new logic block, and marks each new logic block as being written.
Where N is an integer greater than 1, and the value of N depends on the backup mechanism employed by the distributed storage system.
The distributed storage system adopts a three-backup mechanism, and the value of N is 3, namely one data can be stored on different three servers or different three disks; when the data of one server or one disk is lost, the data can be acquired from the other two servers or two disks;
it should be noted that, the present application is only described by taking the three backup mechanisms as examples of the distributed storage system, and the distributed storage system may also use other backup mechanisms according to the actual situation, which is not described herein again.
In addition, a logical block refers to one logical number for all data blocks on a disk block, and numbers from 0; wherein the size of all data blocks on the disk block is the same. In other words, a logical block corresponds to an actual data block on a disk.
In the updating process, the distributed storage system distributes new logic blocks and generates a link address of a server or a disk where the distributed new logic blocks are located and a logic number of the distributed new logic blocks in the server or the disk for convenient searching; when the next time a search is needed, the corresponding new logical block can be found according to the memory address of the new logical block.
The storage path of the new logic block comprises a link address of a disk or a server and a logic number of the new logic block on the corresponding disk or server.
It should be noted that, a logical block refers to a logical number of all data blocks on a disk block, and is numbered from 0; wherein the size of all data blocks on the disk block is the same. In other words, a logical block is an actual block of data on a disk.
For example, during a media asset system update of a "people's nominal" poster, the distributed storage system reassigns three new logical blocks to save "people's nominal" new poster data, wherein the three new logical blocks are from the 3 rd logical block of the first disk, the 4 th logical block of the third disk, and the 7 th logical block of the fourth disk, respectively. When the next time the business system reads the poster of ' people ' name ', the three new logic blocks can be found according to the storage paths of the new logic blocks, namely the 3 rd logic block of the first disk, the 4 th logic block of the third disk and the 7 th logic block of the fourth disk, and the poster data can be read from the three new logic blocks optionally.
And S203, the distributed storage system stores the new poster data into each new logic block, and generates an internal offset address of the new poster data in each new logic block.
In the updating process, the distributed storage system allocates new logic blocks, so that new poster data can be stored in each new logic block, but the new poster data is not stored backwards from the initial part of the new logic block, but has a certain offset, so that after the new poster data is stored in the corresponding new logic block, the internal offset address of the new poster data in each new logic block is generated.
In the reading process, the service system can know from which position of the new logic block to start reading data and how much data to read according to the internal offset address of the new poster data in each new logic block and the size of the new poster data.
For example, in a process of updating a poster of "people's name", after the distributed storage system allocates new logical blocks, the distributed storage system stores the obtained new poster data into three allocated new logical blocks, and obtains internal offset addresses of the new poster data respectively.
The rest of the steps are the same as those of the above embodiment, and will not be repeated here.
Optionally, as shown in fig. 4, on the basis of the foregoing embodiment, in another embodiment of the present application, the method for updating a poster further includes, after step S104:
s105, deleting the original poster data by the distributed storage system.
After each step of the above embodiment, the storage path of the new poster data has completed replacing the original poster data, but the original poster data is still in the distributed storage system, so that the original poster data needs to be deleted at this time, that is, the logic block storing the original poster data is restored to the initial value, and then the logic block can participate in the storage of the data again.
Specifically, the specific implementation manner of the step S105 may, as shown in fig. 5, include:
s301, the distributed storage system places the original logic block on a deletion task list, and sets retention time.
And the original logic block stores the original poster data.
Because the operation on the target file is an atomic operation, that is, only one operation can be performed on the target file at the same time, the operation can be a read operation or a replacement write operation, that is, an update operation; so if the business system operates the target file, the reading process is performed; if the media resource system operates on the target file, the update process is performed.
In addition, because the reading time is related to the reading process of the service system, if the service system is the poster data read before the updating operation, the poster data is read from the original logic block; if the service system is the poster data read after the update operation, the poster data is read from the new logical block.
After step S104, the data of the original logic block can be deleted, but if the data of the original logic block is deleted, the service system just reads the data from the original logic block, which would result in the failure of the service system to read the data, so that the service system is required to read the data again; when reading again, the service system reads data from the new logic block; although reading can be achieved, the workload of the business system is increased, and the user experience is reduced. Thus, the retention time may be selected to be set for the data in the original logical block.
The retention time is set for the data in the original logic block, if the service system reads the storage path of the original poster data, the service system reads the data from the original logic block, so that the integrity of the poster data read by the service system can be ensured, the speed of the poster data read by the service system can be ensured, and the use experience of a user can be improved.
In addition, it should be noted that the length of the retention time setting may depend on the specific application environment, and since the service system may read the data to the user terminal in a short time, the setting that does not affect the reading process is within the protection scope of the present application.
S302, after the retention time is over, the distributed storage system restores the initial value of each original logic block.
And restoring the original logic block to a default initial value, namely deleting the original poster content stored in the original logic block.
The rest of the steps are the same as those of the above embodiment, and will not be repeated here.
In order to solve the problem that the update steps of the poster are too complicated, the embodiment of the application also provides a system for updating the poster, as shown in fig. 6, the specific structure comprises: a media asset system 401, a database system 402, and a distributed storage system 403, wherein:
database system 402 is used to maintain a storage path for a target file.
The media resource system 401 is configured to determine a storage path of the target file from the database system 402, and then open the target file in the distributed storage system in a replacement write state through the storage path of the target file, so that the distributed storage system 403 marks the target file as a replacement write file state; then, uploading new poster data by the media resource system; the target file is a file for storing a storage path of the original poster data.
The distributed storage system 403 is configured to receive and store the new poster data, generate a storage path of the new poster data, update the storage path of the original poster data to the storage path of the new poster data, and update the size of the target file to the size of the new poster data;
the storage path of the new poster data comprises a storage path of a new logic block and an offset address of the new poster data in the new logic block.
Optionally, the distributed storage system 403 is configured to receive and store new poster data, and when generating a storage path of the new poster data, specifically is configured to:
and receiving the new poster data.
Reassigning N new logic blocks which have the same capacity and are not on the same server or the same disk, generating a storage path of each new logic block, and marking each new logic block as being in a writing state; wherein, N is an integer greater than 1, and the value of N depends on the backup mechanism adopted; the storage path of the new logic block comprises the link address of the server or the disk and the logic number of the new logic block on the corresponding server or the disk.
And storing the new poster data into each new logic block, and generating an internal offset address of each new poster data in the new logic block.
Optionally, the distributed storage system 403 is further configured to delete the original poster data after updating the size of the capacity of the target file to the size of the new poster data.
Optionally, the distributed storage system 403 is configured to delete the original poster, specifically:
placing the original logic block into a deletion task list, and setting retention time; and each original logic block stores the original poster data.
And after the retention time is over, restoring the original logic blocks to the initial values.
The rest of the principle is the same as the above embodiment and will not be described here again.
Compared with the prior art, the method and the device for updating the poster have the advantages that under the condition that the storage path of the target file is not changed, the storage path of the original poster data stored in the target file is replaced by the storage path of the new poster data, so that the updating of the poster is realized, the updating step of the poster is effectively simplified, and the updating efficiency of the poster is improved. In addition, in the reading process, if the once-read poster is read, the storage path of the required target file can be determined directly through the call record stored in the database system, so that the step of reading the poster is simplified.
The embodiment of the application also provides a poster management system, as shown in fig. 7, and the specific structure comprises: business system 404 and the update system of the poster described in the above embodiments; wherein:
the business system 404 is used for determining the storage path of the required target file in the database system; then, through the storage path of the desired target file, if the desired target file can be opened in the distributed storage system 403, the desired source data or desired poster data is read; the desired target file holds a storage path of desired source data or desired poster data.
Optionally, the service system 404 is configured to read the required source data or the required poster data if the required target file can be opened in the distributed storage system 403 through the storage path of the required target file, and is specifically configured to:
acquiring a storage path of required source data or required poster data and the size of the required source data or the required poster data in a required target file; and reading the required source data or the required poster data through a storage path of the required data.
In the reading process, if the read required target file is called before, the service system can directly determine the storage path of the required target file through a call record stored in the database system; if the read desired target file has not been previously invoked, the business system retrieves the storage path of the target file in the database system to determine the storage path of the desired target file.
After determining the storage path of the required target file, the service system needs to determine whether the required target file exists according to the storage path of the required target file, and if the required target file does not exist, the service system reads a default poster to the client terminal; if the required target file exists, the required target file can be opened, and the service system reads the information in the target file.
Stored in the desired object file are the storage path of the desired source data or desired poster data, and the size of the desired source data or desired poster data. The storage path of the required source data or the required poster data comprises a storage path of a logic block for storing the required source data or the required poster data and an offset address of the required source data or the required poster data in the logic block. When reading the required source data or the required poster data, the service system 404 selects a logic block, and finds the logic block through the storage path of the logic block; and reading the required video or the required poster data from the logic block according to the internal offset address of the required source data or the required poster data in the logic block and the size of the poster data, and finally transmitting the read required source data or the read required poster data to the client terminal.
The update system of the poster is the same as the above embodiment and will not be described here again.
The application replaces the storage path of the original poster data stored in the target file without changing the storage path of the target file, and changes the storage path of the new poster data, thereby not only realizing the updating of the poster, but also effectively simplifying the updating step of the poster and improving the updating efficiency of the poster. In addition, in the reading process, as the storage path of the target file is not updated, if the required target file read by the service system is called, the storage path of the target file does not need to be searched in the database system, and the storage path of the required target file can be determined directly through the calling record stored in the database system, so that the situation that the storage path of the target file needs to be searched from the database system every time the poster is read is avoided, and the poster reading process is simplified.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (4)
1. A method of updating a poster, comprising:
the media resource system determines a storage path of the target file from the database system; the target file is a file for storing a storage path of the original poster data;
the media resource system opens the target file in a replacement writing state in the distributed storage system through a storage path of the target file, so that the distributed storage system marks the target file as the replacement writing state;
the media resource system uploads new poster data;
the distributed storage system receives and stores the new poster data, generates a storage path of the new poster data, updates the storage path of the original poster data into the storage path of the new poster data, and updates the capacity size of the target file into the size of the new poster data; the storage path of the new poster data comprises at least one storage path of a new logic block and an internal offset address of the new poster data in the new logic block;
under the condition that the storage path of the target file is not changed, the method replaces the storage path of the original poster data stored in the target file with the storage path of the new poster data so as to update the poster data, simplify the updating step of the poster data and improve the updating efficiency of the poster data; in the reading process, if the data which is once read is read, the storage path of the required target file is determined directly through the calling record stored in the database system, so that the step of reading the poster is simplified;
the distributed storage system receives and stores the new poster data, and the process of generating a storage path of the new poster data comprises the following steps:
the distributed storage system receives the new poster data;
the distributed storage system reallocates N new logic blocks which have the same capacity and are not on the same server or the same disk, generates a storage path of each new logic block, and marks each new logic block as being in a writing state; wherein N is an integer greater than 1, and the value of N depends on the backup mechanism adopted; the storage path of the new logic block comprises a link address of a server or a disk and a logic number of the new logic block on the corresponding server or disk;
the distributed storage system stores the new poster data into each new logic block, and generates an internal offset address of the new poster data in each new logic block;
wherein after the distributed storage system updates the capacity size of the target file to the size of the new poster data, the distributed storage system further comprises:
the distributed storage system deletes the original poster data;
wherein the distributed storage system deletes the original poster data, comprising:
the distributed storage system puts the original logic block into a deletion task list and sets retention time; the original logic block stores the original poster data;
after the retention time is over, the distributed storage system restores each of the original logical blocks to an initial value.
2. A poster update system, comprising: the system comprises a media resource system, a database system and a distributed storage system; wherein:
the database system is used for storing a storage path of the target file;
the media resource system is used for determining a storage path of the target file from the database system, and then opening the target file in a replacement writing state in the distributed storage system through the storage path of the target file, so that the distributed storage system marks the target file as the replacement writing state; then, the media resource system uploads new poster data; the target file is a file for storing a storage path of the original poster data;
the distributed storage system is used for receiving and storing the new poster data, generating a storage path of the new poster data, updating the storage path of the original poster data into the storage path of the new poster data, and updating the capacity size of the target file into the size of the new poster data; the storage path of the new poster data comprises a storage path of a new logic block and an internal offset address of the new poster data in the new logic block;
under the condition that the storage path of the target file is not changed, the system replaces the storage path of the original poster data stored in the target file with the storage path of the new poster data, so that the update of the poster data is realized, the update step of the poster data is simplified, and the update efficiency of the poster data is improved; in the reading process, if the data which is once read is read, the storage path of the required target file is determined directly through the calling record stored in the database system, so that the step of reading the poster is simplified;
the distributed storage system is configured to receive and store the new poster data, and when generating a storage path of the new poster data, the distributed storage system is specifically configured to:
receiving the new poster data;
reassigning N new logic blocks which have the same capacity and are not on the same server or the same disk, generating a storage path of each new logic block, and marking each new logic block as being in a writing state; wherein, N is an integer greater than 1, and the value of N depends on the backup mechanism adopted; the storage path of the new logic block comprises a link address of a server or a disk and a logic number of the new logic block on the corresponding server or disk;
storing the new poster data into each new logic block, and generating an internal offset address of each new poster data in the new logic block;
the distributed storage system is further used for deleting the original poster data after updating the capacity size of the target file to the size of the new poster data;
the distributed storage system is used for deleting the original poster data, and is specifically used for:
placing the original logic block into a deletion task list, and setting retention time; each original logic block stores the original poster data;
and after the retention time is over, restoring the original logic blocks to the initial values.
3. A poster management system, comprising: a business system and a poster update system as claimed in claim 2; wherein:
the business system is used for determining the storage path of the required target file in the database system; then, through the storage path of the required target file, if the required target file can be opened in the distributed storage system, the required source data or the required poster data is read; the desired target file holds a storage path of desired source data or desired poster data.
4. A poster management system according to claim 3, wherein said business system is adapted to read desired source data or desired poster data if a desired target file can be opened in said distributed storage system via a storage path of said desired target file, in particular for:
acquiring a storage path of required source data or required poster data and the size of the required source data or the required poster data in a required target file;
and reading the required source data or the required poster data through a storage path of the required source data or the required poster data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910030958.8A CN111435342B (en) | 2019-01-14 | 2019-01-14 | Poster updating method, poster updating system and poster management system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910030958.8A CN111435342B (en) | 2019-01-14 | 2019-01-14 | Poster updating method, poster updating system and poster management system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111435342A CN111435342A (en) | 2020-07-21 |
| CN111435342B true CN111435342B (en) | 2023-12-05 |
Family
ID=71580524
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910030958.8A Active CN111435342B (en) | 2019-01-14 | 2019-01-14 | Poster updating method, poster updating system and poster management system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111435342B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113673212B (en) * | 2021-08-20 | 2024-07-09 | 深圳数拓科技有限公司 | Poster processing method, server and merchant client device |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103279543A (en) * | 2013-05-13 | 2013-09-04 | 清华大学 | Path mode inquiring system for massive image data |
| CN104951243A (en) * | 2014-03-28 | 2015-09-30 | 伊姆西公司 | Storage expansion method and device in virtualized storage system |
| CN105893447A (en) * | 2015-12-28 | 2016-08-24 | 乐视网信息技术（北京）股份有限公司 | File synchronization method, device and system |
| CN105912687A (en) * | 2016-04-19 | 2016-08-31 | 江苏物联网研究发展中心 | Mass distributed database memory cell |
| CN106681724A (en) * | 2016-12-29 | 2017-05-17 | 东软集团股份有限公司 | Method and device for processing intelligent terminal system application |
| CN107341070A (en) * | 2017-06-30 | 2017-11-10 | 长江大学 | A kind of random write method and system based on correcting and eleting codes |
| CN108519861A (en) * | 2018-04-02 | 2018-09-11 | 广东能龙教育股份有限公司 | Dynamic storage method based on large-scale parallel access |
| CN109063103A (en) * | 2018-07-27 | 2018-12-21 | 郑州云海信息技术有限公司 | A kind of non-volatile file system of distribution |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8086634B2 (en) * | 2008-10-07 | 2011-12-27 | Hitachi, Ltd. | Method and apparatus for improving file access performance of distributed storage system |
-
2019
- 2019-01-14 CN CN201910030958.8A patent/CN111435342B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103279543A (en) * | 2013-05-13 | 2013-09-04 | 清华大学 | Path mode inquiring system for massive image data |
| CN104951243A (en) * | 2014-03-28 | 2015-09-30 | 伊姆西公司 | Storage expansion method and device in virtualized storage system |
| CN105893447A (en) * | 2015-12-28 | 2016-08-24 | 乐视网信息技术（北京）股份有限公司 | File synchronization method, device and system |
| CN105912687A (en) * | 2016-04-19 | 2016-08-31 | 江苏物联网研究发展中心 | Mass distributed database memory cell |
| CN106681724A (en) * | 2016-12-29 | 2017-05-17 | 东软集团股份有限公司 | Method and device for processing intelligent terminal system application |
| CN107341070A (en) * | 2017-06-30 | 2017-11-10 | 长江大学 | A kind of random write method and system based on correcting and eleting codes |
| CN108519861A (en) * | 2018-04-02 | 2018-09-11 | 广东能龙教育股份有限公司 | Dynamic storage method based on large-scale parallel access |
| CN109063103A (en) * | 2018-07-27 | 2018-12-21 | 郑州云海信息技术有限公司 | A kind of non-volatile file system of distribution |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111435342A (en) | 2020-07-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110554834B (en) | File system data access method and file system | |
| US10157109B2 (en) | Method for restoring files from a continuous recovery system | |
| US8762353B2 (en) | Elimination of duplicate objects in storage clusters | |
| US9892005B2 (en) | System and method for object-based continuous data protection | |
| CN109118358B (en) | Component-based synchronization of digital assets | |
| US9256498B1 (en) | System and method for generating backups of a protected system from a recovery system | |
| US20150032690A1 (en) | Virtual synchronization with on-demand data delivery | |
| JP6388339B2 (en) | Distributed caching and cache analysis | |
| CN110457305B (en) | Data deduplication method, device, equipment and medium | |
| CN108572888B (en) | Disk snapshot creating method and disk snapshot creating device | |
| CN112965939A (en) | File merging method, device and equipment | |
| US8082230B1 (en) | System and method for mounting a file system on multiple host computers | |
| CN115756955A (en) | Data backup and data recovery method and device and computer equipment | |
| CN111435342B (en) | Poster updating method, poster updating system and poster management system | |
| US12045173B2 (en) | Stale data recovery using virtual storage metadata | |
| CN111435302B (en) | Application processing method and device | |
| JP2006031608A (en) | Computer, storage system, file management method which computer performs, and program | |
| CN113204520B (en) | Remote sensing data rapid concurrent read-write method based on distributed file system | |
| CN115421856A (en) | Data recovery method and device | |
| JP2007293433A (en) | Document management system | |
| CN115525618A (en) | Storage cluster, data storage method, system and storage medium | |
| CN110825715A (en) | Multi-object data second combination implementation method based on Ceph object storage | |
| CN111625397A (en) | Service log backup method, cluster, device, electronic equipment and storage medium | |
| US8024354B2 (en) | System and method for managing data using a hierarchical metadata management system | |
| CN109508324B (en) | Oversized file management method and system based on object storage component |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |