CN109240614B - Data storage method, device and related equipment - Google Patents
Data storage method, device and related equipment Download PDFInfo
- Publication number
- CN109240614B CN109240614B CN201811003279.3A CN201811003279A CN109240614B CN 109240614 B CN109240614 B CN 109240614B CN 201811003279 A CN201811003279 A CN 201811003279A CN 109240614 B CN109240614 B CN 109240614B
- Authority
- CN
- China
- Prior art keywords
- data
- smu
- stored
- cache
- storage
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000013500 data storage Methods 0.000 title claims abstract description 76
- 238000000034 method Methods 0.000 title claims abstract description 58
- 238000012544 monitoring process Methods 0.000 claims abstract description 64
- 230000015654 memory Effects 0.000 claims abstract description 36
- 230000008569 process Effects 0.000 claims description 11
- 238000004590 computer program Methods 0.000 claims description 6
- 238000009825 accumulation Methods 0.000 abstract description 5
- 230000009286 beneficial effect Effects 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 8
- 238000012423 maintenance Methods 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000007726 management method Methods 0.000 description 2
- 230000005012 migration Effects 0.000 description 2
- 238000013508 migration Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/061—Improving I/O performance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/0671—In-line storage system
- G06F3/0673—Single storage device
- G06F3/0674—Disk device
- G06F3/0676—Magnetic disk device
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Retry When Errors Occur (AREA)
Abstract
The application discloses a data storage method, which comprises the steps that a storage monitoring process sends received data to be stored to a cache; judging whether the SMU is in a locking state; if the SMU is in the locking state, storing the data to be stored in the cache until the SMU is unlocked; if the SMU is not in the locked state, the data to be stored is sent to a memory from the cache through the SMU; the data storage method can effectively avoid the problems of front-end data accumulation and write delay caused by SMU locking when a system fails, improves data write concurrency, and can finish data storage with higher efficiency; the application also discloses a data storage device, a system and a computer readable storage medium, which also have the beneficial effects.
Description
Technical Field
The present application relates to the field of computer storage technologies, and in particular, to a data storage method, a data storage apparatus, a data storage system, and a computer-readable storage medium.
Background
The data storage is a temporary file generated in the processing process of the data stream or information needing to be searched in the processing process, and records the data on a storage medium inside or outside a computer in a certain format. The data reflects data that is static in the system, characterizing the static data.
In the prior art, a general data Storage technology uses a logical SMU (Storage management Unit) as a Unit to Manage Storage data, and specifically, referring to fig. 1, fig. 1 is a schematic structural diagram of a data Storage system in the prior art, a client, after receiving data to be stored sent by a user, may send the data to be stored to each Storage monitoring process, each Storage monitoring process may create hundreds of SMUs, after receiving the data to be stored, the Storage monitoring process may store the data to be stored to an SMU, and perform operations such as migration and recovery of the data using the SMU as a Unit, that is, send the data to be stored to a memory for Storage. However, when the storage system has a failure such as node failure, the SMU is locked and enters a log synchronization state, and at this time, in the locked state, the system does not allow the data to be stored in the SMU to be written into the memory, and meanwhile, the data to be stored received in the storage monitoring process cannot be written into the SMU, so that the data to be stored is accumulated in the client and the storage monitoring process, and data writing delay is caused, which results in that the system cannot perform other operations. Furthermore, the normal operation state can be recovered only after the technical personnel finish fault maintenance and SMU unlocking, so that the data storage efficiency is greatly reduced.
Therefore, how to avoid the problems of front-end data accumulation, data write delay, etc. caused by the locking of the SMU, and to complete data storage with higher efficiency is a problem to be solved by those skilled in the art.
Disclosure of Invention
The data storage method can effectively avoid the problems of front-end data accumulation and write delay caused by SMU locking when a system fails, improves data write concurrency, and can finish data storage with higher efficiency; it is another object of the present application to provide a data storage device, system and computer readable storage medium having the above-mentioned advantages as well.
In order to solve the above technical problem, the present application provides a data storage method, where the data storage method includes:
the storage monitoring process sends the received data to be stored to a cache;
judging whether the SMU is in a locking state;
if the SMU is in the locking state, storing the data to be stored in the cache until the SMU is unlocked;
and if the SMU is not in the locked state, sending the data to be stored to a memory from the cache through the SMU.
Preferably, the storage monitoring process is an OSD process.
Preferably, after the storage monitoring process sends the received data to be stored to the cache, the method further includes:
judging whether the data to be stored is sent to the cache;
if yes, returning a writing success message to the client.
Preferably, the data storage method further comprises:
receiving submission information returned by the client based on the writing success message;
and when the SMU is not in the locked state, executing the step of sending the data to be stored from the cache to a memory by the SMU according to the submission information.
Preferably, the data storage method further comprises:
and if the client does not receive the writing success message within the preset time, sending a rollback message to the storage monitoring process so that the storage monitoring process deletes the data to be stored.
Preferably, the memory is a magnetic disk.
Preferably, the data storage method further comprises:
and when the SMU is in the locking state, generating log information to a log list.
In order to solve the above technical problem, the present application provides a data storage device, including:
the data sending module is used for sending the received data to be stored to the cache;
the state judgment module is used for judging whether the SMU is in a locking state;
the data temporary storage module is used for storing the data to be stored to the cache if the SMU is in the locked state until the SMU is unlocked;
and the data storage module is used for sending the data to be stored to a memory from the cache through the SMU if the SMU is not in the locked state.
In order to solve the above technical problem, the present application provides a data storage system, including:
the processor is used for sending the received data to be stored to the cache; judging whether the SMU is in a locking state; if so, storing the data to be stored in the cache until the SMU is unlocked; if not, sending the data to be stored from the cache to a memory through the SMU;
the cache is used for storing the data to be stored when the SMU is in the locking state;
the memory is used for storing the data to be stored when the SMU is not in the locking state.
In order to solve the above technical problem, the present application provides a computer-readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, implements the steps of any one of the above data storage methods.
The data storage method comprises the steps that a storage monitoring process sends received data to be stored to a cache; judging whether the SMU is in a locking state; if the SMU is in the locking state, storing the data to be stored in the cache until the SMU is unlocked; and if the SMU is not in the locked state, sending the data to be stored to a memory from the cache through the SMU.
Therefore, according to the data storage method provided by the application, the corresponding caches are arranged for the storage monitoring processes, when the SMU enters a locking state due to a fault of the system, the data to be stored can be temporarily stored in the caches, therefore, the data to be stored cannot be accumulated in the client and the storage monitoring processes, even if a technician maintains the fault, the front end of the system can still normally operate, the problem of data writing delay is effectively solved, and the data writing concurrency is improved; furthermore, when the fault maintenance is finished, after the SMU is unlocked, the data to be stored in the cache is sent to the memory, the data to be stored is stored, and the data storage efficiency is greatly improved.
The data storage device, the system and the computer readable storage medium provided by the present application also have the above beneficial effects, which are not described herein again.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
FIG. 1 is a schematic diagram of a data storage system according to the prior art;
FIG. 2 is a schematic flow chart illustrating a data storage method according to the present application;
FIG. 3 is a schematic flow chart of another data storage method provided in the present application;
FIG. 4 is a schematic structural diagram of a data storage device provided in the present application;
FIG. 5 is a schematic structural diagram of a data storage system provided in the present application;
FIG. 6 is a schematic diagram of another data storage system provided in the present application.
Detailed Description
The core of the application is to provide a data storage method, which can effectively avoid the problems of front-end data accumulation and write delay caused by SMU locking when a system fails, improve the concurrency of data write, and can finish data storage with higher efficiency; another core of the present application is to provide a data storage device, a system, and a computer-readable storage medium, which also have the above-mentioned advantages.
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Generally, after receiving data to be stored sent by a user, a client sends the data to be stored to each storage monitoring process, and each storage monitoring process sends the received data to be stored to a memory for storage by taking an SMU as a unit. However, in the actual operation process of the storage method, once a fault such as node failure occurs, the SMU will be immediately locked, at this time, the system will not allow the data to be stored in the SMU to be written into the memory, and the data to be stored received in the storage monitoring process will not be written into the SMU, so that the data to be stored will be accumulated in the client and the storage monitoring process, and data writing delay will be caused, which causes the system to be unable to perform other operations, further causing a great reduction in data storage efficiency.
In order to solve the above problems, the present application provides a data storage method, which can effectively avoid the problems of front-end data accumulation and write delay caused by SMU locking when a system fails, and can complete data storage with high efficiency. Referring to fig. 2 specifically, fig. 2 is a schematic flow chart of a data storage method provided in the present application, where the data storage method may include:
s101: the storage monitoring process sends the received data to be stored to a cache;
specifically, a plurality of storage monitoring processes are generally arranged in one computing node, and when the data volume of the data to be stored is large, the data is stored through the plurality of storage monitoring processes, so that the storage efficiency is high. Therefore, when data storage is needed, the data to be stored can be sent to each storage monitoring process based on the client; furthermore, each storage monitoring process can send the data to be stored received by the storage monitoring process to the corresponding cache.
The caches and the storage monitoring processes can be in one-to-one correspondence, namely one storage monitoring process corresponds to one cache, and the number of the storage monitoring processes is equal to that of the caches. In addition, the type, model, installation position and the like of the cache are not limited, and the type selection and the setting can be carried out according to the actual situation, for example, when the corresponding storage system needs to finish the storage of big data, the cache with larger storage space can be set; when only general data storage needs to be completed, a cache with a smaller storage space can be set.
In addition, the type, source, and the like of the data to be stored are not limited in this application, for example, the data to be stored may be data directly input by a user based on a client, or may be data acquired by a corresponding data acquisition device.
Preferably, the Storage monitoring process may be an OSD (Object Storage monitoring process) process.
Specifically, the technical scheme can be applied to realize object storage, namely the storage monitoring process is set as an OSD process. Certainly, the storage monitoring process is not unique, and the storage monitoring process can also be set as a file storage monitoring process to further realize file storage and the like. Therefore, the type of the data to be stored does not affect the implementation of the technical scheme, and the corresponding data can be stored only by sending the data to the corresponding storage monitoring process.
S102: judging whether the SMU (Storage management Unit) is in a locking state;
specifically, migration, transmission, and the like of data to be stored are performed in units of SMUs, and when a corresponding computing node fails, all SMUs will enter a locked state and stop storing data. Thus, prior to a data drop, the current state of the SMU may be predetermined to determine whether it is currently in a locked state.
S103: if the SMU is in a locked state, storing the data to be stored into a cache until the SMU is unlocked;
s104: and if the SMU is not in the locked state, sending the data to be stored to the memory from the cache through the SMU.
Specifically, in the prior art, after receiving data to be stored, each storage monitoring process directly sends the data to be stored to the memory by taking the SMU as a unit, and once the SMU is locked, the data to be stored received in the corresponding storage monitoring thread and the data to be stored being sent in the client end are accumulated because the data cannot be continuously transmitted. However, in the present application, since the corresponding cache is set for each storage monitoring process, if the SMU is in a locked state, the data to be stored stops transmission at this time, and subsequent data dropping cannot be performed, the data to be stored may be directly temporarily stored in the cache, that is, the data to be stored that has been received in the storage monitoring process and the data to be stored that is still sent by the client are all temporarily stored in the cache, thereby effectively solving the problem of the data to be stored being accumulated at the front end. Further, until after the SMU is unlocked, subsequent transmissions may continue.
If the SMU is not in the locked state, or after the SMU is unlocked, the data to be stored may be sent from the cache to the memory through the SMU, that is, in units of SMUs, according to the data transmission method in the prior art, so as to complete the storage of the data.
Preferably, the memory may be a magnetic disk.
In particular, the present application provides a specific type of memory, that is, the above-mentioned magnetic disk is adopted and installed at a corresponding position of the system, so as to realize the storage of the data to be stored. Of course, the type of the memory is only one specific type provided by the present application, and is not unique, and other types of memories, such as a hard disk, a magnetic disk, and the like, may also be used to implement the data storage function. In addition, as for the storage space of the memory, a technician may select and install the storage space according to actual needs, which is not limited in the present application.
According to the data storage method provided by the application, the corresponding caches are arranged for the storage monitoring processes, when the SMU enters a locking state due to the fault of the system, the data to be stored can be temporarily stored in the caches, therefore, the data to be stored cannot be accumulated in the client and the storage monitoring processes, even if a technician maintains the fault, the front end of the system can still normally operate, and the problem of data writing delay is effectively solved; furthermore, when the fault maintenance is finished, after the SMU is unlocked, the data to be stored in the cache is sent to the memory, the data to be stored is stored, and the data storage efficiency is greatly improved.
On the basis of the foregoing embodiments, please refer to fig. 3, and fig. 3 is a schematic flow chart of another data storage method provided in the present application.
As a preferred embodiment, after the storage monitoring process sends the received data to be stored to the cache, the storage monitoring process may further include:
s202: judging whether the data to be stored is sent to a cache;
s204: and if the data to be stored is sent to the cache, returning a write-in success message to the client.
Specifically, in the process of sending the data to be stored to the cache in the storage monitoring process, whether the data to be stored is completely transmitted or not can be judged in real time, whether all the data to be stored is sent to the cache or not, if all the data to be stored is sent to the cache, a write-in success message can be returned to the client so as to inform a user that all the data to be stored is completely transmitted, and at the moment, the front end of the system can perform other operations without influencing the storage process of the data at the rear end.
Preferably, based on the above embodiment, the data storage method may further include:
s205: and receiving the submission information returned by the client based on the writing success message.
Specifically, after receiving a write success message returned by each storage monitoring process, the client can issue a submission message to each storage monitoring process based on the write success message; furthermore, each storage monitoring process can perform the subsequent storage process of the data to be stored according to the submitted information.
The return of the write-in success message can be returned by all storage monitoring processes, or a threshold value can be preset, when the received write-in success message exceeds the threshold value, the data to be stored can be considered to be successfully written in, and a submission message is issued; wherein the threshold value does not exceed the total number of stored monitoring processes. For example, 3 storage monitoring processes are arranged in the system, when the client receives more than 2 successful writing messages, the data to be stored can be determined to be successfully written, and at the moment, the submission message is issued to the 3 storage monitoring processes.
Preferably, based on the above embodiments, the data storage method may further include:
s203: and if the client does not receive the writing success message within the preset time, sending a rollback message to the storage monitoring process so as to enable the storage monitoring process to delete the data to be stored.
Specifically, if the client still does not receive the write-in success message within a certain time, that is, within the predetermined time, or the number of the received write-in success messages does not satisfy the threshold, it indicates that the data to be stored cannot be sent to the cache, that is, the data to be stored fails to be written in, at this time, a rollback message is issued to each storage monitoring process, so that each storage monitoring process deletes the received data to be stored, and retransmits the data to be stored. The predetermined time is set according to actual conditions, and the present application is not particularly limited.
For other method portions of this embodiment, reference may be made to the above specific embodiment, which is not described herein again.
According to the data storage method provided by the embodiment of the application, when the SMU is in the locking filling state, the data to be stored can be effectively and completely stored in the cache, the normal operation of other operations at the front end of the system is not influenced, and the data storage efficiency is further improved.
On the basis of the foregoing embodiments, as a preferred embodiment, the data storage method may further include: when the SMU is in the locking state, the SMU generates log information to a log list.
Specifically, when the SMU is in the locked state, it is indicated that the computing node corresponding to the SMU has a fault, and therefore, corresponding log information can be generated according to the fault and stored in a log list for further display through the client, which is more convenient for a technician to check the fault and further complete fault maintenance. Of course, an alarm device can be further arranged, and when the system breaks down, alarm information is sent to the alarm device to inform technicians of timely fault maintenance.
To solve the above problem, please refer to fig. 4, fig. 4 is a schematic structural diagram of a data storage device according to the present application, which is applied to the storage monitoring process and includes:
the data sending module 10 is used for sending the received data to be stored to the cache;
a state judgment module 20, configured to judge whether the SMU is in a locked state;
the data temporary storage module 30 is configured to store the data to be stored in the cache until the SMU is unlocked if the SMU is in a locked state;
and the data storage module 40 is used for sending the data to be stored to the memory from the cache through the SMU if the SMU is not in the locked state.
As a preferred embodiment, the data storage device may further include:
the data temporary storage judging module is used for judging whether the data to be stored is sent to the cache; if yes, returning a writing success message to the client.
As a preferred embodiment, the data storage device may further include:
the information receiving module is used for receiving the submission information returned by the client based on the write-in success message; and when the SMU is not in the locked state, executing the step of sending the data to be stored to the memory from the cache through the SMU according to the submission information.
As a preferred embodiment, the data storage device may further include:
and the log generation module is used for generating log information to the log list when the SMU is in a locked state.
For the introduction of the apparatus provided in the present application, please refer to the above method embodiments, which are not described herein again.
To solve the above problem, please refer to fig. 5, fig. 5 is a schematic structural diagram of a data storage system provided in the present application, where the data storage system is applied to the storage monitoring process, and the data storage system may include:
the processor 1 is used for sending the received data to be stored to the cache; judging whether the SMU is in a locking state; if so, storing the data to be stored in a cache until the SMU is unlocked; if not, sending the data to be stored to a memory from the cache through the SMU;
the cache 2 is used for storing data to be stored when the SMU is in a locked state;
and the memory 3 is used for storing data to be stored when the SMU is not in a locked state.
Further, on the basis of the above embodiments, the present application provides a more specific implementation manner, please refer to fig. 6, and fig. 6 is a schematic structural diagram of another data storage system provided in the present application.
Specifically, the data storage system takes three objects to store the monitoring process OSDs as an example, and each OSD is provided with a corresponding cache for realizing the temporary storage function of the data to be stored. Specifically, after receiving the data to be stored, the client may send the data to be stored to the three OSDs, and the OSDs send the obtained data to be stored to the respective corresponding caches; further, if the SMU is in a locked state, the data to be stored is temporarily stored in the cache until the SMU is unlocked, and then the data to be stored is sent to the DISK from the cache by taking the SMU as a unit.
For the specific description of the system provided by the present application, please refer to the above method embodiment, which is not described herein again.
To solve the above problem, the present application further provides a computer-readable storage medium having a computer program stored thereon, where the computer program when executed by a processor can implement the following steps:
the storage monitoring process sends the received data to be stored to a cache; judging whether the SMU is in a locking state; if the SMU is in the locking state, storing the data to be stored in the cache until the SMU is unlocked; and if the SMU is not in the locked state, sending the data to be stored to a memory from the cache through the SMU.
The computer-readable storage medium may include: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
For the introduction of the computer-readable storage medium provided in the present application, please refer to the above method embodiments, which are not described herein again.
The embodiments are described in a progressive manner in the specification, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative components and steps have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
The data storage method, apparatus, system and computer readable storage medium provided by the present application are described in detail above. The principles and embodiments of the present application are explained herein using specific examples, which are provided only to help understand the method and the core idea of the present application. It should be noted that, for those skilled in the art, it is possible to make several improvements and modifications to the present application without departing from the principle of the present application, and these improvements and modifications also fall into the elements of the protection scope of the claims of the present application.
Claims (10)
1. A method of storing data, comprising:
the storage monitoring process sends the received data to be stored to a cache;
judging whether the SMU is in a locking state;
if the SMU is in the locking state, storing the data to be stored in the cache until the SMU is unlocked;
and if the SMU is not in the locked state, sending the data to be stored to a memory from the cache through the SMU.
2. The data storage method of claim 1, wherein the storage guardian process is an OSD process.
3. The data storage method of claim 1, wherein after the storage monitoring process sends the received data to be stored to the buffer, the method further comprises:
judging whether the data to be stored is sent to the cache;
if yes, returning a writing success message to the client.
4. The data storage method of claim 3, further comprising:
receiving submission information returned by the client based on the writing success message;
and when the SMU is not in the locked state, executing the step of sending the data to be stored from the cache to a memory by the SMU according to the submission information.
5. The data storage method of claim 3, further comprising:
and if the client does not receive the writing success message within the preset time, sending a rollback message to the storage monitoring process so that the storage monitoring process deletes the data to be stored.
6. The data storage method of claim 1, wherein the memory is a magnetic disk.
7. The data storage method of any one of claims 1 to 6, further comprising:
and when the SMU is in the locking state, generating log information to a log list.
8. A data storage device, for storing a monitoring process, comprising:
the data sending module is used for sending the received data to be stored to the cache;
the state judgment module is used for judging whether the SMU is in a locking state;
the data temporary storage module is used for storing the data to be stored to the cache if the SMU is in the locked state until the SMU is unlocked;
and the data storage module is used for sending the data to be stored to a memory from the cache through the SMU if the SMU is not in the locked state.
9. A data storage system is applied to storing a monitoring process and comprises the following steps:
the processor is used for sending the received data to be stored to the cache; judging whether the SMU is in a locking state; if so, storing the data to be stored in the cache until the SMU is unlocked; if not, sending the data to be stored from the cache to a memory through the SMU;
the cache is used for storing the data to be stored when the SMU is in the locking state;
the memory is used for storing the data to be stored when the SMU is not in the locking state.
10. A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, which computer program, when being executed by a processor, carries out the steps of the data storage method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811003279.3A CN109240614B (en) | 2018-08-30 | 2018-08-30 | Data storage method, device and related equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811003279.3A CN109240614B (en) | 2018-08-30 | 2018-08-30 | Data storage method, device and related equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109240614A CN109240614A (en) | 2019-01-18 |
| CN109240614B true CN109240614B (en) | 2021-09-17 |
Family
ID=65067893
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811003279.3A Active CN109240614B (en) | 2018-08-30 | 2018-08-30 | Data storage method, device and related equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109240614B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111832363A (en) * | 2019-04-22 | 2020-10-27 | 珠海格力电器股份有限公司 | Attendance checking method, device and system based on face recognition and electronic equipment |
| CN110597646B (en) * | 2019-09-16 | 2021-09-07 | 五八有限公司 | Data reading and writing method and system, electronic equipment and storage medium |
| CN111125030B (en) * | 2019-12-18 | 2023-09-22 | 北京数衍科技有限公司 | Data storage method, device and server |
| CN111142795A (en) * | 2019-12-20 | 2020-05-12 | 浪潮电子信息产业股份有限公司 | Control method, control device and control equipment for write operation of distributed storage system |
| CN111176576A (en) * | 2019-12-28 | 2020-05-19 | 北京浪潮数据技术有限公司 | Metadata modification method, device, equipment and storage medium of storage volume |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107025289A (en) * | 2017-04-14 | 2017-08-08 | 腾讯科技（深圳）有限公司 | The method and relevant device of a kind of data processing |
| CN107908505A (en) * | 2017-12-04 | 2018-04-13 | 郑州云海信息技术有限公司 | A kind of date storage method, device, equipment and system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10402218B2 (en) * | 2016-08-30 | 2019-09-03 | Intel Corporation | Detecting bus locking conditions and avoiding bus locks |
-
2018
- 2018-08-30 CN CN201811003279.3A patent/CN109240614B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107025289A (en) * | 2017-04-14 | 2017-08-08 | 腾讯科技（深圳）有限公司 | The method and relevant device of a kind of data processing |
| CN107908505A (en) * | 2017-12-04 | 2018-04-13 | 郑州云海信息技术有限公司 | A kind of date storage method, device, equipment and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109240614A (en) | 2019-01-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109240614B (en) | Data storage method, device and related equipment | |
| US10509585B2 (en) | Data synchronization method, apparatus, and system | |
| US6243744B1 (en) | Computer network cluster generation indicator | |
| CN110008129B (en) | Reliability test method, device and equipment for storage timing snapshot | |
| CN105049260A (en) | Dialog management method and device | |
| CN112506710B (en) | Distributed file system data restoration method, device, equipment and storage medium | |
| CN104735107A (en) | Recovery method and device for data copies in distributed storage system | |
| CN112597249A (en) | Synchronous distribution and storage method and system for service data | |
| CN111046024A (en) | Data processing method, device, equipment and medium for sharing storage database | |
| CN116560889A (en) | Data link management method, device, computer equipment and storage medium | |
| CN112114750B (en) | Metadata volume bitmap data conflict processing method and related components | |
| CN110333916A (en) | Request message processing method, device, computer system and readable storage medium storing program for executing | |
| CN113934547A (en) | Method, device, equipment and product for recording alarm log in cluster environment | |
| CN111124785B (en) | Method, device, equipment and storage medium for hard disk fault detection | |
| WO2017080362A1 (en) | Data managing method and device | |
| CN111930719A (en) | Database access method, device and system | |
| CN111880947A (en) | Data transmission method and device | |
| CN103714059A (en) | Data updating method and device | |
| CN116931814A (en) | Cloud hard disk capacity expansion method and device, electronic equipment and storage medium | |
| CN110837428A (en) | Storage device management method and device | |
| CN112131180B (en) | Data reporting method, device and storage medium | |
| CN113377792A (en) | Data write-back method and device, electronic equipment and storage medium | |
| CN112463887A (en) | Data processing method, device, equipment and storage medium | |
| CN111752911A (en) | Data transmission method, system, terminal and storage medium based on Flume | |
| CN110941591A (en) | File deletion method, device and equipment and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |