CN110990339B - File read-write method, device and platform for distributed storage and readable storage medium - Google Patents
File read-write method, device and platform for distributed storage and readable storage medium Download PDFInfo
- Publication number
- CN110990339B CN110990339B CN201910980132.8A CN201910980132A CN110990339B CN 110990339 B CN110990339 B CN 110990339B CN 201910980132 A CN201910980132 A CN 201910980132A CN 110990339 B CN110990339 B CN 110990339B
- Authority
- CN
- China
- Prior art keywords
- cluster
- file
- priority
- layer
- read
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/13—File access structures, e.g. distributed indices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a file read-write method for distributed storage, which comprises the following steps: after detecting a writing request of a user layer, detecting whether a preset priority cluster in a cluster layer is in a backfill deviation backfill state or not; if the priority cluster is detected to be in the backfill state, a first target cluster which has the highest priority and is not in the backfill state is searched from the cluster layer; and acquiring a file to be written according to the writing request, and writing the file to be written into the first target cluster. The invention also discloses a file read-write device, a platform and a computer readable storage medium for distributed storage. The invention can realize the writing function when the cluster is in the backfill state, can not cause the unavailability of the cluster, and improves the availability of the storage service.
Description
Technical Field
The present invention relates to the field of data storage technologies, and in particular, to a method, an apparatus, a platform, and a computer readable storage medium for reading and writing a file in distributed storage.
Background
Distributed object storage systems are commonly used in a variety of storage scenarios due to their high reliability. ceph (ceph, distributed file system) is a distributed object storage system for implementing object storage, and the distributed object storage implemented based on ceph is a currently mainstream storage mode. By including a plurality of clusters, when the storage amount of the clusters reaches an upper limit, cluster expansion needs to be performed, or a certain OSD (Object-based Storage Device) node in the clusters fails and needs to be replaced, the service side cannot stop a writing request or a reading request by a user. If cluster expansion or replacement is performed by stopping the write request and the read request, this will not guarantee high availability of storage services.
However, when the cluster is required to be expanded or OSD faults in the cluster need to be replaced, if there is a write request during this period, the cluster is caused to be in a backfill deviation back fill state for a long time, and as the write request increases, the response timeliness of the cluster also increases rapidly, and finally the cluster is not available.
Disclosure of Invention
The invention mainly aims to provide a file read-write method, a device, a platform and a computer readable storage medium for distributed storage, and aims to solve the technical problem that clusters in a distributed object storage system are in a backfill state for a long time, so that the clusters are not available.
In order to achieve the above object, the present invention provides a file read-write method for distributed storage, the file read-write method for distributed storage including the steps of:
after detecting a writing request of a user layer, detecting whether a preset priority cluster in a cluster layer is in a backfill deviation backfill state or not;
if the priority cluster is detected to be in the backfill state, a first target cluster which has the highest priority and is not in the backfill state is searched from the cluster layer;
and acquiring a file to be written according to the writing request, and writing the file to be written into the first target cluster.
Optionally, if the priority cluster is detected to be in the backfill state, the step of searching the first target cluster which has the highest priority and is not in the backfill state from the cluster layer includes:
searching each initial cluster which is not in a backfill state from the cluster layer;
detecting a first priority of each initial cluster;
and searching the cluster with the highest first priority from the initial cluster to serve as a first target cluster.
Optionally, the step of detecting the first priority of each of the initial clusters includes:
Sending a detection request to the initial cluster;
acquiring weight information fed back by the initial cluster based on the detection request;
and determining the first priority of the initial cluster according to the weight information.
Optionally, the weight information includes availability of the initial cluster, network delay of the initial cluster and/or abnormal level of the initial cluster;
the step of determining the first priority of the initial cluster according to the weight information includes:
determining a health score of the initial cluster according to the availability, the network delay and/or the abnormality level, wherein the higher the availability is, the higher the health score is, the smaller the network delay is, the higher the health score is, the lower the abnormality level is, and the higher the health score is;
determining a first priority of the initial cluster according to the health score;
wherein the higher the health score, the higher the first priority of the initial cluster.
Optionally, the step of finding each initial cluster not in the backfill state from the cluster layer includes:
detecting health states of all clusters in the cluster layer;
Determining whether the cluster is in a backfill state according to the health state;
and if the cluster is not in the backfill state, acquiring the cluster which is not in the backfill state as the initial cluster.
Optionally, the file reading and writing method of distributed storage further includes:
when a reading request of a user layer is detected, determining a file to be read of the reading request, and detecting a second priority of each cluster in the cluster layer;
determining whether each cluster has the file to be read or not in sequence according to the second priority from high to low until a second target cluster with the file to be read is found out;
and reading the file to be read from the second target cluster, and feeding back the file to be read to the user layer.
Optionally, the step of reading the file to be read from the second target cluster and feeding back the file to the user layer includes:
sending a downloading request of the file to be read to the second target cluster;
acquiring the file to be read fed back by the second target cluster based on the downloading request;
and sending the file to be read to the user layer.
In addition, in order to achieve the above object, the present invention further provides a file reading and writing device for distributed storage, where the file reading and writing device for distributed storage includes:
The detection module is used for detecting whether a preset priority cluster in the cluster layer is in a backfill deviation backfill state or not after detecting a writing request of the user layer;
the cluster searching module is used for searching a first target cluster which has highest priority and is not in a backfill state from the cluster layer if the priority cluster is detected to be in the backfill state;
and the writing module is used for acquiring a file to be written according to the writing request and writing the file to be written into the first target cluster.
In addition, in order to achieve the above object, the present invention further provides a file reading and writing platform for distributed storage, where the file reading and writing platform for distributed storage includes a processor, a memory, and a file reading and writing program for distributed storage stored on the memory and executable by the processor, where the steps of the file reading and writing method for distributed storage are implemented when the file reading and writing program for distributed storage is executed by the processor.
In addition, in order to achieve the above object, the present invention further provides a computer readable storage medium, on which a file read-write program for distributed storage is stored, wherein the file read-write program for distributed storage, when executed by a processor, implements the steps of the file read-write method for distributed storage as described above.
Aiming at the characteristic that the cluster is not available only when writing in the backfill state, the embodiment of the invention presets a certain cluster in the cluster layer as the priority cluster with the highest priority for writing the file preferentially. After detecting a writing request of a user layer, detecting whether a preset priority cluster in a cluster layer is in a backfill deviation backfill state or not; if the priority cluster is detected to be in the backfill state, a first target cluster which has the highest priority and is not in the backfill state is searched from the cluster layer to replace the priority cluster to complete the file writing request of the user layer; according to the writing request, the file to be written is obtained and written into the first target cluster, so that the function of writing the file to the cluster layer by the user layer is realized, the writing function can be realized when the cluster is in a backfill state, the unavailability of the cluster is avoided, and the availability of storage service is improved; and because the cluster in the back fill state is not deactivated, the cluster in the back fill state can still be used for reading the service, and the availability of the cluster in the back fill state is improved.
Drawings
FIG. 1 is a flow chart of a first embodiment of a method for reading and writing files in distributed storage according to the present invention;
FIG. 2 is a schematic diagram of a refinement flow of step S20 in a second embodiment of a file read-write method for distributed storage according to the present invention;
FIG. 3 is a schematic diagram of a refinement flow of step S22 in a second embodiment of the file read-write method of distributed storage according to the present invention;
FIG. 4 is a flowchart of a fourth embodiment of a method for reading and writing files in distributed storage according to the present invention;
FIG. 5 is a schematic diagram of functional modules of a first embodiment of a file read-write device for distributed storage according to the present invention;
fig. 6 is a schematic hardware structure of a file read-write platform of distributed storage according to an embodiment of the present invention.
The achievement of the objects, functional features and advantages of the present invention will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
The invention provides a file reading and writing method of distributed storage, referring to fig. 1, fig. 1 is a flow chart of a first embodiment of the file reading and writing method of distributed storage of the invention.
Embodiments of the present invention provide embodiments of a file read-write method for distributed storage, it being noted that although a logical order is shown in the flowchart, in some cases, the steps shown or described may be performed in a different order than what is shown or described herein.
The file read-write method of the distributed storage is applied to a file read-write platform, a server or a terminal of the distributed storage, and the terminal can comprise a mobile terminal such as a mobile phone, a tablet computer, a notebook computer, a palm computer, a personal digital assistant (Personal Digital Assistant, PDA) and the like, and a fixed terminal such as a digital TV, a desktop computer and the like. In various embodiments of a file read-write method of distributed storage, for convenience of description, the various embodiments are described with a file read-write platform of distributed storage as an execution body.
The embodiment of the invention relates to a user layer, a service layer and a cluster layer, wherein a file read-write platform for distributed storage is equivalent to the service layer arranged between the user layer and the cluster layer; 1. the user layer is mainly used for sending a reading request or a writing request of the file to the service layer; 2. the cluster layer comprises a plurality of ceph clusters (hereinafter referred to as clusters), wherein each ceph cluster is used for reading files or writing files; 3. the service layer is mainly used for detecting whether the clusters of the cluster layer are in a backfilment state and the priorities of the clusters, and reading files from the clusters of the cluster layer or writing the files into the clusters of the cluster layer according to the states and the priorities of the clusters and the read-write request of the user layer.
In a first embodiment of the file read-write method for distributed storage of the present invention, the file read-write method for distributed storage includes:
step S10, after detecting a writing request of a user layer, detecting whether a preset priority cluster in a cluster layer is in a backfill deviation backfill state or not;
in the embodiment of the invention, aiming at the characteristic that the cluster is not available only when writing in the backfill state, the adopted write strategy is as follows: the higher the priority clusters, the more preferred the writing; the read strategy adopted is: write-first-read, since write is prioritized higher as priority is higher, read is prioritized higher as priority is higher when read. The reading strategy is specifically implemented as follows: and according to the cluster priority from high to low, the service layer sequentially inquires whether each cluster of the cluster layer has a file to be read or not until the cluster with the file to be read is found out, downloads the file from the cluster, and feeds the downloaded file back to the user layer.
The priority of each cluster in the cluster layer is determined by the health state of the cluster, the health state of the cluster is determined by the availability of the cluster, the network delay of the cluster, the abnormal grade of the cluster and other information, and the health score of the cluster is determined by the availability of the cluster, the network delay of the cluster, the abnormal grade of the cluster and other information. In this embodiment, the health score of the cluster is used as the priority of the cluster; the higher the health score of a cluster, the higher the priority of the cluster. Specifically, when the priority of each cluster in the cluster layer needs to be detected, the service layer initiates a detection request to each cluster in the cluster layer, then obtains weight information fed back by each cluster based on the detection request, such as availability of the cluster, network delay of the cluster, abnormal grade of the cluster and the like, and then determines that the health score of each cluster is higher according to the weight information such as the availability of each cluster, the network delay, the abnormal grade and the like, so as to determine that the priority of each cluster is relatively higher.
The writing request refers to a request sent by the user layer to the service layer when the user layer needs to write the file into the cluster layer, so that the service layer writes the file into the cluster of the cluster layer according to the writing request of the user layer.
The priority cluster is a cluster which is preset as the highest priority in a cluster layer and is used for writing files preferentially; in the initial state (under the condition that the health score of the cluster is not changed), the health score of the preset priority cluster is highest in each cluster of the cluster layer, and the priority of the priority cluster is highest.
When a write-in request of a user layer is detected, a preset priority cluster is obtained from each cluster of the cluster layer; and detecting whether the priority cluster is in a backfill state. Specifically, a health check request is sent to a preset priority cluster of the cluster layer, then health information such as availability of the cluster, network delay of the cluster, abnormal grade of the cluster and the like fed back by the preset priority cluster of the cluster layer after the health check request is received is obtained, and whether the priority cluster is in a backfilment state is determined according to the health information fed back by the priority cluster.
Step S20, if the priority cluster is detected to be in a backfill state, a first target cluster which has the highest priority and is not in the backfill state is searched from the cluster layer;
The first target cluster refers to a cluster with the highest priority in the cluster layer and not in the backfill state when a priority cluster preset in the cluster layer is in the backfill state.
When the priority cluster is in the backfill state, the file requested to be written by the user layer is written into the priority cluster of the cluster layer, so that the priority cluster is in the backfill state for a long time, and the priority cluster is not available. Therefore, when the priority cluster is in the backfill state, the cluster with the highest priority and not in the backfill state is found out from the cluster layer, so that the file writing request of the user layer is executed instead of the priority cluster.
Specifically, in one embodiment, if a write request exists in the user layer and it is detected that a priority cluster preset in the cluster layer is in a backfilment state, all clusters that are not in the backfilment state are found out from all clusters in the cluster layer (a detection manner of whether each cluster is in the backfilment state is similar to a detection manner of the priority cluster, and will not be described herein). For example, the cluster layer has three clusters: ceph-1, ceph-2, ceph-3, wherein ceph-3 is in a backfill state, then all clusters that are not in the backfill state are found to be ceph-1, ceph-2 from all clusters. Then, the priority of each cluster which is not in the backfill state is detected, and all clusters which are not in the backfill state are ordered according to the priority from high to low. And finally, searching out the cluster with the highest priority from all clusters which are not in the backfill state, and taking the cluster as a first target cluster.
One implementation way is that if a write request exists in a user layer and a preset priority cluster in a back fill state is detected, the priority of each cluster in the cluster layer is detected, and all clusters in the cluster layer are ordered according to the priority from high to low. Then, finding out all clusters which are not in the backfilment state from all clusters in the cluster layer (the detection mode of whether all clusters are in the backfilment state is similar to the detection mode of the priority cluster, and the description is omitted here); and finally, searching out the clusters with the highest priority from all the clusters which are not in the backfill state, and obtaining the clusters which are in the backfill state and have the highest priority in the cluster layer, wherein the clusters are used as the first target clusters.
If a writing request exists in the user layer, but the fact that the priority cluster preset in the cluster layer is not in a backfilment state is detected, acquiring a file to be written according to the writing request of the user layer, and writing the file to be written into the priority cluster.
Step S30, according to the writing request, obtaining a file to be written, and writing the file to be written into the first target cluster.
Specifically, according to a writing request of a user layer, determining and acquiring a file to be written of the user layer, and writing the file to be written of the user layer into a first target cluster of a cluster layer.
The file to be written is determined according to a writing request of a user layer, and the user layer needs to write into the file of the cluster layer.
In this embodiment, aiming at the characteristic that in the backfill state, only when writing, a cluster is unavailable, a certain cluster is preset in a cluster layer as a priority cluster with highest priority for preferentially writing files; and setting the available state of clusters of the cluster layer as: whether or not the cluster is in the backfill state, the cluster is not deactivated. After detecting a writing request of a user layer, detecting whether a preset priority cluster in a cluster layer is in a backfill deviation backfill state or not; if the priority cluster is detected to be in the backfill state, a first target cluster which has the highest priority and is not in the backfill state is searched from the cluster layer to replace the priority cluster to complete the file writing request of the user layer; according to the writing request, the file to be written is obtained and written into the first target cluster, so that the function of writing the file to the cluster layer by the user layer is realized, the writing function can be realized when the cluster is in a backfill state, the unavailability of the cluster is avoided, and the availability of storage service is improved; and because the cluster in the back fill state is not deactivated, the cluster in the back fill state can still be used for reading the service, and the availability of the cluster in the back fill state is improved.
Further, step S10 further includes:
if the priority cluster is detected not to be in the backfill state, acquiring a file to be written according to the writing request;
and writing the file to be written into the priority cluster.
When the priority cluster is not in the backfill state, the file requested to be written by the user layer is written into the priority cluster of the cluster layer, so that the priority cluster is not unavailable due to the fact that the priority cluster is in the backfill state for a long time. If a writing request exists in the user layer, and the fact that the priority cluster preset in the cluster layer is not in a backfilment state is detected, acquiring a file to be written according to the writing request of the user layer, and writing the file to be written into the priority cluster.
When the priority cluster is in the backfilment state, the cluster with the highest priority and not in the backfilment state is searched out from the cluster layer to replace the priority cluster to execute the file writing request of the user layer, the file to be written is obtained according to the writing request of the user layer, and the file to be written is written into the cluster.
In this embodiment, when the priority cluster is not in the backfill state, the file requested to be written by the user layer is written into the priority cluster of the cluster layer, so that the priority cluster is not unavailable due to the fact that the priority cluster is in the backfill state for a long time. When the priority cluster is not in the backfill state, if the fact that the user layer has a writing request is detected, writing the file written by the user request into the priority cluster, and ensuring high availability of the priority cluster.
Further, referring to fig. 2, fig. 2 is a schematic diagram of a refinement flow of step S20 in a second embodiment of the file read-write method of distributed storage according to the present invention. Based on the above-mentioned first embodiment, a second embodiment of the file read-write method for distributed storage according to the present invention is provided, and step S20 includes:
step S21, if the priority cluster is detected to be in a backfill state, each initial cluster which is not in the backfill state is searched from the cluster layer;
if a write-in request exists in the user layer and a priority cluster preset in the cluster layer is detected to be in a backfilment state, all clusters which are not in the backfilment state are searched out from all clusters in the cluster layer. Specifically, a health check request is sent to each cluster of a cluster layer, then health information such as availability of the clusters, network delay of the clusters, abnormal grades of the clusters and the like fed back by each cluster of the cluster layer after the health check request is received is obtained, and whether each cluster is in a backfill state is determined according to the health information fed back by the priority clusters.
And then, acquiring each cluster which is not in the backfill state from each cluster to serve as an initial cluster.
When the priority cluster is in a backfill state, the initial cluster is a cluster which is not in the backfill state in the cluster layer.
Step S22, detecting the first priority of each initial cluster;
specifically, a detection request is initiated to each initial cluster, weight information fed back by each initial cluster based on the detection request, such as availability of the cluster, network delay of the cluster, abnormal level of the cluster and the like, is acquired, and then the priority of each initial cluster is determined according to the weight information, such as the availability of each initial cluster, the network delay, the abnormal level and the like, so as to serve as the first priority of the initial cluster. Similarly, a first priority of each initial cluster is obtained.
The first priority refers to the priority of the initial cluster, i.e. the health score of the initial cluster.
Specifically, referring to fig. 3, fig. 3 is a detailed flowchart of step S22 in a second embodiment of the file read-write method for distributed storage according to the present invention, and step S22 includes:
a1, sending a detection request to the initial cluster;
the detection request is a request initiated by the service layer to the cluster of the cluster layer for detecting health information such as availability of the cluster, network delay of the cluster, abnormal level of the cluster and the like.
A2, acquiring weight information fed back by the initial cluster based on the detection request;
After sending detection requests to each initial cluster, acquiring weight information of the clusters fed back by each initial cluster based on the detection requests.
The weight information refers to health information such as availability, network delay, abnormal level and the like of the initial cluster based on detection request feedback.
And step A3, determining the first priority of the initial cluster according to the weight information.
Further, the weight information comprises the availability of the initial cluster, the network delay of the initial cluster and/or the abnormal level of the initial cluster;
the step of determining the first priority of the initial cluster according to the weight information includes:
determining a health score of the initial cluster according to the availability, the network delay and/or the abnormality level, wherein the higher the availability is, the higher the health score is, the smaller the network delay is, the higher the health score is, the lower the abnormality level is, and the higher the health score is;
determining a first priority of the initial cluster according to the health score;
wherein the higher the health score, the higher the first priority of the initial cluster.
Specifically, according to weight information (availability of the cluster itself, network delay, abnormal level and other health information) of each initial cluster, a health score of each initial cluster is determined, and the health score of each initial cluster is used as a first priority of each initial cluster. Similarly, a first priority of each initial cluster is obtained. Wherein, the higher the availability of the initial cluster, the higher the health score of the initial cluster, and the higher the priority of the initial cluster; the smaller the network delay of the cluster, the higher the health score of the initial cluster, and the higher the priority of the cluster; the lower the anomaly level of the cluster, the higher the health score of the initial cluster and the higher the priority of the cluster.
In this embodiment, a detection request is sent to an initial cluster which is not in a backfill state, so as to detect the health state of the initial cluster, determine the priority of the initial cluster according to the health state of the initial cluster, and use the initial cluster with the best health state as the cluster with the highest priority, so that the health state of a first target cluster selected subsequently is guaranteed to be the best, the availability of the first target cluster is guaranteed to be the highest, the first target cluster is adopted subsequently to replace the priority cluster to interact with a service layer, and the availability of the writing request of a user layer is completed.
Step S23, searching the cluster with the highest first priority from the initial clusters, so as to serve as a first target cluster.
Specifically, according to a first priority, sorting initial clusters which are not in a backfill state from high to low, and acquiring initial clusters with the forefront sorting from all the initial clusters to serve as a first target cluster.
In this embodiment, when the priority cluster is in the backfill state, the cluster with the highest priority and not in the backfill state is found in the cluster layer to be used as the first target cluster. And the first target cluster with the highest priority and not in the backfill state is used for replacing the priority cluster and interacting with the service layer to finish the writing request of the user layer, and the high availability of the writing function is ensured because the first target cluster with the highest priority and not in the backfill state.
Further, based on the above second embodiment, a third embodiment of the file read-write method for distributed storage according to the present invention is provided, and step S23 includes:
step B1, detecting the health state of each cluster in the cluster layer;
specifically, a health check request is sent to each cluster of the cluster layer, and then the states of availability of the clusters, network delay of the clusters, abnormal grades of the clusters and the like fed back by each cluster of the cluster layer after the health check request is received are obtained. The health state refers to the availability of the cluster, network delay of the cluster, abnormal level of the cluster and the like.
Step B2, determining whether the cluster is in a backfill state according to the health state;
then, from the availability, network delay, anomaly level, etc. states of each cluster, it is found and determined whether each cluster is in a backfill state according to the state associated with forming the backfill state. Similarly, it is determined whether each cluster of the cluster layer is in a backfill state.
And step B3, if the cluster is not in the backfill state, acquiring the cluster which is not in the backfill state as the initial cluster.
And if the cluster is not in the backfill state, acquiring the cluster which is not in the backfill state as the initial cluster.
The final purpose for acquiring clusters is: and searching the cluster with the highest priority from the initial clusters, and executing the file writing request of the user layer instead of the priority cluster. When the cluster is in the backfill state, writing the file requested by the user layer to be written into the cluster will result in the cluster being in the backfill state for a long time, so that the cluster is not available. Thus, if a cluster is in a backfill state, the cluster is not acquired.
In this embodiment, by detecting the state (availability, network delay, abnormal level, etc.) of each cluster, and determining whether the cluster is in the backfill state according to the state of the cluster, it is accurately determined whether each cluster is in the backfill state, so that it is ensured that the subsequently selected first target cluster is not the cluster in the backfill state.
Further, referring to fig. 4, fig. 4 is a schematic flow chart of a fourth embodiment of a file read-write method for distributed storage according to the present invention, and based on the first embodiment, the second embodiment, or the third embodiment, the fourth embodiment of the file read-write method for distributed storage according to the present invention is provided, where the file read-write method for distributed storage further includes:
step S40, after detecting a reading request of a user layer, determining a file to be read of the reading request, and detecting a second priority of each cluster in the cluster layer;
due to
When the reading request of the user layer is detected, information of the user layer request is obtained from the reading request of the user layer, and therefore files to be read corresponding to the reading request of the user layer are determined. For example, after the user layer initiates a read request for reading "picture a", the service layer will detect the read request of the user layer, and determine, according to the read request of the user layer, that the file to be read corresponding to the read request of the user layer is "picture a". And initiating a detection request to each cluster in the cluster layer, then acquiring weight information fed back by each cluster based on the detection request, such as availability of the cluster, network delay of the cluster, abnormal level of the cluster and the like, and then determining the priority of each cluster according to the weight information such as the availability of each cluster, the network delay, the abnormal level and the like to serve as a second priority of the cluster. And similarly, the second priority of each cluster is obtained. Wherein, the higher the availability of the cluster, the higher the health score of the cluster, and the higher the priority of the cluster; the smaller the network delay of the cluster, the higher the health score of the cluster, and the higher the priority of the cluster; the lower the anomaly level of a cluster, the higher the health score of the cluster and the higher the priority of the cluster.
The reading request refers to a request sent by the user layer to the service layer when the user layer needs to read the file from the cluster layer, so that the service layer searches a cluster with the file requested to be read by the user layer from the clusters of the cluster layer according to the reading request of the user layer, sends a downloading request to the cluster, reads the file from the cluster layer and feeds the file back to the user layer, thereby realizing the function of reading the file from the cluster layer by the user layer.
The file to be read is determined according to the writing request of the user layer, and the user layer needs to read from the cluster layer.
The second priority refers to the priority of the clusters in the cluster layer when the priority cluster is not in the backfill state, i.e. the health score of the clusters in the cluster layer when the priority cluster is not in the backfill state. The first priority and the second priority refer to the priorities (i.e. health states) of the clusters in the cluster layer, except that the first priority refers to the priority of the clusters which are not in the backfill state in the cluster layer when the priority clusters are in the backfill state; the second priority refers to the priority of the cluster in the cluster layer when the priority cluster is not in the backfill state.
Step S50, determining whether each cluster has the file to be read or not in sequence according to the second priority from high to low until a second target cluster having the file to be read is found;
Firstly, sequencing all clusters of a cluster layer according to the second priority from high to low to obtain a cluster sequence. Then, an inquiry request (for inquiring whether the file to be read exists in the cluster) is initiated to the cluster which is the forefront in the cluster sequence, so that the cluster can detect whether the cluster has the file to be read or not when receiving the inquiry request.
And then, obtaining the reply information fed back by the cluster based on the inquiry request (used for determining whether the file to be read exists in the cluster), and judging whether the file to be read exists in the cluster according to the reply information fed back by the cluster based on the inquiry request. And if the file to be read exists in the cluster, taking the cluster as a second target cluster. If the cluster does not have the file to be read, an inquiry request (used for inquiring whether the file to be read exists in the next cluster) is initiated to the next cluster in the cluster sequence, so that the next cluster can detect whether the file to be read exists in the next cluster when receiving the inquiry request.
And acquiring reply information fed back by the latter cluster based on the inquiry request (used for determining whether the file to be read exists in the latter cluster), and judging whether the file to be read exists in the latter cluster according to the reply information fed back by the latter cluster based on the inquiry request. And if the file to be read exists in the latter cluster, taking the latter cluster as a second target cluster. And if the file to be read does not exist in the next cluster, similarly, initiating an inquiry request to one cluster immediately after the next cluster in the cluster sequence until a second target cluster with the file to be read is found.
The second target cluster refers to a cluster in which a file to be read corresponding to a read request exists in the cluster layer when the read request of the user layer is detected. The first target cluster is different from the second target cluster in that the first target cluster is a cluster for writing files requested by the user layer to write, and the second target cluster is a cluster for reading files requested by the user layer to read.
Step S60, reading the file to be read from the second target cluster, and feeding back the file to the user layer.
And sending a downloading request of the file to be read to the second target cluster, acquiring the file to be read fed back by the second target cluster based on the downloading request, and sending the file to be read to a user layer.
In this embodiment, aiming at the feature that in the backfill state, the cluster is only disabled when writing, and the cluster is not disabled when reading, the cluster availability state of the cluster layer is set as: whether or not the cluster is in the backfill state, the cluster is not deactivated. When a reading request of a user layer is detected, sequentially inquiring whether the user layer requests to read files exist in each cluster according to the priority of each cluster of the cluster layer from high to low until a target cluster with the files requested to read by the user layer is found; and then reading the file requested to be read by the user layer from the target cluster, and feeding back the file requested to be read by the user layer to the user layer, so that the function of reading the file from the user layer to the cluster layer is realized. Since the cluster in the backfill state is not deactivated, the cluster in the backfill state can still be used for reading the service; therefore, whether the cluster is in the backfill state or not can realize the function that the user layer reads files from the cluster layer, and the availability of the cluster in the backfill state is improved.
Specifically, step S60 includes:
step C1, sending a downloading request of the file to be read to the second target cluster;
the downloading request refers to a request sent by the service layer to a second target cluster of the cluster layer when the user layer needs to read the file from the cluster layer, so that the second target cluster feeds back the file to be read stored in the second target cluster to the service layer according to the downloading request of the service layer, and the service layer feeds back the file to be read to the user layer, thereby realizing the function of reading the file from the cluster layer by the user layer.
Step C2, acquiring the file to be read fed back by the second target cluster based on the downloading request;
and sending a downloading request of the file to be read to the second target cluster, so that the second target cluster feeds back the file to be read stored in the second target cluster to the service layer according to the downloading request of the service layer. And then, acquiring a file to be read fed back by a second target cluster of the cluster layer.
And step C3, the file to be read is sent to the user layer.
And finally, sending the file to be read fed back by the second target cluster of the cluster layer to the user layer, thereby completing the function of reading the file from the cluster layer by the user layer.
In this embodiment, a file to be read is fed back to a user layer by a second target cluster of a cluster layer according to a download request of a service layer by sending a download request of the file to the second target cluster, and the file to be read fed back by the second target cluster based on the download request is obtained; the service layer is ensured to be capable of acquiring the file requested to be read by the user layer from the cluster layer and feeding the file back to the user layer, so that the function of reading the file from the user layer to the cluster layer is realized.
The steps S40 to S60 may be performed before or after any one of the steps S10, S20, and S30, that is, the steps S40 to S60 are not affected by the steps S10, S20, and S30.
In addition, the invention also provides a file read-write device for distributed storage.
Referring to fig. 5, fig. 5 is a schematic functional block diagram of a first embodiment of a file reading and writing device for distributed storage according to the present invention.
In this embodiment, the file reading and writing device for distributed storage includes:
the detection module 10 is configured to detect whether a preset priority cluster in the cluster layer is in a backfill deviation back fill state after detecting a write-in request of the user layer;
The cluster searching module 20 is configured to, if it is detected that the priority cluster is in a backfill state, search a first target cluster that has a highest priority and is not in a backfill state from the cluster layer;
the writing module 30 is configured to obtain a file to be written according to the writing request, and write the file to be written into the first target cluster.
Further, the cluster search module 20 further includes:
the first searching unit is used for searching each initial cluster which is not in a backfill state from the cluster layer;
the detection unit is used for detecting the first priority of each initial cluster;
and the second searching unit is used for searching the cluster with the highest first priority from the initial clusters to serve as a first target cluster.
Further, the detection unit further includes:
a request subunit, configured to send a detection request to the initial cluster;
the information acquisition subunit is used for acquiring weight information fed back by the initial cluster based on the detection request;
and the priority determining subunit is used for determining the first priority of the initial cluster according to the weight information.
Further, the weight information comprises the availability of the initial cluster, the network delay of the initial cluster and/or the abnormal level of the initial cluster;
The priority determination subunit further includes:
a health score determining unit, configured to determine a health score of the initial cluster according to the availability, the network delay and/or the anomaly level, where the higher the availability is, the higher the health score is, the smaller the network delay is, the higher the health score is, the lower the anomaly level is, and the higher the health score is;
a priority determining unit, configured to determine a first priority of the initial cluster according to the health score;
wherein the higher the health score, the higher the first priority of the initial cluster.
Further, the first search unit further includes:
a detection subunit, configured to detect a health status of each cluster in the cluster layer;
a state determining subunit, configured to determine, according to the health state, whether the cluster is in a backfill state;
and the cluster determining subunit is used for acquiring the cluster which is not in the backfill state as the initial cluster if the cluster is not in the backfill state.
Further, the file read-write device of distributed storage further includes:
the priority determining module is used for determining a file to be read of the read request after detecting the read request of the user layer, and detecting the second priority of each cluster in the cluster layer;
The cluster determining module is used for sequentially determining whether each cluster has the file to be read or not according to the second priority from high to low until a second target cluster with the file to be read is found out;
and the reading module is used for reading the file to be read from the second target cluster and feeding the file to be read back to the user layer.
Further, the reading module further includes:
a request unit, configured to send a download request of the file to be read to the second target cluster;
the file acquisition unit is used for acquiring the file to be read fed back by the second target cluster based on the downloading request;
and the sending unit is used for sending the file to be read to the user layer.
Further, the writing module is further configured to obtain a file to be written according to the writing request if it is detected that the priority cluster is not in a backfill state;
and writing the file to be written into the priority cluster.
The embodiments of the file read-write device for distributed storage are basically the same as the embodiments of the file read-write method for distributed storage, and are not described in detail herein.
In addition, the invention also provides a file read-write platform for distributed storage. As shown in fig. 6, fig. 6 is a schematic structural diagram of a hardware running environment of a file read-write platform of distributed storage according to an embodiment of the present invention.
It should be noted that fig. 6 is a schematic structural diagram of a hardware running environment of the file read-write platform of distributed storage. The file read-write platform of the distributed storage of the embodiment of the invention can be terminal equipment such as PC, portable computer and the like.
As shown in fig. 6, the file read-write platform for distributed storage may include a processor 1001 (e.g., CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Wherein the communication bus 1002 is used to enable connected communications between these components; the user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard); the network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface); the memory 1005 may be a high-speed RAM memory or a stable memory (non-volatile memory), such as a disk memory, and the memory 1005 may alternatively be a storage device independent of the processor 1001.
Optionally, the file read-write platform of the distributed storage may further include a camera, an RF (Radio Frequency) circuit, a sensor, an audio circuit, a WiFi module, and so on.
Those skilled in the art will appreciate that the hardware architecture of the distributed storage file read-write platform shown in fig. 6 is not limiting of the distributed storage file read-write platform and may include more or fewer components than shown, or may combine certain components, or a different arrangement of components.
With continued reference to fig. 6, the memory 1005 in fig. 6, which is a type of computer readable storage medium, may include an operating system, a network communication module, and a file read-write program that is stored in a distributed manner.
In fig. 6, the network communication module is mainly used for connecting with a database and performing data communication with the database; and the processor 1001 may call a file read-write program of distributed storage stored in the memory 1005 and perform the steps of the file read-write method of distributed storage as described above.
The specific implementation manner of the file read-write platform for distributed storage is basically the same as the above embodiments of the file read-write method for distributed storage, and is not repeated here.
In addition, the invention also provides a computer readable storage medium, the computer readable storage medium stores a file read-write program of distributed storage, and the file read-write program of distributed storage realizes the following steps when being executed by a processor:
after detecting a writing request of a user layer, detecting whether a preset priority cluster in a cluster layer is in a backfill deviation backfill state or not;
if the priority cluster is detected to be in the backfill state, a first target cluster which has the highest priority and is not in the backfill state is searched from the cluster layer;
And acquiring a file to be written according to the writing request, and writing the file to be written into the first target cluster.
Further, if the priority cluster is detected to be in the backfill state, the step of searching the first target cluster which has the highest priority and is not in the backfill state from the cluster layer includes:
searching each initial cluster which is not in a backfill state from the cluster layer;
detecting a first priority of each initial cluster;
and searching the cluster with the highest first priority from the initial cluster to serve as a first target cluster.
Further, the step of detecting the priority of each of the initial clusters includes:
sending a detection request to the initial cluster;
acquiring weight information fed back by the initial cluster based on the detection request;
and determining the first priority of the initial cluster according to the weight information.
Further, the weight information comprises the availability of the initial cluster, the network delay of the initial cluster and/or the abnormal level of the initial cluster;
the step of determining the first priority of the initial cluster according to the weight information includes:
Determining a health score of the initial cluster according to the availability, the network delay and/or the abnormality level, wherein the higher the availability is, the higher the health score is, the smaller the network delay is, the higher the health score is, the lower the abnormality level is, and the higher the health score is;
determining a first priority of the initial cluster according to the health score;
wherein the higher the health score, the higher the first priority of the initial cluster.
Further, the step of finding each initial cluster which is not in the backfill state from the cluster layer includes:
detecting health states of all clusters in the cluster layer;
determining whether the cluster is in a backfill state according to the health state;
and if the cluster is not in the backfill state, acquiring the cluster which is not in the backfill state as the initial cluster.
Further, the file read-write method of distributed storage further comprises the following steps:
when a reading request of a user layer is detected, determining a file to be read of the reading request, and detecting a second priority of each cluster in the cluster layer;
Determining whether each cluster has the file to be read or not in sequence according to the second priority from high to low until a second target cluster with the file to be read is found out;
and reading the file to be read from the second target cluster, and feeding back the file to be read to the user layer.
Further, the step of reading the file to be read from the second target cluster and feeding back the file to the user layer includes:
sending a downloading request of the file to be read to the second target cluster;
acquiring the file to be read fed back by the second target cluster based on the downloading request;
and sending the file to be read to the user layer.
Further, after the step of detecting whether the preset priority cluster in the cluster layer is in the backfill offset state after the step of detecting the writing request of the user layer further includes:
if the priority cluster is detected not to be in the backfill state, acquiring a file to be written according to the writing request;
and writing the file to be written into the priority cluster.
The specific implementation manner of the computer readable storage medium of the present invention is basically the same as the above embodiments of the file read-write method of distributed storage, and will not be described herein again.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) as described above, comprising instructions for causing a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method according to the embodiments of the present invention.
The foregoing description is only of the preferred embodiments of the present invention, and is not intended to limit the scope of the invention, but rather is intended to cover any equivalents of the structures or equivalent processes disclosed herein or in the alternative, which may be employed directly or indirectly in other related arts.
Claims (8)
1. The file read-write method for the distributed storage is characterized by comprising the following steps of:
after detecting a writing request of a user layer, detecting whether a preset priority cluster in a cluster layer is in a backfill deviation backfill state or not;
if the priority cluster is detected to be in the backfill state, a first target cluster which has the highest priority and is not in the backfill state is searched from the cluster layer;
according to the writing request, acquiring a file to be written, and writing the file to be written into the first target cluster;
if the priority cluster is detected to be in the backfill state, the step of searching the first target cluster which has the highest priority and is not in the backfill state from the cluster layer comprises the following steps:
if the priority cluster is detected to be in the backfill state, each initial cluster which is not in the backfill state is searched from the cluster layer;
Detecting a first priority of each initial cluster;
according to the first priority, ordering the initial clusters which are not in a backfill state from high to low, and obtaining the initial cluster with the forefront ordering as a first target cluster;
the step of finding each initial cluster which is not in the backfill state from the cluster layer comprises the following steps:
detecting health states of all clusters in the cluster layer;
determining whether the cluster is in a backfill state according to the health state;
and if the cluster is not in the backfill state, acquiring the cluster which is not in the backfill state as the initial cluster.
2. The method of claim 1, wherein the step of detecting the first priority of each of the initial clusters comprises:
sending a detection request to the initial cluster;
acquiring weight information fed back by the initial cluster based on the detection request;
and determining the first priority of the initial cluster according to the weight information.
3. The method for reading and writing a file of distributed storage according to claim 2, wherein the weight information includes availability of the initial cluster, network delay of the initial cluster, and/or anomaly level of the initial cluster;
The step of determining the first priority of the initial cluster according to the weight information includes:
determining a health score of the initial cluster according to the availability, the network delay and/or the abnormality level, wherein the higher the availability is, the higher the health score is; the smaller the network delay, the higher the health score; the lower the anomaly level, the higher the health score;
determining a first priority of the initial cluster according to the health score;
wherein the higher the health score, the higher the first priority of the initial cluster.
4. A file read-write method for distributed storage according to any one of claims 1 to 3, wherein the file read-write method for distributed storage further comprises:
when a reading request of a user layer is detected, determining a file to be read of the reading request, and detecting a second priority of each cluster in the cluster layer;
determining whether each cluster has the file to be read or not in sequence according to the second priority from high to low until a second target cluster with the file to be read is found out;
and reading the file to be read from the second target cluster, and feeding back the file to be read to the user layer.
5. The method for reading and writing a file stored in a distributed manner as claimed in claim 4, wherein the step of reading the file to be read from the second target cluster and feeding back the file to the user layer includes:
sending a downloading request of the file to be read to the second target cluster;
acquiring the file to be read fed back by the second target cluster based on the downloading request;
and sending the file to be read to the user layer.
6. A file read-write device for distributed storage, wherein the file read-write device for distributed storage comprises:
the detection module is used for detecting whether a preset priority cluster in the cluster layer is in a backfill deviation backfill state or not after detecting a writing request of the user layer;
the cluster searching module is used for searching a first target cluster which has highest priority and is not in a backfill state from the cluster layer if the priority cluster is detected to be in the backfill state;
the writing module is used for acquiring a file to be written according to the writing request and writing the file to be written into the first target cluster;
the cluster searching module is further configured to, if the priority cluster is detected to be in a backfill state, search each initial cluster that is not in the backfill state from the cluster layer; detecting a first priority of each initial cluster; according to the first priority, ordering the initial clusters which are not in a backfill state from high to low, and obtaining the initial cluster with the forefront ordering as a first target cluster;
The cluster searching module is further used for detecting health states of all clusters in the cluster layer; determining whether the cluster is in a backfill state according to the health state; and if the cluster is not in the backfill state, acquiring the cluster which is not in the backfill state as the initial cluster.
7. A distributed storage file read-write platform, characterized in that the distributed storage file read-write platform comprises a processor, a memory, and a distributed storage file read-write program stored on the memory and executable by the processor, wherein the distributed storage file read-write program, when executed by the processor, implements the steps of the distributed storage file read-write method according to any one of claims 1 to 5.
8. A computer readable storage medium, wherein a file read-write program for distributed storage is stored on the computer readable storage medium, wherein the file read-write program for distributed storage, when executed by a processor, implements the steps of the file read-write method for distributed storage according to any one of claims 1 to 5.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910980132.8A CN110990339B (en) | 2019-10-15 | 2019-10-15 | File read-write method, device and platform for distributed storage and readable storage medium |
| PCT/CN2020/093105 WO2021073111A1 (en) | 2019-10-15 | 2020-05-29 | Distributed storage file reading and writing method, device and platform, and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910980132.8A CN110990339B (en) | 2019-10-15 | 2019-10-15 | File read-write method, device and platform for distributed storage and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110990339A CN110990339A (en) | 2020-04-10 |
| CN110990339B true CN110990339B (en) | 2023-09-19 |
Family
ID=70082023
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910980132.8A Active CN110990339B (en) | 2019-10-15 | 2019-10-15 | File read-write method, device and platform for distributed storage and readable storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN110990339B (en) |
| WO (1) | WO2021073111A1 (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110990339B (en) * | 2019-10-15 | 2023-09-19 | 平安科技（深圳）有限公司 | File read-write method, device and platform for distributed storage and readable storage medium |
| CN114189547B (en) * | 2022-02-14 | 2022-05-03 | 北京安盟信息技术股份有限公司 | SSL tunnel fast switching method under cluster |
| CN115292247B (en) * | 2022-09-28 | 2022-12-06 | 北京鼎轩科技有限责任公司 | File reading method and device, electronic equipment and storage medium |
| CN116662017B (en) * | 2023-07-27 | 2023-10-10 | 山东溯源安全科技有限公司 | Method, equipment and medium for determining read-write sequence of industrial control server |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107247729A (en) * | 2017-05-03 | 2017-10-13 | 中国银联股份有限公司 | A kind of document handling method and device |
| CN109981741A (en) * | 2019-02-26 | 2019-07-05 | 启迪云计算有限公司 | A kind of maintaining method of distributed memory system |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102750324A (en) * | 2012-05-28 | 2012-10-24 | 华为技术有限公司 | File storage system, file storage device and file access method |
| CN107341041B (en) * | 2017-06-27 | 2020-08-11 | 南京邮电大学 | Cloud task multidimensional constraint backfill scheduling method based on priority queue |
| CN110990339B (en) * | 2019-10-15 | 2023-09-19 | 平安科技（深圳）有限公司 | File read-write method, device and platform for distributed storage and readable storage medium |
-
2019
- 2019-10-15 CN CN201910980132.8A patent/CN110990339B/en active Active
-
2020
- 2020-05-29 WO PCT/CN2020/093105 patent/WO2021073111A1/en active Application Filing
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107247729A (en) * | 2017-05-03 | 2017-10-13 | 中国银联股份有限公司 | A kind of document handling method and device |
| CN109981741A (en) * | 2019-02-26 | 2019-07-05 | 启迪云计算有限公司 | A kind of maintaining method of distributed memory system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110990339A (en) | 2020-04-10 |
| WO2021073111A1 (en) | 2021-04-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110990339B (en) | File read-write method, device and platform for distributed storage and readable storage medium | |
| US20170034309A1 (en) | Software upgrade method and terminal | |
| US20050289534A1 (en) | Method for upgrading software version of mobile terminal using integrated difference files | |
| US20130297563A1 (en) | Timestamp management method for data synchronization and terminal therefor | |
| US8825991B2 (en) | FOTA based data update method and mobile terminal supporting the same | |
| WO2007020735A1 (en) | Conflict solving device | |
| KR20160138518A (en) | Method and apparatus for network entry when roaming | |
| CN107861832B (en) | Data verification method and device and readable storage medium | |
| KR101499068B1 (en) | Method for joint applications service and apparatus applied to the same | |
| CN111290773B (en) | System upgrade method, device and readable storage medium | |
| CN113592209A (en) | Model training task management method, device, terminal and storage medium | |
| CN114780019A (en) | Electronic device management method and device, electronic device and storage medium | |
| CN114257532A (en) | Server side state detection method and device | |
| CN111212098A (en) | Electronic map downloading method, system, electronic terminal and storage medium | |
| CN110780944B (en) | Method and device for starting application permission and machine-readable storage medium | |
| US7885995B2 (en) | Processing service requests in a distributed environment | |
| CN112328701B (en) | Data synchronization method, terminal device and computer readable storage medium | |
| CN110321251B (en) | Data backup method, device, equipment and storage medium based on network block equipment | |
| CN114880003A (en) | System upgrading method of intelligent terminal, intelligent terminal and storage medium | |
| CN113422791B (en) | Cloud service configuration method and device, electronic equipment and computer readable storage medium | |
| CN109412873B (en) | Configuration updating method and device, terminal equipment and computer storage medium | |
| CN103001889A (en) | Method and device for controlling terminal access and terminals | |
| CN112950370A (en) | Service processing method, device, equipment and storage medium | |
| CN113296945A (en) | Continuous integration method, system, equipment and computer readable storage medium | |
| CN108170549B (en) | Mobile terminal restart positioning method, mobile terminal and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 40020233 Country of ref document: HK |
|
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |