WO2019000675A1

WO2019000675A1 - Data processing method and electronic device

Info

Publication number: WO2019000675A1
Application number: PCT/CN2017/103709
Authority: WO
Inventors: 胡泽志
Original assignee: 联想(北京)有限公司
Priority date: 2017-06-27
Filing date: 2017-09-27
Publication date: 2019-01-03
Also published as: CN107357523B; CN107357523A

Abstract

Provided is a data processing method and an electronic device. The method comprises: obtaining a status of each storage unit in the electronic device (S101); receiving a data operation request from a program (S102); determining, according to the data operation request, the obtained status of each storage unit, and determining a target storage unit for responding to the data operation request (S103); and transmitting the data operation request to the target storage unit for processing, and returning an operation processing result to the program (S104).

Description

Data processing method and electronic device

Technical field

The present disclosure relates to the field of data processing, and in particular, to a data processing method and an electronic device.

Background technique

Solid State Drives (SSDs) are widely used as high-speed storage media. When the SSD is just put into use, the processing speed of the data is very fast; after using for a period of time, since the SSD controller needs to consume more resources for sorting the data, the bad block processing and the write equalization algorithm are processed on the data, resulting in the SSD pair. The processing speed of the data will be reduced.

In the prior art, the SSD controller is usually optimized based on the code of the SSD itself, but the optimization space is limited.

Summary of the invention

In order to solve the existing technical problems, the embodiments of the present disclosure provide a data processing method and an electronic device, which can solve at least the above problems existing in the prior art.

An embodiment of the present disclosure provides a data processing method, including:

Obtaining a status of each storage unit in the electronic device;

Receiving a data operation request from a program;

And analyzing, according to the data operation request, the acquired status of each storage unit, and determining a target storage unit for responding to the data operation request;

The data operation request is sent to the target storage unit for processing, and the operation processing result is returned to the program.

In the above solution, the acquiring, by the acquiring, the status of each storage unit in the electronic device includes:

Timingly detecting the status of each storage unit;

Storing the state of each storage unit to a storage area of the electronic device;

Querying the status of each storage unit in the storage area.

In the above solution, the determining, according to the data operation request, the state of each storage unit that is obtained, and determining a target storage unit for responding to the data operation request, includes:

Determining screening conditions for a plurality of dimensions characterizing the states of the respective storage units;

Sorting each storage unit according to the screening condition of at least one dimension, and obtaining a sorting result;

A target storage unit for responding to the data operation request is determined based on the sort result.

In the foregoing solution, the storing, according to the screening condition of the at least one dimension, sorting the storage units to obtain a sorting result, including:

The storage units are sorted according to the acquired load values of the storage units, or the remaining write life values of the storage units, or the expected response time of the data operations by the storage units, to obtain a sort result.

The screening condition of each dimension corresponds to a weighting value, and the score for characterizing the state of each storage unit is calculated according to the screening condition and the weighting value corresponding to each screening condition;

Correspondingly, the determining, according to the sorting result, the target storage unit for responding to the data operation request comprises:

Determine the storage unit with the highest score as the target storage unit.

An embodiment of the present disclosure further provides an electronic device, including:

a processor, configured to acquire a state of each storage unit in the electronic device, analyze a state of each acquired storage unit according to a data operation request, and determine a target storage unit for responding to the data operation request;

And a transceiver, configured to receive a data operation request from the program, send a data operation request to the target storage unit for processing, and return an operation processing result to the program.

In the foregoing solution, the processor is specifically configured to periodically detect a state of each storage unit;

Querying the status of each storage unit in the storage area.

In the above solution, the processor is specifically configured to determine a screening condition of multiple dimensions that characterize states of the storage units;

In the above solution, the processor is specifically configured to: according to the acquired load value of each storage unit, or a remaining write lifetime value of each storage unit, or an expected response time of each storage unit to the data operation, The storage units are sorted to obtain a sort result.

In the above solution, the screening condition of each dimension corresponds to a weighting value, and the processor is specifically configured to calculate a score for characterizing the state of each storage unit according to the screening condition and the weighting value corresponding to each screening condition;

Determine the storage unit with the highest score as the target storage unit.

Another aspect of the disclosure provides a computer program comprising computer executable instructions that, when executed, are used to implement a method as described above.

In the embodiment of the present disclosure, the electronic device acquires the state of each storage unit of its own, and analyzes the acquired state of each storage unit according to the received data operation request, and determines a target storage unit for responding to the data operation request. In this way, by determining the target storage unit for responding to the data operation request according to the state of each storage unit before processing the data operation request, not only the overhead of calculating the resource generated by the SSD controller but also the balance of each storage unit is avoided. load.

DRAWINGS

1 is a schematic flowchart of processing of a data processing method according to an embodiment of the present disclosure;

2 is a schematic flowchart of processing of another data processing method according to an embodiment of the present disclosure;

FIG. 3 is a schematic diagram of determining a target storage unit according to a usage rate of a CPU according to an embodiment of the present disclosure;

4 is a schematic flowchart of processing of another data processing method according to an embodiment of the present disclosure;

FIG. 5 is a schematic flowchart of processing of another data processing method according to an embodiment of the present disclosure;

FIG. 6 is a schematic flowchart of processing of another data processing method according to an embodiment of the present disclosure;

FIG. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure.

Detailed ways

Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. It should be understood, however, that the description is only illustrative, and is not intended to limit the scope of the disclosure. In addition, descriptions of well-known structures and techniques are omitted in the following description in order to avoid unnecessarily obscuring the concept of the present disclosure.

The terminology used herein is for the purpose of describing the particular embodiments, The use of the terms "comprising", "comprising" or "an"

All terms (including technical and scientific terms) used herein have the meaning commonly understood by one of ordinary skill in the art, unless otherwise defined. It should be noted that the terms used herein are to be interpreted as having a meaning consistent with the context of the present specification and should not be interpreted in an ideal or too rigid manner.

Where an expression similar to "at least one of A, B, and C, etc." is used, it should generally be interpreted in accordance with the meaning of the expression as commonly understood by those skilled in the art (for example, "having A, B, and C" "Systems of at least one of" shall include, but are not limited to, systems having A alone, B alone, C alone, A and B, A and C, B and C, and/or A, B, C, etc. ). Using a table similar to "at least one of A, B, or C, etc." In the case of the description, it should be generally explained in accordance with the meaning of the expression as generally understood by those skilled in the art (for example, "a system having at least one of A, B or C" should include, but is not limited to, having A alone, alone B, having C alone, having A and B, having A and C, having B and C, and/or having A, B, C, etc.). Those skilled in the art will also appreciate that transitional conjunctions and/or phrases that are arbitrarily arbitrarily representing two or more optional items, whether in the specification, claims, or drawings, are to be construed as The possibility of one of the projects, either or both of these projects. For example, the phrase "A or B" should be understood to include the possibility of "A" or "B", or "A and B."

Some block diagrams and/or flowcharts are shown in the drawings. It will be understood that some blocks or combinations of the block diagrams and/or flowcharts can be implemented by computer program instructions. These computer program instructions may be provided to a general purpose computer, a special purpose computer or a processor of other programmable data processing apparatus such that when executed by the processor, the instructions may be used to implement the functions illustrated in the block diagrams and/or flowcharts. / operating device.

Thus, the techniques of this disclosure may be implemented in the form of hardware and/or software (including firmware, microcode, etc.). Additionally, the techniques of this disclosure may take the form of a computer program product on a computer readable medium storing instructions for use by or in connection with an instruction execution system. In the context of the present disclosure, a computer readable medium can be any medium that can contain, store, communicate, propagate or transport the instructions. For example, a computer readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, device, or propagation medium. Specific examples of the computer readable medium include: a magnetic storage device such as a magnetic tape or a hard disk (HDD); an optical storage device such as a compact disk (CD-ROM); a memory such as a random access memory (RAM) or a flash memory; and/or a wired /Wireless communication link. The embodiment of the present disclosure provides a data processing method. FIG. 1 is a schematic flowchart of a data processing method according to an embodiment of the present disclosure. As shown in FIG. 1, the method includes the following steps:

Step S101: Acquire a state of each storage unit in the electronic device.

Specifically, the electronic device periodically detects the state of each storage unit, stores the state of each storage unit to a storage area of the electronic device, and queries the storage area for the state of each storage unit.

Here, the period for detecting the state of each storage unit can be flexibly set according to requirements; the storage area storing the state of each storage unit can also be flexibly set according to the attributes of the electronic device; for example, to reduce the consumption of SSD read and write resources. The state of each storage unit may be stored to a reserved byte in the SSD read/write protocol; or the state of each storage unit may be stored in a preset cache area or the like.

The electronic device internally includes one or more storage units that acquire the state of each storage unit when the electronic device includes a plurality of storage units; the storage unit is an SSD, or other type of storage medium.

The state of the storage unit includes at least: a load value of the storage unit, a remaining write life value of the storage unit, and an expected response time of the storage unit to the data operation.

Step S102, receiving a data operation request from a program;

Specifically, the electronic device receives a data operation request from the program;

Here, the program is a program installed on the electronic device; the data operation request may be a request sent by a user clicking an application or function that triggers the program.

Step S103, analyzing the acquired state of each storage unit according to the data operation request, and determining a target storage unit for responding to the data operation request;

Specifically, the electronic device determines a screening condition that identifies a plurality of dimensions of the states of the storage units; sorts the storage units according to the screening conditions of the at least one dimension to obtain a sorting result; and determines, according to the sorting result, the response The target storage unit of the data operation request.

Here, the screening conditions include: a load value of the storage unit, a remaining write life value of the storage unit, and an expected response time of the storage unit to the data operation.

The load value of the storage unit includes: a central processing unit (CPU) usage rate of the storage unit, a continuous working time of the storage unit, a temperature of the storage unit, a read/write status of the storage unit, and the like.

Step S104, sending the data operation request to the target storage unit for processing, and returning an operation processing result to the program;

Specifically, the electronic device sends the data operation request to the target storage unit for processing, and returns an operation processing result to the program;

Here, the operation processing result is that the data operation request of the program is being processed by the pointer; for example, when the data operation request is write data, the corresponding operation processing result is that the data is being written; the data operation request is When the data is read, the corresponding operation result is that the data is being read.

The embodiment of the present disclosure further provides a data processing method. FIG. 2 is a schematic diagram of a processing flow of another data processing method according to an embodiment of the present disclosure. As shown in FIG. 2, the method includes the following steps:

Step S201, the electronic device periodically detects the state of each storage unit, and stores the state of each storage unit.

The state of the storage unit includes: a load value of the storage unit, a remaining write life value of the storage unit, and an expected response time of the storage unit to the data operation.

When the state of the storage unit is stored in advance in the storage area, after detecting the state of the storage unit, the state of the storage unit already stored in the storage area is updated; when the state of the storage unit is not stored in the storage area, detecting After the state of the storage unit, the state of the storage unit is increased within the storage area.

Step S202, the electronic device receives a data operation request from the program;

Here, the program is a program installed on the electronic device; the data operation request may be sent by a user clicking an application or function corresponding to triggering the program.

Step S203, analyzing a load value of each storage unit according to the data operation request, and determining a target storage unit for responding to the data operation request;

Specifically, the electronic device analyzes the load value of each storage unit according to the data operation request; the parameter used to represent the load value of the storage unit includes: a usage rate of the storage unit CPU, a continuous working time of the storage unit, a temperature of the storage unit, Read and write status of the storage unit, etc.;

Therefore, when analyzing the load value of each storage unit, the storage unit load value can be characterized by one of the above parameters or in combination with the above plurality of parameters.

When the load value of the storage unit is used to represent the load value of the storage unit, the usage rate of each storage unit CPU is sorted to obtain a sort result; and the storage unit with the lowest CPU usage in the sort result is determined to be used for response. The target storage unit of the data operation request. FIG. 3 is a schematic diagram of determining a target storage unit according to a usage rate of a CPU according to an embodiment of the present disclosure. As shown in FIG. 3, when an application sends a data operation request, the usage rates of the CPUs of the four SSDs acquired by the electronic device are respectively 43%, 21%, 86%, and 13%; therefore, the SSD that determines the CPU usage rate of 13% is the target storage unit for responding to data operation requests sent by the application.

When the load value of the storage unit is used to characterize the load value of the storage unit, determining that the storage unit in the non-read-write state is the target storage unit for responding to the data operation request; in the storage unit in the non-read-write state When the number is plural, a storage unit in a non-read-write state may be arbitrarily selected as a target storage unit for responding to the data operation request; or a target for responding to the data operation request may be determined according to parameters of other dimensions. Storage unit.

When the load value of the storage unit is characterized by the continuous working time of the storage unit, the continuous working time of each storage unit is sorted to obtain a sorting result; and the storage unit with the shortest continuous working time in the sorting result is determined to be used for the response The target storage unit of the data operation request.

Step S204, sending the data operation request to the target storage unit for processing, and returning an operation processing result to the program;

Here, the result of the operation processing is that a data operation request for the program is being processed by the pointer; for example, the data operation When the request is to write data, the corresponding operation processing result is that data is being written; when the data operation request is read data, the corresponding operation processing result is reading data.

Step S205, the target storage unit responds to the data operation request;

Specifically, the target storage unit performs corresponding operations on the data, such as reading data or writing data, in response to the data operation request.

The embodiment of the present disclosure further provides a data processing method. FIG. 4 is a schematic diagram of a processing flow of another data processing method according to an embodiment of the present disclosure. As shown in FIG. 4, the method includes the following steps:

Step S301, the electronic device periodically detects the state of each storage unit, and stores the state of each storage unit.

Step S302, the electronic device receives a data operation request from the program;

Step S303, analyzing a remaining write lifetime value of each storage unit according to the data operation request, and determining a target storage unit for responding to the data operation request;

Specifically, the electronic device sorts the storage units according to the remaining write lifetime values of the storage units to obtain a sort result; and determines that the storage unit with the largest write lifetime value in the sort result is used for response. The target storage unit of the data operation request.

Step S304, the data operation request is sent to the target storage unit for processing, and the operation processing result is returned to the program.

Step S305, the target storage unit responds to the data operation request;

The embodiment of the present disclosure further provides a data processing method. FIG. 5 is a schematic diagram of a processing flow of another data processing method according to an embodiment of the present disclosure. As shown in FIG. 5, the method includes the following steps:

Step S401, the electronic device periodically detects the state of each storage unit and stores the state of each storage unit.

Step S402, the electronic device receives a data operation request from the program;

Step S403, analyzing an expected response time of each storage unit for the data operation according to the data operation request, and determining a target storage unit for responding to the data operation request;

Specifically, the electronic device determines, according to the data operation request, a tolerance delay time of the program to respond to the data operation request; and sorts an expected response time of each data unit for the data operation to obtain a sort result; and determines the sorting The storage unit with the shortest expected response time for the data operation in the result is the target storage unit for responding to the data operation request, or the expected response time for the data operation in the sort result is less than any of the tolerance delay times. A storage unit is a target storage unit for responding to the data operation request.

Step S404, sending the data operation request to the target storage unit for processing, and returning to the program Operation processing results.

Step S405, the target storage unit responds to the data operation request;

The embodiment of the present disclosure further provides a data processing method. FIG. 6 is a schematic diagram of a processing flow of another data processing method according to an embodiment of the present disclosure. As shown in FIG. 6, the method includes the following steps:

Step S501, the electronic device periodically detects the state of each storage unit and stores the state of each storage unit.

Here, the period for detecting the state of each storage unit can be flexibly set according to requirements; the storage area storing the state of each storage unit can also be flexibly set according to the attributes of the electronic device; for example, to reduce the consumption of SSD read and write resources. And storing the state of each storage unit to a reserved byte in the SSD read/write protocol; or storing the state of each storage unit to a preset cache area or the like.

Step S502, the electronic device receives a data operation request from the program;

Step S503, sorting each storage unit according to the screening condition of multiple dimensions, and obtaining a sorting result;

In a specific implementation, the screening condition of each dimension corresponds to a weighting value, and the electronic device calculates a score for characterizing the state of each storage unit according to the screening condition and the weighting value corresponding to each screening condition; determining the storage unit with the highest score as the target Storage unit.

For example, the filtering condition is the load value a of the storage unit, the corresponding weighting value is A, the filtering condition is the remaining writing lifetime value b of the storage unit, and the corresponding weighting value is B, and the filtering condition is that the storage unit operates on the data. Estimated response time _c , the corresponding weighting value is C; then, the score S=a*A+b*B+c*C characterizing the state of the storage unit; the storage unit determining the highest score S is used to respond to the data operation request Target storage unit.

In another specific implementation, the target storage unit may be determined according to the screening condition of any two dimensions; specifically, when the data operation request is a read operation request, first determining to store the read operation according to the data operation request a storage unit of the corresponding data as a candidate storage unit; and sorting the candidate storage units according to a load value of the storage unit, or a remaining write lifetime value, or an expected response time of the data operation, and determining according to the sorting result A target storage unit for responding to the data operation request.

In another embodiment, when the data operation request is a write operation request, first determining a read/write state of each storage unit, selecting a storage unit in a non-read-write state as a candidate storage unit; The candidate storage unit is sorted by the load value, or the remaining write life value, or the expected response time for the data operation, and the target storage unit for responding to the data operation request is determined based on the sort result.

The above is only two embodiments for determining the target storage unit according to the screening conditions of the two dimensions. In a specific embodiment, the response may be determined according to the data operation request and the screening condition of any two or more dimensions. The target storage unit for the data operation request.

Step S504, the data operation request is sent to the target storage unit for processing, and the operation processing result is returned to the program.

Step S505, the target storage unit responds to the data operation request;

It should be noted that the foregoing embodiments of the present disclosure exemplarily list the screening conditions for characterizing the multiple dimensions of the state of each storage unit; however, in actual application, it is not limited to the above filtering conditions, and any characterization storage The parameters or indicators of the unit state are applicable to the embodiments of the present disclosure.

The embodiment of the present disclosure further provides an electronic device, and FIG. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure. As shown in FIG. 7, the processor 11 and the transceiver are included. 12 and a storage unit 13; wherein

The processor 11 is configured to acquire a state of each storage unit in the electronic device, analyze a state of each acquired storage unit according to a data operation request, and determine a target storage unit for responding to the data operation request.

among them. The state of the storage unit includes at least: a load value of the storage unit, a remaining write life value of the storage unit, and an expected response time of the storage unit to the data operation.

The load value of the storage unit further includes: a CPU usage rate of the storage unit, a continuous working time of the storage unit, a temperature of the storage unit, a read/write status of the storage unit, and the like.

The transceiver 12 is configured to receive a data operation request from a program, send a data operation request to the target storage unit for processing, and return an operation processing result to the program.

In the above solution, the processor 11 is specifically configured to periodically detect the status of each storage unit.

Querying the status of each storage unit in the storage area.

In the above solution, the processor 11 is specifically configured to determine a screening condition of multiple dimensions that characterize states of the storage units;

In the above solution, the processor 11 is specifically configured to: according to the acquired load value of each storage unit, or the remaining write life value of each storage unit, or the expected response time of each storage unit to the data operation, Sorting the storage units to obtain a sort result.

In the above solution, the filtering condition of each dimension corresponds to a weighting value, and the processor 11 is specifically configured to calculate a score for characterizing the state of each storage unit according to the screening condition and the weighting value corresponding to each screening condition;

Determine the storage unit with the highest score as the target storage unit.

It should be noted that the functions performed by the processor 11 and the transceiver 12 in the electronic device in the embodiment of the present disclosure may be implemented by a CPU, an microprocessor (MPU), or a digital signal processor (DSP) on the electronic device. Or a programmable gate array (FPGA) implementation. A person skilled in the art can understand that all or part of the steps of implementing the above method embodiments may be completed by using hardware related to the program instructions. The foregoing program may be stored in a computer readable storage unit, and the program is executed when executed. The foregoing storage unit includes: SSD, mobile storage device, read-only memory (ROM), random access memory (RAM), disk or optical disk, and the like. A variety of media that can store program code.

Alternatively, the above-described integrated unit of the present disclosure may be stored in a computer readable storage unit if it is implemented in the form of a software function module and sold or used as a standalone product. Based on such understanding, the technical solution of the embodiments of the present disclosure may be embodied in the form of a software product in essence or in the form of a software product, which is stored in a storage unit and includes a plurality of instructions. A computer device (which may be a personal computer, server, or network device, etc.) is caused to perform all or part of the methods described in various embodiments of the present disclosure. The foregoing storage unit includes: a removable storage device, a ROM, a RAM, a magnetic disk, or an optical disk, and the like, which can store program codes.

The above is only the specific embodiment of the present disclosure, but the scope of the present disclosure is not limited thereto, and any person skilled in the art can easily think of changes or substitutions within the technical scope of the disclosure. It should be covered within the scope of protection of the present disclosure. Therefore, the scope of protection of the present disclosure should be determined by the scope of the claims.

Claims

A data processing method, comprising:

Obtaining a status of each storage unit in the electronic device;

Receiving a data operation request from a program;

Determining, according to the data operation request, the acquired state of each storage unit, determining a target storage unit for responding to the data operation request;

The data operation request is sent to the target storage unit for processing, and the operation processing result is returned to the program.
The method of claim 1, wherein the obtaining the status of each storage unit in the electronic device comprises:

Timingly detecting the status of each storage unit;

Storing the state of each of the storage units to a storage area of the electronic device;

Querying the status of each storage unit in the storage area.
The method of claim 1, wherein the analyzing the status of each of the acquired storage units according to the data operation request, and determining a target storage unit for responding to the data operation request comprises:

Determining screening conditions for a plurality of dimensions characterizing the states of the respective storage units;

Sorting each storage unit according to a filter condition of at least one dimension to obtain a sort result;

A target storage unit for responding to the data operation request is determined based on the sort result.
The method according to claim 3, wherein the sorting each storage unit according to the screening condition of at least one dimension to obtain a sorting result comprises:

The storage units are sorted according to the acquired load values of the storage units, or the remaining write life values of the storage units, or the expected response time of the data operations by the storage units, to obtain a sort result.
The method of claim 3 wherein:

And sorting the storage units according to the screening condition of the at least one dimension, and obtaining the sorting result, including: the filtering condition of each dimension corresponds to a weighting value, and is used for characterizing each storage according to the screening condition and the weighting value corresponding to each screening condition. The score of the unit status;

The determining, according to the sorting result, the target storage unit for responding to the data operation request comprises: determining that the storage unit with the highest score is the target storage unit.
An electronic device comprising:

a processor, configured to acquire a state of each storage unit in the electronic device, analyze a state of each acquired storage unit according to a data operation request, and determine a target storage unit for responding to the data operation request;

And a transceiver, configured to receive the data operation request from the program, send the data operation request to the target storage unit for processing, and return an operation processing result to the program.
The electronic device according to claim 6, wherein the processor is specifically configured to periodically detect a state of each storage unit;

Storing the state of each of the storage units to a storage area of the electronic device;

Querying the status of each storage unit in the storage area.
The electronic device according to claim 6, wherein the processor is specifically configured to determine a screening condition of a plurality of dimensions that characterize states of the storage units;

Sorting each storage unit according to a filter condition of at least one dimension to obtain a sort result;

A target storage unit for responding to the data operation request is determined based on the sort result.
The electronic device according to claim 8, wherein the processor is specifically configured to: according to the acquired load value of each storage unit, or a remaining write life value of each storage unit, or each storage unit pair The estimated response time of the data operation, sorting the storage units to obtain a sort result.
The electronic device according to claim 8, wherein the filter condition of each dimension corresponds to a weighting value, and the processor is configured to calculate a state of each storage unit according to a filter condition and a weighting value corresponding to each filter condition. Rating; and

Determine the storage unit with the highest score as the target storage unit.