CN115168413A

CN115168413A - Data processing method and device

Info

Publication number: CN115168413A
Application number: CN202210535801.2A
Authority: CN
Inventors: 杨晔辉
Original assignee: Alibaba China Co Ltd
Current assignee: Alibaba China Co Ltd
Priority date: 2022-05-17
Filing date: 2022-05-17
Publication date: 2022-10-11

Abstract

The embodiment of the specification provides a data processing method and a data processing device, wherein the data processing method is applied to a processing terminal in a data storage system, and the data storage system comprises the processing terminal and a storage area; the method comprises the following steps: receiving a target data access instruction sent by a user, wherein the target data access instruction carries a data identifier of target data, and data processing is performed according to the actual data access condition of the user, so that the data processing efficiency is improved; judging whether the target data exist in the storage area or not based on the data identification of the target data; if not, determining a data processing rule corresponding to the target data and corresponding original data by using the data identifier of the target data; the original data are processed by using the data processing rule to generate target data, and data processing is performed by a processing terminal based on the data storage system, so that additional data processing service does not need to be set up and maintained, the waste of data processing resources is reduced, and the data processing efficiency is further improved.

Description

Data processing method and device

Technical Field

The embodiment of the specification relates to the technical field of computers, in particular to a data processing method.

Background

With the continuous development of computer technology, more and more computer technology is applied in the field of data processing. Data is a form of expression for a fact, concept, or instruction that may be processed by manual or automated means. The data may be in the form of numbers, text, pictures or sounds, etc. The basic purpose of data processing is to extract and derive valuable and meaningful data for certain specific people from a large amount of data which may be chaotic and difficult to understand, and the development of data processing technology and the breadth and depth of application, which extend throughout various fields of social production and social life, greatly influence the progress of human society.

At present, the original data is usually processed into result data in advance, and the obtained result data is stored, but processing the original data in advance requires a large amount of computing resources, which affects the efficiency of data processing. Therefore, an efficient data processing scheme is needed.

Disclosure of Invention

In view of this, the embodiments of the present specification provide a data processing method. One or more embodiments of the present specification also relate to a data processing apparatus, a computing device, a computer-readable storage medium, and a computer program, so as to solve the technical deficiencies of the prior art.

According to a first aspect of embodiments of the present specification, there is provided a data processing method, applied to a processing end in a data storage system, where the data storage system includes the processing end and a storage area; the method comprises the following steps:

receiving a target data access instruction sent by a user, wherein the target data access instruction carries a data identifier of target data;

judging whether the target data exists in the storage area or not based on the data identification of the target data;

if not, determining a data processing rule corresponding to the target data and corresponding original data by using the data identifier of the target data;

and processing the original data by using the data processing rule to generate target data.

Optionally, the step of determining, by using the data identifier of the target data, the data processing rule corresponding to the target data and the corresponding original data includes:

acquiring access characteristic information of a user aiming at target data;

and acquiring a data processing rule corresponding to the target data and corresponding original data according to the access characteristic information and the data identifier of the target data.

Optionally, the step of obtaining a data processing rule corresponding to the target data and corresponding original data according to the access characteristic information and the data identifier of the target data includes:

matching the access characteristic information with a preset processing grade to obtain a target processing grade corresponding to the access characteristic information;

and determining a data processing rule corresponding to the target data and corresponding original data according to the target processing level and the data identification of the target data.

Optionally, the target data comprises target video data, and the data processing rule comprises a data compression rule;

according to the access characteristic information and the data identification of the target data, acquiring a data processing rule corresponding to the target data and corresponding original data, wherein the step comprises the following steps:

and acquiring a data compression rule corresponding to the target video data and corresponding original data according to the access characteristic information and the data identifier of the target video data.

Optionally, the method further comprises:

under the condition that the data processing rule corresponding to the target data does not exist, sending a message that the data processing rule corresponding to the target data fails to acquire to the user;

and receiving a data processing rule aiming at the target data sent by the user.

Optionally, the method further comprises:

under the condition that original data corresponding to the target data does not exist, sending a message that the original data corresponding to the target data fails to be acquired to a user;

and receiving original data aiming at the target data sent by the user.

Optionally, after the step of processing the raw data by using the data processing rule to generate the target data, the method further includes:

and comparing the access characteristic information of the target data with a preset storage condition, and storing the target data into the storage area under the condition that the access characteristic information meets the preset storage condition.

According to a second aspect of the embodiments of the present specification, there is provided a data processing apparatus applied to a processing side in a data storage system, the data storage system including the processing side and a storage area; the device comprises:

the receiving module is configured to receive a target data access instruction sent by a user, wherein the target data access instruction carries a data identifier of target data;

the judging module is configured to judge whether the target data exist in the storage area or not based on the data identification of the target data;

the determining module is configured to determine a data processing rule corresponding to the target data and corresponding original data by using the data identifier of the target data if the target data is not the original data;

and the generating module is configured to process the original data by using the data processing rule to generate target data.

Optionally, the determining module is further configured to obtain access characteristic information of the user for the target data; and acquiring a data processing rule corresponding to the target data and corresponding original data according to the access characteristic information and the data identifier of the target data.

Optionally, the determining module is further configured to match the access characteristic information with a preset processing level, and obtain a target processing level corresponding to the access characteristic information; and determining a data processing rule corresponding to the target data and corresponding original data according to the target processing grade and the data identifier of the target data.

Optionally, the target data comprises target video data, and the data processing rule comprises a data compression rule; and the determining module is further configured to obtain a data compression rule corresponding to the target video data and corresponding original data according to the access characteristic information and the data identifier of the target video data.

Optionally, the apparatus further comprises: the first receiving module is configured to send a message that the acquisition of the data processing rule corresponding to the target data fails to the user under the condition that the data processing rule corresponding to the target data does not exist; and receiving a data processing rule aiming at the target data sent by the user.

Optionally, the apparatus further comprises: the second receiving module is configured to send a message that the acquisition of the original data corresponding to the target data fails to the user under the condition that the original data corresponding to the target data does not exist; and receiving original data aiming at the target data sent by the user.

Optionally, the apparatus further comprises: and the storage module is configured to compare the access characteristic information of the target data with a preset storage condition, and store the target data in the storage area under the condition that the access characteristic information meets the preset storage condition.

According to a third aspect of embodiments herein, there is provided a computing device comprising:

a memory and a processor;

the memory is for storing computer-executable instructions, the processor is for executing the computer-executable instructions, the computer-executable instructions when executed by the processor implement the steps of:

According to a fourth aspect of embodiments herein, there is provided a computer-readable storage medium storing computer-executable instructions that, when executed by a processor, implement the steps of the data processing method described above.

According to a fifth aspect of embodiments herein, there is provided a computer program, wherein the computer program, when executed in a computer, causes the computer to perform the steps of the above-mentioned data processing method.

The data processing method provided by one embodiment of the present specification is applied to a processing terminal in a data storage system, where the data storage system includes the processing terminal and a storage area; the method comprises the following steps: receiving a target data access instruction sent by a user, wherein the target data access instruction carries a data identifier of target data, and data processing is performed according to the actual data access condition of the user, so that the data processing efficiency is improved; judging whether the target data exist in the storage area or not based on the data identification of the target data; if not, determining a data processing rule corresponding to the target data and corresponding original data by using the data identifier of the target data; the original data are processed by using the data processing rule to generate target data, and data processing is performed by a processing terminal based on the data storage system, so that additional data processing service does not need to be set up and maintained, the waste of data processing resources is reduced, and the data processing efficiency is further improved.

Drawings

FIG. 1 is a flow diagram of a data processing method provided in one embodiment of the present description;

FIG. 2 is a flow chart of a data processing method according to an embodiment of the present disclosure;

fig. 3 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present specification;

fig. 4 is a block diagram of a computing device according to an embodiment of the present disclosure.

Detailed Description

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present description. This description may be implemented in many ways other than those specifically set forth herein, and those skilled in the art will appreciate that the present description is susceptible to similar generalizations without departing from the scope of the description, and thus is not limited to the specific implementations disclosed below.

The terminology used in the description of the one or more embodiments is for the purpose of describing the particular embodiments only and is not intended to be limiting of the description of the one or more embodiments. As used in one or more embodiments of the present specification and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used in one or more embodiments of the present specification refers to and encompasses any and all possible combinations of one or more of the associated listed items.

It should be understood that although the terms first, second, etc. may be used herein in one or more embodiments to describe various information, these information should not be limited by these terms. These terms are only used to distinguish one type of information from another. For example, a first can be termed a second and, similarly, a second can be termed a first without departing from the scope of one or more embodiments of the present description. The word "if" as used herein may be interpreted as "at" \8230; "or" when 8230; \8230; "or" in response to a determination ", depending on the context.

First, the noun terms to which one or more embodiments of the present specification relate are explained.

A storage system: the system or service is used for storing user data, and the user can store, modify and read the stored data by the storage system.

Raw data: the initial data obtained in the user project scenario is typically processed in some way to gain further use according to the needs of the user project.

Target data: it is also understood that the result data, the target data being data required in the user project scenario, is typically obtained from raw data through some processing.

The treatment process comprises the following steps: some set of calculation methods, which convert the user's original data into target data through processing

Processing rules: the processing procedures are defined, and the description is used for converting the original data which needs to be processed into the required target data for the specific result data.

In the present specification, a data processing method is provided, and the present specification relates to a data processing apparatus, a computing device, and a computer-readable storage medium, which are described in detail one by one in the following embodiments.

With the continuous development of computer technology, more and more computer technology is applied in the data processing field. Data is a form of expression for facts, concepts, or instructions that may be processed by human or automated means. The data may be in the form of numbers, text, pictures, or sounds. The basic purpose of data processing is to extract and derive valuable and meaningful data for certain specific people from a large amount of data which may be chaotic and difficult to understand, and the development of data processing technology and the breadth and depth of application, which extend throughout various fields of social production and social life, greatly influence the progress of human society.

In practical applications, for a user, the original data is usually stored in a storage system, and then processed according to the service requirement of the user, and the processing result is also stored in the storage system. And accessing the storage system when the result data is needed to be used, and reading the use processing result. However, in many industries, not all raw data need to be used, and the conventional structure may result in a large amount of raw data which does not need to be used being calculated as target data in advance, resulting in waste of computing resources. Therefore, an efficient data processing scheme is needed.

In order to improve data processing efficiency, the present specification provides a data processing method, which is applied to a processing end in a data storage system, wherein the data storage system comprises the processing end and a storage area; receiving a target data access instruction sent by a user, wherein the target data access instruction carries a data identifier of target data; judging whether the target data exists in the storage area or not based on the data identification of the target data; if not, determining a data processing rule corresponding to the target data and corresponding original data by using the data identifier of the target data; and processing the original data by using the data processing rule to generate target data. The data processing method has the advantages that the using habit of a user does not need to be changed, the user does not need to process original data in advance, the result data are directly read in an original mode, when the result data do not exist, the data storage system automatically processes the original data into target data according to the pre-stored data processing rules in real time and returns the target data to the user, the data using process of the user is simplified, meanwhile, the data are processed according to the using requirement of the user, the computing cost of the user for processing the data and the storage cost of the result data can be reduced, in addition, the data processing is carried out on the basis of a processing end in the data storage system, the additional establishment of data processing service is not needed, the waste of data processing resources is reduced, and the data processing efficiency is further improved.

Referring to fig. 1, fig. 1 shows a flowchart of a data processing method provided in an embodiment of the present specification, where the data processing method is applied to a processing end in a data storage system, where the data storage system includes the processing end and a storage area, and specifically includes the following steps:

step 102: and receiving a target data access instruction sent by a user, wherein the target data access instruction carries a data identifier of target data.

In the embodiment of the present description, in order to process data according to the needs of users, and reduce the calculation cost of the users for processing data and the storage cost of result data, a processing end in a data storage system may receive a target data access instruction sent by a user, where the target data access instruction carries a data identifier of target data, and the processing end processes data actually needed by the user based on the target data access instruction sent by the user.

Specifically, the target data refers to data that a user needs to use in a work scenario, and the access instruction of the target data refers to an instruction for accessing the target data, which may be an input instruction or a click instruction, and is specifically selected according to an actual situation, which is not limited in this embodiment of the present specification. The data identifier of the target data refers to a unique identifier of the data, and the target data can be located through the data identifier of the target data, wherein the data identifier of the target data includes but is not limited to a data number of the target data, and is specifically selected according to an actual situation, which is not limited in this embodiment of the specification.

In practical applications, there are various ways for a user to send a target data access instruction, which are specifically selected according to actual situations, and this is not limited in this embodiment of the present specification.

In one possible implementation manner, the data storage system may provide a target data input interface for a user, and the user may input a data identifier of target data on the target data input interface, so that a processing end in the data storage system acquires the target data based on the data identifier of the target data.

In another possible implementation manner, the data storage system may show the data identifier of each data stored in the storage area to a user, and the user may select the data identifier of the target data in a display interface of the data storage system, so that the processing end in the data storage system obtains the target data based on the data identifier of the target data.

Step 104: and judging whether the target data exists in the storage area or not based on the data identification of the target data.

In this embodiment, after receiving the data identifier of the target data, the processing end in the data storage system may determine whether the target data exists in the storage area based on the data identifier of the target data, and in a case that the target data exists in the storage area, the processing end may directly obtain the target data and feed the target data back to the user.

In practical application, the target data can be directly searched in the storage area according to the data identifier of the target data, and whether the target data exists in the storage area or not is further judged.

Illustratively, as shown in table 1 below, table 1 shows the correspondence between the data stored in the storage area and the data identifier. If the processing end in the data storage system obtains the data identifier of the target data as '003', searching the data identifier '003' of the target data in the storage area according to the data identifier of the target data, and obtaining the target data as 'data C'; if the processing end in the data storage system obtains the data identifier of the target data as '006', the data identifier of the target data as '006' is searched in the storage area according to the data identifier of the target data, and under the condition that the query fails, the target data with the data identifier of '006' does not exist in the storage area.

TABLE 1

Data identification	Data stored in the storage area
		001	Data A
002	Data B
		003	Data C
004	Data D

Step 106: if not, determining a data processing rule corresponding to the target data and corresponding original data by using the data identifier of the target data.

In this embodiment of the present description, a processing end in a data storage system may receive a target data access instruction, which is sent by a user and carries a data identifier of target data, determine whether the target data exists in a storage area based on the data identifier of the target data, and if the target data does not exist in the storage area, obtain a data processing rule corresponding to the target data and generate original data of the target data based on the data identifier of the target data, so as to further generate the target data.

In practical application, after the processing end in the data storage system judges that the target data does not exist in the storage area, whether a data processing rule corresponding to the target data exists in the data storage system or not can be judged based on the data identifier of the target data, and data processing is further performed.

In an embodiment of this specification, if the data storage system does not have the data processing rule corresponding to the target data, a message that the data processing rule corresponding to the target data fails to be obtained is sent to the user.

Illustratively, as shown in table 2 below, table 2 shows the correspondence of the data processing rule to the data identification. If the processing end in the data storage system obtains the data identifier '006' of the target data, searching a data processing rule corresponding to the data identifier '006' in the data storage system according to the data identifier '006' of the target data, determining that the data processing rule corresponding to the data identifier '006' does not exist under the condition that the query fails, and sending a message that the data processing rule corresponding to the target data fails to obtain to the user.

TABLE 2

Data identification	Data processing rules
		001	Data processing rule A
002	Data processing rule B
		003	Data processing rule C
004	Data processing rule D
		005	Data processing rules E

Further, under the condition that the data processing rule corresponding to the target data sent to the user fails to be obtained, the data processing rule for the target data sent by the user may also be received, so that the processing end obtains the target data according to the data processing rule sent by the user, that is, the method may further include the following steps:

In an embodiment of the present specification, a target data access instruction sent by a user is received, where the target data access instruction carries a data identifier of target data, and after determining whether target data exists in a storage area based on the data identifier of the target data, and in the absence of a data processing rule corresponding to the target data, a message that data processing rule corresponding to the target data fails to be obtained is sent to the user, and the data processing rule for the target data sent by the user is received.

It should be noted that there are various ways of sending the message that the data processing rule corresponding to the target data fails to be obtained to the user, and the way is specifically selected according to the actual situation, which is not limited in this embodiment of the present specification.

In a possible implementation manner, a message that the data processing rule corresponding to the target data fails to be acquired may be sent to the user in a popup format on a presentation interface of the data processing system.

Illustratively, in the case that there is no data processing rule corresponding to the target data, a popup window of 10 cm × 15 cm is displayed in the center of the interface of the data processing system, and "the data processing rule corresponding to the target data does not exist" is displayed in the popup window.

In another possible implementation manner, a voice prompt may be made to indicate that the data processing rule corresponding to the target data of the user fails to be obtained.

In practical application, after prompting that the data processing rule corresponding to the target data fails to be acquired, the user can be actively prompted to input the data processing rule corresponding to the target data.

Illustratively, in the case that there is no data processing rule corresponding to the target data, a popup window of 10 cm × 15 cm is displayed in the center of the interface of the data processing system, and "there is no data processing rule corresponding to the target data, please input the data processing rule corresponding to the target data" is displayed in the popup window.

By applying the scheme of the embodiment of the specification, under the condition that the data processing rule corresponding to the target data does not exist, the message that the data processing rule corresponding to the target data fails to be acquired is sent to the user, and the data processing rule aiming at the target data sent by the user is received, so that the data processing rule sent by the user can be used for processing, the target data is acquired, and the user experience is further improved.

In another embodiment of this specification, if a data processing rule corresponding to target data exists in the data storage system, it is determined whether original data corresponding to the target data exists in the data storage system, and the data processing is further performed.

And if the original data corresponding to the target data does not exist in the data storage system, sending a message that the original data corresponding to the target data fails to be acquired to the user.

Illustratively, as shown in table 3 below, table 3 shows the correspondence of the original data to the data identification. If the processing end in the data storage system obtains the data identifier "006" of the target data, according to the data identifier "006" of the target data, original data corresponding to the data identifier "006" is searched in the data storage system, and under the condition that the query fails, it is determined that the original data with the data identifier "006" does not exist, and a message that the original data corresponding to the target data fails to be obtained is sent to a user.

TABLE 3

Data identification	Raw data
		001	Raw data A
002	Original data B
		003	Raw data C
004	Original data D
		005	Original data E

Further, in a case that the original data corresponding to the target data sent to the user fails to be obtained, the original data sent by the user for the target data may also be received, so that the processing end obtains the target data according to the original data sent by the user, that is, the method may further include the following steps:

and receiving original data aiming at target data sent by a user.

In an embodiment of the present specification, a target data access instruction sent by a user is received, where the target data access instruction carries a data identifier of target data, and after it is determined, based on the data identifier of the target data, whether the target data exists in a storage area, and in a case that original data corresponding to the target data does not exist, a message that acquisition of the original data corresponding to the target data fails is sent to the user, and the original data sent by the user and specific to the target data is received.

It should be noted that there are various ways to send the message of the failure of obtaining the original data corresponding to the target data to the user, and the sending is specifically selected according to the actual situation, and this is not limited in this embodiment of the present specification.

In a possible implementation manner, a message that the original data corresponding to the target data fails to be acquired may be sent to the user in a popup window on a presentation interface of the data processing system.

Illustratively, in the case that there is no original data corresponding to the target data, a popup window of 10 cm × 15 cm is displayed in the center of the interface of the data processing system, and "the original data corresponding to the target data does not exist" is displayed in the popup window.

In another possible implementation manner, a user may be prompted by voice that the original data corresponding to the target data fails to be acquired.

In practical application, after prompting that the original data corresponding to the target data of the user fails to be acquired, the user can be actively prompted to input the original data corresponding to the target data.

Illustratively, in the case that there is no original data corresponding to the target data, a popup window of 10 cm × 15 cm is displayed in the center of the interface of the data processing system, and "there is no original data corresponding to the target data, please input the original data corresponding to the target data" is displayed in the popup window.

It should be noted that, if the data storage system has the data processing rule corresponding to the target data and the original data corresponding to the target data, the data processing rule corresponding to the target data and the original data corresponding to the target data are directly extracted.

By applying the scheme of the embodiment of the specification, under the condition that the original data corresponding to the target data does not exist, the message of the failure in acquiring the original data corresponding to the target data is sent to the user, and the original data aiming at the target data sent by the user is received, so that the original data sent by the user can be processed to obtain the target data, and the user experience degree is further improved.

In practical applications, when determining the data processing rule corresponding to the target data and the corresponding original data by using the data identifier of the target data, the step of obtaining the data processing rule corresponding to the target data and the corresponding original data according to the access characteristic information of the user for the target data and the data identifier of the target data, that is, determining the data processing rule corresponding to the target data and the corresponding original data by using the data identifier of the target data, may include the following steps:

acquiring access characteristic information of a user aiming at target data;

In the embodiment of the present specification, a target data access instruction sent by a user is received, where the target data access instruction carries a data identifier of target data, whether the target data exists in a storage area is determined based on the data identifier of the target data, if not, access characteristic information of the user for the target data is obtained, and a data processing rule corresponding to the target data and corresponding original data are obtained according to the access characteristic information and the data identifier of the target data.

Specifically, the access characteristic information of the target data refers to relevant information of the target data accessed in the data storage system, and may reflect characteristics such as an access mode and a state of the target data, where the access characteristic information of the target data includes, but is not limited to, the number of times, access time, an access mode, and an access state of a user for accessing the target data, and is specifically selected according to an actual situation, which is not limited in this embodiment of the specification.

Illustratively, the access times of the user for the target data are acquired, and the data processing rule corresponding to the target data and the corresponding original data are acquired according to the access times of the user for the target data and the data identifier of the target data.

By applying the scheme of the embodiment of the specification, the access characteristic information of the user for the target data is acquired, and the data processing rule corresponding to the target data and the corresponding original data are acquired according to the access characteristic information and the data identifier of the target data, so that all data do not need to be processed in advance, the data processing cost is reduced, and the user experience is further improved.

It should be noted that, after the access characteristic information of the target data is obtained, the access characteristic information may be matched with a preset data processing level to obtain a target processing level corresponding to the access characteristic, and further determine a data processing rule corresponding to the target data and corresponding raw data, that is, the step of obtaining the data processing rule corresponding to the target data and corresponding raw data according to the access characteristic information and a data identifier of the target data may include the following steps:

and determining a data processing rule corresponding to the target data and corresponding original data according to the target processing grade and the data identifier of the target data.

In the embodiment of the present specification, a target data access instruction sent by a user is received, where the target data access instruction carries a data identifier of target data, whether the target data exists in a storage area is judged based on the data identifier of the target data, if not, access characteristic information of the user for the target data is obtained, the access characteristic information is matched with a preset processing level, a target processing level corresponding to the access characteristic information is obtained, and a data processing rule corresponding to the target data and corresponding original data are determined according to the target processing level and the data identifier of the target data.

Specifically, the target processing level refers to a processing level corresponding to the target data, and the processing level refers to a level obtained by dividing the data processing rule and is set in advance, and is specifically selected according to an actual situation, which is not limited in this embodiment of the present specification.

Illustratively, a preset processing level table is obtained as shown in table 4 below, where table 4 shows a corresponding relationship between the access times and the processing levels of the target data, the access times of the user for the target data is obtained as 2 times, the processing level corresponding to the access times 2 is queried as "primary compression" in table 2, further, the data processing rule corresponding to the "primary compression" is obtained as "data processing rule A1", and the original data corresponding to the target data is obtained according to the data identifier of the target data.

TABLE 4

By applying the scheme of the embodiment of the specification, the access characteristic information is matched with the preset processing level to obtain the target processing level corresponding to the access characteristic information, and the data processing rule corresponding to the target data and the corresponding original data are determined according to the target processing level and the data identifier of the target data, so that the accuracy of the data processing rule and the original data is improved, the data processing cost is reduced, and the user experience is further improved.

In practical application, the target data may be target video data, the data processing rule may be a data compression rule, and after the access characteristic information of the user for the target video data is obtained, the data compression rule corresponding to the target video data and corresponding original data may be obtained according to the access characteristic information of the target video data and the data identifier of the target video data, that is, the step of obtaining the data processing rule corresponding to the target data and corresponding original data according to the access characteristic information and the data identifier of the target data may include the following steps:

Specifically, the target video data refers to video data that a user wants to view, and the data compression rule refers to a compression rule for each piece of video data, which is specifically selected according to an actual situation, which is not limited in this embodiment of the present specification.

It should be noted that, by compressing the target video data, the user bandwidth can be saved. Since the primary compression consumes less computing resources, but the compression result is larger, the consumed network bandwidth is also larger, and the advanced compression consumes more computing resources, but the compression result is smaller, and the consumed network bandwidth is also smaller, the target video data can be compressed according to the access characteristic information of the target video data.

Illustratively, the number of access times of the acquisition user to the target video data 1 is 20, the data identifier of the target video data 1 is 003, and based on the table 4, according to the number of access times of the target video data 1, the processing level of the target video data 1 is "primary compression", and the data processing rule of the target video data 1 is "data processing rule A1"; the number of times of access by the user to the target video data 2 is 200000, the data identification of the target video data 2 is 005, and based on the table 4, the processing level of the target video data 2 is "high-level compression" and the data processing rule of the target video data 2 is "data processing rule B1" according to the number of times of access to the target video data 2.

By applying the scheme of the embodiment of the specification, the data compression rule corresponding to the target video data and the corresponding original data are obtained according to the access characteristic information and the data identifier of the target video data, so that the cost of a user is reduced, and the user experience is further improved.

Step 108: and processing the original data by using the data processing rule to generate target data.

In the embodiment of the present specification, a target data access instruction sent by a user is received, where the target data access instruction carries a data identifier of target data, whether the target data exists in a storage area is determined based on the data identifier of the target data, if not, after a data processing rule corresponding to the target data and corresponding original data are determined by using the data identifier of the target data, the original data may be processed by using the data processing rule to generate target data, and the target data is fed back to the user.

By applying the scheme of the embodiment of the specification, the target data access instruction sent by the user is received, wherein the target data access instruction carries the data identifier of the target data, and the data processing is performed according to the actual data access condition of the user, so that the data processing efficiency is improved; judging whether the target data exists in the storage area or not based on the data identification of the target data; if not, determining a data processing rule corresponding to the target data and corresponding original data by using the data identifier of the target data; the data processing method comprises the steps of processing original data by using a data processing rule to generate target data, processing the data by a processing terminal based on a data storage system, avoiding the need of additionally constructing and maintaining data processing services, reducing the waste of data processing resources, further improving the data processing efficiency, directly accessing the target data without changing the behavior of accessing the target data by a user, and further improving the user experience without additionally modifying logic to request data processing services as required or batch processing services.

In practical applications, after the original data is processed by using the data processing rule to generate the target data, the storage manner of the target data may be determined according to the access characteristic information of the target data, and the target data is stored based on the storage manner of the target data, that is, after the step of processing the original data by using the data processing rule to generate the target data, the following steps may be further included:

and comparing the access characteristic information of the target data with a preset storage condition, and storing the target data into a storage area under the condition that the access characteristic information meets the preset storage condition.

Specifically, the preset storage condition refers to a preset condition for storing data in the data storage system, and is specifically selected according to an actual situation, which is not limited in this embodiment of the present specification.

Illustratively, the preset storage condition is acquired as the number of accesses being greater than 5000. The access frequency of the acquired target data 1 is 2000, and the processing end cannot store the target data 1 into a storage area in the data storage system because the access frequency of the target data 1 is smaller than a preset storage condition; the number of access times for acquiring the target data 2 is 9000, and since the number of access times of the target data 2 is greater than the preset storage condition, the processing end stores the target data 2 in the storage area in the data storage system.

By applying the scheme of the embodiment of the specification, the target data is stored in the storage area by comparing the access characteristic information of the target data with the preset storage condition under the condition that the access characteristic information meets the preset storage condition, so that the storage data amount of the storage area in the data storage system is reduced, and the data processing efficiency is further improved.

It should be noted that the data processing method provided in this specification is applied to data processing procedures in various scenarios, such as a communication scenario and a transaction scenario, and may also be applied to other scenarios, and the application scenario of the data processing method in this specification is not limited.

In the following, with reference to fig. 2, the data processing method provided in this specification is further described by taking an application of the data processing method in a video data processing scene as an example, where the data processing method is applied to a processing end in a data storage system, and the data storage system includes the processing end and a storage area. Fig. 2 shows a flow chart of a processing procedure of a data processing method provided in an embodiment of the present specification, which specifically includes the following steps:

step 202: and receiving a target video data access instruction sent by a user, wherein the target video data access instruction carries a data identifier of the target video data.

Step 204: and judging whether the target video data exists in the storage area or not based on the data identification of the target video data.

Step 206: and if so, feeding the target video data back to the user.

Step 208: if not, judging whether a data compression rule corresponding to the target video data exists in the storage area or not by using the data identifier of the target video data.

Step 210: and if not, feeding back the data compression rule corresponding to the target video data to the user, and failing to obtain the data compression rule.

Step 212: if so, judging whether the storage area has original video data corresponding to the target video data or not by using the data identifier of the target video data.

Step 214: and if not, feeding back the original video data corresponding to the target video data to the user to acquire failure.

Step 216: and if so, processing the original video data by using a data compression rule to generate target video data.

Step 218: and feeding back the target video data to the user.

By applying the scheme of the embodiment of the specification, a target video data access instruction sent by a user is received, wherein the target video data access instruction carries a data identifier of target video data, whether the target video data exist in a storage area is judged based on the data identifier of the target video data, if yes, the target video data is fed back to the user, if not, whether a data compression rule corresponding to the target video data exists in the storage area is judged by using the data identifier of the target video data, if not, a data compression rule corresponding to the target video data fails to be obtained is fed back to the user, if yes, the data compression rule corresponding to the target video data fails to be obtained, the data identifier of the target video data is used for judging whether the original video data corresponding to the target video data exists in the storage area, if not, the original video data corresponding to the target video data fails to be obtained is fed back to the user, the original video data is processed by using the data compression rule to generate the target video data, the target video data is fed back to the user, data processing is performed through a processing terminal in a data storage system, no additional data processing service is set up, waste of data processing resources is reduced, and data processing efficiency is further improved.

Corresponding to the above method embodiment, this specification further provides an embodiment of a data processing apparatus, and fig. 3 shows a schematic structural diagram of a data processing apparatus provided in an embodiment of this specification, where the data processing apparatus is applied to a processing end in a data storage system, and the data storage system includes the processing end and a storage area. As shown in fig. 3, the apparatus includes:

a receiving module 302, configured to receive a target data access instruction sent by a user, where the target data access instruction carries a data identifier of target data;

a judging module 304 configured to judge whether the target data exists in the storage area based on the data identification of the target data;

a determining module 306 configured to determine, if not, a data processing rule corresponding to the target data and corresponding original data by using the data identifier of the target data;

and a generating module 308 configured to process the raw data by using the data processing rule to generate target data.

Optionally, the determining module 306 is further configured to obtain access characteristic information of the user for the target data; and acquiring a data processing rule corresponding to the target data and corresponding original data according to the access characteristic information and the data identifier of the target data.

Optionally, the determining module 306 is further configured to match the access characteristic information with a preset processing level, and obtain a target processing level corresponding to the access characteristic information; and determining a data processing rule corresponding to the target data and corresponding original data according to the target processing grade and the data identifier of the target data.

Optionally, the target data comprises target video data, and the data processing rule comprises a data compression rule; the determining module 306 is further configured to obtain a data compression rule corresponding to the target video data and corresponding original data according to the access characteristic information and the data identifier of the target video data.

Optionally, the apparatus further comprises: the second receiving module is configured to send a message that the acquisition of the original data corresponding to the target data fails to the user under the condition that the original data corresponding to the target data does not exist; and receiving original data aiming at target data sent by a user.

By applying the scheme of the embodiment of the specification, a target data access instruction sent by a user is received, wherein the target data access instruction carries a data identifier of target data, and data processing is performed according to the actual data access condition of the user, so that the data processing efficiency is improved; judging whether the target data exist in the storage area or not based on the data identification of the target data; if not, determining a data processing rule corresponding to the target data and corresponding original data by using the data identifier of the target data; the original data are processed by using the data processing rule to generate target data, and data processing is performed based on a processing end in the data storage system, so that additional maintenance of data processing service is not required, the waste of data processing resources is reduced, and the data processing efficiency is further improved.

The above is a schematic configuration of a data processing apparatus of the present embodiment. It should be noted that the technical solution of the data processing apparatus belongs to the same concept as the technical solution of the data processing method, and for details that are not described in detail in the technical solution of the data processing apparatus, reference may be made to the description of the technical solution of the data processing method.

FIG. 4 illustrates a block diagram of a computing device 400 provided in accordance with one embodiment of the present description. The components of the computing device 400 include, but are not limited to, a memory 410 and a processor 420. Processor 420 is coupled to memory 410 via bus 430 and database 450 is used to store data.

Computing device 400 also includes access device 440, access device 440 enabling computing device 400 to communicate via one or more networks 460. Examples of such networks include a Public Switched Telephone Network (PSTN), a Local Area Network (LAN), a Wide Area Network (WAN), a Personal Area Network (PAN), or a combination of communication networks such as the internet. The Access device 440 may include one or more of any type of Network Interface (e.g., a Network Interface Card (NIC)) whether wired or Wireless, such as an IEEE802.11 Wireless Local Area Network (WLAN) Wireless Interface, a worldwide Interoperability for Microwave Access (Wi-MAX) Interface, an ethernet Interface, a Universal Serial Bus (USB) Interface, a cellular Network Interface, a bluetooth Interface, a Near Field Communication (NFC) Interface, and so forth.

In one embodiment of the present description, the above-described components of computing device 400, as well as other components not shown in FIG. 4, may also be connected to each other, such as by a bus. It should be understood that the block diagram of the computing device architecture shown in FIG. 4 is for purposes of example only and is not limiting as to the scope of the present description. Other components may be added or replaced as desired by those skilled in the art.

Computing device 400 may be any type of stationary or mobile computing device, including a mobile computer or mobile computing device (e.g., tablet, personal digital assistant, laptop, notebook, netbook, etc.), mobile phone (e.g., smartphone), wearable computing device (e.g., smartwatch, smartglasses, etc.), or other type of mobile device, or a stationary computing device such as a desktop computer or PC. Computing device 400 may also be a mobile or stationary server.

Wherein the processor 420 is configured to execute computer-executable instructions for executing the computer-executable instructions, which when executed by the processor, implement the steps of:

By applying the scheme of the embodiment of the specification, the target data access instruction sent by the user is received, wherein the target data access instruction carries the data identifier of the target data, and the data processing is performed according to the actual data access condition of the user, so that the data processing efficiency is improved; judging whether the target data exists in the storage area or not based on the data identification of the target data; if not, determining a data processing rule corresponding to the target data and corresponding original data by using the data identifier of the target data; the original data are processed by using the data processing rule to generate target data, and data processing is performed based on a processing end in the data storage system, so that additional maintenance of data processing service is not required, the waste of data processing resources is reduced, and the data processing efficiency is further improved.

The above is an illustrative scheme of a computing device of the present embodiment. It should be noted that the technical solution of the computing device and the technical solution of the data processing method belong to the same concept, and details that are not described in detail in the technical solution of the computing device can be referred to the description of the technical solution of the data processing method.

An embodiment of the present specification also provides a computer-readable storage medium storing computer-executable instructions that, when executed by a processor, perform the steps of:

judging whether the target data exist in the storage area or not based on the data identification of the target data;

By applying the scheme of the embodiment of the specification, the target data access instruction sent by the user is received, wherein the target data access instruction carries the data identifier of the target data, and the data processing is performed according to the actual data access condition of the user, so that the data processing efficiency is improved; judging whether the target data exist in the storage area or not based on the data identification of the target data; if not, determining a data processing rule corresponding to the target data and corresponding original data by using the data identifier of the target data; the original data are processed by using the data processing rule to generate target data, and data processing is performed by a processing terminal based on the data storage system, so that additional data processing service does not need to be set up and maintained, the waste of data processing resources is reduced, and the data processing efficiency is further improved.

The above is an illustrative scheme of a computer-readable storage medium of the present embodiment. It should be noted that the technical solution of the storage medium belongs to the same concept as the technical solution of the data processing method, and for details that are not described in detail in the technical solution of the storage medium, reference may be made to the description of the technical solution of the data processing method.

An embodiment of the present specification further provides a computer program, wherein when the computer program is executed in a computer, the computer program causes the computer to execute the following steps:

By applying the scheme of the embodiment of the specification, a target data access instruction sent by a user is received, wherein the target data access instruction carries a data identifier of target data, and data processing is performed according to the actual data access condition of the user, so that the data processing efficiency is improved; judging whether the target data exist in the storage area or not based on the data identification of the target data; if not, determining a data processing rule corresponding to the target data and corresponding original data by using the data identifier of the target data; the original data are processed by using the data processing rule to generate target data, and data processing is performed by a processing terminal based on the data storage system, so that additional data processing service does not need to be set up and maintained, the waste of data processing resources is reduced, and the data processing efficiency is further improved.

The above is a schematic scheme of a computer program of the present embodiment. It should be noted that the technical solution of the computer program and the technical solution of the data processing method belong to the same concept, and details that are not described in detail in the technical solution of the computer program can be referred to the description of the technical solution of the data processing method.

The foregoing description of specific embodiments has been presented for purposes of illustration and description. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.

The computer instructions comprise computer program code which may be in the form of source code, object code, an executable file or some intermediate form, or the like. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, U.S. disk, removable hard disk, magnetic diskette, optical disk, computer Memory, read-Only Memory (ROM), random Access Memory (RAM), electrical carrier wave signal, telecommunications signal, and software distribution medium, etc.

It should be noted that, for the sake of simplicity, the foregoing method embodiments are described as a series of combinations of acts, but it should be understood by those skilled in the art that the embodiments are not limited by the described order of acts, as some steps may be performed in other orders or simultaneously according to the embodiments. Further, those skilled in the art should also appreciate that the embodiments described in this specification are preferred embodiments and that acts and modules referred to are not necessarily required for an embodiment of the specification.

In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to the related descriptions of other embodiments.

The preferred embodiments of the present specification disclosed above are intended only to aid in the description of the specification. Alternative embodiments are not exhaustive and do not limit the invention to the precise embodiments described. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the embodiments and the practical application, and to thereby enable others skilled in the art to best understand the specification and utilize the specification. The specification is limited only by the claims and their full scope and equivalents.

Claims

1. A data processing method is applied to a processing terminal in a data storage system, wherein the data storage system comprises the processing terminal and a storage area; the method comprises the following steps:

receiving a target data access instruction sent by a user, wherein the target data access instruction carries a data identifier of the target data;

and processing the original data by using the data processing rule to generate the target data.

2. The method of claim 1, wherein the step of determining the data processing rule corresponding to the target data and the corresponding raw data by using the data identifier of the target data comprises:

acquiring access characteristic information of the user aiming at the target data;

3. The method according to claim 2, wherein the step of obtaining the data processing rule corresponding to the target data and the corresponding original data according to the access characteristic information and the data identifier of the target data comprises:

4. The method of claim 2, the target data comprising target video data, the data processing rules comprising data compression rules;

the step of obtaining the data processing rule corresponding to the target data and the corresponding original data according to the access characteristic information and the data identifier of the target data includes:

5. The method of claim 1, further comprising:

6. The method of claim 1, further comprising:

under the condition that the original data corresponding to the target data does not exist, sending a message that the original data corresponding to the target data fails to be acquired to the user;

and receiving original data which is sent by the user and aims at the target data.

7. The method of claim 2, further comprising, after the step of processing the raw data using the data processing rule to generate the target data:

8. A data processing device is applied to a processing end in a data storage system, and the data storage system comprises the processing end and a storage area; the device comprises:

the device comprises a receiving module, a processing module and a processing module, wherein the receiving module is configured to receive a target data access instruction sent by a user, and the target data access instruction carries a data identifier of the target data;

a judging module configured to judge whether the target data exists in the storage area based on the data identification of the target data;

a generating module configured to process the raw data by using the data processing rule to generate the target data.

9. A computing device, comprising:

a memory and a processor;

the memory is for storing computer-executable instructions, and the processor is for executing the computer-executable instructions, which when executed by the processor, implement the steps of the data processing method of any one of claims 1 to 7.

10. A computer-readable storage medium storing computer-executable instructions which, when executed by a processor, implement the steps of the data processing method of any one of claims 1 to 7.