WO2021068445A1

WO2021068445A1 - Data processing method and apparatus, computer device, and storage medium

Info

Publication number: WO2021068445A1
Application number: PCT/CN2020/076141
Authority: WO
Inventors: 唐虹刚; 李升林; 谢翔; 孙立林
Original assignee: 云图技术有限公司
Priority date: 2019-10-11
Filing date: 2020-02-21
Publication date: 2021-04-15
Also published as: CN110765473A

Abstract

A data processing method and apparatus, a computer device, and a storage medium. The method comprises: acquiring target data, and encrypting the target data using a homomorphic encryption algorithm to obtain ciphertext data (S201); sending a data processing request to a server, wherein the data processing request carries the ciphertext data (S202); invoking a preset model according to a preset MPC protocol in cooperation with the server so as to process the ciphertext data to obtain a ciphertext processing result (S203), wherein the preset model is compatible with the preset MPC protocol and is used for performing preset processing on the ciphertext data when the data is encrypted; and acquiring the ciphertext processing result (S204). By means of the method, when an input is ciphertext data, the data can be processed, thereby being able to effectively protect data privacy.

Description

Data processing method, device, computer equipment and storage medium

This application claims the priority of a Chinese patent application filed on October 11, 2019 with the application number 201910962649.4 and the title of the invention "data processing method, device, computer equipment and storage medium", the entire content of which is incorporated into this application by reference .

Technical field

This application relates to the field of artificial intelligence technology, and in particular to a data processing method, device, computer equipment, and storage medium.

Background technique

In some application scenarios, the server can process the target data sent by the client according to the trained deep learning model to obtain the processing result. For example, the server can perform diagnosis processing on the medical image data sent by the client according to the trained diagnosis model, so as to obtain the diagnosis result. Among them, the aforementioned medical image data may often involve user privacy, and the aforementioned methods are prone to leakage of user privacy data during specific data processing.

Therefore, there is an urgent need for a method that can process data while protecting user data privacy.

Summary of the invention

The embodiments of the present application provide a data processing method, device, computer equipment, and storage medium to provide a data processing method that can protect user privacy.

The embodiment of the application provides a data processing method, including: obtaining target data, encrypting the target data using a homomorphic encryption algorithm to obtain ciphertext data; sending a data processing request to a server, wherein the data processing request carries Ciphertext data: According to the preset MPC protocol, cooperate with the server to call the preset model to process the ciphertext data to obtain the ciphertext processing result. The preset model is compatible with the preset MPC protocol and is used in the case of data encryption Perform preset processing on ciphertext data; obtain ciphertext processing results.

In one embodiment, after obtaining the ciphertext processing result, the method further includes: decrypting the ciphertext processing result to obtain the plaintext processing result.

In one embodiment, after decrypting the ciphertext processing result to obtain the plaintext processing result, the method further includes: obtaining a verification result of the plaintext processing result, where the verification result is used to indicate whether the plaintext processing result is correct; and the ciphertext processing result And the verification result is sent to the blockchain network for on-chain storage.

In one embodiment, before/while/after sending the data processing request to the server, it further includes: sending the resource data to the contract account of the blockchain network; correspondingly, sending the ciphertext processing result and the verification result to the district The blockchain network performs on-chain storage, including: sending the ciphertext processing result and the verification result to the blockchain network for on-chain storage, so that the blockchain network can store the data in the contract account when the verification result is correct. The resource data is sent to the server's account.

In an embodiment, the target data includes at least one of the following: face image data, medical image data, and human body motion data.

In one embodiment, when the target data includes medical image data, the preset processing includes performing diagnostic processing on the medical image data.

The embodiment of the application provides a data processing method, including: receiving a data processing request sent by a client, wherein the data processing request carries ciphertext data, and the ciphertext data is processed by the client using a homomorphic encryption algorithm on the target data. Generated after encryption; in response to the data processing request, call the preset model according to the preset MPC protocol to process the ciphertext data in cooperation with the client to obtain the ciphertext processing result, where the preset model is compatible with the preset MPC protocol , Used to perform preset processing on ciphertext data in the case of data encryption; send the ciphertext processing result to the client.

In one embodiment, after obtaining the ciphertext processing result, the method further includes: uploading the transaction event data corresponding to the data processing request to the blockchain network for storage on the chain.

In one embodiment, the preset model is called according to the preset MPC protocol to process the ciphertext data in cooperation with the client to obtain the ciphertext processing result, including: according to the preset MPC protocol and the volume in the preset model The product operator performs a privacy convolution operation on the ciphertext data to obtain the ciphertext feature data; according to the preset MPC protocol and the activation operator in the preset model, it cooperates with the client to activate the ciphertext feature data to obtain The first activation data and the second activation data; according to the preset MPC protocol and the pooling operator in the preset model, cooperate with the client to perform the pooling operation on the first activation data and the second activation data to obtain the first pool Data and the second pooled data; According to the preset MPC protocol and the full connection operator in the preset model, cooperate with the client to perform the full connection operation on the first pooled data and the second pooled data to obtain the ciphertext Data processing.

The embodiment of the present application also provides a data processing method, including: a client obtains target data, and encrypts the target data using a homomorphic encryption algorithm to obtain ciphertext data; the client sends a data processing request to the server, where the data The processing request carries the ciphertext data; in response to the data processing request, the server and the client call the preset model according to the preset MPC protocol to process the ciphertext data, and obtain the ciphertext processing result, where the preset model is compatible with the preset The MPC protocol is used to perform preset processing on ciphertext data in the case of data encryption; the server sends the ciphertext processing result to the client; the client decrypts the ciphertext processing result to obtain the plaintext processing result.

The embodiment of the present application also provides a data processing device, including: an encryption module for obtaining target data, and using a homomorphic encryption algorithm to encrypt the target data to obtain ciphertext data; a sending module for sending data to a server Processing request, where the data processing request carries ciphertext data; the processing module is used to process the ciphertext data according to the preset MPC protocol and cooperate with the server to call the preset model to obtain the ciphertext processing result, where the preset The model is compatible with the preset MPC protocol and is used to perform preset processing on the ciphertext data in the case of data encryption; the acquisition module is used to obtain the ciphertext processing result.

An embodiment of the present application further provides a computer device including a processor and a memory for storing executable instructions of the processor, and the processor implements the steps of the data processing method described in any of the foregoing embodiments when the processor executes the instructions.

The embodiments of the present application also provide a computer-readable storage medium on which computer instructions are stored, and when the instructions are executed, the steps of the data processing method described in any of the foregoing embodiments are implemented.

In the embodiment of this application, a data processing method is provided. The client encrypts the obtained target data using a homomorphic encryption algorithm to obtain ciphertext data, and sends a data processing request carrying the ciphertext data to the server. Set the MPC protocol, cooperate with the server to call the preset model to process the ciphertext data, and obtain the ciphertext processing result. The preset model is compatible with the preset MPC protocol, and is used to pre-encrypt the ciphertext data in the case of data encryption. Set up processing to obtain the ciphertext processing result. In the above solution, the target data is homomorphically encrypted to obtain the corresponding ciphertext data, so as to prevent the specific content of the target data from being leaked. Further, the client then performs specific preset processing on the ciphertext data according to the preset MPC protocol and cooperates with the server to call a preset model compatible with the preset MPC protocol to obtain the ciphertext processing result of the target data. Realize that the target data can be specifically processed in the state of target data encryption, thereby effectively protecting data privacy.

Description of the drawings

The drawings described here are used to provide a further understanding of the application, constitute a part of the application, and do not constitute a limitation to the application. In the attached picture:

Figure 1 shows a schematic diagram of an application scenario of a data processing method in some embodiments of the present application;

Figure 2 shows a flowchart of a data processing method in some embodiments of the present application;

Figure 3 shows a flowchart of a data processing method in some embodiments of the present application;

Figure 4 shows a flowchart of a data processing method in some embodiments of the present application;

Figure 5 shows a sequence diagram of a data processing method in some embodiments of the present application;

Fig. 6 shows a schematic diagram of a data processing device in some embodiments of the present application;

Fig. 7 shows a schematic diagram of a data processing device in some embodiments of the present application;

Fig. 8 shows a schematic diagram of a computer device in some embodiments of the present application.

Detailed ways

The principle and spirit of the present application will be described below with reference to several exemplary embodiments. It should be understood that these embodiments are only provided to enable those skilled in the art to better understand and then implement the application, but not to limit the scope of the application in any way. On the contrary, these embodiments are provided to make the disclosure of the present application more thorough and complete, and to fully convey the scope of the present disclosure to those skilled in the art.

Those skilled in the art know that the implementation manners of this application can be implemented as a system, apparatus, method, or computer program product. Therefore, the disclosure of the present application can be specifically implemented in the following forms, namely: complete hardware, complete software (including firmware, resident software, microcode, etc.), or a combination of hardware and software.

Some embodiments of the present application provide a data processing method, and FIG. 1 shows a schematic diagram of an application scenario of the data processing method in an embodiment of the present application. As shown in Figure 1, the client can obtain target data. Among them, the target data may be data to be processed. For example, the target data may include but is not limited to at least one of the following: face image data, medical image data, human body motion data, and so on. The client can use the homomorphic encryption algorithm to encrypt the obtained target data to obtain ciphertext data. Among them, the data encrypted by the homomorphic encryption algorithm is processed to obtain an output, and the output is decrypted. The result is the same as the output result obtained by processing the unencrypted original data in the same method.

The client can send a data processing request to the server. Among them, the data processing request may carry ciphertext data corresponding to the target data. In response to the data processing request, the server may call a preset model according to a preset MPC (Secure Multi-Party Computation) protocol to process the ciphertext data in cooperation with the client to obtain the ciphertext processing result. Among them, the preset model is on the server side. The preset model can be compatible with the preset MPC protocol, and is used for preset processing of ciphertext data in the case of data encryption. In other words, the preset MPC protocol can be used to implement the operations in the preset model when the input is ciphertext data, so as to complete the preset processing of the ciphertext data. Among them, the preset model may include a trained preset deep learning model. For example, the preset model may be a trained convolutional neural network model. In the case where the target data is medical image data, the preset processing may include performing diagnosis processing on the ciphertext data obtained after homomorphic encryption of the medical image data. In the case where the target data is face image data, the preset processing may include performing face recognition processing on the ciphertext data obtained after homomorphic encryption of the face image data. In the case where the target data is human body motion data, the preset processing may include performing motion recognition processing on the ciphertext data obtained after homomorphic encryption of the human body motion data.

After obtaining the ciphertext processing result, the server may send the ciphertext processing result to the client. The public key and private key of homomorphic encryption are stored in the client. Among them, the public key is used to homomorphically encrypt the target data to obtain ciphertext data. The private key is used to decrypt the received ciphertext processing result to obtain the plaintext processing result.

After obtaining the ciphertext processing result, the server may send the transaction event data corresponding to the data processing request to the blockchain network for on-chain storage, so as to facilitate subsequent traceability and query. After the client obtains the ciphertext processing result, the client can send the obtained ciphertext processing result to the blockchain network for storage on the chain.

Take a specific application scenario as an example for description. The client may be a client of a medical institution. The client can obtain the patient's medical image data (for example, X-ray film data). The client can use the homomorphic encryption algorithm to encrypt the X-ray film data to obtain the ciphertext X-ray film data. The client sends a diagnosis request to the medical optical film diagnosis server. Among them, the diagnosis request carries ciphertext X-ray film data. The server may be a medical optical film diagnosis server. The medical light film diagnosis server calls the preset deep learning model according to the preset MPC protocol to cooperate with the client to perform preset processing on the ciphertext X-ray film data, thereby obtaining the ciphertext diagnosis result. The medical optical film diagnosis server sends the ciphertext diagnosis result to the client. The client decrypts the ciphertext diagnosis result, and obtains the plaintext diagnosis result of the X-ray film data.

Among them, the above-mentioned client can be a desktop computer, a notebook, a mobile phone terminal, a PDA, etc., as long as it is a device that can homomorphically encrypt the target data and cooperate with the server to perform preset processing on the ciphertext data. This application is not limited. The above-mentioned server can be a single server, a server cluster, or a cloud server, etc., as long as the equipment that can preset the ciphertext data according to the preset MPC protocol and preset model cooperates with the client Yes, the specific composition is not limited in this application.

Figure 2 shows a flowchart of a method in some embodiments of the present application, and the data processing method can be applied to the client. Although this application provides method operation steps or device structures as shown in the following embodiments or drawings, the method or device may include more or less operation steps or module units based on conventional or no creative labor. . In steps or structures where there is no necessary causal relationship logically, the execution order of these steps or the module structure of the device is not limited to the execution order or module structure shown in the description of the embodiments of this application and the drawings. When the described method or module structure is applied to an actual device or terminal product, it can be executed sequentially or in parallel according to the method or module structure connection shown in the embodiments or drawings (for example, parallel processors or multi-threaded processing Environment, even distributed processing environment).

Specifically, as shown in FIG. 2, the data processing method provided by some embodiments of the present application may include the following steps:

Step S201: Obtain target data, and encrypt the target data using a homomorphic encryption algorithm to obtain ciphertext data.

The client can obtain the target data. Among them, the target data is the data to be processed. The client uses a homomorphic encryption algorithm to encrypt the target data to obtain ciphertext data. Specifically, the client can use a homomorphic encryption algorithm to generate a public key and a private key, and then use the public key to encrypt the target data to obtain ciphertext data.

Step S202: Send a data processing request to the server, where the data processing request carries ciphertext data.

The client can send a data processing request to the server. Among them, the data processing request carries ciphertext data. In other embodiments, the data processing request may also carry the public key generated by the homomorphic encryption algorithm.

Step S203: According to the preset MPC protocol, cooperate with the server to call the preset model to process the ciphertext data, and obtain the ciphertext processing result. The preset model is compatible with the preset MPC protocol and is used for data encryption. The ciphertext data is pre-processed.

Step S204: Obtain the ciphertext processing result.

Specifically, the client can process the ciphertext data according to the preset MPC protocol and cooperate with the server to call the preset model to obtain the ciphertext processing result. Among them, the preset model can be compatible with the preset MPC protocol. The preset model may be a trained deep learning model. Among them, the deep learning model can be obtained by training using a large amount of plaintext data. In order to be compatible with the preset MPC protocol, the floating-point data in the trained deep learning model is converted into integer data. In other words, the preset MPC protocol can be used to implement various operations in the preset model when the input is ciphertext data, so as to realize the preset processing of ciphertext data. Get the ciphertext processing result on the server. The server sends the ciphertext processing result to the client.

In the above solution, the target data is homomorphically encrypted to obtain the corresponding ciphertext data, so as to prevent the specific content of the target data from being leaked. Further, the client then performs specific preset processing on the ciphertext data according to the preset MPC protocol and cooperates with the server to call a preset model compatible with the preset MPC protocol to obtain the ciphertext processing result of the target data. Realize that the target data can be specifically processed in the state of target data encryption, thereby effectively protecting data privacy.

In some embodiments of the present application, the target data may include but is not limited to at least one of the following: face image data, medical image data, and human body motion data. In some embodiments of the present application, when the target data includes medical image data, the preset processing may include performing diagnosis processing on the medical image data. When the target data includes face image data, the preset processing may include face recognition processing. When the target data includes human body motion data, the preset processing includes motion recognition processing.

In some embodiments of the present application, after the client obtains the ciphertext processing result, the client may decrypt the ciphertext processing result according to the private key generated by the homomorphic encryption algorithm to obtain the plaintext processing result. Through the above method, the plaintext processing result of the target data can be revealed on the client.

In some embodiments of the present application, after decrypting the ciphertext processing result to obtain the plaintext processing result, it may further include: obtaining a verification result of the plaintext processing result, where the verification result is used to indicate whether the plaintext processing result is correct; The document processing results and verification results are sent to the blockchain network for on-chain storage.

Specifically, after the client decrypts the ciphertext processing result to obtain the plaintext processing result, the client obtains the verification result of the plaintext processing result. Among them, the verification result may be obtained after the business personnel verify the plaintext processing result. The verification result can also be inferred by the application in the client based on the target data and the plaintext processing result. The verification result is used to indicate whether the plaintext processing result is correct. The client sends the verification result and the ciphertext processing result to the blockchain network for on-chain storage, which is convenient for subsequent query, traceability, billing, verification, etc.

In some embodiments of the present application, before/while/after sending the data processing request to the server, it may also include: sending the resource data to the contract account of the blockchain network; correspondingly, sending the ciphertext processing result and the verification result Sending to the blockchain network for on-chain storage may include: sending the ciphertext processing result and verification result to the blockchain network for on-chain storage, so that the blockchain network will confirm that the verification result is correct. The resource data in the contract account is sent to the server's account.

Specifically, before/while/after the client sends a data processing request to the server, the client can send the resource data of the data processing to the contract account of the blockchain network. Among them, the resource data may be fees that need to be paid for data processing, such as currency or Bitcoin. After the client sends the ciphertext processing result and the verification result to the blockchain network for on-chain storage, the blockchain network determines whether the verification result is correct. When it is determined that the verification result is correct, the blockchain network sends the resource data in the contract account to the server's account. Through the above method, the problem of service billing and settlement can be solved.

Some embodiments of the present application also provide a data processing method, which can be applied to the server side. Fig. 3 shows a flowchart of a data processing method provided by an embodiment of the present application.

As shown in Figure 3, the foregoing data processing method may include the following steps:

Step S301: Receive a data processing request sent by the client, where the data processing request carries ciphertext data, and the ciphertext data is generated by the client after encrypting the target data using a homomorphic encryption algorithm.

Specifically, the client obtains the target data, and encrypts the target data using a homomorphic encryption algorithm to obtain ciphertext data. The client sends a data processing request to the server. Among them, the target data is the data to be processed. The client uses a homomorphic encryption algorithm to encrypt the target data to obtain ciphertext data. Specifically, the client can use a homomorphic encryption algorithm to generate a public key and a private key, and then use the public key to encrypt the target data to obtain ciphertext data. Wherein, the data processing request carries ciphertext data corresponding to the target data. In other embodiments, the data processing request may also carry the public key generated by the homomorphic encryption algorithm. The server receives the data processing request sent by the client.

Step S302: In response to the data processing request, call the preset model according to the preset MPC protocol to process the ciphertext data in cooperation with the client to obtain the ciphertext processing result, where the preset model is compatible with the preset MPC protocol, Used to perform preset processing on ciphertext data in the case of data encryption.

Step S303: Send the ciphertext processing result to the client.

Specifically, in response to the received data processing request, the server may call the preset model according to the preset MPC protocol to process the ciphertext data in cooperation with the client to obtain the ciphertext processing result. Among them, the preset model can be compatible with the preset MPC protocol. The preset model may be a trained deep learning model. Among them, the deep learning model can be obtained by training using a large amount of plaintext data. In order to be compatible with the preset MPC protocol, the floating-point data in the trained deep learning model is converted into integer data. In other words, the preset MPC protocol can be used to implement various operations in the preset model when the input is ciphertext data, so as to realize preset processing of ciphertext data and obtain ciphertext processing on the server side. result.

After the server and the client cooperate to obtain the ciphertext processing result, the server may send the ciphertext processing result to the client. In some embodiments, the client can decrypt the ciphertext processing result according to the private key obtained by the homomorphic encryption algorithm to obtain the plaintext processing result of the target data.

In some embodiments of the present application, after obtaining the ciphertext processing result, it may further include: uploading the transaction event data corresponding to the data processing request to the blockchain network for storage on the chain.

Specifically, after the server and the client cooperate to complete the processing of the ciphertext data, the transaction event data corresponding to the data processing request can be uploaded to the blockchain network for on-chain storage. The transaction event data may include data related to calculations performed by the server in response to the data processing request. Through the above method, the transaction event data is uploaded to the blockchain network for on-chain storage, which is convenient for subsequent query and backtracking.

In some embodiments of the present application, calling the preset model according to the preset MPC protocol to process the ciphertext data in cooperation with the client to obtain the ciphertext processing result may include: according to the preset MPC protocol and the preset model The convolution operator in the ciphertext data performs a private convolution operation to obtain the ciphertext feature data; according to the preset MPC protocol and the activation operator in the preset model, the ciphertext feature data is activated in cooperation with the client Operate to obtain the first activation data and the second activation data; according to the preset MPC protocol and the pooling operator in the preset model, cooperate with the client to perform the pooling operation on the first activation data and the second activation data to obtain The first pooled data and the second pooled data; according to the preset MPC protocol and the fully connected operator in the preset model, cooperate with the client to perform the fully connected operation on the first pooled data and the second pooled data, Obtain ciphertext processing data.

Among them, the preset model may be a trained convolutional neural network model. Convolutional neural network models generally include: convolutional layer, excitation layer, pooling layer and fully connected layer. Among them, the number of each layer can be one or more. Among them, the convolution layer may include a convolution operator for extracting features of the data. The excitation layer can include activation operators to add nonlinear factors to simulate more subtle changes. The pooling layer may include a pooling operator, which is used to compress the input features. On the one hand, the feature map is reduced and the network calculation complexity is simplified. On the other hand, the feature compression is performed to extract the main features. The fully connected layer may include a fully connected operator, which is used to connect all the features, send the output value to the classifier, and obtain the processing result.

Specifically, after receiving the data processing request sent by the client, the server invokes the convolution operator in the preset model to perform a private convolution operation on the ciphertext data according to the preset MPC protocol to obtain the ciphertext feature data. Among them, the plaintext feature data obtained after decrypting the ciphertext feature data obtained by performing the privacy convolution operation on the ciphertext data is the same as the feature data obtained by directly performing the plaintext convolution operation on the plaintext data.

Among them, homomorphic encryption allows operations to be performed on the ciphertext, and the corresponding operations will be mapped to the plaintext. The homomorphic encryption can be refined into the following two homomorphic encryption algorithms:

1) Homomorphic addition

Given that C1=Enc(m1), C2=Enc(m2), then C1·C2=Enc(m1+m2);

2) Homomorphic multiplication

Given that C1=Enc(m1), t1, then (C1) ^t1 =Enc(m1·t1), which can also be derived by homomorphic addition.

The convolution operation on the plaintext data is to multiply the corresponding elements in the plaintext data matrix and the convolution operator matrix and then sum them. The convolution operation on the ciphertext data is obtained by multiplying the powers of the corresponding elements of the convolution operator matrix of the elements in the ciphertext data matrix. Exemplarily, A _3×3 is a plaintext data matrix, C _3×3 is a convolution operator matrix; a _3×3 is a ciphertext data matrix. The plaintext convolution operation and privacy convolution operation are as follows:

After obtaining the ciphertext feature data, the server can call the activation operator in the preset model according to the preset MPC protocol, and cooperate with the client to activate the ciphertext feature data to obtain the first activation data and the second activation data. Among them, the first activation data is held by the server, and the second activation data is held by the client. Specifically, the server performs a homomorphic encryption to secret sharing operation on the ciphertext feature data to obtain the first ciphertext data and the second ciphertext data. The server sends the first ciphertext data to the client. The client decrypts the first ciphertext data to obtain the first plaintext data. The server converts the activation operator into a Boolean circuit and obtains the truth table of each circuit gate of the Boolean circuit. Then the server selects two evenly distributed strings as labels for each door, which are used to represent 0 or 1 respectively. After that, the server randomly generates a first random number, and generates a first label according to the second ciphertext data and the first random number. After replacing the truth table with the first label as input, the server obtains the label table. For each circuit gate, the server uses the tag table to encrypt, and generates a first encryption circuit (GC, Garbled Circuit). The server sends the first encrypted circuit to the client. The client performs an inadvertent transfer (OT, Oblivious Transfer) to the first plaintext data to obtain the second label. The client decrypts the first encryption circuit according to the second tag to obtain activation data. Activation data also belongs to feature data, which is used to characterize features after adding nonlinear factors, and can simulate more subtle feature changes. Then, since the subsequent pooling operation is implemented through secure multi-party computing, the activation data can be secretly shared, so that the first activation data can be obtained on the server side and the second activation data can be obtained on the client side. The activation data is the sum of the first activation data and the second activation data. That is, the server and the client perform secure multi-party calculation on the ciphertext feature data according to the preset MPC protocol and activation operator to obtain the first activation data and the second activation data.

After the server obtains the first activation data and the client obtains the second activation data, the server calls the pooling operator in the preset model according to the preset MPC protocol, and cooperates with the client to compare the first activation data and the second activation data Perform a pooling operation to obtain the first pooled data and the second pooled data. Among them, the first pooled data can be held by the server. The second pooled data can be held by the client. Specifically, the server converts the pooling operator into a Boolean circuit. The server randomly generates a second random number. The server generates a third label according to the first activation function and the random number. The server replaces the truth table of the Boolean circuit with the third label as an input to obtain a label table. The server encrypts each gate of the Boolean circuit using the tag table to generate a second encryption circuit. The server sends the second encryption circuit to the client. The client inadvertently transmits the second activation data to obtain the fourth tag. The client uses the fourth tag to decrypt the second encryption circuit to obtain pooled data. Pooled data also belongs to feature data, which is the feature data obtained after the feature is compressed, which can characterize the main feature. After that, since the subsequent full connection operation is realized through secure multi-party computing, the pooled data can be secretly shared, so that the server side obtains the first pooled data and the client side obtains the second pooled data. The pooled data is the sum of the first pooled data and the second pooled data. That is, the server and the client can perform secure multi-party calculation on the first activation data and the second activation data according to the preset MPC protocol and pooling operator to obtain the first pooling data and the second pooling data.

After the server obtains the first pooled data and the client obtains the second pooled data, the server performs a secret sharing to homomorphic encryption operation on the first pooled data, and the client performs secret sharing to homomorphic encryption on the second pooled data Operation, get pooled data on the server side. Then the obtained pooled data is flattened into a one-dimensional array. The server multiplies each element in the one-dimensional array with the weight value on the connection line (that is, the element in the fully connected operator), adds and outputs the result to obtain the ciphertext processing result. That is, the server cooperates with the client to perform a full connection operation on the first pooled data and the second pooled data according to the preset MPC protocol and the full connection operator in the preset model to obtain the ciphertext processing data. The server sends the obtained ciphertext processing result to the client. The client uses the private key of the homomorphic encryption algorithm to decrypt the ciphertext processing result to obtain the plaintext processing result of the target data.

In the foregoing embodiment, the preset model includes a convolutional layer, a pooling layer, an excitation layer, and a fully connected layer as an example for description, but the application is not limited to this. The data processing method in the embodiment of the present application is applicable to the case where the preset model includes multiple convolutional layers, multiple pooling layers, multiple excitation layers, or multiple fully connected layers.

In the data processing method of the foregoing embodiment, the server and the client call the convolution operator, activation operator, pooling operator, and fully connected operator in the preset model according to the preset MPC protocol to secure the ciphertext data. Multi-party calculations obtain the ciphertext processing result of the ciphertext data, and realize the processing or reasoning of the ciphertext data through the preset model when the input is ciphertext, which can effectively protect the user's data privacy.

Some embodiments of the application also provide a data processing method. Fig. 4 shows a flowchart of a data processing method provided in an embodiment of the present application. As shown in Figure 4, the method may include:

In step S401, the client obtains the target data, and encrypts the target data using a homomorphic encryption algorithm to obtain ciphertext data.

Step S402: The client sends a data processing request to the server, where the data processing request carries ciphertext data.

Step S403, in response to the data processing request, the server and the client call the preset model to process the ciphertext data according to the preset MPC protocol, and obtain the ciphertext processing result, where the preset model is compatible with the preset MPC protocol for In the case of data encryption, the ciphertext data is pre-processed.

In step S404, the server sends the ciphertext processing result to the client.

Step S405: The client decrypts the ciphertext processing result to obtain the plaintext processing result of the target data.

In the above solution, the ciphertext data is obtained by homomorphic encryption of the target data, which is convenient for subsequent direct processing of the ciphertext data. The server calls the preset model according to the preset MPC protocol to process the ciphertext data in cooperation with the client to obtain the ciphertext processing result, which realizes the processing of the data when the input is ciphertext data, which can effectively protect the data privacy.

In some embodiments of the present application, after the server obtains the ciphertext processing result, it may further include: the server uploads the transaction event data corresponding to the data processing request to the blockchain network for storage on the chain.

In some embodiments of the present application, the server calls the preset model according to the preset MPC protocol to process the ciphertext data in cooperation with the client to obtain the ciphertext processing result, which may include: according to the preset MPC protocol and the preset The convolution operator in the model performs a private convolution operation on the ciphertext data to obtain the ciphertext feature data; according to the preset MPC protocol and the activation operator in the preset model, it cooperates with the client to perform the ciphertext feature data Activate the operation to obtain the first activation data and the second activation data; according to the preset MPC protocol and the pooling operator in the preset model, cooperate with the client to perform the pooling operation on the first activation data and the second activation data, Obtain the first pooled data and the second pooled data; according to the preset MPC protocol and the fully connected operator in the preset model, cooperate with the client to perform the fully connected operation on the first pooled data and the second pooled data , Get the ciphertext processing data.

In some embodiments of the present application, after the client decrypts the ciphertext processing result to obtain the plaintext processing result, it may further include: the client obtains the verification result of the plaintext processing result, where the verification result is used to indicate whether the plaintext processing result is Correct; the client sends the ciphertext processing result and verification result to the blockchain network for storage on the chain.

In some embodiments of the present application, before/while/after the client sends a data processing request to the server, it may also include: the client sends resource data to the contract account of the blockchain network; correspondingly, the client sends After the ciphertext processing result and the verification result are sent to the blockchain network for on-chain storage, it can also include: the blockchain network determines whether the verification result is correct; in the case where the verification result is determined to be correct, the blockchain network transfers the contract The resource data in the account is sent to the server's account.

The above method will be described below in conjunction with a specific embodiment. However, it is worth noting that this specific embodiment is only for better describing the application, and does not constitute an improper limitation of the application.

Fig. 5 shows a sequence diagram of the data processing method in this specific embodiment. As shown in Figure 5, the data processing method may include the following steps:

Step 1. The client obtains the target data, and encrypts the target data using a homomorphic encryption algorithm to obtain the ciphertext data corresponding to the target data;

Step 2: The client sends a data processing request to the server, where the data processing request carries ciphertext data;

Step 3. The client mortgages the fee to the contract account of the blockchain network;

Step 4: The server invokes the convolution operator in the preset model to perform a private convolution operation on the ciphertext data according to the preset MPC protocol to obtain the ciphertext feature data;

Step 5. The server and the client call the activation operator in the preset model according to the preset MPC protocol to perform secure multi-party calculation of the ciphertext feature data, and obtain the first activation data on the server side and the second activation data on the client side. ；

Step 6. The server and the client call the pooling operator in the preset model according to the preset MPC protocol to perform secure multi-party calculations on the first activation data and the second activation data, and obtain the first pooled data on the server side, and The client gets the second pooled data;

Step 7, the server and the client call the full connection operator in the preset model according to the preset MPC protocol to perform the full connection operation on the first pooled data and the second pooled data, and obtain the ciphertext processing result on the server side;

Step 8. The server sends the ciphertext processing result to the client;

Step 9. The server sends the transaction event data corresponding to the data processing request to the blockchain network for storage on the chain;

Step 10: The client uses the private key of the homomorphic encryption algorithm to decrypt the ciphertext processing result to obtain the plaintext processing result of the target data;

Step 11. The client obtains the verification result, where the verification result is used to indicate whether the plaintext processing result of the target data is correct;

Step 12. The client sends the plaintext processing result and the verification result to the blockchain network for storage on the chain;

Step 13. The blockchain network determines whether the verification result is correct;

Step 14. When it is determined that the verification result is correct, the blockchain network transfers the fees in the contract account to the server's account;

Step 15. In the case where it is determined that the verification result is incorrect, the blockchain network transfers the fees in the contract account to the client's account.

In the data processing method in the foregoing embodiment, the ciphertext data is obtained by homomorphic encryption of the target data, which is convenient for subsequent direct processing of the ciphertext data. The server and the client call the convolution operator, activation operator, pooling operator and fully connected operator in the preset model according to the preset MPC protocol, and perform preset processing on the ciphertext data to obtain the ciphertext of the target data The processing result realizes the processing of the data when the input is ciphertext data, which can effectively protect data privacy. After that, the server sends the data corresponding to this transaction event to the blockchain network for storage on the chain, so as to facilitate subsequent query, retrieval, verification, etc. The server sends the ciphertext processing result to the client, and the client decrypts the ciphertext processing result to obtain the plaintext processing result of the target data. The client obtains the verification result of the plaintext processing result, and sends the ciphertext processing result and the verification result to the blockchain network for on-chain storage, which can further protect the privacy of the processing result and facilitate subsequent queries and backtracking. And in the case that the blockchain network determines that the verification result is correct, the cost of the client's mortgage in the contract account is transferred to the server's account. In the case that the blockchain network determines that the verification result is wrong, the cost of the client's mortgage to the contract account is returned to the client's account. In this way, the billing and clearing problem of the business can be effectively solved.

Based on the same inventive concept, an embodiment of the present application also provides a data processing device, as described in the following embodiment. Since the problem-solving principle of the data processing device is similar to that of the data processing method, the implementation of the data processing device can refer to the implementation of the data processing method, and the repetition will not be repeated. As used below, the term "unit" or "module" can be a combination of software and/or hardware that implements a predetermined function. Although the devices described in the following embodiments are preferably implemented by software, implementation by hardware or a combination of software and hardware is also possible and conceived. Fig. 6 is a structural block diagram of a data processing device according to an embodiment of the present application. As shown in Fig. 6, it includes: an encryption module 601, a sending module 602, a processing module 603, and an obtaining module 604. The structure is described below.

The encryption module 601 is used to obtain target data, and encrypt the target data using a homomorphic encryption algorithm to obtain ciphertext data.

The sending module 602 is configured to send a data processing request to the server, where the data processing request carries ciphertext data.

The processing module 603 is used to process the ciphertext data according to the preset MPC protocol and cooperate with the server to call the preset model to obtain the ciphertext processing result. The preset model is compatible with the preset MPC protocol and is used in the case of data encryption. Perform preset processing on the ciphertext data below.

The obtaining module 604 is used to obtain the ciphertext processing result.

In some embodiments of the present application, the data processing device may further include a decryption module, and the decryption module may be used to: after obtaining the ciphertext processing result, decrypt the ciphertext processing result to obtain the plaintext processing result.

In some embodiments of the present application, the data processing device may further include an on-chain module, and the on-chain module may be used to: after decrypting the ciphertext processing result to obtain the plaintext processing result, obtain the verification result of the plaintext processing result, where, The verification result is used to indicate whether the plaintext processing result is correct; the ciphertext processing result and the verification result are sent to the blockchain network for on-chain storage.

In some embodiments of the present application, the sending module can also be used to send resource data to the contract account of the blockchain network before/while/after sending the data processing request to the server; correspondingly, the on-chain module can be specific Used to: send the ciphertext processing result and the verification result to the blockchain network for on-chain storage, so that the blockchain network sends the resource data in the contract account to the account of the server when the verification result is determined to be correct in.

In some embodiments of the present application, the target data includes at least one of the following: face image data, medical image data, and human body motion data.

In some embodiments of the present application, when the target data includes medical image data, the preset processing includes performing diagnostic processing on the medical image data.

Based on the same inventive concept, an embodiment of the present application also provides a data processing device, as described in the following embodiment. Since the problem-solving principle of the data processing device is similar to that of the data processing method, the implementation of the data processing device can refer to the implementation of the data processing method, and the repetition will not be repeated. As used below, the term "unit" or "module" can be a combination of software and/or hardware that implements a predetermined function. Although the devices described in the following embodiments are preferably implemented by software, implementation by hardware or a combination of software and hardware is also possible and conceived. Fig. 7 is a structural block diagram of a data processing device according to an embodiment of the present application. As shown in Fig. 7, it includes: a receiving module 701, a processing module 702, and a sending module 703. The structure is described below.

The receiving module 701 is configured to receive a data processing request sent by a client, where the data processing request carries ciphertext data, and the ciphertext data is generated by the client after encrypting target data using a homomorphic encryption algorithm.

The processing module 702 is configured to respond to the data processing request and call the preset model according to the preset MPC protocol to process the ciphertext data in cooperation with the client to obtain the ciphertext processing result, wherein the preset model is compatible with the preset MPC The protocol is used to perform preset processing on ciphertext data in the case of data encryption.

The sending module 703 is used to send the ciphertext processing result to the client.

In some embodiments of the present application, the data processing device further includes an on-chain module, where the on-chain module is specifically configured to: after obtaining the ciphertext processing result, upload transaction event data corresponding to the data processing request to the blockchain network for processing On-chain storage.

In some embodiments of the present application, the processing module may be specifically configured to: perform a private convolution operation on the ciphertext data according to the preset MPC protocol and the convolution operator in the preset model to obtain the ciphertext feature data; Set the MPC protocol and the activation operator in the preset model to cooperate with the client to activate the ciphertext feature data to obtain the first activation data and the second activation data; according to the preset MPC protocol and the preset model The pooling operator cooperates with the client to perform pooling operations on the first activation data and the second activation data to obtain the first pooled data and the second pooled data; according to the preset MPC protocol and the preset model The connection operator cooperates with the client to perform a full connection operation on the first pooled data and the second pooled data to obtain the ciphertext processing data.

From the above description, it can be seen that the embodiments of the present application achieve the following technical effects: by homomorphically encrypting the target data, the corresponding ciphertext data is obtained, and the specific content of the target data is prevented from being leaked. Further, the client then performs specific preset processing on the ciphertext data according to the preset MPC protocol and cooperates with the server to call a preset model compatible with the preset MPC protocol to obtain the ciphertext processing result of the target data. Realize that the target data can be specifically processed in the state of target data encryption, thereby effectively protecting data privacy.

The embodiment of the present application also provides a computer device. For details, please refer to the schematic diagram of the structure of the computer device based on the data processing method provided by the embodiment of the present application shown in FIG. 8. The computer device may specifically include an input device 81 and a processor. 82. Memory 83. Wherein, the memory 83 is used to store processor executable instructions. The processor 82 implements the steps of the data processing method described in any of the foregoing embodiments when executing the instructions.

In this embodiment, the input device may specifically be one of the main devices for information exchange between the user and the computer system. The input device may include a keyboard, a mouse, a camera, a scanner, a light pen, a handwriting input board, a voice input device, etc.; the input device is used to input raw data and programs for processing these numbers into the computer. The input device can also obtain and receive data transmitted from other modules, units, and devices. The processor can be implemented in any suitable way. For example, the processor may take the form of a microprocessor or a processor and a computer readable medium, logic gates, switches, application specific integrated circuits ( Application Specific Integrated Circuit, ASIC), programmable logic controller and embedded microcontroller form, etc. The memory may specifically be a memory device used to store information in modern information technology. The memory can include multiple levels. In a digital system, as long as it can store binary data, it can be a memory; in an integrated circuit, a circuit with a storage function without a physical form is also called a memory, such as RAM, FIFO, etc.; In the system, storage devices in physical form are also called memory, such as memory sticks, TF cards, and so on.

In this embodiment, the specific functions and effects implemented by the computer device can be explained in comparison with other embodiments, and will not be repeated here.

The embodiment of the present application also provides a computer storage medium based on a data processing method, the computer storage medium stores computer program instructions, and when the computer program instructions are executed, the data processing method described in any of the above embodiments is implemented A step of.

In this embodiment, the above-mentioned storage medium includes, but is not limited to, random access memory (Random Access Memory, RAM), read-only memory (Read-Only Memory, ROM), cache (Cache), and hard disk (Hard Disk Drive, HDD). Or memory card (Memory Card). The memory can be used to store computer program instructions. The network communication unit may be an interface set up in accordance with a standard stipulated by the communication protocol and used for network connection communication.

In this embodiment, the specific functions and effects realized by the program instructions stored in the computer storage medium can be explained in comparison with other embodiments, and will not be repeated here.

Obviously, those skilled in the art should understand that the modules or steps of the embodiments of the present application described above can be implemented by a general computing device, and they can be concentrated on a single computing device or distributed among multiple computing devices. Optionally, they can be implemented by the program code executable by the computing device, so that they can be stored in the storage device for execution by the computing device, and in some cases, they can be different from here The steps shown or described are performed in the order of, or they are respectively fabricated into individual integrated circuit modules, or multiple modules or steps of them are fabricated into a single integrated circuit module to achieve. In this way, the embodiments of the present application are not limited to any specific combination of hardware and software.

It should be understood that the above description is for illustration and not for limitation. By reading the above description, many implementations and many applications beyond the examples provided will be obvious to those skilled in the art. Therefore, the scope of this application should not be determined with reference to the above description, but should be determined with reference to the foregoing claims and the full scope of equivalents possessed by these claims.

The foregoing descriptions are only preferred embodiments of the present application, and are not intended to limit the present application. For those skilled in the art, the embodiments of the present application may have various modifications and changes. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application shall be included in the protection scope of this application.

Claims

A data processing method, characterized in that it comprises:

Acquiring target data, and encrypting the target data using a homomorphic encryption algorithm to obtain ciphertext data;

Sending a data processing request to the server, where the data processing request carries the ciphertext data;

According to the preset MPC protocol, cooperate with the server to call a preset model to process the ciphertext data to obtain the ciphertext processing result, wherein the preset model is compatible with the preset MPC protocol, and is used for data Performing preset processing on the ciphertext data in the case of encryption;

Obtain the ciphertext processing result.
The method according to claim 1, wherein after obtaining the ciphertext processing result, the method further comprises:

Decrypt the ciphertext processing result to obtain the plaintext processing result.
The method according to claim 2, wherein after decrypting the ciphertext processing result to obtain the plaintext processing result, the method further comprises:

Obtaining a verification result of the plaintext processing result, where the verification result is used to indicate whether the plaintext processing result is correct;

The ciphertext processing result and the verification result are sent to the blockchain network for on-chain storage.
The method according to claim 3, characterized in that, before/while/after sending the data processing request to the server, the method further comprises:

Sending resource data to the contract account of the blockchain network;

Correspondingly, sending the ciphertext processing result and the verification result to the blockchain network for on-chain storage includes:

The ciphertext processing result and the verification result are sent to the blockchain network for on-chain storage, so that the blockchain network, when the verification result is determined to be correct, will be stored in the contract account The resource data is sent to the account of the server.
The method according to claim 1, wherein the target data includes at least one of the following: face image data, medical image data, and human body motion data.
The method according to claim 5, wherein when the target data includes medical image data, the preset processing includes performing diagnostic processing on the medical image data.
A data processing method, characterized in that it comprises:

Receiving a data processing request sent by a client, where the data processing request carries ciphertext data, and the ciphertext data is generated by the client after encrypting target data using a homomorphic encryption algorithm;

In response to the data processing request, the preset model is called according to the preset MPC protocol to process the ciphertext data in cooperation with the client to obtain the ciphertext processing result, wherein the preset model is compatible with all The preset MPC protocol is used to perform preset processing on the ciphertext data in the case of data encryption;

Sending the ciphertext processing result to the client.
The method according to claim 7, characterized in that, after obtaining the ciphertext processing result, the method further comprises:

Upload the transaction event data corresponding to the data processing request to the blockchain network for on-chain storage.
The method according to claim 7, wherein calling a preset model according to a preset MPC protocol to process the ciphertext data in cooperation with the client to obtain a ciphertext processing result, comprising:

Performing a privacy convolution operation on the ciphertext data according to the preset MPC protocol and the convolution operator in the preset model to obtain ciphertext feature data;

According to the preset MPC protocol and the activation operator in the preset model, cooperate with the client to perform an activation operation on the ciphertext feature data to obtain first activation data and second activation data;

According to the preset MPC protocol and the pooling operator in the preset model, cooperate with the client to perform a pooling operation on the first activation data and the second activation data to obtain the first pool Optimized data and second pooled data;

According to the preset MPC protocol and the fully connected operator in the preset model, cooperate with the client to perform a fully connected operation on the first pooled data and the second pooled data to obtain a secret Text processing data.
A data processing method, characterized in that it comprises:

The client obtains the target data, and encrypts the target data using a homomorphic encryption algorithm to obtain ciphertext data;

The client sends a data processing request to the server, wherein the data processing request carries the ciphertext data;

In response to the data processing request, the server and the client call a preset model to process the ciphertext data according to the preset MPC protocol to obtain the ciphertext processing result, wherein the preset model is compatible with all The preset MPC protocol is used to perform preset processing on the ciphertext data in the case of data encryption;

Sending the ciphertext processing result to the client by the server;

The client decrypts the ciphertext processing result to obtain the plaintext processing result of the target data.
A data processing device, characterized in that it comprises:

The encryption module is used to obtain target data, and encrypt the target data using a homomorphic encryption algorithm to obtain ciphertext data;

A sending module, configured to send a data processing request to the server, wherein the data processing request carries the ciphertext data;

The processing module is configured to process the ciphertext data according to the preset MPC protocol and cooperate with the server to call a preset model to obtain the ciphertext processing result, wherein the preset model is compatible with the preset MPC protocol , Used to perform preset processing on the ciphertext data in the case of data encryption;

The obtaining module is used to obtain the ciphertext processing result.
A computer device characterized by comprising a processor and a memory for storing executable instructions of the processor, and the processor implements the steps of the method according to any one of claims 1 to 6 when the processor executes the instructions.
A computer-readable storage medium having computer instructions stored thereon, characterized in that, when the instructions are executed, the steps of the method according to any one of claims 1 to 6 are realized.