CN109754251B - Data processing method and device, medium and terminal thereof - Google Patents

Data processing method and device, medium and terminal thereof Download PDF

Info

Publication number
CN109754251B
CN109754251B CN201811613037.6A CN201811613037A CN109754251B CN 109754251 B CN109754251 B CN 109754251B CN 201811613037 A CN201811613037 A CN 201811613037A CN 109754251 B CN109754251 B CN 109754251B
Authority
CN
China
Prior art keywords
data
supplier
storage
stored
transaction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201811613037.6A
Other languages
Chinese (zh)
Other versions
CN109754251A (en
Inventor
李佳
袁一
潘晓良
颜卿
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shigengjian Data Technology Shanghai Co ltd
Original Assignee
Shigengjian Data Technology Shanghai Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shigengjian Data Technology Shanghai Co ltd filed Critical Shigengjian Data Technology Shanghai Co ltd
Priority to CN201811613037.6A priority Critical patent/CN109754251B/en
Publication of CN109754251A publication Critical patent/CN109754251A/en
Application granted granted Critical
Publication of CN109754251B publication Critical patent/CN109754251B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Storage Device Security (AREA)

Abstract

The embodiment of the invention discloses a data processing method, a device, a medium and a terminal thereof, wherein the data processing method comprises the following steps: determining a storage demand of a data supplier, wherein the storage demand comprises a storage location of data to be stored of the data supplier, and the storage location is configured to receive an indication that the data supplier operates on the data to be stored; responding to data transaction information, and acquiring data from the storage position, wherein the data transaction information points to the data to be stored; determining that the data retrieved from the storage location is valid compared to the data to be stored. The embodiment of the invention provides a data processing method meeting relevant regulations of a privacy protection act.

Description

Data processing method and device, medium and terminal thereof
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a data processing method, an apparatus, a medium, and a terminal thereof.
Background
With the development of the internet, online transactions, especially data transactions, are prevalent. The data supplier has the right to add or modify or delete transaction data stored in the storage location according to the relevant provisions of the privacy preserving act.
How to provide a data processing method meeting the relevant regulations of the privacy protection act becomes an urgent problem to be solved.
Disclosure of Invention
The technical problem solved by the embodiment of the invention is to provide a data processing method meeting the relevant regulations of the privacy protection act.
In order to solve the above technical problem, an embodiment of the present invention provides a data processing method, including: determining a storage demand of a data supplier, wherein the storage demand comprises a storage location of data to be stored of the data supplier, and the storage location is configured to receive an indication that the data supplier operates on the data to be stored; responding to data transaction information, and acquiring data from the storage position, wherein the data transaction information points to the data to be stored; determining that the data retrieved from the storage location is valid compared to the data to be stored.
Optionally, the determining the storage requirement of the data supplier includes: determining a data type of the data to be stored of the data supplier; and determining the storage position according to the data type.
Optionally, determining the storage location according to the data type of the data supplier includes: if the data type of the data supplier is judged to be large data meeting a preset standard, determining that the storage position is located in the data supplier; and if the data type of the data supplier is judged to be the small data meeting the preset standard, determining the storage position to be a third-party storage position except the data supplier and the data demand party.
Optionally, determining the storage location according to the data type includes: determining the frequency of transmitting the data provided by the data supplier to the data demander according to the data type; determining the storage location based on the frequency.
Optionally, the determining the storage requirement of the data supplier includes: receiving a storage space request from the data supplier; and responding to the memory space application, and sending the address of the memory location to the data supplier.
Optionally, the storage space application includes a storage space capacity, and the storage location is provided with a storage space having the storage space capacity.
Optionally, the instruction of the data supplier to perform an operation on the data to be stored includes an instruction of an addition, deletion, or modification operation, and the data processing method further includes: receiving an indication of the add or delete or modify operation from the data supplier to add or delete or modify all or part of the data to be stored received from the data supplier.
Optionally, if the data to be stored is not added or deleted or modified, the data processing method further includes: performing data transaction indicated by the data transaction information; if the data to be stored is added or deleted or modified, the data processing method further comprises the following steps: terminating the data transaction indicated by the data transaction information.
Optionally, the performing the data transaction indicated by the data transaction information includes: and triggering an intelligent contract running in a block chain to perform the data transaction.
Optionally, the performing the data transaction indicated by the data transaction information includes: carrying out re-encryption operation on the data acquired from the storage position to generate transaction data corresponding to the data transaction; and sending the transaction data to a data demand party.
Optionally, performing a re-encryption operation on the data acquired from the storage location includes: obtaining a re-encryption key, wherein the re-encryption key is generated based on a private key of the data supplier and a public key of the data demander; and carrying out re-encryption operation on the acquired data based on the re-encryption key to generate the transaction data.
Optionally, the data to be stored includes original plaintext verification data, and the original plaintext verification data is generated according to original plaintext data of the data to be stored; the data processing method further comprises: and acquiring the original plaintext verification data from the data supplier, and uploading the acquired original plaintext verification data to a block chain.
An embodiment of the present invention further provides a data processing apparatus, including: a storage requirement determining unit configured to determine a storage requirement of a data supplier, the storage requirement including a storage location of data to be stored of the data supplier, the storage location being configured to receive an indication that the data supplier operates on the data to be stored; a storage data acquisition unit configured to acquire data from the storage location in response to data transaction information, the data transaction information being directed to the data to be stored; a data validity determination unit configured to determine that data acquired from the storage location is valid compared to the data to be stored.
Optionally, the storage requirement determining unit includes: a data type determination subunit configured to determine a data type of the data to be stored of the data supplier; a storage location determination subunit configured to determine the storage location according to the data type.
Optionally, the storage location determining subunit includes: a first storage location determining module configured to determine that the storage location is the data provider if it is determined that the data type of the data provider is large data meeting a preset standard; and the second storage position determining module is configured to determine that the storage position is a third-party storage position except for the data supplier and the data demander if the data type of the data supplier is judged to be small data meeting the preset standard.
Optionally, the storage location determining subunit includes: the frequency determining module is configured to determine the frequency of transmitting the data provided by the data supplier to the data demander according to the data type; a third storage location determination module configured to determine the storage location based on the frequency.
Optionally, the storage requirement determining unit includes: a storage space application receiving subunit configured to receive a storage space application from the data supplier; a storage location transmitting subunit configured to transmit an address of the storage location to the data supplier in response to the storage space application.
Optionally, the storage space application includes a storage space capacity, and the storage location is provided with a storage space having the storage space capacity.
Optionally, the instruction of the data supplier to perform an operation on the data to be stored includes an instruction of an addition or deletion or modification operation, and the data processing apparatus further includes: an indication receiving unit configured to receive an indication of the adding or deleting or modifying operation from the data supplier to add or delete or modify all or part of the data to be stored received from the data supplier.
Optionally, if the data to be stored is not added or deleted or modified, the data processing apparatus further includes: a transaction execution unit configured to perform a data transaction indicated by the data transaction information; if the data to be stored is added or deleted or modified, the data processing device further comprises: a transaction termination unit configured to terminate the data transaction indicated by the data transaction information.
Optionally, the data validity determining unit includes: and the intelligent contract triggering subunit is configured to trigger the intelligent contracts running in the block chain to perform the data transaction.
Optionally, the data validity determining unit includes: the re-encryption subunit is configured to perform re-encryption operation on the data acquired from the storage position to generate transaction data corresponding to the data transaction; and the storage address sending subunit is configured to send and store the transaction data to the data demand party.
Optionally, the re-encryption subunit includes: a re-encryption key acquisition module configured to acquire a re-encryption key generated based on a private key of the data supplier and a public key of the data demander; and the re-encryption module is configured to perform re-encryption operation on the acquired data based on the re-encryption key to generate the transaction data.
Optionally, the data to be stored includes original plaintext verification data, and the original plaintext verification data is generated according to original plaintext data of the data to be stored; the data processing apparatus further includes: an obtaining and uplink unit configured to obtain the original plaintext verification data from the data supplier, and upload the obtained original plaintext verification data to a blockchain.
The embodiment of the invention also provides a computer-readable storage medium, on which computer instructions are stored, and when the computer instructions are executed, the steps of any one of the data processing methods are executed.
The embodiment of the present invention further provides a terminal, which includes a memory and a processor, where the memory stores computer instructions capable of running on the processor, and the processor executes the steps of any one of the data processing methods when executing the computer instructions.
Compared with the prior art, the technical scheme of the embodiment of the invention has the following beneficial effects:
in an embodiment of the present invention, by determining a storage requirement of a data supplier, storing the data to be stored to the storage location determined according to the storage requirement, the storage location being configured to receive an indication that the data supplier operates on the data to be stored, in response to data transaction information, acquiring data from the storage location, the data transaction information being directed to the data to be stored, and determining that the data acquired from the storage location is valid compared with the data to be stored. The storage position is determined according to the storage requirement of the data supplier, and the data supplier can operate the data to be stored in the storage position, so that the data supplier has the right to operate the stored data, and the related regulation of the privacy protection law is met.
Furthermore, the storage position of the data is determined according to the data type of the data to be stored of the data supplier, so that the storage position can be matched with the data type, and the efficiency of the data processing method can be improved.
Furthermore, the data storage position is determined by judging the data type of the data provided by the data supplier and determining whether the data is large data or small data, the large data is stored to the data supplier, and the small data is stored to a third-party storage position except the data supplier and the data demand party, so that the data transmission cost can be saved, and the system resource can be saved.
Furthermore, the storage position of the data is determined according to the frequency of transmitting the data provided by the data supplier to the data demand party, the data with higher frequency is stored in the data transaction platform, and the data with lower frequency is stored in the data supplier or other storage positions, so that the frequency of acquiring the data from other storage positions by the data transaction platform in the data transaction process can be reduced, the data transmission cost can be saved, and the system resources can be saved.
Further, according to the application of the data supplier to the storage space, the storage position is sent to the data supplier, the storage position can be divided according to the storage requirement of the data supplier, more choices are provided for the data supplier, and data transaction can be smoothly carried out under the condition that the data supplier does not store data conveniently, so that the application scene of the data processing method is wider, and the flexibility is higher.
Furthermore, the storage space determined by the application is obtained by applying for the capacity of the storage space, so that the requirement of a data supplier on the capacity of the storage space can be met, and the use experience of the data supplier can be improved.
Furthermore, by receiving an instruction of an adding or deleting or modifying operation of the data supplier, and correspondingly adding or deleting or modifying the data stored in the storage position according to the instruction, the related requirements of the privacy protection act are met, the legal rights and interests of the data supplier can be guaranteed, and the use experience of the data supplier can be improved.
Furthermore, when the data to be stored is not added or deleted or modified, data transaction is carried out, when the data to be stored is added or deleted or modified, the data transaction is terminated, and the authenticity and the safety of transaction data can be improved under the condition that the privacy protection law is met.
Furthermore, the data transaction is carried out by triggering the intelligent contract running in the block chain, and the security of the data transaction can be improved by twisting the flow of the data transaction by the intelligent contract.
Furthermore, the public key of the data demand party and the private key of the data supplier are used for generating the re-encryption key, the re-encryption key is used for carrying out re-encryption operation on the obtained data, and transaction data are generated, so that only the data demand party can decrypt the transaction data through the private key of the data demand party and obtain the plaintext of the transaction data, and the safety of the data can be improved.
Furthermore, the original plaintext verification data uploaded to the block chain cannot be changed by acquiring the original plaintext verification data of the data supplier and uploading the original plaintext verification data to the block chain, and after the data transaction data is acquired by the data demand side, the data transaction data can be verified based on the original plaintext verification data of the block chain, so that the authenticity of the data acquired by verification can be improved, and the safety of the data can be improved.
Drawings
FIG. 1 is a flow chart of a data processing method in an embodiment of the invention;
FIG. 2 is a block diagram of a data processing system according to an embodiment of the present invention;
FIG. 3 is a flow chart of a method of determining storage requirements in an embodiment of the present invention;
FIG. 4 is a flow chart of a method for determining storage locations based on data type in an embodiment of the present invention;
FIG. 5 is a flow chart of another method for determining storage locations based on data type in an embodiment of the present invention;
FIG. 6 is a flow chart of another method of determining storage requirements in an embodiment of the present invention;
FIG. 7 is a flow chart of a method of conducting a data transaction in an embodiment of the invention;
FIG. 8 is a flow chart of a method of data encryption in an embodiment of the present invention;
fig. 9 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present invention.
Detailed Description
As described in the background art, how to provide a data processing method that satisfies the relevant regulations of the privacy protection act is a problem to be solved urgently.
In a block chain-based data transaction, data for transaction is stored in an unalterable storage location, and a data supplier cannot add, delete or modify the data stored in the storage location, which goes against the relevant regulations of the privacy protection act.
In an embodiment of the present invention, by determining a storage requirement of a data supplier, storing the data to be stored to the storage location determined according to the storage requirement, the storage location being configured to receive an indication that the data supplier operates on the data to be stored, in response to data transaction information, acquiring data from the storage location, the data transaction information being directed to the data to be stored, and determining that the data acquired from the storage location is valid compared with the data to be stored. The storage position is determined according to the storage requirement of the data supplier, and the data supplier can operate the data to be stored in the storage position, so that the data supplier has the right to operate the stored data, and the related regulation of the privacy protection law is met.
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in detail below.
Referring to the flowchart of the data processing method shown in fig. 1, in the embodiment of the present invention, the data processing specifically may include the following steps:
step S11, determining a storage requirement of a data supplier, wherein the storage requirement comprises a storage location of data to be stored of the data supplier, and the storage location is configured to receive an instruction of the data supplier to operate the data to be stored;
step S12, responding to data transaction information, acquiring data from the storage position, wherein the data transaction information points to the data to be stored;
step S13, determining that the data retrieved from the storage location is valid compared to the data to be stored.
The storage requirement of the data supplier can be determined by receiving the request of the data supplier, or according to the data type of the data to be stored, or determined by the data transaction platform according to the stored information, or can be determined in other ways. By supporting the determination of the storage requirements of the data supplier in various ways, a more flexible storage way can be provided for the data supplier, and the application scenarios of the data processing method in the embodiment of the invention can be wider.
In specific implementation, the data to be stored is generated by a data provider, and corresponds to different data providers, where the data to be stored may be different, for example, the data provider may be an intelligent hardware terminal with data processing capability, or the data provider may be a data acquisition device without data processing capability, or a cloud third party, and correspondingly, the data to be stored may be data processed by the intelligent hardware terminal, or may be data acquired by the data acquisition device and uploaded, or may be data downloaded by the data transaction platform from the cloud third party.
In a specific implementation, the data to be stored may include all or part of encrypted data, description data, and original plaintext verification data that generates original plaintext data of the encrypted data.
The encrypted data may be encrypted data generated by performing an encryption operation on the original plaintext data. The algorithm for performing encryption operation on the original plaintext data may be an asymmetric encryption algorithm, for example, an RSA algorithm, an Elgamal algorithm, a knapsack algorithm, a Rabin algorithm, a D-H algorithm, an elliptic curve encryption algorithm (ECC), and the like.
Description data may be referred to as metadata (metadata), which may be used to describe the original plaintext data, which may be derived based on the original plaintext data. The description data may include information of a period of time during which the data is generated, an area in which the data is formed, a generation apparatus of the data, and the like.
The original plaintext verification data can be used for verifying transaction data obtained after data transaction. The original plaintext verification data may be data obtained by performing an irreversible algorithm on the original plaintext data, and for example, may be hash data obtained by performing an irreversible hash algorithm on the original plaintext data. In a specific implementation, the hash algorithm may be SHA256 or SHA3, and the like, which is not limited herein. Here, the irreversible algorithm, the hash algorithm, and the like are merely examples, and the generation method of generating the original plaintext verification data from the original plaintext data is not limited.
In order to make the application scenario of the embodiment of the present invention easier to understand, the following description is further made with reference to fig. 2. Those skilled in the art will appreciate that the following scenarios are not intended to limit the scope of the embodiments of the present invention.
Fig. 2 shows a data processing system, in which the data supplier 21 may be the aforementioned intelligent hardware terminal, data acquisition device, cloud third party, and so on; the data demander 22 may be a vendor, insurance company, individual or facilitator, etc. that wants to obtain the data; a data transaction platform 23 may provide a data transaction service for the data supplier 21 and the data demander 22; the block chain 24 may be a chain data structure formed by combining data blocks in a sequential connection manner according to a time sequence, and is a distributed account book which is cryptographically guaranteed to be not falsifiable and counterfeitable; the storage system 25 is a decentralized storage system and may be a distributed storage system.
In particular implementations, the blockchain 24 may include a public, private, or federated chain, among others, and may be, for example, an ethernet (Eth), a commercial distributed design blockchain operating system (EOS), an Ontology (ONT), a star cloud chain (NAS), among others.
Wherein, the public chain is a decentralized block chain 24, and the data uploaded to the public chain cannot be tampered; the private chain is a block chain 24 with writing authority completely in one organization, and all nodes participating in the block chain 24 are strictly controlled; a federation chain refers to a blockchain 24 having several organizations or enterprises that collectively participate in the management, each organization or enterprise controlling one or more nodes that collectively record transaction data, and only those organizations and enterprises are able to read from, write to, and send data in the federation chain.
In a specific implementation, the aforementioned storage location may be a database of an intelligent hardware terminal or a data acquisition device with certain storage capability, or a database of the data transaction platform 23, and a storage node of the storage system 25. The database of the data transaction platform 23 is a centralized database, and the storage node of the storage system 25 is a decentralized storage location.
In a specific implementation, the data transaction information may be information in a data transaction process, and may be information generated by the data requiring party 22 or the data supplying party 21 in the data transaction process for the relevant operation of the data transaction.
For example, in one particular implementation, the data transaction information may be payment information for the data consumer 22. For example, the payment information may be generated by the data consumer 22 determining the purchase data and then paying for the purchased data. Alternatively, the data transaction may be continued, for example, confirmation of the order by the data consumer 22 in the case of a prepayment.
In another specific implementation of the present invention, the data transaction information may be confirmation information of the data supplier 21. For example, after the data demander 22 requests to purchase data, the data supplier 21 obtains a data transaction request issued by the data transaction platform 23, and information generated by a confirmation operation on the data transaction request.
In particular implementations, the data transaction information may be determined from a data search of the data by the data demander 22. For example, the data demander 22 may perform data search on description data for describing the data to be stored according to the demand for the data, and determine the data transaction information according to the search result.
As described above, the data to be stored may include encrypted data, description data, and original plaintext verification data, which is generated according to original plaintext data of the data to be stored. In a specific implementation, the data processing method may further include: and acquiring the original plaintext verification data from the data supplier, and uploading the acquired original plaintext verification data to a block chain.
In a specific implementation, the original plaintext verification data may be used to verify transaction data obtained after data transaction, and the data consumer 22 may determine the authenticity of the obtained data by comparing the transaction data with the original plaintext verification data on the blockchain 24 after obtaining the transaction data through the data transaction.
The original plaintext verification data uploaded to the block chain cannot be changed by acquiring the original plaintext verification data of the data supplier and uploading the original plaintext verification data to the block chain, and after the data transaction data is acquired by the data demand side, the data transaction data can be verified based on the original plaintext verification data of the block chain, so that the authenticity of the acquired data can be verified, and the security of the data transaction can be improved.
In a specific implementation, the storage requirement may be a requirement for the data supplier 21 to store the data to be stored, and may be according to a type of the data, a storage location of the data, a frequency of data transactions between the data supplier 21 and the data demander 22, and a requirement of a storage space, which are described below respectively.
In a specific implementation of the present invention, the determining the storage location according to the data type may include, with reference to fig. 3:
step S31, determining a data type of the data to be stored of the data supplier;
step S32, determining the storage location according to the data type.
The data type may be determined according to the size of the data collected by the data supplier 21, the format of the data, or the data collecting device, for example, the vehicle data may be video data, tire pressure data, voltage data, On-Board Diagnostics (OBD) data, travel data, and the like.
Further, determining the storage location according to the data type of the data supplier 21 may be determined according to the process shown in fig. 4, and specifically, may include:
step S41, if it is determined that the data type of the data provider is large data meeting a preset standard, determining that the storage location is the data provider;
step S42, if it is determined that the data type of the data supplier is the small data meeting the preset standard, determining that the storage location is a third-party storage location other than the data supplier and the data demander.
In specific implementation, the data transaction platform 23 may preset data standards of different data types, and the preset standards may be comprehensively considered from various aspects such as data format, data size, and data content. For example, data having a data size larger than a preset value may be set as large data, or data in a preset format may be set as large data, for example, video data, MP4 data, or the like may be set as large data, data having a data size smaller than a preset value, or data in another specific format may be set as small data.
The data trafficking platform 23 may determine the location of data storage by determining the data as small data or large data for the data type of the data provided by the data supplier 21. Wherein the large data can be stored in the data supplier 21, for example, the aforementioned database of the intelligent hardware terminal or the data acquisition device; the small data may be stored in a third-party storage location, wherein the third-party storage location may be a storage location other than the data supplier 21 and the data demander 22, such as the database of the data transaction platform 23 described above, or a storage node of the storage system 25, or may also be the block chain 24.
The data standard and the storage location are only examples, and the data type and the data storage location are not limited in the present invention.
The data storage position is determined by judging the data type of the data provided by the data supplier and determining that the data is large data or small data, the large data is stored to the data supplier, and the small data is stored to a third party storage position except the data supplier and the data demand side, so that the data transmission cost can be saved, and the system resource can be saved.
In a specific implementation, if the data type of the data supplier is determined to be large data, the storage location is determined to be the data supplier 21. For such an application scenario, the data transaction platform 23 may only need to obtain the original plaintext verification data from the data supplier 21, and obtain the encrypted data from the data supplier 21 when data transaction needs to be performed, so that the data amount of data uploading may be reduced, and the data uploading cost may be saved.
In another specific implementation of the present invention, the storage location of the data may be determined according to the frequency of data interaction between the data supplier 21 and the data demander 22. Specifically, referring to fig. 5, the determining the storage location according to the data type may include:
step S51, determining the frequency of data provided by the data supplier to be transmitted to the data demand side according to the data type;
step S52, determining the storage location based on the frequency.
In a specific implementation, the data supplier 21 determines the frequency of data transaction of the data corresponding to different data types according to the judgment of the data or the experience of the existing data transaction. For example, data with a higher frequency of data transactions may be stored to the data trafficking platform 23, and data with a lower frequency of data transactions may be stored to a storage node of the storage system 25 or a database of the data supplier 21.
The data transaction method has the advantages that the storage position of the data is determined according to the frequency of transmitting the data provided by the data supplier to the data demander, the data with higher frequency is stored in the data transaction platform, the data with lower frequency is stored in the data supplier or other storage positions, the frequency of acquiring the data from other storage positions by the data transaction platform in the data transaction process can be reduced, the data transmission cost can be saved, and the system resources can be saved.
As mentioned above, the data to be stored may be stored in different storage locations according to storage requirements, for example, may be stored in a database of the data supplier 21, a database of the data transaction platform 23, or a storage node of the storage system 25. In a specific implementation, the storage location of the data to be stored may be determined according to the requirement of the data supplier 21 for the storage space. Referring to FIG. 6, in a specific implementation, the determining storage requirements of the data supplier may include:
a step S61 of receiving a storage space application from the data supplier;
step S62, sending the address of the storage location to the data supplier in response to the storage space request.
In particular implementations, the data trafficking platform 23 may determine the storage location based on the storage space request of the data supplier 21. For example, if the data supplier 21 applies for storage in the data transaction platform 23, the data transaction platform 23 allocates the storage space of the database of the data transaction platform 23 to the data supplier 21, and sends the address of the storage location to the supplier 21; if the data supplier 21 applies for storage in the storage system 25, the data transaction platform 23 allocates a storage node of the storage system 25 to the data supplier 21.
In a specific implementation, the data supplier 21 may be an address link according to the received address of the storage location, and the data supplier 21 may enter the storage location by triggering the address link.
According to the application of the data supplier to the storage space, the address of the storage position is sent to the data supplier, the storage position can be divided according to the storage requirement of the data supplier, more choices are provided for the data supplier, and data transaction can be smoothly carried out under the condition that the data supplier does not store data conveniently, so that the application scene of the data processing method is wider, and the flexibility is higher.
Further, the storage space application may include a storage space capacity, and the storage location is provided with a storage space having the storage space capacity.
In a specific implementation, the data transaction platform 23 may allocate a certain amount of storage space to the data supplier 21 according to the storage space application of the data supplier 21. The certain capacity may be a preset storage space capacity of the data transaction platform 23, for example, if the data transaction platform 23 presets that each data supplier 21 may have 10G of storage space, 10G of storage space is allocated to the data supplier 21; alternatively, the storage space capacity may be determined according to the request of the data supplier 21, for example, the data supplier 21 requests 10G of storage space, and the data transaction platform 23 allocates 10G of storage space to the data supplier 21. Here, "10G", "constant capacity", and the like are merely examples, and do not limit the capacity of the storage space.
In a specific implementation, if the capacity of the storage space allocated by the data transaction platform 23 is insufficient or too small, the data supplier 21 may obtain a larger storage space by applying for additional capacity to the data transaction platform 23.
Through the application of the storage space capacity, the storage space determined by the application of the storage space capacity is obtained, the requirement of a data supplier on the storage space capacity can be met, and the use experience of the data supplier can be improved.
In particular implementations, the data trafficking platform 23 may store data stored in a storage location to other storage locations according to the storage requirements of the data supplier 21.
For example, the data transaction platform 23 may transfer data stored in a database of the data transaction platform 23 to a storage node of the storage system 25 according to the storage requirement of the data supplier 21, or may also transfer data in a database of the data supplier 21 to a database of the data transaction platform 23.
It should be noted that the above data transfer manner is only an example, and is not a limitation on allocation of the storage location to the data transaction platform 23.
As mentioned in the background, the storage of existing data transactions needs to meet the relevant regulations of the privacy preserving act, i.e. the data supplier 21 can operate on the data to be stored at the storage location. In a specific implementation, the instruction of the data supplier to perform an operation on the data to be stored includes an instruction of an addition, deletion, or modification operation, and the data processing method may further include: receiving an indication of the adding or deleting or modifying operation from the data supplier to perform the adding or deleting or modifying operation on all or part of the data to be stored received from the data supplier 21.
In a specific implementation, the data transaction platform 23 may add, delete or modify part of the data to be stored in the storage location according to the request of the data supplier 21, for example, delete encrypted data of the data to be stored, or modify all the data to be processed stored in the storage location.
By receiving the instruction of the operation of adding, deleting or modifying the data supplier, and correspondingly adding, deleting or modifying the data to be stored in the storage position according to the instruction, the related requirements of the privacy protection act are met, the legal rights and interests of the data supplier can be guaranteed, and the user experience can be improved.
In a specific implementation, if the data to be stored is not added or deleted or modified, the data processing method may further include: and performing data transaction indicated by the data transaction information. If the data to be stored is added, deleted or modified, the data processing method may further include: terminating the data transaction indicated by the data transaction information.
When the data to be stored is not added or deleted or modified, data transaction is carried out, when the data to be stored is added or deleted or modified, the data transaction is terminated, and the authenticity and the safety of transaction data can be improved under the condition that the privacy protection law is met.
In a specific implementation, the original plaintext verification data uploaded to the block chain 24 has an association relationship with the data to be stored, and the original plaintext verification data uploaded to the block chain 24 cannot be added or deleted or changed, so as to verify the authenticity of the data acquired from the storage location.
If the data supplier 21 adds or deletes or modifies the data to be stored, the association relationship between the original plaintext verification data on the blockchain 24 and the data to be stored will change, and the data transaction platform 23 may determine that the data acquired from the storage location has been added or deleted or modified relative to the data to be stored by determining that the association relationship has changed, and may terminate the transaction.
As mentioned above, the data supplier 21 may add or delete or modify the data to be stored, and the data transaction platform 23 is required to verify the data acquired from the storage location in order to ensure the authenticity of the data acquired by the data demander 22. Specifically, the verification can be performed as follows.
For example, the transaction verification data generated from the original verification data of the data to be stored provided by the data supplier 21 and the data acquired from the storage location may be compared to determine whether the acquired data is added or deleted or modified.
The original verification data is generated based on the data to be stored, and different data to be stored correspond to different original verification data, so that the data to be stored can be verified through the original verification data.
In a specific implementation, the original verification data may be data obtained by performing an irreversible algorithm on the data to be stored, and may be specifically described as above, and is not described herein again.
In different scenarios, the data obtained by the data transaction platform 23 from the storage location may be consistent or inconsistent with the data to be stored, or may be null data. In a specific implementation, the transaction verification data may be generated in a manner consistent with the generation of the original verification data, that is, the transaction verification data is obtained by performing an irreversible algorithm on the acquired data.
In a specific implementation, the comparing the original verification data of the data to be stored and the transaction verification data generated from the acquired data to determine the authenticity of the acquired data may be comparing whether the original verification data is consistent with the transaction verification data, and determining whether the acquired data is added or deleted or modified relative to the data to be stored.
Specifically, if the original verification data is consistent with the transaction verification data, it is determined that the acquired data is not added or deleted or modified relative to the data to be stored, and if the original verification data is inconsistent with the transaction verification data, it is determined that the acquired data is added or deleted or modified relative to the data to be stored.
In a specific implementation, if the data acquired from the storage location is not added or deleted or modified relative to the data to be stored, the data transaction indicated by the data transaction information is performed, and performing the data transaction indicated by the data transaction information may include: and triggering an intelligent contract running in a block chain to perform the data transaction.
Where an intelligent contract is a piece of code running on blockchain 24, the logic of the code defines the content of the intelligent contract, and the account of the contract retains the running state of the contract. In the practice of the present invention, data transactions may be conducted by triggering smart contracts running on the blockchain 24.
The data transaction is carried out by triggering the intelligent contract running in the block chain, and the security of the data transaction can be improved by twisting the flow of the data transaction by the intelligent contract.
In a specific implementation, referring to fig. 7, the performing of the data transaction indicated by the data transaction information may include:
step S71, performing re-encryption operation on the data acquired from the storage location to generate transaction data corresponding to the data transaction;
and step S72, sending the transaction data to a data demand party.
In a specific implementation, the data transaction platform 23 may re-encrypt the encrypted data obtained from the storage location, for example, may re-encrypt the data by proxy, and may generate transaction data corresponding to the data transaction by performing proxy re-encryption on the encrypted data. In other embodiments, other encryption manners are also possible, which is not limited in this regard.
Specifically, referring to fig. 8, the performing a re-encryption operation on the data obtained from the storage location may include:
step S81, obtaining a re-encryption key, where the re-encryption key is generated based on the private key of the data supplier and the public key of the data demander;
step S82, performing a re-encryption operation on the acquired data based on the re-encryption key, and generating the transaction data.
In a particular implementation, the re-encryption key may be generated by the data supplier 21. Specifically, the data supplier 21 may obtain the public key of the data demander 22, and generate the re-encryption key according to the public key of the data demander 22 and the private key of the data supplier 21.
In a specific implementation, the data supplier 21 may obtain the public key of the data demander 22 through the data transaction platform 23, or may obtain the public key directly from the data demander 22, which is not limited to this.
The data transaction platform 23 may perform re-encryption operation on the data obtained from the storage location according to the re-encryption key provided by the data supplier 21, so as to obtain the transaction data. In other embodiments, if the data supplier 21 can encrypt the data, the transaction data can be generated by the data supplier 21 through re-encryption.
In particular implementations, the generated transaction data may be stored in a database of the data trafficking platform 23, and the transaction data may be provided to the data consumer 22 in a variety of traffic patterns. For example, a storage address of a specified term may be generated, and the transaction data is stored in the storage address, and the data transaction platform 23 may issue the storage address for storing the transaction data to the data demanding party 22 in a form of mail or short message, so that the data demanding party 22 may obtain the transaction data of the storage address through the received storage address.
The public key of the data demand party and the private key of the data supplier equipment are used for generating the re-encryption key, the re-encryption key is used for carrying out re-encryption operation on the obtained data, and transaction data are generated.
An embodiment of the present invention further provides a data processing apparatus, a schematic structural diagram of which is shown in fig. 9, and the data processing apparatus may specifically include:
a storage demand determination unit 91 configured to determine a storage demand of a data supplier, the storage demand including a storage location of data to be stored of the data supplier;
a storage data obtaining unit 92 configured to obtain data from the storage location in response to data transaction information, the data transaction information being directed to the data to be stored;
a data validity determination unit 93 configured to determine that the data acquired from the storage location is valid compared to the data to be stored.
In a specific implementation, the storage requirement determining unit 91 may include:
a data type determination subunit 911 configured to determine a data type of the data to be stored of the data supplier;
a storage location determination subunit 912 configured to determine the storage location according to the data type.
In a specific implementation of the present invention, the storage location determining subunit 912 may include:
a first storage location determining module 9121, configured to determine the storage location as the data supplier if the data type of the data supplier is judged to be large data meeting a preset standard;
a second storage location determining module 9122, configured to determine the storage location to be a third-party storage location other than the data supplier and the data demander if the data type of the data supplier is judged to be the small data meeting the preset standard.
In another specific implementation of the present invention, the storage location determining sub-unit 912 may include:
a frequency determining module 9123, configured to determine the frequency of transmitting the data provided by the data supplier to the data demander according to the data type;
a third storage location determining module 9124 configured to determine the storage location based on the frequency.
In a specific implementation, the storage requirement determining unit 91 may include:
a storage space application receiving subunit 913 configured to receive a storage space application from the data supplier;
a storage location transmitting sub-unit 914 configured to transmit an address of the storage location to the data supplier in response to the storage space application.
Further, the storage space application may include a storage space capacity, and the storage location is provided with a storage space having the storage space capacity.
In a specific implementation, the instruction of the data supplier to perform the operation on the data to be stored may include an instruction of adding, deleting, or modifying the operation, and the data processing apparatus may further include: an indication receiving unit 94 configured to receive an indication of the adding or deleting or modifying operation from the data supplier to add or delete or modify all or part of the data to be stored received from the data supplier.
In a specific implementation, if the data to be stored is not added or deleted or modified, the data processing apparatus may further include: a transaction executing unit 95 configured to perform the data transaction indicated by the data transaction information. If the data to be stored is added or deleted or modified, the data processing apparatus may further include: a transaction termination unit 96 configured to terminate the data transaction indicated by the data transaction information.
In a specific implementation, the data validity determination unit 93 may include: and an intelligent contract triggering sub-unit 931 configured to trigger the intelligent contracts running in the blockchain to perform the data transaction.
In a specific implementation, the data validity determination unit 93 may include:
a re-encryption subunit 932 configured to perform a re-encryption operation on the data obtained from the storage location, and generate transaction data corresponding to the data transaction;
a storage address sending subunit 933 configured to send and store the transaction data to the data demanding party.
Specifically, the re-encryption subunit 932 may include:
a re-encryption key obtaining module 9321 configured to obtain a re-encryption key, the re-encryption key being generated based on a private key of the data supplier and a public key of the data demander;
a re-encryption module 9322 configured to perform a re-encryption operation on the acquired data based on the re-encryption key to generate the transaction data.
In a specific implementation, the data to be stored may include original plaintext verification data, and the original plaintext verification data may be generated according to the original plaintext data of the data to be stored; the data processing apparatus may further include: an acquiring and uplink unit 97 configured to acquire the original plaintext verification data from the data supplier, and upload the acquired original plaintext verification data to a blockchain.
The noun explanation, the working principle, the specific implementation and the beneficial effects related to the data processing apparatus in the embodiment of the present invention can be referred to the data processing method in the embodiment of the present invention, and are not described herein again.
The embodiment of the present invention further provides a computer-readable storage medium, where computer instructions are stored, and when the computer instructions are executed, the steps of the data processing method may be executed.
The computer readable storage medium may be an optical disc, a mechanical hard disk, a solid state hard disk, etc.
An embodiment of the present invention further provides a terminal, which may include a memory and a processor, where the memory stores a computer instruction capable of running on the processor, and the processor executes the steps of the data processing method when running the computer instruction.
Although the present invention is disclosed above, the present invention is not limited thereto. Various changes and modifications may be effected therein by one skilled in the art without departing from the spirit and scope of the invention as defined in the appended claims.

Claims (24)

1. A data processing method, comprising:
determining a storage demand of a data supplier, wherein the storage demand comprises a storage location of data to be stored of the data supplier, and the storage location is configured to receive an indication of an operation performed on the data to be stored by the data supplier so that the data supplier has a right of the operation on the data to be stored in the storage location;
responding to data transaction information, and acquiring data from the storage position, wherein the data transaction information points to the data to be stored;
determining that the data retrieved from the storage location is valid compared to the data to be stored;
wherein the determining storage requirements of the data supplier comprises:
determining a data type of the data to be stored of the data supplier, wherein the data type at least comprises a data size or a data format;
and determining the storage position according to the data type.
2. The data processing method of claim 1, wherein determining the storage location based on the data type of the data supplier comprises:
if the data type of the data supplier is judged to be large data meeting a preset standard, determining that the storage position is located in the data supplier;
and if the data type of the data supplier is judged to be the small data meeting the preset standard, determining the storage position to be a third-party storage position except the data supplier and the data demand party.
3. The data processing method of claim 1, wherein determining the storage location based on the data type comprises:
determining the frequency of transmitting the data provided by the data supplier to the data demander according to the data type;
determining the storage location based on the frequency.
4. The data processing method of claim 1, wherein the determining storage requirements of a data supplier comprises:
receiving a storage space request from the data supplier;
and responding to the memory space application, and sending the address of the memory location to the data supplier.
5. The data processing method according to claim 4, wherein the storage space application comprises a storage space capacity, and the storage location is provided with a storage space having the storage space capacity.
6. The data processing method according to claim 1, wherein the indication that the data supplier operates on the data to be stored comprises an indication of an add or delete or modify operation, the data processing method further comprising:
receiving an indication of the add or delete or modify operation from the data supplier to add or delete or modify all or part of the data to be stored received from the data supplier.
7. The data processing method of claim 6, wherein if the data to be stored is not added or deleted or modified, the data processing method further comprises: performing data transaction indicated by the data transaction information;
if the data to be stored is added or deleted or modified, the data processing method further comprises the following steps: terminating the data transaction indicated by the data transaction information.
8. The data processing method of claim 1, wherein the performing the data transaction indicated by the data transaction information comprises: and triggering an intelligent contract running in a block chain to perform the data transaction.
9. The data processing method of claim 1, wherein the performing the data transaction indicated by the data transaction information comprises:
carrying out re-encryption operation on the data acquired from the storage position to generate transaction data corresponding to the data transaction;
and sending the transaction data to a data demand party.
10. The data processing method of claim 9, wherein performing a re-encryption operation on the data retrieved from the storage location comprises:
obtaining a re-encryption key, wherein the re-encryption key is generated based on a private key of the data supplier and a public key of the data demander;
and carrying out re-encryption operation on the acquired data based on the re-encryption key to generate the transaction data.
11. The data processing method according to claim 1, wherein the data to be stored comprises original plaintext validation data, the original plaintext validation data being generated from original plaintext data of the data to be stored;
the data processing method further comprises:
and acquiring the original plaintext verification data from the data supplier, and uploading the acquired original plaintext verification data to a block chain.
12. A data processing apparatus, comprising:
a storage requirement determining unit configured to determine a storage requirement of a data supplier, the storage requirement including a storage location of data to be stored of the data supplier, the storage location being configured to receive an indication that the data supplier operates on the data to be stored, so that the data supplier has an operation right on the data to be stored in the storage location;
a storage data acquisition unit configured to acquire data from the storage location in response to data transaction information, the data transaction information being directed to the data to be stored;
a data validity determination unit configured to determine that data acquired from the storage location is valid compared to the data to be stored;
the storage demand determination unit includes:
a data type determining subunit configured to determine a data type of the data to be stored of the data supplier, wherein the data type includes at least a data size or a data format;
a storage location determination subunit configured to determine the storage location according to the data type.
13. The data processing apparatus of claim 12, wherein the storage location determining subunit comprises:
a first storage location determining module configured to determine that the storage location is the data provider if it is determined that the data type of the data provider is large data meeting a preset standard;
and the second storage position determining module is configured to determine that the storage position is a third-party storage position except for the data supplier and the data demander if the data type of the data supplier is judged to be small data meeting the preset standard.
14. The data processing apparatus of claim 12, wherein the storage location determining subunit comprises: the frequency determining module is configured to determine the frequency of transmitting the data provided by the data supplier to the data demander according to the data type;
a third storage location determination module configured to determine the storage location based on the frequency.
15. The data processing apparatus of claim 12, wherein the storage demand determination unit comprises:
a storage space application receiving subunit configured to receive a storage space application from the data supplier;
a storage location transmitting subunit configured to transmit an address of the storage location to the data supplier in response to the storage space application.
16. A data processing apparatus as claimed in claim 15, characterized in that the storage space application comprises a storage space capacity, the storage location being provided with a storage space having the storage space capacity.
17. The data processing apparatus according to claim 12, wherein the indication of the data supplier to perform the operation on the data to be stored comprises an indication of an add or delete or modify operation, the data processing apparatus further comprising: an indication receiving unit configured to receive an indication of the adding or deleting or modifying operation from the data supplier to add or delete or modify all or part of the data to be stored received from the data supplier.
18. The data processing apparatus according to claim 17, wherein if the data to be stored is not added or deleted or modified, the data processing apparatus further comprises: a transaction execution unit configured to perform a data transaction indicated by the data transaction information;
if the data to be stored is added or deleted or modified, the data processing device further comprises: a transaction termination unit configured to terminate the data transaction indicated by the data transaction information.
19. The data processing apparatus according to claim 12, wherein the data validity determination unit includes: and the intelligent contract triggering subunit is configured to trigger the intelligent contracts running in the block chain to perform the data transaction.
20. The data processing apparatus according to claim 12, wherein the data validity determination unit includes:
the re-encryption subunit is configured to perform re-encryption operation on the data acquired from the storage position to generate transaction data corresponding to the data transaction;
and the storage address sending subunit is configured to send and store the transaction data to the data demand party.
21. The data processing apparatus of claim 20, wherein the re-encryption subunit comprises:
a re-encryption key acquisition module configured to acquire a re-encryption key generated based on a private key of the data supplier and a public key of the data demander;
and the re-encryption module is configured to perform re-encryption operation on the acquired data based on the re-encryption key to generate the transaction data.
22. The data processing apparatus according to claim 12, wherein the data to be stored includes original plaintext validation data, the original plaintext validation data being generated from original plaintext data of the data to be stored; the data processing apparatus further includes: an obtaining and uplink unit configured to obtain the original plaintext verification data from the data supplier, and upload the obtained original plaintext verification data to a blockchain.
23. A computer readable storage medium having stored thereon computer instructions, characterized in that the computer instructions are operative to perform the steps of the data processing method according to any one of claims 1 to 11.
24. A terminal comprising a memory and a processor, the memory having stored thereon computer instructions executable on the processor, wherein the processor, when executing the computer instructions, performs the steps of the data processing method of any one of claims 1 to 11.
CN201811613037.6A 2018-12-27 2018-12-27 Data processing method and device, medium and terminal thereof Active CN109754251B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811613037.6A CN109754251B (en) 2018-12-27 2018-12-27 Data processing method and device, medium and terminal thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811613037.6A CN109754251B (en) 2018-12-27 2018-12-27 Data processing method and device, medium and terminal thereof

Publications (2)

Publication Number Publication Date
CN109754251A CN109754251A (en) 2019-05-14
CN109754251B true CN109754251B (en) 2022-02-01

Family

ID=66404103

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811613037.6A Active CN109754251B (en) 2018-12-27 2018-12-27 Data processing method and device, medium and terminal thereof

Country Status (1)

Country Link
CN (1) CN109754251B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110276213B (en) * 2019-06-24 2021-03-16 恒宝股份有限公司 Smart card and storage and verification method for sensitive result thereof

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108573381A (en) * 2017-03-09 2018-09-25 北京京东尚科信息技术有限公司 Data processing method and device
CN108765240A (en) * 2018-07-16 2018-11-06 阿里巴巴集团控股有限公司 Inter-agency customer authentication method, transaction monitoring and managing method based on block chain and device

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10075298B2 (en) * 2015-06-02 2018-09-11 ALTR Solutions, Inc. Generation of hash values within a blockchain
CN107040582B (en) * 2017-02-17 2020-08-14 创新先进技术有限公司 Data processing method and device
CN107294709A (en) * 2017-06-27 2017-10-24 阿里巴巴集团控股有限公司 A kind of block chain data processing method, apparatus and system
CN107918666B (en) * 2017-11-24 2020-05-12 中钞信用卡产业发展有限公司杭州区块链技术研究院 Data synchronization method and system on block chain
CN108829350B (en) * 2018-05-31 2020-02-21 阿里巴巴集团控股有限公司 Data migration method and device based on block chain
CN108985934B (en) * 2018-07-06 2021-12-17 深圳源码智能科技有限公司 Block chain modification method and device

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108573381A (en) * 2017-03-09 2018-09-25 北京京东尚科信息技术有限公司 Data processing method and device
CN108765240A (en) * 2018-07-16 2018-11-06 阿里巴巴集团控股有限公司 Inter-agency customer authentication method, transaction monitoring and managing method based on block chain and device

Also Published As

Publication number Publication date
CN109754251A (en) 2019-05-14

Similar Documents

Publication Publication Date Title
CN111092727B (en) Method and device for sharing cluster key
CN111090888B (en) Contract verification method and device
CN109144961B (en) Authorization file sharing method and device
CN111092726B (en) Method and device for generating shared contract key
US9735962B1 (en) Three layer key wrapping for securing encryption keys in a data storage system
CN111090875A (en) Contract deployment method and device
CN108833091B (en) Encryption method, decryption method and device for log file
CN110580412B (en) Permission query configuration method and device based on chain codes
US11546348B2 (en) Data service system
CN108898021B (en) Threat information processing method, system and computing device based on block chain
CN110543510B (en) Bill data processing method, device, storage medium and computer equipment
CN111723060B (en) Blacklist data sharing method and system based on blockchain
CN109509099B (en) Data transaction method and device, computing equipment and storage medium
EP3804218B1 (en) Blockchain based access control using time-dependent obfuscation of access tokens
CN104967591A (en) Cloud storage data read-write method and device, and read-write control method and device
CN105635320A (en) Method and equipment for calling configuration information
CN104615929A (en) Security key device for secure cloud services, and system and method of providing security cloud services
CN108459829B (en) Data storage method and device and computer storage medium
CN109754251B (en) Data processing method and device, medium and terminal thereof
CN108809631B (en) Quantum key service management system and method
CN105553661A (en) Key management method and apparatus
CN115426106B (en) Identity authentication method, device and system, electronic equipment and storage medium
CN110851851A (en) Authority management method, device and equipment in block chain type account book
CN109818915B (en) Information processing method and device, server and readable storage medium
US20160381036A1 (en) Resource restriction

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant