CN112866222A - Data processing method and device and data processing device - Google Patents

Data processing method and device and data processing device Download PDF

Info

Publication number
CN112866222A
CN112866222A CN202110033673.7A CN202110033673A CN112866222A CN 112866222 A CN112866222 A CN 112866222A CN 202110033673 A CN202110033673 A CN 202110033673A CN 112866222 A CN112866222 A CN 112866222A
Authority
CN
China
Prior art keywords
data
ciphertext
computing device
ciphertext data
edge computing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110033673.7A
Other languages
Chinese (zh)
Other versions
CN112866222B (en
Inventor
陈洪博
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huakong Tsingjiao Information Technology Beijing Co Ltd
Original Assignee
Huakong Tsingjiao Information Technology Beijing Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huakong Tsingjiao Information Technology Beijing Co Ltd filed Critical Huakong Tsingjiao Information Technology Beijing Co Ltd
Priority to CN202110033673.7A priority Critical patent/CN112866222B/en
Publication of CN112866222A publication Critical patent/CN112866222A/en
Application granted granted Critical
Publication of CN112866222B publication Critical patent/CN112866222B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00Network architectures or network communication protocols for network security
    • H04L63/04Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks
    • H04L63/0428Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60Protecting data
    • G06F21/602Providing cryptographic facilities or services

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Bioethics (AREA)
  • Computing Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computer And Data Communications (AREA)

Abstract

The embodiment of the invention provides a data processing method and device and a device for data processing. The method comprises the following steps: determining metadata corresponding to ciphertext data required by a ciphertext computing task; sending the metadata to a cloud management node to acquire positioning information corresponding to the ciphertext data returned by the cloud management node according to the metadata; acquiring the ciphertext data from a second edge computing device corresponding to the positioning information; and sending the ciphertext computing task and the ciphertext data to a computing node so that the computing node executes the ciphertext computing task by using the ciphertext data. The embodiment of the invention can form a secure computing cooperative network between the edge computing devices, realize data sharing between the edge computing devices on the basis of ensuring data security, and meet the requirement of big data processing.

Description

Data processing method and device and data processing device
Technical Field
The present invention relates to the field of computer technologies, and in particular, to a data processing method and apparatus, and an apparatus for data processing.
Background
An IoT (internet of things) edge computing device is a core device applied to a distributed computing architecture. In the distributed computing architecture, the edge nodes access the distributed computing system through the IoT edge computing device, and the operations of the application programs, data and services are transferred from the network center node to the edge nodes on the network logic for processing. The IoT edge computing device is closer to the ue device, so that the data processing and transmission speed can be increased and the delay can be reduced. Under the structure, the analysis of the data and the generation of knowledge are closer to the source of the data, so that the data processing method is more suitable for processing large data.
However, when private data of a user is shared among IoT edge computing devices, private data leakage is easily generated. Moreover, because the edge nodes and the distributed computing system and the edge nodes are not trusted with each other, only small-scale data sharing or no data sharing is performed, a data island is formed, and the requirement of processing large data cannot be met.
Disclosure of Invention
Embodiments of the present invention provide a data processing method and apparatus, and an apparatus for data processing, which can form a secure computing cooperative network between edge computing devices, implement data sharing between edge computing devices on the basis of ensuring data security, and meet a requirement for big data processing.
In order to solve the above problem, an embodiment of the present invention discloses a data processing method applied to a first edge computing device, where the method includes:
determining metadata corresponding to ciphertext data required by a ciphertext computing task;
sending the metadata to a cloud management node to acquire positioning information corresponding to the ciphertext data returned by the cloud management node according to the metadata;
acquiring the ciphertext data from a second edge computing device corresponding to the positioning information;
and sending the ciphertext computing task and the ciphertext data to a computing node so that the computing node executes the ciphertext computing task by using the ciphertext data.
Optionally, the obtaining the ciphertext data from the second edge computing device corresponding to the positioning information includes:
establishing a first communication link with the second edge computing device based on a heterogeneous communication protocol;
obtaining the ciphertext data from the second edge computing device via the first communication link.
Optionally, the method further comprises:
setting data probes for input data and output data in the first edge computing equipment in the ciphertext computing task execution process;
monitoring input data and output data change information in the first edge computing device based on the data probe;
and debugging the functional component in the first edge computing device according to the change information.
Optionally, before the sending the ciphertext computing task and the ciphertext data to the computing node, the method further includes:
acquiring a computing node list from the cloud management node, wherein the computing node list is determined by the cloud management node according to the resource use condition of each computing node, and the computing delay of the computing node in the computing node list is smaller than a preset threshold value;
and determining the computing nodes participating in the ciphertext computing task in the computing node list.
Optionally, the method further comprises:
receiving a control instruction for the ciphertext computing task;
and responding to the control instruction, and controlling the ciphertext computing task, wherein the control instruction comprises any one of a task starting instruction, a task ending instruction and a task modifying instruction.
Optionally, before determining metadata corresponding to ciphertext data required by the ciphertext computation task, the method further includes:
and under the condition of meeting the preset time, creating a ciphertext computing task according to the received service requirement.
Optionally, after the sending the ciphertext computing task and the ciphertext data to a computing node to enable the computing node to execute the ciphertext computing task using the ciphertext data, the method further includes:
establishing a second communication link with the computing node based on a communication protocol supported by the computing node;
and acquiring a calculation result obtained by the calculation node executing the ciphertext calculation task through the second communication link.
Optionally, the metadata corresponding to the ciphertext data includes at least one of a data type, a data tag, and a feature description of the ciphertext data.
The embodiment of the invention also discloses a data processing method applied to the second edge computing device, which comprises the following steps:
encrypting the acquired data to obtain ciphertext data;
sending positioning information corresponding to the ciphertext data and metadata corresponding to the ciphertext data to a cloud management node so as to register the ciphertext data in the cloud management node;
and sending the ciphertext data to a first edge computing device to enable the first edge computing device to execute a ciphertext computing task by scheduling a computing node through the ciphertext data.
Optionally, the sending the ciphertext data to the first edge computing device includes:
establishing a first communication link with the first edge computing device based on a heterogeneous communication protocol;
transmitting the ciphertext data to the first edge computing device over the first communication link.
Optionally, before the encrypting the collected data, the method further includes:
preprocessing acquired data to obtain processed acquired data, wherein the preprocessing comprises at least one of denoising processing, filtering processing, screening processing and normalization processing;
the encrypting process of the collected data comprises the following steps:
and encrypting the processed collected data to obtain ciphertext data.
Optionally, the method further comprises:
setting data probes for input data and output data in the second edge computing equipment in the cryptograph computing task execution process;
monitoring input data and output data change information in the second edge computing device based on the data probe;
and debugging the functional components in the second edge computing equipment according to the change information.
Optionally, the metadata corresponding to the ciphertext data includes at least one of a data type, a data tag, and a feature description of the ciphertext data.
On the other hand, the embodiment of the invention discloses a data processing device, which is applied to first edge computing equipment, and the device comprises:
the metadata determining module is used for determining metadata corresponding to ciphertext data required by the ciphertext computing task;
the positioning information acquisition module is used for sending the metadata to a cloud management node so as to acquire positioning information corresponding to the ciphertext data returned by the cloud management node according to the metadata;
the ciphertext data acquisition module is used for acquiring the ciphertext data from the second edge computing device corresponding to the positioning information;
and the data sending module is used for sending the ciphertext computing task and the ciphertext data to a computing node so that the computing node executes the ciphertext computing task by using the ciphertext data.
Optionally, the ciphertext data acquiring module includes:
a first communication link establishing sub-module for establishing a first communication link with the second edge computing device based on a heterogeneous communication protocol;
a ciphertext data obtaining sub-module to obtain the ciphertext data from the second edge computing device via the first communication link.
Optionally, the apparatus further comprises:
the first setting module is used for setting data probes for input data and output data in the first edge computing equipment in the cryptograph computing task execution process;
a first monitoring module to monitor information of changes in input data and output data in the first edge computing device based on the data probe;
and the first debugging module is used for debugging the functional component in the first edge computing device according to the change information.
Optionally, the apparatus further comprises:
the computing node list obtaining module is used for obtaining a computing node list from the cloud management node, wherein the computing node list is determined by the cloud management node according to the resource use condition of each computing node, and the computing delay of the computing node in the computing node list is smaller than a preset threshold value;
and the computing node determining module is used for determining the computing nodes participating in the ciphertext computing task in the computing node list.
Optionally, the apparatus further comprises:
the control instruction receiving module is used for receiving a control instruction aiming at the ciphertext computing task;
and the control instruction response module is used for responding to the control instruction and controlling the ciphertext computing task, wherein the control instruction comprises any one of a task starting instruction, a task ending instruction and a task modifying instruction.
Optionally, the apparatus further comprises:
and under the condition of meeting the preset time, creating a ciphertext computing task according to the received service requirement.
Optionally, the apparatus further comprises:
a second communication link establishing module for establishing a second communication link with the computing node based on a communication protocol supported by the computing node;
and the calculation result acquisition module is used for acquiring a calculation result obtained by the calculation node executing the ciphertext calculation task through the second communication link.
Optionally, the metadata corresponding to the ciphertext data includes at least one of a data type, a data tag, and a feature description of the ciphertext data.
The embodiment of the invention also discloses a data processing device applied to the second edge computing equipment, which comprises:
the encryption processing module is used for encrypting the acquired data to obtain ciphertext data;
the ciphertext data registration module is used for sending the positioning information corresponding to the ciphertext data and the metadata corresponding to the ciphertext data to a cloud management node so as to register the ciphertext data in the cloud management node;
and the ciphertext data sending module is used for sending the ciphertext data to the first edge computing device so that the first edge computing device executes a ciphertext computing task by using the ciphertext data through the scheduling computing node.
Optionally, the ciphertext data sending module includes:
a third communication link establishing sub-module for establishing a first communication link with the first edge computing device based on a heterogeneous communication protocol;
and the ciphertext data sending sub-module is used for sending the ciphertext data to the first edge computing device through the first communication link.
Optionally, the apparatus further comprises:
the preprocessing module is used for preprocessing acquired data to obtain processed acquired data, and the preprocessing comprises at least one of denoising processing, filtering processing, screening processing and normalization processing;
the encryption processing module comprises:
and the encryption processing submodule is used for carrying out encryption processing on the processed acquired data to obtain ciphertext data.
Optionally, the apparatus further comprises:
the second setting module is used for setting data probes for input data and output data in the second edge computing equipment in the cryptograph computing task execution process;
a second monitoring module to monitor change information of input data and output data in the second edge computing device based on the data probe;
and the second debugging module is used for debugging the functional component in the second edge computing device according to the change information.
Optionally, the metadata corresponding to the ciphertext data includes at least one of a data type, a data tag, and a feature description of the ciphertext data.
In yet another aspect, an embodiment of the present invention discloses an apparatus for data processing, applied to a first edge computing device, the apparatus including a memory, and one or more programs, wherein the one or more programs are stored in the memory, and the one or more programs configured to be executed by the one or more processors include instructions for:
determining metadata corresponding to ciphertext data required by a ciphertext computing task;
sending the metadata to a cloud management node to acquire positioning information corresponding to the ciphertext data returned by the cloud management node according to the metadata;
acquiring the ciphertext data from a second edge computing device corresponding to the positioning information;
and sending the ciphertext computing task and the ciphertext data to a computing node so that the computing node executes the ciphertext computing task by using the ciphertext data.
Optionally, the obtaining the ciphertext data from the second edge computing device corresponding to the positioning information includes:
establishing a first communication link with the second edge computing device based on a heterogeneous communication protocol;
obtaining the ciphertext data from the second edge computing device via the first communication link.
Optionally, the device is also configured to execute the one or more programs by the one or more processors including instructions for:
setting data probes for input data and output data in the first edge computing equipment in the ciphertext computing task execution process;
monitoring input data and output data change information in the first edge computing device based on the data probe;
and debugging the functional component in the first edge computing device according to the change information.
Optionally, prior to said sending the ciphertext computing task and the ciphertext data to the computing node, the apparatus being further configured to execute, by the one or more processors, the one or more programs including instructions for:
acquiring a computing node list from the cloud management node, wherein the computing node list is determined by the cloud management node according to the resource use condition of each computing node, and the computing delay of the computing node in the computing node list is smaller than a preset threshold value;
and determining the computing nodes participating in the ciphertext computing task in the computing node list.
Optionally, the device is also configured to execute the one or more programs by the one or more processors including instructions for:
receiving a control instruction for the ciphertext computing task;
and responding to the control instruction, and controlling the ciphertext computing task, wherein the control instruction comprises any one of a task starting instruction, a task ending instruction and a task modifying instruction.
Optionally, prior to said determining metadata corresponding to ciphertext data required by the ciphertext computing task, the apparatus is further configured to execute, by the one or more processors, the one or more programs including instructions for:
and under the condition of meeting the preset time, creating a ciphertext computing task according to the received service requirement.
Optionally, after the sending the ciphertext computing task and the ciphertext data to a compute node to cause the compute node to perform the ciphertext computing task using the ciphertext data, the apparatus being further configured to execute, by one or more processors, the one or more programs including instructions to:
establishing a second communication link with the computing node based on a communication protocol supported by the computing node;
and acquiring a calculation result obtained by the calculation node executing the ciphertext calculation task through the second communication link.
Optionally, the metadata corresponding to the ciphertext data includes at least one of a data type, a data tag, and a feature description of the ciphertext data.
The embodiment of the invention also discloses a device for data processing, which is applied to a second edge computing device, and comprises a memory and one or more programs, wherein the one or more programs are stored in the memory, and the one or more programs are configured to be executed by one or more processors and comprise instructions for:
encrypting the acquired data to obtain ciphertext data;
sending positioning information corresponding to the ciphertext data and metadata corresponding to the ciphertext data to a cloud management node so as to register the ciphertext data in the cloud management node;
and sending the ciphertext data to a first edge computing device to enable the first edge computing device to execute a ciphertext computing task by scheduling a computing node through the ciphertext data.
Optionally, the sending the ciphertext data to the first edge computing device includes:
establishing a first communication link with the first edge computing device based on a heterogeneous communication protocol;
transmitting the ciphertext data to the first edge computing device over the first communication link.
Optionally, prior to the cryptographic processing of the collected data, the device is further configured to execute the one or more programs by the one or more processors including instructions for:
preprocessing acquired data to obtain processed acquired data, wherein the preprocessing comprises at least one of denoising processing, filtering processing, screening processing and normalization processing;
the encrypting process of the collected data comprises the following steps:
and encrypting the processed collected data to obtain ciphertext data.
Optionally, the device is also configured to execute the one or more programs by the one or more processors including instructions for:
setting data probes for input data and output data in the second edge computing equipment in the cryptograph computing task execution process;
monitoring input data and output data change information in the second edge computing device based on the data probe;
and debugging the functional components in the second edge computing equipment according to the change information.
Optionally, the metadata corresponding to the ciphertext data includes at least one of a data type, a data tag, and a feature description of the ciphertext data.
In yet another aspect, an embodiment of the invention discloses a machine-readable medium having stored thereon instructions, which, when executed by one or more processors, cause an apparatus to perform a data processing method as described in one or more of the preceding.
The embodiment of the invention has the following advantages:
the embodiment of the invention provides a data processing method, which can be used for sending metadata to a cloud management node by determining the metadata corresponding to ciphertext data required by a ciphertext calculation task after determining the ciphertext calculation task so as to obtain positioning information corresponding to the ciphertext data returned by the cloud management node according to the metadata, then obtaining the ciphertext data from a second edge computing device corresponding to the positioning information, and sending the ciphertext calculation task and the ciphertext data to a calculation node, so that the calculation node executes the ciphertext calculation task by using the ciphertext data. The first edge computing device may be a data consumer of the ciphertext data, and the second edge computing device may be a data provider of the ciphertext data. By the embodiment of the invention, a secure computing cooperative network between the first edge computing device and the second edge computing device can be formed, data sharing between the edge computing devices is realized on the basis of ensuring data security, and the requirement of big data processing is met.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive labor.
FIG. 1 is a flow chart of the steps of one data processing method embodiment of the present invention;
FIG. 2 is a block diagram of an edge computing collaboration network of the present invention;
FIG. 3 is a flow chart of steps in another data processing method embodiment of the present invention;
FIG. 4 is a block diagram of an embodiment of a data processing apparatus of the present invention;
FIG. 5 is a block diagram of another data processing apparatus embodiment of the present invention;
FIG. 6 is a block diagram of an apparatus 800 for data processing of the present invention;
fig. 7 is a schematic diagram of a server in some embodiments of the invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Method embodiment
Referring to fig. 1, a flowchart illustrating steps of an embodiment of a data processing method according to the present invention is shown, where the method is applied to a first edge computing device, and specifically may include the following steps:
step 101, determining metadata corresponding to ciphertext data required by a ciphertext computing task.
And 102, sending the metadata to a cloud management node to acquire positioning information corresponding to the ciphertext data returned by the cloud management node according to the metadata.
And 103, acquiring the ciphertext data from the second edge computing device corresponding to the positioning information.
And step 104, sending the ciphertext computing task and the ciphertext data to a computing node so that the computing node executes the ciphertext computing task by using the ciphertext data.
The metadata corresponding to the ciphertext data comprises at least one of a data type, a data tag and a feature description of the ciphertext data.
The data type may be determined according to a storage type of the data, and for example, the data type may include Integer (Integer type), Long (Long Integer type), Single (Single precision floating point type), Double (Double precision floating point type), and Currency (Currency type) among Numeric data types. The data type may also be determined according to a classification standard set by a user in an actual application process, for example, the data type may be classified according to an application scenario, and the data type may include production data, security data, traffic data, and the like. The embodiment of the present invention is not particularly limited.
The data tags are used for marking the ciphertext data, and each piece of ciphertext data corresponds to one data tag. For example, for traffic data, whether the vehicle is overspeed or not may be determined according to the running speed of the vehicle, and "overspeed or not" is a data tag corresponding to the running speed of the vehicle, and "overspeed is represented by 0 and" overspeed "may be represented by 1. The data tag may also be a unique code of the data, for example, the storage address of the ciphertext data may be used as the data tag. As long as the identifier can mark the ciphertext data and facilitate classification and search of the ciphertext data, the identifier may be used as a data tag of the ciphertext data, and the embodiment of the present invention is not particularly limited.
The feature description is used to summarize data features of the ciphertext data, for example, for traffic data of a vehicle, a driving speed may be taken as a feature description of the vehicle, such as "70 km/h". As long as the information of the data characteristics of the ciphertext data can be summarized, the information can be used as the characteristic description of the ciphertext data.
After the first edge device determines the ciphertext calculation task, metadata of the required ciphertext data can be determined according to the ciphertext calculation task, so that the corresponding ciphertext data can be searched according to the metadata. For example, for a ciphertext computing task "search all cars with a speed per hour greater than 70 km within a distance range of 2 km", it may be determined that the metadata of the ciphertext data required by the ciphertext computing task includes a data type "traffic data of a car", and a feature description "speed per hour greater than 70 km within a range of 2 km", so as to further determine that the ciphertext data including the metadata is the ciphertext data required by the ciphertext computing task.
In an embodiment of the present invention, the first edge computing device may be a data consumer of the ciphertext data, and the second edge computing device may be a data provider of the ciphertext data. The computing node executes a ciphertext computing task on the received ciphertext data based on the multi-party secure computing protocol to generate a computing result, and feeds the result back to the first edge computing device which sends the ciphertext computing task. The cloud management node is used for managing, controlling and coordinating the first edge computing device, the second edge computing device and the computing nodes, and enabling the first edge computing device, the second edge computing device and the computing nodes to complete ciphertext computing tasks through cooperation. The first edge computing device, the second edge computing device, the computing nodes and the cloud management node form an edge computing cooperative network together, and the data processing method provided by the embodiment of the invention is executed to realize data sharing among the edge computing devices, so that the requirement of big data processing is met.
The specific process of data processing based on the edge computing cooperative network formed by the first edge computing device, the second edge computing device, the computing nodes and the cloud management node in the embodiment of the invention is as follows:
first, the first edge computing device analyzes the ciphertext computing task and determines metadata corresponding to ciphertext data required by the ciphertext computing task. The first edge computing device then sends the determined metadata to the cloud management node. The cloud management node stores metadata of ciphertext data provided by each edge computing device in the collaborative computing network and positioning information of each edge computing device, and the metadata of the ciphertext data provided by each edge computing device corresponds to the positioning information of the edge computing device. The second edge computing device sends the metadata and the positioning information corresponding to the ciphertext data to the cloud management node by sending a ciphertext registration request to the cloud management node, and the ciphertext data is registered at the cloud management node.
And under the condition that the cloud management node receives the metadata sent by the first edge computing device, searching the positioning information of the second edge computing device corresponding to the metadata sent by the first edge computing device according to the corresponding relation between the stored metadata and the positioning information, and feeding back the searched positioning information to the first edge computing device. And after the first edge computing device acquires the positioning information, acquiring ciphertext data from a second edge computing device corresponding to the positioning information. And then sending the ciphertext calculation task and the obtained ciphertext data to the calculation node, and executing the ciphertext calculation task by the calculation node by using the ciphertext data.
Alternatively, a URL (Uniform Resource Locator) of the ciphertext data may be used as the location information of the ciphertext data. The URL typically includes a communication Protocol, an IP (Internet Protocol) address of the second edge computing device where the ciphertext data resides, a path, and a file name of the ciphertext data. After the first edge computing device obtains the URL corresponding to the ciphertext data, the corresponding second edge computing device may be determined according to the IP address in the UPL, a communication connection may be established with the second edge computing device according to a communication protocol in the URL, and the ciphertext data may be obtained from the second edge computing device according to a storage path and a file name of the ciphertext data in the second edge computing device.
In the embodiment of the invention, the second edge computing device stores the ciphertext data in the data storage component of the second edge computing device, the cloud management node only stores the positioning information and the metadata of the ciphertext data, when the first edge computing device needs to acquire the ciphertext data to execute the ciphertext computing task, the positioning information corresponding to the ciphertext data is searched from the cloud management node according to the metadata of the required ciphertext data, then a security channel is established according to the positioning information and the second edge computing device related to the ciphertext computing task, the ciphertext data is acquired, and then the ciphertext data is delivered to the computing node to perform ciphertext computing. In the whole data processing process, the first edge computing device only acquires the ciphertext data required by the ciphertext computing task, and does not relate to any original data in the second edge computing device, so that the privacy and the safety of the data are ensured.
In an optional embodiment of the present invention, before determining metadata corresponding to ciphertext data required by the ciphertext computation task in step 101, the method further includes:
and under the condition of meeting the preset time, creating a ciphertext computing task according to the received service requirement.
The preset timing refers to meeting a trigger condition for creating a ciphertext calculation task, for example, receiving an information stream sent by another IoT device, or a timer of the first edge calculation device reaching a preset time, and so on. And when the preset time is met, the first edge computing equipment creates a ciphertext computing task according to the received service requirement.
It should be noted that the business requirement received by the first edge computing device may be a business requirement generated by the first edge computing device itself, for example, a certain workflow of the first edge computing device needs to perform the next data processing according to the computation result of the ciphertext computation. The service requirement received by the first edge computing device may also be a ciphertext computing request sent by another IoT device to the first edge computing device, and the first edge computing device needs to obtain a ciphertext computing task and then feed back a ciphertext computing result. In any case, as long as there is a business requirement in the first edge computing device, the first edge computing device may create the ciphertext computing task according to the specific business requirement when the preset time is met.
In an optional embodiment of the present invention, the obtaining, in step 103, the ciphertext data from the second edge computing device corresponding to the positioning information includes:
step S11, establishing a first communication link with the second edge computing device based on the heterogeneous communication protocol.
Step S12, obtaining the ciphertext data from the second edge computing device via the first communication link.
After the first edge computing device acquires the positioning information corresponding to the required ciphertext data from the cloud management node, a first communication link between the second edge computing device corresponding to the positioning information needs to be established according to the positioning information to form a secure channel between the first edge computing device and the second edge computing device, and then the ciphertext data is acquired from the second edge computing device through the first communication link to ensure the transmission security of the ciphertext data.
The heterogeneous communication protocol is a generic term of various different types of communication protocols, and includes but is not limited to BLE (bluetooth low Energy) protocol, NB-IoT (NarrowBand Internet of things) protocol, Sora (Software radio) protocol, Zigbee protocol, Z-Wave protocol, 802.11 protocol, CAN (controllerrane network) protocol, and other commonly used communication protocols.
The IoT edge computing device can establish communication connections with other IoT devices of different communication protocols, receive and fuse data sent by IoT devices of different types of communication protocols. In the embodiment of the present invention, the first edge computing device and the second edge computing device are both IoT edge computing devices, and both have the capability of establishing communication connection with IoT devices of different communication protocols. Therefore, in the embodiment of the present invention, the first communication link between the first edge computing device and the second edge computing device may be established according to a communication protocol of the first edge computing device, and the communication link between the first edge computing device and the second edge computing device may also be established according to a communication protocol of the second edge computing device, which is not limited in the embodiment of the present invention.
In an optional embodiment of the present invention, before the sending 104 the ciphertext computing task and the ciphertext data to the computing node, the method further includes:
step S21, a computing node list is obtained from the cloud management node, where the computing node list is determined by the cloud management node according to resource usage of each computing node, and a computation delay of a computing node in the computing node list is smaller than a preset threshold.
And step S22, determining the computing nodes participating in the ciphertext computing task in the computing node list.
In order to increase the data processing speed and reduce the computation delay, the first edge computing device needs to acquire a low-delay computing node from each computing node as a computing node for executing the ciphertext computing task. Specifically, the cloud management node monitors resource use conditions of each computing node in the edge computing cooperative network, establishes a computing node list according to the resource use conditions of each computing node, for example, establishes a graph model of each computing node based on the resource use conditions of each computing node, calculates a weight value of each graph edge, and determines the computing node list according to the weight value of the graph edge. And the calculation delay of each calculation node in the calculation node list is smaller than a preset threshold value. The first edge computing device acquires the computing node list from the cloud management node by accessing the cloud management node, and determines the computing nodes participating in the ciphertext computing task from the computing node list according to conditions which need to be met by the computing nodes required by the ciphertext computing task.
In an optional embodiment of the invention, the method further comprises:
and step S31, receiving a control instruction aiming at the ciphertext calculation task.
And step S32, responding to the control instruction, and controlling the ciphertext computing task, wherein the control instruction comprises any one of a task starting instruction, a task ending instruction and a task modifying instruction.
In the embodiment of the invention, a workflow management interface can be further arranged on the first edge computing device, and a user can remotely control the ciphertext computing task through the workflow management interface. For example, a user interaction interface is arranged on the first edge computing device to receive control instructions of a user; alternatively, the first edge computing device may establish a communication connection with a user terminal, and the user may send a control instruction for the ciphertext computing task at the terminal, and the terminal transmits the control instruction to the first edge computing device.
The control instruction comprises any one of a task starting instruction, a task ending instruction and a task modifying instruction. After receiving the control instruction for the ciphertext computation task, the first edge computing device controls the ciphertext computation task in response to the received control instruction, for example, starting the ciphertext computation task, suspending the ciphertext computation task, modifying the ciphertext computation task, and the like.
In addition, the user may also monitor the resource occupation situation of the first edge computing device in the data processing process, for example, send a resource report request to the first edge computing device, and request the first edge computing device to report the resource occupation situation and update the resource occupation situation in real time.
In an optional embodiment of the present invention, after the step 104 of sending the ciphertext computing task and the ciphertext data to a computing node, so that the computing node executes the ciphertext computing task by using the ciphertext data, the method further includes:
step S41, establishing a second communication link with the computing node based on the communication protocol supported by the computing node.
And step S42, acquiring a calculation result obtained by the calculation node executing the ciphertext calculation task through the second communication link.
The first edge computing device needs to send the ciphertext computing task and ciphertext data acquired from the second edge computing device to the computing node, and the computing node executes the ciphertext computing task on the ciphertext data to obtain a computing result. The computation results are stored at the computation nodes from which the first edge computing device needs to retrieve the computation results. Specifically, the first edge computing device may establish a second communication link with the computing node based on a communication protocol supported by the computing node, and then obtain a computation result of the ciphertext computing task from the computing node through the second communication link.
In addition, the first edge computing device may establish a second communication link with the computing node after determining the computing node corresponding to the ciphertext computing task, and send the ciphertext computing task and the ciphertext data to the computing node through the second communication link. After the computing node executes the ciphertext computing task, the first edge computing device obtains a computing result corresponding to the ciphertext computing task from the computing node through the second communication link.
In order to better implement the data processing method provided by the embodiment of the present invention, each functional component may be configured for the first edge computing device and the second edge computing device in the edge collaborative network, different functional components correspond to different functions, respectively, and the data processing method provided by the embodiment of the present invention is implemented by the combined action of each functional component. Referring to fig. 2, a diagram of an edge computing collaborative network structure according to an embodiment of the present invention is shown. The second edge computing device is responsible for providing ciphertext data, and the ciphertext data in the second edge computing device may be generated by the second edge computing device itself or collected from other IoT devices. The second edge computing device collects ciphertext data from other IoT devices through the ciphertext data collection component, the ciphertext data collection component can establish communication connection with the IoT devices with different communication protocols, and therefore the second edge computing device can collect data from various IoT devices, for example, the second edge computing device collects ciphertext data from IoT devices such as intelligent traffic devices, intelligent security devices, military devices, intelligent household devices and intelligent medical devices, and application scenarios of the data processing method provided by the application are enriched.
The ciphertext data acquisition component transmits the acquired ciphertext data to the ciphertext data preprocessing component, and the ciphertext data preprocessing component performs operations such as denoising processing, filtering processing, screening processing, normalization processing and the like on the acquired ciphertext data so that the ciphertext data can better meet the data processing requirements. The ciphertext data preprocessing component sends the processed ciphertext data to the ciphertext data registration component, the ciphertext data registration component sends a ciphertext data registration request to the cloud management node, positioning information and metadata corresponding to the ciphertext data are sent to the cloud management node, the cloud management node stores the metadata of the ciphertext data according to the positioning information of the ciphertext data, and the metadata of the ciphertext data correspond to the positioning information of the ciphertext data one to one.
And the task triggering component in the first edge computing device is used for creating a ciphertext computing task according to the received service requirement under the condition of meeting the preset time. The task triggering component can receive information streams sent by other IoT devices and can also set a timer. And when the task triggering component receives the information stream containing the ciphertext computing service requirement sent by other IoT equipment or the timer set by the task triggering component reaches the preset time, creating a ciphertext computing task. The task triggering component sends the created ciphertext computing task to the task executing component, the task executing component analyzes the ciphertext computing task, metadata of ciphertext data are determined, corresponding positioning information is obtained from the cloud management node according to the determined metadata, the ciphertext data are obtained from the second edge computing device according to the positioning information, the ciphertext computing task and the ciphertext data are sent to the computing node, computing results are obtained from the computing node and the like. If the ciphertext computing task is created by the task triggering component according to the information stream sent by the other IoT equipment to the first edge computing equipment, the first edge computing equipment feeds back the obtained computing result to the corresponding IoT equipment through the data output component.
The cloud management node continuously monitors the resource use condition of each computing node in the whole data processing process, determines and updates a computing node list, and the computing delay of each computing node in the computing node list is lower than a preset threshold value. Before sending the ciphertext calculation task and the ciphertext data to the calculation nodes, the first edge calculation device can acquire a calculation node list from the cloud management node through the task execution component, determine the calculation nodes corresponding to the ciphertext calculation task, and then send the ciphertext calculation task and the ciphertext data to the determined calculation nodes.
It should be noted that the functional components shown in fig. 2 are only an exemplary illustration and do not limit the embodiments of the present invention. In practical applications, other functional components may also be adopted, or corresponding service software may be configured on the first edge computing device and the second edge computing device, for example, ciphertext data storage service software, ciphertext computing engine service software, encryption computing task management service software, computing resource registration and discovery service software, data resource registration and discovery service software, configuration management service software, and the like.
In an optional embodiment of the invention, the method further comprises:
and step S51, setting data probes for the input data and the output data in the first edge computing equipment in the process of executing the ciphertext computing task.
Step S52, monitoring the first edge computing device for information about changes in input data and output data based on the data probes.
And step S53, debugging the functional component in the first edge computing device according to the change information.
In the embodiment of the invention, a workflow engine interface can be arranged on the edge computing device, so that a user can debug the ciphertext computing workflow running in the edge computing device. Specifically, a user can set a data probe for input data and output data in the first edge computing device based on the configured workflow engine interface, monitor change information of the input data and/or the output data, and debug each functional component in the first edge computing device if the monitored change information is found to be inconsistent with expectations until the change information meets the expectations, thereby realizing remote debugging of the workflow running in the edge computing device by the user. And in addition, the monitored change information can be output to the terminal, so that the user can conveniently check the change information.
To sum up, the embodiment of the present invention provides a data processing method, which may be configured to, after a ciphertext calculation task is determined, send metadata to a cloud management node by determining metadata corresponding to ciphertext data required by the ciphertext calculation task, so as to obtain positioning information corresponding to the ciphertext data returned by the cloud management node according to the metadata, then obtain the ciphertext data from a second edge computing device corresponding to the positioning information, and send the ciphertext calculation task and the ciphertext data to a calculation node, so that the calculation node executes the ciphertext calculation task by using the ciphertext data. By the embodiment of the invention, a secure computing cooperative network between the first edge computing device and the second edge computing device can be formed, data sharing between the edge computing devices is realized on the basis of ensuring data security, and the requirement of big data processing is met.
Referring to fig. 3, a flowchart illustrating steps of an embodiment of a data processing method according to the present invention is shown, where the method is applied to a second edge computing device, and specifically includes the following steps:
step 201, encrypting the collected data to obtain ciphertext data.
Step 202, sending the positioning information corresponding to the ciphertext data and the metadata corresponding to the ciphertext data to a cloud management node, so as to register the ciphertext data in the cloud management node.
Step 203, sending the ciphertext data to a first edge computing device, so that the first edge computing device executes a ciphertext computing task by using the ciphertext data through a scheduling computing node.
The metadata corresponding to the ciphertext data comprises at least one of a data type, a data tag and a feature description of the ciphertext data.
The data type may be determined according to a storage type of the data, and for example, the data type may include Integer (Integer type), Long (Long Integer type), Single (Single precision floating point type), Double (Double precision floating point type), and Currency (Currency type) among Numeric data types. The data type may also be determined according to a classification standard set by a user in an actual application process, for example, the data type may be classified according to an application scenario, and the data type may include production data, security data, traffic data, and the like. The embodiment of the present invention is not particularly limited.
The data tags are used for marking the ciphertext data, and each piece of ciphertext data corresponds to one data tag. For example, for traffic data, whether the vehicle is overspeed or not may be determined according to the running speed of the vehicle, and "overspeed or not" is a data tag corresponding to the running speed of the vehicle, and "overspeed is represented by 0 and" overspeed "may be represented by 1. The data tag may also be a unique code of the data, for example, the storage address of the ciphertext data may be used as the data tag. As long as the identifier can mark the ciphertext data and facilitate classification and search of the ciphertext data, the identifier may be used as a data tag of the ciphertext data, and the embodiment of the present invention is not particularly limited.
The data feature of the ciphertext data is summarized, for example, for the traffic data of the vehicle, the running speed can be taken as the feature description of the vehicle, such as '70 km/h'. As long as the information of the data characteristics of the ciphertext data can be summarized, the information can be used as the characteristic description of the ciphertext data.
The second edge computing in the embodiment of the present invention is a data provider of the ciphertext data, and the ciphertext data provided by the second edge computing device may be generated by the second edge computing device itself or collected from other IoT devices. After the second edge computing device collects original data, cipher text data are obtained by encrypting the original data, then positioning information and metadata corresponding to the cipher text data are sent to the cloud management node, the cloud management node stores the metadata of the cipher text data according to the positioning information of the cipher text data, and the metadata of the cipher text data correspond to the positioning information of the cipher text data one to one. And after the first edge computing device acquires the positioning information corresponding to the required ciphertext data from the cloud management node according to the metadata of the ciphertext data required by the ciphertext computing task, the first edge computing device establishes a communication link with the second edge computing device according to the positioning information, the second edge computing device sends the ciphertext data to the first edge computing device according to the communication link, and the first edge computing device schedules the computing node to execute the ciphertext computing task according to the ciphertext data.
In the embodiment of the invention, the second edge computing device stores the ciphertext data in the data storage component of the second edge computing device, the cloud management node only stores the positioning information and the metadata of the ciphertext data, when the first edge computing device needs to acquire the ciphertext data to execute the ciphertext computing task, the positioning information corresponding to the ciphertext data is searched from the cloud management node according to the metadata of the required ciphertext data, then a security channel is established according to the positioning information and the second edge computing device related to the ciphertext computing task, the ciphertext data is acquired, and then the ciphertext data is delivered to the computing node to perform ciphertext computing. In the whole process of executing the ciphertext computing task, the second edge computing device sends the metadata of the ciphertext data to the cloud management node, the ciphertext data is sent to the first edge computing device, and the transmitted data do not relate to any original data in the second edge computing device, so that the privacy and the safety of the data are guaranteed.
In an optional embodiment of the present invention, the sending the ciphertext data to the first edge computing device in step 103 includes:
step P11, establishing a first communication link with the first edge computing device based on a heterogeneous communication protocol.
Step P12, sending the ciphertext data to the first edge computing device via the first communication link.
When the second edge computing device sends the ciphertext data to the first edge computing device, a first communication link is established with the first edge computing device to form a secure data channel, and then the ciphertext data is sent to the first edge computing device through the first communication link.
The heterogeneous communication protocol is a generic term of various different types of communication protocols, and includes but is not limited to BLE (bluetooth low Energy) protocol, NB-IoT (NarrowBand Internet of things) protocol, Sora (Software radio) protocol, Zigbee protocol, Z-Wave protocol, 802.11 protocol, CAN (controllerrane network) protocol, and other commonly used communication protocols.
The IoT edge computing device can establish communication connections with other IoT devices of different communication protocols, receive and fuse data sent by IoT devices of different types of communication protocols. In the embodiment of the present invention, the first edge computing device and the second edge computing device are both IoT edge computing devices, and both have the capability of establishing communication connection with IoT devices of different communication protocols. Therefore, in the embodiment of the present invention, the first communication link between the first edge computing device and the second edge computing device may be established according to a communication protocol of the first edge computing device, and the communication link between the first edge computing device and the second edge computing device may also be established according to a communication protocol of the second edge computing device, which is not limited in the embodiment of the present invention.
In an optional embodiment of the present invention, before performing the encryption processing on the collected data in step 201, the method further includes:
and P21, preprocessing the acquired data to obtain processed acquired data, wherein the preprocessing comprises at least one of denoising processing, filtering processing, screening processing and normalization processing.
The encrypting process of the collected data comprises the following steps:
and step P22, carrying out encryption processing on the processed acquired data to obtain ciphertext data.
Before the acquired data is encrypted, preprocessing operations such as denoising processing, filtering processing, screening processing, normalization processing and the like can be performed on the acquired data, so that the data quality is improved, the data redundancy is reduced, and then the preprocessed data is encrypted to obtain ciphertext data, so that the ciphertext data can better meet the data processing requirements.
In an optional embodiment of the invention, the method further comprises:
and step P31, setting data probes for the input data and the output data in the second edge computing device in the process of executing the ciphertext computing task.
Step P32, monitoring the second edge computing device for information about changes in the input data and the output data based on the data probes.
And step P33, debugging the functional components in the second edge computing device according to the change information.
In the embodiment of the invention, a workflow engine interface can be arranged on the edge computing device, so that a user can debug the ciphertext computing workflow running in the edge computing device. Specifically, a user can set a data probe for input data and output data in the second edge computing device based on the configured workflow engine interface, monitor change information of the input data and/or the output data, and debug each functional component in the second edge computing device if the monitored change information is found to be inconsistent with expectations until the change information meets the expectations, thereby realizing remote debugging of the workflow running in the edge computing device by the user. And in addition, the monitored change information can be output to the terminal, so that the user can conveniently check the change information.
To sum up, the embodiment of the present invention provides a data processing method, which may be configured to encrypt acquired data to obtain ciphertext data, send positioning information and metadata corresponding to the ciphertext data to a cloud management node, register the ciphertext data at the cloud management node, and when a first edge computing device obtains the positioning information corresponding to the required ciphertext data from the cloud management node according to the metadata of the ciphertext data required by a ciphertext computing task and obtains the ciphertext data from a second edge computing device according to the obtained positioning information, the second edge computing device sends the ciphertext data to the first edge computing device, so that the first edge computing device executes the ciphertext computing task by scheduling a computing node using the ciphertext data. By the embodiment of the invention, a secure computing cooperative network between the first edge computing device and the second edge computing device can be formed, data sharing between the edge computing devices is realized on the basis of ensuring data security, and the requirement of big data processing is met.
It should be noted that, for simplicity of description, the method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the illustrated order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments of the present invention. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred and that no particular act is required to implement the invention.
Device embodiment
Referring to fig. 4, a block diagram of a data processing apparatus according to an embodiment of the present invention is shown, where the apparatus is applied to a first edge computing device, and specifically may include:
a metadata determining module 301, configured to determine metadata corresponding to ciphertext data required by a ciphertext computation task;
a positioning information obtaining module 302, configured to send the metadata to a cloud management node, so as to obtain positioning information corresponding to the ciphertext data returned by the cloud management node according to the metadata;
a ciphertext data obtaining module 303, configured to obtain the ciphertext data from the second edge computing device corresponding to the positioning information;
a data sending module 304, configured to send the ciphertext computation task and the ciphertext data to a computing node, so that the computing node executes the ciphertext computation task by using the ciphertext data.
Optionally, the ciphertext data obtaining module 303 includes:
a first communication link establishing sub-module for establishing a first communication link with the second edge computing device based on a heterogeneous communication protocol;
a ciphertext data obtaining sub-module to obtain the ciphertext data from the second edge computing device via the first communication link.
Optionally, the apparatus further comprises:
the first setting module is used for setting data probes for input data and output data in the first edge computing equipment in the cryptograph computing task execution process;
a first monitoring module to monitor information of changes in input data and output data in the first edge computing device based on the data probe;
and the first debugging module is used for debugging the functional component in the first edge computing device according to the change information.
Optionally, the apparatus further comprises:
the computing node list obtaining module is used for obtaining a computing node list from the cloud management node, wherein the computing node list is determined by the cloud management node according to the resource use condition of each computing node, and the computing delay of the computing node in the computing node list is smaller than a preset threshold value;
and the computing node determining module is used for determining the computing nodes participating in the ciphertext computing task in the computing node list.
Optionally, the apparatus further comprises:
the control instruction receiving module is used for receiving a control instruction aiming at the ciphertext computing task;
and the control instruction response module is used for responding to the control instruction and controlling the ciphertext computing task, wherein the control instruction comprises any one of a task starting instruction, a task ending instruction and a task modifying instruction.
Optionally, the apparatus further comprises:
and under the condition of meeting the preset time, creating a ciphertext computing task according to the received service requirement.
Optionally, the apparatus further comprises:
a second communication link establishing module for establishing a second communication link with the computing node based on a communication protocol supported by the computing node;
and the calculation result acquisition module is used for acquiring a calculation result obtained by the calculation node executing the ciphertext calculation task through the second communication link.
Optionally, the metadata corresponding to the ciphertext data includes at least one of a data type, a data tag, and a feature description of the ciphertext data.
To sum up, the embodiment of the present invention provides a data processing apparatus, which may determine a ciphertext calculation task, send metadata to a cloud management node by determining metadata corresponding to ciphertext data required by the ciphertext calculation task, so as to obtain positioning information corresponding to the ciphertext data returned by the cloud management node according to the metadata, then obtain the ciphertext data from a second edge computing device corresponding to the positioning information, and send the ciphertext calculation task and the ciphertext data to a calculation node, so that the calculation node executes the ciphertext calculation task by using the ciphertext data. By the embodiment of the invention, a secure computing cooperative network between the first edge computing device and the second edge computing device can be formed, data sharing between the edge computing devices is realized on the basis of ensuring data security, and the requirement of big data processing is met.
Referring to fig. 5, a block diagram illustrating a structure of an embodiment of a data processing apparatus according to the present invention, where the apparatus is applied to a second edge computing device, specifically, the apparatus may include:
the encryption processing module 401 is configured to encrypt the acquired data to obtain ciphertext data;
a ciphertext data registration module 402, configured to send positioning information corresponding to the ciphertext data and metadata corresponding to the ciphertext data to a cloud management node, so as to register the ciphertext data at the cloud management node;
a ciphertext data sending module 403, configured to send the ciphertext data to a first edge computing device, so that the first edge computing device executes a ciphertext computing task by using the ciphertext data through a scheduling computing node.
Optionally, the ciphertext data sending module 403 includes:
a third communication link establishing sub-module for establishing a first communication link with the first edge computing device based on a heterogeneous communication protocol;
and the ciphertext data sending sub-module is used for sending the ciphertext data to the first edge computing device through the first communication link.
Optionally, the apparatus further comprises:
the preprocessing module is used for preprocessing acquired data to obtain processed acquired data, and the preprocessing comprises at least one of denoising processing, filtering processing, screening processing and normalization processing;
the encryption processing module 401 includes:
and the encryption processing submodule is used for carrying out encryption processing on the processed acquired data to obtain ciphertext data.
Optionally, the apparatus further comprises:
the second setting module is used for setting data probes for input data and output data in the second edge computing equipment in the cryptograph computing task execution process;
a second monitoring module to monitor change information of input data and output data in the second edge computing device based on the data probe;
and the second debugging module is used for debugging the functional component in the second edge computing device according to the change information.
Optionally, the metadata corresponding to the ciphertext data includes at least one of a data type, a data tag, and a feature description of the ciphertext data.
To sum up, the embodiment of the present invention provides a data processing apparatus, which may encrypt collected data to obtain ciphertext data, send positioning information and metadata corresponding to the ciphertext data to a cloud management node, register the ciphertext data at the cloud management node, and when a first edge computing device obtains the positioning information corresponding to the required ciphertext data from the cloud management node according to the metadata of the ciphertext data required by a ciphertext computing task and obtains the ciphertext data from a second edge computing device according to the obtained positioning information, the second edge computing device sends the ciphertext data to the first edge computing device, so that the first edge computing device executes the ciphertext computing task by scheduling the computing node using the ciphertext data. By the embodiment of the invention, a secure computing cooperative network between the first edge computing device and the second edge computing device can be formed, data sharing between the edge computing devices is realized on the basis of ensuring data security, and the requirement of big data processing is met.
For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
An embodiment of the present invention provides an apparatus for data processing, applied to a first edge computing device, the apparatus including a memory, and one or more programs, wherein the one or more programs are stored in the memory, and the one or more programs configured to be executed by the one or more processors include instructions for: determining metadata corresponding to ciphertext data required by a ciphertext computing task; sending the metadata to a cloud management node to acquire positioning information corresponding to the ciphertext data returned by the cloud management node according to the metadata; acquiring the ciphertext data from a second edge computing device corresponding to the positioning information; and sending the ciphertext computing task and the ciphertext data to a computing node so that the computing node executes the ciphertext computing task by using the ciphertext data.
Embodiments of the present invention also provide an apparatus for data processing, applied to a second edge computing device, the apparatus including a memory, and one or more programs, wherein the one or more programs are stored in the memory, and the one or more programs configured to be executed by the one or more processors include instructions for: encrypting the acquired data to obtain ciphertext data; sending positioning information corresponding to the ciphertext data and metadata corresponding to the ciphertext data to a cloud management node so as to register the ciphertext data in the cloud management node; and sending the ciphertext data to a first edge computing device to enable the first edge computing device to execute a ciphertext computing task by scheduling a computing node through the ciphertext data.
Fig. 6 is a block diagram illustrating an apparatus 800 for data processing in accordance with an example embodiment. For example, the apparatus 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.
Referring to fig. 6, the apparatus 800 may include one or more of the following components: processing component 802, memory 804, power component 806, multimedia component 808, audio component 810, input/output (I/O) interface 812, sensor component 814, and communication component 816.
The processing component 802 generally controls overall operation of the device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing elements 802 may include one or more processors 820 to execute instructions to perform all or a portion of the steps of the methods described above. Further, the processing component 802 can include one or more modules that facilitate interaction between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.
The memory 804 is configured to store various types of data to support operation at the device 800. Examples of such data include instructions for any application or method operating on device 800, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 804 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.
Power components 806 provide power to the various components of device 800. The power components 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the apparatus 800.
The multimedia component 808 includes a screen that provides an output interface between the device 800 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front facing camera and/or a rear facing camera. The front-facing camera and/or the rear-facing camera may receive external multimedia data when the device 800 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a Microphone (MIC) configured to receive external audio signals when the apparatus 800 is in an operational mode, such as a call mode, a recording mode, and a voice information processing mode. The received audio signals may further be stored in the memory 804 or transmitted via the communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.
The I/O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.
The sensor assembly 814 includes one or more sensors for providing various aspects of state assessment for the device 800. For example, the sensor assembly 814 may detect the open/closed state of the device 800, the relative positioning of the components, such as a display and keypad of the apparatus 800, the sensor assembly 814 may also detect a change in position of the apparatus 800 or a component of the apparatus 800, the presence or absence of user contact with the apparatus 800, orientation or acceleration/deceleration of the apparatus 800, and a change in temperature of the apparatus 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 816 is configured to facilitate communications between the apparatus 800 and other devices in a wired or wireless manner. The device 800 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on radio frequency information processing (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.
In an exemplary embodiment, a non-transitory computer-readable storage medium comprising instructions, such as the memory 804 comprising instructions, executable by the processor 820 of the device 800 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
Fig. 7 is a schematic diagram of a server in some embodiments of the invention. The server 1900 may vary widely by configuration or performance and may include one or more Central Processing Units (CPUs) 1922 (e.g., one or more processors) and memory 1932, one or more storage media 1930 (e.g., one or more mass storage devices) storing applications 1942 or data 1944. Memory 1932 and storage medium 1930 can be, among other things, transient or persistent storage. The program stored in the storage medium 1930 may include one or more modules (not shown), each of which may include a series of instructions operating on a server. Still further, a central processor 1922 may be provided in communication with the storage medium 1930 to execute a series of instruction operations in the storage medium 1930 on the server 1900.
The server 1900 may also include one or more power supplies 1926, one or more wired or wireless network interfaces 1950, one or more input-output interfaces 1958, one or more keyboards 1956, and/or one or more operating systems 1941, such as Windows Server, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, etc.
A non-transitory computer-readable storage medium in which instructions, when executed by a processor of an apparatus (server or terminal), enable the apparatus to perform the data processing method shown in fig. 1 and 2.
A non-transitory computer readable storage medium, applied to a first edge computing device, whose instructions, when executed by a processor of an apparatus (server or terminal), enable the apparatus to perform a data processing method, the method comprising: determining metadata corresponding to ciphertext data required by a ciphertext computing task; sending the metadata to a cloud management node to acquire positioning information corresponding to the ciphertext data returned by the cloud management node according to the metadata; acquiring the ciphertext data from a second edge computing device corresponding to the positioning information; and sending the ciphertext computing task and the ciphertext data to a computing node so that the computing node executes the ciphertext computing task by using the ciphertext data.
A non-transitory computer readable storage medium, applied to a second edge computing device, having instructions therein, which when executed by a processor of an apparatus (server or terminal), enable the apparatus to perform a data processing method, the method comprising: encrypting the acquired data to obtain ciphertext data; sending positioning information corresponding to the ciphertext data and metadata corresponding to the ciphertext data to a cloud management node so as to register the ciphertext data in the cloud management node; and sending the ciphertext data to a first edge computing device to enable the first edge computing device to execute a ciphertext computing task by scheduling a computing node through the ciphertext data.
Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This invention is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the invention and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the invention being indicated by the following claims.
It will be understood that the invention is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the invention is limited only by the appended claims.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.
The data processing method, the data processing apparatus and the apparatus for data processing provided by the present invention are described in detail above, and specific examples are applied herein to illustrate the principles and embodiments of the present invention, and the description of the above embodiments is only used to help understand the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims (10)

1. A data processing method applied to a first edge computing device, the method comprising:
determining metadata corresponding to ciphertext data required by a ciphertext computing task;
sending the metadata to a cloud management node to acquire positioning information corresponding to the ciphertext data returned by the cloud management node according to the metadata;
acquiring the ciphertext data from a second edge computing device corresponding to the positioning information;
and sending the ciphertext computing task and the ciphertext data to a computing node so that the computing node executes the ciphertext computing task by using the ciphertext data.
2. The method of claim 1, wherein the obtaining the ciphertext data from the second edge computing device to which the locating information corresponds comprises:
establishing a first communication link with the second edge computing device based on a heterogeneous communication protocol;
obtaining the ciphertext data from the second edge computing device via the first communication link.
3. The method of claim 1, further comprising:
setting data probes for input data and output data in the first edge computing equipment in the ciphertext computing task execution process;
monitoring input data and output data change information in the first edge computing device based on the data probe;
and debugging the functional component in the first edge computing device according to the change information.
4. The method of claim 1, wherein prior to sending the ciphertext computing task and the ciphertext data to a compute node, the method further comprises:
acquiring a computing node list from the cloud management node, wherein the computing node list is determined by the cloud management node according to the resource use condition of each computing node, and the computing delay of the computing node in the computing node list is smaller than a preset threshold value;
and determining the computing nodes participating in the ciphertext computing task in the computing node list.
5. A data processing method, applied to a second edge computing device, the method comprising:
encrypting the acquired data to obtain ciphertext data;
sending positioning information corresponding to the ciphertext data and metadata corresponding to the ciphertext data to a cloud management node so as to register the ciphertext data in the cloud management node;
and sending the ciphertext data to a first edge computing device to enable the first edge computing device to execute a ciphertext computing task by scheduling a computing node through the ciphertext data.
6. A data processing apparatus for use with a first edge computing device, the apparatus comprising:
the metadata determining module is used for determining metadata corresponding to ciphertext data required by the ciphertext computing task;
the positioning information acquisition module is used for sending the metadata to a cloud management node so as to acquire positioning information corresponding to the ciphertext data returned by the cloud management node according to the metadata;
the ciphertext data acquisition module is used for acquiring the ciphertext data from the second edge computing device corresponding to the positioning information;
and the data sending module is used for sending the ciphertext computing task and the ciphertext data to a computing node so that the computing node executes the ciphertext computing task by using the ciphertext data.
7. A data processing apparatus for application to a second edge computing device, the apparatus comprising:
the encryption processing module is used for encrypting the acquired data to obtain ciphertext data;
the ciphertext data registration module is used for sending the positioning information corresponding to the ciphertext data and the metadata corresponding to the ciphertext data to a cloud management node so as to register the ciphertext data in the cloud management node;
and the ciphertext data sending module is used for sending the ciphertext data to the first edge computing device so that the first edge computing device executes a ciphertext computing task by using the ciphertext data through the scheduling computing node.
8. An apparatus for data processing, for use in a first edge computing device, the apparatus comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured for execution by the one or more processors to perform the one or more programs includes instructions for:
determining metadata corresponding to ciphertext data required by a ciphertext computing task;
sending the metadata to a cloud management node to acquire positioning information corresponding to the ciphertext data returned by the cloud management node according to the metadata;
acquiring the ciphertext data from a second edge computing device corresponding to the positioning information;
and sending the ciphertext computing task and the ciphertext data to a computing node so that the computing node executes the ciphertext computing task by using the ciphertext data.
9. An apparatus for data processing, for use with a second edge computing device, the apparatus comprising a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured for execution by the one or more processors to perform the one or more programs includes instructions for:
encrypting the acquired data to obtain ciphertext data;
sending positioning information corresponding to the ciphertext data and metadata corresponding to the ciphertext data to a cloud management node so as to register the ciphertext data in the cloud management node;
and sending the ciphertext data to a first edge computing device to enable the first edge computing device to execute a ciphertext computing task by scheduling a computing node through the ciphertext data.
10. A machine-readable medium having stored thereon instructions which, when executed by one or more processors, cause an apparatus to perform the data processing method of claims 1-4 or 5.
CN202110033673.7A 2021-01-11 2021-01-11 Data processing method and device and data processing device Active CN112866222B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110033673.7A CN112866222B (en) 2021-01-11 2021-01-11 Data processing method and device and data processing device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110033673.7A CN112866222B (en) 2021-01-11 2021-01-11 Data processing method and device and data processing device

Publications (2)

Publication Number Publication Date
CN112866222A true CN112866222A (en) 2021-05-28
CN112866222B CN112866222B (en) 2023-04-18

Family

ID=76002623

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110033673.7A Active CN112866222B (en) 2021-01-11 2021-01-11 Data processing method and device and data processing device

Country Status (1)

Country Link
CN (1) CN112866222B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113420001A (en) * 2021-06-04 2021-09-21 中国联合网络通信集团有限公司 Data sharing method and edge computing device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170104746A1 (en) * 2015-10-08 2017-04-13 American Express Travel Related Services Company, Inc. System and method for data security on big data sets
WO2019157810A1 (en) * 2018-02-13 2019-08-22 华为技术有限公司 Data transmission method and device and network node
CN111526197A (en) * 2020-04-24 2020-08-11 远光软件股份有限公司 Cloud data secure sharing method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170104746A1 (en) * 2015-10-08 2017-04-13 American Express Travel Related Services Company, Inc. System and method for data security on big data sets
WO2019157810A1 (en) * 2018-02-13 2019-08-22 华为技术有限公司 Data transmission method and device and network node
CN111526197A (en) * 2020-04-24 2020-08-11 远光软件股份有限公司 Cloud data secure sharing method

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113420001A (en) * 2021-06-04 2021-09-21 中国联合网络通信集团有限公司 Data sharing method and edge computing device
CN113420001B (en) * 2021-06-04 2024-02-09 中国联合网络通信集团有限公司 Data sharing method and edge computing device

Also Published As

Publication number Publication date
CN112866222B (en) 2023-04-18

Similar Documents

Publication Publication Date Title
CN109121468B (en) Access method and device related to network slice
CN109451793B (en) Method and device for realizing network edge calculation
RU2595769C2 (en) Method and device for token key binding to account
CN106211159B (en) Bluetooth-based identity recognition method and device
US20230262665A1 (en) Method and apparatus for determining resource, and storage medium
EP3051772B1 (en) Method and apparatus for accessing network
CN113014625B (en) Task processing method and device for task processing
CN113783774A (en) Cross-cluster network configuration method and device, communication equipment and storage medium
CN109525652B (en) Information sharing method, device, equipment and storage medium
CN113420338A (en) Data processing method and device and data processing device
CN113254956A (en) Data processing method and device and data processing device
CN109565650B (en) Method and device for broadcasting and receiving configuration information of synchronous signal block
CN112866222B (en) Data processing method and device and data processing device
CN108053241B (en) Data analysis method, device and computer readable storage medium
CN110690979B (en) Group message processing method, device, server, client and storage medium
CN109150901B (en) Information source prompting method and device, electronic equipment and storage medium
CN110169107B (en) Method and device for realizing wireless network edge calculation
CN112929271B (en) Route configuration method and device for configuring route
CN114915455A (en) Ciphertext data transmission method and device for ciphertext data transmission
CN113901353A (en) Information display method, device and system, electronic equipment and server
CN110263211B (en) Resource synchronization method and device
CN109766501B (en) Crawler protocol management method and device and crawler system
CN108476392B (en) Method, device and equipment for establishing quick connection between Internet of things equipment
CN113206832B (en) Data processing method and device and data processing device
CN113517977B (en) Data processing method and device and data processing device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant