CN116244374A

CN116244374A - Data processing method, device, equipment and storage medium

Info

Publication number: CN116244374A
Application number: CN202310027013.7A
Authority: CN
Inventors: 武惠韬; 张思琦; 吴家林; 王华伟; 代小亚; 黄海峰
Original assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Current assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Priority date: 2023-01-09
Filing date: 2023-01-09
Publication date: 2023-06-09
Anticipated expiration: 2043-01-09
Also published as: CN116244374B

Abstract

The disclosure provides a data processing method, a device, equipment and a storage medium, and relates to the field of data processing, in particular to the field of big data. The specific implementation scheme is as follows: determining a processing rule of data processing; determining a processing invited party which performs data processing jointly, and sending a data processing request and a processing rule to second equipment of the processing invited party; receiving analog processing feedback sent by a second device of the processing invitee, wherein the analog processing feedback is: the second equipment carries out feedback generated after simulating data processing on the locally stored data based on the processing rule; determining a processing participant jointly performing data processing from the processing invitees according to the received analog processing feedback; and carrying out data processing according to the processing rules based on the locally stored data, and indicating a third device of the processing party to carry out data processing jointly according to the processing rules based on the locally stored data. By applying the scheme provided by the embodiment of the disclosure, the accuracy of the data processing result can be improved.

Description

Data processing method, device, equipment and storage medium

Technical Field

The present disclosure relates to the field of information processing technologies, and in particular, to the field of big data technologies.

Background

With the advent of the large data age, various fields are being filled with large amounts of related data. In order to enable smooth development of work and production in each field, it is necessary to process data in the field and then develop work based on the processing result or guide production.

In each field, there are various individuals who have related data in the field where they are located, and therefore, when data processing is currently performed, data processing is generally performed based on data existing in a single individual.

For example, in the medical field, each medical center has individual medical data, and when processing the medical data, data processing is generally performed based on the medical data of a single medical center.

Disclosure of Invention

The present disclosure provides a data processing method, apparatus, device, and storage medium.

According to an aspect of the present disclosure, there is provided a data processing method applied to a first device that processes an initiator, including:

determining a processing rule of data processing;

determining a processing invitee which performs data processing jointly, and sending a data processing request and the processing rule to a second device of the determined processing invitee;

Receiving analog processing feedback sent by the second device of the determined processing invitee, wherein the analog processing feedback is: the second equipment carries out feedback generated after simulating data processing on the locally stored data based on the processing rule;

determining a processing participant jointly performing data processing from the determined processing invitees according to the received analog processing feedback;

and carrying out data processing according to the processing rules based on the locally stored data, and indicating the third equipment of the determined processing participant to carry out data processing jointly according to the processing rules based on the locally stored data.

According to another aspect of the present disclosure, there is provided a data processing method applied to a second device that processes an invitee, comprising:

receiving a data processing request and a processing rule of data processing sent by first equipment of a processing initiator;

performing analog data processing on the locally stored data based on the processing rule;

based on the simulation processing result, feedback representing whether to jointly perform data processing is sent to the first equipment;

and responding to the joint processing instruction sent by the first equipment, and carrying out data processing on the basis of the locally stored data in a joint mode according to the processing rules.

According to another aspect of the present disclosure, there is provided a data processing apparatus applied to a first device of a processing initiator, including:

the rule determining module is used for determining a processing rule of data processing;

the invitee determining module is used for determining a processing invitee which performs data processing jointly and sending a data processing request and the processing rule to the second equipment of the determined processing invitee;

the processing feedback receiving module is used for receiving the simulation processing feedback sent by the second equipment of the determined processing invitee, wherein the simulation processing feedback is as follows: the second equipment carries out feedback generated after simulating data processing on the locally stored data based on the processing rule;

the participant determining module is used for determining a processing participant which jointly performs data processing from the determined processing invited participants according to the received simulation processing feedback;

and the data processing module is used for carrying out data processing according to the processing rules based on the locally stored data and indicating the third equipment of the determined processing party to jointly carry out data processing according to the processing rules based on the locally stored data.

According to another aspect of the present disclosure, there is provided a data processing apparatus for use in a second device for processing invitees, comprising:

The request and rule receiving module is used for receiving a data processing request and a processing rule of data processing sent by the first equipment of the processing initiator;

the simulation data processing module is used for performing simulation data processing on the locally stored data based on the processing rule;

the feedback sending module is used for sending feedback representing whether the data processing is jointly performed or not to the first equipment based on the simulation processing result;

and the data processing module is used for responding to the joint processing instruction sent by the first equipment and jointly processing data according to the processing rule based on the locally stored data.

According to another aspect of the present disclosure, there is provided an electronic device including:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein, the liquid crystal display device comprises a liquid crystal display device,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the aforementioned data processing method applied to the first device or the second device.

According to another aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium storing computer instructions for causing the computer to execute the aforementioned data processing method applied to the first device or the second device.

According to another aspect of the present disclosure, there is provided a computer program product comprising a computer program which, when executed by a processor, implements the aforementioned data processing method applied to a first device or a second device.

From the above, when the scheme provided by the embodiment of the present disclosure is applied to perform data processing, the first device may determine a processing invited party that performs data processing jointly, and send a data processing request and a processing rule of the data processing to the second device of the determined processing invited party, so that, according to feedback generated after the received second device performs analog data processing on locally stored data based on the processing rule, a processing participant that performs data processing jointly is determined from the determined processing invited party, so that the first device may perform data processing according to the processing rule based on the locally stored data, and instruct a third device of the determined processing participant to perform data processing jointly according to the processing rule based on the locally stored data.

It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the disclosure, nor is it intended to be used to limit the scope of the disclosure. Other features of the present disclosure will become apparent from the following specification.

Drawings

The drawings are for a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:

fig. 1 is a flow chart of a first data processing method according to an embodiment of the disclosure;

figure 2 is a schematic diagram of a process invitee determination interface provided by an embodiment of the disclosure;

FIG. 3 is a flowchart illustrating a second data processing method according to an embodiment of the disclosure;

FIG. 4 is a flowchart illustrating a third data processing method according to an embodiment of the present disclosure;

FIG. 5 is a schematic diagram of a distributed database creation process according to an embodiment of the present disclosure;

FIG. 6 is a flowchart illustrating a fourth data processing method according to an embodiment of the present disclosure;

FIG. 7 is a schematic diagram of a data processing flow provided in an embodiment of the disclosure;

FIG. 8 is a schematic diagram of a multi-center task processing flow provided by an embodiment of the present disclosure;

FIG. 9 is a schematic diagram of a first data processing apparatus according to an embodiment of the disclosure;

FIG. 10 is a schematic diagram of a second data processing apparatus according to an embodiment of the present disclosure;

fig. 11 is a block diagram of an electronic device for implementing a data processing method provided by an embodiment of the present disclosure.

Detailed Description

Exemplary embodiments of the present disclosure are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding, and should be considered as merely exemplary. Accordingly, one of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

First, an application scenario of the scheme provided by the embodiment of the present disclosure is described.

The application scene of the scheme provided by the embodiment of the disclosure is as follows: the data volume locally stored by the data processing party is difficult to meet the data volume requirement of the data processing party.

For example, in the medical field, a worker in a medical institution may process medical data owned by the medical institution using his electronic device, thereby conducting data study based on the processing result; in another example, in the field of business processing, a worker in a dealer may use his electronic device to perform data processing on historical business data owned by the dealer, so as to guide his own policies of stock, management, etc. based on the processing result.

However, the data amount of the data owned by a single medical institution or a single dealer is often limited, and then the electronic device performs data processing on the limited data, which tends to result in a smaller amount of data covered by the data processing, and thus in a lower accuracy of the data processing.

In view of the above, embodiments of the present disclosure provide a data processing method.

The data processing method provided by the embodiment of the present disclosure is described below by taking the medical field as an example, and it can be understood that the application of the data processing method in any other field can be analogically obtained, and the distinction only relates to the replacement of data in different fields.

A data processing method applied to a first device of a processing initiator provided in an embodiment of the present disclosure will be first described in detail below.

Referring to fig. 1, a flowchart of a first data processing method provided by an embodiment of the present disclosure is applied to a first device of a processing initiator, where the method includes the following steps S101 to S105.

Step S101: processing rules for data processing are determined.

The processing rule may be any rule for describing a data processing manner, for example, an object of interest in data processing, a data processing manner for the object, and the like may be described in the processing rule.

In particular, the processing rules may include a plurality of sub-rules, and for a detailed description of the processing rules, reference is made to the embodiment of fig. 1.

In one embodiment of the disclosure, before determining a processing rule, the first device may first obtain the processing rule to be determined, perform multiple analog data processing on locally stored data based on the processing rule to be determined, check whether the analog data processing process is normal, and whether an analog data processing result meets expectations, and if both meet expectations, determine the processing rule to be determined as a final processing rule; otherwise, the processing rule to be determined can be continuously updated according to the simulation data processing result until the conditions are met.

Step S102: a processing invitee that performs data processing in association is determined, and a data processing request and a processing rule are sent to a second device of the determined processing invitee.

The above-described processing invitees may be organizations or personnel.

In particular, the processing invitees may be determined in a number of ways.

In a first way, a target team may be determined from teams that have jointly processed data, and an organization included in the target team may be determined as a processing invitee to jointly process data.

The tissue may be any type of institution or unit, for example, in the medical field, the tissue may be a medical center.

The organization may be an organization included in the target team when the history is combined for data processing, or may be an organization added to the target team later.

Wherein the target team may be determined from the topics involved in the first device initiated data processing.

For example, where the subject matter to which the data processing initiated by the first device relates is tumor data processing, then the team that has jointly performed data processing subject to tumor processing may be determined to be the target team.

In a second way, team members in the target team may be determined to be processing invitees that combine to perform data processing.

The team members may be members involved in data processing by the target team history federation.

In a third way, the organization members included in the organization may be determined as processing invitees that combine to perform data processing.

In addition to determining the team members as processing invitees, any of the organization members contained in the organization may be determined as processing invitees.

All three ways are based on the target team selection process invitees, so the process invitees determination mode involved in the three ways can be called team mode.

The manner in which the invitees are processed based on team mode determination described above will be intuitively described below with reference to fig. 2.

Referring to fig. 2, a schematic diagram of a process invitee determination interface is provided for an embodiment of the disclosure.

As can be seen from fig. 2, in team mode, a target team may be selected and the organization contained in the target team, which may be center a, center B, center C contained in the center list in fig. 2, is determined to be the processing invitee.

Wherein the center list represents a list of medical centers, and centers a-C represent medical centers. For ease of description, the medical centers referred to in the examples or other descriptions below are simply referred to as centers.

In the process invitee determination interface shown in fig. 2, a team button is added for selecting a new target team; the add member button is used to determine team members in a team as processing invitees or members in the organization as processing invitees, such as the king of center a; the initiate invite button is used to invite new organizations and/or members.

Therefore, the reusable team can be provided for the processing initiator, so that the processing initiator can conveniently select a target team from the reusable teams in the various modes, and the invited party can be processed based on the convenient and rapid determination of the target team.

In a fourth manner, user-specified organizations and/or people may be determined as processing invitees to conduct data processing in conjunction.

Thus, any organization and/or person designated by the user can be determined as the invited party for processing the data jointly, and the flexibility in determining the invited party for processing is improved.

The present approach is based on user-specified organization and/or person selection of the processing invitees, and thus the processing invitees determination mode to which the present approach relates may be referred to as a member mode.

The manner in which the invitee is determined is intuitively described below with reference to table 1.

TABLE 1

The first column in table 1 represents a mode of determining the invitees, the second column represents a hierarchy of the invitees, and the third column represents a specific determination mode of the invitees.

In one embodiment of the present disclosure, after the above step S102 determines the processing invitees that perform data processing jointly, an invitation code for data processing may be directly sent to the processing invitees, so that the processing invitees may obtain a processing rule for data processing based on the invitation code.

Specifically, the invitation code may be a website password, and the processing invitee may enter a registration webpage based on the website password, and after the webpage is registered, the processing rule of the data processing set by the processing initiator may be checked.

Step S103: an analog processing feedback sent by the second device of the determined processing invitee is received.

Wherein, the feedback of the simulation process is: and the second equipment performs feedback generated after simulating data processing on the locally stored data based on the processing rule.

The feedback may be feedback characterizing whether the second device is intentionally co-operating with the data processing.

After the second device receives the processing rule, analog data processing may be performed on the locally stored data based on the processing rule, and the feedback may be sent to the first device based on the processing result.

For example, the second device may determine, according to the processing result, whether the locally stored data meets a requirement of jointly performing data processing, and send the feedback to the first device according to the determination result. The specific embodiment is shown in the following example of the application to the second device shown in fig. 6, and will not be described in detail here.

Step S104: from the received simulated processing feedback, a processing participant is determined from the determined processing invitees that jointly performs the data processing.

In particular, the processing participants that jointly perform data processing may be determined in the following manner.

In one embodiment, the target simulation feedback representing the intentional joint data processing may be determined from the simulation feedback, the invitee corresponding to the second device sending the target simulation feedback is determined, and then the invitee is directly determined as the processing participant.

According to the above steps, the above simulation processing feedback can represent whether the invited party corresponding to the second device is willing to perform data processing in a combined manner, so that the invited party corresponding to the target simulation feedback representing the intentional combined data processing can be directly determined as the processing participant.

In another embodiment, the processing intent party that is intended to combine with the data processing may be determined from the processing invitees based on the simulated processing feedback, and then the processing participant that is to combine with the data processing may be determined from the processing intent party. The specific embodiment is described in the following steps S304-S306 in the embodiment shown in fig. 3, which will not be described in detail here.

In one embodiment of the present disclosure, after the processing participant that performs data processing jointly is determined in this step, a participation confirmation message may also be sent to the third device of the determined processing participant, and a participation failure message may be sent to a device other than the third device among the second devices of the determined processing invitee.

In this way, the processing participants which are selected by the processing initiator to jointly process data and other non-selected invited participants in the determined invited participants receive corresponding notification messages, so that the determined invited participants can clearly know whether the invited participants are determined to be the processing participants which jointly process data according to the received messages, and further the determined invited participants can perform subsequent processing according to the selected conditions of the invited participants.

Step S105: and carrying out data processing according to the processing rules based on the locally stored data, and indicating the third equipment of the determined processing participant to jointly carry out data processing according to the processing rules based on the locally stored data.

After the processing participant determines, the first device may not only perform data processing according to the processing rule based on the locally stored data by itself, but also instruct the third device of the processing participant to perform data processing jointly according to the processing rule based on the locally stored data.

In one embodiment, the first device may perform data processing based on data stored in the distributed database, and instruct the third device of the determined processing participant to perform data processing jointly according to the processing rules based on the data stored in the distributed database. The specific implementation manner is shown in step S405-step S406 in the embodiment shown in fig. 4, and will not be described herein.

It can be seen that when the above scheme is adopted to perform data processing, the first device performs data processing according to the processing rule based on the locally stored data, and the first device instructs the third device of the processing party to perform data processing jointly according to the processing rule based on the locally stored data, so that compared with the case that only the first device performs data processing, the number of devices performing data processing according to the processing rule is increased, the data amount covered by the data processing is increased, a more comprehensive data processing result is obtained, and accuracy of the data processing result is improved.

In addition, the feedback received by the first device is feedback generated after the second device performs analog data processing on the locally stored data according to the received processing rule, so that the feedback can be feedback sent by the second device according to a processing result of the analog data processing, specifically, the feedback can be feedback representing whether the second device is willing to perform data processing in a combined mode, and therefore a processing participant for performing data processing in a combined mode can be determined more reasonably according to the feedback by the first device.

The processing rules of the aforementioned data processing are described in detail below.

Specifically, the processing rule may include at least one of the following sub-rules:

1. the data processing is directed to determining sub-rules of the object.

The sub-rules may be used to describe a manner of determining the above object, and may include an inclusion rule, an exclusion rule, and the like when determining the above object.

The object can be understood as an object of interest in data processing, and the data processing is the data processing for the object.

For example, in the medical field, the subject may be a particular population, such as a patient aged over 40 years, or the like.

2. And selecting sub-rules aiming at the object attributes of the objects.

The sub-rules are used to describe the way in which the object properties for which the data processing is directed are chosen.

The object property may be any property of the object, and may also be referred to as a study variable for the object.

For example, the subject may be a patient aged over 40 years, and the subject attribute may be basic information such as age and sex of the patient, or may be information such as history information and test information of the patient.

3. Preprocessing sub-rules for object attributes.

The sub-rules are used to describe the preprocessing mode of the object attributes.

The preprocessing may include missing value filling, normalization, encoding of object attributes, etc., which are not illustrated here.

4. Sub-rules are extracted for the data of the object attributes.

The sub-rule is a data extraction method for describing object properties, and may include a data extraction statement and the like.

5. Statistical sub-rules for the extraction result.

The sub-rule is used to describe a statistical method for the extraction result.

The statistical method may be a hypothesis test method, and the hypothesis test method may be a chi-square test method, a two-independent sample t-test method, or the like; the method may be a machine learning method, and the machine learning model may be a Logistic regression model, a decision tree model, or the like.

6. And checking sub rules aiming at statistical results.

The sub-rules are used to describe the statistics of the key audits.

For example, the audit rule may be a statistical result that highlights that a certain index is smaller than a preset value.

From the above, the processing rules may include sub-rules of the above-mentioned multiple dimensions, and the processing rules for data processing may be flexibly composed based on the above-mentioned multiple sub-rules with explicit levels.

The contents related to the above sub-rules are intuitively described by the processing rule table shown in table 2.

TABLE 2

/>

In table 2, the first column represents the names of the sub-rules, the second column represents the rule details of the sub-rules, the third column represents the specific cases of the sub-rules, the fourth column represents the technical language used for configuring the sub-rules, and the fifth column represents the configuration implementation of the sub-rules based on the technical language.

In table 2 above, the numerical variables can be understood as object attributes with values as numerical values, such as tumor sizes, etc.; classification variables are understood to be variables that are valued for a specific class, such as the type of drug, etc.

In one embodiment of the present disclosure, after the step S105, the following steps a to C may be further included:

step A: and obtaining a first processing result obtained by processing the data according to the processing rule based on the locally stored data.

And (B) step (B): and receiving a second processing result obtained by the third equipment of the determined processing participant by performing data processing according to the processing rule based on the locally stored data.

Step C: based on the first processing result and the received second processing result, a comprehensive data processing result is obtained.

Specifically, the first processing result and the second processing result can be analyzed based on a joint analysis method, so as to obtain a comprehensive data processing result.

The joint analysis method may be a Meta analysis method, a federal analysis method, or the like.

The above-described integrated data processing result may be expressed in the form of a data processing report shown in table 3 below:

TABLE 3 Table 3

In table 3, the first column indicates each report item included in the data processing report, and the second column indicates report details of each report item.

Thus, the first device can obtain a first processing result obtained by performing data processing according to the processing rules based on the locally stored data, and can also obtain a second processing result obtained by performing data processing according to the processing rules based on the locally stored data by the third device of the processing party, so that a comprehensive and accurate data processing result can be obtained based on the first processing result and the second processing result.

In one embodiment of the present disclosure, the first device may send the above-mentioned integrated data processing result to the third device in response to receiving the integrated data processing result acquisition request sent by the third device of the processing participant.

Thus, each processing participant can acquire the comprehensive data processing result, and the sharing of the comprehensive data processing result is realized.

On the basis of the embodiment shown in fig. 1, when determining a processing participant, a processing intention party which is intended to jointly perform data processing may be determined from the processing invited parties according to the analog processing feedback sent by the second device, and then the processing participant which jointly performs data processing may be determined from the processing intention party. In view of the foregoing, embodiments of the present disclosure provide a second data processing method.

Referring to fig. 3, a flowchart of a second data processing method provided by an embodiment of the present disclosure is applied to a first device of a processing initiator, where the method includes the following steps S301 to S307.

Step S301: processing rules for data processing are determined.

Step S302: a processing invitee that performs data processing in association is determined, and a data processing request and a processing rule are sent to a second device of the determined processing invitee.

Step S303: an analog processing feedback sent by the second device of the determined processing invitee is received.

The steps S301 to S303 are the same as the steps S101 to S103 in the embodiment shown in fig. 1, and are not described herein.

Step S304: from the received simulated processing feedback, a processing intent is determined from the determined processing invitees to attempt to combine data processing.

Specifically, the target simulation feedback representing the intentional joint data processing can be determined from the simulation feedback, the invitee corresponding to the second device for sending the target simulation feedback is determined, and then the invitee is determined as the processing intent.

Step S305: and obtaining a simulation processing result of the determined processing intention direction for performing simulation data processing on the locally stored data based on the processing rule.

Step S306: based on the obtained simulation processing result, a target intention party, of which the locally stored data meet the data quality standard, is determined as a processing party for jointly performing data processing.

In particular, the processing participant may be determined from the processing intent in the following manner.

In one embodiment, the intention direction corresponding to the simulation processing result satisfying the first preset condition may be determined as the target intention direction satisfying the data quality standard, and the target intention direction may be determined as the processing participant.

The first preset condition may be preset by a worker, for example, the number of results related to the object for which the data processing is performed included in the simulation result may be not less than the first preset number, or the like.

The simulation result is obtained by performing simulation data processing on the locally stored data by the processing intention party based on the processing rule, so that the simulation result can reflect the related information of the data stored by the processing intention party.

For example, if the data stored locally in the processing intention side does not include data for a certain object, the simulation processing result corresponding to the processing intention side does not include the processing result for the object.

Based on the above understanding, it can be considered that the data locally stored in the processing intention side corresponding to the simulation processing result satisfying the preset condition satisfies the data quality standard, thereby determining the above processing intention side as the intention side.

In another embodiment, a data quality criterion for evaluating the quality of data may be determined based on the type of data processing, and a target intended party of the determined processing intended party, for which locally stored data satisfies each sub-criterion in the data quality criterion, is determined as a processing participant for performing the data processing in combination based on the obtained simulation processing result.

The corresponding relation between the types of various data processing and the data quality standards can be preset, so that the data quality standards corresponding to the types can be determined from the data quality standard library based on the types of the data processing and the corresponding relation.

The data quality criteria may include a plurality of sub-criteria, which are illustrated below.

For example, the sub-criteria may be that the number of pieces of data related to the object for which the data processing is directed included in the locally stored data is not less than the second preset number, the kind of the study variable related in the locally stored data is not less than the third preset number, the data filling rate of the data related to the study variable in the locally stored data is not less than the preset filling rate, and the like.

It can be seen that the data quality criteria for evaluating the quality of the data are determined based on the type of data processing, such that the data quality criteria are more targeted in relation to the type of data processing; in addition, the processing intention party of which the data stored locally meet each sub-standard in the data quality standard is determined as the target intention party, so that the target intention party with higher data quality of the data stored locally is determined.

The manner in which the target intent is determined will be intuitively described below with reference to table 4.

TABLE 4 Table 4

The first column in table 4 represents the dimension related to the data quality standard, the second column represents the sub-standard included in the data quality standard, and the third column represents the specific example corresponding to each sub-standard.

Step S307: and carrying out data processing according to the processing rules based on the locally stored data, and indicating the third equipment of the determined processing participant to jointly carry out data processing according to the processing rules based on the locally stored data.

The step S307 is the same as the step S105 in the embodiment shown in fig. 1, and will not be described again here.

From the above, when the scheme provided by the embodiment of the present disclosure is applied to determine a processing participant that performs data processing jointly, firstly, according to the received feedback of analog processing, a processing intention party that is intended to perform data processing jointly is determined from processing invited parties, then, according to a simulation processing result of performing analog data processing on locally stored data based on a processing rule by the processing intention party, a target intention party that satisfies a data quality standard in the processing intention party is determined as a processing participant that performs data processing jointly, thus, a processing intention party that does not satisfy the standard in data quality is filtered out, a processing intention party that has higher data quality and is stored this time is determined as a processing participant, thereby being beneficial to improving the quality of data that participates in data processing, and being beneficial to avoiding uneven data quality of a third device of the determined processing participant, thereby being beneficial to improving the quality and accuracy of the data processing result.

On the basis of the embodiment shown in fig. 1, when the data processing is jointly performed, the first device may perform data processing based on the data stored in the distributed database, and instruct the third device of the determined processing participant to jointly perform data processing according to the processing rule based on the data stored in the distributed database. In view of the foregoing, embodiments of the present disclosure provide a third data processing method.

Referring to fig. 4, a flowchart of a third data processing method according to an embodiment of the present disclosure is applied to a first device of a processing initiator, where the method includes the following steps S401 to S406.

Step S401: processing rules for data processing are determined.

Step S402: a processing invitee that performs data processing in association is determined, and a data processing request and a processing rule are sent to a second device of the determined processing invitee.

Step S403: an analog processing feedback sent by the second device of the determined processing invitee is received.

Step S404: from the received simulated processing feedback, a processing participant is determined from the determined processing invitees that jointly performs the data processing.

The steps S401 to S404 are the same as the steps S101 to S104 in the embodiment shown in fig. 1, and are not described here again.

Step S405: a distributed database is established based on the locally stored data and the data stored by the third device of the determined processing participant.

The process of creating the distributed database will be described with reference to fig. 5.

Referring to fig. 5, a schematic diagram of a distributed database establishment procedure is provided in an embodiment of the disclosure.

As can be seen from fig. 5, the first device first obtains the data processing rules and then sends a data processing invitation and the processing rules to the second device; the second device may perform analog data processing based on the processing rules and send feedback to the processing initiator, such as second device A, B, C in the figure; then the first equipment confirms the data quality so as to judge whether the data quality knowledge locally stored by the second equipment meets the standard; a distributed database is then established based on the validation results, e.g., based on the locally stored data and the data stored by the second device for which the data quality meets the criteria.

The manner of the first device performing the data quality confirmation is detailed in the foregoing steps S304-S306 in the embodiment shown in fig. 3, and will not be described herein.

Step S406: and carrying out data processing according to the processing rules based on the data stored in the distributed database, and indicating the third equipment of the determined processing participant to carry out data processing jointly according to the processing rules based on the data stored in the distributed database.

Specifically, the first device may perform data processing based on the data stored in the distributed database in the following manner.

In one embodiment, the first device may perform data processing according to the processing rules based on data stored in the distributed database corresponding to the locally stored data.

In another embodiment, the first device may determine a first access requester from the determined processing participants, send an access request for the first target data in the distributed database to a fourth device of the determined first access requester, and then perform data processing according to a processing rule based on the first target data in response to receiving an access request acknowledgement message sent by the fourth device of the determined first access requester.

The first target data is as follows: the determined fourth device of the first access requestor stores data.

The access request confirmation message sent by the fourth device is used for characterizing that the fourth device allows the first device to access data corresponding to the local storage of the fourth device in the distributed data.

Of course, in this embodiment, the first device may perform data processing according to the processing rule by combining the locally stored data and the first target data.

For example, the first access requesters determined by the first device are the medical centers A, B, C, respectively, in which the access request acknowledge messages sent by the fourth devices of the medical centers a and B are received, that is, the first device receives the access permission notifications of the medical centers a and B, and thus the first device has the right to access the first target data locally stored in the distributed database corresponding to the fourth devices of the medical centers a and B, so that the first device can perform data processing in combination with the locally stored data and the first target data.

It can be seen that the first device may send a data access request to the fourth device of the determined first access requester, so that, in case of obtaining permission of the fourth device, first target data corresponding to the fourth device local storage in the distributed database may be accessed, and data processing may be performed according to a processing rule based on the first target data. Therefore, the first device can access the data stored locally by other devices under the condition of obtaining the permission, the data quantity which can be accessed by the first device is expanded, and the flexibility of a data processing scheme is improved.

From the above, the first device may perform data processing according to the processing rule based on the data stored in the distributed database, and instruct the third device of the determined processing participant to perform data processing jointly according to the processing rule based on the data stored in the distributed database.

The data processing method applied to the second device processing the invitee will be explained again below.

Referring to fig. 6, a flowchart of a fourth data processing method according to an embodiment of the present disclosure is applied to a second device for processing an invitee, where the method includes the following steps S601 to S604.

Step S601: a data processing request and a processing rule for data processing sent by a first device of a processing initiator are received.

Step S602: and performing analog data processing on the locally stored data based on the processing rules.

In one embodiment, the second device may determine, based on a locally stored data processing criterion, whether a processing invitee corresponding to the second device accepts a processing rule, and if so, perform analog data processing on locally stored data based on the processing rule.

The data processing criteria may be processing criteria regarding the object for which the data processing is directed, such as receiving only data processing requests for a first set of preset objects, not receiving data processing requests for a second preset object, etc.; the processing criteria of the object attributes of the above object may also be, for example, receiving only a data processing request for a first set of preset object attributes, not receiving a data processing request for a second set of preset object attributes, etc.

Therefore, the second device can judge whether the invited party receives the processing rule or not based on the locally stored data processing standard, and then perform the simulation data processing under the condition of receiving the processing rule, so that the calculation resource waste caused by performing the simulation data processing when the invited party does not receive the processing rule can be avoided by judging whether the invited party receives the processing rule or not, and the practicability and the user experience of the data processing scheme are improved.

Step S603: and based on the simulation processing result, sending feedback representing whether the data processing is combined or not to the first equipment.

In particular, feedback may be sent to the first device that characterizes whether the data processing is joint or not in the following manner.

In one embodiment, whether the simulation processing result meets the second preset condition may be determined, if yes, feedback indicating that the data processing is performed jointly is sent to the first device, and if not, feedback indicating that the data processing is not performed jointly is sent to the first device.

The second preset condition may be preset by a worker, and for example, the number of results related to the object for which the data processing is performed included in the simulation result may be not less than the first preset number.

In another embodiment, based on the simulation result, it may be determined whether the locally stored data meets the requirement of joint data processing, if so, feedback indicating that the joint data processing is performed is sent to the first device, and if not, feedback indicating that the joint data processing is not performed is sent to the first device.

Wherein, the requirements of the joint data processing are as follows: the locally stored data contains the data processing object specified in the processing rule, and the object attribute of the object in the locally stored data contains the object attribute of the data processing object.

The meaning of the data processing object and the object attribute of the data processing object specified in the above processing rule refers to the foregoing embodiment of the data processing method applied to the first device, and is not described herein again.

Specifically, if the simulation result includes a result of processing the data processing object, the locally stored data may be considered to include the data processing object specified in the processing rule; if the simulation result includes a result of processing the object attribute, it is considered that the object attribute of the data processing object is included in the object attribute of the object in the locally stored data.

It can be seen that the second device can determine, based on the simulation result, whether the locally stored data meets the requirement of jointly performing data processing, so as to send feedback representing whether to jointly perform data processing to the first device according to the determination result. Specifically, the second device may send feedback representing the joint data processing to the first device only when judging that the second device meets the requirement of the joint data processing, so that the probability that the processing invited party corresponding to the second device is determined as the processing participant of the joint data processing is improved through preliminary screening of the second device.

In one embodiment of the present disclosure, after the step of sending feedback to the first device, the method may further include:

and sending the simulation processing result to the first device so that the first device judges whether to determine the processing invited party corresponding to the second device as a processing participant for jointly performing data processing based on the simulation processing result.

In this case, the second device may perform encryption processing on the above-described simulation processing result, and then transmit the simulation processing result after the encryption processing to the first device.

The second device may encrypt the simulation result based on an encryption algorithm such as DES (Data Encryption Standard ) algorithm, MD5 (Message-Digest 5), or the like.

The manner in which the first device determines whether to determine the processing invitee corresponding to the second device as the processing participant based on the simulation processing result is detailed in the foregoing step S304-step S306 in the embodiment shown in fig. 3, which is not described herein again.

In this way, the simulation processing result is sent to the first device, so that the first device can evaluate the relevant information of the data stored locally by the second device based on the simulation processing result, and the first device can conveniently and rapidly determine whether to a processing invitee corresponding to the second device as a processing participant for jointly performing data processing based on the simulation processing result.

Step S604: and responding to the joint processing instruction sent by the first equipment, and jointly processing the data according to the processing rule based on the locally stored data.

In one embodiment, in response to the joint processing instruction sent by the first device, data processing can be performed jointly according to the processing rule based on data stored in the distributed database established by the first device.

Specifically, the data processing may be performed based on the data stored in the distributed database in various manners, which will be described in detail in the following embodiments.

Therefore, the second equipment can perform data processing jointly according to the processing rules based on the data stored in the distributed database, and the distributed database can realize convenient data access and sharing, so that the second equipment can perform joint data processing conveniently and efficiently based on the data stored in the distributed database.

From the above, when the scheme provided by the embodiment of the present disclosure is applied to perform data processing, the second device may perform analog data processing on locally stored data based on the processing rule when receiving the data processing request sent by the first device, then determine whether to perform data processing jointly based on the result of the analog processing, send feedback indicating whether to perform data processing jointly to the first device, and perform data processing jointly when receiving the indication of joint processing sent by the first device.

Therefore, compared with the case that the second equipment only carries out data processing by itself, the number of the equipment for carrying out data processing according to the processing rule is increased, so that the data amount covered by the data processing is increased, further, more comprehensive data processing results are obtained, and the accuracy of the data processing results is improved.

In addition, the feedback sent by the second device to the first device is feedback which is sent by the second device after the second device performs analog data processing on locally stored data and represents whether the locally stored data are jointly processed or not, and because the analog processing result can guide whether the processing invited party corresponding to the second device is suitable for jointly processing the data to a great extent, the second device can judge whether the second device meets the requirement of data processing according to the analog data processing result, and then the second device can send feedback for jointly processing the data under the condition that the second device meets the requirement, thereby being beneficial to avoiding data processing obstruction after participating in the data processing, ensuring the processing quality of the data processing on the side surface and being beneficial to improving the efficiency of the data processing.

The manner in which the aforementioned second device performs data processing based on the data stored in the distributed database will be described below.

In the first way, the second device may perform data processing according to the processing rule based on the data stored in the distributed database and corresponding to the locally stored data.

In a second manner, the second device may determine a second access requester from the processing initiator and other processing participants that jointly perform data processing, send an access request for second target data in the distributed database to a sixth device of the determined second access requester, and, in response to receiving an access request acknowledgement message sent by the sixth device of the determined second access requester, jointly perform data processing according to a processing rule based on the second target data.

Wherein the second target data is: the determined sixth device of the second access requestor stores data.

The present embodiment may be obtained based on the foregoing embodiment of performing data processing by the first device based on the data stored in the distributed database in the embodiment shown in fig. 4, where the difference is merely that the execution main body is different, and will not be described herein again.

It can be seen that the second device may send a data access request to the sixth device of the determined second access requester, so that, in case of obtaining permission of the sixth device, second target data corresponding to the local storage of the sixth device in the distributed database may be accessed, and data processing may be performed according to a processing rule based on the second target data. Therefore, the second device can access the data stored locally by other devices under the condition of obtaining the permission, the data quantity which can be accessed by the second device is expanded, and the flexibility of a data processing scheme is improved.

In one embodiment of the present disclosure, the third device of the processing participant may send a comprehensive data processing result acquisition request to the first device of the processing initiator, and obtain a comprehensive data processing result sent by the first device.

Thus, the processing participators can acquire the comprehensive data processing results obtained based on the data processing results of the first equipment and the third equipment, and the sharing of the comprehensive data processing results is realized.

A first data processing flow provided by an embodiment of the present disclosure is described below with reference to fig. 7.

Referring to fig. 7, a schematic diagram of a data processing flow provided in an embodiment of the disclosure includes the following steps S701 to S713.

Step S701: the first device determines a processing rule for data processing.

Step S702: the first device determines a processing invitee to combine data processing.

Step S703: the first device sends a data processing request and a processing rule to the second device of the determined processing invitee.

Step S704: the second device receives a data processing request and a processing rule of data processing sent by the first device of the processing initiator.

Step S705: the second device performs analog data processing on the locally stored data based on the processing rules.

Step S706: the second device sends feedback to the first device indicating whether to combine the data processing based on the simulation result.

Step S707: the first device accepts analog processing feedback sent by the second device of the determined processing invitee.

Step S708: the first device determines, from the determined processing invitees, a processing intent to combine data processing in accordance with the received simulated processing feedback.

Step S709: the first device obtains a simulation result of the simulation data processing of the locally stored data by the determined processing intent based on the processing rule.

Step S710: the first device determines, as a processing participant that performs data processing in combination, a target intention party, of the determined processing intention parties, for which data stored locally satisfies the data quality criterion, based on the obtained simulation processing result.

Step S711: the first device performs data processing according to processing rules based on locally stored data.

Step S712: the first device instructs the third device of the determined processing participant to jointly perform data processing according to the processing rules based on the locally stored data.

The third device is a second device corresponding to the target intention direction in which the locally stored data meets the data quality standard.

Step S713: and the second device responds to the joint processing instruction sent by the first device and performs data processing jointly according to the processing rules based on the locally stored data.

The implementation of each step is described in the foregoing embodiments, and will not be repeated here.

One specific application of the solution provided by the embodiments of the present disclosure in the medical field is described below with reference to fig. 8.

Referring to fig. 8, a schematic diagram of a multi-center task processing flow is provided in an embodiment of the disclosure.

In fig. 8, the originating center and the participating center each represent a medical center, wherein the originating center corresponds to a preamble processing initiator and the participating center corresponds to a preamble processing invitee.

It should be noted that, in fig. 8, the information interactions related to the initiation center and the participation center each represent information interactions between the electronic device of the initiation center and the electronic device of the participation center.

As can be seen from fig. 8, the multi-center task processing procedure can be divided into an originating center procedure and a participating center procedure, which are described below.

Initiating a center flow:

1. the initiating center completes the research project configuration.

The study item configuration may include study population for the item, pretreatment mode of study variable for the study population, extraction mode of study variable, statistical method for extraction result and auditing method for statistical result.

2. The originating center selects a team and the originating center adds/invites members.

The adding member can be any member in the medical centers contained in the selected team, wherein the medical centers contained in the team can be the medical centers in the team when the history is processed by the multi-center task, and can also be the medical centers of the target team to be added later; the inviting member may be any member that invites.

3. The initiating center confirms team members, confirms project configuration, and sends a multi-center task participation invitation to the participating center.

4. The initiation center judges the receiving condition of the participation center and the data returning condition, if part of the participation centers or all the participation centers return to the receiving state, the initiation center performs collaborative analysis with the participation centers of the returning state and the data, and if all the participation centers return to the rejecting state, the multi-center task fails.

Specifically, the initiating center may accept an accept state or a reject state returned by the participating center, and may also accept data returned by the participating center that returns to the accept state, where the data may be a processing result generated by the initiating center performing task processing locally based on project configuration simulation.

If part of the participating centers or all the participating centers return to the receiving state, the initiating center can perform collaborative analysis with the participating centers of the return state and the data. And performing collaborative analysis, namely performing task processing by the initiating center and the participating center based on project configuration, and then obtaining a final processing result of the multi-center task by adopting a joint analysis method on the processing results obtained by the initiating center and the participating center.

Of course, the initiating center may also determine the quality of the data stored locally at the initiating center based on the returned data and then conduct collaborative analysis with participating centers whose data quality meets the criteria.

If all participating centers return to the refusal state, the multi-center task fails.

Participate in the central flow:

1. the participating center receives the invitation prompt.

2. The participating center previews whether the required queue, data preprocessing and statistical analysis can be smoothly performed in the participating center according to the synchronous project configuration, if so, the step of judging whether to agree to participate in the multi-center task is executed, and if not, the participating center refuses to join and returns to the initiating center.

3. Judging whether to agree to participate in the multi-center task, if yes, confirming to join, and returning to the state of the initiating center; if not, refusing to join and returning to the initiating center.

Specifically, the participating center may return to the reject state when rejecting the join, and return to the accept state when confirming the join.

It can be seen that for the medical field, the scheme provided by the embodiment of the disclosure can effectively and rapidly realize the multi-center research task development and promotion based on the multi-center, and through the association of research project configuration and multi-center research team, the barriers of scientific researchers on the business requirements and the technical requirements of multi-center research task development in clinical data application are broken, and the acquisition of scientific research data is ensured from the source. Through the technical means of the specification, the application breakthrough of scientific research projects from single center to multiple centers is realized, and the method has important significance in improving the application efficiency of medical data, normalizing the extraction flow of medical data and ensuring the deep utilization of medical data assets and has popularization value.

Corresponding to the data processing method applied to the first device, the embodiment of the disclosure also provides a data processing device applied to the first device.

Referring to fig. 9, a schematic structural diagram of a first data processing apparatus according to an embodiment of the present disclosure is applied to a first device of a processing initiator, where the apparatus includes the following modules 901 to 905.

A rule determining module 901, configured to determine a processing rule of data processing;

an invitee determining module 902, configured to determine a processing invitee that performs data processing in association, and send a data processing request and the processing rule to a second device of the determined processing invitee;

a processing feedback receiving module 903, configured to receive an analog processing feedback sent by the second device of the determined processing invitee, where the analog processing feedback is: the second equipment carries out feedback generated after simulating data processing on the locally stored data based on the processing rule;

a participant determination module 904 for determining a processing participant from the determined processing invitees that jointly performs data processing based on the received simulated processing feedback;

the data processing module 905 is configured to perform data processing according to the processing rule based on the locally stored data, and instruct the third device of the determined processing participant to perform data processing jointly according to the processing rule based on the locally stored data.

In one embodiment of the disclosure, the participant determination module 904 includes:

the intention party determining submodule is used for determining a processing intention party which is intended to jointly process data from the determined processing invited parties according to the received simulation processing feedback;

the simulation processing result obtaining submodule is used for obtaining a simulation processing result of performing simulation data processing on the locally stored data by the determined processing intention party based on the processing rule;

and the participant determination submodule is used for determining a target intention party, of the determined processing intention parties, for which the locally stored data meet the data quality standard, as a processing participant for jointly processing the data based on the obtained simulation processing result.

In one embodiment of the disclosure, the participant determination submodule is specifically configured to determine a data quality criterion for evaluating a data quality based on a type of data processing; and based on the obtained simulation processing result, determining the target intention party of which the data stored locally in the determined processing intention party meets all the sub-standards in the data quality standard as a processing party for jointly processing the data.

In one embodiment of the disclosure, the invitee determining module 902 is specifically configured to determine a target team from the teams that have jointly processed data, and determine an organization included in the target team as a processing participant that jointly processes data; and/or determining team members in the target team as processing participants for joint data processing; and/or determining the organization members contained in the organization as processing participants for joint data processing; and/or determining a user-specified organization and/or person as a processing participant for joint data processing.

In addition, any organization and/or person designated by the user can be determined as the processing invitee for carrying out data processing jointly, so that the flexibility in determining the processing invitee is improved.

In one embodiment of the disclosure, the apparatus further includes:

a first processing result obtaining module, configured to obtain, after the data processing module 905 indicates that the third device of the determined processing participant performs data processing jointly according to the processing rule based on the locally stored data, a first processing result obtained by performing data processing according to the processing rule based on the locally stored data;

the second processing result receiving module is used for receiving a second processing result obtained by the third equipment of the determined processing participant through data processing according to the processing rule based on the locally stored data;

and the comprehensive data processing result obtaining module is used for obtaining a comprehensive data processing result based on the first processing result and the received second processing result.

In one embodiment of the present disclosure, the data processing module 905 includes:

a distributed database establishing sub-module for establishing a distributed database based on the locally stored data and the data stored by the third device of the determined processing participant;

and the data processing sub-module is used for carrying out data processing according to the processing rules based on the data stored in the distributed database and indicating the third equipment of the determined processing participant to jointly carry out data processing according to the processing rules based on the data stored in the distributed database.

In one embodiment of the disclosure, the data processing sub-module is specifically configured to determine a first access requester from the determined processing participants; sending an access request for first target data in the distributed database to a fourth device of the determined first access requester, wherein the first target data is: the determined data stored by the fourth device of the first access requestor; and responding to the received access request confirmation message sent by the fourth equipment of the determined first access request party, carrying out data processing according to the processing rule based on the first target data, and indicating the third equipment of the determined processing party to jointly carry out data processing according to the processing rule based on the data stored in the distributed database.

In one embodiment of the disclosure, the apparatus further includes:

a message sending module, configured to send a participation confirmation message to a third device of the determined processing participants after the participant determining module 904 determines a processing participant that performs data processing jointly from the determined processing invitees, and send a participation failure message to a device other than the third device in the second device of the determined processing invitees.

In one embodiment of the present disclosure, the processing rule includes at least one of the following sub-rules:

the method comprises the steps of determining a sub-rule for an object, selecting a sub-rule for an object attribute of the object, preprocessing the sub-rule for the object attribute, extracting the sub-rule for the data of the object attribute, counting the sub-rule for an extraction result and auditing the sub-rule for the counting result.

Corresponding to the data processing method applied to the second device, the embodiment of the disclosure also provides a data processing device applied to the second device.

Referring to fig. 10, a schematic structural diagram of a second data processing apparatus according to an embodiment of the present disclosure is applied to a second device for processing an invitee, where the apparatus includes the following modules 1001 to 1004.

A request and rule receiving module 1001, configured to receive a data processing request and a processing rule of data processing sent by a first device of a processing initiator;

a simulation data processing module 1002, configured to perform simulation data processing on locally stored data based on the processing rule;

A feedback sending module 1003, configured to send feedback representing whether to perform data processing jointly to the first device based on the simulation processing result;

and the data processing module 1004 is configured to perform data processing jointly according to the processing rule based on the locally stored data in response to the joint processing instruction sent by the first device.

In one embodiment of the present disclosure, the feedback sending module 1003 is specifically configured to determine, based on the simulation result, whether locally stored data meets a requirement of joint data processing, where the requirement of joint data processing is: the local stored data comprises a data processing object specified in the processing rule, and the object attribute of the data processing object is contained in the object attribute of the object in the local stored data; if yes, sending feedback representing joint data processing to the first equipment; if not, sending feedback representing that the data processing is not carried out jointly to the first equipment.

In one embodiment of the present disclosure, after the feedback sending module 1003, the method further includes:

and the result sending module is used for sending the simulation processing result to the first equipment so that the first equipment judges whether to determine the processing invited party corresponding to the second equipment as a processing participant for jointly performing data processing based on the simulation processing result.

In one embodiment of the present disclosure, the data processing module 1004 is specifically configured to determine, based on a locally stored data processing standard, whether a processing invitee corresponding to the second device accepts the processing rule, in response to a joint processing instruction sent by the first device; if so, performing analog data processing on the locally stored data based on the processing rule.

In one embodiment of the present disclosure, the data processing module 1004 includes:

and the data processing sub-module is used for jointly processing data according to the processing rules based on the data stored in the distributed database established by the first equipment, wherein the distributed database comprises the following components: locally stored data, data stored by the first device, and data stored by a fifth device of the other processing participants in conjunction with the data processing.

In one embodiment of the disclosure, the data processing sub-module is specifically configured to determine a second access requester from the processing initiator and other processing participants that perform data processing jointly; sending an access request for second target data in the distributed database to a sixth device of the determined second access requestor, wherein the second target data is: the determined data stored by the sixth device of the second access requestor; and responding to the received access request confirmation message sent by the sixth equipment of the determined second access requester, and jointly performing data processing according to the processing rules based on the second target data.

In the technical scheme of the disclosure, the related processes of collecting, storing, using, processing, transmitting, providing, disclosing and the like of the personal information of the user accord with the regulations of related laws and regulations, and the public order colloquial is not violated.

According to embodiments of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium and a computer program product.

In one embodiment of the present disclosure, there is provided an electronic device including:

at least one processor; and

In one embodiment of the present disclosure, a non-transitory computer readable storage medium storing computer instructions for causing a computer to perform the aforementioned data processing method applied to a first device or a second device is provided.

In one embodiment of the present disclosure, a computer program product is provided, comprising a computer program which, when executed by a processor, implements the aforementioned data processing method applied to a first device or a second device.

Fig. 11 illustrates a schematic block diagram of an example electronic device 1100 that can be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the disclosure described and/or claimed herein.

As shown in fig. 11, the apparatus 1100 includes a computing unit 1101 that can perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM) 1102 or a computer program loaded from a storage unit 1108 into a Random Access Memory (RAM) 1103. In the RAM 1103, various programs and data required for the operation of the device 1100 can also be stored. The computing unit 1101, ROM 1102, and RAM 1103 are connected to each other by a bus 1104. An input/output (I/O) interface 1105 is also connected to bus 1104.

Various components in device 1100 are connected to I/O interface 1105, including: an input unit 1106 such as a keyboard, a mouse, etc.; an output unit 1107 such as various types of displays, speakers, and the like; a storage unit 1108, such as a magnetic disk, optical disk, etc.; and a communication unit 1109 such as a network card, modem, wireless communication transceiver, or the like. The communication unit 1109 allows the device 1100 to exchange information/data with other devices through a computer network such as the internet and/or various telecommunication networks.

The computing unit 1101 may be a variety of general purpose and/or special purpose processing components having processing and computing capabilities. Some examples of computing unit 1101 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 1101 performs the respective methods and processes described above, for example, a data processing method applied to the first device or the second device. For example, in some embodiments, the data processing method applied to the first device or the second device may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as storage unit 1108. In some embodiments, some or all of the computer programs may be loaded and/or installed onto device 1100 via ROM 1102 and/or communication unit 1109. When the computer program is loaded into the RAM1103 and executed by the computing unit 1101, one or more steps of the data processing method described above as being applied to the first device or the second device may be performed. Alternatively, in other embodiments, the computing unit 1101 may be configured to perform the data processing method applied to the first device or the second device by any other suitable means (e.g. by means of firmware).

Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems On Chip (SOCs), complex Programmable Logic Devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.

Program code for carrying out methods of the present disclosure may be written in any combination of one or more programming languages. These program code may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus such that the program code, when executed by the processor or controller, causes the functions/operations specified in the flowchart and/or block diagram to be implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and pointing device (e.g., a mouse or trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), and the internet.

The computer system may include a client and a server. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server may be a cloud server, a server of a distributed system, or a server incorporating a blockchain.

It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps recited in the present disclosure may be performed in parallel, sequentially, or in a different order, provided that the desired results of the disclosed aspects are achieved, and are not limited herein.

The above detailed description should not be taken as limiting the scope of the present disclosure. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present disclosure are intended to be included within the scope of the present disclosure.

Claims

1. A data processing method applied to a first device of a processing initiator, comprising:

determining a processing rule of data processing;

2. The method of claim 1, wherein the determining a processing participant from the determined processing invitees that jointly performs data processing based on the received simulated processing feedback comprises:

determining a processing intent party for intentional joint data processing from the determined processing invited parties according to the received simulation processing feedback;

obtaining a simulation processing result of the determined processing intention to perform simulation data processing on the locally stored data based on the processing rule;

based on the obtained simulation processing result, a target intention party, of which the locally stored data meet the data quality standard, is determined as a processing party for jointly performing data processing.

3. The method of claim 2, wherein the determining, based on the obtained simulation processing results, a target intent party for which the locally stored data satisfies the data quality criterion among the determined processing intent parties as a processing party for joint data processing includes:

Determining a data quality criterion for evaluating the quality of the data based on the type of data processing;

and based on the obtained simulation processing result, determining the target intention party of which the data stored locally in the determined processing intention party meets all the sub-standards in the data quality standard as a processing party for jointly processing the data.

4. The method of claim 1, wherein the determining a processing invitee to combine data processing comprises:

determining a target team from teams which are subjected to data processing jointly, and determining an organization contained in the target team as a processing participant which is subjected to data processing jointly;

and/or

Determining team members in the target team as processing participants for jointly performing data processing;

and/or

Determining the organization members contained in the organization as processing participants for jointly performing data processing;

and/or

User-specified organizations and/or persons are determined as processing participants who jointly perform data processing.

5. The method of any of claims 1-4, wherein after the third device indicating the determined processing participant jointly performs data processing according to the processing rules based on locally stored data, further comprising:

Obtaining a first processing result obtained by performing data processing according to the processing rule based on the locally stored data;

receiving a second processing result obtained by the third equipment of the determined processing participant by performing data processing according to the processing rule based on the locally stored data;

and obtaining a comprehensive data processing result based on the first processing result and the received second processing result.

6. The method of any of claims 1-4, wherein the processing data according to the processing rules based on locally stored data and instructing a third device of the determined processing participant to jointly process data according to the processing rules based on locally stored data comprises:

establishing a distributed database based on the locally stored data and the data stored by the third device of the determined processing participant;

and carrying out data processing according to the processing rules based on the data stored in the distributed database, and indicating a third device of the determined processing participant to carry out data processing jointly according to the processing rules based on the data stored in the distributed database.

7. The method of claim 6, wherein the data processing according to the processing rules based on the data stored by the distributed database comprises:

Determining a first access requester from the determined processing participants;

sending an access request for first target data in the distributed database to a fourth device of the determined first access requester, wherein the first target data is: the determined data stored by the fourth device of the first access requestor;

and responding to the received access request confirmation message sent by the fourth equipment of the determined first access requester, and carrying out data processing according to the processing rule based on the first target data.

8. The method of any of claims 1-4, wherein, after the determining of the processing participants to combine for data processing from the determined processing invitees, further comprising:

a participation confirmation message is sent to the third device of the determined processing participant and a participation failure message is sent to a device other than the third device of the determined processing invitee's second device.

9. The method of any of claims 1-4, wherein the processing rule comprises at least one of the following sub-rules:

10. A data processing method applied to a second device that processes invitees, comprising:

11. The method of claim 10, wherein the sending feedback to the first device, based on the simulation results, indicating whether to jointly perform data processing, comprises:

based on the simulation processing result, judging whether the locally stored data meets the requirement of jointly processing the data, wherein the requirement of jointly processing the data is as follows: the local stored data comprises a data processing object specified in the processing rule, and the object attribute of the data processing object is contained in the object attribute of the object in the local stored data;

if yes, sending feedback representing joint data processing to the first equipment;

If not, sending feedback representing that the data processing is not carried out jointly to the first equipment.

12. The method of claim 10, wherein after the sending feedback to the first device indicating whether to jointly perform data processing, further comprising:

and sending the simulation processing result to the first device, so that the first device judges whether to determine a processing invited party corresponding to the second device as a processing participant for jointly performing data processing based on the simulation processing result.

13. The method of claim 10, wherein the performing analog data processing on locally stored data based on the processing rules comprises:

judging whether a processing invited party corresponding to the second equipment accepts the processing rule or not based on a locally stored data processing standard;

if so, performing analog data processing on the locally stored data based on the processing rule.

14. The method according to any of claims 10-13, wherein the joint data processing according to the processing rules based on locally stored data comprises:

and carrying out data processing jointly according to the processing rule based on the data stored in the distributed database established by the first equipment, wherein the distributed database comprises the following components: locally stored data, data stored by the first device, and data stored by a fifth device of the other processing participants in conjunction with the data processing.

15. The method of claim 14, wherein the data stored in the distributed database established based on the first device is processed jointly according to the processing rule, comprising:

determining a second access requester from the processing initiator and other processing participants that jointly perform data processing;

sending an access request for second target data in the distributed database to a sixth device of the determined second access requestor, wherein the second target data is: the determined data stored by the sixth device of the second access requestor;

and responding to the received access request confirmation message sent by the sixth equipment of the determined second access requester, and jointly performing data processing according to the processing rules based on the second target data.

16. A data processing apparatus for use in a first device of a processing initiator, comprising:

17. The apparatus of claim 16, wherein the party determination module comprises:

18. The apparatus of claim 17, wherein,

the participant determination submodule is specifically used for determining a data quality standard for evaluating the data quality based on the type of data processing; and based on the obtained simulation processing result, determining the target intention party of which the data stored locally in the determined processing intention party meets all the sub-standards in the data quality standard as a processing party for jointly processing the data.

19. The apparatus of claim 16, wherein,

the invitee determining module is specifically configured to determine a target team from teams that have jointly processed data, and determine an organization included in the target team as a processing participant that jointly processes data;

and/or

And/or

20. The apparatus of any of claims 16-19, wherein the apparatus further comprises:

the first processing result obtaining module is used for obtaining a first processing result obtained by carrying out data processing according to the processing rule based on the locally stored data after the data processing module indicates that the third equipment of the determined processing participant carries out data processing jointly according to the processing rule based on the locally stored data;

21. The apparatus of any of claims 16-19, wherein the data processing module comprises:

22. The apparatus of claim 21, wherein,

the data processing sub-module is specifically configured to determine a first access requester from the determined processing participants; sending an access request for first target data in the distributed database to a fourth device of the determined first access requester, wherein the first target data is: the determined data stored by the fourth device of the first access requestor; and responding to the received access request confirmation message sent by the fourth equipment of the determined first access request party, carrying out data processing according to the processing rule based on the first target data, and indicating the third equipment of the determined processing party to jointly carry out data processing according to the processing rule based on the data stored in the distributed database.

23. The apparatus of any of claims 16-19, wherein the apparatus further comprises:

And the message sending module is used for sending a participation confirmation message to the third equipment of the determined processing party after the participant determining module determines the processing party which performs data processing jointly from the determined processing invited parties, and sending a participation failure message to equipment except the third equipment in the second equipment of the determined processing invited parties.

24. The apparatus of any of claims 16-19, wherein the processing rule comprises at least one of the following sub-rules:

25. A data processing apparatus for use in processing a second device of an invitee, comprising:

26. The apparatus of claim 25, wherein,

the feedback sending module is specifically configured to determine, based on the simulation result, whether locally stored data meets a requirement of joint data processing, where the requirement of joint data processing is: the local stored data comprises a data processing object specified in the processing rule, and the object attribute of the data processing object is contained in the object attribute of the object in the local stored data; if yes, sending feedback representing joint data processing to the first equipment; if not, sending feedback representing that the data processing is not carried out jointly to the first equipment.

27. The apparatus of claim 25, wherein after the feedback sending module, further comprising:

28. The apparatus of claim 25, wherein,

the data processing module is specifically configured to respond to the joint processing instruction sent by the first device, and determine, based on a locally stored data processing standard, whether a processing invitee corresponding to the second device accepts the processing rule; if so, performing analog data processing on the locally stored data based on the processing rule.

29. The apparatus of any of claims 25-28, wherein the data processing module comprises:

30. The apparatus of claim 29, wherein,

the data processing sub-module is specifically configured to determine a second access requester from the processing initiator and other processing participants that perform data processing jointly; sending an access request for second target data in the distributed database to a sixth device of the determined second access requestor, wherein the second target data is: the determined data stored by the sixth device of the second access requestor; and responding to the received access request confirmation message sent by the sixth equipment of the determined second access requester, and jointly performing data processing according to the processing rules based on the second target data.

31. An electronic device, comprising:

at least one processor; and

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-9 or 10-15.

32. A non-transitory computer readable storage medium storing computer instructions for causing the computer to perform the method of any one of claims 1-9 or 10-15.

33. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any of claims 1-9 or 10-15.