CN110119309A - Data processing method, device and storage medium - Google Patents
Data processing method, device and storage medium Download PDFInfo
- Publication number
- CN110119309A CN110119309A CN201910269186.3A CN201910269186A CN110119309A CN 110119309 A CN110119309 A CN 110119309A CN 201910269186 A CN201910269186 A CN 201910269186A CN 110119309 A CN110119309 A CN 110119309A
- Authority
- CN
- China
- Prior art keywords
- project
- calculate node
- sub
- calculated
- calculating task
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 15
- 238000013507 mapping Methods 0.000 claims abstract description 25
- 238000000034 method Methods 0.000 claims abstract description 15
- 238000012544 monitoring process Methods 0.000 claims abstract description 11
- 230000015654 memory Effects 0.000 claims description 16
- 238000012545 processing Methods 0.000 claims description 12
- 230000002776 aggregation Effects 0.000 claims description 6
- 238000004220 aggregation Methods 0.000 claims description 6
- 230000005540 biological transmission Effects 0.000 claims description 5
- 238000004891 communication Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- PCHJSUWPFVWCPO-UHFFFAOYSA-N gold Chemical compound [Au] PCHJSUWPFVWCPO-UHFFFAOYSA-N 0.000 description 3
- 239000010931 gold Substances 0.000 description 3
- 229910052737 gold Inorganic materials 0.000 description 3
- 239000000284 extract Substances 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 238000009825 accumulation Methods 0.000 description 1
- 230000010267 cellular communication Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5061—Partitioning or combining of resources
- G06F9/5072—Grid computing
Abstract
The present invention provides a kind of data processing method, device and storage mediums.This method comprises: electronic device is after receiving user and inputting the computations of project to be calculated, the corresponding several sub-projects of the project to be calculated are determined according to the first mapping relations between project to be calculated and sub-project, the current CPU usage of each available calculate node is obtained in real time, and the calculating task of the sub-project is successively distributed to by each corresponding calculate node according to the sequence of CPU usage from low to high.When monitoring each calculate node and completing the calculating task of the sub-project, the calculated result that each calculate node executes the calculating task of the sub-project is obtained.It carries out summarizing calculating according to the calculated result that preset formula obtains each calculate node got, obtains summarizing calculated result.Using the present invention, nodes sharing, decentralization may be implemented, improve system availability and operational efficiency.
Description
Technical field
The present invention relates to data processing field more particularly to a kind of data processing methods, device and storage medium.
Background technique
When calculating task is related to the data of magnanimity, it is huge to may result in calculation amount.In this case, appoint if calculating
Business rely on separate unit calculate equipment execute, not only calculating task execution efficiency is low, and easily lead to calculate equipment calculating speed slowly, be
Availability/stability of uniting declines.
Summary of the invention
The present invention provides a kind of data processing method, device and storage medium, and main purpose is to realize calculate node
Resource-sharing, decentralization, while improving system availability and operational efficiency.
To achieve the above object, the present invention provides a kind of data processing method, this method comprises:
Task distributing step: the computations that user inputs project to be calculated are received, according to project to be calculated and subitem
The first mapping relations between mesh determine the corresponding several sub-projects of the project to be calculated, obtain each available calculating in real time
The current CPU usage of node successively distributes the calculating task of the sub-project according to the sequence of CPU usage from low to high
To each corresponding calculate node；
Obtaining step: being to obtain each meter when monitoring each calculate node to complete the calculating task of the sub-project
Operator node executes the calculated result of the calculating task of the sub-project, wherein each calculate node is receiving the son
After the calculating task of project, the pending data needed for obtaining the calculating task for executing the sub-project in block chain is calculated
To the calculated result；And
Aggregation step: it carries out summarizing calculating according to calculated result of the preset formula to each calculate node got, obtain
To summarizing calculated result.
Preferably, each calculate node stores a pair of of private key and public key respectively, when a calculate node executes number to be processed
After the calculated result of the calculate node is calculated, the calculated result of the calculate node is added using the private key of the calculate node
It is close, the public key of cryptographic calculation results He the calculate node is sent to other calculate nodes.
Preferably, after a calculate node receives the cryptographic calculation results and public key of another calculate node transmission,
Using the cryptographic calculation results of the public key decryptions of another calculate node received another calculate node, and save solution
Close obtained calculated result.
Preferably, the step of the pending data needed for obtaining the calculating task for executing the sub-project in block chain
Suddenly further include:
According to the second mapping relations of sub-project and data type, several corresponding data types of the sub-project are determined,
And the corresponding pending data of each data type is searched in block chain, the second of each sub-project and data type is reflected
Relationship is penetrated to be identified according to identification code, each sub-project and corresponding data type be assigned respectively one it is unique and identical
Identification code.
Preferably, monitoring all calculate nodes and whether completing calculating task is by checking any one meter in real time or periodically
Whether the quantity for the calculated result that operator node saves is identical as the quantity for issuing calculating task, if they are the same, then all calculate nodes
Calculating task is completed.
In addition, the electronic device includes memory and processor, the memory the present invention also provides a kind of electronic device
In include data processor, which realizes following steps when being executed by the processor:
Task distributing step: the computations that user inputs project to be calculated are received, according to project to be calculated and subitem
The first mapping relations between mesh determine the corresponding several sub-projects of the project to be calculated, obtain each available calculating in real time
The current CPU usage of node successively distributes the calculating task of the sub-project according to the sequence of CPU usage from low to high
To each corresponding calculate node；
Obtaining step: when monitoring each calculate node and completing the calculating task of the sub-project, each meter is obtained
Operator node executes the calculated result of the calculating task of the sub-project, wherein each calculate node is receiving the son
After the calculating task of project, the pending data needed for obtaining the calculating task for executing the sub-project in block chain is calculated
To the calculated result；And
Aggregation step: it carries out summarizing calculating according to calculated result of the preset formula to each calculate node got, obtain
To summarizing calculated result.
Preferably, each calculate node stores a pair of of private key and public key respectively, when a calculate node executes number to be processed
After the calculated result of the calculate node is calculated, the calculated result of the calculate node is added using the private key of the calculate node
It is close, the public key of cryptographic calculation results He the calculate node is sent to other calculate nodes.
Preferably, after a calculate node receives the cryptographic calculation results and public key of another calculate node transmission,
Using the cryptographic calculation results of the public key decryptions of another calculate node received another calculate node, and save solution
Close obtained calculated result.
Preferably, the step of the pending data needed for obtaining the calculating task for executing the sub-project in block chain
Suddenly further include:
According to the second mapping relations of sub-project and data type, several corresponding data types of the sub-project are determined,
And the corresponding pending data of each data type is searched in block chain, the second of each sub-project and data type is reflected
Relationship is penetrated to be identified according to identification code, each sub-project and corresponding data type be assigned respectively one it is unique and identical
Identification code.
In addition, to achieve the above object, it is described computer-readable the present invention also provides a kind of computer readable storage medium
It include data processor in storage medium, which realizes data processing as described above when being executed by processor
Arbitrary steps in method.
Data processing method, electronic device and computer readable storage medium proposed by the present invention, electronic device are receiving
To after the computations of project to be calculated, according to the first mapping relations between project to be calculated and sub-project, determine it is described to
The corresponding several sub-projects of calculating project, and the calculating task of sub-project is issued to each calculate node respectively.Each calculating
Node is when receiving the calculating task of the sub-project, the number to be processed needed for obtaining the calculating sub-project in block chain
According to.The pending data that each calculate node is utilized respectively acquisition is calculated, and saves the calculating for the sub-project being calculated
As a result it stores to block chain.Electronic device is when monitoring all calculate nodes and completing calculating task, from each calculate node
The space for storing block chain obtains the calculated result of all sub-projects, and is counted using the calculated result of each sub-project
It calculates, obtains summarizing calculated result.Using the present invention, nodes sharing, decentralization may be implemented, improve system availability and operation
Efficiency.
Detailed description of the invention
Fig. 1 is the running environment schematic diagram of one embodiment of electronic device of the present invention；
Fig. 2 is the schematic diagram of one embodiment of electronic device of the present invention；
Fig. 3 is the Program modual graph of one embodiment of data processor in Fig. 1, Fig. 2；
Fig. 4 is the flow chart of data processing method first embodiment of the present invention；
The embodiments will be further described with reference to the accompanying drawings for the realization, the function and the advantages of the object of the present invention.
Specific embodiment
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
Based on the embodiments of the present invention, those of ordinary skill in the art institute obtained without making creative work
There are other embodiments, shall fall within the protection scope of the present invention.
The present invention provides a kind of electronic device.It is the operation ring of 1 one embodiment of electronic device of the present invention shown in referring to Fig.1
Border schematic diagram.In this embodiment, electronic device 1 and block chain 3 communicate to connect.Each calculate node in block chain 3, such as
Calculate node N1, N2 ... Nm is communicated to connect by network 2.User instruction (such as computations) are passed through net by electronic device 1
Network 2 is issued to each calculate node.Each calculate node obtains the to be processed of calculating task after receiving computations from network 2
Data.Electronic device 1 monitors after each calculate node completes calculating task, summarizes the calculated result of all calculate nodes simultaneously
Export the calculated result after summarizing.
Electronic device 1 includes data processor 10, and data processor 10 is parsed according to the content that user inputs,
Calculating task is issued to each calculate node of block chain 3, summarizes the calculated result of each calculate node.
The electronic device 1 can be server, smart phone, tablet computer, portable computer, desktop PC,
Game station, video/audio conference system, virtual reality device etc. have the terminal device of storage and calculation function.In a reality
It applies in example, when electronic device 1 is server, which can be rack-mount server, blade server, tower service
The one or more of device or Cabinet-type server etc..
The network 2 can be internet, cloud network, Wireless Fidelity (Wi-Fi) network, personal net (PAN), local area network
(LAN) and/or Metropolitan Area Network (MAN) (MAN).Various equipment in network environment can be configured as according to various wired and wireless communications
Agreement is connected to communication network.The example of such wired and wireless communication protocol can include but is not limited in following at least
One: transmission control protocol and Internet protocol (TCP/I P), User Datagram Protocol (UDP), hypertext transfer protocol
(HTTP), File Transfer Protocol (FTP), Z igBee, EDGE, IEEE 802.11, light fidelity (Li-Fi), 802.16, IEEE
802.11s, IEEE802.11g, multi-hop communication, wireless access point (AP), equipment to equipment communicate, cellular communication protocol and/or
Bluetooth (BlueTooth) communication protocol or combinations thereof.
It is the schematic diagram of 1 one embodiment of electronic device of the present invention referring to shown in Fig. 2.In this embodiment, the electronics dress
Setting 1 includes memory 11, processor 12 and network interface 13.Memory 11 includes data processor 10.
Wherein, the memory 11 includes the readable storage medium storing program for executing of at least one type.At least one type can
Read the non-volatile memory medium that storage medium can be such as flash memory, hard disk, multimedia card, card-type memory.In some implementations
In example, the readable storage medium storing program for executing can be the internal storage unit of the electronic device 1, such as the hard disk of the electronic device 1.
In further embodiments, the readable storage medium storing program for executing is also possible to the external memory 11 of the electronic device 1, such as described
The plug-in type hard disk being equipped on electronic device 1, intelligent memory card (Smart Media Card, SMC), secure digital (Secure
Digital, SD) card, flash card (Flash Card) etc..
In the present embodiment, the readable storage medium storing program for executing of the memory 11 commonly used in storing data processing routine 10 and
Execute the data used or generated during data processor 10.
Processor 12 can be in some embodiments a central processing unit (Central Processing Unit,
CPU), microprocessor or other data processing chips, the program code or data for being stored in run memory 11, such as hold
Row data processor 10.
Network interface 13 may include standard wireline interface and wireless interface (such as WI-FI interface).Commonly used in the electricity
Communication connection is established between sub-device 1 and other electronic equipments, such as establishes communication link with the input unit 2, output device 3
It connects.
Fig. 2 illustrates only the electronic device 1 with component 11-13 and data processor 10, it should be understood that simultaneously
All components shown realistic are not applied, the implementation that can be substituted is more or less component.
In one embodiment, it when processor 12 executes the data processor 10 stored in memory 11, realizes as follows
Step:
Task distributing step: the computations that user inputs project to be calculated are received, according to project to be calculated and subitem
The first mapping relations between mesh determine the corresponding several sub-projects of the project to be calculated, obtain each available calculating in real time
The current CPU usage of node successively distributes the calculating task of the sub-project according to the sequence of CPU usage from low to high
To each corresponding calculate node；
Obtaining step: when monitoring each calculate node and completing the calculating task of the sub-project, each meter is obtained
Operator node calculates the calculated result of the sub-project；And
Aggregation step: it carries out summarizing calculating according to calculated result of the preset formula to each calculate node got, obtain
To summarizing calculated result.
In the present embodiment, each calculate node need to be needed for the calculating task for obtaining the execution sub-project in block chain
Pending data.Each calculate node determines that the sub-project is corresponding according to the second mapping relations of sub-project and data type
Several data types, and the corresponding pending data of each data type, each sub-project and number are searched in block chain
Identified that each sub-project is assigned one with corresponding data type respectively according to identification code according to the second mapping relations of type
A unique and identical identification code, identification code can use Universally Unique Identifier (Universally Unique
Identifier, UUID) it generates.
In the present embodiment, electronic device 1 monitor all calculate nodes whether complete calculating task can by real time or
Timing checks whether the quantity for the calculated result that any one calculate node saves is identical as the quantity for issuing calculating task, if phase
Together, then calculating task is completed in all calculate nodes.
The calculating task implementation progress information that electronic device 1 can also be fed back by receiving calculate node, according to the calculating
Task execution progress msg, determines whether each calculate node completes calculating task.Specifically, electronic device 1 is read each in real time
The journal file of a calculate node, the journal file record of each calculate node have the calculating task implementation progress of the calculate node
The running state information of information and calculate node, and the journal file can be stored in the local storage space or block of calculate node
In chain.Electronic device 1 determines whether each calculate node is completed according to the calculating task implementation progress information of each calculate node
Calculating task.
In the present embodiment, the first mapping relations between project and sub-project to be calculated are predetermined.Each meter
Operator node can in advance deposit the corresponding computation rule of each sub-project before receiving the calculating task for calculating corresponding sub-project
Storage is into the local storage space of block chain or each calculate node, and each calculate node is according to the corresponding computation rule of sub-project
And obtain corresponding pending data and calculated, obtain the calculated result of sub-project.Then, the subitem that calculate node will obtain
Purpose calculated result is stored into block chain or local storage space.If calculate node by the calculated result of sub-project store to
In local storage space, then need to provide calculated result to external device (ED) reads interface by single reading or batch, for outside
The calculated result is read in device (such as electronic device 1) access.
Concrete principle please refer to following Fig. 3 about data processor 10 Program modual graph and Fig. 4 about data processing
The introduction of the flow chart of method.
It is the Program modual graph of data processor 10 in Fig. 1, Fig. 2 referring to shown in Fig. 3.The data processor 10
Multiple modules are divided into, multiple module is stored in memory 12, and is executed by processor 13, to complete the present invention.
The so-called module of the present invention is the series of computation machine program instruction section for referring to complete specific function.
The data processor 10 can be divided into: task distribution module 110 obtains module 120 and summarizing module
130。
The task distribution module 110, the computations of project to be calculated is inputted for receiving user, according to be calculated
The first mapping relations between project and sub-project determine the corresponding several sub-projects of the project to be calculated, obtain in real time each
The current CPU usage of a available calculate node appoints the calculating of the sub-project according to the sequence of CPU usage from low to high
Business is successively distributed to each corresponding calculate node.
Each calculate node number to be processed needed for obtaining the calculating task for executing the sub-project in block chain
According to.The step of pending data needed for obtaining the calculating task for executing the sub-project in block chain further include: root
According to the second mapping relations of sub-project and data type, several corresponding data types of the sub-project are determined, and in block chain
It is middle to search the corresponding pending data of each data type.The step of the calculating task that sub-project is issued to each calculate node
It suddenly include: to obtain the current CPU usage of each available calculate node in real time, it will according to the sequence of CPU usage from low to high
The calculating task of the sub-project is successively distributed to each corresponding calculate node, wherein the calculating task of sub-project is basis
The data volume that each calculating task includes is descending to be ranked up, by the low calculate node of CPU usage execute data volume compared with
Big calculating task.
Pending data needed for the sub-project is the initial data to be calculated of electronic device 1, for example, to calculate
The loss ratio of declaration form, then required initial data is history declaration form data, which includes: the declaration form year of declaration form
The data such as degree, protection amount, premium.
In the present embodiment, the first mapping relations between project and sub-project to be calculated are predetermined.For example, if
Project to be calculated is the loss ratio of declaration form, then its corresponding sub-project includes effective time, Valid Insured Amount, release Reserve Fund, hair
Raw rate and Claims Resolution event and guarantee cost.These sub-projects are parameter needed for calculating the loss ratio of declaration form.
Wherein, effective time refers to that declaration form is subtracted from the effective date to the interval duration between the expiration date and wherein saves mistake from damage for each section
Remaining duration after the duration of effect.
If Valid Insured Amount refers to the insurance risk that maximum payment volume in insurance contract has occurred, insurance company need to be paid most
The high amount of money mainly includes that the basic insurance amount of money and dividend accumulation are insured amount.It can be changed according to the annual change of declaration form, surrender value
Etc. dynamic changes.
Release Reserve Fund refers to the money that insurance artificially guarantees that it such as from about fulfils insurance indemnity or payment obligation and extracts in advance
Gold.
Claims Resolution event and guarantee cost refer to Claims Resolution liability items and reason according to insurance contract, after settling a claim
Pay for the amount of money.
Incidence refers to ratio shared by declaration form of settling a claim in all declaration forms.
Reserve Fund calculation formula is as follows:
Reserve Fund=year hands over the premium * Reserve Fund factor
The Reserve Fund factor includes not yet due liability reserve (Unearned Premium Reserve, UPR), outstanding claims
Outstanding loss reserve (I&R), has occurred to have reported for Reserve Fund (Reserve for Outstanding Losses, OCR)
Do not report a case to the security authorities outstanding loss reserve (Incurred But Not Reported, IBNR) and claim expense reserve occurs
(LAE)。
Not yet due liability reserve refers to that in the Reserve Fund date of the valuation be the Reserve Fund that the insurance responsibility not yet terminated is extracted,
It is to count the liability reserve mentioned for the still unexposed risk of the declaration form that comes into force.
Outstanding loss reserve refers to the Reserve Fund that insurance company extracts still autre action pendante compensation case.
Occur to have reported outstanding loss reserve, referred to that insurance risk has occurred and that and reports a case to the security authorities to insurance company, has insured
The still autre action pendante Reserve Fund of company.
Outstanding loss reserve of not reporting a case to the security authorities has occurred, has referred to that insurance risk has occurred and that, but insurant is not yet to insurance
Company reports a case to the security authorities and the Reserve Fund extracted.
Claim expense reserve refers to the Reserve Fund extracted to the expense that still autre action pendante compensation case may occur.Wherein,
The Reserve Fund for surveying the extractions such as expense, expert's attorney fee, damage survey expense for directly betiding specific compensation case is directly Claims Resolution
Expense Reserve Fund；It is that indirect settling fee is quasi- for the Reserve Fund for not being the expense extraction for directly betiding some specific compensation case
Standby gold.
Each calculate node, can be in advance by each sub-project pair before receiving the calculating task for calculating corresponding sub-project
The computation rule answered is stored into the local storage space of block chain or each calculate node, and each calculate node is according to sub-project
Corresponding computation rule and the corresponding pending data of acquisition are calculated, and the calculated result of sub-project is obtained.Then, section is calculated
Point stores the calculated result of obtained sub-project into block chain or local storage space.If calculate node is by sub-project
Calculated result is stored into local storage space, then needs to provide reading by single reading or batch for calculated result to external device (ED)
Interface for external device (ED) (such as electronic device 1) access, reads the calculated result.
The acquisition module 120, for when monitoring each calculate node and completing the calculating task of the sub-project,
Obtain the calculated result that each calculate node executes the calculating task of the sub-project.
In the present embodiment, electronic device 1 monitor all calculate nodes whether complete calculating task can by real time or
Timing checks whether the quantity for the calculated result that any one calculate node saves is identical as the quantity for issuing calculating task, if phase
Together, then calculating task is completed in all calculate nodes.
The calculating task implementation progress information that electronic device 1 can also be fed back by receiving calculate node, according to the calculating
Task execution progress msg, determines whether each calculate node completes calculating task.Specifically, electronic device 1 is read each in real time
The journal file of a calculate node, the journal file record of each calculate node have the calculating task implementation progress of the calculate node
The running state information of information and calculate node, and the journal file can be stored in the local storage space or block of calculate node
In chain.Electronic device 1 determines whether each calculate node is completed according to the calculating task implementation progress information of each calculate node
Calculating task.
In one embodiment, electronic device 1 can be patterned processing simultaneously to the running log of each calculate node
Graphic software platform, so that user intuitively observes the operation conditions of each calculate node.
The summarizing module 130, for being carried out according to calculated result of the preset formula to each calculate node got
Summarize calculating, obtains summarizing calculated result.
Using project to be calculated as the loss ratio of declaration form for example, its corresponding sub-project includes effective time, effectively protects
Volume, release Reserve Fund, incidence and Claims Resolution event and guarantee cost.Electronic device 1 is quasi- by effective time, Valid Insured Amount, release
The calculating task of standby gold, incidence and Claims Resolution event and guarantee these sub-projects of cost is handed down to each calculate node.It is each
After calculate node receives corresponding calculating task, the pending data needed for obtaining calculating sub-project in block chain.It is each
After calculate node has obtained pending data, it need to also be obtained from block chain or local storage space and calculate the corresponding calculating of sub-project
Rule is calculated according to computation rule.For example, when calculate node N1 receives the effective time project that electronic device 1 issues
When calculating task, it is corresponding more that effective time project is first found with the second mapping relations of data type according to effective time project
A data type, then find the corresponding pending data of each data type from block chain and calculate effective time project
Computation rule calculates the pending data got according to computation rule.Calculate node N1 is calculated in effective time project and is completed
Afterwards, it is sent completely instruction electron device 1.
Electronic device 1 monitors after all calculate nodes complete calculating task, will obtain the calculating knot of each node
Fruit, and each calculated result is substituted into the preset formula: loss ratio=(amount for which loss settled-release Reserve Fund)/((Valid Insured Amount-
Discharge Reserve Fund) the predetermined incidence * effective time of *), obtain the value of the loss ratio of declaration form.
It is the flow chart of data processing method first embodiment of the present invention referring to shown in Fig. 4.The processor of electronic device 1
The following steps of data processing method are realized when the data processor 10 stored in 13 execution memories 12:
Step S400 receives the computations that user inputs project to be calculated, according to project to be calculated and sub-project it
Between the first mapping relations determine the corresponding several sub-projects of the project to be calculated, obtain each available calculate node in real time
The calculating task of the sub-project is successively handed down to respectively by current CPU usage according to the sequence of CPU usage from low to high
A corresponding calculate node.
Each calculate node number to be processed needed for obtaining the calculating task for executing the sub-project in block chain
According to.The step of pending data needed for obtaining the calculating task for executing the sub-project in block chain further include: root
According to the second mapping relations of sub-project and data type, several corresponding data types of the sub-project are determined, and in block chain
It is middle to search the corresponding pending data of each data type, the second mapping relations of each sub-project and data type according to
Identification code is identified that each sub-project is assigned a unique and identical identification code with corresponding data type respectively.
Pending data needed for the sub-project is the initial data to be calculated of electronic device 1, for example, to calculate
The loss ratio of declaration form, then required initial data is history declaration form data, which includes: the declaration form year of declaration form
The data such as degree, protection amount, premium.
In the present embodiment, the mapping relations between project and sub-project to be calculated are predetermined.For example, if wait count
Calculation project is the loss ratio of declaration form, then its corresponding sub-project includes effective time, Valid Insured Amount, release Reserve Fund, incidence
And settle a claim event and guarantee cost.These sub-projects are parameter needed for calculating the loss ratio of declaration form.
In the present embodiment, each calculate node stores a pair of of private key and public key respectively, when a calculate node execute to
After the calculated result of the calculate node is calculated in processing data, the calculating using the private key of the calculate node to the calculate node
As a result it encrypts, the public key of cryptographic calculation results He the calculate node is sent to other calculate nodes.
After a calculate node receives the cryptographic calculation results and public key of another calculate node transmission, reception is utilized
The cryptographic calculation results of the public key decryptions of another calculate node arrived another calculate node, and save what decryption obtained
Calculated result.
Each calculate node, can be in advance by each sub-project pair before receiving the calculating task for calculating corresponding sub-project
The computation rule answered is stored into the local storage space of block chain or each calculate node, and each calculate node is according to sub-project
Corresponding computation rule and the corresponding pending data of acquisition are calculated, and the calculated result of sub-project is obtained.Then, section is calculated
Point stores the calculated result of obtained sub-project into block chain or local storage space.If calculate node is by sub-project
Calculated result is stored into local storage space, then needs to provide reading by single reading or batch for calculated result to external device (ED)
Interface for external device (ED) (such as electronic device 1) access, reads the calculated result.
Step S410 obtains each meter when monitoring each calculate node and completing the calculating task of the sub-project
Operator node executes the calculated result of the calculating task of the sub-project.
In the present embodiment, electronic device 1 monitor all calculate nodes whether complete calculating task can by real time or
Timing checks whether the quantity for the calculated result that any one calculate node saves is identical as the quantity for issuing calculating task, if phase
Together, then calculating task is completed in all calculate nodes.
The calculating task implementation progress information that electronic device 1 can also be fed back by receiving calculate node, according to the calculating
Task execution progress msg, determines whether each calculate node completes calculating task.Specifically, electronic device 1 is read each in real time
The journal file of a calculate node, the journal file record of each calculate node have the calculating task implementation progress of the calculate node
The running state information of information and calculate node, and the journal file can be stored in the local storage space or block of calculate node
In chain.Electronic device 1 determines whether each calculate node is completed according to the calculating task implementation progress information of each calculate node
Calculating task.
In the present embodiment, whether calculate node, which can detect acquired pending data and obtain, finishes, if do not obtained
Taking required pending data will continue to obtain.It is to be processed using what is obtained if having obtained required pending data
Data are calculated.
Step S420 is carried out summarizing calculating, be obtained according to calculated result of the preset formula to each calculate node got
To summarizing calculated result.
In addition, the embodiment of the present invention also proposes a kind of storage medium, it is stored with data processor on the storage medium,
The data processor can be executed by one or more processors, to realize following method:
Task distributing step: the computations that user inputs project to be calculated are received, according to project to be calculated and subitem
The first mapping relations between mesh determine the corresponding several sub-projects of the project to be calculated, obtain each available calculating in real time
The current CPU usage of node successively distributes the calculating task of the sub-project according to the sequence of CPU usage from low to high
To each corresponding calculate node；
Obtaining step: when monitoring each calculate node and completing the calculating task of the sub-project, each meter is obtained
Operator node executes the calculated result of the calculating task of the sub-project；And
Aggregation step: it carries out summarizing calculating according to calculated result of the preset formula to each calculate node got, obtain
To summarizing calculated result.
Storage medium specific embodiment of the present invention and above-mentioned electronic device 1 and each embodiment of method are essentially identical, herein
Do not make tired state.
It should be noted that, in this document, the terms "include", "comprise" or its any other variant are intended to non-row
His property includes, so that the process, device, article or the method that include a series of elements not only include those elements, and
And further include other elements that are not explicitly listed, or further include for this process, device, article or method institute it is intrinsic
Element.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can be realized by means of software and necessary general hardware platform, naturally it is also possible to by hardware, but in many cases
The former is more preferably embodiment.Based on this understanding, technical solution of the present invention substantially in other words does the prior art
The part contributed out can be embodied in the form of software products, which is stored in one as described above
In storage medium (such as ROM/RAM, magnetic disk, CD), including some instructions are used so that terminal device (it can be mobile phone,
Computer, server or network equipment etc.) execute method described in each embodiment of the present invention.
The above is only a preferred embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hair
Equivalent structure or equivalent flow shift made by bright specification and accompanying drawing content is applied directly or indirectly in other relevant skills
Art field, is included within the scope of the present invention.
Claims (10)
1. a kind of data processing method is applied to electronic device, which is characterized in that the described method includes:
Task distributing step: receiving the computations that user inputs project to be calculated, according to project to be calculated and sub-project it
Between the first mapping relations determine the corresponding several sub-projects of the project to be calculated, obtain each available calculate node in real time
The calculating task of the sub-project is successively distributed to respectively by current CPU usage according to the sequence of CPU usage from low to high
A corresponding calculate node；
Obtaining step: it when monitoring each calculate node and completing the calculating task of the sub-project, obtains each calculatings and saves
Point executes the calculated result of the calculating task of the sub-project, wherein each calculate node is receiving the sub-project
Calculating task after, institute is calculated in the pending data needed for obtaining the calculating task for executing the sub-project in block chain
State calculated result；And
Aggregation step: it carries out summarizing calculating according to calculated result of the preset formula to each calculate node got, be converged
Total calculated result.
2. data processing method as described in claim 1, which is characterized in that each calculate node store respectively a pair of of private key and
Public key utilizes the calculating section after calculate node executes pending data, and the calculated result of the calculate node is calculated
The private key of point encrypts the calculated result of the calculate node, the public key of cryptographic calculation results He the calculate node is sent to other
Calculate node.
3. data processing method as claimed in claim 2, which is characterized in that when a calculate node receives another calculating
After cryptographic calculation results and public key that node is sent, the public key decryptions this another of another calculate node received are utilized
The cryptographic calculation results of calculate node, and save the calculated result that decryption obtains.
4. data processing method as described in claim 1, which is characterized in that described obtain from block chain executes the subitem
The step of pending data needed for purpose calculating task further include:
According to the second mapping relations of sub-project and data type, several corresponding data types of the sub-project are determined, and in
The corresponding pending data of each data type is searched in block chain, the second mapping of each sub-project and data type is closed
System is identified that each sub-project is assigned a unique and identical identification with corresponding data type respectively according to identification code
Code.
5. data processing method as described in claim 1, which is characterized in that monitor all calculate nodes and whether complete to calculate and appoint
Business be by real time or timing check any one calculate node save calculated result quantity whether with issue calculating task
Quantity it is identical, if they are the same, then calculating task is completed in all calculate nodes.
6. a kind of electronic device, including memory and processor, which is characterized in that include data processing journey in the memory
Sequence, the data processor realize following steps when being executed by the processor:
Task distributing step: receiving the computations that user inputs project to be calculated, according to project to be calculated and sub-project it
Between the first mapping relations determine the corresponding several sub-projects of the project to be calculated, obtain each available calculate node in real time
The calculating task of the sub-project is successively distributed to respectively by current CPU usage according to the sequence of CPU usage from low to high
A corresponding calculate node；
Obtaining step: it when monitoring each calculate node and completing the calculating task of the sub-project, obtains each calculatings and saves
Point executes the calculated result of the calculating task of the sub-project, wherein each calculate node is receiving the sub-project
Calculating task after, institute is calculated in the pending data needed for obtaining the calculating task for executing the sub-project in block chain
State calculated result；And
Aggregation step: it carries out summarizing calculating according to calculated result of the preset formula to each calculate node got, be converged
Total calculated result.
7. electronic device as claimed in claim 6, which is characterized in that each calculate node stores a pair of of private key and public affairs respectively
Key utilizes the calculate node after calculate node executes pending data, and the calculated result of the calculate node is calculated
Private key the calculated result of the calculate node is encrypted, the public key of cryptographic calculation results He the calculate node is sent to other meters
Operator node.
8. electronic device as claimed in claim 7, which is characterized in that when a calculate node receives another calculate node
After the cryptographic calculation results and public key of transmission, another calculating of the public key decryptions of another calculate node received is utilized
The cryptographic calculation results of node, and save the calculated result that decryption obtains.
9. electronic device as claimed in claim 6, which is characterized in that described obtain from block chain executes the sub-project
The step of pending data needed for calculating task further include:
According to the second mapping relations of sub-project and data type, several corresponding data types of the sub-project are determined, and in
The corresponding pending data of each data type is searched in block chain, the second mapping of each sub-project and data type is closed
System is identified that each sub-project is assigned a unique and identical identification with corresponding data type respectively according to identification code
Code.
10. a kind of computer readable storage medium, which is characterized in that include data processing in the computer readable storage medium
Program when the data processor is executed by processor, realizes the data processing as described in any one of claims 1 to 5
The step of method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910269186.3A CN110119309A (en) | 2019-04-04 | 2019-04-04 | Data processing method, device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910269186.3A CN110119309A (en) | 2019-04-04 | 2019-04-04 | Data processing method, device and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110119309A true CN110119309A (en) | 2019-08-13 |
Family
ID=67520722
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910269186.3A Pending CN110119309A (en) | 2019-04-04 | 2019-04-04 | Data processing method, device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110119309A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102081841A (en) * | 2011-01-18 | 2011-06-01 | 北京世纪高通科技有限公司 | Method and system for processing huge traffic data |
| CN107239479A (en) * | 2017-03-28 | 2017-10-10 | 阿里巴巴集团控股有限公司 | A kind of method and device of data storage and inquiry based on block chain |
| CN107528688A (en) * | 2017-09-30 | 2017-12-29 | 矩阵元技术（深圳）有限公司 | A kind of keeping of block chain key and restoration methods, device based on encryption commission technology |
| CN107547514A (en) * | 2017-07-17 | 2018-01-05 | 招商银行股份有限公司 | Identity identifying method, system and computer-readable recording medium |
| CN109542428A (en) * | 2018-10-16 | 2019-03-29 | 平安普惠企业管理有限公司 | Method for processing business, device, computer equipment and storage medium |
-
2019
- 2019-04-04 CN CN201910269186.3A patent/CN110119309A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102081841A (en) * | 2011-01-18 | 2011-06-01 | 北京世纪高通科技有限公司 | Method and system for processing huge traffic data |
| CN107239479A (en) * | 2017-03-28 | 2017-10-10 | 阿里巴巴集团控股有限公司 | A kind of method and device of data storage and inquiry based on block chain |
| CN107547514A (en) * | 2017-07-17 | 2018-01-05 | 招商银行股份有限公司 | Identity identifying method, system and computer-readable recording medium |
| CN107528688A (en) * | 2017-09-30 | 2017-12-29 | 矩阵元技术（深圳）有限公司 | A kind of keeping of block chain key and restoration methods, device based on encryption commission technology |
| CN109542428A (en) * | 2018-10-16 | 2019-03-29 | 平安普惠企业管理有限公司 | Method for processing business, device, computer equipment and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 韦鹏程: "《大数据时代hadoop技术及应用分析》", 31 March 2019 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110175913B (en) | Data processing system, method, computing device and storage medium based on block chain | |
| US20220261882A1 (en) | Method for creating commodity assets from unrefined commodity reserves utilizing blockchain and distributed ledger technology | |
| US10937111B2 (en) | Managing energy purchase agreements on a blockchain | |
| US11354727B2 (en) | System and method for improving security of smart contract on blockchain | |
| US20170293980A1 (en) | System and method for managing processing resources of a computing system | |
| CN106101258A (en) | A kind of interface interchange method of mixed cloud, Apparatus and system | |
| CN110349004A (en) | Risk of fraud method for detecting and device based on user node relational network | |
| CN110033282A (en) | Complaining method and device | |
| US11138597B2 (en) | System and method for improving security of smart contract on blockchain | |
| WO2020243961A1 (en) | Aggregated payment method and system for digital currencies, and edge server | |
| CN110471982A (en) | Data processing method and device based on block chain | |
| WO2018192931A1 (en) | Delivery versus payment mechanism | |
| CN108830715A (en) | Disk processing method and system are returned in batch documents part | |
| CN109544266A (en) | Product data method for pushing, device and computer readable storage medium | |
| KR20160028010A (en) | Apparatus, Method and Recording medium for processing value added tax of buyer | |
| CN112181628B (en) | Resource transfer method, device, system and electronic equipment | |
| CN110119309A (en) | Data processing method, device and storage medium | |
| CN109829135A (en) | A kind of method and device of Information Statistics | |
| Abdo et al. | Cloud federation means cash | |
| CN106156185A (en) | A kind of service request performs the querying method of state, Apparatus and system | |
| CN111815272B (en) | Application auditing method and device, electronic equipment and storage medium | |
| CN112036850A (en) | Digital asset data access method and device and digital asset transaction system | |
| US11699188B2 (en) | Banking as a service enabled virtual exchange computing platform | |
| CN110753114A (en) | Data sharing method, cloud platform and system for industrial field | |
| CN103065264B (en) | System for managing risk of bond insurance cash flow |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190813 |
|
| RJ01 | Rejection of invention patent application after publication |