CN108829735A - Synchronous method, device, server and the storage medium of parallel executive plan - Google Patents
Synchronous method, device, server and the storage medium of parallel executive plan Download PDFInfo
- Publication number
- CN108829735A CN108829735A CN201810488211.2A CN201810488211A CN108829735A CN 108829735 A CN108829735 A CN 108829735A CN 201810488211 A CN201810488211 A CN 201810488211A CN 108829735 A CN108829735 A CN 108829735A
- Authority
- CN
- China
- Prior art keywords
- data
- receiving end
- parallel
- executive plan
- transmitting terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Information Transfer Between Computers (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses synchronous method, device, server and the storage mediums of a kind of parallel executive plan.This method includes：When the parallel work-flow tally used in ancient times as credentials or a warrant point of parallel executive plan is transmitting terminal and sends data to receiving end, record sends the number of data；When the number for sending data reaches setting number, detection message is sent to receiving end；Receiving end is waited to return to the response message of detection message, and after receiving response message, it re-executes above-mentioned transmission data and records the number for sending data and send detection message when the number for sending data reaches setting number and receive the operation of response message, until data are sent, wherein, response message is that receiving end is sent when the data volume of accumulation is no more than setting quantity.The present invention can control the flow for sending data, so as to reduce the memory or disk space of the occupancy of the data in a website or multiple websites, improve overall performance.
Description
Technical field
The present embodiments relate to database technology more particularly to a kind of synchronous method, device, the clothes of parallel executive plan
Business device and storage medium.
Background technique
In supporting parallel query or distributed data base system, executive plan can execute parallel in each website, the execution
Plan is known as parallel executive plan.Parallel executive plan is to joined on the basis of common executive plan with communication function
Parallel work-flow tally used in ancient times as credentials or a warrant point, parallel work-flow symbol include collect (gather), distribution (distribute) and diverging (scatter)
Deng.
Parallel executive plan is sent to each website and executes parallel, is accorded with by parallel work-flow therein, can control number
According between website movement with it is synchronous, be finally aggregated into the home site inquired, and be uploaded to client.
Since the data volume of each website is different, the difference of station system resource or the characteristics of parallel executive plan itself,
Parallel executive plan is in the process of implementation, it is understood that there may be the data between each website transmit nonsynchronous phenomenon, cause to check out
Data on one or more websites bulk deposition, occupy more memory or disk space, cause the decline of overall performance.
Summary of the invention
In view of this, the embodiment of the present invention provides synchronous method, device, server and the storage of a kind of parallel executive plan
Medium improves overall performance with memory or disk space that the data reduced in a website or multiple websites occupy.
In a first aspect, the embodiment of the invention provides a kind of synchronous method of parallel executive plan, the method includes：
When the parallel work-flow tally used in ancient times as credentials or a warrant point of parallel executive plan is transmitting terminal and sends data to receiving end, record sends number
According to number；
When the number for sending data reaches setting number, detection message is sent to the receiving end；
The receiving end is waited to return to the response message of the detection message, and after receiving the response message, weight
It newly executes above-mentioned transmission data and records the number for sending data and send inspection when the number for sending data reaches setting number
It surveys message and receives the operation of response message, until data are sent, wherein the response message is the receiving end in heap
It is sent when long-pending data volume is no more than setting quantity.
Second aspect, the embodiment of the invention also provides a kind of synchronous method of parallel executive plan, the method includes：
When the parallel work-flow tally used in ancient times as credentials or a warrant point of parallel executive plan is receiving end, the detection message that transmitting terminal is sent is received,
The detection message is that the transmitting terminal is sent when the number for sending data reaches setting number；
Determine the data volume of the receiving end accumulation；
If the data volume of the receiving end accumulation is more than setting quantity, data are handled in the receiving end and are accumulated
Data volume be no more than the setting quantity when, transmission response message to the transmitting terminal.
The third aspect, the embodiment of the invention also provides a kind of synchronizing device of parallel executive plan, described device includes：
Data transmission times logging modle is transmitting terminal for the parallel work-flow tally used in ancient times as credentials or a warrant point in parallel executive plan and sends
When data are to receiving end, record sends the number of data；
Message transmission module being detected, when for reaching setting number in the number for sending data, sending detection message to institute
State receiving end；
Control module, for waiting the receiving end to return to the response message of the detection message, and it is described receiving
After response message, re-executes above-mentioned transmission data and record the number for sending data and reach setting in the number for sending data
Detection message is sent when number and receives the operation of response message, until data are sent, wherein the response message is institute
State what receiving end was sent when the data volume of accumulation is no more than setting quantity.
Fourth aspect, the embodiment of the invention also provides a kind of synchronizing device of parallel executive plan, described device includes：
Detect message reception module, for the parallel work-flow tally used in ancient times as credentials or a warrant point in parallel executive plan be receiving end when, receive hair
The detection message that sending end is sent, the detection message are transmitting terminal hairs when the number for sending data reaches setting number
It send；
Data volume determining module is accumulated, for determining the data volume of the receiving end accumulation；
Response message sending module, if the data volume for receiving end accumulation is more than setting quantity, described
Receiving end handle data and accumulate data volume be no more than the setting quantity when, transmission response message to the transmitting terminal.
5th aspect, the embodiment of the invention also provides a kind of database server, the server includes：
One or more processors；
Storage device, for storing one or more programs,
When one or more of programs are executed by one or more of processors, so that one or more of processing
Device realizes the synchronous method of parallel executive plan described in any embodiment of the present invention.
6th aspect, the embodiment of the invention also provides a kind of computer readable storage mediums, are stored thereon with computer
Program realizes the synchronous method of parallel executive plan described in any embodiment of the present invention when the program is executed by processor.
The technical solution of the embodiment of the present invention is that transmitting terminal is concurrent by the parallel work-flow tally used in ancient times as credentials or a warrant point in parallel executive plan
When sending data to receiving end, record sends the number of data, and sends detection when the number for sending data reaches setting number
Message gives the receiving end, and receiving end is waited to return to the response message of detection message, and after receiving response message, retransmits
Data can control the flow for sending data to receiving end, avoid caused by the unconfined transmission of data in certain sections
Packing phenomenon is generated on point, so as to reduce the memory or disk space of the occupancy of the data in a website or multiple websites,
Improve overall performance.
Detailed description of the invention
Fig. 1 is a kind of flow chart of the synchronous method for parallel executive plan that the embodiment of the present invention one provides；
Fig. 2 is the example of the parallel executive plan in the synchronous method of parallel executive plan provided in an embodiment of the present invention
Figure；
Fig. 3 is a kind of flow chart of the synchronous method of parallel executive plan provided by Embodiment 2 of the present invention；
Fig. 4 is a kind of structural schematic diagram of the synchronizing device for parallel executive plan that the embodiment of the present invention three provides；
Fig. 5 is a kind of structural schematic diagram of the synchronizing device for parallel executive plan that the embodiment of the present invention four provides；
Fig. 6 is a kind of structural schematic diagram for database server that the embodiment of the present invention five provides.
Specific embodiment
The present invention is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouched
The specific embodiment stated is used only for explaining the present invention rather than limiting the invention.It also should be noted that in order to just
In description, only some but not all contents related to the present invention are shown in the drawings.
Embodiment one
Fig. 1 is a kind of flow chart of the synchronous method for parallel executive plan that the embodiment of the present invention one provides, the present embodiment
It is applicable to the case where synchronizing to the data of each website in parallel executive plan, this method can be by executing meter parallel
The synchronizing device drawn executes, which can be realized by software and/or hardware, can generally be integrated in database server
In.This method specifically comprises the following steps：
Step 110, when the parallel work-flow tally used in ancient times as credentials or a warrant point of parallel executive plan is transmitting terminal and sends data to receiving end, note
Record sends the number of data.
Wherein, parallel executive plan refers in supporting parallel query or distributed Database Systems, can be in each website
The executive plan executed parallel.Wherein, website refers to a database instance, and for parallel query, executive plan is in each line
Cheng Binghang is executed, then per thread can be described as a website；For distributed data base system, executive plan is in each database
Parallel to execute, a database is known as a website.Parallel executive plan is on the basis of common executive plan, and addition has
The parallel work-flow of communication function accords with (being referred to as MOTION operator) node, wherein parallel work-flow symbol includes collecting
(GATHER), distribution (DISTRIBUTE), diverging (SCATTER) etc. may include one in a parallel executive plan or more
A parallel work-flow tally used in ancient times as credentials or a warrant point, is distributed in the different levels of executive plan tree.One website by parallel executive plan and
Row operator node can parallel work-flow tally used in ancient times as credentials or a warrant point identical in other websites in parallel executive plan communicated, i.e.,
Parallel executive plan is sent to each website and executes parallel, by parallel work-flow tally used in ancient times as credentials or a warrant point therein, can control data and exists
Moved between website with it is synchronous, be finally aggregated into the home site inquired and be uploaded to client.
When multiple websites are performed in parallel parallel executive plan, the executive plan of each website be it is identical, stand
Between point using parallel work-flow tally used in ancient times as credentials or a warrant point communicated with it is synchronous.The same parallel work-flow accords with the communication executed on different websites
Movement may be different.Such as home site A and slave site B executes parallel executive plan shown in Fig. 2, wherein GATHER is to grasp parallel
Make tally used in ancient times as credentials or a warrant point.Then the GATHER operator node of home site A is used to collect the data of the GATHER operator node of slave site B,
The GATHER operator node of slave site B can then send the data to the GATHER operator node of home site A, at this point, claim from
The GATHER operator node of website B is transmitting terminal, and the GATHER operator node of home site A is receiving end.Simultaneously for other
Row operator node, such as SCATTER, then the SCATTER operator node of home site is transmitting terminal, the SCATTER behaviour of slave site
Making tally used in ancient times as credentials or a warrant point is receiving end, may send and receive data simultaneously there are also certain parallel work-flow tally used in ancient times as credentials or a warrant points, then be both transmitting terminal
It is receiving end.Receiving end and transmitting terminal can be in the same database servers, can also be in different database servers
In.
Website judges it itself is transmitting terminal or receiving end according to the parallel work-flow symbol in parallel executive plan, and is being hair
When sending end, 0 is set by the number initial value for sending data, transmitting terminal sends a data to receiving end, is increased by primary meter
Number, to count on the data volume for being sent to receiving end, i.e., the number of total transmission data is the data for being destined to receiving end
Amount.
Step 120, when the number for sending data reaches setting number, detection message is sent to the receiving end.
Wherein, setting number value in 1~100,000 ranges, is only for illustrating, is not used in restriction, specifically, with
Family can be as needed, selects suitable setting number.Such as in the biggish situation of data volume interaction, number setting can will be set
It is slightly smaller；In the lesser situation of data volume interaction, the slightly larger of number setting can will be set, so as to avoid executing parallel
A website or multiple websites in the works accumulates more data.
When the number for sending data reaches setting number, detection message is sent to receiving end, and stops sending data to
Receiving end, so as to detect whether receiving end has accumulated more data.
Wherein, when the parallel work-flow tally used in ancient times as credentials or a warrant point of parallel executive plan is transmitting terminal and sends data to receiving end, record
The number of data is sent, including：
When the parallel work-flow tally used in ancient times as credentials or a warrant point of parallel executive plan is transmitting terminal, variable is set, and by the initial of the variable
Value is assigned a value of 0, and the variable is for recording the number that the transmitting terminal sends data to the receiving end；
When the transmitting terminal sends a data to the receiving end, the value of the variable is increased by one；
When sending detection message to the receiving end, further include：
The value of the variable is reset.
When the parallel work-flow tally used in ancient times as credentials or a warrant point of parallel executive plan is transmitting terminal, a variable is set, for recording transmitting terminal
The value of variable is increased by one, thus just when transmitting terminal sends a data to receiving end by the number for sending data to receiving end
It is counted in the number for sending data.
When sending detection message to receiving end, stopping sends data to receiving end, determines that the transmission of epicycle data has terminated,
The value of variable is reset, convenient for the subsequent number for restarting to send data and record transmission data.
Step 130, it waits the receiving end to return to the response message of the detection message, and receives the response message,
Step 110 is executed later, until data are sent.
Wherein, the response message is that the receiving end is sent when the data volume of accumulation is no more than setting quantity.Institute
Setting quantity value in 1~100,000 ranges is stated, is only for illustrating, is not used in restriction, specific value can be with the setting time
Number is identical.
If more data have been accumulated in receiving end, will not make an immediate response the detection message, reach in the data of accumulation
It is required that when can just respond.Transmitting terminal sends detection message, no longer sends data to receiving end, needs that receiving end is waited to return to detection
The response message of message, and when receiving response message, it just determines that the data of receiving end are not accumulated, can continue to send number
According to receiving end is given, current limliting is realized, to ensure that the data of each website are synchronous.
After receiving response message, then determine send data number whether reach setting number when, only determine receive
Whether the number that data are retransmitted after to response message reaches setting number.
Step 140, judge whether data are sent, if not, 110 are thened follow the steps, if it is, terminating.
The technical solution of the present embodiment is transmitting terminal by the parallel work-flow tally used in ancient times as credentials or a warrant point in parallel executive plan and sends number
When according to giving receiving end, record sends the number of data, and detection message is sent when the number for sending data reaches setting number
To the receiving end, receiving end is waited to return to the response message of detection message, and after receiving response message, retransmits data
To receiving end, the flow for sending data can be controlled, be avoided caused by the unconfined transmission of data on certain nodes
Packing phenomenon is generated, so as to reduce the memory or disk space of the occupancy of the data in a website or multiple websites, is improved
Overall performance.
Embodiment two
Fig. 3 is a kind of flow chart of the synchronous method of parallel executive plan provided by Embodiment 2 of the present invention, the present embodiment
It is applicable to the case where synchronizing to the data of each website in parallel executive plan, this method can be by executing meter parallel
The synchronizing device drawn executes, which can be realized by software and/or hardware, can generally be integrated in database server
In.This method specifically comprises the following steps：
Step 210, when the parallel work-flow tally used in ancient times as credentials or a warrant point of parallel executive plan is receiving end, the inspection that transmitting terminal is sent is received
Message is surveyed, the detection message is that the transmitting terminal is sent when the number for sending data reaches setting number.
Wherein, parallel executive plan refers in supporting parallel query or distributed Database Systems, can be in each website
The executive plan executed parallel.Wherein, website refers to a database instance, and for parallel query, executive plan is in each line
Cheng Binghang is executed, then per thread can be described as a website；For distributed data base system, executive plan is in each database
Parallel to execute, a database is known as a website.Parallel executive plan is on the basis of common executive plan, and addition has
The parallel work-flow of communication function accords with (being referred to as MOTION operator) node, wherein parallel work-flow symbol includes collecting
(GATHER), distribution (DISTRIBUTE), diverging (SCATTER) etc. may include one in a parallel executive plan or more
A parallel work-flow tally used in ancient times as credentials or a warrant point, is distributed in the different levels of executive plan tree.One website by parallel executive plan and
Row operator node can parallel work-flow tally used in ancient times as credentials or a warrant point identical in other websites in parallel executive plan communicated, i.e.,
Parallel executive plan is sent to each website and executes parallel, by parallel work-flow tally used in ancient times as credentials or a warrant point therein, can control data and exists
Moved between website with it is synchronous, be finally aggregated into the home site inquired and be uploaded to client.
When multiple websites are performed in parallel parallel executive plan, the executive plan of each website be it is identical, stand
Between point using parallel work-flow tally used in ancient times as credentials or a warrant point communicated with it is synchronous.The same parallel work-flow accords with the communication executed on different websites
Movement may be different.Such as home site A and slave site B executes parallel executive plan shown in Fig. 2, wherein GATHER is to grasp parallel
Make tally used in ancient times as credentials or a warrant point.Then the GATHER operator node of home site A is used to collect the data of the GATHER operator node of slave site B,
The GATHER operator node of slave site B can then send the data to the GATHER operator node of home site A, at this point, claim from
The GATHER operator node of website B is transmitting terminal, and the GATHER operator node of home site A is receiving end.Simultaneously for other
Row operator node, such as SCATTER, then the SCATTER operator node of home site is transmitting terminal, the SCATTER behaviour of slave site
Making tally used in ancient times as credentials or a warrant point is receiving end, may send and receive data simultaneously there are also certain parallel work-flow tally used in ancient times as credentials or a warrant points, then be both transmitting terminal
It is receiving end.Receiving end and transmitting terminal can be in the same database servers, can also be in different database servers
In.
Website judges it itself is transmitting terminal or receiving end according to the parallel work-flow symbol in parallel executive plan, and is being to connect
When receiving end, the detection message that transmitting terminal is sent can receive.Transmitting terminal is recorded when sending data to receiving end sends data
Number, and send data number reach setting number when send detection message to receiving end.
Wherein, setting number value in 1~100,000 ranges, is only for illustrating, is not used in restriction, specifically, with
Family can be as needed, selects suitable setting number.Such as in the biggish situation of data volume interaction, number setting can will be set
It is slightly smaller；In the lesser situation of data volume interaction, the slightly larger of number setting can will be set, so as to avoid executing parallel
A website or multiple websites in the works accumulates more data.
Step 220, the data volume of the receiving end accumulation is determined.
After receiving detection message, judge the parallel work-flow tally used in ancient times as credentials or a warrant point of the parallel executive plan as receiving end in local
Data whether have been accumulated, that is, have determined the data volume of accumulation.
Step 230, if the data volume of receiving end accumulation is more than setting quantity, data are handled in the receiving end
And when the data volume accumulated is no more than the setting quantity, response message is sent to the transmitting terminal.
Wherein, setting quantity value in 1~100,000 ranges, is only for illustrating, and is not used in restriction, specific value can
With identical as the setting number.
If the parallel work-flow tally used in ancient times as credentials or a warrant point of the parallel executive plan as receiving end is more than setting in the quantity locally accumulated
Quantity, then be arranged detection on the parallel work-flow tally used in ancient times as credentials or a warrant point and mark, and has received detection message for mark, at this moment can be with
Batch processing data, and after handling batch of data, check the data volume of remaining accumulation, if also greater than setting quantity, then
After handling batch of data, the data volume of remaining accumulation is checked again for, if being less than or equal to setting quantity, response is sent and disappears
It ceases to transmitting terminal, and removes the label of the detection on the parallel work-flow tally used in ancient times as credentials or a warrant point.Subsequent transmitting terminal receives after response message can be with
Receiving end is sent data to again.
Wherein, when receiving end handles data, a specific batch processing how many data are determined by the attribute of database.
The technical solution of the present embodiment is sent out by the parallel work-flow tally used in ancient times as credentials or a warrant point in parallel executive plan to receive when receiving end
The detection message that sending end is sent determines the data volume of receiving end accumulation, if the data volume of accumulation is more than setting quantity,
When receiving the data volume for handling data and accumulation no more than setting quantity, response message is sent to transmitting terminal, to send
End can send data to receiving end again, can control the flow for sending data, avoid the unconfined transmission of data
It is caused to generate packing phenomenon on certain nodes, it is possible to reduce memory that data in a website or multiple websites occupy or
Disk space improves overall performance.
Based on the above technical solution, also optional to include：
When the data volume of accumulation is no more than setting quantity in the receiving end, response message is directly transmitted to the transmission
End.
When receiving detection message in receiving end, and determining that the data volume of accumulation is no more than setting quantity, sound is directly transmitted
It answers message to transmitting terminal, so that transmitting terminal can immediately begin to the transmission of next round data, saves data processing time.
Embodiment three
Fig. 4 is a kind of structural schematic diagram of the synchronizing device for parallel executive plan that the embodiment of the present invention three provides, this reality
It applies example and is applicable to the case where synchronizing to the data of each website in parallel executive plan, which can execute this hair
The synchronous method for the parallel executive plan that bright embodiment one provides, which can be realized by software and/or hardware, generally may be used
It is integrated in database server.As shown in figure 4, the synchronizing device of parallel executive plan described in the present embodiment includes：Data
Transmission times logging modle 310, detection message transmission module 320 and control module 330.
Wherein, data transmission times logging modle 310 is to send for the parallel work-flow tally used in ancient times as credentials or a warrant point in parallel executive plan
When holding and sending data to receiving end, record sends the number of data；
Detect message transmission module 320, for send data number reach setting number when, send detection message to
The receiving end；
Control module 330, for waiting the receiving end to return to the response message of the detection message, and receiving
After stating response message, re-executes above-mentioned transmission data and record the number for sending data and reach and set in the number for sending data
Detection message is sent when determining number and receives the operation of response message, until data are sent, wherein the response message is
What the receiving end was sent when the data volume of accumulation is no more than setting quantity.
Optionally, the data transmission times logging modle includes：
Variable setting unit, for the parallel work-flow tally used in ancient times as credentials or a warrant point in parallel executive plan be transmitting terminal when, be arranged variable, and
The initial value of the variable is assigned a value of 0, the variable is used to record time that the transmitting terminal sends data to the receiving end
Number；
Variable adding unit is used for when the transmitting terminal sends a data to the receiving end, by the variable
Value increases by one；
Described device further includes：
Variable dump block, for when sending detection message to the receiving end, the value of the variable to be reset.
Parallel executive plan provided by the embodiment of the present invention one can be performed in the synchronizing device of above-mentioned parallel executive plan
Synchronous method has the corresponding functional module of execution method and beneficial effect.The technology of detailed description is not thin in the present embodiment
Section, reference can be made to the synchronous method for the parallel executive plan that the embodiment of the present invention one provides.
Example IV
Fig. 5 is a kind of structural schematic diagram of the synchronizing device for parallel executive plan that the embodiment of the present invention four provides, this reality
It applies example and is applicable to the case where synchronizing to the data of each website in parallel executive plan, which can execute this hair
The synchronous method for the parallel executive plan that bright embodiment two provides, which can be realized by software and/or hardware, generally may be used
It is integrated in database server.As shown in figure 5, the synchronizing device of parallel executive plan described in the present embodiment includes：Detection
Message reception module 410, accumulation data volume determining module 420 and response message sending module 430.
Wherein, message reception module 410 is detected, is receiving end for the parallel work-flow tally used in ancient times as credentials or a warrant point in parallel executive plan
When, receive the detection message that sends of transmitting terminal, the detection message is that the transmitting terminal reaches in the number for sending data and sets
Determine to send when number；
Data volume determining module 420 is accumulated, for determining the data volume of the receiving end accumulation；
Response message sending module 430, if the data volume for receiving end accumulation is more than setting quantity, in institute
State receiving end processing data and accumulate data volume be no more than the setting quantity when, transmission response message to the transmission
End.
Optionally, described device further includes：
Response message directly transmits module, when the data volume for accumulating in the receiving end is no more than setting quantity, directly
Response message is received and sent to the transmitting terminal.
Parallel executive plan provided by the embodiment of the present invention two can be performed in the synchronizing device of above-mentioned parallel executive plan
Synchronous method has the corresponding functional module of execution method and beneficial effect.The technology of detailed description is not thin in the present embodiment
Section, reference can be made to the synchronous method of parallel executive plan provided by Embodiment 2 of the present invention.
Embodiment five
Fig. 6 is a kind of structural schematic diagram for database server that the embodiment of the present invention five provides, as shown in fig. 6, the number
It include processor 510, memory 520, input unit 530 and output device 540 according to library server；Processor 510 in server
Quantity can be one or more, in Fig. 6 by taking a processor 510 as an example；Processor 510, memory in server
520, input unit 530 can be connected with output device 540 by bus or other modes, to be connected as by bus in Fig. 6
Example.
Memory 520 is used as a kind of computer readable storage medium, can be used for storing software program, journey can be performed in computer
Sequence and module, as the corresponding program instruction/module of the synchronous method of the parallel executive plan in the embodiment of the present invention (for example,
Data transmission times logging modle 310, detection message transmission module 320 and control mould in the synchronizing device of parallel executive plan
Block 330, alternatively, detection message reception module 410, accumulation data volume determining module in the synchronizing device of parallel executive plan
420 and response message sending module 430).Processor 510 by operation be stored in memory 520 software program, instruction with
And module realizes the same of above-mentioned parallel executive plan thereby executing the various function application and data processing of server
One step process.
Memory 520 can mainly include storing program area and storage data area, wherein storing program area can store operation system
Application program needed for system, at least one function；Storage data area, which can be stored, uses created data etc. according to server.
It can also include nonvolatile memory in addition, memory 520 may include high-speed random access memory, for example, at least one
A disk memory, flush memory device or other non-volatile solid state memory parts.In some instances, memory 520 can be into
One step includes the memory remotely located relative to processor 510, these remote memories can pass through network connection to service
Device.The example of above-mentioned network includes but is not limited to internet, intranet, local area network, mobile radio communication and combinations thereof.
Input unit 530 can be used for receiving the number or character information of input, and generate the user setting with server
And the related key signals input of function control.Output device 540 may include that display screen etc. shows equipment.
Embodiment six
The embodiment of the present invention six also provides a kind of storage medium comprising computer executable instructions, and the computer can be held
When being executed by computer processor for executing a kind of synchronous method of parallel executive plan, this method includes for row instruction：
When the parallel work-flow tally used in ancient times as credentials or a warrant point of parallel executive plan is transmitting terminal and sends data to receiving end, record sends number
According to number；
When the number for sending data reaches setting number, detection message is sent to the receiving end；
The receiving end is waited to return to the response message of the detection message, and after receiving the response message, weight
It newly executes above-mentioned transmission data and records the number for sending data and send inspection when the number for sending data reaches setting number
Survey the operation of message, wherein the response message is receiving end transmission when the data volume of accumulation is no more than setting quantity
's.
Alternatively, the computer executable instructions by computer processor when being executed by executing based on the parallel execution of one kind
The synchronous method drawn, this method include：
When the parallel work-flow tally used in ancient times as credentials or a warrant point of parallel executive plan is receiving end, the detection message that transmitting terminal is sent is received,
The detection message is that the transmitting terminal is sent when the number for sending data reaches setting number；
Determine the data volume of the receiving end accumulation；
If the data volume of the receiving end accumulation is more than setting quantity, data are handled in the receiving end and are accumulated
Data volume be no more than the setting quantity when, transmission response message to the transmitting terminal.
Certainly, a kind of storage medium comprising computer executable instructions, computer provided by the embodiment of the present invention
The method operation that executable instruction is not limited to the described above, can also be performed parallel execution provided by any embodiment of the invention
Relevant operation in the synchronous method of plan.
By the description above with respect to embodiment, it is apparent to those skilled in the art that, the present invention
It can be realized by software and required common hardware, naturally it is also possible to which by hardware realization, but in many cases, the former is more
Good embodiment.Based on this understanding, technical solution of the present invention substantially in other words contributes to the prior art
Part can be embodied in the form of software products, which can store in computer readable storage medium
In, floppy disk, read-only memory (Read-Only Memory, ROM), random access memory (Random such as computer
Access Memory, RAM), flash memory (FLASH), hard disk or CD etc., including some instructions are with so that a computer is set
Standby (can be personal computer, server or the network equipment etc.) executes method described in each embodiment of the present invention.
It is worth noting that, in the embodiment of the synchronizing device of above-mentioned parallel executive plan, included each unit and
Module is only divided according to the functional logic, but is not limited to the above division, as long as corresponding functions can be realized
?；In addition, the specific name of each functional unit is also only for convenience of distinguishing each other, the protection being not intended to restrict the invention
Range.
Note that the above is only a better embodiment of the present invention and the applied technical principle.It will be appreciated by those skilled in the art that
The invention is not limited to the specific embodiments described herein, be able to carry out for a person skilled in the art it is various it is apparent variation,
It readjusts and substitutes without departing from protection scope of the present invention.Therefore, although being carried out by above embodiments to the present invention
It is described in further detail, but the present invention is not limited to the above embodiments only, without departing from the inventive concept, also
It may include more other equivalent embodiments, and the scope of the invention is determined by the scope of the appended claims.
Claims (10)
1. a kind of synchronous method of parallel executive plan, which is characterized in that the method includes：
When the parallel work-flow tally used in ancient times as credentials or a warrant point of parallel executive plan is transmitting terminal and sends data to receiving end, record sends data
Number；
When the number for sending data reaches setting number, detection message is sent to the receiving end；
It waits the receiving end to return to the response message of the detection message, and after receiving the response message, holds again
The above-mentioned transmission data of row simultaneously record the number for sending data and send detection when the number for sending data reaches setting number and disappear
Breath and the operation for receiving response message, until data are sent, wherein the response message is the receiving end in accumulation
It is sent when data volume is no more than setting quantity.
2. the method according to claim 1, wherein the parallel work-flow tally used in ancient times as credentials or a warrant point in parallel executive plan is to send
When holding and sending data to receiving end, record sends the number of data, including：
When the parallel work-flow tally used in ancient times as credentials or a warrant point of parallel executive plan is transmitting terminal, variable is set, and the initial value of the variable is assigned
Value is 0, and the variable is for recording the number that the transmitting terminal sends data to the receiving end；
When the transmitting terminal sends a data to the receiving end, the value of the variable is increased by one；
When sending detection message to the receiving end, further include：
The value of the variable is reset.
3. a kind of synchronous method of parallel executive plan, which is characterized in that the method includes：
When the parallel work-flow tally used in ancient times as credentials or a warrant point of parallel executive plan is receiving end, the detection message that transmitting terminal is sent is received, it is described
Detection message is that the transmitting terminal is sent when the number for sending data reaches setting number；
Determine the data volume of the receiving end accumulation；
If the data volume of the receiving end accumulation is more than setting quantity, in the number that the receiving end handles data and accumulates
When being no more than the setting quantity according to amount, response message is sent to the transmitting terminal.
4. according to the method described in claim 3, it is characterized in that, further including：
When the data volume of accumulation is no more than setting quantity in the receiving end, response message is directly transmitted to the transmitting terminal.
5. a kind of synchronizing device of parallel executive plan, which is characterized in that described device includes：
Data transmission times logging modle is transmitting terminal for the parallel work-flow tally used in ancient times as credentials or a warrant point in parallel executive plan and sends data
When to receiving end, record sends the number of data；
Message transmission module is detected, when for reaching setting number in the number for sending data, detection message is sent and being connect to described
Receiving end；
Control module for waiting the receiving end to return to the response message of the detection message, and is receiving the response
After message, re-executes above-mentioned transmission data and record the number for sending data and reach setting number in the number for sending data
When send detection message and receive the operation of response message, until data are sent, wherein the response message is described connects
What receiving end was sent when the data volume of accumulation is no more than setting quantity.
6. device according to claim 5, which is characterized in that the data transmission times logging modle includes：
When variable setting unit for the parallel work-flow tally used in ancient times as credentials or a warrant point in parallel executive plan is transmitting terminal, variable is set, and by institute
The initial value for stating variable is assigned a value of 0, and the variable is for recording the number that the transmitting terminal sends data to the receiving end；
Variable adding unit, for when the transmitting terminal sends a data to the receiving end, the value of the variable to be increased
Add one；
Described device further includes：
Variable dump block, for when sending detection message to the receiving end, the value of the variable to be reset.
7. a kind of synchronizing device of parallel executive plan, which is characterized in that described device includes：
Detect message reception module, for the parallel work-flow tally used in ancient times as credentials or a warrant point in parallel executive plan be receiving end when, receive transmitting terminal
The detection message sent, the detection message are transmitting terminal transmissions when the number for sending data reaches setting number
's；
Data volume determining module is accumulated, for determining the data volume of the receiving end accumulation；
Response message sending module, if the data volume for receiving end accumulation is more than setting quantity, in the reception
When the data volume for handling data and accumulation being held to be no more than the setting quantity, response message is sent to the transmitting terminal.
8. device according to claim 7, which is characterized in that further include：
Response message directly transmits module, when the data volume for accumulating in the receiving end is no more than setting quantity, directly sends out
Send response message to the transmitting terminal.
9. a kind of database server, which is characterized in that the server includes：
One or more processors；
Storage device, for storing one or more programs,
When one or more of programs are executed by one or more of processors, so that one or more of processors are real
The now synchronous method of the parallel executive plan as described in any in claim 1-2 or 3-4.
10. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor
The synchronous method of the parallel executive plan as described in any in claim 1-2 or 3-4 is realized when execution.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810488211.2A CN108829735B (en) | 2018-05-21 | 2018-05-21 | Synchronization method, device, server and storage medium for parallel execution plan |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810488211.2A CN108829735B (en) | 2018-05-21 | 2018-05-21 | Synchronization method, device, server and storage medium for parallel execution plan |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108829735A true CN108829735A (en) | 2018-11-16 |
| CN108829735B CN108829735B (en) | 2021-06-29 |
Family
ID=64148242
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810488211.2A Active CN108829735B (en) | 2018-05-21 | 2018-05-21 | Synchronization method, device, server and storage medium for parallel execution plan |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108829735B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110569257A (en) * | 2019-09-16 | 2019-12-13 | 上海达梦数据库有限公司 | data processing method, corresponding device, equipment and storage medium |
| CN111753028A (en) * | 2020-07-02 | 2020-10-09 | 上海达梦数据库有限公司 | Data transmission method, device, equipment and storage medium |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1941954A (en) * | 2005-09-29 | 2007-04-04 | 中兴通讯股份有限公司 | Method for controlling HSDPA flow based on feedback mode |
| CN102081678A (en) * | 2011-03-14 | 2011-06-01 | 华中科技大学 | Method for searching optimal execution plan in database query |
| CN102323946A (en) * | 2011-09-05 | 2012-01-18 | 天津神舟通用数据技术有限公司 | Implementation method for operator reuse in parallel database |
| CN102480500A (en) * | 2010-11-26 | 2012-05-30 | 黑龙江亿林网络技术服务有限公司 | Distributed harmful information management system and method |
| CN102571277A (en) * | 2011-12-29 | 2012-07-11 | 中兴通讯股份有限公司 | Method and device for sending serial number detection message |
| CN102780593A (en) * | 2012-07-25 | 2012-11-14 | 中兴通讯股份有限公司 | BFD (Bidirectional Forwarding Detection) protocol-based link detection method and apparatus and network processor |
| US20150066972A1 (en) * | 2013-09-05 | 2015-03-05 | Futurewei Technologies, Inc. | Mechanism for Optimizing Parallel Execution of Queries on Symmetric Resources |
| CN104639298A (en) * | 2013-11-08 | 2015-05-20 | 腾讯科技（深圳）有限公司 | Data transmission method, device and system |
| CN106302201A (en) * | 2015-05-14 | 2017-01-04 | 华为技术有限公司 | Flow control methods, equipment and system |
| CN107656937A (en) * | 2016-07-26 | 2018-02-02 | 北京京东尚科信息技术有限公司 | Method and apparatus for realizing read-write data consistency |
| CN107688660A (en) * | 2017-09-08 | 2018-02-13 | 上海达梦数据库有限公司 | The execution method and device of parallel executive plan |
| CN108052635A (en) * | 2017-12-20 | 2018-05-18 | 江苏瑞中数据股份有限公司 | A kind of heterogeneous data source unifies conjunctive query method |
-
2018
- 2018-05-21 CN CN201810488211.2A patent/CN108829735B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1941954A (en) * | 2005-09-29 | 2007-04-04 | 中兴通讯股份有限公司 | Method for controlling HSDPA flow based on feedback mode |
| CN102480500A (en) * | 2010-11-26 | 2012-05-30 | 黑龙江亿林网络技术服务有限公司 | Distributed harmful information management system and method |
| CN102081678A (en) * | 2011-03-14 | 2011-06-01 | 华中科技大学 | Method for searching optimal execution plan in database query |
| CN102323946A (en) * | 2011-09-05 | 2012-01-18 | 天津神舟通用数据技术有限公司 | Implementation method for operator reuse in parallel database |
| CN102571277A (en) * | 2011-12-29 | 2012-07-11 | 中兴通讯股份有限公司 | Method and device for sending serial number detection message |
| CN102780593A (en) * | 2012-07-25 | 2012-11-14 | 中兴通讯股份有限公司 | BFD (Bidirectional Forwarding Detection) protocol-based link detection method and apparatus and network processor |
| US20150066972A1 (en) * | 2013-09-05 | 2015-03-05 | Futurewei Technologies, Inc. | Mechanism for Optimizing Parallel Execution of Queries on Symmetric Resources |
| CN104639298A (en) * | 2013-11-08 | 2015-05-20 | 腾讯科技（深圳）有限公司 | Data transmission method, device and system |
| CN106302201A (en) * | 2015-05-14 | 2017-01-04 | 华为技术有限公司 | Flow control methods, equipment and system |
| CN107656937A (en) * | 2016-07-26 | 2018-02-02 | 北京京东尚科信息技术有限公司 | Method and apparatus for realizing read-write data consistency |
| CN107688660A (en) * | 2017-09-08 | 2018-02-13 | 上海达梦数据库有限公司 | The execution method and device of parallel executive plan |
| CN108052635A (en) * | 2017-12-20 | 2018-05-18 | 江苏瑞中数据股份有限公司 | A kind of heterogeneous data source unifies conjunctive query method |
Non-Patent Citations (2)
| Title |
|---|
| M LACLAVIK 等: "Email Analysis and Information Extraction for Enterprise Benefit", 《COMPUTING AND INFORMATICS》 * |
| 郑黎辉: "数据库并行查询优化的设计与实现", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110569257A (en) * | 2019-09-16 | 2019-12-13 | 上海达梦数据库有限公司 | data processing method, corresponding device, equipment and storage medium |
| CN110569257B (en) * | 2019-09-16 | 2022-04-01 | 上海达梦数据库有限公司 | Data processing method, corresponding device, equipment and storage medium |
| CN111753028A (en) * | 2020-07-02 | 2020-10-09 | 上海达梦数据库有限公司 | Data transmission method, device, equipment and storage medium |
| CN111753028B (en) * | 2020-07-02 | 2023-08-25 | 上海达梦数据库有限公司 | Data transmission method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108829735B (en) | 2021-06-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106528432B (en) | The construction method and device of test scene data bury a test method | |
| US10956244B1 (en) | Systems and methods for automated application programming interface evaluation and migration | |
| CN110297766A (en) | Method for testing software and software testing system based on distributed test node cluster | |
| CN102035696B (en) | Website access performance monitoring method, device and system | |
| CN104092719B (en) | Document transmission method, device and distributed cluster file system | |
| CN103051717A (en) | Method, device and equipment for processing http request | |
| CN105577772A (en) | Material receiving method, material uploading method and device | |
| CN109741060A (en) | Information inquiry system, method, device, electronic equipment and storage medium | |
| US20170168881A1 (en) | Process chain discovery across communication channels | |
| CN105579976B (en) | Webpage automated testing method and device | |
| CN103902446A (en) | Network server automated testing method and device | |
| CN103607476A (en) | System and method for distributed multi-stage persistence of huge number of messages | |
| CN109739711A (en) | A kind of interface test method, device, equipment and storage medium | |
| CN108829735A (en) | Synchronous method, device, server and the storage medium of parallel executive plan | |
| CN110677684A (en) | Video processing method, video access method, distributed storage method and distributed video access system | |
| KR101663412B1 (en) | Method for Defining Quality of Things based on DDS in Internet of Things | |
| US9590934B2 (en) | Method and system of creating a graylist for message transmission | |
| CN103716230A (en) | Message sending method, device and server | |
| CN110430070A (en) | A kind of service state analysis method, device, server, data analysis equipment and medium | |
| TWI843063B (en) | Computer-implemented method and computer-implemented system | |
| CN107302584A (en) | A kind of efficient collecting method | |
| CN108664550A (en) | It is a kind of that funnel analysis method and device are carried out to user behavior data | |
| CN109471746A (en) | A kind of collection method and system of cluster log | |
| CN106933718B (en) | Method for monitoring performance and device | |
| Nilsson et al. | Performance evaluation of message-oriented middleware |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |