CN108829735A - Synchronous method, device, server and the storage medium of parallel executive plan - Google Patents

Synchronous method, device, server and the storage medium of parallel executive plan Download PDF

Info

Publication number
CN108829735A
CN108829735A CN201810488211.2A CN201810488211A CN108829735A CN 108829735 A CN108829735 A CN 108829735A CN 201810488211 A CN201810488211 A CN 201810488211A CN 108829735 A CN108829735 A CN 108829735A
Authority
CN
China
Prior art keywords
data
receiving end
parallel
executive plan
transmitting terminal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201810488211.2A
Other languages
Chinese (zh)
Other versions
CN108829735B (en
Inventor
韩朱忠
郭振岗
王海龙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Dameng Database Co Ltd
Original Assignee
Shanghai Dameng Database Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Dameng Database Co Ltd filed Critical Shanghai Dameng Database Co Ltd
Priority to CN201810488211.2A priority Critical patent/CN108829735B/en
Publication of CN108829735A publication Critical patent/CN108829735A/en
Application granted granted Critical
Publication of CN108829735B publication Critical patent/CN108829735B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Information Transfer Between Computers (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses synchronous method, device, server and the storage mediums of a kind of parallel executive plan.This method includes:When the parallel work-flow tally used in ancient times as credentials or a warrant point of parallel executive plan is transmitting terminal and sends data to receiving end, record sends the number of data;When the number for sending data reaches setting number, detection message is sent to receiving end;Receiving end is waited to return to the response message of detection message, and after receiving response message, it re-executes above-mentioned transmission data and records the number for sending data and send detection message when the number for sending data reaches setting number and receive the operation of response message, until data are sent, wherein, response message is that receiving end is sent when the data volume of accumulation is no more than setting quantity.The present invention can control the flow for sending data, so as to reduce the memory or disk space of the occupancy of the data in a website or multiple websites, improve overall performance.

Description

Synchronous method, device, server and the storage medium of parallel executive plan
Technical field
The present embodiments relate to database technology more particularly to a kind of synchronous method, device, the clothes of parallel executive plan Business device and storage medium.
Background technique
In supporting parallel query or distributed data base system, executive plan can execute parallel in each website, the execution Plan is known as parallel executive plan.Parallel executive plan is to joined on the basis of common executive plan with communication function Parallel work-flow tally used in ancient times as credentials or a warrant point, parallel work-flow symbol include collect (gather), distribution (distribute) and diverging (scatter) Deng.
Parallel executive plan is sent to each website and executes parallel, is accorded with by parallel work-flow therein, can control number According between website movement with it is synchronous, be finally aggregated into the home site inquired, and be uploaded to client.
Since the data volume of each website is different, the difference of station system resource or the characteristics of parallel executive plan itself, Parallel executive plan is in the process of implementation, it is understood that there may be the data between each website transmit nonsynchronous phenomenon, cause to check out Data on one or more websites bulk deposition, occupy more memory or disk space, cause the decline of overall performance.
Summary of the invention
In view of this, the embodiment of the present invention provides synchronous method, device, server and the storage of a kind of parallel executive plan Medium improves overall performance with memory or disk space that the data reduced in a website or multiple websites occupy.
In a first aspect, the embodiment of the invention provides a kind of synchronous method of parallel executive plan, the method includes:
When the parallel work-flow tally used in ancient times as credentials or a warrant point of parallel executive plan is transmitting terminal and sends data to receiving end, record sends number According to number;
When the number for sending data reaches setting number, detection message is sent to the receiving end;
The receiving end is waited to return to the response message of the detection message, and after receiving the response message, weight It newly executes above-mentioned transmission data and records the number for sending data and send inspection when the number for sending data reaches setting number It surveys message and receives the operation of response message, until data are sent, wherein the response message is the receiving end in heap It is sent when long-pending data volume is no more than setting quantity.
Second aspect, the embodiment of the invention also provides a kind of synchronous method of parallel executive plan, the method includes:
When the parallel work-flow tally used in ancient times as credentials or a warrant point of parallel executive plan is receiving end, the detection message that transmitting terminal is sent is received, The detection message is that the transmitting terminal is sent when the number for sending data reaches setting number;
Determine the data volume of the receiving end accumulation;
If the data volume of the receiving end accumulation is more than setting quantity, data are handled in the receiving end and are accumulated Data volume be no more than the setting quantity when, transmission response message to the transmitting terminal.
The third aspect, the embodiment of the invention also provides a kind of synchronizing device of parallel executive plan, described device includes:
Data transmission times logging modle is transmitting terminal for the parallel work-flow tally used in ancient times as credentials or a warrant point in parallel executive plan and sends When data are to receiving end, record sends the number of data;
Message transmission module being detected, when for reaching setting number in the number for sending data, sending detection message to institute State receiving end;
Control module, for waiting the receiving end to return to the response message of the detection message, and it is described receiving After response message, re-executes above-mentioned transmission data and record the number for sending data and reach setting in the number for sending data Detection message is sent when number and receives the operation of response message, until data are sent, wherein the response message is institute State what receiving end was sent when the data volume of accumulation is no more than setting quantity.
Fourth aspect, the embodiment of the invention also provides a kind of synchronizing device of parallel executive plan, described device includes:
Detect message reception module, for the parallel work-flow tally used in ancient times as credentials or a warrant point in parallel executive plan be receiving end when, receive hair The detection message that sending end is sent, the detection message are transmitting terminal hairs when the number for sending data reaches setting number It send;
Data volume determining module is accumulated, for determining the data volume of the receiving end accumulation;
Response message sending module, if the data volume for receiving end accumulation is more than setting quantity, described Receiving end handle data and accumulate data volume be no more than the setting quantity when, transmission response message to the transmitting terminal.
5th aspect, the embodiment of the invention also provides a kind of database server, the server includes:
One or more processors;
Storage device, for storing one or more programs,
When one or more of programs are executed by one or more of processors, so that one or more of processing Device realizes the synchronous method of parallel executive plan described in any embodiment of the present invention.
6th aspect, the embodiment of the invention also provides a kind of computer readable storage mediums, are stored thereon with computer Program realizes the synchronous method of parallel executive plan described in any embodiment of the present invention when the program is executed by processor.
The technical solution of the embodiment of the present invention is that transmitting terminal is concurrent by the parallel work-flow tally used in ancient times as credentials or a warrant point in parallel executive plan When sending data to receiving end, record sends the number of data, and sends detection when the number for sending data reaches setting number Message gives the receiving end, and receiving end is waited to return to the response message of detection message, and after receiving response message, retransmits Data can control the flow for sending data to receiving end, avoid caused by the unconfined transmission of data in certain sections Packing phenomenon is generated on point, so as to reduce the memory or disk space of the occupancy of the data in a website or multiple websites, Improve overall performance.
Detailed description of the invention
Fig. 1 is a kind of flow chart of the synchronous method for parallel executive plan that the embodiment of the present invention one provides;
Fig. 2 is the example of the parallel executive plan in the synchronous method of parallel executive plan provided in an embodiment of the present invention Figure;
Fig. 3 is a kind of flow chart of the synchronous method of parallel executive plan provided by Embodiment 2 of the present invention;
Fig. 4 is a kind of structural schematic diagram of the synchronizing device for parallel executive plan that the embodiment of the present invention three provides;
Fig. 5 is a kind of structural schematic diagram of the synchronizing device for parallel executive plan that the embodiment of the present invention four provides;
Fig. 6 is a kind of structural schematic diagram for database server that the embodiment of the present invention five provides.
Specific embodiment
The present invention is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouched The specific embodiment stated is used only for explaining the present invention rather than limiting the invention.It also should be noted that in order to just In description, only some but not all contents related to the present invention are shown in the drawings.
Embodiment one
Fig. 1 is a kind of flow chart of the synchronous method for parallel executive plan that the embodiment of the present invention one provides, the present embodiment It is applicable to the case where synchronizing to the data of each website in parallel executive plan, this method can be by executing meter parallel The synchronizing device drawn executes, which can be realized by software and/or hardware, can generally be integrated in database server In.This method specifically comprises the following steps:
Step 110, when the parallel work-flow tally used in ancient times as credentials or a warrant point of parallel executive plan is transmitting terminal and sends data to receiving end, note Record sends the number of data.
Wherein, parallel executive plan refers in supporting parallel query or distributed Database Systems, can be in each website The executive plan executed parallel.Wherein, website refers to a database instance, and for parallel query, executive plan is in each line Cheng Binghang is executed, then per thread can be described as a website;For distributed data base system, executive plan is in each database Parallel to execute, a database is known as a website.Parallel executive plan is on the basis of common executive plan, and addition has The parallel work-flow of communication function accords with (being referred to as MOTION operator) node, wherein parallel work-flow symbol includes collecting (GATHER), distribution (DISTRIBUTE), diverging (SCATTER) etc. may include one in a parallel executive plan or more A parallel work-flow tally used in ancient times as credentials or a warrant point, is distributed in the different levels of executive plan tree.One website by parallel executive plan and Row operator node can parallel work-flow tally used in ancient times as credentials or a warrant point identical in other websites in parallel executive plan communicated, i.e., Parallel executive plan is sent to each website and executes parallel, by parallel work-flow tally used in ancient times as credentials or a warrant point therein, can control data and exists Moved between website with it is synchronous, be finally aggregated into the home site inquired and be uploaded to client.
When multiple websites are performed in parallel parallel executive plan, the executive plan of each website be it is identical, stand Between point using parallel work-flow tally used in ancient times as credentials or a warrant point communicated with it is synchronous.The same parallel work-flow accords with the communication executed on different websites Movement may be different.Such as home site A and slave site B executes parallel executive plan shown in Fig. 2, wherein GATHER is to grasp parallel Make tally used in ancient times as credentials or a warrant point.Then the GATHER operator node of home site A is used to collect the data of the GATHER operator node of slave site B, The GATHER operator node of slave site B can then send the data to the GATHER operator node of home site A, at this point, claim from The GATHER operator node of website B is transmitting terminal, and the GATHER operator node of home site A is receiving end.Simultaneously for other Row operator node, such as SCATTER, then the SCATTER operator node of home site is transmitting terminal, the SCATTER behaviour of slave site Making tally used in ancient times as credentials or a warrant point is receiving end, may send and receive data simultaneously there are also certain parallel work-flow tally used in ancient times as credentials or a warrant points, then be both transmitting terminal It is receiving end.Receiving end and transmitting terminal can be in the same database servers, can also be in different database servers In.
Website judges it itself is transmitting terminal or receiving end according to the parallel work-flow symbol in parallel executive plan, and is being hair When sending end, 0 is set by the number initial value for sending data, transmitting terminal sends a data to receiving end, is increased by primary meter Number, to count on the data volume for being sent to receiving end, i.e., the number of total transmission data is the data for being destined to receiving end Amount.
Step 120, when the number for sending data reaches setting number, detection message is sent to the receiving end.
Wherein, setting number value in 1~100,000 ranges, is only for illustrating, is not used in restriction, specifically, with Family can be as needed, selects suitable setting number.Such as in the biggish situation of data volume interaction, number setting can will be set It is slightly smaller;In the lesser situation of data volume interaction, the slightly larger of number setting can will be set, so as to avoid executing parallel A website or multiple websites in the works accumulates more data.
When the number for sending data reaches setting number, detection message is sent to receiving end, and stops sending data to Receiving end, so as to detect whether receiving end has accumulated more data.
Wherein, when the parallel work-flow tally used in ancient times as credentials or a warrant point of parallel executive plan is transmitting terminal and sends data to receiving end, record The number of data is sent, including:
When the parallel work-flow tally used in ancient times as credentials or a warrant point of parallel executive plan is transmitting terminal, variable is set, and by the initial of the variable Value is assigned a value of 0, and the variable is for recording the number that the transmitting terminal sends data to the receiving end;
When the transmitting terminal sends a data to the receiving end, the value of the variable is increased by one;
When sending detection message to the receiving end, further include:
The value of the variable is reset.
When the parallel work-flow tally used in ancient times as credentials or a warrant point of parallel executive plan is transmitting terminal, a variable is set, for recording transmitting terminal The value of variable is increased by one, thus just when transmitting terminal sends a data to receiving end by the number for sending data to receiving end It is counted in the number for sending data.
When sending detection message to receiving end, stopping sends data to receiving end, determines that the transmission of epicycle data has terminated, The value of variable is reset, convenient for the subsequent number for restarting to send data and record transmission data.
Step 130, it waits the receiving end to return to the response message of the detection message, and receives the response message, Step 110 is executed later, until data are sent.
Wherein, the response message is that the receiving end is sent when the data volume of accumulation is no more than setting quantity.Institute Setting quantity value in 1~100,000 ranges is stated, is only for illustrating, is not used in restriction, specific value can be with the setting time Number is identical.
If more data have been accumulated in receiving end, will not make an immediate response the detection message, reach in the data of accumulation It is required that when can just respond.Transmitting terminal sends detection message, no longer sends data to receiving end, needs that receiving end is waited to return to detection The response message of message, and when receiving response message, it just determines that the data of receiving end are not accumulated, can continue to send number According to receiving end is given, current limliting is realized, to ensure that the data of each website are synchronous.
After receiving response message, then determine send data number whether reach setting number when, only determine receive Whether the number that data are retransmitted after to response message reaches setting number.
Step 140, judge whether data are sent, if not, 110 are thened follow the steps, if it is, terminating.
The technical solution of the present embodiment is transmitting terminal by the parallel work-flow tally used in ancient times as credentials or a warrant point in parallel executive plan and sends number When according to giving receiving end, record sends the number of data, and detection message is sent when the number for sending data reaches setting number To the receiving end, receiving end is waited to return to the response message of detection message, and after receiving response message, retransmits data To receiving end, the flow for sending data can be controlled, be avoided caused by the unconfined transmission of data on certain nodes Packing phenomenon is generated, so as to reduce the memory or disk space of the occupancy of the data in a website or multiple websites, is improved Overall performance.
Embodiment two
Fig. 3 is a kind of flow chart of the synchronous method of parallel executive plan provided by Embodiment 2 of the present invention, the present embodiment It is applicable to the case where synchronizing to the data of each website in parallel executive plan, this method can be by executing meter parallel The synchronizing device drawn executes, which can be realized by software and/or hardware, can generally be integrated in database server In.This method specifically comprises the following steps:
Step 210, when the parallel work-flow tally used in ancient times as credentials or a warrant point of parallel executive plan is receiving end, the inspection that transmitting terminal is sent is received Message is surveyed, the detection message is that the transmitting terminal is sent when the number for sending data reaches setting number.
Wherein, parallel executive plan refers in supporting parallel query or distributed Database Systems, can be in each website The executive plan executed parallel.Wherein, website refers to a database instance, and for parallel query, executive plan is in each line Cheng Binghang is executed, then per thread can be described as a website;For distributed data base system, executive plan is in each database Parallel to execute, a database is known as a website.Parallel executive plan is on the basis of common executive plan, and addition has The parallel work-flow of communication function accords with (being referred to as MOTION operator) node, wherein parallel work-flow symbol includes collecting (GATHER), distribution (DISTRIBUTE), diverging (SCATTER) etc. may include one in a parallel executive plan or more A parallel work-flow tally used in ancient times as credentials or a warrant point, is distributed in the different levels of executive plan tree.One website by parallel executive plan and Row operator node can parallel work-flow tally used in ancient times as credentials or a warrant point identical in other websites in parallel executive plan communicated, i.e., Parallel executive plan is sent to each website and executes parallel, by parallel work-flow tally used in ancient times as credentials or a warrant point therein, can control data and exists Moved between website with it is synchronous, be finally aggregated into the home site inquired and be uploaded to client.
When multiple websites are performed in parallel parallel executive plan, the executive plan of each website be it is identical, stand Between point using parallel work-flow tally used in ancient times as credentials or a warrant point communicated with it is synchronous.The same parallel work-flow accords with the communication executed on different websites Movement may be different.Such as home site A and slave site B executes parallel executive plan shown in Fig. 2, wherein GATHER is to grasp parallel Make tally used in ancient times as credentials or a warrant point.Then the GATHER operator node of home site A is used to collect the data of the GATHER operator node of slave site B, The GATHER operator node of slave site B can then send the data to the GATHER operator node of home site A, at this point, claim from The GATHER operator node of website B is transmitting terminal, and the GATHER operator node of home site A is receiving end.Simultaneously for other Row operator node, such as SCATTER, then the SCATTER operator node of home site is transmitting terminal, the SCATTER behaviour of slave site Making tally used in ancient times as credentials or a warrant point is receiving end, may send and receive data simultaneously there are also certain parallel work-flow tally used in ancient times as credentials or a warrant points, then be both transmitting terminal It is receiving end.Receiving end and transmitting terminal can be in the same database servers, can also be in different database servers In.
Website judges it itself is transmitting terminal or receiving end according to the parallel work-flow symbol in parallel executive plan, and is being to connect When receiving end, the detection message that transmitting terminal is sent can receive.Transmitting terminal is recorded when sending data to receiving end sends data Number, and send data number reach setting number when send detection message to receiving end.
Wherein, setting number value in 1~100,000 ranges, is only for illustrating, is not used in restriction, specifically, with Family can be as needed, selects suitable setting number.Such as in the biggish situation of data volume interaction, number setting can will be set It is slightly smaller;In the lesser situation of data volume interaction, the slightly larger of number setting can will be set, so as to avoid executing parallel A website or multiple websites in the works accumulates more data.
Step 220, the data volume of the receiving end accumulation is determined.
After receiving detection message, judge the parallel work-flow tally used in ancient times as credentials or a warrant point of the parallel executive plan as receiving end in local Data whether have been accumulated, that is, have determined the data volume of accumulation.
Step 230, if the data volume of receiving end accumulation is more than setting quantity, data are handled in the receiving end And when the data volume accumulated is no more than the setting quantity, response message is sent to the transmitting terminal.
Wherein, setting quantity value in 1~100,000 ranges, is only for illustrating, and is not used in restriction, specific value can With identical as the setting number.
If the parallel work-flow tally used in ancient times as credentials or a warrant point of the parallel executive plan as receiving end is more than setting in the quantity locally accumulated Quantity, then be arranged detection on the parallel work-flow tally used in ancient times as credentials or a warrant point and mark, and has received detection message for mark, at this moment can be with Batch processing data, and after handling batch of data, check the data volume of remaining accumulation, if also greater than setting quantity, then After handling batch of data, the data volume of remaining accumulation is checked again for, if being less than or equal to setting quantity, response is sent and disappears It ceases to transmitting terminal, and removes the label of the detection on the parallel work-flow tally used in ancient times as credentials or a warrant point.Subsequent transmitting terminal receives after response message can be with Receiving end is sent data to again.
Wherein, when receiving end handles data, a specific batch processing how many data are determined by the attribute of database.
The technical solution of the present embodiment is sent out by the parallel work-flow tally used in ancient times as credentials or a warrant point in parallel executive plan to receive when receiving end The detection message that sending end is sent determines the data volume of receiving end accumulation, if the data volume of accumulation is more than setting quantity, When receiving the data volume for handling data and accumulation no more than setting quantity, response message is sent to transmitting terminal, to send End can send data to receiving end again, can control the flow for sending data, avoid the unconfined transmission of data It is caused to generate packing phenomenon on certain nodes, it is possible to reduce memory that data in a website or multiple websites occupy or Disk space improves overall performance.
Based on the above technical solution, also optional to include:
When the data volume of accumulation is no more than setting quantity in the receiving end, response message is directly transmitted to the transmission End.
When receiving detection message in receiving end, and determining that the data volume of accumulation is no more than setting quantity, sound is directly transmitted It answers message to transmitting terminal, so that transmitting terminal can immediately begin to the transmission of next round data, saves data processing time.
Embodiment three
Fig. 4 is a kind of structural schematic diagram of the synchronizing device for parallel executive plan that the embodiment of the present invention three provides, this reality It applies example and is applicable to the case where synchronizing to the data of each website in parallel executive plan, which can execute this hair The synchronous method for the parallel executive plan that bright embodiment one provides, which can be realized by software and/or hardware, generally may be used It is integrated in database server.As shown in figure 4, the synchronizing device of parallel executive plan described in the present embodiment includes:Data Transmission times logging modle 310, detection message transmission module 320 and control module 330.
Wherein, data transmission times logging modle 310 is to send for the parallel work-flow tally used in ancient times as credentials or a warrant point in parallel executive plan When holding and sending data to receiving end, record sends the number of data;
Detect message transmission module 320, for send data number reach setting number when, send detection message to The receiving end;
Control module 330, for waiting the receiving end to return to the response message of the detection message, and receiving After stating response message, re-executes above-mentioned transmission data and record the number for sending data and reach and set in the number for sending data Detection message is sent when determining number and receives the operation of response message, until data are sent, wherein the response message is What the receiving end was sent when the data volume of accumulation is no more than setting quantity.
Optionally, the data transmission times logging modle includes:
Variable setting unit, for the parallel work-flow tally used in ancient times as credentials or a warrant point in parallel executive plan be transmitting terminal when, be arranged variable, and The initial value of the variable is assigned a value of 0, the variable is used to record time that the transmitting terminal sends data to the receiving end Number;
Variable adding unit is used for when the transmitting terminal sends a data to the receiving end, by the variable Value increases by one;
Described device further includes:
Variable dump block, for when sending detection message to the receiving end, the value of the variable to be reset.
Parallel executive plan provided by the embodiment of the present invention one can be performed in the synchronizing device of above-mentioned parallel executive plan Synchronous method has the corresponding functional module of execution method and beneficial effect.The technology of detailed description is not thin in the present embodiment Section, reference can be made to the synchronous method for the parallel executive plan that the embodiment of the present invention one provides.
Example IV
Fig. 5 is a kind of structural schematic diagram of the synchronizing device for parallel executive plan that the embodiment of the present invention four provides, this reality It applies example and is applicable to the case where synchronizing to the data of each website in parallel executive plan, which can execute this hair The synchronous method for the parallel executive plan that bright embodiment two provides, which can be realized by software and/or hardware, generally may be used It is integrated in database server.As shown in figure 5, the synchronizing device of parallel executive plan described in the present embodiment includes:Detection Message reception module 410, accumulation data volume determining module 420 and response message sending module 430.
Wherein, message reception module 410 is detected, is receiving end for the parallel work-flow tally used in ancient times as credentials or a warrant point in parallel executive plan When, receive the detection message that sends of transmitting terminal, the detection message is that the transmitting terminal reaches in the number for sending data and sets Determine to send when number;
Data volume determining module 420 is accumulated, for determining the data volume of the receiving end accumulation;
Response message sending module 430, if the data volume for receiving end accumulation is more than setting quantity, in institute State receiving end processing data and accumulate data volume be no more than the setting quantity when, transmission response message to the transmission End.
Optionally, described device further includes:
Response message directly transmits module, when the data volume for accumulating in the receiving end is no more than setting quantity, directly Response message is received and sent to the transmitting terminal.
Parallel executive plan provided by the embodiment of the present invention two can be performed in the synchronizing device of above-mentioned parallel executive plan Synchronous method has the corresponding functional module of execution method and beneficial effect.The technology of detailed description is not thin in the present embodiment Section, reference can be made to the synchronous method of parallel executive plan provided by Embodiment 2 of the present invention.
Embodiment five
Fig. 6 is a kind of structural schematic diagram for database server that the embodiment of the present invention five provides, as shown in fig. 6, the number It include processor 510, memory 520, input unit 530 and output device 540 according to library server;Processor 510 in server Quantity can be one or more, in Fig. 6 by taking a processor 510 as an example;Processor 510, memory in server 520, input unit 530 can be connected with output device 540 by bus or other modes, to be connected as by bus in Fig. 6 Example.
Memory 520 is used as a kind of computer readable storage medium, can be used for storing software program, journey can be performed in computer Sequence and module, as the corresponding program instruction/module of the synchronous method of the parallel executive plan in the embodiment of the present invention (for example, Data transmission times logging modle 310, detection message transmission module 320 and control mould in the synchronizing device of parallel executive plan Block 330, alternatively, detection message reception module 410, accumulation data volume determining module in the synchronizing device of parallel executive plan 420 and response message sending module 430).Processor 510 by operation be stored in memory 520 software program, instruction with And module realizes the same of above-mentioned parallel executive plan thereby executing the various function application and data processing of server One step process.
Memory 520 can mainly include storing program area and storage data area, wherein storing program area can store operation system Application program needed for system, at least one function;Storage data area, which can be stored, uses created data etc. according to server. It can also include nonvolatile memory in addition, memory 520 may include high-speed random access memory, for example, at least one A disk memory, flush memory device or other non-volatile solid state memory parts.In some instances, memory 520 can be into One step includes the memory remotely located relative to processor 510, these remote memories can pass through network connection to service Device.The example of above-mentioned network includes but is not limited to internet, intranet, local area network, mobile radio communication and combinations thereof.
Input unit 530 can be used for receiving the number or character information of input, and generate the user setting with server And the related key signals input of function control.Output device 540 may include that display screen etc. shows equipment.
Embodiment six
The embodiment of the present invention six also provides a kind of storage medium comprising computer executable instructions, and the computer can be held When being executed by computer processor for executing a kind of synchronous method of parallel executive plan, this method includes for row instruction:
When the parallel work-flow tally used in ancient times as credentials or a warrant point of parallel executive plan is transmitting terminal and sends data to receiving end, record sends number According to number;
When the number for sending data reaches setting number, detection message is sent to the receiving end;
The receiving end is waited to return to the response message of the detection message, and after receiving the response message, weight It newly executes above-mentioned transmission data and records the number for sending data and send inspection when the number for sending data reaches setting number Survey the operation of message, wherein the response message is receiving end transmission when the data volume of accumulation is no more than setting quantity 's.
Alternatively, the computer executable instructions by computer processor when being executed by executing based on the parallel execution of one kind The synchronous method drawn, this method include:
When the parallel work-flow tally used in ancient times as credentials or a warrant point of parallel executive plan is receiving end, the detection message that transmitting terminal is sent is received, The detection message is that the transmitting terminal is sent when the number for sending data reaches setting number;
Determine the data volume of the receiving end accumulation;
If the data volume of the receiving end accumulation is more than setting quantity, data are handled in the receiving end and are accumulated Data volume be no more than the setting quantity when, transmission response message to the transmitting terminal.
Certainly, a kind of storage medium comprising computer executable instructions, computer provided by the embodiment of the present invention The method operation that executable instruction is not limited to the described above, can also be performed parallel execution provided by any embodiment of the invention Relevant operation in the synchronous method of plan.
By the description above with respect to embodiment, it is apparent to those skilled in the art that, the present invention It can be realized by software and required common hardware, naturally it is also possible to which by hardware realization, but in many cases, the former is more Good embodiment.Based on this understanding, technical solution of the present invention substantially in other words contributes to the prior art Part can be embodied in the form of software products, which can store in computer readable storage medium In, floppy disk, read-only memory (Read-Only Memory, ROM), random access memory (Random such as computer Access Memory, RAM), flash memory (FLASH), hard disk or CD etc., including some instructions are with so that a computer is set Standby (can be personal computer, server or the network equipment etc.) executes method described in each embodiment of the present invention.
It is worth noting that, in the embodiment of the synchronizing device of above-mentioned parallel executive plan, included each unit and Module is only divided according to the functional logic, but is not limited to the above division, as long as corresponding functions can be realized ?;In addition, the specific name of each functional unit is also only for convenience of distinguishing each other, the protection being not intended to restrict the invention Range.
Note that the above is only a better embodiment of the present invention and the applied technical principle.It will be appreciated by those skilled in the art that The invention is not limited to the specific embodiments described herein, be able to carry out for a person skilled in the art it is various it is apparent variation, It readjusts and substitutes without departing from protection scope of the present invention.Therefore, although being carried out by above embodiments to the present invention It is described in further detail, but the present invention is not limited to the above embodiments only, without departing from the inventive concept, also It may include more other equivalent embodiments, and the scope of the invention is determined by the scope of the appended claims.

Claims (10)

1. a kind of synchronous method of parallel executive plan, which is characterized in that the method includes:
When the parallel work-flow tally used in ancient times as credentials or a warrant point of parallel executive plan is transmitting terminal and sends data to receiving end, record sends data Number;
When the number for sending data reaches setting number, detection message is sent to the receiving end;
It waits the receiving end to return to the response message of the detection message, and after receiving the response message, holds again The above-mentioned transmission data of row simultaneously record the number for sending data and send detection when the number for sending data reaches setting number and disappear Breath and the operation for receiving response message, until data are sent, wherein the response message is the receiving end in accumulation It is sent when data volume is no more than setting quantity.
2. the method according to claim 1, wherein the parallel work-flow tally used in ancient times as credentials or a warrant point in parallel executive plan is to send When holding and sending data to receiving end, record sends the number of data, including:
When the parallel work-flow tally used in ancient times as credentials or a warrant point of parallel executive plan is transmitting terminal, variable is set, and the initial value of the variable is assigned Value is 0, and the variable is for recording the number that the transmitting terminal sends data to the receiving end;
When the transmitting terminal sends a data to the receiving end, the value of the variable is increased by one;
When sending detection message to the receiving end, further include:
The value of the variable is reset.
3. a kind of synchronous method of parallel executive plan, which is characterized in that the method includes:
When the parallel work-flow tally used in ancient times as credentials or a warrant point of parallel executive plan is receiving end, the detection message that transmitting terminal is sent is received, it is described Detection message is that the transmitting terminal is sent when the number for sending data reaches setting number;
Determine the data volume of the receiving end accumulation;
If the data volume of the receiving end accumulation is more than setting quantity, in the number that the receiving end handles data and accumulates When being no more than the setting quantity according to amount, response message is sent to the transmitting terminal.
4. according to the method described in claim 3, it is characterized in that, further including:
When the data volume of accumulation is no more than setting quantity in the receiving end, response message is directly transmitted to the transmitting terminal.
5. a kind of synchronizing device of parallel executive plan, which is characterized in that described device includes:
Data transmission times logging modle is transmitting terminal for the parallel work-flow tally used in ancient times as credentials or a warrant point in parallel executive plan and sends data When to receiving end, record sends the number of data;
Message transmission module is detected, when for reaching setting number in the number for sending data, detection message is sent and being connect to described Receiving end;
Control module for waiting the receiving end to return to the response message of the detection message, and is receiving the response After message, re-executes above-mentioned transmission data and record the number for sending data and reach setting number in the number for sending data When send detection message and receive the operation of response message, until data are sent, wherein the response message is described connects What receiving end was sent when the data volume of accumulation is no more than setting quantity.
6. device according to claim 5, which is characterized in that the data transmission times logging modle includes:
When variable setting unit for the parallel work-flow tally used in ancient times as credentials or a warrant point in parallel executive plan is transmitting terminal, variable is set, and by institute The initial value for stating variable is assigned a value of 0, and the variable is for recording the number that the transmitting terminal sends data to the receiving end;
Variable adding unit, for when the transmitting terminal sends a data to the receiving end, the value of the variable to be increased Add one;
Described device further includes:
Variable dump block, for when sending detection message to the receiving end, the value of the variable to be reset.
7. a kind of synchronizing device of parallel executive plan, which is characterized in that described device includes:
Detect message reception module, for the parallel work-flow tally used in ancient times as credentials or a warrant point in parallel executive plan be receiving end when, receive transmitting terminal The detection message sent, the detection message are transmitting terminal transmissions when the number for sending data reaches setting number 's;
Data volume determining module is accumulated, for determining the data volume of the receiving end accumulation;
Response message sending module, if the data volume for receiving end accumulation is more than setting quantity, in the reception When the data volume for handling data and accumulation being held to be no more than the setting quantity, response message is sent to the transmitting terminal.
8. device according to claim 7, which is characterized in that further include:
Response message directly transmits module, when the data volume for accumulating in the receiving end is no more than setting quantity, directly sends out Send response message to the transmitting terminal.
9. a kind of database server, which is characterized in that the server includes:
One or more processors;
Storage device, for storing one or more programs,
When one or more of programs are executed by one or more of processors, so that one or more of processors are real The now synchronous method of the parallel executive plan as described in any in claim 1-2 or 3-4.
10. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor The synchronous method of the parallel executive plan as described in any in claim 1-2 or 3-4 is realized when execution.
CN201810488211.2A 2018-05-21 2018-05-21 Synchronization method, device, server and storage medium for parallel execution plan Active CN108829735B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810488211.2A CN108829735B (en) 2018-05-21 2018-05-21 Synchronization method, device, server and storage medium for parallel execution plan

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810488211.2A CN108829735B (en) 2018-05-21 2018-05-21 Synchronization method, device, server and storage medium for parallel execution plan

Publications (2)

Publication Number Publication Date
CN108829735A true CN108829735A (en) 2018-11-16
CN108829735B CN108829735B (en) 2021-06-29

Family

ID=64148242

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810488211.2A Active CN108829735B (en) 2018-05-21 2018-05-21 Synchronization method, device, server and storage medium for parallel execution plan

Country Status (1)

Country Link
CN (1) CN108829735B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110569257A (en) * 2019-09-16 2019-12-13 上海达梦数据库有限公司 data processing method, corresponding device, equipment and storage medium
CN111753028A (en) * 2020-07-02 2020-10-09 上海达梦数据库有限公司 Data transmission method, device, equipment and storage medium

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1941954A (en) * 2005-09-29 2007-04-04 中兴通讯股份有限公司 Method for controlling HSDPA flow based on feedback mode
CN102081678A (en) * 2011-03-14 2011-06-01 华中科技大学 Method for searching optimal execution plan in database query
CN102323946A (en) * 2011-09-05 2012-01-18 天津神舟通用数据技术有限公司 Implementation method for operator reuse in parallel database
CN102480500A (en) * 2010-11-26 2012-05-30 黑龙江亿林网络技术服务有限公司 Distributed harmful information management system and method
CN102571277A (en) * 2011-12-29 2012-07-11 中兴通讯股份有限公司 Method and device for sending serial number detection message
CN102780593A (en) * 2012-07-25 2012-11-14 中兴通讯股份有限公司 BFD (Bidirectional Forwarding Detection) protocol-based link detection method and apparatus and network processor
US20150066972A1 (en) * 2013-09-05 2015-03-05 Futurewei Technologies, Inc. Mechanism for Optimizing Parallel Execution of Queries on Symmetric Resources
CN104639298A (en) * 2013-11-08 2015-05-20 腾讯科技(深圳)有限公司 Data transmission method, device and system
CN106302201A (en) * 2015-05-14 2017-01-04 华为技术有限公司 Flow control methods, equipment and system
CN107656937A (en) * 2016-07-26 2018-02-02 北京京东尚科信息技术有限公司 Method and apparatus for realizing read-write data consistency
CN107688660A (en) * 2017-09-08 2018-02-13 上海达梦数据库有限公司 The execution method and device of parallel executive plan
CN108052635A (en) * 2017-12-20 2018-05-18 江苏瑞中数据股份有限公司 A kind of heterogeneous data source unifies conjunctive query method

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1941954A (en) * 2005-09-29 2007-04-04 中兴通讯股份有限公司 Method for controlling HSDPA flow based on feedback mode
CN102480500A (en) * 2010-11-26 2012-05-30 黑龙江亿林网络技术服务有限公司 Distributed harmful information management system and method
CN102081678A (en) * 2011-03-14 2011-06-01 华中科技大学 Method for searching optimal execution plan in database query
CN102323946A (en) * 2011-09-05 2012-01-18 天津神舟通用数据技术有限公司 Implementation method for operator reuse in parallel database
CN102571277A (en) * 2011-12-29 2012-07-11 中兴通讯股份有限公司 Method and device for sending serial number detection message
CN102780593A (en) * 2012-07-25 2012-11-14 中兴通讯股份有限公司 BFD (Bidirectional Forwarding Detection) protocol-based link detection method and apparatus and network processor
US20150066972A1 (en) * 2013-09-05 2015-03-05 Futurewei Technologies, Inc. Mechanism for Optimizing Parallel Execution of Queries on Symmetric Resources
CN104639298A (en) * 2013-11-08 2015-05-20 腾讯科技(深圳)有限公司 Data transmission method, device and system
CN106302201A (en) * 2015-05-14 2017-01-04 华为技术有限公司 Flow control methods, equipment and system
CN107656937A (en) * 2016-07-26 2018-02-02 北京京东尚科信息技术有限公司 Method and apparatus for realizing read-write data consistency
CN107688660A (en) * 2017-09-08 2018-02-13 上海达梦数据库有限公司 The execution method and device of parallel executive plan
CN108052635A (en) * 2017-12-20 2018-05-18 江苏瑞中数据股份有限公司 A kind of heterogeneous data source unifies conjunctive query method

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
M LACLAVIK 等: "Email Analysis and Information Extraction for Enterprise Benefit", 《COMPUTING AND INFORMATICS》 *
郑黎辉: "数据库并行查询优化的设计与实现", 《中国优秀硕士学位论文全文数据库 信息科技辑》 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110569257A (en) * 2019-09-16 2019-12-13 上海达梦数据库有限公司 data processing method, corresponding device, equipment and storage medium
CN110569257B (en) * 2019-09-16 2022-04-01 上海达梦数据库有限公司 Data processing method, corresponding device, equipment and storage medium
CN111753028A (en) * 2020-07-02 2020-10-09 上海达梦数据库有限公司 Data transmission method, device, equipment and storage medium
CN111753028B (en) * 2020-07-02 2023-08-25 上海达梦数据库有限公司 Data transmission method, device, equipment and storage medium

Also Published As

Publication number Publication date
CN108829735B (en) 2021-06-29

Similar Documents

Publication Publication Date Title
CN106528432B (en) The construction method and device of test scene data bury a test method
US10956244B1 (en) Systems and methods for automated application programming interface evaluation and migration
CN110297766A (en) Method for testing software and software testing system based on distributed test node cluster
CN102035696B (en) Website access performance monitoring method, device and system
CN103051717A (en) Method, device and equipment for processing http request
CN105577772A (en) Material receiving method, material uploading method and device
CN109741060A (en) Information inquiry system, method, device, electronic equipment and storage medium
CN104092719A (en) File transmission method, device and distributed cluster file system
US20170168881A1 (en) Process chain discovery across communication channels
CN108173976A (en) Domain name analytic method and device
CN105579976B (en) Webpage automated testing method and device
CN103607476A (en) System and method for distributed multi-stage persistence of huge number of messages
CN109739711A (en) A kind of interface test method, device, equipment and storage medium
CN108829735A (en) Synchronous method, device, server and the storage medium of parallel executive plan
CN110677684A (en) Video processing method, video access method, distributed storage method and distributed video access system
KR101663412B1 (en) Method for Defining Quality of Things based on DDS in Internet of Things
US9590934B2 (en) Method and system of creating a graylist for message transmission
CN110430070A (en) A kind of service state analysis method, device, server, data analysis equipment and medium
TWI843063B (en) Computer-implemented method and computer-implemented system
CN107302584A (en) A kind of efficient collecting method
CN108664550A (en) It is a kind of that funnel analysis method and device are carried out to user behavior data
CN109471746A (en) A kind of collection method and system of cluster log
CN106933718B (en) Method for monitoring performance and device
Nilsson et al. Performance evaluation of message-oriented middleware
US10148518B2 (en) Method and apparatus for managing computer system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant