CN116708434B - Data exchange system capable of simultaneously meeting multiple types of relational databases - Google Patents
Data exchange system capable of simultaneously meeting multiple types of relational databases Download PDFInfo
- Publication number
- CN116708434B CN116708434B CN202310717946.9A CN202310717946A CN116708434B CN 116708434 B CN116708434 B CN 116708434B CN 202310717946 A CN202310717946 A CN 202310717946A CN 116708434 B CN116708434 B CN 116708434B
- Authority
- CN
- China
- Prior art keywords
- data exchange
- port
- exchange platform
- target
- target data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000004458 analytical method Methods 0.000 claims abstract description 56
- 238000004364 calculation method Methods 0.000 claims abstract description 29
- 238000000034 method Methods 0.000 claims description 24
- 238000007726 management method Methods 0.000 claims description 11
- 230000005540 biological transmission Effects 0.000 description 10
- 238000013523 data management Methods 0.000 description 3
- 230000007547 defect Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000007792 addition Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The invention relates to the technical field of data exchange analysis, and particularly discloses a data exchange system capable of simultaneously meeting multiple types of relational databases, which comprises a user information acquisition module, a platform information acquisition module, a port number calculation module, a user information analysis module, a platform port analysis module, a user port distribution module and a cloud database.
Description
Technical Field
The invention relates to the technical field of data exchange analysis, in particular to a data exchange system capable of simultaneously meeting multiple types of relational databases.
Background
Data is valuable in circulation, applications, which involve "data sharing" and "data exchange". In the process of implementing data exchange, different data contents, data formats and data quality are quite different, and the problem of transmission blockage and the like frequently occurs in data transmission, so that the bearing capacity of the ports of the data exchange platform is insufficient, and the distribution management of the ports of the data exchange platform is highlighted.
The prior data exchange platform mainly aims at the troublesome problems of incapability of converting data formats or information loss after converting the data formats, has certain limitations, and obviously, the prior port allocation management of the data exchange platform has the following defects:
1. the method has the advantages that the port allocation is not adopted at present, so that the data uploading time of a user is shortened, the data flow and sharing are blocked to a certain extent, the data exchange efficiency cannot be effectively improved, the information transmission time is increased, the resource utilization rate cannot be improved, the waiting time of the user is increased to a certain extent, the favor of the user on a data exchange platform cannot be improved, and meanwhile, the management of the data complexity is also increased;
2. currently, the data transmission ports are randomly allocated, so that the workload of a background cannot be reduced, the phenomenon that the waiting time of the ports of a data exchange platform is too long is caused, the running efficiency of the data exchange platform cannot be improved, the response speed and the processing capacity of the data exchange platform cannot be effectively optimized, and further the unstable network environment can possibly cause interruption or delay of data transmission, so that the data management efficiency cannot be improved.
Disclosure of Invention
The invention provides a data exchange system capable of simultaneously meeting multiple types of relational databases aiming at the defects of the prior art.
The invention solves the technical problems by the following technical means: a data exchange system capable of simultaneously meeting multiple types of relational databases comprises a user information acquisition module, a platform information acquisition module, a port number calculation module, a user information analysis module, a platform port analysis module, a user port distribution module and a cloud database;
the user information acquisition module is used for acquiring login time and uploading information corresponding to a target user login target data exchange platform, and simultaneously acquiring the number of user login people in the target user login period, and the uploading information and login information corresponding to each user;
the platform information acquisition module is used for calling out the number of the ports of the target data exchange platform and the parameter information corresponding to each port from the cloud database;
the port number calculation module is used for analyzing and obtaining the number of calling data exchange ports corresponding to the target data exchange platform according to the number of user login people in the target data exchange platform in the target user login period;
the user information analysis module is used for analyzing and obtaining file uploading completion time length corresponding to each port in the target data exchange platform in the target user login period according to the user login number in the target data exchange platform in the target user login period and uploading information corresponding to each user;
the platform port analysis module is used for combining the parameter information corresponding to each port in the target data exchange platform to analyze and obtain the occupation information corresponding to each port in the target data exchange platform in the login period of the target user;
and the user port allocation module is used for carrying out information uploading port allocation processing on the target user according to the occupation information corresponding to each port in the target data exchange platform in the login period of the target user.
Preferably, the uploading information includes file type and file capacity, and the login information includes login time and exit time.
Preferably, the parameter information corresponding to each port includes a port receiving file type and a port management rate.
As a preferred scheme, the analysis obtains the number of calling data exchange ports corresponding to the target data exchange platform, and the specific analysis process is as follows:
b1, extracting historical login data corresponding to a target data exchange platform from a cloud database, wherein the historical login data comprises the number of people logged in each time of history and the number of call ports corresponding to the number of people logged in each time of history, and further utilizing a calculation formulaCalculating call port number corresponding to unit number of historical login +.>Wherein i is represented as the number corresponding to each history of the number of logins, < >>，/>The number of people represented as the i-th history log-in, < + >>The number of ports corresponding to the number of people registered for the ith historical time is expressed, and j is expressed as the total number of historical registration times;
and B2, further calculating the number of calling ports corresponding to the user login number and the unit number logged in history in the target data exchange platform in the target user login period by utilizing multiplication to obtain the number of calling data exchange ports corresponding to the target data exchange platform.
As a preferred scheme, the analysis obtains the file uploading completion time length corresponding to each port in the target data exchange platform in the target user login period, and the specific analysis process is as follows:
a1, distributing all users in all ports of a target data exchange platform according to all uploading data IP ports corresponding to all users stored in a cloud database, acquiring uploading information corresponding to all users in all ports of the target data exchange platform in a target user login period, and extracting file types and file capacities corresponding to all users in all ports of the target data exchange platform in the target user login period;
a2, comparing the file types corresponding to all users in the target data exchange platform in the target user login period with the file types corresponding to the file uploading time consumption levels stored in the cloud database, so as to obtain the file uploading time consumption levels corresponding to all users in the target data exchange platform in the target user login period;
and A3, analyzing and obtaining the file uploading completion time length corresponding to each port in the target data exchange platform in the target user login period through an analysis formula according to the number of the calling data exchange ports corresponding to the target data exchange platform.
Preferably, the occupation information corresponding to each port in the target data exchange platform includes throughput and concurrency.
As a preferred scheme, the analysis obtains the occupation information corresponding to each port in the target data exchange platform in the login period of the target user, and the specific analysis process is as follows:
c1, acquiring the number of calling data exchange ports corresponding to the target data exchange platform, and further utilizing a calculation formulaCalculating and obtaining the average response time corresponding to each port in the target data exchange platform in the target user login periodWherein m is represented by the number corresponding to each port, ">，/>Expressed as the number of call data exchange ports corresponding to the target data exchange platform,/for the target data exchange platform>The method comprises the steps of representing the file uploading completion time length corresponding to an mth port in a target data exchange platform in a target user login period;
c2, according to the average response time corresponding to each port in the target data exchange platform in the target user login period and the analysis formulaCalculating and obtaining the throughput corresponding to each port in the target data exchange platform in the target user login period>。
As a preferred scheme, the analysis obtains the occupation information corresponding to each port in the target data exchange platform in the login period of the target user, and the specific analysis process further comprises the following steps:
d1, extracting the login time and the exit time corresponding to each user in each port of the target data exchange platform in the target user login period according to the login information corresponding to each user in the target data exchange platform in the target user login period;
d2, and further using a calculation formulaCalculating and obtaining the concurrency quantity corresponding to each port in the target data exchange platform in the target user login period>Wherein->Expressed as a set concurrency reference factor, RS expressed as the number of user logins in a target data exchange platform in a target user login period, y expressed as the number corresponding to each user, and ∈>，/>Respectively representing login time and exit time corresponding to the y-th user in the m-th port of the target data exchange platform in the login period of the target user, wherein h represents the total number of users and is ∈>And representing the corresponding open time length in the set time of the predefined target data exchange platform.
As a preferred solution, the process of distributing the uploading information port to the target user includes the following steps:
e1, calculating residual data bearing capacity corresponding to each port in the target data exchange platform in the target user login period according to throughput and concurrency corresponding to each port in the target data exchange platform in the target user login period through a calculation formula;
e2, extracting the file capacity corresponding to the target user login target data exchange platform according to the uploading information corresponding to the target user login target data exchange platform, and utilizing a calculation formulaCalculating to obtain the port capacity corresponding to the login target data exchange platform of the target user>Wherein, RL represents the file capacity corresponding to the login target data exchange platform of the target user, and +.>Expressed as a multiple of the port capacity corresponding to the unit file capacity;
e3, comparing the port capacity corresponding to the target user login target data exchange platform with the residual data bearing capacity corresponding to each port in the target data exchange platform in the target user login period, if the residual data bearing capacity corresponding to a certain port in the target data exchange platform in the target user login period is greater than or equal to the port capacity corresponding to the target user login target data exchange platform, marking the port in the target data exchange platform in the target user login period as a transmissible port, otherwise marking the port as an undeliverable port;
and E4, acquiring the residual data bearing capacity corresponding to each transmissible port, arranging the residual data bearing capacity corresponding to each transmissible port in sequence from large to small, and further distributing the transmissible port with the minimum residual data bearing capacity from the residual data bearing capacity as the information uploading port corresponding to the target user.
As a preferred scheme, the system further comprises a cloud database, which is used for storing the number of the receiving ports of the target data exchange platform, parameter information corresponding to each port, historical login data corresponding to the target data exchange platform and file types corresponding to the uploading time-consuming grades of each file, and storing file types corresponding to the uploading time-consuming grades of each file and uploading data IP ports corresponding to each user.
The invention has the beneficial effects that:
(1) According to the data exchange system capable of simultaneously meeting the multiple types of relational databases, the information of each user logging in the target data exchange platform is collected, and then the occupation information corresponding to each port in the target data exchange platform in the target user logging period is analyzed and obtained according to the number of calling data exchange ports corresponding to the target data exchange platform and the file uploading completion time corresponding to each port in the target data exchange platform in the target user logging period, and the uploading information port allocation processing is carried out on the target user, so that the problem that the port allocation of the data exchange platform is limited to a certain extent in the prior art is effectively solved, the data flow and sharing are enhanced to a certain extent, the data exchange efficiency is effectively improved, the information transfer time is reduced, the resource utilization rate is improved, the waiting time of the user is reduced to a certain extent, the favor of the user to the data exchange platform is improved, and meanwhile, the management of the data complexity is avoided.
(2) According to the embodiment of the invention, the data transmission ports are finely distributed to the target users, so that the workload of the background is reduced, the phenomenon of overlong waiting time of the ports of the data exchange platform is avoided, the operation efficiency of the data exchange platform is improved, the response speed and the processing capacity of the data exchange platform can be effectively optimized, the interruption or delay of data transmission caused by unstable network environment is avoided, and the data management efficiency is improved.
Drawings
Fig. 1 is a schematic diagram of a system module connection structure according to the present invention.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the embodiments of the present invention more apparent, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are some embodiments of the present invention, but not all embodiments of the present invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Referring to fig. 1, a data exchange system capable of simultaneously satisfying multiple types of relational databases includes a user information acquisition module, a platform information acquisition module, a port number calculation module, a user information analysis module, a platform port analysis module, a user port allocation module and a cloud database.
The port number calculation module is connected with the user information acquisition module and the platform information acquisition module, the user information analysis module is connected with the user information acquisition module and the port number calculation module, the platform port analysis module is connected with the user information analysis module and the user port distribution module, and the cloud database is connected with the platform information acquisition module, the user information analysis module and the platform port analysis module.
The user information acquisition module is used for acquiring login time and uploading information corresponding to the target user logging in the target data exchange platform, and simultaneously acquiring the number of logged-in users in the target data exchange platform and the uploading information and login information corresponding to each user in a target user login period.
As a further aspect of the present invention, the upload information includes a file type and a file capacity, and the login information includes a login time and an exit time.
The platform information acquisition module is used for calling out the number of the ports of the target data exchange platform and the parameter information corresponding to each port from the cloud database.
As a further scheme of the present invention, the parameter information corresponding to each port includes a port receiving file type and a port management rate.
The port number calculation module is used for analyzing and obtaining the number of the call data exchange ports corresponding to the target data exchange platform according to the number of user login people in the target data exchange platform in the target user login period.
As a further scheme of the invention, the analysis obtains the number of calling data exchange ports corresponding to the target data exchange platform, and the specific analysis process is as follows:
b1, extracting historical login data corresponding to a target data exchange platform from a cloud database, wherein the historical login data comprises the number of people logged in each time of history and the number of call ports corresponding to the number of people logged in each time of history, and further utilizing a calculation formulaCalculating call port number corresponding to unit number of historical login +.>Wherein i is represented as the number corresponding to each history of the number of logins, < >>，/>The number of people represented as the i-th history log-in, < + >>The number of ports corresponding to the number of people registered for the i-th time is expressed, and j is expressed as the total number of times of history registration.
And B2, further calculating the number of calling ports corresponding to the user login number and the unit number logged in history in the target data exchange platform in the target user login period by utilizing multiplication to obtain the number of calling data exchange ports corresponding to the target data exchange platform.
In a specific embodiment, the number of call data exchange ports corresponding to the target data exchange platform is calculated by multiplication, and a specific calculation formula is as follows:
，/>the number of the call data exchange ports corresponding to the target data exchange platform is expressed, and the RS is expressed as the number of user login people in the target data exchange platform in the login period of the target user.
The user information analysis module is used for analyzing and obtaining the file uploading completion time length corresponding to each port in the target data exchange platform in the target user login period according to the user login number in the target data exchange platform in the target user login period and uploading information corresponding to each user.
As a further scheme of the invention, the analysis obtains the file uploading completion time length corresponding to each port in the target data exchange platform in the target user login period, and the specific analysis process is as follows:
a1, distributing each user in each port of the target data exchange platform according to the uploading data IP ports corresponding to each user stored in the cloud database, acquiring uploading information corresponding to each user in each port of the target data exchange platform in a target user login period, and extracting the file types and the file capacities corresponding to each user in each port of the target data exchange platform in the target user login period.
And A2, comparing the file types corresponding to the users in the target data exchange platform in the target user login period with the file types corresponding to the file uploading time consumption levels stored in the cloud database, thereby obtaining the file uploading time consumption levels corresponding to the users in the target data exchange platform in the target user login period.
And A3, analyzing and obtaining the file uploading completion time length corresponding to each port in the target data exchange platform in the target user login period through an analysis formula according to the number of the calling data exchange ports corresponding to the target data exchange platform.
In a specific embodiment, the file uploading completion time corresponding to each port in the target data exchange platform in the target user login period is obtained through analysis by an analysis formula, and the specific analysis process is as follows:
f1, obtaining the file uploading time consumption level corresponding to each user in each port of the target data exchange platform in the target user login period according to the file uploading time consumption level corresponding to each user in the target data exchange platform in the target user login period, and marking the file uploading time consumption level as；
F2, extracting the port management rate corresponding to each port according to the parameter information corresponding to each port, and recording the port management rate asAccording to the analytical formula->Calculating and obtaining the file uploading completion time length corresponding to each port in the target data exchange platform in the target user login period>Wherein a1 and a2 are respectively expressed as the set influence factors corresponding to the file uploading time-consuming level and the file capacity, ">Reference file capacity corresponding to the set unit file uploading time length, < >>And e is expressed as a natural constant, wherein the file capacity is expressed as the file capacity corresponding to the y user in the mth port of the target data exchange platform in the login period of the target user.
In a specific embodiment, the higher the file uploading time consumption level corresponding to each user in each port of the target data exchange platform in the target user login period, the longer the file uploading time is indicated.
And the platform port analysis module is used for combining the parameter information corresponding to each port in the target data exchange platform to analyze and obtain the occupation information corresponding to each port in the target data exchange platform in the login period of the target user.
As a further scheme of the present invention, the occupation information corresponding to each port in the target data exchange platform includes throughput and concurrency.
As a further scheme of the invention, the analysis obtains the occupation information corresponding to each port in the target data exchange platform in the login period of the target user, and the specific analysis process is as follows:
c1, acquiring the number of calling data exchange ports corresponding to the target data exchange platform, and further utilizing a calculation formulaCalculating and obtaining the average response time of each port in the target data exchange platform in the target user login period>Wherein m is represented by the number corresponding to each port, ">，/>Expressed as the number of call data exchange ports corresponding to the target data exchange platform,/for the target data exchange platform>And the file uploading completion time length corresponding to the mth port in the target data exchange platform in the target user login period is represented.
C2, according to the average response time corresponding to each port in the target data exchange platform in the target user login period and the analysis formulaCalculating and obtaining the throughput corresponding to each port in the target data exchange platform in the target user login period>。
As a further scheme of the present invention, the analysis obtains the occupation information corresponding to each port in the target data exchange platform in the login period of the target user, and the specific analysis process further includes the following steps:
and D1, extracting the login time and the exit time corresponding to each user in each port of the target data exchange platform in the target user login period according to the login information corresponding to each user in the target data exchange platform in the target user login period.
D2, and further using a calculation formulaCalculating and obtaining the concurrency quantity corresponding to each port in the target data exchange platform in the target user login period>Wherein->Expressed as a set concurrency reference factor, RS expressed as the number of user logins in a target data exchange platform in a target user login period, y expressed as the number corresponding to each user, and ∈>，/>Respectively representing login time and exit time corresponding to the y-th user in the m-th port of the target data exchange platform in the login period of the target user, wherein h represents the total number of users and is ∈>And representing the corresponding open time length in the set time of the predefined target data exchange platform.
In a specific embodiment, the opening duration corresponding to the set time of the target data exchange platform is specifically expressed as the opening duration corresponding to one day of the target data exchange platform.
And the user port allocation module is used for carrying out information uploading port allocation processing on the target user according to the occupation information corresponding to each port in the target data exchange platform in the login period of the target user.
As a further scheme of the present invention, the allocation process of the uploading information port to the target user is as follows:
and E1, calculating residual data bearing capacity corresponding to each port in the target data exchange platform in the target user login period according to throughput and concurrency corresponding to each port in the target data exchange platform in the target user login period through a calculation formula.
In a specific embodiment, the remaining data carrying capacity corresponding to each port in the target data exchange platform in the target user login period is calculated by a calculation formula, and the specific calculation process is as follows:
calculating residual data bearing capacity corresponding to each port in the target data exchange platform in the target user login period>Wherein b1 and b2 are respectively expressed as the set throughput and the corresponding influence factors of the concurrency, and +.>The total capacity corresponding to the mth port in the set target data exchange platform is represented, and p1 and p2 are respectively represented as a set full-load throughput value and a set full-load concurrency value.
E2, extracting the file capacity corresponding to the target user login target data exchange platform according to the uploading information corresponding to the target user login target data exchange platform, and utilizing a calculation formulaCalculating to obtain the port capacity corresponding to the login target data exchange platform of the target user>Wherein, RL represents the file capacity corresponding to the login target data exchange platform of the target user, and +.>Expressed as a multiple of the port capacity corresponding to the unit file capacity.
And E3, comparing the port capacity corresponding to the target user login target data exchange platform with the residual data bearing capacity corresponding to each port in the target data exchange platform in the target user login period, and if the residual data bearing capacity corresponding to a certain port in the target data exchange platform in the target user login period is greater than or equal to the port capacity corresponding to the target user login target data exchange platform, marking the port in the target data exchange platform in the target user login period as a transmissible port, otherwise marking the port as an undeliverable port.
And E4, acquiring the residual data bearing capacity corresponding to each transmissible port, arranging the residual data bearing capacity corresponding to each transmissible port in sequence from large to small, and further distributing the transmissible port with the minimum residual data bearing capacity from the residual data bearing capacity as the information uploading port corresponding to the target user.
The embodiment of the invention enhances the flow and sharing of data to a certain extent, effectively improves the efficiency of data exchange, reduces the time of information transmission, thereby improving the resource utilization rate, reducing the waiting time of users to a certain extent, improving the favor of users to a data exchange platform, and simultaneously avoiding the management of the complexity of data.
As a further scheme of the present invention, the system further includes a cloud database, configured to store the number of receiving ports of the target data exchange platform, parameter information corresponding to each port, historical login data corresponding to the target data exchange platform, and file types corresponding to each file uploading time-consuming level, and further configured to store file types corresponding to each file uploading time-consuming level and uploading data IP ports corresponding to each user.
According to the embodiment of the invention, the data transmission ports are finely distributed to the target users, so that the workload of the background is reduced, the phenomenon of overlong waiting time of the ports of the data exchange platform is avoided, the operation efficiency of the data exchange platform is improved, the response speed and the processing capacity of the data exchange platform can be effectively optimized, the interruption or delay of data transmission caused by unstable network environment is avoided, and the data management efficiency is improved.
The foregoing is merely illustrative of the structures of this invention and various modifications, additions and substitutions for those skilled in the art can be made to the described embodiments without departing from the scope of the invention or from the scope of the invention as defined in the accompanying claims.
In the description of the present specification, the descriptions of the terms "one embodiment," "example," "specific example," and the like, mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiments or examples. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
The preferred embodiments of the invention disclosed above are intended only to assist in the explanation of the invention. The preferred embodiments are not intended to be exhaustive or to limit the invention to the precise form disclosed. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the invention and the practical application, to thereby enable others skilled in the art to best understand and utilize the invention. The invention is limited only by the claims and the full scope and equivalents thereof.
Claims (6)
1. The data exchange system simultaneously meeting the requirement of the multi-type relational database is characterized by comprising a user information acquisition module, a platform information acquisition module, a port number calculation module, a user information analysis module, a platform port analysis module, a user port distribution module and a cloud database;
the user information acquisition module is used for acquiring login time and uploading information corresponding to a target user login target data exchange platform, and simultaneously acquiring the number of user login people in the target user login period, and the uploading information and login information corresponding to each user;
the platform information acquisition module is used for calling out the number of the ports of the target data exchange platform and the parameter information corresponding to each port from the cloud database;
the port number calculation module is used for analyzing and obtaining the number of calling data exchange ports corresponding to the target data exchange platform according to the number of user login people in the target data exchange platform in the target user login period;
the user information analysis module is used for analyzing and obtaining file uploading completion time length corresponding to each port in the target data exchange platform in the target user login period according to the user login number in the target data exchange platform in the target user login period and uploading information corresponding to each user;
the platform port analysis module is used for combining the parameter information corresponding to each port in the target data exchange platform to analyze and obtain the occupation information corresponding to each port in the target data exchange platform in the login period of the target user;
the occupation information corresponding to each port in the target data exchange platform comprises throughput and concurrency;
the analysis obtains the occupation information corresponding to each port in the target data exchange platform in the target user login period, and the specific analysis process is as follows:
c1, acquiring the number of calling data exchange ports corresponding to the target data exchange platform, and further utilizing a calculation formulaCalculating and obtaining the average response time of each port in the target data exchange platform in the target user login period>Wherein m is represented by the number corresponding to each port, ">，/>Expressed as the number of call data exchange ports corresponding to the target data exchange platform,/for the target data exchange platform>The method comprises the steps of representing the file uploading completion time length corresponding to an mth port in a target data exchange platform in a target user login period;
c2, according to the average response time corresponding to each port in the target data exchange platform in the target user login period and the analysis formulaCalculating and obtaining the throughput corresponding to each port in the target data exchange platform in the target user login period>；
The analysis obtains the occupation information corresponding to each port in the target data exchange platform in the target user login period, and the specific analysis process further comprises the following steps:
d1, extracting the login time and the exit time corresponding to each user in each port of the target data exchange platform in the target user login period according to the login information corresponding to each user in the target data exchange platform in the target user login period;
d2, and further using a calculation formulaCalculating and obtaining the concurrency quantity corresponding to each port in the target data exchange platform in the target user login period>Wherein->Expressed as a set concurrency reference factor, RS expressed as the number of user logins in a target data exchange platform in a target user login period, y expressed as the number corresponding to each user, and ∈>，/>Respectively representing login time and exit time corresponding to the y-th user in the m-th port of the target data exchange platform in the login period of the target user, wherein h represents the total number of users and is ∈>The method comprises the steps of representing corresponding open time length in a preset time of a predefined target data exchange platform;
the user port allocation module is used for carrying out information uploading port allocation processing on the target user according to the occupation information corresponding to each port in the target data exchange platform in the login period of the target user;
the allocation process of the uploading information port to the target user is as follows:
e1, calculating residual data bearing capacity corresponding to each port in the target data exchange platform in the target user login period according to throughput and concurrency corresponding to each port in the target data exchange platform in the target user login period through a calculation formula;
the residual data bearing capacity corresponding to each port in the target data exchange platform in the target user login period is calculated through a calculation formula, and the specific calculation process is as follows:
calculating residual data bearing capacity corresponding to each port in the target data exchange platform in the target user login period>Wherein b1 and b2 are respectively expressed as the set throughput and the corresponding influence factors of the concurrency, and +.>Expressed as the total capacity, p1 andp2 is respectively expressed as a set full-load throughput value and a set full-load concurrency value;
e2, extracting the file capacity corresponding to the target user login target data exchange platform according to the uploading information corresponding to the target user login target data exchange platform, and utilizing a calculation formulaCalculating to obtain the port capacity corresponding to the login target data exchange platform of the target user>Wherein, RL represents the file capacity corresponding to the login target data exchange platform of the target user, and +.>Expressed as a multiple of the port capacity corresponding to the unit file capacity;
e3, comparing the port capacity corresponding to the target user login target data exchange platform with the residual data bearing capacity corresponding to each port in the target data exchange platform in the target user login period, if the residual data bearing capacity corresponding to a certain port in the target data exchange platform in the target user login period is greater than or equal to the port capacity corresponding to the target user login target data exchange platform, marking the port in the target data exchange platform in the target user login period as a transmissible port, otherwise marking the port as an undeliverable port;
and E4, acquiring the residual data bearing capacity corresponding to each transmissible port, arranging the residual data bearing capacity corresponding to each transmissible port in sequence from large to small, and further distributing the transmissible port with the minimum residual data bearing capacity from the residual data bearing capacity as the information uploading port corresponding to the target user.
2. A data exchange system for simultaneously satisfying multiple types of relational databases according to claim 1, wherein the upload information comprises file type and file capacity, and the login information comprises login time and exit time.
3. The data exchange system according to claim 1, wherein the parameter information corresponding to each port includes a port receiving file type and a port management rate.
4. The data exchange system for simultaneously satisfying multiple types of relational databases according to claim 1, wherein the analysis results in the number of call data exchange ports corresponding to the target data exchange platform, and the specific analysis process is as follows:
b1, extracting historical login data corresponding to a target data exchange platform from a cloud database, wherein the historical login data comprises the number of people logged in each time of history and the number of call ports corresponding to the number of people logged in each time of history, and further utilizing a calculation formulaCalculating call port number corresponding to unit number of historical login +.>Wherein i is represented as the number corresponding to each history of the number of logins, < >>，/>The number of people represented as the i-th history log-in, < + >>The number of ports corresponding to the number of people registered for the ith historical time is expressed, and j is expressed as the total number of historical registration times;
and B2, further calculating the number of calling ports corresponding to the user login number and the unit number logged in history in the target data exchange platform in the target user login period by utilizing multiplication to obtain the number of calling data exchange ports corresponding to the target data exchange platform.
5. The data exchange system for simultaneously satisfying multiple types of relational databases according to claim 4, wherein the analysis obtains a file upload completion duration corresponding to each port in the target data exchange platform in a target user login period, and the specific analysis process is as follows:
a1, distributing all users in all ports of a target data exchange platform according to all uploading data IP ports corresponding to all users stored in a cloud database, acquiring uploading information corresponding to all users in all ports of the target data exchange platform in a target user login period, and extracting file types and file capacities corresponding to all users in all ports of the target data exchange platform in the target user login period;
a2, comparing the file types corresponding to all users in the target data exchange platform in the target user login period with the file types corresponding to the file uploading time consumption levels stored in the cloud database, so as to obtain the file uploading time consumption levels corresponding to all users in the target data exchange platform in the target user login period;
a3, analyzing according to the number of the called data exchange ports corresponding to the target data exchange platform through an analysis formula to obtain file uploading completion time corresponding to each port in the target data exchange platform in the login period of the target user;
and analyzing the file uploading completion time length corresponding to each port in the target data exchange platform in the login period of the target user through an analysis formula, wherein the specific analysis process is as follows:
f1, obtaining the file uploading time consumption level corresponding to each user in each port of the target data exchange platform in the target user login period according to the file uploading time consumption level corresponding to each user in the target data exchange platform in the target user login period, and marking the file uploading time consumption level as；
F2, extracting the port management corresponding to each port according to the parameter information corresponding to each portRate, which is noted asAccording to the analytical formula->Calculating and obtaining the file uploading completion time length corresponding to each port in the target data exchange platform in the target user login period>Wherein a1 and a2 are respectively expressed as the set influence factors corresponding to the file uploading time-consuming level and the file capacity, ">Reference file capacity corresponding to the set unit file uploading time length, < >>And e is expressed as a natural constant, wherein the file capacity is expressed as the file capacity corresponding to the y user in the mth port of the target data exchange platform in the login period of the target user.
6. The data exchange system for simultaneously satisfying multiple types of relational databases according to claim 1, further comprising a cloud database for storing the number of receiving ports of the target data exchange platform and parameter information corresponding to each port, historical login data corresponding to the target data exchange platform and file types corresponding to each file uploading time-consuming level, and further for storing file types corresponding to each file uploading time-consuming level and uploading data IP ports corresponding to each user.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310717946.9A CN116708434B (en) | 2023-06-16 | 2023-06-16 | Data exchange system capable of simultaneously meeting multiple types of relational databases |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310717946.9A CN116708434B (en) | 2023-06-16 | 2023-06-16 | Data exchange system capable of simultaneously meeting multiple types of relational databases |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116708434A CN116708434A (en) | 2023-09-05 |
| CN116708434B true CN116708434B (en) | 2023-12-22 |
Family
ID=87833665
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310717946.9A Active CN116708434B (en) | 2023-06-16 | 2023-06-16 | Data exchange system capable of simultaneously meeting multiple types of relational databases |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116708434B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105656973A (en) * | 2014-11-25 | 2016-06-08 | 中国科学院声学研究所 | Distributed method and system for scheduling tasks in node group |
| CN108681488A (en) * | 2018-05-19 | 2018-10-19 | 济南浪潮高新科技投资发展有限公司 | A kind of platform of internet of things terminal data report method |
| CN109034445A (en) * | 2018-06-08 | 2018-12-18 | 广东红海湾发电有限公司 | A kind of market-oriented electric power management system and method |
| CN109672740A (en) * | 2018-10-15 | 2019-04-23 | 无锡华云数据技术服务有限公司 | The method of deployment configuration information is obtained in a kind of large-scale cluster environment |
| CN113590575A (en) * | 2020-12-29 | 2021-11-02 | 一汽资本控股有限公司 | Service integration sharing-based method, device, terminal and storage medium |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5332006B2 (en) * | 2009-08-07 | 2013-11-06 | 株式会社日立製作所 | Computer system, program, and method for allocating computing resources for use in simulation |
-
2023
- 2023-06-16 CN CN202310717946.9A patent/CN116708434B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105656973A (en) * | 2014-11-25 | 2016-06-08 | 中国科学院声学研究所 | Distributed method and system for scheduling tasks in node group |
| CN108681488A (en) * | 2018-05-19 | 2018-10-19 | 济南浪潮高新科技投资发展有限公司 | A kind of platform of internet of things terminal data report method |
| CN109034445A (en) * | 2018-06-08 | 2018-12-18 | 广东红海湾发电有限公司 | A kind of market-oriented electric power management system and method |
| CN109672740A (en) * | 2018-10-15 | 2019-04-23 | 无锡华云数据技术服务有限公司 | The method of deployment configuration information is obtained in a kind of large-scale cluster environment |
| CN113590575A (en) * | 2020-12-29 | 2021-11-02 | 一汽资本控股有限公司 | Service integration sharing-based method, device, terminal and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| "基于ELK Stack与Spark的日志实时分析系统的设计与实现";马宏辉;《中国优秀硕士论文全文数据库》;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116708434A (en) | 2023-09-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10354201B1 (en) | Scalable clustering for mixed machine learning data | |
| EP2498440A1 (en) | Configuration method and system of complex network and configuration and management module of server resources | |
| CN113515351B (en) | Resource scheduling implementation method based on energy consumption and QoS (quality of service) cooperative optimization | |
| US10158709B1 (en) | Identifying data store requests for asynchronous processing | |
| CN110413776B (en) | High-performance calculation method for LDA (text-based extension) of text topic model based on CPU-GPU (Central processing Unit-graphics processing Unit) collaborative parallel | |
| CN111901145B (en) | Power Internet of things heterogeneous shared resource allocation system and method | |
| CN115134368B (en) | Load balancing method, device, equipment and storage medium | |
| CN113946436B (en) | Resource pre-scheduling method based on load balancing | |
| CN109948848A (en) | Research-on-research flows down the Cost Optimization dispatching method of deadline constraint in a kind of cloud | |
| CN112835698A (en) | Heterogeneous cluster-based dynamic load balancing method for request classification processing | |
| CN112217745A (en) | Online office processing method and network equipment based on intelligent terminal cloud computing | |
| CN111625583B (en) | Business data processing method and device, computer equipment and storage medium | |
| CN111198918B (en) | Data processing system based on big data platform and link optimization method | |
| CN111813502A (en) | Computing resource management scheduling method for industrial edge nodes | |
| CN116708434B (en) | Data exchange system capable of simultaneously meeting multiple types of relational databases | |
| CN114356531A (en) | Edge calculation task classification scheduling method based on K-means clustering and queuing theory | |
| CN112685162A (en) | High-efficiency scheduling method, system and medium for heterogeneous computing resources of edge server | |
| CN115795368B (en) | Enterprise internal training data processing method and system based on artificial intelligence | |
| CN114531448B (en) | Calculation force determining method and device and calculation force sharing system | |
| CN116089367A (en) | Dynamic barrel dividing method, device, electronic equipment and medium | |
| CN115525230A (en) | Storage resource allocation method and device, storage medium and electronic equipment | |
| CN115062676A (en) | Data processing method, device and computer readable storage medium | |
| CN114896285A (en) | Bank flow calculation service real-time index system based on multi-dimensional intermediate state aggregation | |
| JP6047190B2 (en) | Program and apparatus for determining relational model | |
| CN114489463A (en) | Method and device for dynamically adjusting QOS (quality of service) of storage volume and computing equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |