CN113079067A - Union chain performance bottleneck testing system and method based on multidimensional data integration analysis - Google Patents
Union chain performance bottleneck testing system and method based on multidimensional data integration analysis Download PDFInfo
- Publication number
- CN113079067A CN113079067A CN202110342233.XA CN202110342233A CN113079067A CN 113079067 A CN113079067 A CN 113079067A CN 202110342233 A CN202110342233 A CN 202110342233A CN 113079067 A CN113079067 A CN 113079067A
- Authority
- CN
- China
- Prior art keywords
- data
- module
- request
- alliance chain
- performance
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 26
- 238000004458 analytical method Methods 0.000 title claims abstract description 19
- 230000010354 integration Effects 0.000 title claims abstract description 15
- 238000012360 testing method Methods 0.000 title claims abstract description 14
- 238000013480 data collection Methods 0.000 claims abstract description 28
- 238000012545 processing Methods 0.000 claims abstract description 23
- 230000000977 initiatory effect Effects 0.000 claims abstract description 5
- 230000005540 biological transmission Effects 0.000 claims abstract description 4
- 238000012351 Integrated analysis Methods 0.000 claims abstract description 3
- 238000005457 optimization Methods 0.000 claims description 8
- 238000011056 performance test Methods 0.000 claims description 5
- 238000007405 data analysis Methods 0.000 abstract description 2
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/50—Testing arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
- H04L9/50—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols using hash chains, e.g. blockchains or hash trees
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Environmental & Geological Engineering (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention provides a alliance chain performance bottleneck testing system and method based on multidimensional data integration analysis, which comprises the following steps: bottom layer application: providing functions of transaction initiation, request uplink, transaction processing and data collection; a service module: the bottom layer applications are connected in series to carry out data stream transmission; a data module: and performing integrated analysis on the data of each flow and reflecting the data into the service flow of the bottom application. According to the invention, the performance data of the alliance chain is collected and credible performance data analysis is carried out through the Jmeter, the linux data collection script, the influxdb and the packet capturing tool, so that the problem of discovering the performance bottleneck is solved.
Description
Technical Field
The invention relates to the technical field of multidimensional data processing, in particular to a system and a method for testing alliance chain performance bottleneck based on multidimensional data integration analysis.
Background
The invention aims to improve the final data processing performance by analyzing the data condition of each part of the whole flow of the block chain. Often, there is no inaccuracy in knowing exactly which link of blockchain request processing is the bottleneck affecting the performance of blockchain processing data. Based on the situation, the system deconstructs each link of the block chain request processing, collects detailed data of each link before and after and reacts to the block chain request processing flow through analysis and modification, and therefore the final data processing performance is improved.
Patent document CN101221516B (application number: cn200810056430.x) discloses a method and system for seamless integration of interfaces across operating system platforms, the system includes: the device comprises a configuration module, an association module, a starting module, a window management module and a network protocol implementation module. The method is suitable for interface fusion of a plurality of operating systems. The integration method comprises the steps of firstly determining a main operating system and a secondary operating system, logging in the secondary operating system and starting a background process; the secondary operating system accesses the primary operating system through a network protocol; configuring environmental parameters in a main operating system; when an event is triggered in the primary operating system to be consistent with the configured parameters, sending corresponding information to the secondary operating system; when the background process started in the secondary operating system receives the information, the corresponding application program and the window management program in the secondary operating system are started, and the information is displayed in the interface style of the main operating system in the window of the main operating system.
Disclosure of Invention
Aiming at the defects in the prior art, the invention aims to provide a alliance chain performance bottleneck testing system and method based on multi-dimensional data integration analysis.
The alliance chain performance bottleneck testing system based on multi-dimensional data integration analysis provided by the invention comprises:
bottom layer application: providing functions of transaction initiation, request uplink, transaction processing and data collection;
a service module: the bottom layer applications are connected in series to carry out data stream transmission;
a data module: and performing integrated analysis on the data of each flow and reflecting the data into the service flow of the bottom application.
Preferably, the bottom layer application comprises:
a meter: providing a transaction initiation function;
java: providing an association service between applications;
PLATONE: is responsible for processing the request;
shell + Influxdb: collecting machine performance data;
wireshark: and collecting network packet data.
Preferably, the service module includes: the system comprises a request sending module, a chain loading module, a alliance chain cluster module, an alliance chain bottom layer data collecting module, a pressure applying cluster data collecting module, an alliance chain cluster data collecting module and a network data collecting module;
the request sending module applies a Jmeter;
the uplink module applies Java;
the alliance chain cluster module and the alliance chain bottom layer data collection module apply PLATONE;
the pressure applying cluster data collection module and the alliance chain cluster data collection module apply Shell + Influxdb;
the network data collection module applies Wireshark.
Preferably, the data module performs data processing through the service module, and the processed data includes: request consumption data, machine performance data, underlying data, network packet data, and request processing TPS data.
The alliance chain performance bottleneck testing method based on multi-dimensional data integration analysis provided by the invention comprises the following steps:
step 1: the request sending module sends a request to the uplink module according to the input parameters;
step 2: the uplink module carries out uplink request on the alliance chain cluster according to the input parameters;
and step 3: processing the uplink receiving request of the alliance link;
and 4, step 4: respectively collecting request consumption data, machine performance data, bottom layer data and network packet data in the main process;
and 5: analyzing the collected data, positioning a bottleneck point of the performance test by contrasting the alliance chain configuration and the physical machine configuration, performing disassembly analysis on the packet name of the network packet, and providing an optimization suggestion from the bottom layer.
Preferably, the pressure applying cluster data collecting module monitors the processes of request sending and request uplink.
Preferably, the process of receiving and processing uplink requests is monitored by the alliance chain bottom layer data collection module, the pressure applying trunking data collection module, the alliance chain trunking data collection module and the network data collection module, and required data is collected from the modules.
Preferably, the final performance optimization is performed by adjusting the alliance chain configuration, the transaction request sending mode and the network link by combining the final performance result and the performance data of each module.
Compared with the prior art, the invention has the following beneficial effects:
(1) according to the invention, the performance data of the alliance chain is collected and credible performance data analysis is carried out through the Jmeter, the linux data collection script, the influxdb and the packet capturing tool, so that the problem of performance bottleneck discovery is solved;
(2) the invention solves the optimization problem of the performance test bottleneck point of the alliance chain by comparing the performance data of each link of the alliance chain business process, the basic configuration of the bottom layer of the alliance chain, the combination of the actual block output time condition, the number of transactions in the block and the like.
Drawings
Other features, objects and advantages of the invention will become more apparent upon reading of the detailed description of non-limiting embodiments with reference to the following drawings:
FIG. 1 is a flow chart of the method of the present invention;
fig. 2 is a system architecture diagram of the present invention.
Detailed Description
The present invention will be described in detail with reference to specific examples. The following examples will assist those skilled in the art in further understanding the invention, but are not intended to limit the invention in any way. It should be noted that it would be obvious to those skilled in the art that various changes and modifications can be made without departing from the spirit of the invention. All falling within the scope of the present invention.
Example (b):
the invention aims to comprehensively collect performance data and network data in the process of testing the block chain performance, compare the request processing condition, the configuration related to influencing block chain out, the bottom layer block out information and the transaction condition in the block in each link of a alliance chain, analyze and position the performance bottleneck problem in the block chain performance test based on a credible block line performance analysis mode and provide an analysis scheme of optimization suggestion, so that the performance of a block chain product has an optimization direction and suggestion based on a principle layer.
Referring to fig. 1, the federation chain performance bottleneck testing method based on multidimensional data integration analysis provided by the present invention includes the following steps:
step 1: the request sending module sends a request to the uplink module according to the input parameters and is monitored by the pressure cluster data collection module;
step 2: the uplink module carries out uplink request on the alliance chain cluster according to the input parameters and is monitored by the pressure cluster data collection module;
and step 3: the alliance chain receives the uplink request for processing and is monitored by a plurality of modules;
and 4, step 4: respectively collecting pressure application module request consumption data, pressure application module machine performance data, alliance chain module bottom layer data, alliance chain machine performance data and alliance chain module network packet data in a main process from a plurality of modules;
and 5: analyzing the data collected in each module, positioning a bottleneck point of a performance test by contrasting alliance chain configuration and physical machine configuration, and carrying out disassembly analysis on packet names to provide an optimization suggestion from the bottom layer;
step 6: and adjusting the configuration of the alliance chain, the transaction request sending mode, the network link and the like by combining the final performance result and the performance data of each module to optimize the final performance.
Referring to fig. 2, the federation chain performance bottleneck test system based on multidimensional data integration analysis provided by the present invention includes an underlying application, a service module and a data module;
the bottom layer application comprises: jmeter, Java, PLATONE, Shell + Influxdb, Wireshark;
the service module comprises: the system comprises a request sending module, a chain loading module, a alliance chain cluster module, an alliance chain bottom layer data collecting module, a pressure applying cluster data collecting module, an alliance chain cluster data collecting module and a network data collecting module;
the request sending module applies a Jmeter; the uplink module applies Java; the alliance chain cluster module and the alliance chain bottom layer data collection module apply PLATONE; the pressure applying cluster data collection module and the alliance chain cluster data collection module apply Shell + Influxdb; the network data collection module applies Wireshark.
And the data module performs data processing through the service module, and comprises pressure application module consumption request data, pressure application module machine performance data, alliance chain module bottom layer data, alliance chain machine performance data, alliance chain module network packet data and TPS data.
Those skilled in the art will appreciate that, in addition to implementing the systems, apparatus, and various modules thereof provided by the present invention in purely computer readable program code, the same procedures can be implemented entirely by logically programming method steps such that the systems, apparatus, and various modules thereof are provided in the form of logic gates, switches, application specific integrated circuits, programmable logic controllers, embedded microcontrollers and the like. Therefore, the system, the device and the modules thereof provided by the present invention can be considered as a hardware component, and the modules included in the system, the device and the modules thereof for implementing various programs can also be considered as structures in the hardware component; modules for performing various functions may also be considered to be both software programs for performing the methods and structures within hardware components.
The foregoing description of specific embodiments of the present invention has been presented. It is to be understood that the present invention is not limited to the specific embodiments described above, and that various changes or modifications may be made by one skilled in the art within the scope of the appended claims without departing from the spirit of the invention. The embodiments and features of the embodiments of the present application may be combined with each other arbitrarily without conflict.
Claims (8)
1. A alliance chain performance bottleneck testing system based on multidimensional data integration analysis, comprising:
bottom layer application: providing functions of transaction initiation, request uplink, transaction processing and data collection;
a service module: the bottom layer applications are connected in series to carry out data stream transmission;
a data module: and performing integrated analysis on the data of each flow and reflecting the data into the service flow of the bottom application.
2. The system of claim 1, wherein the underlying applications comprise:
a meter: providing a transaction initiation function;
java: providing an association service between applications;
PLATONE: is responsible for processing the request;
shell + Influxdb: collecting machine performance data;
wireshark: and collecting network packet data.
3. The system of claim 2, wherein the service module comprises: the system comprises a request sending module, a chain loading module, a alliance chain cluster module, an alliance chain bottom layer data collecting module, a pressure applying cluster data collecting module, an alliance chain cluster data collecting module and a network data collecting module;
the request sending module applies a Jmeter;
the uplink module applies Java;
the alliance chain cluster module and the alliance chain bottom layer data collection module apply PLATONE;
the pressure applying cluster data collection module and the alliance chain cluster data collection module apply Shell + Influxdb;
the network data collection module applies Wireshark.
4. A federation chain performance bottleneck test system based on multidimensional data integration analysis according to claim 3, wherein the data module performs data processing through the service module, the processed data comprising: request consumption data, machine performance data, underlying data, network packet data, and request processing TPS data.
5. A alliance chain performance bottleneck testing method based on multidimensional data integration analysis, characterized in that, the alliance chain performance bottleneck testing system based on multidimensional data integration analysis of claim 3 or 4 is adopted, comprising the following steps:
step 1: the request sending module sends a request to the uplink module according to the input parameters;
step 2: the uplink module carries out uplink request on the alliance chain cluster according to the input parameters;
and step 3: processing the uplink receiving request of the alliance link;
and 4, step 4: respectively collecting request consumption data, machine performance data, bottom layer data and network packet data in the main process;
and 5: analyzing the collected data, positioning a bottleneck point of the performance test by contrasting the alliance chain configuration and the physical machine configuration, performing disassembly analysis on the packet name of the network packet, and providing an optimization suggestion from the bottom layer.
6. The method of claim 5, wherein the pressure application cluster data collection module monitors the process of request transmission and request uplink.
7. The method of claim 5, wherein the process of receiving and processing uplink requests is monitored and required data is collected from each module by a federation chain underlying data collection module, a pressure application cluster data collection module, a federation chain cluster data collection module, and a network data collection module.
8. The method of claim 5, wherein final performance optimization is performed by adjusting federation chain configuration, transaction request sending mode, and network link according to the final performance result and the performance data of each module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110342233.XA CN113079067A (en) | 2021-03-30 | 2021-03-30 | Union chain performance bottleneck testing system and method based on multidimensional data integration analysis |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110342233.XA CN113079067A (en) | 2021-03-30 | 2021-03-30 | Union chain performance bottleneck testing system and method based on multidimensional data integration analysis |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113079067A true CN113079067A (en) | 2021-07-06 |
Family
ID=76611936
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110342233.XA Pending CN113079067A (en) | 2021-03-30 | 2021-03-30 | Union chain performance bottleneck testing system and method based on multidimensional data integration analysis |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113079067A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115033303A (en) * | 2022-06-20 | 2022-09-09 | 寒武纪行歌(南京)科技有限公司 | Performance optimization method and device of pavement quality detection system and related products |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106598824A (en) * | 2016-11-25 | 2017-04-26 | 深圳前海微众银行股份有限公司 | Performance analysis method and device for block chain |
| CN109639521A (en) * | 2018-12-05 | 2019-04-16 | 北京京东金融科技控股有限公司 | Test method, device, equipment and the storage medium of block chain performance |
| CN110061889A (en) * | 2019-04-01 | 2019-07-26 | 北京众享比特科技有限公司 | Block chain performance test methods, device, equipment and storage medium |
| CN110493080A (en) * | 2019-08-19 | 2019-11-22 | 腾讯科技（深圳）有限公司 | A kind of block chain node monitoring method, device and electronic equipment and storage medium |
| US20190394113A1 (en) * | 2018-06-25 | 2019-12-26 | Blocktest Global | Systems and methods to automatically evaluate blockchain-based solution performance |
| CN110737584A (en) * | 2019-08-30 | 2020-01-31 | 深圳壹账通智能科技有限公司 | Service data testing method and device based on block chain and computer equipment |
| CN111382047A (en) * | 2018-12-28 | 2020-07-07 | 中国电信股份有限公司 | Block chain evaluation method, device and system and computer-storable medium |
| CN111767211A (en) * | 2020-06-15 | 2020-10-13 | 北京同邦卓益科技有限公司 | Test method and device of alliance chain, storage medium and electronic device |
-
2021
- 2021-03-30 CN CN202110342233.XA patent/CN113079067A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106598824A (en) * | 2016-11-25 | 2017-04-26 | 深圳前海微众银行股份有限公司 | Performance analysis method and device for block chain |
| US20190394113A1 (en) * | 2018-06-25 | 2019-12-26 | Blocktest Global | Systems and methods to automatically evaluate blockchain-based solution performance |
| CN109639521A (en) * | 2018-12-05 | 2019-04-16 | 北京京东金融科技控股有限公司 | Test method, device, equipment and the storage medium of block chain performance |
| CN111382047A (en) * | 2018-12-28 | 2020-07-07 | 中国电信股份有限公司 | Block chain evaluation method, device and system and computer-storable medium |
| CN110061889A (en) * | 2019-04-01 | 2019-07-26 | 北京众享比特科技有限公司 | Block chain performance test methods, device, equipment and storage medium |
| CN110493080A (en) * | 2019-08-19 | 2019-11-22 | 腾讯科技（深圳）有限公司 | A kind of block chain node monitoring method, device and electronic equipment and storage medium |
| CN110737584A (en) * | 2019-08-30 | 2020-01-31 | 深圳壹账通智能科技有限公司 | Service data testing method and device based on block chain and computer equipment |
| CN111767211A (en) * | 2020-06-15 | 2020-10-13 | 北京同邦卓益科技有限公司 | Test method and device of alliance chain, storage medium and electronic device |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115033303A (en) * | 2022-06-20 | 2022-09-09 | 寒武纪行歌(南京)科技有限公司 | Performance optimization method and device of pavement quality detection system and related products |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111897724B (en) | Automatic testing method and device suitable for cloud platform | |
| CN100451989C (en) | Software testing system and testing method | |
| CN111147322B (en) | Test system and method for micro service architecture of 5G core network | |
| CN103793326B (en) | Assembly test method and device | |
| CN111274095A (en) | Log data processing method, device, equipment and computer readable storage medium | |
| CN1805383A (en) | Automatization testing device and method for service system | |
| CN112988679B (en) | Log acquisition control method and device, storage medium and server | |
| CN110532021B (en) | Processing method of configuration file of distributed control system, client and service device | |
| CN114356785B (en) | Data processing method and device, electronic equipment and storage medium | |
| CN111221807A (en) | Cloud service-oriented industrial equipment big data quality testing method and architecture | |
| CN113704077A (en) | Test case generation method and device | |
| CN104123397A (en) | Automatic test device and method for Web page | |
| CN112306837A (en) | Cloud pressure testing method and platform, equipment and readable storage medium | |
| CN114090047A (en) | Software upgrading method and device | |
| CN113079067A (en) | Union chain performance bottleneck testing system and method based on multidimensional data integration analysis | |
| US20050114836A1 (en) | Block box testing in multi-tier application environments | |
| CN106201810A (en) | A kind of method of testing, device | |
| CN111639022B (en) | Transaction testing method and device, storage medium and electronic device | |
| CN113760774A (en) | OTA simulation test method, platform and system | |
| US20040268318A1 (en) | Expert system for intelligent testing | |
| CN115757010A (en) | Application abnormal data acquisition method, query method, device, equipment and medium | |
| CN112311679B (en) | State detection method, state detection device, electronic equipment and readable storage medium | |
| Lee et al. | Collecting big data from automotive ECUs beyond the CAN bandwidth for fault visualization | |
| CN109714220B (en) | Network quality detection method and device | |
| US20220415101A1 (en) | Method and Device for the Computer-Supported Monitoring of the Operation of a Vehicle Service |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210706 |