CN110061889A - Block chain performance test methods, device, equipment and storage medium - Google Patents
Block chain performance test methods, device, equipment and storage medium Download PDFInfo
- Publication number
- CN110061889A CN110061889A CN201910256370.4A CN201910256370A CN110061889A CN 110061889 A CN110061889 A CN 110061889A CN 201910256370 A CN201910256370 A CN 201910256370A CN 110061889 A CN110061889 A CN 110061889A
- Authority
- CN
- China
- Prior art keywords
- block chain
- performance
- tested
- test
- block
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/06—Generation of reports
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0805—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability
- H04L43/0817—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability by checking functioning
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
- H04L43/0876—Network utilisation, e.g. volume of load or congestion level
- H04L43/0888—Throughput
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/14—Arrangements for monitoring or testing data switching networks using software, i.e. software packages
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
- G06Q40/04—Trading; Exchange, e.g. stocks, commodities, derivatives or currency exchange
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/104—Peer-to-peer [P2P] networks
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Environmental & Geological Engineering (AREA)
- Computer Security & Cryptography (AREA)
- Debugging And Monitoring (AREA)
Abstract
This application discloses a kind of block chain performance test methods, device, equipment and storage mediums.This method comprises: successively block chain information statistical tool, system performance monitoring tools and performance testing tool is called to treat test block chain network and tested；It statisticallys analyze testing as a result, the performance test of the block chain network to be tested report is presented.The technical solution is used for each node of test block chain network by fusion block chain information statistical tool, system performance monitoring tools and performance testing tool, so as to block chain operating condition and operational process in system resources consumption be monitored analysis, largely make the performance test generated report more comprehensively and complete.
Description
Technical field
The present invention relates generally to software test fields, and in particular to a kind of block chain performance test methods, device, equipment and
Storage medium.
Background technique
With the development of bit coin and universal, block chain is as a kind of distributed bottom architecture with universality, extensively
Substantially it is the database of a decentralization applied to the different fields such as finance, politics, science and technology, is a string using password
Method is associated the data block generated, the information of batch Binet network transaction is contained in each data block, for verifying
The validity and the next block of generation of its information.Domestic block chain industry also in developing stage, open by block chain at present
Hair and deployment lack standardization guidance, particularly significant to the evaluation and test of block chain in order to preferably develop block chain industry.
Currently, traditional evaluation and test to block chain is surveyed mostly in reference to traditional testing scheme by the way that performance is used alone
Trial work tool is tested for the property or is used alone system performance monitoring tools to block chain to block chain operating system progressive
It can monitor, to obtain the performance indicator of some function point, still, the performance indicator of this method statistics is limited, and with block
The continuous development of chain technology cannot achieve the performance pressures test of great deal of nodes, cause test flexibility poor.
Summary of the invention
In view of drawbacks described above in the prior art or deficiency, it is intended to provide a kind of block chain performance test methods, device, sets
Standby and storage medium is able to solve the problem to block chain evaluation and test flexibility difference.
In a first aspect, the present invention provides a kind of block chain performance test methods, this method comprises:
Successively block chain information statistical tool, system performance monitoring tools and performance testing tool is called to treat test block
Chain network is tested；
It statisticallys analyze testing as a result, the performance test of the block chain network to be tested report is presented.
Block chain information statistical tool, system performance monitoring tools and performance are successively called in one of the embodiments,
Testing tool is treated test block chain network and is tested, comprising:
The block chain information statistical tool is called, the block number of deals of the block chain network to be tested is counted；
The system performance monitoring tools are called, determine the system performance index of the block chain network to be tested；
The performance testing tool is called, determines area of the block chain network to be tested in different pressures test environment
Block chain performance indicator result；
Also, when the block number of deals for counting the block chain network to be tested tends to threshold value, stop calling the system
System performance monitoring tool.
The system performance monitoring tools are called in one of the embodiments, determine the block chain network to be tested
System performance index, comprising:
Read the monitoring frequency being arranged on the system performance monitoring tools；
It is monitored according to operating system of the monitoring frequency to the block chain network to be tested, obtains system performance
Index.
The performance testing tool is called in one of the embodiments, determines the block chain network to be tested not
With the block chain performance indicator result in pressure test environment, comprising:
Determine the transaction node of the block chain network to be tested；
Transaction request is sent to the transaction node to carry out pressure test；
When the block number of deals tends to threshold value, the block chain performance indicator result is presented.
In one of the embodiments, the statistical analysis test as a result, the block chain to be tested is presented
The performance test of network is reported, comprising:
The block chain information statistical tool, the performance testing tool or the system performance monitoring tools are analyzed respectively
Test as a result, performance test report is presented；And/or
Block chain information statistical tool, the performance testing tool described in comprehensive analysis and the system performance monitoring tools
Test as a result, performance test report is presented.
The system performance index includes: cpu utilization rate, Installed System Memory utilization rate, system in one of the embodiments,
Disk read-write rate, the IO rate of system disk and bandwidth.
The block chain performance indicator result includes: request word joint number, thread name, line in one of the embodiments,
Number of passes amount, request success rate and Server throughput.
Second aspect, the embodiment of the invention provides a kind of block chain performance testing device, which includes:
Test module, for successively calling block chain information statistical tool, system performance monitoring tools and performance test work
Tool is treated test block chain network and is tested；
Performance test report present module, for statistically analyze test as a result, the block link network to be tested is presented
The performance test of network is reported.
The test module in one of the embodiments, comprising:
Statistic unit counts the area of the block chain network to be tested for calling the block chain information statistical tool
Block number of deals；
First determination unit determines the block chain network to be tested for calling the system performance monitoring tools
System performance index；
Second determination unit determines the block chain network to be tested in difference for calling the performance testing tool
Block chain performance indicator result in pressure test environment；
Also, when the block number of deals for counting the block chain network to be tested tends to threshold value, stop calling the system
System performance monitoring tool.
The third aspect, the embodiment of the present application provide a kind of computer equipment, including memory and processor, the storage
Device is stored with computer program, and the processor realizes block chain described above performance test side when executing the computer program
Method.
Fourth aspect, the embodiment of the present application provide a kind of computer readable storage medium, are stored thereon with computer journey
Sequence, the computer program realize block chain performance test methods described above when being executed by processor.
Block chain performance test methods, device, equipment and storage medium provided by the present application, by successively calling block chain
Information Statistics tool, system performance monitoring tools and performance testing tool are treated test block chain network and are tested, and count
It analyzes testing as a result, the performance test of block chain network to be tested report is presented.The technical solution passes through fusion block chain
Information Statistics tool, system performance monitoring tools and performance testing tool are used for each transaction node of test block chain network,
System resources consumption is monitored point in the operating condition to each transaction node of block chain network and operational process in real time
Analysis, to obtain more fully performance test report to objectively respond the real change of block chain network.
Detailed description of the invention
By reading a detailed description of non-restrictive embodiments in the light of the attached drawings below, the application's is other
Feature, objects and advantages will become more apparent upon:
Fig. 1 is the flow diagram of block chain performance test methods provided in an embodiment of the present invention；
Fig. 2 is the flow diagram of block chain performance test methods provided in an embodiment of the present invention；
Fig. 3 is the schematic diagram of the block generating rate of generation provided in an embodiment of the present invention；
Fig. 4 is the schematic diagram of the block trading volume of generation provided in an embodiment of the present invention；
Fig. 5 is the structural representation of the block chain network to be tested in block chain performance test provided in an embodiment of the present invention
Figure；
Fig. 6 is the structural schematic diagram for the block chain performance testing device of the embodiment of the present invention provided；
Fig. 7 is a kind of structural schematic diagram of computer equipment provided in an embodiment of the present invention.
Specific embodiment
The application is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouched
The specific embodiment stated is used only for explaining related invention, rather than the restriction to the invention.It also should be noted that in order to
Convenient for description, part relevant to invention is illustrated only in attached drawing.
It should be noted that in the absence of conflict, the features in the embodiments and the embodiments of the present application can phase
Mutually combination.
As mentioned in the background art, block chain is distributed account book, point-to-point transmission, common recognition mechanism, Encryption Algorithm etc.
The new application mode of computer technology, in broad terms, block chain technology are to verify and store number using linked data structure
According to, using distributed node know together algorithm and generate and more new data, guarantee in the way of cryptography data transmission and access
Safety, programmed using the intelligent contract being made of automatized script code and distributed base that one kind of operation data is completely new
Plinth framework and calculation.In order to make block chain technology widely be applied to different field, extremely to the performance test of block chain
It closes important.Pressure survey is carried out to block chain by the way that performance testing tool is used alone in traditional technology, it can be different by being arranged
Concurrency goes pressure to survey block chain, to obtain the performance indicator of block chain some function point under different pressures rank.But it is united
The performance indicator counted is extremely limited, is only capable of counting the server performances indexs such as server response time, interaction error rate.With
Constantly bringing forth new ideas for distributed account book and common recognition mechanism, cannot achieve the performance pressures test of great deal of nodes, can not count on
The blocks chain performance indicators such as the block number of deals of each block, block generating rate, transaction common recognition rate, lead to that performance is used alone
Flexibility is poor when testing tool is tested.
Based on drawbacks described above, the present invention provides a kind of block chain performance test methods, by successively calling block chain to believe
Breath statistical tool, system performance monitoring tools and performance testing tool are treated test block chain network and are tested, and statistical
Analyse testing as a result, the performance test of block chain network to be tested report is presented, which is believed by fusion block chain
Each node that statistical tool, system performance monitoring tools and performance testing tool are used for test block chain network is ceased, so as to
It is enough that analysis is monitored to system resources consumption in the operating condition and operational process of block chain, and consider the friendship of block chain
Easy common recognition situation, to largely make the performance test generated report more comprehensively and complete.
The application is described in detail below with reference to the accompanying drawings and in conjunction with the embodiments.
The embodiment of the present application can build block chain network to be tested in advance.
Specifically, block chain technology has been applied in more and more business scenarios, such as: financial service, medical treatment & health,
The every field such as entertainment, social management, different block platform chains have different needs, and such as: bit coin is for doing a little
To a payment, the featured intelligent contract in ether mill can issue the ideal money of certain written standards with contract, and Ripple is used to solve
The difficult problem of certainly cross-border payment, HyperLedger are used to solve the privacy concern of alliance's chain.
Wherein, above-mentioned block chain network to be tested can be user and need to carry out according to what different business scenarios was put up
The block chain network of performance test, each block chain network build mode difference.
Illustratively, before building block chain network, need first to complete corresponding environmental preparation work, such as: creation
Cluster, binding resilient ip, creation file storage etc.；It, can be by determining block after completing corresponding environmental preparation work
Structure, such as the cryptographic Hash core element of the incremental number of block, the data of block preservation, timestamp, previous block, from
And block is together in series.
Optionally, above-mentioned block chain network to be tested can be any kind of network, such as publicly-owned chain, privately owned chain and alliance
Chain.Wherein, publicly-owned chain is an independent operating, and everybody can participate in the block chain of book keeping operation, not controlled by anyone, Ren Rendou
It may participate in account dealing, account book full disclosure, code open source；Alliance's chain is set with the block chain basis of tissue morphology running
It applies, arbitrary node is not allowed to be involved in block chain network, the node of alliance's chain is all to preselect number and limited amount,
It is safeguarded jointly by participating in member mechanism；Privately owned chain is the block chain in a certain field, a certain enterprise operation, has privacy and envelope
Closing property.
In general, block chain network is made of data Layer, network layer, common recognition layer, excitation layer, contract layer and application layer,
Wherein, data Layer encapsulates bottom data block and the basic datas such as relevant data encryption and timestamp and rudimentary algorithm；
Network layer includes distributed networking mechanism, data dissemination mechanism and data authentication mechanism etc.；Common recognition layer predominant package network node
All kinds of common recognition algorithms；Economic factor is integrated into block chain technical system by excitation layer, and main includes the distribution of economic incentives
Mechanism and distribution mechanism；All kinds of scripts of contract layer predominant package, algorithm and intelligent contract；Application layer then encapsulates each of block chain
Kind application scenarios and case；But for different block chain networks, layering can be different, as ChainSQL can be divided into
Application layer, api layer, network layer, common recognition layer and data storage layer；Wherein, application layer is mainly used for that API is called to realize operation,
Api layer is available to the API that the various language of user are realized, is used to node interaction, network layer is mainly P2P network, is used to
The transmitting information between each node is wanted, common recognition layer is mainly used for knowing together to transaction, block, and intelligent contract correlation is handed over
Easily, intelligent contract can be executed in common recognition, data storage layer is mainly responsible for the storage of block, transaction, table content etc..
After the block chain network to be tested for completing to build in advance, performance test methods as shown in Figure 1 can be used
It treats test block chain network to be tested, to obtain the data of objective reality.
Fig. 1 is the flow diagram of block chain performance test methods provided in an embodiment of the present invention, as shown in Figure 1, the party
Method includes:
Step S101, block chain information statistical tool, system performance monitoring tools and performance testing tool pair are successively called
Block chain network to be tested is tested.
Step S102, it statisticallys analyze testing as a result, the performance test of block chain network to be tested report is presented.
Specifically, can successively start block chain information statistical tool statistics after determining block chain network to be tested
The block information and activation system performance monitoring tool of block chain network to be tested monitor block chain network to be tested and are running
The performance of system in the process, last starting performance testing tool test above-mentioned block chain network to be tested, so that it is determined that
The result tested out, wherein the result of above-mentioned test can reflect the performance parameter of the block chain network to be tested, test out area
The availability of block chain.
Further, it after terminating to treat the performance test of test block chain network, can choose in test report project
Details page carries out the generation and publication of test report, after user selects to generate test report, by analyzing block chain index
As a result, scheduler can transmit block chain index result data to test report generation module, so that forming properties are tested
Report.Wherein, above-mentioned performance test report may include performance indicator, test environment, test data, test method, test into
The data such as degree can be used to evaluate the current performance of block chain network, to judge whether it meets expected performance requirement.
Block chain performance test methods provided in this embodiment, by successively calling block chain information statistical tool, system
Performance monitoring tool and performance testing tool are treated test block chain network and are tested, and statistically analyze test as a result, with
The performance test report of block chain network to be tested is presented.The technical solution passes through fusion block chain information statistical tool, system
Performance monitoring tool and performance testing tool are used for each node of test block chain network, in real time to each section of block chain
System resources consumption is monitored analysis in the operating condition and operational process of point, can obtain more fully performance test report
To objectively respond the real change of block chain network.
It optionally, on the basis of the above embodiments, should as shown in Fig. 2, a kind of achievable mode as step S101
Method includes:
Step S201, block chain information statistical tool is called, the block number of deals of block chain network to be tested is counted.
Specifically, above-mentioned block chain information statistical tool is for for statistical analysis to the data of block chain, usually root
According to the tool that each different block chain is individually developed, after determining block chain network to be tested, block chain letter can star
Statistical tool is ceased, the network structure and parameter of the block chain network to be tested are analyzed, counts block number of deals, it can be with Statistical Area
Block generating rate, transaction common recognition rate, block height, block generate interval time etc..
It should be noted that the block height is the number that block is linked at main chain, it is to be arrived for measuring some block
Position of a certain block on chain can be accurately depicted by block height in the distance between first block.For example,
The height of a certain block is 3, it is meant that Cong Chuanshi block is to current block longest chain block numerical digit 3+1；Wherein, area
The quantity that block number of deals is traded between certain section of time intra block；Block generating rate is the life of the block during pressure test
At speed；Transaction common recognition rate percent of pass is the percentage for the total number of transaction of number of transaction Zhan that common recognition passes through；Wherein, above-mentioned block
Data can be indicated by chart format, for example, block chain generating rate line chart, transaction common recognition rate line chart, block include
Transaction histogram and block height histogram etc..
In addition, block chain generating rate line chart can be as shown in Figure 3, wherein horizontal axis indicates block height, and the longitudinal axis indicates
Block generates the time；Block transaction line chart may refer to Fig. 4., as shown in figure 4, its horizontal axis indicates block height, the longitudinal axis is indicated
Trading volume.
Step S202, calling system performance monitoring tool determines the system performance index of block chain network to be tested.
Specifically, can be adopted after counting the block number of deals of block chain network by block chain information statistical tool
Server system is monitored with system performance monitoring tools.Wherein, system performance monitoring tools such as nmon tool, is used to
The system performance index of monitoring system whithin a period of time can be on corresponding server when needing monitor system performance
Nmon tool is called, and according to pre-set monitoring frequency, as 1s is primary.After monitoring, nmon can be generated
File copies to windows system, and the file generated with nmon tool open, to view system within certain time
System performance index.
Wherein, above system performance indicator may include the read-write of cpu utilization rate, Installed System Memory utilization rate, system disk
Rate, the IO rate of system disk and bandwidth；Optionally, above system performance indicator can be indicated by chart format, such as: system
Memory usage line chart, the read and write rate line chart of system disk, IO rate line chart of system disk etc..
It should be noted that system cpu utilization rate refers to the memory percentage of time of consumer process and system process consumption,
In the case of long-time, the generally receivable upper limit is no more than 85%；Memory usage=(1- free memory/total memory size) *
100%, generally at least 10% free memory, it is 85% that memory usage, which receives the upper limit,；Disk is mainly used for accessing data, right
For disk, one time the continuous of disk is read or continuously writes to be called an IO.When I/O operation is there are two kinds of respective operations, number is deposited
According to it is corresponding be to write I/O operation, access according to it is corresponding be read I O operation；Above system performance indicator reflects block chain node and exists
The occupancy situation of system resource during pressure survey illustrates that performance has reached the limit when resource occupation is more than preset percentage,
The preset percentage can be 90%.
Further, above-mentioned block chain network to be measured is normally operated on server system, main to the monitoring of the system
Be monitored for each server system platform resource use, wherein server system platform can be Windows, Linux,
Unix etc., system performance monitoring tools can be the included monitoring tools of system, are also possible to supervise by third party's tool
Control, such as: Windows system included " system performance monitor ", third party's monitoring tools, for example, can be spotlight,
Nmon etc..
In addition, calling system performance monitoring tool monitors block by running block chain network to be tested in system
The Expenditure Levels of system resource in chain network operational process, to determine the performance bottleneck of system in block catenary system operational process,
To further assess the performance of block chain network.
Step S203, invocation performance testing tool determines block chain network to be tested in different pressures test environment
Block chain performance indicator result；
Also, when the block number of deals for counting block chain network to be tested tends to threshold value, stop calling system performance prison
Control tool.
Optionally, it may refer to shown in Fig. 5, which includes multiple transaction nodes, can be by the area shown in Fig. 5
Block chain network is as block chain network to be tested.As transaction node any in Fig. 5 all can serve as start node, such as with dotted line
Showing region is start node, is tested, is restarted respectively using block chain information statistical tool, system performance monitoring tools
Performance testing tool successively sends transaction to each transaction node of block chain network to be tested and carries out pressure test, and determines area
Block number of deals, when block number of deals tends to threshold value, i.e., the number of deals in the block of block chain information statistical tool statistics is stablized
At 0, then stop calling system performance monitoring tool, and indicate that pressure test terminates, then checks calling system performance monitoring
The system performance index and invocation performance testing tool that tool obtains obtain block chain performance indicator as a result, area to be tested is presented
The performance test of block chain network is reported.
During passage capacity testing tool carries out pressure test to block chain network, performance testing tool can be to
Transaction node sends transaction, and block chain information statistical tool statistics block number of deals is likely larger than 0, when performance testing tool stops
When sending transaction to transaction node, the block number of deals that block chain information statistical tool may count on is stablized 0, indicates at this time
It shuts the book between block, then can terminate pressure test.
Specifically, can be by checking block number of deals, system performance index and block chain performance indicator as a result, to above-mentioned
Data carry out analysis and arrangement, to generate test result.
In addition, statistical analysis test as a result, present block chain network to be tested performance test report when, Ke Yifen
Not Fen Xi block chain information statistical tool, performance testing tool or system performance monitoring tools test as a result, performance is presented
Test report；It can also be tested with comprehensive analysis block chain information statistical tool, performance testing tool and system performance monitoring tools
As a result, with present performance test report.
Wherein, above-mentioned block chain performance indicator result may include request word joint number, request sum, number of samples, thread
The parameters such as title, thread waiting time and Server throughput；Wherein, request word joint number is the byte of the every transaction sent
Number, thread name are the title for sending transaction, and number of threads is concurrently to send the quantity of transaction, and request success rate is normal response
And the number of requests of the successful number of request of response/total, Server throughput refer to the number of request of completion per second.
Wherein, above-mentioned block chain performance indicator result can be shown by chart format, for example, showing in a tabular form
Sample serial number, request time started, thread name, request title, each request time-consuming, solicited status, request word joint number, sample
Number, thread waiting time；Handling capacity, average value, intermediate value are shown in the form of graphic result；Come in the form of aggregated report
Show number of samples, average response time, median, most short/maximum duration of server response, interaction error statistics, service
Device transmitting-receiving byte number per second；Show that sampler result, request and response data, partial data can join with result number format
As shown in following table:
Wherein, TPS is the message count of processing per second, can state the performance indicator of system processing capacity.
Optionally, above-mentioned performance testing tool can be Hyperledger Caliper, be also possible to Jemeter,
In, which is a block chain performance benchmark test frame, and user is allowed to test different areas using customized use-case
Block chain solution, and one group of the performance test results is obtained, it is able to reflect and services to obtain reliability, the response performance and clothes of platform
Situations such as availability of business.
Further, in specific pressure test sequence, a pressure measuring point can be first chosen, such as tests money transfer transactions, or
It trades in ChainSQL to the insertion of database table；Wherein, for money transfer transactions, firstly, generating a collection of quantity account, such as 1000
Then a account, and these accounts are activated on chain allows between 1000 accounts with preset rules, carries out between each other
Money transfer transactions obtain transaction data and performance indicator；For carrying out pressure survey to the insertion transaction of database table in ChainSQL
Examination can be first to send and build table transaction, after building table on block chain, and sends authorization transaction, the insertion operation permission of table is awarded
It weighs to all users, then generates m user at random, after which is activated on chain, can be united by block chain information
Meter tool subscribes to all blocks and generates event, and each block generation time and number of transaction are packaged into a file, unites
Common recognition situation and common recognition successful transaction amount of the meter transaction in each block, then monitor work by system performance in node
Tool nmon carrys out the finger such as cpu utilization rate, memory usage, system disk read and write rate and the bandwidth of monitoring system whithin a period of time
N thread is arranged finally by performance testing tool Jemeter in mark, is inserted into data using the transmission of m account (m > n) rotation
Transaction to transaction node on, Jemeter send trade after, can be checked by Jemeter request success rate, request
The blocks chain performance indicator result such as byte number and Server throughput.
The present embodiment provides must determine block chain index as a result, counting to be measured by calling block chain information statistical tool
The block number of deals of block chain network, and calling system performance monitoring tool are tried, determines the systematicness of block chain network to be tested
Energy index, then invocation performance testing tool, determines block chain of the block chain network to be tested in different pressures test environment
Performance indicator result.The technical solution can go out block data by block chain statistical and analytical tool, accurate statistics, and combine system
System monitoring tools and performance testing tool, test out the Expenditure Levels of the running performance indicator of block chain and system resource,
So as to more comprehensively to block chain network carry out test analysis, further test out block chain availability and whether
It meets the needs of users, provides important reference value for the use of block chain.
It should be noted that above method embodiment can be the reality by way of software, hardware or software and hardware combining
Ready-made is some or all of of terminal device, and executing subject can be terminal device.
It should be noted that although describing the operation of the method for the present invention in the accompanying drawings with particular order, this is not required that
Or hint must execute these operations in this particular order, or have to carry out operation shown in whole and be just able to achieve the phase
The result of prestige.On the contrary, the step of describing in flow chart can change and execute sequence.Additionally or alternatively, it is convenient to omit certain
Multiple steps are merged into a step and executed, and/or a step is decomposed into execution of multiple steps by step.
Fig. 6 is the structural schematic diagram of block chain performance testing device provided in an embodiment of the present invention.As shown in fig. 6, the dress
The method as shown in FIG. 1 to FIG. 2 that may be implemented is set, the apparatus may include:
Test module 10, for successively calling block chain information statistical tool, system performance monitoring tools and performance test
Tool is treated test block chain network and is tested；
Performance test report present module 20, for statistically analyze test as a result, the block chain to be tested is presented
The performance test of network is reported.
Preferably, the test module 10, comprising:
Statistic unit 101 counts the block chain network to be tested for calling the block chain information statistical tool
Block number of deals；
First determination unit 102 determines the block chain network to be tested for calling the system performance monitoring tools
System performance index；
Second determination unit 103 determines the block chain network to be tested not for calling the performance testing tool
With the block chain performance indicator result in pressure test environment；
Also, when the block number of deals for counting the block chain network to be tested tends to threshold value, stop calling the system
System performance monitoring tool.
Preferably, first determination unit 102, is specifically used for:
Read the monitoring frequency being arranged on the system performance monitoring tools；
It is monitored according to operating system of the monitoring frequency to the block chain network to be tested, obtains system performance
Index.
Preferably, second determination unit 103, is specifically used for:
Determine the transaction node of the block chain network to be tested；
Transaction request is sent to the transaction node to carry out pressure test；
When the block number of deals tends to threshold value, the block chain performance indicator result is presented.
Preferably, module 20 is presented in the test report, is specifically used for:
The block chain information statistical tool, the performance testing tool or the system performance monitoring tools are analyzed respectively
Test as a result, performance test report is presented；And/or
Block chain information statistical tool, the performance testing tool described in comprehensive analysis and the system performance monitoring tools
Test as a result, performance test report is presented.
Preferably, the system performance index includes: cpu utilization rate, Installed System Memory utilization rate, system disk read-write speed
Rate, the IO rate of system disk and bandwidth.
Preferably, the block chain performance indicator result include: request word joint number, thread name, number of threads, request at
Power and Server throughput.
Block chain performance testing device provided in this embodiment, can execute the embodiment of the above method, realization principle
Similar with technical effect, details are not described herein.
Fig. 7 is a kind of structural schematic diagram of computer equipment provided in an embodiment of the present invention.As shown in fig. 7, it illustrates
Suitable for being used to realize the structural schematic diagram of the terminal device of the embodiment of the present application or the computer system 700 of server.
As shown in fig. 7, computer system 700 includes central processing unit (CPU) 701, it can be read-only according to being stored in
Program in memory (ROM) 702 or be loaded into the program in random access storage device (RAM) 703 from storage section 708 and
Execute various movements appropriate and processing.In RAM703, also it is stored with system 700 and operates required various programs and data.
CPU701, ROM702 and RAM703 are connected with each other by bus 704.Input/output (I/O) interface 706 is also connected to bus
704。
I/O interface 705 is connected to lower component: the importation 706 including keyboard, mouse etc.；It is penetrated including such as cathode
The output par, c 707 of spool (CRT), liquid crystal display (LCD) etc. and loudspeaker etc.；Storage section 708 including hard disk etc.；
And the communications portion 709 of the network interface card including LAN card, modem etc..Communications portion 709 via such as because
The network of spy's net executes communication process.Driver 710 is also connected to I/O interface 706 as needed.Detachable media 711, such as
Disk, CD, magneto-optic disk, semiconductor memory etc. are mounted on as needed on driver 710, in order to read from thereon
Computer program be mounted into storage section 708 as needed.
Particularly, in accordance with an embodiment of the present disclosure, it is soft to may be implemented as computer for the process above with reference to Fig. 1-2 description
Part program.For example, embodiment of the disclosure includes a kind of computer program product comprising be tangibly embodied in machine readable Jie
Computer program in matter, the computer program include the program code for executing the method for Fig. 1-2.In such implementation
In example, which can be downloaded and installed from network by communications portion 709, and/or from detachable media 711
It is mounted.
Flow chart and block diagram in attached drawing are illustrated according to the system of various embodiments of the invention, method and computer journey
The architecture, function and operation in the cards of sequence product.In this regard, each box in flowchart or block diagram can generation
A part of one module, program segment or code of table, a part of aforementioned modules, program segment or code include one or more
Executable instruction for implementing the specified logical function.It should also be noted that in some implementations as replacements, institute in box
The function of mark can also occur in a different order than that indicated in the drawings.For example, two boxes succeedingly indicated are practical
On can be basically executed in parallel, they can also be executed in the opposite order sometimes, and this depends on the function involved.Also it wants
It is noted that the combination of each box in block diagram and or flow chart and the box in block diagram and or flow chart, Ke Yiyong
The dedicated hardware based system of defined functions or operations is executed to realize, or can be referred to specialized hardware and computer
The combination of order is realized.
Being described in the embodiment of the present application involved unit or module can be realized by way of software, can also be with
It is realized by way of hardware.Described unit or module also can be set in the processor, for example, can be described as:
A kind of processor includes that module is presented in test module and performance test report.Wherein, the title of these units or module is at certain
The restriction to the unit or module itself is not constituted in the case of kind, for example, test module is also described as " for successively
Block chain information statistical tool, system performance monitoring tools and performance testing tool is called to treat test block chain network and surveyed
Examination ".
As on the other hand, present invention also provides a kind of computer-readable medium, which be can be
Included in electronic equipment described in above-described embodiment；It is also possible to individualism, and without in the supplying electronic equipment.
Above-mentioned computer-readable medium carries one or more program, when the electronics is set by one for said one or multiple programs
When standby execution, so that the electronic equipment realizes the block chain performance test methods as described in above-described embodiment.
For example, the electronic equipment may be implemented as shown in Figure 1: step S101 successively calls block chain information system
Meter tool, system performance monitoring tools and performance testing tool are treated test block chain network and are tested；Step S102, statistics
It analyzes testing as a result, the performance test of the block chain network to be tested report is presented.For another example, the electronic equipment can be with
Realize each step as shown in Figure 2.
It should be noted that although being referred to several modules or list for acting the equipment executed in the above detailed description
Member, but this division is not enforceable.In fact, according to embodiment of the present disclosure, it is above-described two or more
Module or the feature and function of unit can embody in a module or unit.Conversely, an above-described mould
The feature and function of block or unit can be to be embodied by multiple modules or unit with further division.
In addition, although describing each step of method in the disclosure in the accompanying drawings with particular order, this does not really want
These steps must be executed in this particular order by asking or implying, or having to carry out step shown in whole could realize
Desired result.It is additional or it is alternatively possible to omit certain steps, multiple steps are merged into a step and are executed, and/
Or a step is decomposed into execution of multiple steps etc..Through the above description of the embodiments, those skilled in the art
It can be readily appreciated that example embodiment described herein can also combine necessary hardware by software by software realization
Mode realize.
Above description is only the preferred embodiment of the application and the explanation to institute's application technology principle.Those skilled in the art
Member is it should be appreciated that invention scope involved in the application, however it is not limited to technology made of the specific combination of above-mentioned technical characteristic
Scheme, while should also cover in the case where not departing from the inventive concept, it is carried out by above-mentioned technical characteristic or its equivalent feature
Any combination and the other technical solutions formed.Such as features described above has similar function with (but being not limited to) disclosed herein
Can technical characteristic replaced mutually and the technical solution that is formed.
Claims (11)
1. a kind of block chain performance test methods characterized by comprising
Successively block chain information statistical tool, system performance monitoring tools and performance testing tool is called to treat test block link network
Network is tested；
It statisticallys analyze testing as a result, the performance test of the block chain network to be tested report is presented.
2. block chain performance test methods according to claim 1, which is characterized in that successively call block chain information statistics
Tool, system performance monitoring tools and performance testing tool are treated test block chain network and are tested, comprising:
The block chain information statistical tool is called, the block number of deals of the block chain network to be tested is counted；
The system performance monitoring tools are called, determine the system performance index of the block chain network to be tested；
The performance testing tool is called, determines block chain of the block chain network to be tested in different pressures test environment
Performance indicator result；
Also, when the block number of deals for counting the block chain network to be tested tends to threshold value, stop calling the systematicness
It can monitoring tools.
3. block chain performance test methods according to claim 2, which is characterized in that call the system performance monitoring work
Tool, determines the system performance index of the block chain network to be tested, comprising:
Read the monitoring frequency being arranged on the system performance monitoring tools；
It is monitored according to operating system of the monitoring frequency to the block chain network to be tested, obtains system performance and refer to
Mark.
4. block chain performance test methods according to claim 2, which is characterized in that the performance testing tool is called,
Determine block chain performance indicator result of the block chain network to be tested in different pressures test environment, comprising:
Determine the transaction node of the block chain network to be tested；
Transaction request is sent to the transaction node to carry out pressure test；
When the block number of deals tends to threshold value, the block chain performance indicator result is presented.
5. block chain performance test methods according to claim 1, which is characterized in that the statistical analysis test
As a result, the performance test of the block chain network to be tested report is presented, comprising:
The block chain information statistical tool, the performance testing tool or system performance monitoring tools test are analyzed respectively
As a result, performance test report is presented；And/or
Block chain information statistical tool, the performance testing tool described in comprehensive analysis and system performance monitoring tools test
As a result, performance test report is presented.
6. block chain performance test methods according to claim 2, which is characterized in that the system performance index includes:
Cpu utilization rate, Installed System Memory utilization rate, system disk read and write rate, the IO rate of system disk and bandwidth.
7. block chain performance test methods according to claim 2, which is characterized in that the block chain performance indicator result
It include: request word joint number, thread name, number of threads, request success rate and Server throughput.
8. a kind of block chain performance testing device characterized by comprising
Test module, for successively calling block chain information statistical tool, system performance monitoring tools and performance testing tool pair
Block chain network to be tested is tested；
Performance test report present module, for statistically analyze test as a result, the block chain network to be tested is presented
Performance test report.
9. block chain performance testing device according to claim 8, which is characterized in that the test module, comprising:
Statistic unit, for calling the block chain information statistical tool, the block for counting the block chain network to be tested is handed over
Easily number；
First determination unit, for calling the system performance monitoring tools, the system for determining the block chain network to be tested
Performance indicator；
Second determination unit determines the block chain network to be tested in different pressures for calling the performance testing tool
Test the block chain performance indicator result in environment；
Also, when the block number of deals for counting the block chain network to be tested tends to threshold value, stop calling the systematicness
It can monitoring tools.
10. a kind of computer equipment, can run on a memory and on a processor including memory, processor and storage
Computer program, which is characterized in that the processor is realized when executing described program as of any of claims 1-7
Method.
11. a kind of computer readable storage medium is stored thereon with computer program, the computer program is used for:
Such as method of any of claims 1-7 is realized when the computer program is executed by processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910256370.4A CN110061889A (en) | 2019-04-01 | 2019-04-01 | Block chain performance test methods, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910256370.4A CN110061889A (en) | 2019-04-01 | 2019-04-01 | Block chain performance test methods, device, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110061889A true CN110061889A (en) | 2019-07-26 |
Family
ID=67317950
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910256370.4A Pending CN110061889A (en) | 2019-04-01 | 2019-04-01 | Block chain performance test methods, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110061889A (en) |
Cited By (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110471827A (en) * | 2019-08-09 | 2019-11-19 | 中国信息通信研究院 | A kind of block chain performance benchmark test method and apparatus |
| CN110493080A (en) * | 2019-08-19 | 2019-11-22 | 腾讯科技（深圳）有限公司 | A kind of block chain node monitoring method, device and electronic equipment and storage medium |
| CN110958161A (en) * | 2019-12-02 | 2020-04-03 | 中国银行股份有限公司 | Block link point monitoring method and device |
| CN111147575A (en) * | 2019-12-25 | 2020-05-12 | 山东公链信息科技有限公司 | Data storage system based on block chain |
| CN111162970A (en) * | 2019-12-30 | 2020-05-15 | 支付宝(杭州)信息技术有限公司 | Method and device for testing decentralized application server in block chain system |
| CN111428259A (en) * | 2020-06-09 | 2020-07-17 | 浙江国发企服科技有限公司 | Information collaborative check management method, collaborative check system and storage medium |
| CN111447112A (en) * | 2020-03-25 | 2020-07-24 | 中国银行股份有限公司 | Block chain network monitoring system, device and method |
| CN111478827A (en) * | 2020-06-24 | 2020-07-31 | 支付宝(杭州)信息技术有限公司 | Pressure testing method, device and system for block chain network |
| CN111614761A (en) * | 2020-05-21 | 2020-09-01 | 腾讯科技（深圳）有限公司 | Block chain message transmission method, device, computer and readable storage medium |
| CN111625474A (en) * | 2020-07-29 | 2020-09-04 | 南京可信区块链与算法经济研究院有限公司 | Automatic testing method of alliance chain |
| CN112486830A (en) * | 2020-06-24 | 2021-03-12 | 支付宝(杭州)信息技术有限公司 | Pressure testing method, device and system for block chain network |
| CN112506798A (en) * | 2020-12-22 | 2021-03-16 | 杭州趣链科技有限公司 | Performance test method, device, terminal and storage medium of block chain platform |
| CN112579405A (en) * | 2019-09-29 | 2021-03-30 | 中国科学院深圳先进技术研究院 | Method and system for selecting performance evaluation index of block chain benchmark test program |
| CN112910743A (en) * | 2021-03-19 | 2021-06-04 | 中山大学 | Block chain performance detection system |
| CN113079067A (en) * | 2021-03-30 | 2021-07-06 | 上海万向区块链股份公司 | Union chain performance bottleneck testing system and method based on multidimensional data integration analysis |
| CN113326197A (en) * | 2021-06-11 | 2021-08-31 | 南京工业大学 | Performance test method for Diem block chain |
| CN113360182A (en) * | 2021-06-04 | 2021-09-07 | 建信金融科技有限责任公司 | Method and apparatus for system performance diagnostics |
| CN113609008A (en) * | 2021-07-27 | 2021-11-05 | 北京淇瑀信息科技有限公司 | Test result analysis method and device and electronic equipment |
| CN113806203A (en) * | 2020-06-12 | 2021-12-17 | 阿里巴巴集团控股有限公司 | Block chain testing method and device |
| CN113821426A (en) * | 2021-11-23 | 2021-12-21 | 南京金宁汇科技有限公司 | Block chain performance test method and device |
| WO2022111109A1 (en) * | 2020-11-25 | 2022-06-02 | 深圳前海微众银行股份有限公司 | Fork resistance detection method and apparatus for blockchain |
| CN115994363A (en) * | 2023-03-24 | 2023-04-21 | 北京邮电大学 | Block chain security assessment method and device based on multidimensional security detection |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160100018A1 (en) * | 2014-10-03 | 2016-04-07 | Drive Time Metrics, Inc. | Cross channel in-vehicle media consumption measurement and analysis |
| CN106101242A (en) * | 2016-06-24 | 2016-11-09 | 深圳前海微众银行股份有限公司 | The construction method of block chain cloud service platform and device |
| CN106506203A (en) * | 2016-10-25 | 2017-03-15 | 杭州云象网络技术有限公司 | A kind of monitoring nodes system for being applied to block chain |
| CN106598824A (en) * | 2016-11-25 | 2017-04-26 | 深圳前海微众银行股份有限公司 | Performance analysis method and device for block chain |
| CN108647361A (en) * | 2018-05-21 | 2018-10-12 | 中国工商银行股份有限公司 | A kind of date storage method, apparatus and system based on block chain |
| CN108763058A (en) * | 2018-04-24 | 2018-11-06 | 苏州同济区块链研究院有限公司 | A kind of block chain evaluation system |
| US10158527B2 (en) * | 2016-10-28 | 2018-12-18 | International Business Machines Corporation | Changing an existing blockchain trust configuration |
-
2019
- 2019-04-01 CN CN201910256370.4A patent/CN110061889A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160100018A1 (en) * | 2014-10-03 | 2016-04-07 | Drive Time Metrics, Inc. | Cross channel in-vehicle media consumption measurement and analysis |
| CN106101242A (en) * | 2016-06-24 | 2016-11-09 | 深圳前海微众银行股份有限公司 | The construction method of block chain cloud service platform and device |
| CN106506203A (en) * | 2016-10-25 | 2017-03-15 | 杭州云象网络技术有限公司 | A kind of monitoring nodes system for being applied to block chain |
| US10158527B2 (en) * | 2016-10-28 | 2018-12-18 | International Business Machines Corporation | Changing an existing blockchain trust configuration |
| CN106598824A (en) * | 2016-11-25 | 2017-04-26 | 深圳前海微众银行股份有限公司 | Performance analysis method and device for block chain |
| CN108763058A (en) * | 2018-04-24 | 2018-11-06 | 苏州同济区块链研究院有限公司 | A kind of block chain evaluation system |
| CN108647361A (en) * | 2018-05-21 | 2018-10-12 | 中国工商银行股份有限公司 | A kind of date storage method, apparatus and system based on block chain |
Cited By (27)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110471827A (en) * | 2019-08-09 | 2019-11-19 | 中国信息通信研究院 | A kind of block chain performance benchmark test method and apparatus |
| CN110471827B (en) * | 2019-08-09 | 2023-02-17 | 中国信息通信研究院 | Block chain performance benchmark test method and device |
| CN110493080A (en) * | 2019-08-19 | 2019-11-22 | 腾讯科技（深圳）有限公司 | A kind of block chain node monitoring method, device and electronic equipment and storage medium |
| CN110493080B (en) * | 2019-08-19 | 2021-12-14 | 腾讯科技（深圳）有限公司 | Block link point monitoring method and device, electronic equipment and storage medium |
| CN112579405A (en) * | 2019-09-29 | 2021-03-30 | 中国科学院深圳先进技术研究院 | Method and system for selecting performance evaluation index of block chain benchmark test program |
| CN110958161A (en) * | 2019-12-02 | 2020-04-03 | 中国银行股份有限公司 | Block link point monitoring method and device |
| CN110958161B (en) * | 2019-12-02 | 2021-11-19 | 中国银行股份有限公司 | Block chain link point monitoring method and device and storage medium |
| CN111147575A (en) * | 2019-12-25 | 2020-05-12 | 山东公链信息科技有限公司 | Data storage system based on block chain |
| CN111162970A (en) * | 2019-12-30 | 2020-05-15 | 支付宝(杭州)信息技术有限公司 | Method and device for testing decentralized application server in block chain system |
| CN111447112A (en) * | 2020-03-25 | 2020-07-24 | 中国银行股份有限公司 | Block chain network monitoring system, device and method |
| CN111614761A (en) * | 2020-05-21 | 2020-09-01 | 腾讯科技（深圳）有限公司 | Block chain message transmission method, device, computer and readable storage medium |
| CN111428259A (en) * | 2020-06-09 | 2020-07-17 | 浙江国发企服科技有限公司 | Information collaborative check management method, collaborative check system and storage medium |
| CN113806203A (en) * | 2020-06-12 | 2021-12-17 | 阿里巴巴集团控股有限公司 | Block chain testing method and device |
| CN112486830A (en) * | 2020-06-24 | 2021-03-12 | 支付宝(杭州)信息技术有限公司 | Pressure testing method, device and system for block chain network |
| CN111478827A (en) * | 2020-06-24 | 2020-07-31 | 支付宝(杭州)信息技术有限公司 | Pressure testing method, device and system for block chain network |
| CN111625474A (en) * | 2020-07-29 | 2020-09-04 | 南京可信区块链与算法经济研究院有限公司 | Automatic testing method of alliance chain |
| CN111625474B (en) * | 2020-07-29 | 2020-11-10 | 南京可信区块链与算法经济研究院有限公司 | Automatic testing method of alliance chain |
| WO2022111109A1 (en) * | 2020-11-25 | 2022-06-02 | 深圳前海微众银行股份有限公司 | Fork resistance detection method and apparatus for blockchain |
| CN112506798A (en) * | 2020-12-22 | 2021-03-16 | 杭州趣链科技有限公司 | Performance test method, device, terminal and storage medium of block chain platform |
| CN112910743A (en) * | 2021-03-19 | 2021-06-04 | 中山大学 | Block chain performance detection system |
| CN113079067A (en) * | 2021-03-30 | 2021-07-06 | 上海万向区块链股份公司 | Union chain performance bottleneck testing system and method based on multidimensional data integration analysis |
| CN113360182A (en) * | 2021-06-04 | 2021-09-07 | 建信金融科技有限责任公司 | Method and apparatus for system performance diagnostics |
| CN113326197A (en) * | 2021-06-11 | 2021-08-31 | 南京工业大学 | Performance test method for Diem block chain |
| CN113609008A (en) * | 2021-07-27 | 2021-11-05 | 北京淇瑀信息科技有限公司 | Test result analysis method and device and electronic equipment |
| CN113821426A (en) * | 2021-11-23 | 2021-12-21 | 南京金宁汇科技有限公司 | Block chain performance test method and device |
| CN113821426B (en) * | 2021-11-23 | 2022-02-15 | 南京金宁汇科技有限公司 | Block chain performance test method and device |
| CN115994363A (en) * | 2023-03-24 | 2023-04-21 | 北京邮电大学 | Block chain security assessment method and device based on multidimensional security detection |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110061889A (en) | Block chain performance test methods, device, equipment and storage medium | |
| US10116534B2 (en) | Systems and methods for WebSphere MQ performance metrics analysis | |
| US9942103B2 (en) | Predicting service delivery metrics using system performance data | |
| US20130006717A1 (en) | Evaluating a worker in performing crowd sourced tasks and providing in-task training through programmatically generated test tasks | |
| EP2733615B1 (en) | System and method to validate test cases | |
| CN110428325A (en) | Transaction tracking and device | |
| EP3126995A1 (en) | Cloud computing benchmarking | |
| EP3143510A1 (en) | Load generation application and cloud computing benchmarking | |
| US9134997B2 (en) | Methods for assessing deliverable product quality and devices thereof | |
| CN107527222A (en) | Information processing method and apparatus and system | |
| CN113900921B (en) | Court information system running state evaluation method, device, equipment and storage medium | |
| WO2022142013A1 (en) | Artificial intelligence-based ab testing method and apparatus, computer device and medium | |
| US12093964B2 (en) | Automated rules execution testing and release system | |
| Lalanne et al. | Quality of experience as a selection criterion for web services | |
| CN111008767B (en) | Internet financial technology architecture evaluation method, device, electronic equipment and medium | |
| CN111966585A (en) | Test task execution method, device, equipment and system | |
| CN111897706A (en) | Server performance prediction method, device, computer system and medium | |
| CN110675069A (en) | Real estate industry client signing risk early warning method, server and storage medium | |
| CN110262955A (en) | Application performance monitoring tools based on pinpoint | |
| US11709750B2 (en) | Dynamically mapping software infrastructure utilization | |
| CN112734227A (en) | Big data decision system and method | |
| CN112769642A (en) | Method for testing PCIE link of server and related equipment | |
| CN112181376A (en) | Code resource management method, device, electronic equipment and medium | |
| CN116228312A (en) | Processing method and device for large-amount point exchange behavior | |
| CN114862282A (en) | Business and financial cooperative management method and system based on data analysis |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190726 |
|
| RJ01 | Rejection of invention patent application after publication |