KR100967525B1 - Method and system for generating load only to the targeted system, not to the connected ones when doing performance, load, functional tests on the targeted system. - Google Patents

Abstract

The present invention, when performing a variety of tests, including load test, performance test, stress test, functional test, when the test target system is interlocked with a database system, an external system or a separate system that performs a specific logic, interlocked system The present invention relates to a system and a method for performing a test while generating a load only on the system under test, without generating a load on them.

In more detail, when a test target system implemented in Java transmits a result to a client program by interworking with a database system or an external system or a separate system that executes specific logic, the Java in charge of communicating with the interworking systems By modifying the original method using a BCI (Byte Code Instrumentation) program, the user's code is executed instead of the original method, and the preset response data is returned. The present invention relates to a system and method capable of performing various tests including a performance test, a load test, and a function test without generating a load on the interworking database system, an external system, or a separate system that performs specific logic.

To this end, the present invention, the BCI (Byte Code Instrumentation) program, the Simulator Manager (Simulator Manager) and the JSP (Java Server Page) program or Servlet program used to deliver the user setting information to the simulator manager and interworking with the external system It characterized in that it comprises a simulator handler (Simulator Handler) responsible for the processing of the modified method responsible for the.

Specifically, the BCI program includes a means for modifying a method of a class previously designated by a user in charge of communicating with the interworking systems, and the simulator manager includes a target class designated by a user from a JSP (or Servlet) and a user; The name of the method, the processing time, the method return variable type, the default method return value, the method input value and the method return value for the input value, whether or not the method's original code has been executed, and the maximum number of methods responsible for interworking with the external system. In case of exceeding the maximum number of executions per second, if the number of executions exceeds the maximum number of executions per second, the inspection interval, parameter type of input data, input data value Therefore, I / O data file and this I / O data that can be returned by selecting return value And means that can read the work simulator handler in accordance with the terms set in the simulation manager, characterized in that it comprises means capable of processing the modified maesodeu (instrument).

Performance Test, Load Test, Function Test, Test, Simulator, Method, Java, ASP

Description

Systems and methods for generating load only to the targeted system, not to the connected ones when doing performance, load, functional tests on the targeted system. }

The present invention, when performing a variety of tests, including load test, performance test, stress test, functional test, when the test target system is interlocked with a database system, an external system or a separate system that performs a specific logic, interlocked system The present invention relates to a system and a method for performing a test while generating a load only on the system under test, without generating a load on them.

In more detail, when a test target system implemented in Java transmits a result to a client program by interworking with a database system or an external system or a separate system that executes specific logic, the Java in charge of communicating with the interworking systems By modifying the original method using a BCI (Byte Code Instrumentation) program, the user's code is executed instead of the original method, and the preset response data is returned. The present invention relates to a system and method capable of performing various tests including a performance test, a load test, and a functional test without generating a load on the interworking database system, an external system, or a separate system that performs specific logic.

As described above, when the system under test performs the entire process by interworking with a database system, a system processing specific logic, or an external system, only the direct communication with the client program is performed without generating a load on the interlocked systems. There is a need for a method and a system that generates a load only for the system that is doing the job.

For example, in the case of interworking with a database system, the test target system is composed of a web application built in Java, and the web application of the class communicating with the interlocked database to process a client's request. When a method is called and a result is delivered to a client, when various tests including a load test, a performance test, and a functional test are performed on the web application system built in Java, data modification occurs in the linked database system. If the interlocked database system is linked with another system, and the database system is under load, when the other interlocked system is difficult to operate, the interlocked database system is not generated. The system and method for generating a load only to the system implemented by a Java agent target system is needed.

In addition, in more detail, taking an example of interworking with a system that processes a specific logic including an ERP system, a CRM system, and a middleware system, the test target system is composed of a web application built in Java, and the web application. In order to process the client's request, the method of the class communicating with the interlocked systems to deliver the results to the client, the various tests including load test, performance test, functional test to build in the Java When performing on the linked web application system, data modification of the linked systems should not occur, or the linked systems are linked with another system, and if the linked systems are under load, the operation of the other linked system is stopped. In case of difficulty, load is generated on the linked systems There is a need for a system and method for generating a load only on a system implemented in Java, which is the system under test.

In addition, in more detail, taking an example of interworking with an external system, the test target system is composed of a web application built in Java, and the web application communicates with the interworking external system to process a client request. When calling a method of a class to deliver a result to a client, when performing various tests including a load test, a performance test, and a functional test to the web application system built in Java, the data of the linked external system is modified. This should not occur, or if the interlocked external system is linked with another system, if the linked external system receives a load, it may not generate a load on the interlocked external system when the operation of the other interlocked system is difficult. Implemented in Java, the system under test Only systems need a system and method of generating load.

As described above, when the system under test is interlocked with other systems, and the interlocked systems should not generate a load, various tests including a load test, a performance test, and a functional test cannot be performed, or a program In most cases, only a limited test is performed by modifying the source. In this case, there is a need for a method and system for generating a load only on the system under test without generating a load on the interlocked systems.

Java Byte Code Instrumentation (BCI) programs include Apache BCEL, JBoss Javassist, and Object Web ASM.

The present invention has been made to solve the above problems, the object of the present invention when performing a variety of tests, including load test, performance test, functional test, when the test target system is linked with other systems, The interlocked systems provide a system and a method for generating a load only to the system under test without generating a load.

In order to achieve the above object, the present invention, a byte code instrumentation (BCI) program, a simulator manager (Simulator Manager) and a JSP (Java Server Page) program or Servlet program used to deliver user configuration information to the simulator manager and It is characterized in that it comprises a simulator handler (Simulator Handler) in charge of the processing of the modified method in charge of interworking with the external system.

Specifically, the BCI program includes a means for modifying a method of a class previously designated by a user in charge of communicating with the interworking systems, and the simulator manager includes a target class designated by a user from a JSP (or Servlet) and a user; Method name, process time, method return variable type, default method return value, method input value and method return value for input value, whether or not to perform the original code of the method, method of the class in charge of interworking with the external system The maximum number of executions per second, the inspection cycle used to periodically check the maximum number of executions per second when the maximum number of executions per second is not greater than the maximum number of executions per second, parameter type of input data, input data The data file that can be returned by selecting the return value according to the value of And means for reading the data file, wherein the simulator handler includes means for processing the instrumented method according to a condition set in the simulator manager.

As described above, according to the present invention, when performing various tests including a load test, a performance test and a functional test, the load is generated only to the test target system without generating a load to the linked systems. The system can be operated normally, and various tests can be performed without modifying important data of interlocked systems. In addition, when using the BCI program 50 provides a method and system for performing the tests without changing the source of the program of the system under test.

Preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. 1 is a Java virtual machine, a simulator manager, a simulator handler, a JSP (Servlet) program, an input / output (I / O) data file, configuration information, a BCI program, an instrument information file, and an instrument target class (A. class), using methods of instrumented target class and web browser, when performing various tests including load test, performance test, and functional test, the system linked with the system under test does not generate a load. This is a block diagram showing the general configuration of a system that can generate a load only on the system under test.

As shown in FIG. 1, the overall configuration of the system that generates a load only on the system under test without generating a load on the interlocked system according to the present invention includes a Java virtual machine 10, a simulator handler 20, and a simulator manager. 30, the input / output (I / O) data file 31 and the setting information 32, and setting information 32 including the name of the input / output (I / O) data file from the user using the web browser 70, JSP (Servlet) program 40 and interworking systems 80 that serve to deliver to the simulator manager 30, that is, the database system 81, a system for processing a specific logic 82, external interworking system 83 The BCI program 50 for instrumenting a method of a specific class in charge of interworking with the information, the information file 51 for a specific class and a specific method targeted by the instrument used by the BCI program 50, and the Instru of the BCI program 50 The ment target class file 52 and the method 53 in which the BCI program 50 is instrumented.

The Java virtual machine 10 supports the J2EE standard, the JSP (Serlvet) program 40 supports the J2EE standard, and includes means for conveying conditions set by the user to the simulator manager 30, The simulator manager 30 receives user setting information from the JSP (Servlet) program 40 and stores and stores the user setting information in the setting information 32 and input / output (I / O) among the user setting information 32. A query means for the data file 31, wherein the simulator handler 20 uses the simulator manager 30 to set setting information 32 and input / output (I / O) data files 31 set by the user. Means for retrieving the data, and means for processing according to the information 32 set by the user, wherein the BCI program 50 includes the instrument means for the Java class and the target class according to the Instruemt information file 51.And it means to instrument the sword 52.

When performing various tests including a load test, a performance test, and a functional test using FIG. 1, a method of generating a load only on the test target system without generating a load on the systems connected to the test target system in detail. In other words, when the user describes the information on the instrument target class in the instrument information file 51, the BCI program 50 may refer to the instrument information file 51 and the instrument class 52 to the Java virtual machine. When loading ③ The method of the Instrument target class 52 is modified to load the Java virtual machine 10. ④ The user transfers user setting information to the JSP (Servlet) program 40 by using a program that supports HTTP communication including a web browser 70. ⑤ The JSP (Servlet) 40 program delivers the received user setting information to the simulator manager 30. ⑥ The simulator manager 30 stores the received setting information in the setting information 32 data structure. ⑦ Meanwhile, the client program 60 generating the load requests the web application 61 to perform the method 53 of the instrumented class. ⑧ The called method 53 does not execute the original code before being instrumented, but uses the simulator handler 20 to perform the execution according to the simulator manager 30 and setting information 32 preset by the user. In particular, when the processing method of the method 53 is set to process according to the input / output (I / O) data file 31, the processing is referred to with reference to the input / output (I / O) data file 31. The web application 61 receives the processing result of the requested method 53 and delivers the result to the client program 60 that generates the load. ⑫ At this time, communication with the interworking system requested in the original method of the instrumented method is processed according to the setting information 32.

Referring to FIG. 2, a method in which the user sets the setting information 32 to the simulator manager 30 using the web browser 70 and the JSP (Servlet) program 40 will be described in detail. The details of the query string delivered to the program 40 are as follows.

Pass the instrument target class and method name to method_name (321). For example, to set the doTest method of the Manager class in the com.strbus package, set com.strobus.Manager.doTest, and in the case of ASP, pass it as the program name and method name. The parameter type of the method is transmitted to i_type 322 to set the input parameter type of the target method. That is, the input parameter type supports Java primitive types including string, int, long, byte, float, char, and void, and an array of primitive types. Here, the dimension of the array is set by the number of []. For example, int [] [] [] means a three-dimensional array of integer types. The return type of the target method is set in o_type 323 and the contents are set in the same manner as in the aforementioned i_type 322. io_mehthod (324) to process the selection method of the return data for the input data of the method in accordance with the pre-generated input / output (I / O) data file 31, JSP (Servlet) program (40) Set whether to process using the set values. The setting value is set to the value of file or value, and in the case of file, it is processed according to the input / output (I / O) data file 31, and in case of value, i_vlaue 325, o_value (326) and o_value_default ( 327). A default return value is set in o_value_default (327). When an input parameter value satisfying the input value is input in i_value (325), the value set in o_value (326) is returned. The use of i_vlaue 325, o_value 326 and o_value_default 327 is used only when the above-mentioned value of io_method is set to value. For example, the processing of the set values of the i_vlaue 325 and the o_value 326 will be described in detail. When i_value = * is set and o_value = 1 is set, the method 53 is related to the input value when the method 53 is called. If the return value is set to 1, o_value_default = -1, i_value = 1 is set, and o_value = 2 is set, when the method 53 is called, it returns 2 only if the input value is 1. In all other cases, the setting returns -1. The io_data_file 328 is used when the above-described io_method 324 is set to file. The file name set by the io_data_file 328 is read by the simulator manager 30 and transferred to the simulator handler 20 to be processed according to the setting information 32. do. The processing time of the method 53 is determined according to the value set in the process_time 329. The simulator handler 20 returns the set return value when the set processing time passes. The max_tps 32A is set to the maximum number of processes per second of the method 53, and the simulator handler 20 performs the time set in the lookup_unit_time 32B when the number of processes per second of the method 53 becomes larger than max_tps. Periodically, the number of processes per second of the method 53 is checked to process when the number is less than max_tps. A value of y or n is set in process_origin 32C, and if this value is y, the simulator handler 20 executes the process according to the setting information 32 set by the user after executing the original code of the method 53. In the case of n, the original code of the method 53 is not executed but is processed according to the setting information 32 set by the user.

3, when the simulator handler 20 processes the value of the input value and the return value stored in the io_data_file 328 when the value of the io_method 324 is set to file among the setting information 32. In more detail,

Input / output (I / O) data file 31 is a file using a tab character or a comma character as a delimiter, and the first line 311 stores values distinguishing input parameters and return parameters. . Specifically, when there are k input parameters, I1, I2, I3,... , Ik and set it as one output parameter. In the case of the second row 312, it is set to set all return data to 1 regardless of the input data value. In the case of the third row 313, when the first input parameter value is 1, the second input parameter value is 2, and the kth input parameter value is 3, the setting returns 'a'. Referring to the case of the fourth row 314, the setting returns 'A' when the first input parameter value is 4, the second input parameter value is 5, and the kth input parameter value is 6. In the case of Fig. 3, all other cases that do not satisfy the input parameter values of the third (313) and fourth (314) rows are set to be processed according to the conditions of the second (312) rows.

In the case where the values of the input parameter and the return parameter are arrays, a method of setting data values is described in detail as described above in the case of non-arrays, and in the case of arrays, the parenthesis '{}' character and the comma character. Use to set. For example, an integer one-dimensional array represented by int [] is used as {1,2,3} to represent int [3], and an integer two-dimensional array represented by int [] [] is represented by {{1, 2,3}, {1,2,3}} to represent int [2] [3]. The other types represent arrays in the same way.

Using this method, loads can be generated only on the system under test without generating loads on the interlocked systems in various tests including load tests, performance tests, and functional tests. In addition, the max_tps 31A can be used to simulate the maximum performance of the interlocked systems so that various tests closer to the actual situation can be performed.

The present invention is not limited to the above-described embodiments, but can be applied in various ways within the scope of the technical idea of the present invention. For example, if the Java virtual machine 10, as well as the compiled code (Byte Code or pseudo byte code) is used and there is a means to modify the code to change the execution code of a particular method, other than the Java virtual machine It can be applied to byte code-based systems, and even in script-based languages such as ASP (Microsoft's Active Server Page), users can use the program directly without using BCI program 50. ) Directly, and when the user delivers the setting information 32 to the simulator manager 30, it is possible to apply the same by using the ASP. In addition, it is possible to apply regardless of the communication protocol of the interlocking system.

1 is a diagram illustrating a linked database system, an external system, and specific logic using a BCI program, a simulator manager, a simulator handler, a JSP (or servlet), an input / output (I / O) data file, and configuration information according to the present invention. It is a block diagram showing a general configuration of a system that can generate a load only on a target Java system without putting a load on a separate system.

 <Description of Symbols for Main Parts of Drawings>

10. Java Virtual Machine

20. Simulator Handler

30. Simulator Manager

31 I / O Data File 32. Configuration Information

40. JSP (or Servlet) program or ASP program

50. Byte Code Instrumentation Program

51.Instrument Information File

52. Instrument target class

53.Instrumented Methods

60. Client Program

61. Web Applications

70. Web browser

80. Interlock system

81. Database system

82. Systems Handling Specific Logic

83. External Systems

2 is a diagram illustrating configuration information received by a simulator manager from a user using a JSP (or servlet) program according to the present invention.

<Description of Symbols for Main Parts of Drawings>

32. User configuration data information (received by JSP, Servlet or ASP)

321. Name of Instrument target class and method

322. Input Parameter Types of Instrumet Target Methods

323. Return Data Types of Instrument Target Methods

324. Policies to Select Return Values for Inputs to Instrument Target Methods

325. Input Value of Instrument Target Method

326. Return Values of Instrument Target Methods

327. Default Return Value of Instrument Target Method

328. I / O data file name to be used when I / O policy of instrument target method is file

329. Virtual Processing Time for Instrumented Methods

32A. Maximum number of operations per second for instrumented methods

32B. The cycle to use when checking max_tps on instrumented methods

32C. Whether to run the original code of the Instrument target method

FIG. 3 is a diagram representing input and return data information files of methods used by a simulator handler in processing an instrumented method according to the present invention.

<Description of Symbols for Main Parts of Drawings>

31. I / O data file (lower line conditions take precedence over upper line conditions)

311.Separation line for input and return parameters (I1: 1th input parameter, O: return)

312. Setting the same return value regardless of the value of the input

313. Set return value for input value

314. Set return value for input

Claims (4)

When performing various tests including a load test, a performance test, and a functional test, a method of generating a load only on the test target system without generating a load on the systems connected to the test target system, Using a BCI program, modifying a method of a target class that communicates with interworking systems using predetermined instrument information so that a user preset code is executed; Delivering user setting information to a simulator manager using a web browser and a JSP (or Servlet) program; Storing setting information received by the simulator manager; Using the client program, performing the various tests on the web application of the system under test; The web application invoking a method of the instrumented class for communication with a coordinated system; The method of the instrumented class does not execute the original code, but instead executes the modified code; When executing the modified code, processing the simulator according to the set configuration information using a simulator handler; When processing according to the set setting information (A) ensuring the processing time of the modified method; (B) ensuring a maximum number of treatments per second of the modified method; (C) using the cycle time used to examine the maximum number of treatments per second of the modified method; (D) selecting and processing a method for returning the modified method data according to a setting value and the contents of an input / output (I / O) data file separate from the method; (E) if it is set to return according to a setting value when returning the data of the modified method, processing the default value of return data, a specific input value, and a return data value; (F) When the data of the modified method is set to return according to the value set in the separate I / O data file, the separate I / O data file is read to the set value. Therefore, processing the return data value (G) processing according to the execution of the original code before the modified method is instrumented, Returning the processed data to the web application according to each step of (a) to (g) so that the final response data is delivered to the client program generating the load. A method of generating a load only on a system under test without generating a load on interlocked systems When performing various tests including a load test, a performance test, and a functional test, a method of generating a load only on the test target system without generating a load on the systems connected to the test target system, If the system under test is developed as a Microsoft Active Server Page (ASP), the method of the ASP program communicating with the interworking systems is directly modified so that the user-defined code is executed instead of the original code of the method. Steps, Delivering user setting information to a simulator manager using a web browser and an ASP program; The simulator manager storing the received setting information; Performing the various tests on a web application (ASP) of a system under test using a client program, Calling, by the web application, a method of the modified ASP program for communication with a coordinated system; The method of the modified ASP program does not execute the original code, but instead executes the modified code, Processing the modified code according to the set configuration information using a simulator handler; When processing according to the set setting information (A) ensuring the processing time of the modified method; (B) ensuring a maximum number of treatments per second of the modified method; (C) using the cycle time used to examine the maximum number of treatments per second of the modified method; (D) selecting and processing a method for returning the modified method data according to a setting value and the contents of an input / output (I / O) data file separate from the method; (E) if it is set to return according to a setting value when returning the data of the modified method, processing the default value of return data, a specific input value, and a return data value; (F) When the data of the modified method is set to return according to the value set in the separate I / O data file, the separate I / O data file is read to the set value. Therefore, processing the return data value The modified method returns data processed according to each step of (a) to (bar) to the web application (ASP) so that the final response data is delivered to the client program generating the load. A method of generating a load only on a system under test without generating a load on interlocked systems Including a simulator handler 20, a simulator manager 30, a JSP (Servlet) program 40, and a BCI program 50, The BCI program 50 loads the instrument target class 52 according to the contents of the Instrument information file 51 set by the user, and modifies the target method to replace the original code of the method. Means for enabling the execution of predetermined code in The JSP (Servlet) program 40 includes means for transferring setting information 32 from the user to the simulator manager 30, The simulator manager 30 (A) means for receiving and storing the user setting information 32 from the JSP (Servlet) program 40, (B) means for reading and decoding the input / output (I / O) data file 31 when the simulator handler processes the instrumented method using the setting information 32, The simulator handler 20 uses the simulator manager 30 according to the configuration information 32 when the web application 61 receives a load from the client program 60 and requests a modified method 53. So (A) means for ensuring the processing time of the modified method; (B) means for ensuring the maximum number of treatments per second of the modified method; (C) means for using the cycle time used to examine the maximum number of treatments per second of the modified method; (D) means for processing by selecting from among methods for returning according to the setting value and the contents of an input / output (I / O) data file when returning the modified method data; (E) a means for processing the default value of the return data, a specific input value, and a return data value when the modified method is set to return according to a setting value when returning the data of the modified method; (F) When the data of the modified method is set to return according to the value set in the separate I / O data file, the separate I / O data file is read to the set value. Thus means for handling the return data value, (G) a means for processing in accordance with the execution of the original code prior to instrumentation of the modified method; A system capable of generating a load only on the system under test, without generating a load on interlocked systems, including Including a simulator handler 20, a simulator manager 30, and an ASP program 40, The ASP program 40 includes means for transferring setting information 32 from the user to the simulator manager 30, The simulator manager 30 (A) means for receiving and storing the user setting information 32 from the ASP program 40, (B) means for reading and decoding the input / output (I / O) data file 31 when the simulator handler processes the method directly modified by the user using the setting information 32, The simulator handler 20 uses the simulator manager 30 according to the configuration information 32 when the web application 61 receives a load from the client program 60 and requests a modified method 53. So (A) means for ensuring the processing time of the modified method; (B) means for ensuring the maximum number of treatments per second of the modified method; (C) means for using the cycle time used to examine the maximum number of treatments per second of the modified method; (D) means for processing by selecting from among methods for returning according to the setting value and the contents of an input / output (I / O) data file when returning the modified method data; (E) a means for processing the default value of the return data, a specific input value, and a return data value when the modified method is set to return according to a setting value when returning the data of the modified method; (F) When the data of the modified method is set to return according to the value set in the separate I / O data file, the separate I / O data file is read to the set value. Therefore, the means of handling the return data value Characterized in that it comprises A system that can generate a load only on the system under test without generating a load on interlocked systems.

Images