WO2024117384A1

WO2024117384A1 - Test information management method and electronic device for supporting same

Info

Publication number: WO2024117384A1
Application number: PCT/KR2023/001737
Authority: WO
Inventors: 린유안; 선웨이; 랴오수; 종칭양; 공시웨이
Original assignee: 쿠팡 주식회사
Priority date: 2022-11-29
Filing date: 2023-02-07
Publication date: 2024-06-06

Abstract

Disclosed is a test information management method by which an electronic device manages test information, comprising the steps of: transferring request information based on first test case information to a service server related to a service provided on the basis of an application; generating, on the basis of first response information received from the service server according to the request information, first mock data information corresponding to the first test case information; and acquiring first reference data information on the basis of first output information that is output as the result of executing first code information on the basis of the first test case information and the first mock data information.

Description

Test information management method and electronic devices that support it

The present invention relates to an electronic device and a method for managing test information, and more specifically, to an electronic device and a method for performing a unit test of an application based on mock data information. .

With the development of electronic technology, consumers of e-commerce services can search for and purchase items using applications installed on their terminals, and each service provider is managing its own applications. Consumers can purchase items online using applications provided by each service provider, and the rate of purchasing items online is gradually increasing.

During the development process to update existing functions of these applications or add new functions, various data used in actual services may be used to test whether the updated or added functions are operated properly. However, when using data based on an actual service, there is a possibility that the ideal situation for testing may differ depending on the current state of the service, and the data used to provide the actual service may change during the testing process or may affect the traffic of the actual service. This may lead to instability in service provision. However, if you try to intentionally generate data, the efficiency of test progress may be very low as data suitable for various test situations must be generated one by one.

Therefore, there is a need for technology that improves the convenience of developers who develop and manage applications and minimizes the impact of testing on services.

According to the method of the present invention, an electronic device can manage test information.

The technical problems to be achieved in the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art from the description below. You will be able to.

Various embodiments may provide a method for an electronic device to manage test information and an electronic device that supports the same.

An electronic device according to various embodiments disclosed in this document may include a method for managing test information, comprising: transmitting request information based on first test case information to a service server related to a service provided based on an application; generating first subject data (mock data) information corresponding to the first test case information based on first response information received from the service server in response to the request information; It may include obtaining first reference data information based on first output information, which is output as a result of executing first code information based on the first test case information and the first data information.

In an embodiment, the method of managing the test information may include obtaining the first reference data information based on information regarding whether the first output information is verified.

In an embodiment, the test information management method includes: confirming the first subject data information based on the first test case information; and confirming second output information output as a result of executing second code information based on the first test case information and the first data information.

In an embodiment, the second code information may include code information that changes at least part of the first code information.

In an embodiment, the test information management method may further include confirming comparison information obtained based on the first reference data information and the second output information.

In an embodiment, the comparison information may include information about the difference between the first reference data information and the second output information.

In an embodiment, the test information management method may further include obtaining second reference data corresponding to the second output information based on information regarding whether the second output information is verified.

In an embodiment, information regarding whether the second output information is verified may be confirmed based on comparison information corresponding to the first reference data information and the second output information.

In an embodiment, changed first output information is output as a result of executing the first code information based on the changed first test case information and the first item data information, in which the first test case information is at least partially changed. Confirming; And it may further include confirming the changed first reference data information based on a comparison of the changed first output information and the first output information.

In an embodiment, the first test case information may include one or more request parameters related to the request, and the first subject data information may include one or more response parameters corresponding to the one or more requests.

In an embodiment, the first subject data information may include subject data identification information corresponding to the first test case information.

In an embodiment, the first reference data information may include reference data identification information corresponding to the first test case information.

In an embodiment, the first code information may include at least part of code information regarding one or more functions provided by the application.

Electronic devices according to various embodiments disclosed in this document include a transceiver; storage; and a processor, wherein the processor transmits request information based on first test case information to a service server related to a service provided based on an application, and receives a first response from the service server in response to the request information. A result of generating first item data (mock data) information corresponding to the first test case information based on the information, and executing the first code information based on the first test case information and the first data information It can be set to obtain first reference data information based on the first output information, which is output as .

According to the method of the present invention, an electronic device can test developed functions by minimizing the load on the service being provided.

According to the method of the present invention, an electronic device can perform stable testing by minimizing dependency on the system environment of the service being provided.

According to the method of the present invention, an electronic device can provide an independent test environment for each developed function.

According to the method of the present invention, an electronic device can provide a plug-in that supports various test methods according to the development environment.

The effects that can be obtained from the present invention are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the description below. will be.

FIG. 1 is a diagram illustrating a test information management system in which a method of managing test information by an electronic device can be implemented according to various embodiments.

FIG. 2 is a diagram illustrating the configuration of an electronic device, an operator device, and a service server according to various embodiments.

Figure 3 is a flowchart of an operation in which an electronic device acquires reference data information according to various embodiments.

Figure 4 is a flowchart of an operation in which an electronic device acquires comparison information according to various embodiments.

FIG. 5 is a flowchart of an operation in which an electronic device checks changed reference data information according to various embodiments.

FIG. 6 is a diagram illustrating a process in which an electronic device manages test information according to an embodiment.

FIG. 7 is a diagram for explaining the functional configuration of an electronic device according to an embodiment.

The following embodiments combine components and features of various embodiments in a predetermined form. Each component or feature may be considered optional unless explicitly stated otherwise. Each component or feature may be implemented in a form that is not combined with other components or features. Additionally, various embodiments may be configured by combining some components and features. The order of operations described in various embodiments may change. Some features or features of one embodiment may be included in other embodiments or may be replaced with corresponding features or features of other embodiments.

In the description of the drawings, procedures or steps that may obscure the gist of the various embodiments are not described, and procedures or steps that can be understood at the level of a person with ordinary knowledge in the relevant technical field are not described. did.

Throughout the specification, when a part is said to “comprise or include” a certain element, this means that it does not exclude other elements but may further include other elements, unless specifically stated to the contrary. do. In addition, terms such as "... unit", "... unit", and "module" used in the specification refer to a unit that processes at least one function or operation, which refers to hardware, software, or a combination of hardware and software. It can be implemented as: Additionally, the terms “a or an,” “one,” “the,” and similar related terms are used herein in the context of describing various embodiments (particularly in the context of the claims below). Unless otherwise indicated or clearly contradicted by context, it may be used in both singular and plural terms.

Hereinafter, preferred embodiments according to various embodiments will be described in detail with reference to the attached drawings. The detailed description set forth below in conjunction with the accompanying drawings is intended to illustrate exemplary embodiments of various embodiments and is not intended to represent the only embodiment.

In addition, specific terms used in various embodiments are provided to aid understanding of the various embodiments, and the use of such specific terms may be changed to other forms without departing from the technical spirit of the various embodiments. .

At this time, it will be understood that each block of the processing flow diagram diagrams and combinations of the flow diagram diagrams can be performed by computer program instructions. These computer program instructions can be mounted on a processor of a general-purpose computer, special-purpose computer, or other programmable data processing equipment, so that the instructions performed through the processor of the computer or other programmable data processing equipment are described in the flow chart block(s). It creates the means to perform functions. These computer program instructions may also be stored in computer-usable or computer-readable memory that can be directed to a computer or other programmable data processing equipment to implement a function in a particular manner, so that the computer-usable or computer-readable memory The instructions stored in may also produce manufactured items containing instruction means that perform the functions described in the flow diagram block(s). Computer program instructions can also be mounted on a computer or other programmable data processing equipment, so that a series of operational steps are performed on the computer or other programmable data processing equipment to create a process that is executed by the computer, thereby generating a process that is executed by the computer or other programmable data processing equipment. Instructions that perform processing equipment may also provide steps for executing the functions described in the flow diagram block(s).

Additionally, each block may represent a module, segment, or portion of code that includes one or more executable instructions for executing specified logical function(s). Additionally, it should be noted that in some alternative execution examples it is possible for the functions mentioned in the blocks to occur out of order. For example, it is possible for two blocks shown in succession to be performed substantially at the same time, or it is possible for the blocks to be performed in reverse order depending on the corresponding function.

FIG. 1 is a diagram illustrating a test information management system 100 in which a method performed by an electronic device can be implemented according to various embodiments.

Referring to FIG. 1, a test information management system 100 according to various embodiments may be implemented in various types of devices. For example, the test information management system 100 may be implemented in the electronic device 101, the operator device 102, and the service server 103. In other words, the electronic device 101, the operator device 102, and the service server 103 perform operations according to various embodiments of the present disclosure based on the test information management system 100 implemented in each device. can do. Meanwhile, the test information management system 100 according to various embodiments is not limited to what is shown in FIG. 1, and may be implemented in a wider variety of electronic devices and servers.

The electronic device 101 according to various embodiments may be a device that performs wireless and wired communication with one or more worker devices 102 and the service server 103 and includes storage with a large storage capacity. For example, the electronic device 101 may be a cloud device connected to one or more worker devices 102.

The worker device 102 according to various embodiments may be a device that can be used by an individual user, such as a desktop PC, tablet PC, or mobile terminal. In addition, other electronic devices that perform similar functions may be used as the operator device 102.

The test information management system 100 according to various embodiments may include various modules for operation. Modules included in the test information management system 100 enable a physical device (e.g., electronic device 101) on which the test information management system 100 is implemented (or included in the physical device) to perform a specified operation. It may be implemented computer code or one or more instructions. In other words, the physical device on which the test information management system 100 is implemented stores a plurality of modules in the memory in the form of computer code, and when the plurality of modules stored in the memory are executed, the physical device is a plurality of modules. It is possible to perform designated operations corresponding to .

The electronic device 101, operator device 102, and service server 103 of the test information management system 100 may each include a transceiver, memory (storage), and processor. In addition, the electronic device 101, the operator device 102, and the service server 103 each refer to a unit that processes at least one function or operation, which may be implemented through hardware, software, or a combination of hardware and software. You can.

Meanwhile, throughout the embodiment, the electronic device 101, the operator device 102, and the service server 103 are referred to as separate devices and servers, but this may be a logically divided structure, and functions are separated from one device or server. It can be implemented by . For example, at least some of the operator device 102 and the service server 103 may be included in the electronic device 101 or may be combined with the electronic device 101 to form an integrated unit. However, even in this case, a series of test information management methods performed by data transmission and reception between the electronic device 101, the operator device 102, and the service server 103 can be performed similarly. In the case of a device included in or integrated with the electronic device 101, communication with the electronic device 101 occurs within the device and between its components (e.g., the processor of the electronic device 101). Wow) It can be understood as a process of exchanging data.

Hereinafter, for convenience of explanation, embodiments in which the worker device 102 and the service server 103 exist as devices or servers separate from the electronic device 101 will be described. However, the following description only describes the worker device 102 and the service server 103. This may also apply when at least part of the server 103 is included in the electronic device 101 or is integrated with the electronic device 101.

According to one embodiment, the electronic device 101, the operator device 102, and the service server 103 may include a plurality of computer systems or computer software implemented as network servers. For example, at least some of the electronic device 101, worker device 102, and service server 103 are connected to subordinate devices that can communicate with other network servers through a computer network such as an intranet or the Internet to request performance of a task. It can refer to a computer system and computer software that receives information, performs work on it, and provides performance results. In addition, at least some of the electronic device 101, operator device 102, and service server 103 are a broad concept that includes a series of application programs that can operate on a network server and various databases built therein. It can be understood. For example, at least some of the electronic device 101, worker device 102, and service server 103 may run DOS, Windows, Linux, UNIX, or MacOS, etc. It can be implemented using various network server programs provided depending on the operating system.

Referring to Figure 2, the electronic device 101, the operator device 102, and the service server 103 may include an input/output unit 210, a communication unit 220, a storage 230, and a processor 240. there is.

The input/output unit 210 may be various interfaces or connection ports that receive user input or output information to the user. The input/output unit 210 may include an input module and an output module, and the input module receives user input from the user. User input can take various forms, including key input, touch input, and voice input. Examples of input modules that can receive such user input include traditional keypads, keyboards, and mice, as well as touch sensors that detect the user's touch, microphones that receive voice signals, cameras that recognize gestures through image recognition, etc. A proximity sensor including at least one of an illumination sensor or an infrared sensor that detects user approach, a motion sensor that recognizes user movement through an acceleration sensor or gyro sensor, and various other types of sensors that detect or receive user input. There is an input means, and the input module according to an embodiment of the present disclosure may include at least one of the devices listed above. Here, the touch sensor may be implemented as a piezoelectric or capacitive touch sensor that detects touch through a touch panel or touch film attached to the display panel, or an optical touch sensor that detects touch by an optical method. In addition, the input module may be implemented in the form of an input interface (USB port, PS/2 port, etc.) that connects an external input device that receives user input instead of a device that detects user input itself. Additionally, the output module can output various information. The output module may include at least one of a display that outputs an image, a speaker that outputs sound, a haptic device that generates vibration, and other various types of output means. In addition, the output module may be implemented in the form of a port-type output interface that connects the individual output means described above.

As an example, a display-type output module can display text, still images, and moving images. Displays include liquid crystal display (LCD), light emitting diode (LED) display, organic light emitting diode (OLED) display, flat panel display (FPD), and transparent display. Among various types of devices that can perform image output functions such as display, curved display, flexible display, 3D display, holographic display, projector, and other It can contain at least one. This display may be in the form of a touch display integrated with the touch sensor of the input module.

The communication unit 220 can communicate with other devices. Accordingly, the electronic device 101, the operator device 102, and the service server 103 can transmit and receive information with other devices through the communication unit. For example, the electronic device 101, the operator device 102, and the service server 103 may communicate with each other or with other devices using a communication unit.

Here, communication, that is, transmission and reception of data, can be accomplished wired or wirelessly. For this purpose, the communication department includes a wired communication module that connects to the Internet through a LAN (Local Area Network), a mobile communication module that transmits and receives data by connecting to a mobile communication network through a mobile communication base station, and a WLAN (Wireless Local Area Network) such as Wi-Fi. A short-distance communication module using an Area Network-type communication method or a WPAN (Wireless Personal Area Network)-type communication method such as Bluetooth or Zigbee, and a GNSS (Global Navigation Satellite System) such as a GPS (Global Positioning System) ) may be composed of a satellite communication module using a satellite communication module or a combination thereof.

Storage 230 can store various types of information. Storage can store data temporarily or semi-permanently. For example, the storage of the electronic device 101 includes an operating program (OS: Operating System) for driving the electronic device 101, a program for generating data or Braille for hosting a website, or an application (e.g., Data related to web applications) may be stored. Additionally, the storage may store modules in the form of computer code as described above.

Examples of storage 230 include hard disk drive (HDD), solid state drive (SSD), flash memory, read-only memory (ROM), random access memory (RAM), etc. This can be. This storage can be provided as a built-in or detachable type.

The processor 240 controls the overall operation of the electronic device 101, the operator device 102, and the service server 103. To this end, the processor 240 can perform computation and processing of various information and control the operation of components of the electronic device 101. For example, the processor 240 may execute a program or application for managing test information. The processor 240 may be implemented as a computer or similar device using hardware, software, or a combination thereof. In hardware, the processor 240 may be implemented in the form of an electronic circuit that processes electrical signals to perform a control function, and in software, it may be implemented in the form of a program that drives the hardware processor 240. Meanwhile, unless otherwise specified in the following description, the operations of the electronic device 101, operator device 102, and service server 103 may be interpreted as being performed under the control of the processor 240. That is, when the modules implemented in the test information management system 100 described above are executed, the processor 240 performs the following operations on the electronic device 101, the operator device 102, and the service server 103. It can be interpreted as controlling to do so.

In summary, various embodiments may be implemented through various means. For example, various embodiments may be implemented by hardware, firmware, software, or a combination thereof.

In the case of hardware implementation, methods according to various embodiments include one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), and FPGAs. It can be implemented by (field programmable gate arrays), processor, controller, microcontroller, microprocessor, etc.

In the case of implementation by firmware or software, methods according to various embodiments may be implemented in the form of modules, procedures, or functions that perform the functions or operations described below. For example, software code can be stored in memory and run by a processor. The memory may be located inside or outside the processor, and may exchange data with the processor through various known means.

Below, various embodiments will be described in more detail based on the above technical idea. The contents described above may be applied to various embodiments described below. For example, operations, functions, terms, etc. that are not defined in various embodiments described below may be performed and explained based on the contents described above.

In the following description, various embodiments are described on the premise that the electronic device 101 performs a test information management operation. According to various embodiments, the electronic device 101 provides information related to the test information management operation to the operator. It can transmit and receive information with the device 102 and the service server 103.

According to various embodiments, the electronic device 101 may transmit request information to the service server 103 (S301). Request information may include information about one or more requests confirmed based on test case information. Test case information may include information about one or more user operations for testing an application that provides services according to various embodiments of the present invention. A test case may include information about user actions related to the function being tested. The function to be tested may include some functions provided by the application and may be understood as corresponding to at least a portion of one or more code information included in the application. The function to be tested may be a function corresponding to the first code information. For example, the function to be tested may be a function that provides a detailed information page for a product, and the first code information is one or more logical information and operations that enable the service server 103 to perform an operation to provide a detailed information page for the product. May contain information or algorithms. For one test target function, one or more test cases may correspond. Each test case can express a specific user's operation by varying one or more parameters corresponding to the first code information. For example, the first test case and the second test case may be cases in which different product price information is provided depending on the different membership status of the user requesting the product detailed information page. Test case information may include one or more request information corresponding to the function being tested. The test case information may correspond to one or more request information requesting the return of data to the service server 103 in response to the test case. For example, the electronic device 101 may request information about the user's membership status and product information from the service server 103 in response to test case information. At this time, the request information may include one or more parameters and information about the request operation. For example, the request information may include user identification information and product identification information as request parameters, and may include information about the operation of requesting information about one or more response parameters confirmed based on the request parameters. . Request information may include API (application programming interface) data. According to one embodiment, the request information may include one or more request parameters and address information (eg, url information) corresponding to test case information. Address information may correspond to information about specific request operations. In one embodiment, the request information may include one or more API data related to the functionality of the test case. For example, test case information may include information about an operation in which a user with a specific membership status requests a detailed information page for a specific product. Since different response parameters can be requested from the service server 103 based on the same request parameter, the response parameter can be determined based on information about the requested operation. At this time, the request information corresponding to the test case information may include API data including user identification information as a parameter. The electronic device 101 may receive response information corresponding to the request information, for example, information about user membership status, from the service server 103 based on the request information. Additionally, request information corresponding to test case information may include API data including product identification information as a parameter. Based on the request information, the electronic device 101 receives response information corresponding to the request information from the service server 103, that is, information about specific data to be included in the product detailed information page, such as information about the price of the product, membership of the product. You can receive information about discount rates by status.

According to various embodiments, the electronic device 101 may generate mock data information based on response information (S302). The electronic device 101 may generate mock data information based on response information confirmed based on the request information. The response information may include one or more pieces of information received from the service server 103 in response to the request information. In one embodiment, the response information may include one or more information returned by the service server 103 corresponding to the API data. The service server 103 may include a database, and may check one or more data to be included in response information from the database based on one or more operations and request information of a service currently being provided. The service server 103 may receive request information from the electronic device 101 and return response information corresponding to the request information to the electronic device 101. The electronic device 101 may generate mock data information based on the response information. The mock data information may include one or more data related to the test function. The mock data information may include response information corresponding to the request information. In an embodiment, the mock data information may be understood as a sample corresponding to the response of the service server 103. The mock data information may include one or more response parameters included in the response information. Response parameters are one or more specific service-related data corresponding to the request parameters and request operation information, such as product price information, discount rate information, price information by membership status, user information, and user membership status information. May contain related data. The electronic device 101 may store neck data information. The mock data information may correspond to the identification information of the test case. The mock data information may include identification information corresponding to the identification information of the test case.

According to various embodiments, the electronic device 101 may obtain first reference data information based on the first output information (S303). The electronic device 101 can check the first output information. The output information may include data output as a result of executing the application code based on test case information and mock data information. The application code may include one or more code information (first code) related to the function to be tested, and the electronic device 101 may determine the test target among one or more functions provided by the application based on the first code. The function can be executed. For example, in response to the product detail page output function, which is the function to be tested, the first code calculates the discount price based on user membership status information and product information, and relates to specific application operations that determine the data to be output on the product detail page. May contain information. At this time, the electronic device 101 may execute the first code based on test case information. Test case information may include information about user actions related to the function under test. For example, if the function being tested is a function that prints a product detail page, the test case information may include information about a detail page request for a case where a user with a specific membership status prints a detailed description page of a specific product. You can. The electronic device 101 may check the operation result of the first code corresponding to the test case information. At this time, specific parameter values required for the operation of the first code, such as data on product information and user information, can be obtained based on the neck data information. The electronic device 101 may execute the first code based on test case information and generate output information by reading at least some data of the mock data information to generate an execution result of the first code. Output information may include one or more data to be provided to the user device. Data to be provided to the user device may include components to be rendered to provide a service, for example, data for outputting a page. Output information may include information in HTML format, for example. At this time, during the testing process, the user device may be understood as the worker device 102.

The electronic device 101 may obtain first reference data information based on first output information corresponding to first test case information. The first reference data information may be confirmed based on information regarding whether the first output information is verified. For example, when the first output information outputs a result that matches the function to be tested, the first output information can be verified as an appropriate output, and the electronic device 101 receives information about whether the first output information has been verified. Based on this, the first output information can be stored as first reference data information. The first standard data is information that serves as a standard for checking whether the output information generated as a result of testing the application code in response to later test case information meets the specification standard to be developed. You can. Accordingly, the electronic device 101 can later test the developed application code based on test case information and verify the tested output information without transmitting a request to the service server 103. The electronic device 101 may map the identification information to first reference data in response to the identification information of the first test case information, and store the first reference data information including the identification information corresponding to the first test case information. .

According to various embodiments, the electronic device 101 may check first subject data information based on first test case information (S401). The electronic device 101 may check mock data information corresponding to the first test case based on the identification information of the first test case. The electronic device 101 may read pre-stored first subject data information based on the first test case information.

According to various embodiments, the electronic device 101 may check the second output information based on the second code and first item data information (S402). The second code can be understood as application code. The second code may include application code information corresponding to the function being tested. For example, the second code may be generated by partially changing the first code information or adding some code information to the first code information. The second code can be understood as a code that updates the specific operation code for the function corresponding to the first code. The second code may include a new version of the application code that has been developed. At this time, the first code may be a standard version of the application code for verifying the application function of the new version developed. The electronic device 101 may execute the second code. At this time, the electronic device 101 may execute the second code based on the first test case information and first subject data information. The electronic device 101 may check second output information including data as a result of executing the second code.

According to various embodiments, the electronic device 101 may obtain comparison information based on first reference data information and second output information (S403). In one embodiment, the comparison information may include information regarding the result of comparing the first reference data and the second output information. For example, the comparison information may include information about the difference between the first reference data and the second output information. For example, in the case of first code information, information about an operation to show discount information according to membership status may be included on the product detailed description page, and in the case of second code information, discount information according to membership status may be included. In addition, when information about an operation to show additional discount information that can be received when changing membership status is further included, the comparison information may include information to output additional discount information.

In an embodiment, the electronic device 101 may verify the second code information based on comparison information. For example, the electronic device 101 may verify whether the second code information has been appropriately developed based on the comparison information.

In an embodiment, the electronic device 101 may obtain second reference data based on information regarding whether the second output information is verified. For example, if it is confirmed that the second code information has been appropriately developed based on the information regarding whether the second output information has been verified, the electronic device 101 may use the second code information to create an application code corresponding to the same function in the future. It can be used as a standard for verification. In this case, the electronic device 101 may replace the first reference data with the second reference data based on the second output information. The electronic device 101 may store second reference data information in response to first test case information.

Referring to FIG. 5, operations performed by a series of electronic devices 101 corresponding to a case where the same function is tested but the test case is partially changed can be described.

According to various embodiments, the electronic device 101 may check the changed first output information based on the changed first test case information and first subject data information (S501). The changed first test case information may include information in which at least part of the first test case information has been changed. The electronic device 101 may execute the first code information based on the changed first test case information and first subject data information. At this time, since the function to be tested is in the same situation, the first item data information can be maintained as is, and the electronic device 101 can execute the first code information based on the same first item data information. The electronic device 101 may check the changed first output information that is output as a result of executing the first code information based on the changed first test case information. The changed first output information may include data that is different from the first output information in at least some areas. In an embodiment, the electronic device 101 may generate comparison information between the changed first output information and the first output information.

According to one embodiment, the electronic device 101 may check the changed first reference data based on whether the changed first output information is verified (S502). The electronic device 101 can verify the changed first output information. For example, the electronic device 101 may verify the changed first output information based on comparison information including information about the difference between the first output information and the changed first output information. Based on whether the changed first output information is verified, the electronic device 101 may confirm and/or store the changed first output information corresponding to the changed first test case information as the changed first reference data information. At this time, the changed first test case information may be stored as a replacement for the first test case information, and the changed first test case information may be mapped to identification information corresponding to the test case.

Referring to FIG. 6 , an example of the functional configuration of the electronic device 101 connected to the service environment 10 can be seen. The functional configuration of the electronic device 101 may include one or more software components stored in the memory of the electronic device 101 and instructing each operation of the processor.

According to one embodiment, the service environment 10 may include a service server 103. The service environment 10 may include a network formed between the electronic device 101 and the service server 103. The service environment 10 may include a network between the service server 103 and a user device that receives the service. The service environment 10 may include one or more devices related to services provided to actual users. For example, the service server 103 is a web server that receives one or more requests from the electronic device 101 or a user device, and manages and forwards the request to a web application server and/or It may include a web application server that performs specific service operations of the web application based on requests. The web server is a server that performs static requests, transmits request information received from the user or the electronic device 101 to the web application server, and provides response information generated as the web application server performs service operations based on the request. It may be received from the web application server, and a response corresponding to the request may be provided to the user or the electronic device 101. The web application server performs actions according to the received request based on the request information received from the web server, the application logic included in the web application server, and the code information that embodies the logic, and sends the response generated as a result to the web server. It can be provided as . The web application server may be connected to or include a database containing various specific data required to provide services, process data based on requests, or return data as a result of performing necessary operations as a response.

In an embodiment, the electronic device 101 may include a mock data manager 610. The mock data manager can store and manage the created mock data information. For example, identification information can be given to mock data information, and information about the mapping relationship with test case information corresponding to the mock data identification information can be stored.

In an embodiment, electronic device 101 may include mock data request unit 620. The mock data request unit 620 may provide one or more request information corresponding to a test case to the service environment 10 and generate mock data based on response information received in response. The mock data request unit 620 may generate mock data corresponding to a test case and transmit the generated mock data to the mock data manager, or transmit the mock data to the application 640 when executing the test case.

In embodiments, test case manager 630 may store test case information. The test case information may include test case identification information, and the test case manager 630 may store information about the mapping relationship with reference data information or mock data information corresponding to the test case identification information. The test case manager 630 may provide test case information to the application 640 in relation to the execution of the test case.

In an embodiment, the application 640 may store application code that is subject to verification or is a standard for verification. The application code subject to verification may refer to at least a portion of the application code corresponding to at least one developed or updated function. The application code that serves as the standard for verification may refer to at least a portion of the application code corresponding to the control group in order to verify at least one developed or updated function. The application 640 may store the entire application code for each release version, or may store information about at least some code specifically corresponding to the function subject to verification for each version of each function. The application 640 may store index information about the version of code information stored for each version of the application or function. The application 640 can execute application code in response to a test case and provide output information corresponding to the execution result to the verification manager 650.

In an embodiment, the verification manager 650 may verify output information based on reference data information and output information. The verification manager 650 may receive reference data information from the reference data manager 660, receive output information from the application 640, and generate comparison information regarding comparison between the reference data information and the output information. In one embodiment, the verification manager 650 may request reference data information corresponding to output information from the reference data manager 660. The verification manager 650 may request reference data corresponding to the test case from the reference data manager 650 based on the identification information of the test case corresponding to the output information. The verification manager 650 may provide output information to the reference data manager based on the verification results.

In an embodiment, reference data manager 660 may store reference data information. The reference data manager 660 may store output information as reference data based on a verification result of the output information, or may delete existing reference data and overwrite it with new reference data. The reference data manager 660 may provide reference data information corresponding to a test case to the verification manager 650 based on a request from the verification manager 650. The reference data manager 660 may store information regarding the correspondence between test cases and reference data information.

The electronic device 101 can use the mock data manager and the reference data manager to conduct tests without requesting the service environment 10 for specific data related to service provision that can be obtained from the service environment 10 for each test situation. . The electronic device 101 can generate mock data and reference data based on the received response data by sending only one request to the service environment 10 for each test case, and then as the test progresses, the service environment 10 There is no need to send the same request to . Therefore, through the test information management method for the electronic device 101 disclosed in this document, testing can be carried out stably in a state independent of the service environment 10, and at the same time, data in the same format as the actual service environment can be used for testing. Therefore, the accuracy of the test, the stability of the test results, and the prevention of load due to the test that may affect the service environment (10) can all be expected.

Referring to FIG. 7 , this is a diagram illustrating an example 700 for explaining the functional configuration of the electronic device 101.

The electronic device 101 can be used as a test tool to verify the functionality of an application, and the electronic device 101 can provide operation as a software development kit (SDK). Electronic device 101 may include one or more SDK components. SDK components are functional components and can be understood as software components stored in memory or embodied in the processor. The electronic device 101 includes one or more SDK components, implements test functions by modularizing each SDK component, and can add new test functions or manage or supplement existing test functions for each SDK component, thereby enabling testing. Efficient management of functions and ease of development can be expected. The electronic device 101 can perform various types of tests (AB tests, upstream dependent tests, system time-based tests) using modularized SDK components and generate mock data required for these tests. For example, the electronic device 101 may include an AB test mocking component to perform AB testing and generate mock data to perform AB testing in an environment independent of the service environment 10. . In addition, the electronic device 101 can use a verification component (Golden File Based Verifier) for test results based on reference data to perform tests based on various types of data depending on what type of file the test is to be performed on. there is.

The embodiments of the present invention disclosed in this specification and drawings are merely provided as specific examples to easily explain the technical content of the present invention and to facilitate understanding of the present invention, and are not intended to limit the scope of the present invention. In other words, it is obvious to those skilled in the art that other modifications based on the technical idea of the present invention can be implemented. Additionally, each of the above embodiments can be operated in combination with each other as needed. For example, all embodiments of the present invention can be implemented by a system by combining parts of each other.

Additionally, the method according to the system according to the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium.

As such, various embodiments of the present invention may be implemented as computer readable code on a computer readable recording medium in certain respects. A computer-readable recording medium is any data storage device capable of storing data that can be read by a computer system. Examples of computer readable recording media include read only memory (ROM), random access memory (RAM), and compact disk-read only memory (CD-ROM). ), magnetic tapes, floppy disks, optical data storage devices, and carrier waves (data transmission over the Internet, etc.). Computer-readable recording media may also be distributed across networked computer systems, such that computer-readable code is stored and executed in a distributed manner. Additionally, functional programs, codes, and code segments for achieving various embodiments of the present invention can be easily interpreted by programmers skilled in the field to which the present invention is applied.

Additionally, it will be appreciated that the devices and methods according to various embodiments of the present invention can be implemented in the form of hardware, software, or a combination of hardware and software. Such software may, for example, use any storage device, volatile or non-volatile, such as ROM, whether erasable or rewritable, or memory such as, for example, RAM, memory chips, devices or integrated circuits; Alternatively, it may be stored on a storage medium that is optically or magnetically recordable and readable by a machine (e.g., a computer), for example, a compact disk (CD), DVD, magnetic disk, or magnetic tape. . Methods according to various embodiments of the present invention may be implemented by a computer including a control unit and a memory, or a vehicle including such memory or a computer, and such memory is a program containing instructions that implement the embodiments of the present invention. Alternatively, you can see that it is an example of a machine-readable storage medium suitable for storing programs.

Accordingly, the present invention includes a program containing code for implementing the device or method described in the claims of this specification and a machine-readable storage medium (such as a computer) storing such a program. Additionally, such programs may be transmitted electronically through any medium, such as communication signals transmitted over a wired or wireless connection, and the present invention includes equivalents thereof as appropriate.

Although the present invention has been described above with reference to embodiments of the present invention, the embodiments of the present invention disclosed in the specification and drawings are merely presented as specific examples to easily explain the technical content of the present invention and to aid understanding of the present invention. It is not intended to limit the scope. In addition, the embodiments according to the present invention described above are merely illustrative, and those skilled in the art will understand that various modifications and equivalent scope of embodiments are possible therefrom. Therefore, the true technical protection scope of the present invention should be determined by the following patent claims.

Claims

In a method of managing test information in an electronic device,

transmitting request information based on first test case information to a service server related to a service provided based on the application;

generating first subject data (mock data) information corresponding to the first test case information based on first response information received from the service server in response to the request information;

Test information comprising the step of obtaining first reference data information based on first output information, which is output as a result of executing first code information based on the first test case information and the first item data information. How to manage.
According to paragraph 1,

How to manage the test information:

A test information management method comprising acquiring the first reference data information based on information regarding whether the first output information is verified.
According to paragraph 1,

The test information management method is,

Confirming the first item data information based on the first test case information; and

A test information management method further comprising checking second output information output as a result of executing second code information based on the first test case information and the first data information.
According to paragraph 3,

The second code information is,

A test information management method comprising code information obtained by changing at least part of the first code information.
According to paragraph 3,

The test information management method is,

A test information management method further comprising confirming comparison information obtained based on the first reference data information and the second output information.
According to clause 5,

The above comparative information is,

A test information management method including information about the difference between the first reference data information and the second output information.
According to paragraph 3,

The test information management method is,

A test information management method further comprising acquiring second reference data corresponding to the second output information based on information regarding whether the second output information is verified.
In clause 7,

Information regarding whether the second output information is verified,

A test information management method confirmed based on comparison information corresponding to the first reference data information and the second output information.
According to paragraph 1,

Confirming changed first output information that has at least partially changed the first test case information and is output as a result of executing the first code information based on the changed first test case information and the first item data information. ; and

A test information management method further comprising confirming changed first reference data information based on a comparison of the changed first output information and the first output information.
According to paragraph 1,

The first test case information is,

Contains one or more request parameters associated with the request,

The data information in Item 1 above is,

A test information management method, comprising one or more response parameters corresponding to the one or more requests.
According to paragraph 1,

The data information in Item 1 above is,

A test information management method, including mock data identification information corresponding to the first test case information.
According to paragraph 1,

The first standard data information is,

A test information management method including reference data identification information corresponding to the first test case information.
According to paragraph 1,

The first code information is,

A test information management method including at least a portion of code information regarding one or more functions provided by the application.
In electronic devices,

transceiver;

storage; and

Includes a processor,

The processor,

Delivering request information based on the first test case information to the service server related to the service provided based on the application,

Generating first item data (mock data) information corresponding to the first test case information based on the first response information received from the service server in response to the request information,

An electronic device configured to obtain first reference data information based on first output information, which is output as a result of executing first code information based on the first test case information and the first data information.
A non-transitory computer-readable recording medium that records a program for executing the method of claim 1 on a computer.