KR102413647B1 - Client server, method and computer program for testing multi-view streaming service - Google Patents

Abstract

The client server for testing the multi-view streaming service includes a test condition setting unit receiving test conditions set including one or more of the number of virtual clients for testing the multi-view streaming service, and at least one method and test execution time, the setting An execution unit for executing at least one or more virtual clients based on the number of received virtual clients, receiving the multi-view streaming service from a plurality of streaming servers through the executed virtual client, and receiving the multi-view streaming service for the provided multi-view streaming service A test performing unit that performs a test based on the set test condition, a receiving unit that receives monitoring information for the multi-view streaming service from a management server that manages the plurality of streaming servers, and the multi-view based on the received monitoring information It includes a detection unit that detects whether an error has occurred for the view streaming service.

Description

CLIENT SERVER, METHOD AND COMPUTER PROGRAM FOR TESTING MULTI-VIEW STREAMING SERVICE}

The present invention relates to a client server, a method and a computer program for testing a multiview streaming service.

In the time slice technique, a plurality of cameras are set up facing the subject at various angles to shoot instantaneously at the same time, and then, by connecting the photos using a computer, the still motion of the subject is displayed as if it were taken with a movie camera. video technique that Time slice not only can depict a subject three-dimensionally, but also provides a feeling that transcends time and space.

In relation to this time slice technique, Korean Patent Application Laid-Open No. 2007-0000994, which is a prior art, discloses a system and method for recording and reproducing an image.

Conventionally, by executing an auto-testing script for a streaming service that provides a single-view video, it is possible to calculate the number of executable clients or to check the performance of a streaming server to perform a test for the streaming service. However, when a test is performed on a streaming service that provides a time slice image using the conventional method, as each client streams different views, time slice images such as view switching for each client and movement of playback time at different views It had the disadvantage of not being able to test functions implemented only in streaming services that provide

An object of the present invention is to provide a client server, method, and computer program for testing multi-view streaming service by setting test conditions including method, number of virtual clients, and test execution time.

In the past, a streaming service could be tested using only one method in one test, but by enabling at least one method to be set in one test, a client that enables testing for a multi-view streaming service for each method It is intended to provide a server, method and computer program.

An object of the present invention is to provide a client server, a method, and a computer program for detecting whether an error occurs for a multi-view streaming service based on monitoring information for the multi-view streaming service.

However, the technical problems to be achieved by the present embodiment are not limited to the technical problems described above, and other technical problems may exist.

As a means for achieving the above-described technical problem, an embodiment of the present invention provides a test condition including one or more of the number of virtual clients and at least one or more methods and test execution time for testing the multi-view streaming service. A receiving test condition setting unit, an execution unit executing at least one or more virtual clients based on the set number of virtual clients, and receiving the multi-view streaming service from a plurality of streaming servers through the executed virtual clients, A test performing unit for performing a test on the received multi-view streaming service based on the set test condition, a receiving unit for receiving monitoring information for the multi-view streaming service from a management server that manages the plurality of streaming servers, and the It is possible to provide a client server including a detection unit that detects whether an error has occurred for the multi-view streaming service based on the received monitoring information.

Another embodiment of the present invention is a step of receiving a set of test conditions including one or more of the number of virtual clients for testing the multi-view streaming service, and at least one method and test execution time, the number of virtual clients set executing at least one or more virtual clients based on performing a test, receiving monitoring information for the multi-view streaming service from a management server that manages the plurality of streaming servers, and whether an error occurs for the multi-view streaming service based on the received monitoring information It is possible to provide a test method comprising the step of detecting

Another embodiment of the present invention, when the computer program is executed by the computing device, the number of virtual clients for testing the multi-view streaming service, and at least one or more methods and test conditions including one or more of a test execution time Set, execute at least one or more virtual clients based on the set number of virtual clients, receive the multi-view streaming service from a plurality of streaming servers through the executed virtual client, and receive the multi-view streaming service provided performs a test on the basis of the set test condition, receives monitoring information for the multi-view streaming service from a management server that manages the plurality of streaming servers, and based on the received monitoring information, the multi-view It is possible to provide a computer program stored in a medium including a sequence of instructions to detect whether an error has occurred for the streaming service.

The above-described problem solving means are merely exemplary, and should not be construed as limiting the present invention. In addition to the exemplary embodiments described above, there may be additional embodiments described in the drawings and detailed description.

According to any one of the above-described problem solving means of the present invention, in the case of an auto-testing script conventionally used for testing in a single-view video streaming service, it is suitable for testing various functions that can be implemented in a multi-view streaming service. However, it is possible to provide a client server, a method, and a computer program for performing a test based on the test conditions set for the multi-view streaming service.

In one test, a client server, method, and computer program can be provided that allow the multi-view streaming service to be tested by mixing each method, such as video playback, viewpoint shift, screen switching, and time slice video generation.

It is possible to provide a client server, a method, and a computer program for providing an optimal multi-view streaming service by checking the number of concurrent users that can be executed in the multi-view streaming service.

It is possible to provide a client server, a method, and a computer program capable of providing an improved quality of a multi-view streaming service by checking errors occurring in the multi-view streaming service and the resource status of the streaming server in real time.

It is possible to provide a client server, a method, and a computer program for stably and efficiently providing a service to a user based on a test result of the multi-view streaming service.

1 is a block diagram of a system for providing a multi-view streaming service according to an embodiment of the present invention.
2 is a block diagram of a client server according to an embodiment of the present invention.
3 is an exemplary diagram illustrating a method for performing a test in a multi-view streaming service according to an embodiment of the present invention.
4 is a flowchart of a method for testing a multi-view streaming service in a client server according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art can easily implement them. However, the present invention may be embodied in several different forms and is not limited to the embodiments described herein. And in order to clearly explain the present invention in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the specification, when a part is "connected" with another part, this includes not only the case of being "directly connected" but also the case of being "electrically connected" with another element interposed therebetween. . In addition, when a part "includes" a certain component, it means that other components may be further included, rather than excluding other components, unless otherwise stated, and one or more other features However, it is to be understood that the existence or addition of numbers, steps, operations, components, parts, or combinations thereof is not precluded in advance.

In this specification, a "part" includes a unit realized by hardware, a unit realized by software, and a unit realized using both. In addition, one unit may be implemented using two or more hardware, and two or more units may be implemented by one hardware.

Some of the operations or functions described as being performed by the terminal or device in this specification may be instead performed by a server connected to the terminal or device. Similarly, some of the operations or functions described as being performed by the server may also be performed in a terminal or device connected to the server.

Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of a multi-view streaming service test system according to an embodiment of the present invention. Referring to FIG. 1 , the multi-view streaming service providing system 1 may include a storage 100 , a plurality of streaming servers 110 , a client server 120 , and a management server 130 . The storage 100 , a plurality of streaming servers 110 , the client server 120 , and the management server 130 exemplarily illustrate components that can be controlled by the multi-view streaming service test system 1 .

Each component of the multi-view streaming service test system 1 of FIG. 1 is generally connected through a network. For example, as shown in FIG. 1 , the client server 120 may be connected to a plurality of streaming servers 110 or management server 130 at a time interval at the same time.

A network refers to a connection structure in which information can be exchanged between each node, such as terminals and servers, and includes a local area network (LAN), a wide area network (WAN), and the Internet (WWW: World). Wide Web), wired and wireless data communication networks, telephone networks, wired and wireless television networks, and the like. Examples of wireless data communication networks include 3G, 4G, 5G, 3rd Generation Partnership Project (3GPP), Long Term Evolution (LTE), World Interoperability for Microwave Access (WIMAX), Wi-Fi, Bluetooth communication, infrared communication, ultrasound Communication, Visible Light Communication (VLC), LiFi, and the like are included, but are not limited thereto.

The storage 100 may encode and store images photographed from a plurality of cameras arranged based on a predetermined interval. Here, the image may be a multi-view image obtained by photographing a specific object.

The plurality of streaming servers 110 may receive a request for a multi-view image from a user terminal (not shown), extract the requested multi-view image from the storage 100, and stream it to a user terminal (not shown).

A plurality of streaming servers 110 create a socket, and when a virtual client executed by the client server 120 is connected through the socket, a multi-view image for testing the multi-view streaming service by creating a corresponding session is generated as a virtual client can be streamed with

When the plurality of streaming servers 110 receives a method from the virtual client, it may perform a command related to the received method, and stream a multi-view streaming image according to the performed command to the virtual client.

The client server 120 may test the performance of the multi-view streaming service by configuring users to access the plurality of streaming servers 110 as virtual clients before commercializing the actual multi-view streaming service. In this case, the client server 120 implements a plurality of virtual clients, so that the plurality of virtual clients can download images by accessing distributedly from the plurality of streaming servers 110 through a communication network.

Hereinafter, a process of testing the multi-view streaming service in the client server 120 will be described.

The client server 120 may receive test conditions including the number of virtual clients for testing the multi-view streaming service and at least one method and test execution time from an administrator terminal (not shown). Here, the at least one method may include an image reproduction command, a viewpoint movement command, a screen change command, a time slice image generation command, and the like.

The client server 120 may execute at least one or more virtual clients based on the set number of virtual clients.

The client server 120 may receive the multi-view streaming service from the plurality of streaming servers 110 through the executed virtual client, and perform a test based on test conditions set for the provided multi-view streaming service. Here, the client server 120 may perform a test by applying a random variable to each method.

The client server 120 may receive monitoring information for the multi-view streaming service from the management server 130 that manages the plurality of streaming servers 110 . Here, the monitoring information may include resource items for a plurality of streaming servers. The resource item may include CPU utilization, memory utilization, network traffic utilization, storage and traffic utilization between a plurality of streaming servers, the number of users per streamer, the maximum number of concurrent users, and the like.

When the test being performed is terminated, the client server 120 may determine whether the execution period of the terminated test corresponds to the set test execution time based on monitoring information on the terminated test. For example, when the execution period of the finished test is the same as the set test execution time, the client server 120 resets the test execution time among the set test conditions to increase, and restarts the test based on the reset test conditions. can be done As another example, when the execution period of the terminated test is not the same as the set test execution time, the client server 120 may determine whether monitoring information for the terminated test exceeds a preset resource acceptance condition. have.

The client server 120 may detect whether an error occurs for the multi-view streaming service based on the received monitoring information. For example, when the monitoring information for the finished test does not exceed a preset resource acceptance condition, the client server 120 may detect whether an error occurs for the multi-view streaming service. When an error occurs for the multi-view streaming service, the client server 120 may notify the error to an administrator terminal (not shown). For another example, when the monitoring information for the finished test exceeds a preset resource acceptance condition, the client server 120 resets the number of virtual clients among the set test conditions to decrease, and based on the reset test condition, the number of virtual clients is reduced. You can rerun the test.

When an error for the multi-view streaming service does not occur, the client server 120 may check at least one of the maximum test execution time and the maximum number of clients according to the set test condition.

The client server 120 may be executed by a computer program stored in a medium including a sequence of instructions for testing the multi-view streaming service. When the computer program is executed by a computing device, the number of virtual clients for testing the multi-view streaming service, and at least one or more methods and test conditions including one or more of the test execution time are set, and the number of set virtual clients Executes at least one or more virtual clients based on , receives multi-view streaming services from a plurality of streaming servers 110 through the executed virtual clients, and tests based on test conditions set for the provided multi-view streaming services , and receives monitoring information for the multi-view streaming service from the management server 130 that manages the plurality of streaming servers 110, and detects whether an error occurs for the multi-view streaming service based on the received monitoring information It may contain a sequence of instructions to make it happen.

The management server 130 manages the plurality of streaming servers 110 , and when the test for the multi-view streaming service is performed in the client server 120 , the monitoring information for the multi-view streaming service is transmitted to the client server 120 . can be transmitted

2 is a block diagram of a client server according to an embodiment of the present invention. Referring to FIG. 2 , the client server 120 includes a test condition setting unit 210 , an execution unit 220 , a test execution unit 230 , a receiving unit 240 , a detection unit 250 , a notification unit 260 , and a confirmation unit. A portion 270 may be included. The test condition setting unit 210 may receive set test conditions including the number of virtual clients for testing the multi-view streaming service, and at least one method and test execution time.

The at least one method includes an image playback command, a viewpoint movement command, a screen change command, a time slice image creation command, and the like, and may receive at least one command set from an administrator. For example, the test condition setting unit 210 may be set such that at least one method is mixed in one test, such as generating a time slice image → moving a viewpoint → changing a screen for a method. A command related to the method will be described in detail with reference to FIG. 3 .

3 is an exemplary diagram illustrating a method for performing a test in a multi-view streaming service according to an embodiment of the present invention. Referring to FIG. 3 , in the image reproduction command 310 , the virtual client receives an image photographed by the first camera 301 among a plurality of images photographed through the plurality of cameras 300 , and through the screen of the virtual client can be played back. In this case, the video playback command 310 becomes a basic starting point of all tests, and an initial basic command may be set after connecting to the plurality of streaming servers 110 .

The timing (timestamp) movement command 320 is a frame of a specific time (for example, a user using a multi-view streaming service It can be moved to the desired frame of time). For example, the timestamp movement command 320 may move the playback time of the multi-view image from 01:00 to 10:00 through the virtual client.

The screen switching command 330 is an image of any one camera among images captured by a plurality of cameras 300 through the screen of the virtual client (eg, an image of a camera requested by a user using a multi-view streaming service). can be converted to In this case, camera switching and frame viewpoint switching may be simultaneously performed according to the passage of time. For example, the screen switching command 330 may be performed from an image captured by the first camera 301 while the image captured by the first camera 301 is being reproduced through the virtual client to the second camera 302 and the third The screen may be switched to an image captured by any one of the cameras 303 to the kth camera 304 .

In the time slice image creation command 340 , a specific angle of view area (eg, a field of view area selected by a user using a multi-view streaming service) is selected from the plurality of cameras 300 to generate a time slice image through the virtual client. An image may be extracted from frames having the same indexing among frames constituting each captured image, and an angle-of-view region may be cropped for each image to provide processed image information.

Returning to FIG. 2 , the test execution time means the maximum time that can be repeatedly performed for each method, and it is possible to receive from the administrator how long the test is to be performed for each set method. For example, the test condition setting unit 210 may receive the execution time for each method set for the test execution time, such as 'movement of a point of view: performed for 1 minute' and 'screen change: performed for 1 minute'.

The number of virtual clients means the number of virtual clients that can be distributed and connected to the plurality of streaming servers 110, and the number of virtual clients to be executed in the test for the multi-view streaming service can be set by the administrator. .

In addition, the test condition setting unit 210 may receive a setting from the manager at what time interval the virtual client connects to the plurality of streaming servers 110 .

By setting these test conditions, the maximum number of concurrent users that can connect can be identified.

The execution unit 220 may execute at least one or more virtual clients based on the set number of virtual clients.

The test performing unit 230 may receive a multi-view streaming service from a plurality of streaming servers 110 through the executed virtual client, and perform a test based on test conditions set for the provided multi-view streaming service. .

When at least one method is set, the test performing unit 230 may test the multi-view streaming service by repeatedly transmitting a command related to each method to the plurality of streaming servers 110 .

For example, when a screen change command and a viewpoint movement command are set by at least one method in the test condition, the test performing unit 230 reproduces a screen of a random image based on the 'screen change command' by the plurality of virtual clients In the current state, the playback time may be changed based on the 'viewpoint movement command', and this may be repeated.

For another example, if the time slice image creation command and the time point switching command are set by at least one method in the test condition, the test execution unit 230 may perform a 'time slice image creation command' while a plurality of virtual clients are playing an image It is possible to select a random field of view region based on ' and repeatedly perform a 'viewpoint switching command' by acquiring a cropped and resized image.

Through this process, when a plurality of user terminals access a plurality of streaming servers 110 and receive an image streaming in an actual situation through this process, the image downloaded by each user is randomly changed, so that through the streaming service Since it is difficult to understand the load generated by each streaming server, it is possible to determine the load generated by each streaming server by testing the multi-view streaming service for each method. Also, based on the number of virtual clients performing the test, it is possible to determine the maximum number of concurrent users that can operate for each method. As such, by mixing at least one method and performing a test for each method, it is possible to perform a test specialized for the multi-view streaming service, and has the advantage of being able to check individual issues that may occur for each method.

The test execution unit 230 may perform a test by applying a random variable to each method. For example, when the method for the viewpoint movement command is set in the test condition, the test execution unit 230 randomly applies a variable for how to change the speed to move the viewpoint on the screen being played through the virtual client. tests can be performed. For another example, when a method for a screen change command is set in the test condition, the test execution unit 230 determines which camera image among the plurality of cameras to be played in order to switch the screen being played through the virtual client. A test can be performed by randomly applying a variable. As another example, if the method for the time slice image creation command is set in the test condition, the test execution unit 230 may enlarge a specific angle of view area (eg, a user using a multi-view streaming service) through a virtual client. The test can be performed by randomly applying variables for the x and y coordinates corresponding to the desired viewing angle region).

Through this, when performing a test on the multi-view streaming service, by applying a random variable, the multi-view streaming service is provided to a plurality of user terminals and creates the same test environment as the actual environment used, thereby deriving accurate test results. because it can

In addition, when multiple cameras are installed in a large space such as an actual stadium, the amount of light irradiated varies depending on the location of the camera, and the bit rate for each image changes, which can affect network traffic and reduce the time slice function. This is because, when the same variable is repeated several times to operate, the cropped and resized data already stored in the buffer is cached, so it is difficult to derive an accurate test result according to repeated execution of the same variable.

The test execution unit 230 may additionally perform an auto-testing function to automatically control the number of virtual clients, a test execution time, and the like to determine an optimized test environment.

The receiver 240 may receive monitoring information for the multi-view streaming service from the management server 130 that manages the plurality of streaming servers 110 . The receiver 240 may receive monitoring information for the multi-view streaming service provided through each streaming server from the management server 130 . Here, the monitoring information may include resource items for a plurality of streaming servers. The resource item may include CPU utilization, memory utilization, network traffic utilization, storage and traffic utilization between a plurality of streaming servers, the number of users per streamer, the maximum number of concurrent users, and the like.

The detection unit 250 may detect whether an error occurs for the multi-view streaming service based on the received monitoring information. At this time, the detection unit 250 may determine the maximum time for performing a test for the multi-view streaming service and the maximum number of connectable virtual clients based on the monitoring information.

Hereinafter, a process of re-performing the test will be described.

For example, when the test being performed is terminated, the detection unit 250 may determine whether the period for performing the terminated test corresponds to the set test execution time based on monitoring information on the terminated test.

For example, the test condition setting unit 210 resets the test execution time to increase among the set test conditions when the execution period of the finished test is the same as the set test execution time, and the test execution unit 230 resets The test can be re-performed based on the tested test conditions.

Thereafter, when the execution period of the finished test is not the same as the set test execution time, the detection unit 250 may determine whether monitoring information for the terminated test exceeds a preset resource acceptance condition. The detection unit 250 may detect whether an error occurs in the multi-view streaming service when the monitoring information for the finished test does not exceed a preset resource acceptance condition. The error is, for example, when the command related to the method requested by the virtual client does not work properly, when the frame number and image information requested by the virtual client are not normally responded, the virtual client is evenly distributed to the plurality of streaming servers 110 It may include a case where it is not dispersed. The test condition setting unit 210 resets the number of virtual clients among the set test conditions when the monitoring information for the finished test exceeds a preset resource acceptance condition, and the test execution unit 230 sets the reset test condition. Based on the condition, the test may be re-run.

When an error occurs for the multi-view streaming service, the notification unit 260 may notify the error to an administrator terminal (not shown).

For example, when an error response is received from the streaming server because a command related to each method requested by the virtual client does not work properly, the notification unit 260 transmits an error related to this to the manager terminal (not shown) to the manager By this, it is possible to check whether the command desired by the user works smoothly and to take action.

For another example, if the virtual client does not receive a normal response to the requested frame number and image information from the streaming server 110, the notification unit 260 transmits an error related to this to the manager terminal (not shown). , it is possible to check whether the network connection between the streaming server and the storage 100 is unstable or there are other issues with respect to whether the streaming server 110 properly extracts the image from the storage 100 and streams it to the virtual client by the administrator. .

For another example, if the virtual client is not evenly distributed among the plurality of streaming servers 110, the load is concentrated on some streaming servers and it may be difficult to test a smooth multi-view streaming service, so the notification unit 260 is An error related thereto may be transmitted to an administrator terminal (not shown) so that the administrator may perform an action on the network.

When an error for the multi-view streaming service does not occur, the check unit 270 may check at least one of the maximum test execution time and the maximum number of clients according to the set test condition.

4 is a flowchart of a method for testing a multi-view streaming service in a client server according to an embodiment of the present invention. The method for testing the multi-view streaming service in the client server 120 shown in FIG. 4 includes the steps processed in time series by the multi-view streaming service providing system 1 according to the embodiment shown in FIGS. 1 to 3 . include Therefore, even if omitted below, it is also applied to the method of testing the multi-view streaming service in the client server 120 according to the embodiment shown in FIGS. 1 to 3 .

The client server 120 may receive, from the administrator, the number of virtual clients for testing the multi-view streaming service, and test conditions including one or more of at least one method and test execution time (S401).

The client server 120 may execute at least one or more virtual clients based on the set number of virtual clients (S402).

The client server 120 may receive a multi-view streaming service from a plurality of streaming servers 110 through the executed virtual client, and perform a test based on test conditions set for the provided multi-view streaming service ( S403).

The client server 120 may receive monitoring information for the test from the management server 130 (S404). For example, the client server 120 may receive monitoring information for the test from the management server 130 in real time while performing the test.

Thereafter, when the test being performed is finished ( S405 ), the client server 120 may determine whether the terminated test execution period is the same as the set test execution time ( S406 ).

For example, if the end test execution period is the same as the set test execution time (S407), the client server 120 resets the test execution time to increase among the set test conditions (S408), and returns to the reset test condition. Based on the virtual client may be re-executed (S402). For another example, if the terminated test execution period is not the same as the set test execution time (S409), the client server 120 determines whether the monitoring information received from the management server 130 exceeds a preset resource acceptance condition. It can be determined whether or not (S410).

For example, if the monitoring information exceeds a preset resource acceptance condition (S411), the client server 120 resets the number of virtual clients among the set test conditions to be reduced (S412), and based on the set test conditions, virtual The client may be re-executed (S402). As another example, when the monitoring information does not exceed the preset resource acceptance condition (S413), the client server 120 may determine whether an error occurs with respect to the multi-streaming service (S414).

For example, when an error occurs for the multi-streaming service (S415), the client server 120 may notify the error to the manager terminal (not shown) (S416). As another example, if no error occurs for the multi-streaming service (S417), the client server 120 may check at least one of the maximum test execution time and the maximum number of clients according to the set test condition (S418). ).

In the above description, steps S401 to S418 may be further divided into additional steps or combined into fewer steps, according to an embodiment of the present invention. In addition, some steps may be omitted as needed, and the order between the steps may be switched.

The method of testing the multi-view streaming service in the client server 120 through FIGS. 1 to 4 may also be implemented in the form of a recording medium including a computer program stored in a medium executed by a computer or instructions executable by a computer. can In addition, the method for testing the multi-view streaming service in the client server 120 through FIGS. 1 to 4 may be implemented in the form of a computer program stored in a medium executed by a computer.

Computer-readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. Also, computer-readable media may include computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.

The above description of the present invention is for illustration, and those of ordinary skill in the art to which the present invention pertains can understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. For example, each component described as a single type may be implemented in a dispersed form, and likewise components described as distributed may be implemented in a combined form.

The scope of the present invention is indicated by the following claims rather than the above detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention. do.

100: storage
110: multiple streaming servers
120: client server
210: test condition setting unit
220: execution unit
230: test execution unit
240: receiver
250: detection unit
260: notification unit
270: confirmation unit

Claims (19)

In the client server for testing the multi-view streaming service,
a test condition setting unit configured to set a test condition including at least one of the number of virtual clients for testing the multi-view streaming service, and at least one method and test execution time;
an execution unit executing at least one or more virtual clients based on the set number of virtual clients;
a test performing unit receiving the multi-view streaming service from a plurality of streaming servers through the executed virtual client, and performing a test on the received multi-view streaming service based on the set test conditions;
a receiving unit for receiving monitoring information for the multi-view streaming service from a management server that manages the plurality of streaming servers; and
A detection unit for detecting whether an error occurs for the multi-view streaming service on the basis of the received monitoring information,
The test condition setting unit receives the set of the test conditions in which at least one method of an image playback command, a viewpoint shift command, a screen change command, and a time slice image generation command is mixed;
The test performing unit performs the test for each of the at least one or more methods for the multi-view streaming service,
When the test being performed is terminated, when the execution period of the finished test is not the same as the set test execution time, and the monitoring information for the terminated test does not exceed a preset resource acceptance condition For detecting whether an error occurs for the multi-view streaming service, the client server.
delete The method of claim 1,
The test execution unit will apply a random variable for each method to perform the test, the client server.
The method of claim 1,
When the test being performed is terminated,
The client server, wherein the detection unit determines whether an execution period of the terminated test corresponds to the set test execution time based on monitoring information on the terminated test.
5. The method of claim 4,
The test condition setting unit resets the test execution time to increase among the set test conditions when the execution period of the finished test is the same as the set test execution time,
The test execution unit will re-perform the test based on the reset test condition, the client server.
5. The method of claim 4,
The detection unit determines whether monitoring information for the terminated test exceeds a preset resource acceptance condition when the duration of the completed test is not the same as the set test execution time, the client server.
delete 7. The method of claim 6,
The test condition setting unit resets the number of virtual clients to decrease among the set test conditions when the monitoring information for the finished test exceeds the preset resource acceptance condition,
The test execution unit will re-perform the test based on the reset test condition, the client server.
The method of claim 1,
When an error occurs for the multi-view streaming service, the client server further comprising a notification unit for notifying the error occurred to the administrator terminal.
The method of claim 1,
When an error for the multi-view streaming service does not occur, the client server further comprising a confirmation unit for checking at least one of the maximum test execution time and the maximum number of clients according to the set test condition.
The method of claim 1,
The monitoring information includes resource items for the plurality of streaming servers,
The resource item will include at least one of CPU utilization, memory utilization, network traffic utilization, storage and traffic utilization between the plurality of streaming servers, the number of users per streamer, and the maximum number of concurrent users.
A method for testing a multi-view streaming service on a client server, the method comprising:
Receiving test conditions including at least one of the number of virtual clients for testing the multi-view streaming service, and at least one method and test execution time;
executing at least one or more virtual clients based on the set number of virtual clients;
receiving the multi-view streaming service from a plurality of streaming servers through the executed virtual client, and performing a test on the received multi-view streaming service based on the set test conditions;
Receiving monitoring information for the multi-view streaming service from a management server that manages the plurality of streaming servers; and
Detecting whether an error occurs for the multi-view streaming service based on the received monitoring information,
The step of receiving the test condition is set,
Receiving the test condition in which at least one method of an image playback command, a viewpoint shift command, a screen change command, and a time slice image generation command is set is set;
The step of performing the test is
Comprising the step of performing the test for each of the at least one method for the multi-view streaming service,
The step of detecting whether the error has occurred is
When the test being performed is terminated, the execution period of the finished test is not the same as the set test execution time, and monitoring information for the finished test does not exceed the preset resource acceptance condition A test method comprising the step of detecting whether an error occurs for the multi-view streaming service.
delete 13. The method of claim 12,
When the test being performed is terminated,
The method further comprising the step of determining whether an execution period of the terminated test corresponds to the set test execution time based on monitoring information on the terminated test.
15. The method of claim 14,
resetting the test execution time to increase among the set test conditions when the duration of the finished test is the same as the set test execution time; and
and re-performing the test based on the reset test condition.
15. The method of claim 14,
The step of detecting whether the error has occurred is
When the execution period of the terminated test is not the same as the set test execution time, determining whether monitoring information for the terminated test exceeds a preset resource acceptance condition, the test method .
delete 17. The method of claim 16,
resetting the number of virtual clients to decrease among the set test conditions when the monitoring information for the terminated test exceeds the preset resource acceptance condition; and
The method of claim 1, further comprising re-performing the test based on the reset test condition.
A computer program stored on a medium comprising a sequence of instructions for testing a multi-view streaming service, the computer program comprising:
When the computer program is executed by a computing device,
To set a test condition including at least one of the number of virtual clients for testing the multi-view streaming service, and at least one or more methods and test execution time,
Execute at least one or more virtual clients based on the set number of virtual clients,
The multi-view streaming service is provided from a plurality of streaming servers through the executed virtual client, and a test is performed on the received multi-view streaming service based on the set test conditions,
Receive monitoring information for the multi-view streaming service from a management server that manages the plurality of streaming servers,
Detecting whether an error occurs for the multi-view streaming service based on the received monitoring information,
receiving the test condition in which at least one method of an image playback command, a viewpoint shift command, a screen change command, and a time slice image creation command is mixed;
performing the test for each of the at least one or more methods for the multi-view streaming service,
When the test being performed is terminated, the execution period of the finished test is not the same as the set test execution time, and monitoring information for the finished test does not exceed a preset resource acceptance condition. A computer program stored in a medium, comprising a sequence of instructions for detecting whether an error has occurred for the multi-view streaming service.

Images