KR20210025385A - Client server, method and computer program for testing multi-view streaming service - Google Patents

Abstract

A client server for testing a multi-view streaming service includes: a test condition setting unit subject to the setting of test conditions including at least one of the number of virtual clients for testing the multi-view streaming service, at least one method, and test implementation time; an execution unit executing at least one virtual client based on the set number of virtual clients; a test implementation unit receiving the multi-view streaming service from streaming servers through the executed virtual client and implementing the test based on the set test conditions with respect to the provided multi-view streaming service; a receiving unit receiving monitoring information on the multi-view streaming service from a management server managing the streaming servers; and a detection unit detecting the presence or absence of an error with respect to the multi-view streaming service based on the received monitoring information.

Description

Client server, method and computer program for testing multi-view streaming service {CLIENT SERVER, METHOD AND COMPUTER PROGRAM FOR TESTING MULTI-VIEW STREAMING SERVICE}

The present invention relates to a client server, a method, and a computer program for testing a multiview streaming service.

The time slice technique means that a plurality of cameras are installed facing the subject at various angles and taken instantaneously at the same time, and then the still motions of the subject appear as if they were taken with a movie camera by connecting the pictures using a computer. It refers to the video technique to do. Time slice not only can describe the subject in three dimensions, but also provides a feeling that transcends time and space.

With respect to such a time slice technique, Korean Patent Publication No. 2007-0000994, which is a prior art, discloses a system and method for recording and reproducing an image.

In the related art, by executing an auto testing script for a streaming service that provides a single view video, it is possible to calculate the number of executable clients or perform a test on the streaming service by grasping the performance of the streaming server. However, when a test is performed on a streaming service that provides a time-slice image using a conventional method, as different views are streamed for each client, time-slice images such as time-slice switching for each client and movement of playback time at different views are performed. It had the disadvantage of not being able to test the functions implemented only in the streaming service that provides.

It is intended to provide a client server, a method, and a computer program for testing a multi-view streaming service by setting test conditions including a method, the number of virtual clients, and test execution time.

In the past, a streaming service could be tested using only one method in a single test, but a client that enables testing of the multi-view streaming service for each method by allowing at least one method to be set in a single test It is intended to provide a server, a method and a computer program.

An object of the present invention is to provide a client server, a method, and a computer program for detecting whether an error has occurred in the multi-view streaming service based on monitoring information on the multi-view streaming service.

However, the technical problem to be achieved by the present embodiment is not limited to the technical problems as described above, and other technical problems may exist.

As a means for achieving the above-described technical problem, an embodiment of the present invention provides a test condition including at least one of the number of virtual clients for testing the multi-view streaming service, and at least one method and test execution time. A set test condition setting unit, an execution unit that executes at least one virtual client based on the set number of virtual clients, receive the multi-view streaming service from a plurality of streaming servers through the executed virtual clients, and the A test execution unit that performs a test on the provided multi-view streaming service based on the set test condition, a receiving unit that receives monitoring information on the multi-view streaming service from a management server that manages the plurality of streaming servers, and the It is possible to provide a client server including a detection unit that detects whether an error has occurred in the multi-view streaming service based on the received monitoring information.

Another embodiment of the present invention is the step of setting a test condition including one or more of the number of virtual clients for testing a multi-view streaming service, and at least one method and a test execution time, and the set number of virtual clients Executing at least one virtual client based on, receiving the multi-view streaming service from a plurality of streaming servers through the executed virtual client, and based on the set test condition for the provided multi-view streaming service Performing a test by performing a test, receiving monitoring information on the multi-view streaming service from a management server that manages the plurality of streaming servers, and whether an error has occurred in the multi-view streaming service based on the received monitoring information It is possible to provide a test method including the step of detecting.

In another embodiment of the present invention, when the computer program is executed by a computing device, the number of virtual clients for testing the multi-view streaming service, and a test condition including one or more of at least one method and a test execution time It is set, executes at least one virtual client based on the set number of virtual clients, receives the multi-view streaming service from a plurality of streaming servers through the executed virtual client, and receives the provided multi-view streaming service Performs a test based on the set test condition for, receives monitoring information on the multi-view streaming service from a management server that manages the plurality of streaming servers, and receives the multi-view based on the received monitoring information. It is possible to provide a computer program stored in a medium including a sequence of instructions for detecting whether an error has occurred in the streaming service.

The above-described problem solving means are merely exemplary and should not be construed as limiting the present invention. In addition to the above-described exemplary embodiments, there may be additional embodiments described in the drawings and detailed description of the invention.

According to any one of the above-described problem solving means of the present invention, in the case of an auto testing script conventionally used for testing in a streaming service of a single view video, it is suitable for testing various functions that can be implemented in a multi-view streaming service. Although not performed, a client server, a method, and a computer program for performing a test based on a test condition set for a multi-view streaming service may be provided.

It is possible to provide a client server, a method, and a computer program that allow a multi-view streaming service to perform a test by mixing for each method such as video playback, viewpoint movement, screen change, and time slice video generation in a single test.

It is possible to provide a client server, a method, and a computer program capable of providing an optimal multi-view streaming service by checking the number of concurrent users that can be executed in a multi-view streaming service.

It is possible to provide a client server, a method, and a computer program capable of providing an improved quality of a multi-view streaming service by checking an error occurring in a multi-view streaming service in real time and a resource state of a streaming server.

It is possible to provide a client server, a method, and a computer program for stably and efficiently providing a service to a user based on a test result of a multi-view streaming service.

1 is a block diagram of a system for providing a multi-view streaming service according to an embodiment of the present invention.
2 is a configuration diagram of a client server according to an embodiment of the present invention.
3 is an exemplary diagram showing a method for performing a test in a multi-view streaming service according to an embodiment of the present invention.
4 is a flowchart of a method for testing a multi-view streaming service in a client server according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art can easily implement the present invention. However, the present invention may be implemented in various different forms and is not limited to the embodiments described herein. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and similar reference numerals are attached to similar parts throughout the specification.

Throughout the specification, when a part is said to be "connected" with another part, this includes not only "directly connected" but also "electrically connected" with another element interposed therebetween. . In addition, when a part "includes" a certain component, it means that other components may be further included, and one or more other features, not excluding other components, unless specifically stated to the contrary. It is to be understood that it does not preclude the presence or addition of any number, step, action, component, part, or combination thereof.

In the present specification, the term "unit" includes a unit realized by hardware, a unit realized by software, and a unit realized using both. Further, one unit may be realized by using two or more hardware, or two or more units may be realized by one piece of hardware.

In this specification, some of the operations or functions described as being performed by the terminal or device may be performed instead in a server connected to the terminal or device. Likewise, some of the operations or functions described as being performed by the server may also be performed by a terminal or device connected to the server.

Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of a multi-view streaming service test system according to an embodiment of the present invention. Referring to FIG. 1, the multi-view streaming service providing system 1 may include a storage 100, a plurality of streaming servers 110, a client server 120, and a management server 130. The storage 100, the plurality of streaming servers 110, the client server 120, and the management server 130 illustrate components that can be controlled by the multi-view streaming service test system 1 by way of example.

Components of the multi-view streaming service test system 1 of FIG. 1 are generally connected through a network. For example, as shown in FIG. 1, the client server 120 may be connected to the plurality of streaming servers 110 or the management server 130 at a time interval at the same time.

A network refers to a connection structure that enables information exchange between nodes such as terminals and servers, and is a local area network (LAN), a wide area network (WAN), and the Internet (WWW: World). Wide Web), wired and wireless data communication networks, telephone networks, wired and wireless television networks, etc. Examples of wireless data networks include 3G, 4G, 5G, 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), WIMAX (World Interoperability for Microwave Access), Wi-Fi, Bluetooth communication, infrared communication, and ultrasound. Communication, Visible Light Communication (VLC), LiFi, and the like are included, but are not limited thereto.

The storage 100 may encode and store images taken from a plurality of cameras arranged based on a predetermined interval. Here, the image may be a multi-view image photographing a specific object.

The plurality of streaming servers 110 may receive a multi-view image from a user terminal (not shown), extract the multi-view image requested from the storage 100, and stream the multi-view image to the user terminal (not shown).

The plurality of streaming servers 110 create a socket, and when a virtual client executed by the client server 120 is connected through a socket, a corresponding session is created to test a multi-view video for testing the multi-view streaming service as a virtual client. Can be streamed to.

When receiving a method from a virtual client, the plurality of streaming servers 110 may perform a command related to the received method and stream a multi-view streaming image according to the executed command to the virtual client.

Before commercializing the actual multi-view streaming service, the client server 120 may test the performance of the multi-view streaming service by configuring users who will access the plurality of streaming servers 110 as virtual clients. In this case, the client server 120 implements a plurality of virtual clients, so that a plurality of virtual clients can download images by distributed access from the plurality of streaming servers 110 through a communication network.

Hereinafter, a process of testing the multi-view streaming service in the client server 120 will be described.

The client server 120 may receive a test condition including the number of virtual clients for testing the multi-view streaming service, at least one method, and a test execution time from a manager terminal (not shown). Here, the at least one method may include an image playback command, a viewpoint movement command, a screen change command, a time slice image generation command, and the like.

The client server 120 may execute at least one virtual client based on the set number of virtual clients.

The client server 120 may receive a multi-view streaming service from a plurality of streaming servers 110 through an executed virtual client, and perform a test based on a test condition set for the provided multi-view streaming service. Here, the client server 120 may perform a test by applying a random variable for each method.

The client server 120 may receive monitoring information on the multi-view streaming service from the management server 130 that manages the plurality of streaming servers 110. Here, the monitoring information may include resource items for a plurality of streaming servers. The resource item may include CPU utilization, memory utilization, network traffic utilization, storage and traffic utilization between a plurality of streaming servers, the number of users per streamer, and the maximum number of concurrent users.

When the test being performed is terminated, the client server 120 may determine whether the execution period of the ended test corresponds to a set test execution time based on monitoring information on the ended test. For example, when the execution period of the ended test is the same as the set test execution time, the client server 120 resets the test execution time among the set test conditions to increase, and retakes the test based on the reset test condition. Can be done. For another example, when the execution period of the ended test is not the same as the set test execution time, the client server 120 may determine whether the monitoring information for the ended test exceeds a preset resource acceptance condition. have.

The client server 120 may detect whether an error has occurred in the multi-view streaming service based on the received monitoring information. For example, when the monitoring information for the terminated test does not exceed a preset resource acceptance condition, the client server 120 may detect whether an error has occurred in the multi-view streaming service. When an error for the multi-view streaming service occurs, the client server 120 may notify the generated error to a manager terminal (not shown). For another example, when the monitoring information for the terminated test exceeds a preset resource acceptance condition, the client server 120 resets the number of virtual clients among the set test conditions to decrease, based on the reset test condition. You can rerun the test.

When an error for the multi-view streaming service does not occur, the client server 120 may check at least one of a maximum test execution time and a maximum number of clients according to a set test condition.

This client server 120 may be executed by a computer program stored in a medium containing a sequence of instructions for testing the multi-view streaming service. When the computer program is executed by a computing device, the number of virtual clients for testing the multi-view streaming service, and the number of virtual clients that have received test conditions including one or more of at least one method and test execution time are set. Based on the execution of at least one virtual client, receiving a multi-view streaming service from a plurality of streaming servers 110 through the executed virtual client, and testing based on the test conditions set for the provided multi-view streaming service And receiving monitoring information on the multi-view streaming service from the management server 130 that manages the plurality of streaming servers 110, and detecting whether an error has occurred in the multi-view streaming service based on the received monitoring information. It may contain a sequence of instructions to cause.

The management server 130 manages a plurality of streaming servers 110, and when a test for the multi-view streaming service is performed in the client server 120, the monitoring information for the multi-view streaming service is transferred to the client server 120. Can be transmitted.

2 is a configuration diagram of a client server according to an embodiment of the present invention. Referring to FIG. 2, the client server 120 includes a test condition setting unit 210, an execution unit 220, a test execution unit 230, a reception unit 240, a detection unit 250, a notification unit 260, and confirmation. It may include a unit 270. The test condition setting unit 210 may receive test conditions including the number of virtual clients for testing the multi-view streaming service, at least one method, and test execution time.

The at least one or more methods include an image playback command, a viewpoint movement command, a screen change command, a time slice image generation command, and the like, and may receive at least one command from an administrator. For example, the test condition setting unit 210 may be set to mix at least one method in a single test, such as generating a time slice image → moving a viewpoint → switching a screen for the method. Instructions related to the method will be described in detail with reference to FIG. 3.

3 is an exemplary diagram showing a method for performing a test in a multi-view streaming service according to an embodiment of the present invention. Referring to FIG. 3, the image playback command 310 receives an image captured by the first camera 301 from among a plurality of images captured by the plurality of cameras 300 by a virtual client, and through the screen of the virtual client. You can make it play. In this case, the video playback command 310 becomes a basic starting point for all tests, and an initial basic command may be set after connecting to the plurality of streaming servers 110.

The timestamp movement command 320 is a frame of a specific time (for example, a user using a multi-view streaming service) in a state in which the image captured by the first camera 301 is being played through the screen of the virtual client. It can be moved to the desired time frame). For example, the timestamp movement command 320 may move the playback time of the multi-view image from 01:00 to 10:00 through the virtual client.

The screen change command 330 is an image of any one of the images captured by the plurality of cameras 300 through the screen of the virtual client (for example, an image of a camera requested by a user using a multi-view streaming service). You can make it switch. At this time, camera switching and frame viewpoint switching may be performed simultaneously according to the passage of time. For example, the screen change command 330 is playing back an image captured by the first camera 301 through a virtual client, from the image captured by the first camera 301 to the second camera 302 and the third. The screen may be changed to an image captured by any one of the cameras 303 to k-th cameras 304.

The time slice image generation command 340 allows a specific field of view (eg, a field of view selected by a user using the multi-view streaming service) to be generated by a plurality of cameras to generate a time slice image through a virtual client. An image may be extracted from frames having the same indexing among frames constituting each captured image, and a field of view area may be cropped for each image, so that processed image information may be provided.

Returning to FIG. 2 again, the test execution time means the maximum time that can be repeatedly performed for each method, and how long to perform the test for each method set by the administrator can be set. For example, the test condition setting unit 210 may receive the execution time for each method, such as'view point movement: performed for 1 minute' and'screen change: performed for 1 minute' for the test execution time.

The number of virtual clients refers to the number of virtual clients that can be distributed and connected to a plurality of streaming servers 110, and the number of virtual clients to be executed in a test for the multi-view streaming service can be set from the administrator. .

In addition, the test condition setting unit 210 may be configured by the administrator to determine how much time intervals the virtual client will connect to the plurality of streaming servers 110.

By setting these test conditions, the maximum number of simultaneous users that can be connected can be determined.

The execution unit 220 may execute at least one virtual client based on the set number of virtual clients.

The test execution unit 230 may receive a multi-view streaming service from a plurality of streaming servers 110 through an executed virtual client, and perform a test based on a test condition set for the provided multi-view streaming service. .

When at least one method is set, the test execution unit 230 may test a multi-view streaming service by repeatedly transmitting a command related to each method to the plurality of streaming servers 110.

For example, when a screen change command and a viewpoint movement command are set as at least one method in the test condition, the test execution unit 230 reproduces a screen of a random image based on the'screen change command' by a plurality of virtual clients. In the current state, the playback time may be changed based on the'view point movement command', and this may be performed repeatedly.

For another example, when a time slice image generation command and a viewpoint change command are set as at least one method in the test condition, the test execution unit 230 performs a'time slice image generation command while a plurality of virtual clients are playing the image. The'view point switching command' may be repeatedly performed by selecting a random field of view based on ', acquiring a cropped and resized image.

Through this process, when a plurality of user terminals access a plurality of streaming servers 110 to receive an image stream in an actual situation, the image downloaded by each user is randomly changed, and thus, through the streaming service. Since it is difficult to grasp the load generated by each streaming server, it is possible to understand the load generated by each streaming server through a test of the multiview streaming service for each method. Also, based on the number of virtual clients performing the test, it is possible to determine the maximum number of concurrent users that can operate for each method. In this way, by performing a test for each method by mixing at least one method, it has the advantage of performing a test specialized for the multi-view streaming service, and checking individual issues that may occur for each method.

The test execution unit 230 may perform a test by applying a random variable for each method. For example, when a method for a viewpoint movement command is set in the test condition, the test execution unit 230 randomly applies a variable for how to change the double speed in order to move the viewpoint on the screen being played through the virtual client. You can do the test. For another example, when a method for a screen change command is set in the test condition, the test execution unit 230 determines which camera video from among the images of a plurality of cameras is to be played in order to switch the screen being played through the virtual client. You can perform a test by applying a variable randomly. For another example, when a method for a time slice image generation command is set in the test condition, the test execution unit 230 expands a specific field of view (for example, a user using a multi-view streaming service) through a virtual client. A test can be performed by randomly applying variables for x and y coordinates corresponding to the field of view desired to be viewed.

Through this, when performing a test on the multi-view streaming service, by applying a random variable, a test environment identical to the actual environment in which the multi-view streaming service is provided and used by a plurality of user terminals is created, so that accurate test results can be derived. Because it can.

In addition, when a plurality of cameras are installed in a large space such as an actual stadium, the amount of light irradiation varies depending on the location of the camera, and the bit rate for each video may affect network traffic. This is because, when the same variable is repeated several times to operate, the cropped and resized data already stored in the buffer are cached, so it is difficult to derive an accurate test result according to the repeated execution of the same variable.

The test execution unit 230 may additionally perform an auto testing function to automatically control the number of virtual clients, test execution time, and the like to determine an optimized test environment.

The receiving unit 240 may receive monitoring information on the multi-view streaming service from the management server 130 that manages the plurality of streaming servers 110. The receiving unit 240 may receive monitoring information on the multi-view streaming service provided through each streaming server from the management server 130. Here, the monitoring information may include resource items for a plurality of streaming servers. The resource item may include CPU utilization, memory utilization, network traffic utilization, storage and traffic utilization between a plurality of streaming servers, the number of users per streamer, and the maximum number of concurrent users.

The detection unit 250 may detect whether an error has occurred in the multi-view streaming service based on the received monitoring information. In this case, the detection unit 250 may determine the maximum time for performing a test on the multi-view streaming service and the maximum number of virtual clients that can be connected based on the monitoring information.

Hereinafter, a process of re-performing the test will be described.

For example, when a test being performed is terminated, the detection unit 250 may determine whether the execution period of the ended test corresponds to a set test execution time based on monitoring information on the ended test.

For example, when the execution period of the ended test is the same as the set test execution time, the test condition setting unit 210 resets the test execution time among the set test conditions to increase, and the test execution unit 230 resets the test execution time. The test can be re-run based on the established test conditions.

Thereafter, when the execution period of the ended test is not the same as the set test execution time, the detection unit 250 may determine whether the monitoring information for the ended test exceeds a preset resource acceptance condition. The detection unit 250 may detect whether an error has occurred in the multi-view streaming service when the monitoring information for the terminated test does not exceed a preset resource acceptance condition. The error is, for example, when a command related to a method requested by the virtual client does not operate properly, when the frame number and video information requested by the virtual client are not properly responded, the virtual client is equally distributed to the plurality of streaming servers 110. It may include the case of not being dispersed. The test condition setting unit 210 resets the number of virtual clients among the set test conditions to decrease when the monitoring information for the terminated test exceeds a preset resource acceptance condition, and the test execution unit 230 resets the reset test. The test can be rerun based on the condition.

When an error for the multi-view streaming service occurs, the notification unit 260 may notify the generated error to a manager terminal (not shown).

For example, when an error response is received from the streaming server because a command related to each method requested by the virtual client does not work properly, the notification unit 260 transmits the related error to the manager terminal (not shown) to the manager. Therefore, it is possible to take action by checking whether the command desired by the user works smoothly.

For another example, when a frame number requested by the virtual client and whether a normal response to the video information is not received from the streaming server 110, the notification unit 260 transmits an error related thereto to the manager terminal (not shown). , It is possible to check whether the network connection between the streaming server and the storage 100 is unstable or other issues as to whether the streaming server 110 properly extracted the image from the storage 100 and streamed it to the virtual client by the administrator. .

For another example, if the virtual clients are not evenly distributed across the plurality of streaming servers 110, the load is concentrated on some streaming servers, so it may be difficult to test a smooth multi-view streaming service. An error related to this may be transmitted to an administrator terminal (not shown), so that an action on the network may be performed by the administrator.

When an error for the multi-view streaming service has not occurred, the checker 270 may check at least one of a maximum test execution time and a maximum number of clients according to a set test condition.

4 is a flowchart of a method for testing a multi-view streaming service in a client server according to an embodiment of the present invention. The method for testing the multi-view streaming service in the client server 120 shown in FIG. 4 includes steps processed in time series by the multi-view streaming service providing system 1 according to the embodiment shown in FIGS. 1 to 3. Includes. Therefore, even if omitted below, the method of testing the multi-view streaming service in the client server 120 according to the embodiment illustrated in FIGS. 1 to 3 is also applied.

The client server 120 may receive a test condition including one or more of the number of virtual clients for testing the multi-view streaming service, and at least one method and test execution time from the administrator (S401).

The client server 120 may execute at least one virtual client based on the set number of virtual clients (S402).

The client server 120 may receive a multi-view streaming service from a plurality of streaming servers 110 through an executed virtual client, and perform a test based on a test condition set for the provided multi-view streaming service ( S403).

The client server 120 may receive monitoring information for a test from the management server 130 (S404). For example, the client server 120 may receive monitoring information for a test from the management server 130 in real time while performing the test.

Thereafter, when the test being performed is finished (S405), the client server 120 may determine whether the ended test execution period is the same as the set test execution time (S406).

For example, when the ended test execution period is the same as the set test execution time (S407), the client server 120 resets the test execution time to increase among the set test conditions (S408), and Based on the virtual client can be re-executed (S402). For another example, if the ended test execution period is not the same as the set test execution time (S409), the client server 120 determines whether the monitoring information received from the management server 130 exceeds a preset resource acceptance condition. Whether or not it can be determined (S410).

For example, when the monitoring information exceeds a preset resource acceptance condition (S411), the client server 120 resets to decrease the number of virtual clients among the set test conditions (S412), and based on the set test condition, the virtual The client can be re-executed (S402). For another example, when the monitoring information does not exceed a preset resource acceptance condition (S413), the client server 120 may determine whether an error has occurred with respect to the multi-streaming service (S414).

For example, when an error occurs for the multi-streaming service (S415), the client server 120 may notify the generated error to a manager terminal (not shown) (S416). For another example, when an error has not occurred for the multi-streaming service (S417), the client server 120 may check at least one of the maximum test execution time and the maximum number of clients according to the set test condition (S418). ).

In the above description, steps S401 to S418 may be further divided into additional steps or combined into fewer steps, according to an embodiment of the present invention. In addition, some steps may be omitted as necessary, and the order between steps may be switched.

The method of testing the multi-view streaming service in the client server 120 through FIGS. 1 to 4 may be implemented in the form of a computer program stored in a medium executed by a computer or a recording medium including instructions executable by a computer. I can. In addition, the method of testing the multi-view streaming service in the client server 120 through FIGS. 1 to 4 may be implemented in the form of a computer program stored in a medium executed by a computer.

Computer-readable media can be any available media that can be accessed by a computer, and includes both volatile and nonvolatile media, removable and non-removable media. Further, the computer-readable medium may include a computer storage medium. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.

The above description of the present invention is for illustrative purposes only, and those of ordinary skill in the art to which the present invention pertains will be able to understand that other specific forms can be easily modified without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are illustrative and non-limiting in all respects. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as being distributed may also be implemented in a combined form.

The scope of the present invention is indicated by the claims to be described later rather than the detailed description, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be construed as being included in the scope of the present invention. do.

100: storage
110: multiple streaming servers
120: client server
210: test condition setting unit
220: executive
230: test execution unit
240: receiver
250: detection unit
260: notification unit
270: confirmation unit

Claims (19)

In the client server testing the multi-view streaming service,
A test condition setting unit configured to set a test condition including one or more of the number of virtual clients for testing the multi-view streaming service, at least one method, and a test execution time;
An execution unit executing at least one virtual client based on the set number of virtual clients;
A test execution unit receiving the multi-view streaming service from a plurality of streaming servers through the executed virtual client and performing a test on the provided multi-view streaming service based on the set test condition;
A receiver configured to receive monitoring information on the multi-view streaming service from a management server that manages the plurality of streaming servers; And
And a detector configured to detect whether an error has occurred in the multi-view streaming service based on the received monitoring information.
The method of claim 1,
The at least one method comprises at least one of a video playback command, a viewpoint movement command, a screen change command, and a time slice video generation command.
The method of claim 2,
The test execution unit is to perform the test by applying a random variable for each method, the client server.
The method of claim 1,
When the test being performed is terminated,
And the detection unit determines whether the execution period of the ended test corresponds to the set test execution time based on monitoring information on the ended test.
The method of claim 4,
The test condition setting unit resets the test execution time among the set test conditions to increase when the execution period of the ended test is the same as the set test execution time,
The test execution unit to perform the test again based on the reset test condition, the client server.
The method of claim 4,
When the execution period of the ended test is not the same as the set test execution time, the detection unit determines whether the monitoring information for the ended test exceeds a preset resource acceptance condition.
The method of claim 6,
When the monitoring information for the terminated test does not exceed the preset resource acceptance condition, the detection unit detects whether an error has occurred in the multi-view streaming service.
The method of claim 6,
The test condition setting unit resets so that the number of virtual clients among the set test conditions is reduced when monitoring information for the terminated test exceeds the preset resource acceptance condition,
The test execution unit to perform the test again based on the reset test condition, the client server.
The method of claim 7,
When an error occurs in the multi-view streaming service, the client server further comprising a notification unit notifying the generated error to the manager terminal.
The method of claim 7,
If an error for the multi-view streaming service does not occur, the client server further comprising a confirmation unit for checking at least one of a maximum test execution time and a maximum number of clients according to the set test condition.
The method of claim 1,
The monitoring information includes resource items for the plurality of streaming servers,
The resource item includes at least one of a CPU usage rate, a memory usage rate, a network traffic usage, a storage and a traffic usage between the plurality of streaming servers, a number of users per streamer, and a maximum number of concurrent users.
In a method of testing a multi-view streaming service in a client server,
Receiving a test condition including one or more of the number of virtual clients for testing the multi-view streaming service, at least one method, and a test execution time;
Executing at least one virtual client based on the set number of virtual clients;
Receiving the multi-view streaming service from a plurality of streaming servers through the executed virtual client, and performing a test on the provided multi-view streaming service based on the set test condition;
Receiving monitoring information on the multi-view streaming service from a management server that manages the plurality of streaming servers; And
And detecting whether an error has occurred in the multi-view streaming service based on the received monitoring information.
The method of claim 12,
The at least one method includes at least one or more of an image playback command, a viewpoint movement command, a screen change command, and a time slice image generation command.
The method of claim 12,
When the test being performed is terminated,
The test method further comprising the step of determining whether the execution period of the ended test corresponds to the set test execution time based on the monitoring information on the ended test.
The method of claim 14,
Resetting the test execution time among the set test conditions to increase when the execution period of the ended test is the same as the set test execution time; And
Further comprising re-performing the test based on the reset test condition.
The method of claim 14,
The step of detecting whether the error has occurred,
If the execution period of the ended test is not the same as the set test execution time, the test method comprising the step of determining whether the monitoring information for the ended test exceeds a preset resource acceptance condition .
The method of claim 16,
The step of detecting whether the error has occurred,
And detecting whether an error has occurred in the multi-view streaming service when the monitoring information for the terminated test does not exceed the preset resource acceptance condition.
The method of claim 16,
Resetting so that the number of virtual clients among the set test conditions is reduced when monitoring information for the terminated test exceeds the preset resource acceptance condition; And
And re-performing the test based on the reset test condition.
A computer program stored in a medium containing a sequence of instructions for testing a multi-view streaming service,
When the computer program is executed by a computing device,
A test condition including one or more of the number of virtual clients for testing the multi-view streaming service, and at least one method and test execution time is set,
Run at least one virtual client based on the set number of virtual clients,
Receiving the multi-view streaming service from a plurality of streaming servers through the executed virtual client, and performing a test on the provided multi-view streaming service based on the set test condition,
Receiving monitoring information on the multi-view streaming service from a management server that manages the plurality of streaming servers,
A computer program stored in a medium comprising a sequence of instructions for detecting whether an error has occurred in the multi-view streaming service based on the received monitoring information.

Images