KR20160069442A - Service error detection apparatus for cloud streaming service, end to end service monitoring system and method thereof - Google Patents

Abstract

The present invention relates to a service error detection apparatus for a cloud streaming service, and an end-to-end service monitoring system and method including the same and, more particularly, to a service error detection apparatus for a cloud streaming service and an end-to-end service monitoring system and method including the same, which can check a service state of each service region by monitoring a situation in which a service is implemented in a user device disposed at an end. The service error detection apparatus comprises: a client management unit which transmits a control signal to a cloud streaming server; a service error detection unit which detects whether a failure occurs; and a message transmission unit which transmits message information regarding whether the failure occurs. According to the present invention, a support can be provided such that a service state of a cloud streaming server can be checked by an administrator or a service management center in real time and a support can be provided such that, when a failure occurs, a message can be transmitted and a rapid measures to solve the failure can be taken.

Description

Technical Field [0001] The present invention relates to a service error detection apparatus for a cloud streaming service, and an end-to-end service monitoring system and method including the service error detection apparatus for the cloud streaming service.

The present invention relates to a service error detection apparatus for a cloud streaming service and a system and method for end-to-end service monitoring including the same. More particularly, the present invention relates to a system and method for end- The present invention relates to a service error detection apparatus for a cloud streaming service, and an end-to-end service monitoring system and method including the same.

In addition to the development of various communication networks, various kinds of data can be transmitted to a terminal device configured at a high speed at a high speed. Accordingly, a cloud streaming server which provides a web application or a video by virtualization stores data in a streaming manner, The development of a cloud streaming service that supports various types of data in a streaming manner and enables the device to be used in real time has become prominent.

However, such a cloud streaming service method may cause a service failure due to an external environment factor or an internal system error in service provision. When the number of communication resources allocated to a user device requesting a streaming service increases, It is increasing together.

Therefore, it is very important to effectively monitor and resolve such service failures in order to provide high-quality services.

However, there is currently no way to check the service status of each user equipment in each service branch. In addition to imposing a burden on the administrator, this method constitutes an extremely inefficient monitoring system. In addition, There is a problem that it is difficult to cope with a service failure quickly because the action must be dependent on the manager's experience.

Therefore, an alternative to the monitoring system of the cloud streaming service is required to solve this problem.

Korean Patent Publication No. 10-2001-0035171

In order to solve the above-mentioned problems, the present invention monitors the service status of each service area providing the cloud streaming service and collects and manages the contents of the occurrence of the failure in the center, This is the purpose of this.

In addition, the present invention provides a client device that configures an endpoint in the same manner as a user device so as to determine a service status between a user device configured at a remote site and a cloud streaming server, The purpose of this study is to support the effective identification and countermeasure of disability.

A service error detection apparatus for a cloud streaming service according to an exemplary embodiment of the present invention includes a client device that receives image information and audio information from a cloud streaming server that compresses and transmits image information and audio information to be output in response to driving of an application A client management unit for transmitting a control signal for capturing a screen according to the outputted image information to a cloud streaming server, a client management unit for delivering a preset key sequence to the cloud streaming server, receiving image information and audio information according to the key sequence, A service error detector for detecting a failure by comparing the captured image with the video information and audio information in a normal state, receiving the captured image generated through the capture from the cloud streaming server and detecting a failure, That operates to transmit the message information to the message transfer part may comprise.

As an example related to the present invention, the client management unit may change the channel of the client apparatus through the control signal, and capture a screen according to the image information output through the changed channel.

As an example related to the present invention, the service error detection unit may include information on a capture object image among the image information through a client management unit, and transmits the control signal.

As an example related to the present invention, the service error detection unit may transmit at least one of a key sequence or a control signal at a predetermined cycle through a client management unit.

As an example related to the present invention, the message transmission unit may control the EMS server to transmit a message related to the type of a failure to a preset contact when a failure is detected.

In one embodiment of the present invention, the service error detection unit outputs a captured image through a separate output unit, and receives a user input on a failure or receives a reference image corresponding to the captured image from the cloud streaming server via a control signal, And detecting a failure through mutual comparison.

An end-to-end service monitoring system for a cloud streaming service according to an exemplary embodiment of the present invention includes a cloud streaming server for compressing image information and audio information output according to driving of an application and transmitting the compressed image information and audio information in a streaming manner, The client device and the cloud streaming server receiving and outputting the information and audio information transmit a preset key sequence to compare the received video information with previously stored video information of the normal state to detect a failure, And a service error detection device for receiving a reference image corresponding to the captured image and the captured image through capturing the image information output by the device and detecting a failure through mutual comparison.

As an example related to the present invention, the service error detection device may generate a message related to the type of a fault upon detection of a fault and transmit the generated message to a preset contact.

The end-to-end service monitoring method for a cloud streaming service of a service error detecting apparatus for determining a service status for each of cloud-streaming servers constituting a service drone installed according to an embodiment of the present invention includes: Transmitting a preset key sequence to a cloud streaming server for compressing and transmitting image information and audio information to be output in accordance with the driving of the mobile terminal; and receiving the video information and audio information according to the key sequence, The method comprising the steps of: comparing a video information and a voice information of a state of a mobile terminal with a voice information to check whether the mobile terminal has a fault, Generating a captured image by capturing a screen according to image information output through the network and transmitting a control signal for generating a reference image corresponding to the captured image to a cloud streaming server, Receiving and comparing images to detect a failure, and operating to send a message upon failure.

As a related example of the present invention, in the step of transmitting a control signal to the cloud streaming server, the service error detection device may include information on the capture object image in the control signal and transmit the control information.

According to the present invention, it is possible to support the service status of the cloud streaming server in real time in a manager or a service operation center, and to send a message in the event of a failure to support a quick troubleshooting action.

In addition, the present invention provides an environment in which a service operation center is not required to confirm a service reception status of an actual user apparatus in a remote area through a client apparatus installed in a service area, The user can determine the service status of the actual user device through the status, thereby reducing the cost of the failure monitoring system and improving the monitoring efficiency. In addition, by effectively determining the service status of the actual user device in the remote area, In this case, it is effective to support prompt action.

1 is a block diagram of a general cloud streaming service system to which an embodiment of the present invention is applied;
2 is a configuration diagram of an end-to-end service monitoring system for a cloud streaming service according to an embodiment of the present invention;
3 is a configuration diagram of a service error detection apparatus for a cloud streaming service according to an embodiment of the present invention.
FIG. 4 to FIG. 6 are diagrams illustrating an operation example of a service error detection apparatus for a cloud streaming service according to an embodiment of the present invention; FIG.
7 is a configuration diagram of a client apparatus according to an embodiment of the present invention;
FIG. 8 is a flowchart illustrating an end-to-end service monitoring method for a cloud streaming service according to an embodiment of the present invention; FIG.

It is noted that the technical terms used in the present invention are used only to describe specific embodiments and are not intended to limit the present invention. In addition, the technical terms used in the present invention should be construed in a sense generally understood by a person having ordinary skill in the art to which the present invention belongs, unless otherwise defined in the present invention, Should not be construed to mean, or be interpreted in an excessively reduced sense. In addition, when a technical term used in the present invention is an erroneous technical term that does not accurately express the concept of the present invention, it should be understood that technical terms can be understood by those skilled in the art. In addition, the general terms used in the present invention should be interpreted according to a predefined or prior context, and should not be construed as being excessively reduced.

Furthermore, the singular expressions used in the present invention include plural expressions unless the context clearly dictates otherwise. In the present invention, terms such as "comprising" or "comprising" and the like should not be construed as encompassing various elements or stages of the invention, Or may further include additional components or steps.

Furthermore, terms including ordinals such as first, second, etc. used in the present invention can be used to describe elements, but the elements should not be limited by terms. Terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals refer to like or similar elements throughout the several views, and redundant description thereof will be omitted.

In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail. It is to be noted that the accompanying drawings are only for the purpose of facilitating understanding of the present invention, and should not be construed as limiting the scope of the present invention with reference to the accompanying drawings.

1 is a block diagram of a general cloud streaming service system to which an embodiment of the present invention is applied. As shown in FIG. 1, a cloud streaming server 200 configuring a service drone for each service area, a cloud streaming server 200, And a user device 20 (i.e., a client) that provides input information for driving a desired application by communicating with the cloud streaming server 200 and receives image information and audio information generated by application of the cloud streaming server 200 through the communication network from the cloud streaming server 200 ).

In this case, the communication network may be a wireless LAN (WLAN), a Digital Living Network Alliance (DLNA), a Wireless Broadband (WIBRO), a World Interoperability for Microwave Access (WIMAX) (Code Division Multiple Access), CDMA2000 (Code Division Multi Access 2000), EV-DO (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), WCDMA (Wideband CDMA), HSDPA (High Speed Downlink Packet Access) (IEEE 802.16), Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), Wireless Mobile Broadband Service (WMBS), Bluetooth (High Speed Uplink Packet Access) , Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Near Field Communication (NFC), Ultra Sound Communication (USC) Visible Light Communication (VLC), Wi-Fi Wireless communications such as Power Line Communication (PLC), USB communication, Ethernet, serial communication, and optical / coaxial cable such as Wi-Fi Direct, Wi-Fi Direct, Method.

The user device 20 may be a set-top box or may be a smart phone having a communication function, a portable terminal, a mobile terminal, a personal digital assistant (PDA), a portable multimedia player (PMP) terminal, a telematics terminal, a navigation terminal, a personal computer, a notebook computer, a slate PC, a tablet PC, an ultrabook, a wearable device (e.g., a smartwatch, a smart glass, and a head mounted display), a Wibro terminal, an Internet Protocol Television (IPTV) ) Terminal, a smart TV, a digital broadcasting terminal, an AVN (Audio Video Navigation) terminal, an A / V (Audio / Video) system, and a flexible terminal .

In addition, the cloud streaming server 200 may be implemented in the form of a web server, a database server, a proxy server, or the like. In addition, the cloud streaming server 200 may be equipped with one or more of a network load balancing mechanism, various software that enables the service device to operate on the Internet or another network, and may be implemented as a computerized system . The network may also be an http network, a private line, an intranet or any other network. Furthermore, the connection of each cloud streaming server 200 and the user device 20 may be connected to a secure network so that the data is not attacked by any hacker or other third party. Also, the cloud streaming server 200 may include a plurality of database servers, which are separately connected to the cloud streaming server 200 through any type of network connection including a distributed database server architecture .

First, the cloud streaming server 200 drives the application program, compresses the video information and audio information output in accordance with the driving of the application in real time, and transmits the compressed video and audio information to the user device 20, In a live streaming manner.

At this time, the cloud streaming server 200 virtualizes and provides the web based on the cloud streaming to provide an application service capable of cloud streaming (CS), and therefore, Service is possible. Accordingly, the cloud streaming server 200 according to the embodiment of the present invention can provide the application in the form of a local browser-based online web application of the user device 20 or an online web application based on the cloud streaming server 200. The application may also refer to a web application implemented according to the application standard of the World Wide Web Consortium (W3C).

At this time, the cloud streaming server 200 can encode the data in H.264 to increase compression efficiency, but it is not limited thereto and various compression algorithms can be applied.

In addition, the cloud streaming server 200 may transmit the compressed image information and audio information to the user device 20 in a streaming manner.

Accordingly, the user device 20 receives the video information and audio information that are being streamed in real time, and synchronizes the video information and the audio information synchronously based on the synchronization information included in the video information and the audio information, Can be reproduced.

At this time, the user device 20 may decode the video information and the audio information in a decoding scheme corresponding to the compression scheme, and then output the video information and the audio information after the rendering process.

On the other hand, the user device 20 provides the user with the result information according to the driving of the application through the outputted image information, and receives the touch input or the key input for operating the application on the screen, It may generate user input information and transmit it to the cloud streaming server 200.

Accordingly, the cloud streaming server 200 may receive the user input information and execute the functions related to the application, and then transmit the video information and the audio information of the execution result to the user device 20 in a streaming manner in real time.

According to the above-described configuration, even if the user apparatus 20 has resources that do not meet the specifications required for running the application, the user can easily operate the application through the cloud streaming server 200 and render the result screen accordingly It is possible to easily drive and virtualize an application on a streaming basis.

However, in the above-described configuration, there is a delay problem occurring in the process of application driving, processing of image information and audio information and data transmission in the cloud streaming server 200, a receiving process, a decoding process, There is a possibility that the service state may be obstructed due to a delay problem occurring in the rendering process and user input reception process or various transmission errors that may occur in the data transmission process.

Therefore, it is required to monitor and solve the problem quickly to provide a high-quality cloud streaming service. However, since it is difficult to determine the service status of all the user devices 20 as in the past, to provide.

Hereinafter, a configuration for this will be described in detail with reference to the drawings.

2 is a configuration diagram of a cloud streaming service system according to an embodiment of the present invention.

As shown in the figure, a service operation center (SOC) corresponding to a service operation center (SOC) which is installed for each service area and transmits various application-related program data to each cloud streaming server 200 constituting a service dron through a communication network, And a service error monitoring unit for monitoring the service status of the image information and the audio information according to the application running through the communication with the user device 20 in the cloud streaming server 200 of each service drone, An EMS (Enhanced Message Service) server that transmits a message to a preset contact when a detection of the failure of the detection device 10 and the service error detection device 10 can be configured.

At this time, the service operation server 1, the service error detection device 10, and the EMS server 2 may be constituted by one virtual real-time service monitoring device or server, Detection server.

According to the above-described configuration, the cloud streaming server 200 installed in each service area and providing a streaming virtualization application service can download and store various applications from the operation server, And then receives the input information to drive the application and provide the resultant video information and audio information to the user device 20 connected to the cloud streaming server 200 in a streaming manner.

Accordingly, the user device 20 receives the video information and the audio information, decodes the video information and the audio information according to a predetermined decoding algorithm, and outputs a screen corresponding to the video information. The user device 20 touches the output screen of the user, And transmits the generated input information to the cloud streaming server 200. The cloud streaming server 200 receives the input information,

The cloud streaming server 200 selects the function of the web application corresponding to the input information according to the reception of the input information, generates the resultant image information and the resultant audio information, and outputs the resulting image information and the resulting audio information to the compression And transmit it to the user device 20. [

Accordingly, in the user device 20, the application can be easily virtualized without restriction of the system structure or hardware.

In order to smoothly execute the web application provided by the user device 20 in a real-time streaming manner in the above-described configuration, it is required that the driving screen of the application be accurately provided to the user device 20 without obstacle.

However, since it is difficult to directly detect the occurrence of a failure due to various factors described above from the user device 20, end-to-end service monitoring is required to check whether an actual service is erroneous.

In order to solve this problem, a client device 100 (e.g., a set-top box (STB)), which is a device drone capable of checking service status and remotely controlling the regional operation center, can be configured.

The service error detection apparatus 10 may control the client apparatus 100 through the cloud streaming server 200 and may be connected to the client apparatus 100 having the same environment as the user apparatus 20 The service status can be determined in the same environment as that of the user device 20. [

In other words, the service error detection device 10 monitors the status of the client device 100 through the cloud streaming server 200 and notifies the service operation server 1 of the service error to the EMS server 2, So that the trouble can be solved quickly.

At this time, the client device 100 may be a set-top box, or may be a smart phone, a portable terminal, a mobile terminal, a personal digital assistant (PDA), a portable multimedia player (PMP) terminal, a telematics terminal, a navigation terminal, a personal computer, a notebook computer, a slate PC, a tablet PC, an ultrabook, a wearable device (e.g., a smartwatch, a smart glass, and a head mounted display), a Wibro terminal, an Internet Protocol Television (IPTV) ) Terminals, smart TVs, digital broadcasting terminals, AVN (Audio Video Navigation) terminals, A / V (Audio / Video) systems, and flexible terminals, A.

The service error detection device 10 accesses the corresponding cloud streaming server 200 and monitors the state of the corresponding service drone (state information, screen information, etc.) while controlling the service method or channel of the client device 100, And monitors the error detected by the service error detecting apparatus 10 to provide information about the error directly to the service operation center through the EMS server 2 at the time of failure detection or to provide the error information to the administrator Indirectly.

With this configuration, the service status of each region can be checked in real time in the service operation center, and the status of the real user device 20 in the remote area can be confirmed in real time through the client device 100 in the event of a failure.

The detailed configuration for end-to-end service monitoring of the service error detection device 10 will be described with reference to the drawings with reference to the above-described configuration.

3 is a detailed configuration diagram of the service error detection apparatus 10 and may include a client management unit 11, a service error detection unit 12, and a message transmission unit 13 as shown in FIG.

At this time, not all of the components of the illustrated service error detecting device 10 are required components, and the service error detecting device 10 may be implemented by more components than the illustrated components, The service error detection device 10 may be implemented by the service error detection device 10 as well.

First, the service error detection unit 12 transmits a preset key sequence to the cloud streaming server 200 configured in the service drones in each region, receives image information and audio information according to the key sequence, And the voice information to confirm whether or not the failure has occurred.

For example, the service error detection unit 12 and the cloud streaming server 200 store in advance a key sequence that can confirm a video according to a driving instruction of a specific application or an execution of a specific application with respect to commands such as image playback and image extraction And the service error detection unit 12 can transmit the key sequence to the cloud streaming server 200. [

In addition, the service error detection unit 12 can previously store reference image information and audio information generated upon execution of the application according to the key sequence.

Accordingly, the cloud streaming server 200 provides the video information and audio information generated according to the execution of the application according to the key sequence provided from the service error detection unit 12 to the service error detection unit 12 of the service error detection apparatus 10 can do.

The service error detection unit 12 can decode the video information and the audio information from the cloud streaming server 200 and then render the same to be compared with the reference video information and audio information.

Accordingly, the service error detection unit 12 determines whether the video information and the audio information provided in a streaming manner match with the operation state of the cloud streaming server 200 and the reference video information and the audio information without delay, according to the execution of the application .

In addition, the service error detection unit 12 can perform image comparison of reference image information and audio information with image information and audio information received from the cloud streaming server 200, If data inconsistency with reference video information and audio information due to loss or distortion occurs, it can be judged as a failure.

At this time, the service error detector 12 may determine that the service error is normal when the image comparison is not less than a preset reference value, and may determine that the error is below a preset reference value.

According to the above description, the service error detection unit 12 can detect whether an operation delay of each of the cloud streaming servers 200 constituting the service drone for each region occurs or an internal error occurs.

In other words, the service error detecting unit 12 operates as a client apparatus 100 equivalent to the user apparatus 10 that has received the virtualization application streaming service from the cloud streaming server 200, and is provided with streaming along with execution of the application Video information, and audio information, and it can be determined from the client's point of view whether the received video information and audio information are normally served.

At this time, the service error detecting unit 12 detects the service error of each cloud streaming server 200 through the client DB 14 storing the identification information of the connection address and the service area of each cloud streaming server 200 constituting the service drones by region, It is possible to judge whether or not there is a failure.

In addition, the service error detection unit 12 can identify the type of a fault by comparing the video information and the audio information provided from the cloud streaming server 200 with the reference video information and the audio information. For example, And an image error occurrence.

In addition, the service error detector 12 may generate the fault information according to the fault type, and may store the fault information in the fault history DB 15 by matching with the identification information of the faulty cloud streaming server 200.

4, the service error detection unit 12 transmits a predetermined key sequence to the cloud streaming server 200, and transmits the key sequence to the cloud streaming server 200. [ It is possible to receive the video information and the audio information generated in accordance with the capture of the execution screen and audio by the streaming method.

Accordingly, the service error detecting unit 12 decodes and renders the video information and the audio information received by the streaming method, and then compares the video information and the audio information with reference video information and audio information corresponding to the key sequence. have.

Thereafter, the service error detection unit 12 can generate the failure information upon occurrence of a failure and provide the failure information to the message transmission unit 13.

The message transmitting unit 13 can communicate with the EMS server 2 through a communication network as shown in the figure. The message transmitting unit 13 can generate message information according to the fault information and transmit the message information to the EMS server 2. In this case, the message information may include the identification information of the failed cloud streaming server 200 and the contact information preset in the message transmission unit 13.

On the other hand, the EMS server 2 may transmit the message information through a short message or E-mail based on preset contact information at the time of receiving the message information. For example, the manager device, corresponding to the contact information, Information can be received.

Accordingly, the administrator can promptly determine whether the failed cloud streaming server 200 has failed, so that the failover can be performed.

It goes without saying that the EMS server 2 can directly notify the failure of the cloud streaming server 200 by transmitting the message information to the service operation server 1. [

As described above, the service error detecting unit 12 can judge whether each service drones is faulty or not and can easily take measures.

It is important to determine the reception state of the user device 20 in order to determine whether or not a fault occurs between the user devices 20 in the cloud streaming server 200. However, Therefore, the present invention can configure a separate client device 100 communicating with the cloud streaming server 200 in the service drones.

In addition, the service error detection apparatus 10 may include a client management unit 11 for controlling the client apparatus 100. [

The client management unit 11 controls the client device 100 located in the same service area as the user device 20 through the cloud streaming server 200 located in the same service area and provides the same from the cloud streaming server 200 The service error detecting unit 12 may be configured to control the video and audio information to be received by the user device 20 and to determine whether the normal service is being performed.

5, the service error detecting unit 12 detects a service failure in the user device 20 through the client management unit 11, (100) for capturing the same image as the reference image from the client device (100) controlled by the cloud streaming server (200) so as to transmit at least one reference image among the image information served according to the driving of the application from the server Signals to the cloud streaming server 200. [

In response to the control signal, the cloud streaming server 200 captures one or more images of the image information generated in response to the control signal to generate a reference image, and then the service error detecting unit 12 ).

In addition, the cloud streaming server 200 transmits the video information and audio information to the client device 100 in response to the control signal, and controls the client device 100 according to the control signal, To capture the same image.

At this time, the client device 100 may capture an image based on a preset time point in the image information transmitted from the cloud streaming server 200 in response to the control of the cloud streaming server 200, and generate a captured image.

Thereafter, the cloud streaming server 200 may transmit the reference image and the captured image to the service error detection unit 12 in response to the control signal.

Accordingly, the service error detection unit 12 can receive and compare the reference image and the captured image, compare whether the captured image matches the reference image, and determine whether the service is normally performed in the user device 20 can do.

Accordingly, the service error detection unit 12 can determine whether there is a normal operation (or whether there is a failure / an error) and generate failure information on the determination result. At this time, the fault information may include information on the fault type.

The service error detection unit 12 may transmit a control signal for receiving only the captured image to the cloud streaming server 200. The service error detection unit 10 may include a separate output unit Lt; / RTI >

Accordingly, the service error detection unit 12 may output the capture image for each service area through the display of the corresponding output unit so that the administrator can visually check the service status.

In addition, the service error detection apparatus 10 may further include a user interface unit for inputting a service area corresponding to the detection of a failure by the visual determination of the administrator. The service error detection unit 12 may include a user interface unit Identifies the service area corresponding to the selected captured image, extracts the identification information corresponding to the service area from the client DB 14, inputs the information on the type of the failure through the user interface unit, matches the identification information with the identification information, As failure information.

Thereafter, the service error detector 12 may provide the error message to the message transmitter 13 when the error information is generated.

The message transmission unit 13 can communicate with the EMS server 2 through the communication network as described above, and can generate message information according to the failure information and transmit the message information to the EMS server 2. In this case, the message information may include the identification information of the failed cloud streaming server 200 and the contact information preset in the message transmission unit 13.

On the other hand, the EMS server 2 may transmit the message information through a short message or E-mail based on preset contact information at the time of receiving the message information. For example, the manager device, corresponding to the contact information, Information can be received.

Accordingly, the administrator can determine that the service drones are out of order, and notify the cloud streaming server 200 and the respective user devices 20 of the problem to solve the problem.

It goes without saying that the EMS server 2 can directly notify the failure of the cloud streaming server 200 by transmitting the message information to the service operation server 1. [

As described above, the service error detection unit 12 can determine whether or not a failure (error) occurs in the user device 20 receiving the service provided from the cloud streaming server 200 as well as the cloud streaming server 200 And it is possible to facilitate the action by this.

The service error detector 12 controls the client device 100 through the cloud streaming server 200 to monitor the state of the client device 100 (state information, screen information, etc.) Thereby detecting a service error.

The service error detection unit 12 can transmit at least one of the key sequence or the control signal at a predetermined cycle through the client management unit 11. The service error detection unit 12 periodically determines the service state for each service area, .

In this case, the service error detecting unit 12 may transmit at least one of the key sequence or the control signal in real time to determine the service state for each region in real time.

6, the service error detection unit 12 can control the channel streaming server 200 to provide a channel change control signal through the client management unit 11. [

Accordingly, the cloud streaming server 200 may change the channel according to the reception of the control signal, and may generate the reference image by capturing at least one image from the image information according to the channel change

In addition, the cloud streaming server 200 provides the generated image information to the client device 100 based on the channel change according to the control signal, and displays the received image information on the changed channel in the client device 100 To capture at least one image corresponding to the reference image to generate a captured image, and receive the captured image from the client device 100.

Thereafter, the cloud streaming server 200 may transmit the reference image and the captured image to the service error detecting unit 12 of the service error detecting apparatus 10. [

Accordingly, the service error detecting unit 12 compares the reference image with the captured image, and determines whether the reference image and the captured image are faulty according to whether they match or not. Then, the service error detecting unit 12 generates message information through the message transmitting unit 13 and transmits the message information to the EMS server 2, To be notified to the operation server 1 or to allow the message to be delivered to the administrator via E-mail or SMS.

As described above, the service error detector 12 can remotely control the desired function through the client device 100 through the cloud streaming server 200, It is possible to judge in real time whether there is a failure or an error in the data.

In the above-described configuration, each component of the service error detection device 10 may be software stored on the memory of the service error detection device 10. [ The memory may be an internal memory of the service error detection device 10, and may be an external memory or other type of storage device. Further, the memory may be a non-volatile memory. The software stored on the memory may include a set of instructions that cause the service error detection device 10 to perform certain operations upon execution. The client management unit 11, the service error detection unit 12 and the message transmission unit 13 of the service error detection device 10 may be connected to each other or may be connected to the processor and the memory of the service error detection device 10. [

7 is a configuration diagram of a client apparatus 100 according to an embodiment of the present invention. The client apparatus 100 includes a communication unit 110, a storage unit 120, an input unit 130, a display unit 140, and a control unit 150 .

Not all of the components of the client device 100 shown in Fig. 7 are essential components, and the client device 100 may be implemented by more components than the components shown in Fig. 7, The client device 100 may be implemented by the client device 100 as well.

The client device 100 also includes a browser for communicating with the cloud streaming server 200 via a communication network, a memory for storing programs and protocols, a terminal for executing various programs, Lt; / RTI >

That is, the client device 100 can be any terminal capable of communicating with the cloud streaming server 200.

For example, the client device 100 accesses the cloud streaming server 200 to request a specific service or function according to a user input, and displays a result screen on execution of the requested service or function from the cloud streaming server 200 And can receive and output it.

The client device 100 may be a virtual client module that virtualizes a client on the user side that is provided with a cloud streaming service from the cloud streaming server 200. [

First, the communication unit 110 is for accessing the service device 200 via a wired / wireless network and communicating with the cloud streaming server 200. The communication unit 110 may transmit a request message for requesting a web page, a moving picture, or the like to the service device 200 under the control of the control unit 150. Also, the communication unit 110 can receive a web page, a moving image, and the like from the service device 200. [

At this time, the communication unit 110 receives the application according to the streaming technique. The communication unit 110 may further include a function of processing data according to a type of network and a protocol applied to the network.

Also, the communication unit 110 communicates with at least one external terminal or any internal component via a wired / wireless communication network. At this time, the external arbitrary terminal may include a network service system, a server, a cloud streaming server 200, and the like. Here, the wireless Internet technology includes a wireless LAN (WLAN), a digital living network alliance (DLNA), a wireless broadband (Wibro), a world interoperability for a microwave (WiMAX), a high speed downlink packet access ), HSUPA (High Speed Uplink Packet Access), IEEE 802.16, Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), Wireless Mobile Broadband Service (WMBS) And the communication unit 110 transmits and receives data according to at least one wireless Internet technology in a range including internet technologies not listed above. In addition, the near field communication technology includes Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, Near Field Communication (NFC) , Ultra Sound Communication (USC), Visible Light Communication (VLC), Wi-Fi, and Wi-Fi Direct. The wired communication technology may include a power line communication (PLC), a USB communication, an Ethernet, a serial communication, an optical / coaxial cable, and the like.

In addition, the communication unit 110 can transmit information to and from an arbitrary terminal through a universal serial bus (USB).

The communication unit 110 forms (or forms) a connection (or a connection / session) with the cloud streaming server 200 under the control of the control unit 150. [

The display unit 140 is a means for outputting information generated by use of the client device 100 so that the user can visually recognize the information. The display unit 140 may be a touch screen and the display unit 140 may perform some or all of the functions of the input unit 130 when the display unit 140 is formed in the form of a touch screen have.

For example, the display unit 140 can display various contents such as various menu screens by using the user interface and / or graphical user interface stored in the storage unit 120 under the control of the controller 150. [

Here, the content displayed on the display unit 140 includes various text or image data (including various information data) and a menu screen including data such as an icon, a list menu, and a combo box.

Also, the display unit 140 may be a touch screen. At this time, a touch sensor for sensing the touch gesture of the user may be included. The touch sensor may be one of various types such as an electrostatic type, a pressure sensitive type, a piezoelectric type, and the like. In the case of the electrostatic type, the touch coordinates are calculated by sensing the minute electricity that is excited by the user's body when a part of the user's body is touched on the touch screen surface by using the dielectric coated on the surface of the touch screen. In the case of the pressure sensitive type, two electrode plates are built in the touch screen. When the user touches the screen, the upper and lower electrode plates of the touched position contact each other and current flows.

In addition, the client device 100 may support a pen input function, in which case a gesture of a user utilizing an input means such as a pen, which is not part of the user's body, may be sensed. For example, if the input means is a stylus pen containing a coil therein, the client device 100 may include a magnetic field sensing sensor for sensing a magnetic field that is varied by a coil within the stylus pen. In this case, not only the user's touch gesture but also the proximity gesture of the user such as hovering can be detected.

The display unit 140 may be a liquid crystal display (LCD), a thin film transistor liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display (LCD), a flexible display, a 3D display, an e-ink display, and a light emitting diode (LED), and includes a driving circuit, a backlight unit, and the like can do.

The input unit 130 may include at least one of a command, a selection, data, and information of a user. The input unit 130 may include a plurality of input keys and function keys for receiving numeric or character information and setting various functions. The input unit 130 senses a key input of the user and transmits an input signal corresponding to the sensed key input to the controller 150.

The input unit 130 may include a key pad, a dome switch, a touch pad (static / static), a touch screen, a jog wheel, a jog switch, a jog shuttle, a mouse, a stylus pen, a touch pen, or the like may be used. Particularly, when the display unit 140 is formed in the form of a touch screen, some or all of the functions of the input may be performed through the display unit 140.

The storage unit 120 is an apparatus for storing data, and includes a main storage device and an auxiliary storage device. The storage unit 120 stores various user interfaces (UI), a graphical user interface (GUI), and the like.

In addition, the storage unit 120 stores data and programs necessary for the client device 100 to operate.

That is, the storage unit 120 may store a plurality of application programs (application programs or applications) driven by the client apparatus 100, data for operation for capturing the image information, and commands. At least some of these applications may be downloaded from an external server via wireless communication. Meanwhile, the application program may be stored in the storage unit 120, loaded by the control unit 150, and operated to perform the above-described capture operation (or function).

The storage unit 120 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory A random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a PROM (Programmable Read-Only Memory). In addition, the client device 100 may operate in association with web storage or operate web storage to perform the storage function of the storage unit 120 on the Internet.

The control unit 150 may be a process unit that actually operates the operating system. For example, the control unit 150 may be a central processing unit (CPU). When the client apparatus 100 is powered on, the control unit 150 moves the operating system from the auxiliary storage unit of the storage unit 120 to the main storage unit, and then performs booting to drive the operating system.

The control unit 150 may transmit a request message to the cloud streaming server 200 through the communication unit 110 in response to a request from the user. Accordingly, the control unit 150 can receive data on the video information and the audio information from the cloud streaming server 200 through the communication unit 110 in a streaming manner.

The control unit 150 may be activated by receiving a power control signal from the cloud streaming server 200 that receives the control signal from the service error detection apparatus 10. When the control unit 150 receives the power control signal from the cloud streaming server 200, It is possible to receive the video information and the audio information corresponding to the control signal of the device 10 in a streaming manner.

For example, the cloud streaming server 200 provides a power control signal to the client device 100 via infrared communication in accordance with a control signal received from the service error detection device 10 to activate the client device 100, The video information and the audio information corresponding to the control signal of the error detection apparatus 10 can be transmitted to the client apparatus 100 in a streaming manner.

The control unit 150 of the client device 100 is activated when the power control signal is received through the communication unit 110 and the activated control unit 150 receives the service error from the cloud streaming server 200 through the communication unit 110. [ It is possible to receive the video information and the audio information corresponding to the control signal of the detection apparatus 10 in a streaming manner.

The control unit 150 may output the video information and the audio information through the display unit 140 or the external display device. The control unit 150 may receive the video information output on the screen of the display unit 140 according to the control of the cloud streaming server 200 It is possible to capture an image at a specific point in time to generate a captured image and provide it to the cloud streaming server 200 through the communication unit 110. [

The cloud streaming server 200 may transmit the captured image and reference image received from the client device 100 to the service error detection device 10 to support the detection of the failure.

In addition, a processor mounted on the client device 100 or the cloud streaming server 200 according to the present invention can process program instructions for executing the method according to the present invention. In one implementation, the processor may be a single-threaded processor, and in other embodiments, the processor may be a multi-threaded processor. Further, the processor is capable of processing instructions stored on a memory or storage device.

In addition, the various devices and components described herein may be implemented by hardware circuitry (e.g., CMOS-based logic circuitry), firmware, software, or a combination thereof. For example, it can be implemented utilizing transistors, logic gates, and electronic circuits in the form of various electrical structures.

8 is a flowchart illustrating an end-to-end service monitoring for a cloud streaming service of a service error detection device 10 for determining a service status for each of cloud streaming servers 200 constituting a service dron installed according to an embodiment of the present invention. It is a flowchart for the method.

As shown in the figure, the service error detection apparatus 10 may transmit a preset key sequence to the cloud streaming server 200, which compresses and transmits image information and audio information output according to the driving of the web application (S1).

Next, the service error detection apparatus 10 receives the image information and the audio information according to the key sequence (S2), and compares the image information and the audio information with the previously stored image information and audio information to check whether there is a failure (S3).

For example, the service error detection apparatus 10 and the cloud streaming server 200 store a key sequence capable of confirming an image according to a driving instruction of a specific application or an execution of a specific application with respect to commands such as image reproduction and image extraction And the service error detection device 10 can transmit the key sequence to the cloud streaming server 200. [

In addition, the service error detection apparatus 10 can previously store the reference image information and the audio information generated upon execution of the application according to the key sequence.

Accordingly, the cloud streaming server 200 transmits the video information and audio information generated according to the application execution according to the key sequence provided from the service error detection device 10 to the service error detection device 10 of the service error detection device 10, .

Then, the service error detection device 10 decodes the video information and audio information received from the cloud streaming server 200, and then decodes the video information and the audio information. The service error detection device 10 can compare the reference video information and the audio information, (S4).

Accordingly, the service error detection apparatus 10 judges whether the video information and the audio information provided in a streaming manner coincide with the reference video information and the audio information without delay, in accordance with the operation state of the cloud streaming server 200, can do.

In addition, the service error detection apparatus 10 can perform image comparison of reference image information and audio information with image information and audio information received from the cloud streaming server 200, If data inconsistency with reference video information and audio information due to data loss or distortion occurs, it can be judged as a fault.

At this time, the service error detection apparatus 10 may determine that the service error is normal when the image comparison is not less than a preset reference value, and may determine that the error is less than a preset reference value.

According to the above description, the service error detection device 10 can detect whether an operation delay of each cloud streaming server 200 constituting a service drone for each region occurs or an internal error occurs.

In other words, the service error detection apparatus 10 operates as a client apparatus 100 equivalent to the user apparatus 20 that has been provided with the virtualization application streaming service from the cloud streaming server 200 and provides the streaming service along with execution of the application And can determine whether the received video information and audio information are normally served from a client's point of view.

At this time, the service error detection device 10 detects the service error of each cloud streaming server 200 through the client DB 14, which stores identification information on the connection address and service area of each cloud streaming server 200, ) Can be connected to determine whether or not a fault has occurred.

In addition, the service error detection apparatus 10 can identify the type of a fault based on a comparison between the video information and the audio information provided from the cloud streaming server 200, the reference image information, and the audio information. For example, It is possible to discriminate the types of faults by various kinds such as occurrence or image error occurrence.

The service error detection apparatus 10 may generate failure information according to the type of failure and then store the failure information in the failure history DB 15 by matching with the identification information of the failed cloud streaming server 200.

Thereafter, the service error detection apparatus 10 may operate to transmit a message to the client apparatus 100 in which a failure has occurred, based on the failure information and the identification information when the failure occurs (S5).

At this time, the service error detecting apparatus 10 provides information on errors generated through monitoring in the event of a failure directly to a service operation center (SOC) through the EMS server 2, And the like.

With this configuration, service status of each region can be checked in real time at the service operation center.

Meanwhile, the service error detection apparatus 10 is connected to the cloud streaming server 200 through a separate client device 100 communicating with the cloud streaming server 200 in order to determine whether a failure occurs between the user devices 20 in the cloud streaming server 200 It is possible to determine whether or not the user terminal 20 has failed at the terminal corresponding to the user terminal 20. [

To this end, the service error detection device 10 transmits at least one reference image among the image information to be served according to the driving of the application from the cloud streaming server 200 in order to determine a service failure at the user device 20 And transmits a control signal to the cloud streaming server 200 for capturing and transmitting the same image as the reference image from the client device 100 controlled by the cloud streaming server 200 (S6).

At this time, the service error detection apparatus 10 may transmit information (for example, capture time) about the image to be captured in the control information including the control information.

In response to the control signal, the cloud streaming server 200 may capture or extract one or more images of the image information generated according to the driving of the application, generate the reference image, and transmit the reference image to the service error detection device 10 .

The cloud streaming server 200 also controls the client device 100 in accordance with the control signal received from the service error detection device 10 to transmit the image information including the reference image to the client device 100, It is possible to capture the same image as the reference image on the screen according to the output of the server 200 and transmit the captured image to the cloud streaming server 200.

Thereby, the cloud streaming server 200 can receive the capture image generated through the capture from the client device 100, and can transmit the captured image to the service error detection device 10 together with the reference image.

Thereafter, the service error detection apparatus 10 receives the capture image and the reference image, and compares the captured image and the reference image with each other (S7).

Accordingly, the service error detecting apparatus 10 can compare whether the captured image matches the reference image, and determine whether the service is normally performed at the user apparatus 20. Accordingly, Whether or not there is an error or not), and generate failure information when a failure occurs. At this time, the fault information may include information on the fault type (S8).

The service error detection apparatus 10 may transmit a control signal for receiving only a captured image to the cloud streaming server 200. The service error detection apparatus 10 may include a separate output Can be connected to the department.

Accordingly, the service error detection apparatus 10 may output the capture image for each service area through the display of the corresponding output unit so that the administrator can visually check the service status.

In addition, the service error detection device 10 can receive failure information from a manager through user input, by receiving information on a service area where a failure occurs.

Next, the service error detecting apparatus 10 can operate to transmit a message in the event of a failure according to a comparison of the captured image and the reference image (S5).

At this time, the service error detection apparatus 10 also provides information on errors generated through monitoring in the event of a failure directly to a service operation center (SOC) through the EMS server 2, It can be indirectly provided to the administrator.

In this way, the service operation center can confirm the status of the real user device 20 in the remote area through the client device 100 in real time, and can easily check the service status between the cloud streaming server 200 and the user device 20 And can help prompt action in the event of a disability.

The end-to-end service monitoring method for the cloud streaming service according to the embodiment of the present invention described above can be written as a computer program, and the codes and code segments constituting the computer program can be easily Can be deduced. In addition, the computer program is stored in a computer readable medium, readable and executed by a computer, a service error detection device, a client device, a cloud streaming server, etc. according to an embodiment of the present invention, An end-to-end service monitoring method for a streaming service can be implemented.

The information storage medium includes a magnetic recording medium, an optical recording medium, and a carrier wave medium. The computer program implementing the end-to-end service monitoring method for the cloud streaming service according to the embodiment of the present invention can be stored and installed in the service error detection device, the client device, and the internal memory of the cloud streaming server. Alternatively, an external memory such as a smart card storing and installing a computer program for implementing an end-to-end service monitoring method for a cloud streaming service according to an embodiment of the present invention may be connected to a service error detection device, a client device, a cloud streaming server As shown in FIG.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or essential characteristics thereof. Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents should be construed as falling within the scope of the present invention.

The present invention is based on a service state of a cloud streaming server that transmits data in accordance with application running in real time in a streaming manner in each service area and a service state of a client device corresponding to a user device that receives a cloud streaming service, And can support real-time confirmation from an administrator or a service operation center, and at the same time, it can transmit a message in case of a failure to enable quick trouble shooting, and can be widely used in the fields of cloud streaming service and streaming server.

1: Service Operation Server 2: EMS Server
10: Service error detecting device 11:
12: service error detection unit 13: message transmission unit
100: client device 200: cloud streaming server

Claims (10)

A control unit for receiving a control signal for capturing a screen according to image information output from a client device for receiving the image information and audio information from a cloud streaming server for compressing and transmitting image information and audio information to be output according to driving of an application, A client management unit for transmitting the streaming data to the streaming server;
Transmits the preset key sequence to the cloud streaming server, receives image information and audio information according to the key sequence, compares the received image information and audio information with previously stored normal image information and audio information, A service error detector for receiving a captured image from the cloud streaming server and detecting a failure; And
And a message transmission unit operable to transmit message information on the failure status to the service error detection unit. The method according to claim 1,
Wherein the client management unit changes the channel of the client apparatus through the control signal and captures a screen according to the image information output through the changed channel. The method according to claim 1,
Wherein the service error detection unit transmits the control signal including information on a capture target image among the image information through the client management unit. The method according to claim 1,
Wherein the service error detection unit transmits at least one of the key sequence or the control signal at a predetermined period through the client management unit. The method according to claim 1,
Wherein the message transmission unit controls the EMS server to transmit a message related to the type of the failure to the preset contact when the failure is determined. The method according to claim 1,
Wherein the service error detection unit outputs the captured image through a separate output unit and receives a user input of a failure or receives a reference image and a captured image corresponding to the captured image from the cloud streaming server through the control signal And detecting a failure through a comparison between the service error and the service error. A cloud streaming server for compressing and outputting video information and audio information to be output in accordance with a driving method of the application;
A client device for receiving and outputting image information and audio information received from the cloud streaming server; And
Transmitting the preset key sequence to the cloud streaming server to compare the received image information with previously stored image information of the normal state to detect a failure, and to capture the image information output by the client device through the cloud streaming server And a service error detection unit for receiving a reference image corresponding to the captured image and detecting a failure through mutual comparison. The method of claim 7,
Wherein the service error detection device generates a message related to the type of a failure when the failure is detected and transmits the generated message to a preset contact. An end-to-end service monitoring method for a cloud streaming service of a service error detection device for determining a service status for each cloud streaming server constituting an installed service dron for each service area,
Transmitting the preset key sequence to the cloud streaming server for compressing and transmitting the video information and the audio information output by the service error detection device when the application is driven;
The service error detection device receives image information and voice information according to the key sequence and compares the received image information and voice information with previously stored image information and voice information to check whether there is a failure, ;
Wherein the service error detection device generates a captured image by capturing a screen according to image information output through a client device that receives the image information and audio information from the cloud streaming server, Transmitting a control signal to the cloud streaming server to generate a control signal; And
Wherein the service error detection device is operable to receive and compare the captured image and the reference image to detect a failure and to send a message upon failure. The method of claim 9,
Wherein the step of transmitting the control signal to the cloud streaming server comprises transmitting the control signal including information on a capture target image among the image information to the service error detection device. How to monitor.

Images