KR20160087227A - System for cloud streaming service, method of image cloud streaming service using animation message and apparatus for the same - Google Patents

Abstract

Disclosed are a system for a cloud streaming service, a method for an image cloud streaming service using an animation message, and an apparatus for the same. Timing for screens corresponding to an animation among application execution screens is acquired. Frames corresponding to the timing among the application execution screens are captured, and varying regions are extracted. Still image encoding is performed on the varying regions by using a still image compression technique. An animation message, including the varying regions on which the still image encoding has been performed and information of the animation, is transmitted to a user terminal so that the screens corresponding to the animation can be generated on the user terminal. Accordingly, a still image-based cloud streaming service can be performed. Timing in which the cloud streaming server performs capturing is provided, and thus the server captures a minimum number of screens, thereby enabling system resources used for performing unnecessary capturing to be reduced.

Description

TECHNICAL FIELD [0001] The present invention relates to a cloud streaming service system, an image cloud streaming service method using an animation message, and a device for the same. BACKGROUND ART [0002]

The present invention relates to a technology for providing a still image based cloud streaming service by transmitting an animation message together with an encoded image. More particularly, the present invention relates to a technology for providing a still image based cloud streaming service by transmitting an animation- A cloud streaming service system capable of generating an animation-applied screen, an image cloud streaming service method using an animation message, and an apparatus therefor.

Recently, due to the development of the Internet, the speed of communication using a personal mobile communication device has been dramatically improved. Based on this, an Internet environment such as downloading and uploading a large amount of data through a remote computer connection or locally logging into a remote computer . In addition, as a variety of applications have been developed for mobile communication terminals such as smart phones, many virtualization technologies have been proposed for driving applications requiring high performance in relatively low performance user terminals. Among them, the application is driven on the server, the driving screen is compressed through video encoding and transmitted to the client, and the client reproduces the transmitted video to generate a screen virtualization Cloud streaming service is becoming popular.

Although the cloud streaming service based on the video codec is applied to the cloud streaming service based on the video codec, when the service such as the menu display is provided, the entire screen is unnecessarily captured and operated using the video codec, exist.

Therefore, there is a need for a new cloud streaming technology capable of providing dynamic animation that can be superimposed on the screen, while appropriately dynamically animating. In particular, it provides timings to capture such that even when dynamic, such as a menu display with animated effects, does not capture unnecessarily large screens, and transmits information related to animations to the client's set-top box, A technology capable of creating a service screen is urgently required.

Korean Patent Laid-Open No. 10-2014-0076668, published on June 23, 2014 (name: game providing method, system, client terminal and service apparatus based on cloud streaming)

It is an object of the present invention to provide an effective cloud streaming service when serving a screen such as a menu display which is not suitable for applying video-based cloud streaming technology.

It is another object of the present invention to provide a cloud streaming service method capable of providing a screen in which an animation is applied in a set-top box of a client without capturing an unnecessarily large number of screens in a cloud streaming server when a dynamic display is required by applying animation to a menu .

It is also an object of the present invention to provide a cloud streaming server with a timing to capture and save a system resource used to perform unnecessary capturing by capturing only a minimum screen in a server.

According to an aspect of the present invention, there is provided a cloud streaming server comprising: a timing acquisition unit for acquiring a timing of a screen corresponding to an animation in an application execution screen; A capture unit for capturing a frame corresponding to the timing of the application execution screen and extracting a change area; An encoding unit for still image encoding the change area using a still image compression scheme; And a sending unit for transmitting a still image-encoded cloud streaming service to the user terminal by transmitting an animation message including the change area and the animation information to the user terminal so that the user terminal can generate a screen corresponding to the animation do.

In this case, the timing acquiring unit may sense a deformation effect included in the application execution screen, and may acquire a timing corresponding to a portion of the application execution screen where the deformation effect is sensed.

At this time, the animation information may include at least one of animation type, start coordinate, end coordinate, start size, end size, start transparency, end transparency, and application time.

At this time, the deformation effect may correspond to at least one of an animation timing change, an animation screen color change, and an animation shape change.

At this time, the capturing unit may extract the change area by comparing a frame corresponding to the timing with a previous frame of a frame corresponding to the timing.

At this time, the still image compression technique may correspond to any one of portable network graphics (PNG), portable network graphics (PNG) and joint experts group (JPEG).

In this case, the animation message may be generated using a message including the animation information received from the application server.

According to another aspect of the present invention, there is provided a method of providing a cloud streaming service using an animation message, the method comprising: acquiring a timing of a screen corresponding to an animation in an application execution screen; Capturing a frame corresponding to the timing among the animation execution screens and extracting a change area; Still image encoding the change area using a still image compression technique; And a still image-based cloud streaming service by transmitting an animation message including still image-encoded change area and animation information to the user terminal so that a screen corresponding to the animation can be generated at the user terminal do.

In this case, the step of acquiring the timing may include sensing a deformation effect included in the application execution screen, and may obtain a timing corresponding to a portion of the application execution screen where the deformation effect is sensed.

At this time, the animation information may include at least one of animation type, start coordinate, end coordinate, start size, end size, start transparency, end transparency, and application time.

At this time, the deformation effect may correspond to at least one of an animation timing change, an animation screen color change, and an animation shape change.

In this case, the step of extracting the change area may extract the change area by comparing a frame corresponding to the timing with a previous frame of a frame corresponding to the timing.

At this time, the still image compression technique may correspond to any one of portable network graphics (PNG), portable network graphics (PNG) and joint experts group (JPEG).

At this time, the animation message may be generated using a message including the animation information received from the application server.

As another means for solving the problem of the present invention, there is provided a computer program stored in a medium for executing the above-described method.

In addition, the cloud streaming service system according to the present invention acquires the timing of the animation execution portion of the application execution screen, captures the frame corresponding to the timing of the animation execution screen to extract the change region, And transmits an animation message including still image-encoded change area and animation information to the user terminal so that the user terminal can generate a screen corresponding to the animation, A cloud streaming server performing an image-based cloud streaming service; And a terminal for receiving an application execution result screen corresponding to the still image based cloud streaming service from the cloud streaming server.

According to the present invention, it is possible to provide an effective cloud streaming service when a screen such as a menu display that is not suitable for applying a video-based cloud streaming technology is served.

Also, the present invention provides a cloud streaming service method capable of providing a screen in which an animation is applied in a set-top box of a client without capturing an unnecessarily large number of screens in a cloud streaming server when a dynamic display is required by applying animation to a menu .

In addition, the present invention can save the system resources used to perform unnecessary capturing by providing the timing to capture by the cloud streaming server and capturing only the minimum screen in the server.

1 is a block diagram illustrating a cloud streaming service system according to an embodiment of the present invention.
2 is a block diagram illustrating an example of the cloud streaming server shown in FIG.
3 is a view illustrating a change area according to an embodiment of the present invention.
4 is a diagram illustrating an animation message according to an embodiment of the present invention.
5 is a flowchart illustrating an image cloud streaming service method using an animation message according to an exemplary embodiment of the present invention.
FIG. 6 is a flowchart illustrating an image cloud streaming service method using an animation message according to an exemplary embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description and the accompanying drawings, detailed description of well-known functions or constructions that may obscure the subject matter of the present invention will be omitted. It should be noted that the same constituent elements are denoted by the same reference numerals as possible throughout the drawings.

The terms and words used in the present specification and claims should not be construed to be limited to ordinary or dictionary meanings and the inventor is not limited to the concept of terminology for describing his or her invention in the best way. It should be interpreted as meaning and concept consistent with the technical idea of the present invention. Therefore, the embodiments described in the present specification and the configurations shown in the drawings are merely the most preferred embodiments of the present invention, and not all of the technical ideas of the present invention are described. Therefore, It is to be understood that equivalents and modifications are possible. Also, the terms first, second, etc. are used for describing various components and are used only for the purpose of distinguishing one component from another component, and are not used to define the components.

1 is a block diagram illustrating a cloud streaming service system according to an embodiment of the present invention.

1, a cloud streaming service system according to an embodiment of the present invention includes a cloud streaming server 110, terminal devices 120-1, 120-2, ..., 120-N, a network 130 And an application server 140.

The cloud streaming server 110 executes the application server 140 and acquires the timing of the screen corresponding to the animation among the received application execution screens. At this time, it is possible to detect a deformation effect included in the application execution screen and obtain a timing corresponding to a portion where the deformation effect is detected in the application execution screen. At this time, the deformation effect may correspond to at least one of an animation timing change, an animation screen color change, and an animation shape change.

In addition, the cloud streaming server 110 captures a frame corresponding to the timing of the application execution screen and extracts the change area. At this time, the change area can be extracted by comparing the frame corresponding to the timing with the previous frame of the frame corresponding to the timing.

In addition, the cloud streaming server 110 still images encodes the change area using the still image compression technique. At this time, the still image compression technique may correspond to any one of portable network graphics (PNG), portable network graphics (PNG) and joint experts group (JPEG).

In addition, the cloud streaming server 110 transmits an animation message including a still image encoded change area and animation information to the user terminal so that a screen corresponding to the animation can be generated at the user terminal, thereby providing a still image based cloud streaming service . At this time, it may include at least one of animation type, start coordinate, end coordinate, start size, end size, start transparency, end transparency, and application time. At this time, the animation message may be generated using a message including the animation information received from the application server.

The terminal devices 120-1, 120-2, ..., and 120-N receive an application execution result screen corresponding to the cloud streaming service from the cloud streaming server 110 and provide them to the user.

Each of the terminal devices 120-1, 120-2, ..., and 120-N is connected to a communication network and is capable of executing applications based on a cloud computing system. The terminal devices 120-1 to 120- Devices, a multimedia terminal, a wired terminal, a fixed terminal, and an IP (Internet Protocol) terminal. Each of the terminal devices 120-1, 120-2, ..., and 120-N may be a cellular phone, a portable multimedia player (PMP), a mobile Internet device (MID), a smart phone, ), Mobile phones with various mobile communication specifications such as a tablet PC, a notebook computer, a netbook, a personal digital assistant (PDA), a smart TV, ) Terminal.

The network 130 provides a path for transferring data between the cloud streaming server 110 and the terminal devices 120-1, 120-2, ..., 120-N, It is a concept that encompasses all future developable networks. For example, the network 130 may be a wired / wireless local area network that provides communication of various information devices within a limited area, a mobile communication network that provides communication between mobile objects and mobile objects outside the mobile object, Or a wired / wireless communication network, or a combination of two or more. Meanwhile, the transmission scheme standard of the network 130 is not limited to the existing transmission scheme standard, and may include all transmission scheme standards to be developed in the future. 1, the network used between the cloud streaming server 110 and the terminal devices 120-1, 120-2, ..., 120-N is connected to the terminal devices 120-1, 120-2, ..., 120-N may be the same or different from the network used between them.

The application server 140 is a server for receiving requests from the terminal devices 120-1, 120-2, ..., and 120-N from the web server and processing the requests. Rather than processing all the requests received from the terminal devices 120-1, 120-2, ..., 120-N in the web server, the functions of the web server can be structurally separated and processed through the web application servers Therefore, the more service requests from the terminal devices 120-1, 120-2, ..., and 120-N are, the more effective the service using the web application server may be. For example, WEB LOGIC of BEA, Web Spere of IBM, JEUS of T-max, Tomcat, and JBoss of RedHot may correspond to a web application server.

The application server 140 generates video information corresponding to the application result based on the service request requested from the terminal devices 120-1, 120-2, ..., 120-N. At this time, the application server 140 may provide a deformation effect so that the cloud streaming server 110 can detect a dynamic screen such as animation in the application result screen. In addition, the application result screen having the deformation effect can be transmitted to the cloud streaming server 110, so that the cloud streaming server 110 can perform the still image based cloud streaming service.

2 is a block diagram illustrating an example of the cloud streaming server shown in FIG.

Referring to FIG. 2, the cloud streaming server shown in FIG. 1 includes a timing acquisition unit 210, a capture unit 220, an encoding unit 230, a sending unit 240, and a storage unit 250.

The timing acquiring unit 210 acquires the timing of the screen corresponding to the animation in the application execution screen.

The web application server can generate an application execution screen corresponding to the service result and provide it to the cloud streaming server 110. At this time, in the still image-based cloud streaming server, it is possible to perform service by capturing only the changed part of the received application execution screen. For example, when a menu screen is superimposed on an existing screen, only a portion corresponding to the menu window can be captured and services can be performed.

At this time, if an animation effect is displayed on the menu screen, a still image-based cloud streaming server captures unnecessarily many screens and transmits them to the user terminal. A cloud streaming server requires a lot of resources to perform the operations of capturing and transmitting a large number of screens, which can result in a heavy load on the server. Accordingly, in such a case, the timing of the animation-applied portion can be obtained so that the still image-based cloud streaming server can capture at an appropriate time on the application execution screen transmitted by the web application server.

At this time, it is possible to detect a deformation effect included in the application execution screen and obtain a timing corresponding to a portion where the deformation effect is detected in the application execution screen. For example, the web application server gives a deformation effect giving a delay to a specific timing of the animation, and the cloud streaming server 110 can detect the deformation effect on the application execution screen and acquire the timing of the part where the animation timing is changed .

At this time, the deformation effect may correspond to at least one of an animation timing change, an animation screen color change, and an animation shape change.

The capture unit 220 captures a frame corresponding to the timing of the application execution screen and extracts the change area. At this time, the frame corresponding to the timing may be a screen corresponding to the animation in the application execution screen. In this way, by accurately capturing the screen corresponding to the animation based on the timing, it is possible to save resources of the cloud streaming server because it is unnecessary to capture an unnecessary portion in addition to the captured frame.

At this time, the change area can be extracted by comparing the frame corresponding to the timing with the previous frame of the frame corresponding to the timing. For example, it is possible to compare two frames and extract a difference area from a previous frame as a change area. That is, a change frame can be extracted by comparing a previous frame of the frame corresponding to the animation with a frame corresponding to the animation.

Further, the change area may be a partial area of the frame, or an area corresponding to the entire frame. In the case of a part of the frame, only a part corresponding to a part of the frame can be captured, and if the frame corresponds to the entire frame, the entire frame can be captured.

The encoding unit 230 still images the change region using a still image compression technique.

At this time, the still image compression technique may correspond to any one of portable network graphics (PNG), portable network graphics (PNG) and joint experts group (JPEG).

In PNG still image compression, image quality is good when encoding, but when the bandwidth of the transmission network is low due to a large data size, the transmission speed may be lowered.

PALETED PNG still image compression techniques can reduce the data size of the image during encoding, which can guarantee the transmission speed, but it can cause deterioration in image quality because it expresses color with 8 bits.

The JPEG Still Image Compression technique can greatly reduce the amount of data transferred during encoding because of its high compression efficiency. However, when encoding and decoding are performed, the system load may be increased.

The sending unit 240 transmits a still image-encoded change area and an animation message including the animation information to the user terminal so as to generate a screen corresponding to the animation at the user terminal, and performs a still image-based cloud streaming service. When the animation message including the still image encoded change area and the animation information to be applied to the change area is transmitted to the user terminal, the user terminal decodes the change area and outputs the decoded change area A screen can be generated by applying an animation effect corresponding to the animation information.

At this time, the animation information may include at least one of animation type, start coordinate, end coordinate, start size, end size, start transparency, end transparency, and application time.

The animation type indicates the kind of animation applied to the change area, and it can be named as a value expressing a shape in which the change area moves dynamically, such as flying, brightness change, rising and wiping.

The starting coordinates may be the starting coordinates of the animation of the video object to which the animation is applied.

The end coordinates may be the animation end coordinates of the video object to which the animation is applied, similar to the start coordinates.

The starting size may be the starting size of the animation of the video object being animated. For example, since the size of a video object to which an animation is applied according to an animation type may be continuously deformed, a coordinate value corresponding to a start size of the animation and an end size of the animation may be included in the animation information.

In addition, when transparency is applied to a video object to which an animation is applied, the start transparency and the end transparency of the video object to which the animation is applied can be included in the animation information.

The duration may be the time at which the animation is applied. For example, a duration value corresponding to the number of frames to which the animation is applied can be included in the animation message.

At this time, the animation message may be generated using a message including the animation information received from the application server. When an application execution screen is transmitted from the web application to the cloud streaming server 110, animation information applied to the application execution screen together with the application execution screen are transmitted together to generate an animation message using the corresponding information of the cloud streaming server 110 .

In addition, the cloud streaming server 110 may transmit only the animation message to the user terminal. For example, when there is a history of transferring an image corresponding to the change area to the user terminal, only the animation information to be given to the change area is transmitted through the animation message, so that an application execution screen is generated in the user terminal and is provided to the user .

The storage unit 250 stores various information generated in the cloud streaming service process according to the embodiment of the present invention as described above.

According to an embodiment, the storage unit 250 may be configured independently of the cloud streaming server 110 to support a function for the cloud streaming service. At this time, the storage unit 250 may operate as a separate mass storage and may include a control function for performing operations.

In addition, the cloud streaming server 110 configured as described above may be implemented as one or more servers.

On the other hand, the cloud streaming server 110 can store information in the memory on which the memory is mounted. In one implementation, the memory is a computer-readable medium. In one implementation, the memory may be a volatile memory unit, and in other embodiments, the memory may be a non-volatile memory unit. In one implementation, the storage device is a computer-readable medium. In various different implementations, the storage device may include, for example, a hard disk device, an optical disk device, or any other mass storage device.

3 is a view illustrating a change area according to an embodiment of the present invention.

Referring to FIG. 3, it is possible to capture a changed area of the entire frame 310 as a change area 320, as shown in FIG.

At this time, the change area 320 may correspond to the area that is changed compared to the previous frame with respect to the frame full screen 310. Accordingly, such a change area 320 may be extracted, and the still image may be encoded and transmitted to the user terminal together with the animation information to be applied to the change area 320.

In addition, the change area 320 may be an area corresponding to the frame full screen 310. If the change area 320 corresponds to the frame full screen 310, the entire frame 310 is captured to perform still image encoding, and the animation information to be applied to the frame full screen 310, Lt; / RTI >

4 is a diagram illustrating an animation message according to an embodiment of the present invention.

Referring to FIG. 4, the animation message according to an embodiment of the present invention includes animation information such as animation type, start coordinates, end coordinates, start size, end size, start transparency, end transparency, have.

The animation type indicates the kind of animation applied to the change area, and it can be named as a value expressing a shape in which the change area moves dynamically, such as flying, brightness change, rising and wiping.

The starting coordinates may be the starting coordinates of the animation of the video object to which the animation is applied.

The end coordinates may be the animation end coordinates of the video object to which the animation is applied, similar to the start coordinates.

The starting size may be the starting size of the animation of the video object being animated. For example, since the size of a video object to which an animation is applied according to an animation type may be continuously deformed, a coordinate value corresponding to a start size of the animation and an end size of the animation may be included in the animation information.

In addition, when transparency is applied to a video object to which an animation is applied, the start transparency and the end transparency of the video object to which the animation is applied can be included in the animation information.

The duration may be the time at which the animation is applied. For example, a duration value corresponding to the number of frames to which the animation is applied can be included in the animation message.

5 is a flowchart illustrating an image cloud streaming service method using an animation message according to an exemplary embodiment of the present invention.

Referring to FIG. 5, an image cloud streaming service method using an animation message according to an embodiment of the present invention acquires the timing of a screen corresponding to an animation in an application execution screen (S510).

The web application server can generate an application execution screen corresponding to the service result and provide it to the cloud streaming server. At this time, in the still image-based cloud streaming server, it is possible to perform service by capturing only the changed part of the received application execution screen. For example, when a menu screen is superimposed on an existing screen, only a portion corresponding to the menu window can be captured and services can be performed.

At this time, if an animation effect is displayed on the menu screen, a still image-based cloud streaming server captures unnecessarily many screens and transmits them to the user terminal. A cloud streaming server requires a lot of resources to perform the operations of capturing and transmitting a large number of screens, which can result in a heavy load on the server. Accordingly, in such a case, the timing of the animation-applied portion can be obtained so that the still image-based cloud streaming server can capture at an appropriate time on the application execution screen transmitted by the web application server.

At this time, it is possible to detect a deformation effect included in the application execution screen and obtain a timing corresponding to a portion where the deformation effect is detected in the application execution screen. For example, the web application server gives a deformation effect giving a delay to a specific timing of the animation, and the cloud streaming server can detect the deformation effect on the application execution screen and acquire the timing of the changed animation timing.

At this time, the deformation effect may correspond to at least one of an animation timing change, an animation screen color change, and an animation shape change.

In addition, the image cloud streaming service method using an animation message according to an exemplary embodiment of the present invention captures a frame corresponding to a timing of an animation execution screen to extract a change area (S520). At this time, the frame corresponding to the timing may be a screen corresponding to the animation in the application execution screen. In this way, by accurately capturing the screen corresponding to the animation based on the timing, it is possible to save resources of the cloud streaming server because it is unnecessary to capture an unnecessary portion in addition to the captured frame.

At this time, the change area can be extracted by comparing the frame corresponding to the timing with the previous frame of the frame corresponding to the timing. For example, it is possible to compare two frames and extract a difference area from a previous frame as a change area. That is, a change frame can be extracted by comparing a previous frame of the frame corresponding to the animation with a frame corresponding to the animation.

Further, the change area may be a partial area of the frame, or an area corresponding to the entire frame. In the case of a part of the frame, only a part corresponding to a part of the frame can be captured, and if the frame corresponds to the entire frame, the entire frame can be captured.

Also, in the image cloud streaming service method using an animation message according to an exemplary embodiment of the present invention, still image encoding is performed on a change area using a still image compression technique (S530).

At this time, the still image compression technique may correspond to any one of portable network graphics (PNG), portable network graphics (PNG) and joint experts group (JPEG).

In PNG still image compression, image quality is good when encoding, but when the bandwidth of the transmission network is low due to a large data size, the transmission speed may be lowered.

PALETED PNG still image compression techniques can reduce the data size of the image during encoding, which can guarantee the transmission speed, but it can cause deterioration in image quality because it expresses color with 8 bits.

The JPEG Still Image Compression technique can greatly reduce the amount of data transferred during encoding because of its high compression efficiency. However, when encoding and decoding are performed, the system load may be increased.

Also, an image cloud streaming service method using an animation message according to an exemplary embodiment of the present invention may include providing an animation message including a still image-encoded change area and animation information to a user terminal so as to generate a screen corresponding to the animation, To perform a still image based cloud streaming service (S540). When the animation message including the still image encoded change area and the animation information to be applied to the change area is transmitted to the user terminal, the user terminal decodes the change area and outputs the decoded change area A screen can be generated by applying an animation effect corresponding to the animation information.

At this time, the animation information may include at least one of animation type, start coordinate, end coordinate, start size, end size, start transparency, end transparency, and application time.

The animation type indicates the kind of animation applied to the change area, and it can be named as a value expressing a shape in which the change area moves dynamically, such as flying, brightness change, rising and wiping.

The starting coordinates may be the starting coordinates of the animation of the video object to which the animation is applied.

The end coordinates may be the animation end coordinates of the video object to which the animation is applied, similar to the start coordinates.

The starting size may be the starting size of the animation of the video object being animated. For example, since the size of a video object to which an animation is applied according to an animation type may be continuously deformed, a coordinate value corresponding to a start size of the animation and an end size of the animation may be included in the animation information.

In addition, when transparency is applied to a video object to which an animation is applied, the start transparency and the end transparency of the video object to which the animation is applied can be included in the animation information.

The duration may be the time at which the animation is applied. For example, a duration value corresponding to the number of frames to which the animation is applied can be included in the animation message.

At this time, the animation message may be generated using a message including the animation information received from the application server. When transmitting an application execution screen to a cloud streaming server in a web application, animation information applied to the application execution screen together with the application execution screen are transmitted together, so that an animation message can be generated using the corresponding information of the cloud streaming server.

In addition, the cloud streaming server can transmit only the animation message to the user terminal. For example, when there is a history of transferring an image corresponding to the change area to the user terminal, only the animation information to be given to the change area is transmitted through the animation message, so that an application execution screen is generated in the user terminal and is provided to the user .

5, an image cloud streaming service method using an animation message according to an exemplary embodiment of the present invention stores various information generated in a cloud streaming service process according to an exemplary embodiment of the present invention, do. It is possible to support the function for the cloud streaming service by using the information stored in the storage unit configured independently of the cloud streaming server.

FIG. 6 is a flowchart illustrating an image cloud streaming service method using an animation message according to an exemplary embodiment of the present invention.

Referring to FIG. 6, in an image cloud streaming service method using an animation message according to an embodiment of the present invention, a cloud streaming server receives an application execution screen from an application server (S610).

In addition, the image cloud streaming service method using an animation message according to an exemplary embodiment of the present invention detects a transformation effect applied to a received application execution screen (S620). At this time, the deformation effect may correspond to at least one of an animation timing change, an animation screen color change, and an animation shape change.

In addition, the image cloud streaming service method using an animation message according to an embodiment of the present invention acquires the timing of a portion of the application execution screen where the deformation effect is detected (S630).

In addition, the image cloud streaming service method using an animation message according to an embodiment of the present invention captures a frame corresponding to the acquired timing among application execution screens (S640).

In addition, the image cloud streaming service method using an animation message according to an embodiment of the present invention extracts a changed region compared with a previous frame in the captured frame (S650). At this time, the change area may correspond to the entire frame or to some areas of the frame.

Also, in the image cloud streaming service method using an animation message according to an embodiment of the present invention, still image encoding is performed using the still image compression method on the extracted change area (S660). At this time, the still image compression technique may correspond to any one of portable network graphics (PNG), portable network graphics (PNG) and joint experts group (JPEG).

In addition, according to an embodiment of the present invention, an image cloud streaming service method using an animation message generates an animation message including animation information to be transmitted to a user terminal together with a still image encoded change area (S670). At this time, the animation information may include at least one of animation type, start coordinate, end coordinate, start size, end size, start transparency, end transparency, and application time.

In addition, the image cloud streaming service method using an animation message according to an embodiment of the present invention transmits a still image encoded change area and an animation message to a user terminal (S680).

The image cloud streaming service method using the animation message according to the present invention can be implemented in the form of a program command that can be executed through various computer means and recorded in a computer readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Includes all types of hardware devices that are specially configured to store and execute magneto-optical media and program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions may include machine language code such as those generated by a compiler, as well as high-level language code that may be executed by a computer using an interpreter or the like. Such a hardware device may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

As described above, the cloud streaming service system according to the present invention, the image cloud streaming service method using the animation message, and the apparatus therefor are not limited to the configuration and method of the embodiments described above, The examples may be constructed by selectively combining all or a part of each embodiment so that various modifications can be made.

According to the present invention, the timing of the animation-applied portion of the application execution screen is acquired, the frame corresponding to the timing of the application execution screen is captured to extract the change region, the still region is still image encoded using the still image compression technique , And a still image-based cloud streaming service can be performed by transmitting an animation message including the still image encoded change area and the animation information to the user terminal so that a screen corresponding to the animation can be generated in the user terminal. In addition, since unnecessary screen capturing is not performed in the server in order to provide an application result screen having an animation effect, it is possible to save resources used to perform capturing on the server, thereby reducing load on the server, So that it is possible to save costs for the hardware server expansion.

110: Cloud streaming servers 120-1 to 120-N:
130: network 210: timing acquisition unit
220: capture unit 230: encoding unit
240: sending unit 250: storing unit
310: frame full screen 320: change area

Claims (16)

A timing acquiring unit for acquiring a timing of a screen corresponding to an animation in an application execution screen;
A capture unit for capturing a frame corresponding to the timing of the application execution screen and extracting a change area;
An encoding unit for still image encoding the change area using a still image compression scheme; And
A sending unit for sending a still image-based cloud streaming service to the user terminal by transmitting an animation message including still image-encoded change area and animation information to a user terminal so as to generate a screen corresponding to the animation,
Wherein the server comprises: The method according to claim 1,
The timing acquiring unit
And detects a deformation effect included in the application execution screen and obtains a timing corresponding to a portion where the deformation effect is detected in the application execution screen. The method of claim 2,
The animation information
An animation type, an initialization coordinate, an ending coordinate, a start size, an end size, a start transparency, an end transparency, and an application time. The method of claim 3,
The deformation effect
Wherein the animation stream corresponds to at least one of an animation timing change, an animation screen color change, and an animation shape change. The method of claim 4,
The capture unit
Wherein the controller is configured to compare the frame corresponding to the timing with the previous frame of the frame corresponding to the timing to extract the change area. The method of claim 5,
The still image compression technique
A portable network graphics (PNG), a portable network graphics (PNG), and a joint art experts group (JPEG). The method of claim 6,
The animation message
Wherein the message is generated using a message including the animation information received from the application server. Obtaining a timing of a screen corresponding to an animation in an application execution screen;
Capturing a frame corresponding to the timing among the animation execution screens and extracting a change area;
Still image encoding the change area using a still image compression technique; And
A still image-based cloud streaming service is performed by transmitting an animation message including still image-encoded change area and animation information to the user terminal so that a user terminal can generate a screen corresponding to the animation
The method of claim 1, further comprising the steps of: The method of claim 8,
The step of obtaining the timing
And detecting a deformation effect included in the application execution screen,
And acquiring a timing corresponding to a portion of the application execution screen where the deformation effect is sensed. The method of claim 9,
The animation information
An animation type, an animation type, a start coordinate, an end coordinate, a start size, an end size, a start transparency, an end transparency, and an application time. The method of claim 10,
The deformation effect
Wherein the animation message includes at least one of an animation timing change, an animation screen color change, and an animation shape change. The method of claim 11,
The step of extracting the change area
And comparing the frame corresponding to the timing with a previous frame of a frame corresponding to the timing to extract the change area. The method of claim 12,
The still image compression technique
(PNG), a portable network graphics (PNG), and a joint art experts group (JPEG). 14. The method of claim 13,
The animation message
Wherein the animation message is generated using a message including the animation information received from the application server. A computer program stored on a medium for carrying out the method of any one of claims 8 to 14. Capturing a frame corresponding to the timing of the animation execution screen to extract a change area, and still image encoding the change area using a still image compression technique An animation message including still image-encoded change area and animation information to the user terminal so that a screen corresponding to the animation can be generated at the user terminal, and a cloud for performing a still image- Streaming server; And
And a terminal for receiving an application execution result screen corresponding to the still image based cloud streaming service from the cloud streaming server,
And a cloud streaming system.

Images