KR20160132607A - System for cloud streaming service, method of image cloud streaming service using data substitution and apparatus for the same - Google Patents

Abstract

Disclosed are a system for cloud streaming service, a method of image cloud streaming service using data substitution and an apparatus for the same. The method of the image cloud streaming service using the data substitution includes: substituting at least one image data included in an application execution screen with at least one modified data of which a volume is reduced, and rendering the modified data; detecting a frame for capturing an image to be transmitted to a terminal in a rendered application execution screen; restoring, according to whether the frame corresponds to the at least one modified data or not, the frame into at least one image data to capture an image; and performing still-image encoding on the image, and transmitting the encoded image to the terminal. Resources required for rendering are reduced when providing the image cloud streaming service, so that system efficiency is improved.

Description

TECHNICAL FIELD [0001] The present invention relates to a cloud streaming service system, a cloud streaming service system, a method of providing an image cloud streaming service through data replacement,

The present invention relates to a cloud streaming service system capable of saving resources of a cloud streaming server when performing rendering by replacing picture data with data having a small capacity in an image-based cloud streaming service, an image cloud streaming service And an apparatus therefor.

The rapid development of the Internet has resulted in a rapid increase in the communication speed of an individual. The improvement in the communication speed can be achieved by downloading or uploading a large amount of data by accessing a computer located at a remote place, or by using a remote computer control program, As well as providing an environment in which a remote computer can be used.

In addition, as a variety of applications have been developed for mobile communication terminals such as smart phones, many virtualization technologies have been proposed for driving applications requiring high performance in relatively low performance user terminals.

Among them, the application is driven on the server, the driving screen is compressed through video encoding and transmitted to the client, and the client reproduces the transmitted video to generate a screen virtualization Cloud streaming service is becoming popular.

The cloud streaming service basically adopts the cloud streaming method based on the video codec. However, even when a static screen such as a menu display is serviced, the entire screen is unnecessarily captured and operated using a video codec, which makes the overall system ineffective.

Also, in a cloud streaming service, a component that consumes the most resource efficiency such as a CPU may be picture data. Therefore, each browser may be burdened when rendering the picture data in the cloud streaming server. However, this streaming process is also inefficient because the cloud streaming server does not need to render the actual screen correctly.

Accordingly, an image-based cloud streaming service technology that captures only static images of an application execution screen and provides it to the user's terminal, but performs rendering by substituting a small amount of data to reduce the burden upon rendering, .

Korean Patent Laid-Open Publication No. 2014-0056673, registered May 12, 2014 (name: a method for providing a game based on cloud streaming, a system therefor, a client terminal for the same, a service device for the same, Recording medium)

It is an object of the present invention to improve the efficiency of an image cloud streaming system by reducing the load generated during rendering.

It is another object of the present invention to provide a service method that can use resources of a cloud streaming server more effectively while maintaining a service quality provided to a user.

It is another object of the present invention to provide a high-performance application execution screen even in a low-end terminal by processing only the changed image on the application execution screen and providing it to the user terminal.

According to an aspect of the present invention, there is provided a cloud streaming server comprising: a substitution rendering unit for substituting at least one piece of picture data included in an application execution picture into at least one piece of transformed data having a reduced capacity; A frame detector for detecting a frame to capture an image to be transmitted to the terminal on the rendered application execution screen; A capture unit for capturing the image by restoring the frame to the at least one picture data according to whether the frame corresponds to the at least one deformation data; And a streaming unit for still image encoding the image and transmitting the still image to the terminal.

In this case, the capture unit may determine that the frame corresponds to the at least one transformed data when the frame includes a substitution mark indicating that the at least one picture data is replaced.

At this time, the capture unit may capture the image by restoring the picture data corresponding to the frame among the at least one picture data, when the frame corresponds to the at least one deformation data.

At this time, the substitution rendering unit may replace the at least one picture data by mapping the at least one transformed data.

In this case, the capturing unit may restore picture data corresponding to the frame mapped with the deformation data corresponding to the frame among the at least one deformation data.

At this time, the capture unit can capture the image corresponding to the changed portion compared with the previous frame of the frame.

At this time, the capture unit may capture the image without performing the restoration if the frame does not correspond to the at least one deformation data.

According to another aspect of the present invention, there is provided an image cloud streaming service method for replacing at least one image data included in an application execution image with at least one deformation data having a reduced capacity, Detecting a frame to capture an image to be transmitted to the terminal on the rendered application execution screen; Capturing the image by restoring the frame to the at least one picture data according to whether the frame corresponds to the at least one deformation data; And transmitting still image encoding the image to the terminal.

In this case, the step of capturing includes checking whether the frame includes a substitute mark indicating that the at least one picture data is replaced, and when the substitute mark is included, It can be determined that it corresponds to the deformation data.

At this time, the capturing step may capture the image by restoring picture data corresponding to the frame among the at least one picture data when the frame corresponds to the at least one deformation data.

In this case, the replacing and rendering may replace the at least one picture data with the at least one transformed data.

In this case, the capturing may restore picture data corresponding to the frame mapped with the deformation data corresponding to the frame among the at least one deformation data.

At this time, the capturing step may capture the image corresponding to the changed part compared to the previous frame of the frame.

At this time, the capturing step may capture the image without performing the restoration if the frame does not correspond to the at least one deformation data.

According to the present invention, it is possible to improve the efficiency of the image cloud streaming system by reducing the load generated during rendering.

In addition, the present invention can provide a service method that can use the resources of the cloud streaming server more effectively while maintaining the service quality provided to the user.

In addition, according to the present invention, only the changed image is processed on the application execution screen and provided to the user terminal, thereby providing a high-performance application execution screen even in low-end terminals.

1 is a block diagram illustrating a cloud streaming service system according to an embodiment of the present invention.
2 is a block diagram illustrating an example of the cloud streaming server shown in FIG.
3 is a diagram illustrating a data replacement process according to an embodiment of the present invention.
4 is a flowchart illustrating an image capturing process according to an exemplary embodiment of the present invention.
5 is a diagram illustrating a mapping table according to an embodiment of the present invention.
FIG. 6 is a flowchart illustrating an image cloud streaming service method using data replacement according to an embodiment of the present invention.
FIG. 7 is a flowchart illustrating an image cloud streaming service method according to an exemplary embodiment of the present invention.
FIG. 8 is a flowchart illustrating an image cloud streaming service process through data replacement according to an exemplary embodiment of the present invention. Referring to FIG.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description and the accompanying drawings, detailed description of well-known functions or constructions that may obscure the subject matter of the present invention will be omitted. It should be noted that the same constituent elements are denoted by the same reference numerals as possible throughout the drawings. Embodiments of the present invention are provided to more fully describe the present invention to those skilled in the art. Accordingly, the shapes and sizes of the elements in the drawings and the like can be exaggerated for clarity.

The terms and words used in the present specification and claims should not be construed to be limited to ordinary or dictionary meanings and the inventor is not limited to the concept of terminology for describing his or her invention in the best way. It should be interpreted as meaning and concept consistent with the technical idea of the present invention. Therefore, the embodiments described in the present specification and the configurations shown in the drawings are merely the most preferred embodiments of the present invention, and not all of the technical ideas of the present invention are described. Therefore, It is to be understood that equivalents and modifications are possible. Also, the terms first, second, etc. are used for describing various components and are used only for the purpose of distinguishing one component from another component, and are not used to define the components.

1 is a block diagram illustrating a cloud streaming service system according to an embodiment of the present invention.

Referring to FIG. 1, a cloud streaming service system according to an embodiment of the present invention includes a cloud streaming server 110, terminals 120-1 to 120-N, and a network 130. FIG.

The cloud streaming server 110 replaces at least one picture data included in the application execution picture with at least one modified data having a reduced capacity.

At this time, at least one picture data and at least one transformed data may be mapped and replaced.

In addition, the cloud streaming server 110 detects a frame to capture an image to be transmitted to the terminals 120-1 to 120-N on the rendered application execution screen.

In addition, the cloud streaming server 110 restores the frame to at least one picture data according to whether or not the frame corresponds to at least one transformed data, thereby capturing an image.

At this time, if the frame includes a substitution mark indicating that at least one picture data is replaced, it can be determined that the frame corresponds to at least one piece of transformed data.

At this time, when the frame corresponds to at least one deformation data, the image data can be captured by restoring the picture data corresponding to the frame among at least one picture data.

At this time, it is possible to restore the picture data corresponding to the frame mapped with the deformation data corresponding to the frame among the at least one deformation data.

At this time, it is possible to capture an image corresponding to the changed portion compared with the previous frame of the frame.

At this time, if the frame does not correspond to at least one deformation data, the image can be captured without performing restoration.

Also, the image is still image encoded and transmitted to the terminals 120-1 to 120-N.

At this time, the still image encoding method can still image the image.

The terminals 120-1 to 120-N receive an application execution screen corresponding to the cloud streaming service from the cloud streaming server 110 and provide them to the user.

The terminals 120-1 to 120-N are connected to a communication network and are capable of executing applications on the basis of a cloud computing system. The terminals 120-1 to 120-N are not limited to the mobile communication terminal but may be any information communication device, multimedia terminal, A fixed terminal and an IP (Internet Protocol) terminal. Each of the terminals 120-1 to 120-N may be a mobile phone, a portable multimedia player (PMP), a mobile Internet device (MID), a smart phone, a desktop, a tablet PC, A mobile terminal having various mobile communication specifications such as a notebook computer, a notebook computer, a netbook, a personal digital assistant (PDA), a smart TV, and an information communication device.

The terminals 120-1 to 120-N receive various kinds of information such as numeric and character information, set various functions, and input signals related to the function control of the terminals 120-1 to 120-N And can be transmitted to the control unit through the input unit. The input unit of the terminals 120-1 to 120-N may include at least one of a keypad and a touchpad for generating an input signal according to a user's touch or operation. At this time, the input units of the terminals 120-1 to 120-N are configured in the form of one touch panel (or touch screen) together with the display units of the terminals 120-1 to 120-N, Display function can be performed at the same time. The input unit of the terminals 120-1 to 120-N may be any type of input unit that can be developed in addition to an input unit such as a keyboard, a keypad, a mouse, a joystick, and the like. In particular, the input units of the terminals 120-1 to 120-N according to the present invention can transmit input signals for uploading or downloading contents based on cloud computing to the control units of the terminals 120-1 to 120-N.

In addition, the display unit of the terminals 120-1 to 120-N can display information on a series of operation states, operation results, and the like that occur during the performance of the functions of the terminals 120-1 to 120-N. In addition, the display units of the terminals 120-1 to 120-N can display menus of the terminals 120-1 to 120-N and user data input by the user. The display units of the terminals 120-1 to 120-N may be a liquid crystal display (LCD), a thin film transistor LCD (TFT-LCD), a light emitting diode (LED) An organic light emitting diode (OLED), an organic light emitting diode (AMOLED), an active matrix OLED, a retina display, a flexible display, and a three-dimensional display have. At this time, when the display units of the terminals 120-1 to 120-N are configured as touch screens, the display units of the terminals 120-1 to 120-N function as the input units of the terminals 120-1 to 120- Some or all of them. In particular, the display unit of the terminals 120-1 to 120-N according to the present invention can display information related to execution of content provided on a cloud computing basis on a screen.

The storage units of the terminals 120-1 to 120-N are devices for storing data, and include a main storage device and an auxiliary storage device, and are used for applications required for functional operations of the terminals 120-1 to 120- You can save the program. The storage units of these terminals 120-1 to 120-N may largely include a program area and a data area. Here, when the terminals 120-1 to 120-N activate the respective functions in response to a request from the user, the terminals 120-1 to 120-N provide the respective functions by executing the corresponding application programs under the control of the controller. In particular, the storage units of the terminals 120-1 to 120-N according to the present invention may store an operating system for booting the terminals 120-1 to 120-N, a program for uploading or downloading contents on the basis of cloud computing have. In addition, the storage units of the terminals 120-1 to 120-N may store information of a content DB storing a plurality of contents and information of the terminals 120-1 to 120-N. At this time, the content DB includes execution data for executing the content and attribute information about the content, and content usage information according to the execution of the content can be stored. The information of the terminals 120-1 to 120-N may include terminal specification information.

In addition, the communication units of the terminals 120-1 to 120-N may perform a function of transmitting and receiving data through the cloud streaming server 110 and the network 130. [ Here, the communication unit of the terminals 120-1 to 120-N may include RF transmitting means for up-converting and amplifying the frequency of the transmitted signal, RF receiving means for low-noise amplifying the received signal and down-converting the frequency . The communication units of the terminals 120-1 to 120-N may include at least one of a wireless communication module and a wired communication module. In the case where the terminals 120-1 to 120-N use wireless communication, the wireless communication module is a module for transmitting and receiving data according to a wireless communication method. The wireless communication module, the wireless LAN communication module, The data can be transmitted / received to / from the cloud streaming server 110 by using any one of them. The wired communication module is for transmitting / receiving data by wire. The wired communication module may connect to the network 130 through a wired network and transmit / receive data to / from the cloud streaming server 110. That is, the terminals 120-1 to 120-N access the network 130 using a wireless communication module or a wired communication module and transmit and receive data to and from the cloud streaming server 110 through the network 130. [ In particular, the network 130 according to the present invention can communicate with the cloud streaming server 110 or other terminals 120-1 to 120-N to transmit / receive data necessary for uploading or downloading content based on cloud computing.

The control unit of the terminal devices 120-1 to 120-N may be an operating system (OS) and a process unit for driving each configuration. For example, the control unit may include a cloud streaming server 110, When accessing the cloud streaming server 110 through a separate service application, it is possible to control the entire process of executing the service application according to the request of the user, and at the same time, It is possible to control the streaming server 110 to transmit the service use request and control the information of the terminals 120-1 to 120-N necessary for user authentication to be transmitted together.

In addition, the control units of the terminals 120-1 to 120-N can execute the specific contents stored in the storage units of the terminals 120-1 to 120-N according to the request of the user. At this time, the control unit may store the content usage history according to the execution of the content as the content usage information.

In addition, the control unit of the terminals 120-1 to 120-N may execute execution data for executing the content, content information including attribute information about the content, and content usage information, which is information according to the content usage history, And uploaded to the server 110 for uploading. Then, the controller transmits the uploaded content to the cloud streaming server 110, deletes the uploaded content from the storage unit of the terminals 120-1 to 120-N according to the user's request, connects to the cloud streaming server 110 The content may be executed through the cloud streaming server 110 and used.

In addition, the control units of the terminals 120-1 to 120-N may access the cloud streaming server 110 to download the content from the other terminals 120-1 to 120-N and control the content to be stored in the storage unit , It is also possible to control the content to be executed after receiving only data necessary for execution at the time of executing the content through the cloud streaming server 110.

The network 130 provides a path for transferring data between the cloud streaming server 110 and the terminals 120-1 to 120-N, and is a concept covering both existing networks and future developable networks . For example, the network 130 may be a wired / wireless local area network that provides communication of various information devices within a limited area, a mobile communication network that provides communication between mobile objects and mobile objects outside the mobile object, Or a wired / wireless communication network, or a combination of two or more. Meanwhile, the transmission scheme standard of the network 130 is not limited to the existing transmission scheme standard, and may include all transmission scheme standards to be developed in the future. In addition, the network used between the cloud streaming server 110 and the terminals 120-1 to 120-N in FIG. 1 may be different from the network used between the terminals 120-1 to 120-N, It may be the same.

2 is a block diagram illustrating an example of the cloud streaming server shown in FIG.

2, the cloud streaming server 110 shown in FIG. 1 includes a communication unit 210, a replacement rendering unit 220, a frame detection unit 230, a capture unit 240, a streaming unit 250, (260).

The communication unit 210 transmits and receives information related to a plurality of terminals through a communication network such as the network shown in FIG. In particular, the communication unit 210 according to an embodiment of the present invention can receive a request for a cloud streaming service from the terminal and provide the terminal with the execution result of the application corresponding to the cloud streaming service requested by the terminal.

At this time, the terminal can receive the application execution result from the cloud streaming server with respect to the requested cloud streaming service.

The substitution rendering unit 220 substitutes at least one piece of picture data included in the application execution picture with at least one piece of transformed data having a reduced capacity and renders it.

The cloud streaming technique based on the video codec can capture and encode all the frames corresponding to the screen on which the application operates. However, when the frame-to-frame change on the screen on which the application operates is not large, the still-image encoding is performed by capturing only the change area of the changed frame as compared with the previous frame like the image-based cloud streaming technique, The part except for the change area can be displayed in the same manner, and the change area can be displayed in a manner of changing only.

In this image-based cloud streaming service, picture data is the component that makes the CPU and other resources consume the most. At this time, the picture data may include at least one of a natural image and a composite image, and may be an image including at least one color. In addition, picture data can use more resources in the cloud streaming server when rendering, compared to regular data such as text.

Rendering is the process of creating images from multiple scenes using a computer program. A scene file contains objects with precisely defined language or data structures, which can include an array of shapes representing the virtual scene, viewpoints, texture mapping, lighting, shading information, and so on. The data contained in such a scene file can be rendered to produce a digital image or raster graphics image file as a result. The rendering method is technically very different, but it is the same in that it creates a two-dimensional picture from the three-dimensional rendering stored in the scene file along the graphics pipeline through a rendering device such as a graphics processing unit (GPU). The GPU is also a device designed to help a central processing unit (CPU) perform complex rendering calculations.

However, in the cloud streaming service, since the user does not see a screen in which the application execution screen is rendered, it may not be necessary to render it with high quality. That is, it can be said that it is not necessary to render the picture data with good quality.

Therefore, in the present invention, in order to save resources used in rendering the picture data in the cloud streaming server, it is possible to perform rendering after replacing picture data with deformation data having a smaller capacity. At this time, the deformation data may correspond to the data in which the quality of picture data is lowered and the capacity is reduced. For example, it is possible to substitute deformation data whose capacity is reduced by reducing the number of colors in the picture data.

At this time, the at least one modified data included in the application execution screen may include substitution markers. Substitution markers can be used to determine whether the object to be captured is transformed data when performing capturing at a later time.

At this time, at least one picture data and at least one transformed data may be mapped and replaced.

At this time, the substitution markers may be stored together when the transformed data and the picture data are mapped and stored. In addition, the substitution tag may be included in a unique form for each transformed data, or may include a substitution tag of the same type.

At this time, at least one picture data and at least one transformed data may be mapped and stored in the mapping table. For example, a mapping table can be created, and picture data corresponding to transformed data and transformed data can be stored for each item of the table.

The frame detection unit 230 detects a frame to capture an image to be transmitted to the terminal on the rendered application execution screen.

In this case, it is possible to detect intervals in which there is little change between frames among the frames corresponding to the execution screen of the rendered application, and to detect a frame in which the image is to be captured in a section where the change between frames is small. For example, it may be inefficient to provide an image-based cloud streaming service because there are a large number of images to be captured with a large number of frames between frames. Therefore, the service can be performed through the cloud streaming technique based on the video codec and the image can be captured in the changed frame in order to perform the image based cloud streaming service only in a section where the change between the frames is small.

The capturing unit 240 captures an image by restoring the frame into at least one picture data according to whether the frame corresponds to at least one deformation data. If the image is captured from the transformed transformed data at the time of rendering, the image is captured in a state where the image quality is deteriorated in order to reduce the capacity, so that the user may be provided with a degraded image. Accordingly, the transformed data can be restored to the original picture data and captured by the user in order to provide the service by ensuring the image quality in the same manner as the basic method.

At this time, if the frame includes a substitution mark indicating that at least one picture data is replaced, it can be determined that the frame corresponds to at least one piece of transformed data. When replacing data, the transformed data to be substituted with the picture data may include a substitution mark to indicate that the corresponding data has been replaced. Accordingly, in order to confirm whether the frame to be captured is the transformed transformed data, it can be determined whether or not the data corresponding to the frame includes a substitution mark.

At this time, when the frame corresponds to at least one deformation data, the image data can be captured by restoring the picture data corresponding to the frame among at least one picture data.

At this time, it is possible to restore the picture data corresponding to the frame mapped with the deformation data corresponding to the frame among the at least one deformation data.

For example, it is possible to retrieve transformed data corresponding to a frame in a mapping table for mapping and storing at least one transformed data and at least one transformed transformed data on an application execution screen. The application execution screen can be restored with the image data mapped to the searched transformed data and stored in the table.

In addition, picture data corresponding to a frame in the mapping table may be obtained by using a replacement mark included in the deformation data corresponding to the frame. For example, each of the at least one deformation data may have a different replacement mark, and when the replacement mark is mapped together with the mapping table, the replacement mark may be searched as an address value to obtain the mapped image data .

At this time, a method of mapping at least one transformed data and at least one picture data to each other on the application execution screen may be various methods other than a method using a mapping table.

At this time, it is possible to capture an image corresponding to the changed portion compared with the previous frame of the frame. For example, it is possible to compare a current frame with a previous frame among a large number of frames constituting an application execution screen, and to judge a difference part between two frames as a changed part and capture it as an image. In addition, when the changed portion is detected as a plurality of regions on the frame, one region including a plurality of regions may be captured as an image, or a plurality of regions may be captured as a plurality of images.

At this time, if the frame does not correspond to at least one deformation data, the image can be captured without performing restoration. In other words, since the capturing part of the image is not a substituted part, capturing can be performed directly without restoration.

The streaming unit 250 encodes the still image and transmits the still image to the terminal.

At this time, still image encoding can be performed by selecting a method corresponding to an image among a plurality of still image encoding methods.

In this case, the still image encoding method can be determined in consideration of the load generated in the cloud streaming server 110, the service speed, the image quality of the image, or the performance of the terminal receiving and rendering the encoded image. For example, to improve the speed of the cloud streaming service, you can compress the image with a palette PNG encoding method that has a high compression ratio and low load. In addition, if it is desired to provide a good image quality without regard to the load, the image can be compressed using the PNG 32-bit encoding method or the JPEG encoding method.

The storage unit 260 stores various information generated in the cloud streaming service process according to the embodiment of the present invention as described above.

According to an embodiment, the storage unit 260 may be configured independently of the cloud streaming server 110 to support a function for the cloud streaming service. At this time, the storage unit 260 may operate as a separate mass storage and may include a control function for performing operations.

In addition, the cloud streaming server 110 configured as described above may be implemented as one or more servers.

On the other hand, the cloud streaming server 110 can store information in the memory on which the memory is mounted. In one implementation, the memory is a computer-readable medium. In one implementation, the memory may be a volatile memory unit, and in other embodiments, the memory may be a non-volatile memory unit. In one implementation, the storage device is a computer-readable medium. In various different implementations, the storage device may comprise, for example, a hard disk device, an optical disk device, or any other mass storage device.

The efficiency of the image cloud streaming system can be improved by reducing the amount of load generated when the image-based cloud streaming is performed through the cloud streaming server 110.

In addition, it is possible to save the resources of the cloud streaming server while maintaining the quality of service provided to the user, and to operate the cloud streaming service system more effectively.

3 is a diagram illustrating a data replacement process according to an embodiment of the present invention.

Referring to FIG. 3, a data replacement process according to an embodiment of the present invention may first search for a frame 311 corresponding to picture data among frames 310 constituting an application execution screen.

At the time of the cloud streaming service, since the user does not see the screen in which the application execution screen is rendered, it may not be necessary to render it with high quality. That is, it can be said that it is not necessary to render the picture data with good quality.

Therefore, in the present invention, in order to save resources used in rendering the picture data in the cloud streaming server, it is possible to perform rendering after replacing picture data with deformation data having a smaller capacity. You can search for picture data.

Thereafter, the frame 311 corresponding to the retrieved picture data can be replaced with the frame 321 corresponding to the transformed data.

At this time, the at least one modified data included in the application execution screen, that is, the frame 321, may include a substitution mark. At this time, the substitution mark can be used to check whether or not the object to be captured when the capture is performed later is deformation data.

At this time, the frame 311 corresponding to the picture data and the frame 321 corresponding to the transformed data can be mapped and stored.

In addition, the substitution markers may be stored together when the transformed data and the picture data are mapped and stored. In addition, the substitution tag may be included in a unique form for each transformed data, or may include a substitution tag of the same type.

At this time, the frame 311 corresponding to the picture data and the frame 321 corresponding to the transformed data can be mapped and stored using the mapping table. For example, a mapping table can be created, and picture data corresponding to transformed data and transformed data can be stored for each item of the table.

4 is a flowchart illustrating an image capturing process according to an exemplary embodiment of the present invention.

Referring to FIG. 4, in the image capturing process according to an embodiment of the present invention, a previous frame 410 and a current frame 420 are compared, and a portion having a difference between two frames is determined as a changed portion, .

For example, when comparing the previous frame 410 and the current frame 420 of FIG. 4, two regions A and B among the four regions A to D of the previous frame 410 correspond to the current frame 420 ), It can be confirmed that A 'and B' are changed. That is, it can be said that other contents of the area are displayed on the actual screen.

Accordingly, at the capture end of the cloud streaming server, the region corresponding to the changed A 'and B' can be determined as the capture image 430 and capture can be performed.

Such a captured image 430 may be variously generated according to a frame to be compared. Also, the captured image 430 may be generated as multiple images instead of one image.

For example, when comparing the previous frame and the current frame, assuming that various regions that are not in contact with each other have changed, capturing may be performed by generating a captured image as a captured image, respectively.

In addition, one area including all the areas where the change occurs may be newly generated, and the newly generated area may be generated as one capture image. By combining a plurality of capture regions into one region to generate a capture image, a still image can be encoded with a single encoding, thereby saving resources used by the server.

Accordingly, the method of performing the capture can be performed in various ways in consideration of the performance of the corresponding cloud streaming server or the performance of the terminal receiving the image, and the setting can be freely changed according to the setting by the administrator.

5 is a diagram illustrating a mapping table according to an embodiment of the present invention.

Referring to FIG. 5, a mapping table 510 according to an embodiment of the present invention may include substitution markers, modified data, and picture data.

According to the present invention, since the rendered screen is not output to the user when rendering the application execution screen, the rendering screen does not need to be generated with high quality.

Therefore, in the case of picture data that requires a lot of resources for rendering, it is possible to perform rendering after replacing the transformed data with reduced data capacity before rendering. In performing capturing at the capture end of the cloud streaming server, It may be necessary to perform a process of restoring the image data again. This may be because, when the frame in which the image is captured is deformed data whose data capacity is reduced, the image quality of the image actually output to the user may deteriorate.

Therefore, the mapping table shown in FIG. 5 can be generated and stored when replacing the image data corresponding to the transformed data to easily obtain the reconstructed image data.

In this case, the substitution mark is a mark included in the transformed data to be substituted with the picture data, and may be a means for checking whether or not the detected frame for performing the capturing at the capturing end is the transformed transformed data. That is, if the frame includes the replacement mark, the frame can be determined as the transformed data, and the image can be captured after performing the restoration process.

At this time, the substitution landmarks may be generated uniquely for each of the transformed data as shown in FIG. By storing the substitution markers uniquely generated in this manner together in the mapping table 510, it is also possible to obtain picture data by using the substitution markers as address values when searching picture data for the modified data in the mapping table.

Also, all of the transformed data may include substitution markers of the same type. At this time, the transformed data itself can be used as an address value of the mapping table 510 to obtain picture data.

At this time, various methods other than the method using the mapping table 510 as shown in FIG. 5 can be used as a method of mapping substituted data and picture data on the application execution screen.

FIG. 6 is a flowchart illustrating an image cloud streaming service method using data replacement according to an embodiment of the present invention.

Referring to FIG. 6, an image cloud streaming service method using data replacement according to an exemplary embodiment of the present invention renders at least one picture data included in an application execution picture by substituting at least one modified data having a reduced capacity (S610).

The cloud streaming technique based on the video codec can capture and encode all the frames corresponding to the screen on which the application operates. However, when the frame-to-frame change on the screen on which the application operates is not large, the still-image encoding is performed by capturing only the change area of the changed frame as compared with the previous frame like the image-based cloud streaming technique, The part except for the change area can be displayed in the same manner, and the change area can be displayed in a manner of changing only.

In this image-based cloud streaming service, picture data is the component that makes the CPU and other resources consume the most. At this time, the picture data may include at least one of a natural image and a composite image, and may be an image including at least one color. In addition, picture data can use more resources in the cloud streaming server when rendering, compared to regular data such as text.

Rendering is the process of creating images from multiple scenes using a computer program. A scene file contains objects with precisely defined language or data structures, which can include an array of shapes representing the virtual scene, viewpoints, texture mapping, lighting, shading information, and so on. The data contained in such a scene file can be rendered to produce a digital image or raster graphics image file as a result. The rendering method is technically very different, but it is the same in that it creates a two-dimensional picture from the three-dimensional rendering stored in the scene file along the graphics pipeline through a rendering device such as a graphics processing unit (GPU). The GPU is also a device designed to help a central processing unit (CPU) perform complex rendering calculations.

However, in the cloud streaming service, since the user does not see a screen in which the application execution screen is rendered, it may not be necessary to render it with high quality. That is, it can be said that it is not necessary to render the picture data with good quality.

Therefore, in the present invention, in order to save resources used in rendering the picture data in the cloud streaming server, it is possible to perform rendering after replacing picture data with deformation data having a smaller capacity. At this time, the deformation data may correspond to the data in which the quality of picture data is lowered and the capacity is reduced. For example, it is possible to substitute deformation data whose capacity is reduced by reducing the number of colors in the picture data.

At this time, the at least one modified data included in the application execution screen may include substitution markers. Substitution markers can be used to determine if the object to be captured is transformed data when performing capturing at a later time.

At this time, at least one picture data and at least one transformed data may be mapped and replaced.

At this time, the substitution markers may be stored together when the transformed data and the picture data are mapped and stored. In addition, the substitution tag may be included in a unique form for each transformed data, or may include a substitution tag of the same type.

At this time, at least one picture data and at least one transformed data may be mapped and stored in the mapping table. For example, a mapping table can be created, and picture data corresponding to transformed data and transformed data can be stored for each item of the table.

In addition, the method of image cloud streaming service through data replacement according to an embodiment of the present invention detects a frame to capture an image to be transmitted to a terminal on a rendered application execution screen (S620).

In this case, it is possible to detect intervals in which there is little change between frames among the frames corresponding to the execution screen of the rendered application, and to detect a frame in which the image is to be captured in a section where the change between frames is small. For example, it may be inefficient to provide an image-based cloud streaming service because there are a large number of images to be captured with a large number of frames between frames. Therefore, the service can be performed through the cloud streaming technique based on the video codec and the image can be captured in the changed frame in order to perform the image based cloud streaming service only in a section where the change between the frames is small.

In addition, the method of image cloud streaming service through data replacement according to an embodiment of the present invention restores a frame into at least one picture data and captures an image according to whether the frame corresponds to at least one transformed data (S630) . If the image is captured from the transformed transformed data at the time of rendering, the image is captured in a state where the image quality is deteriorated in order to reduce the capacity, so that the user may be provided with a degraded image. Accordingly, the transformed data can be restored to the original picture data and captured by the user in order to provide the service by ensuring the image quality in the same manner as the basic method.

At this time, if the frame includes a substitution mark indicating that at least one picture data is replaced, it can be determined that the frame corresponds to at least one piece of transformed data. When replacing data, the transformed data to be substituted with the picture data may include a substitution mark to indicate that the corresponding data has been replaced. Accordingly, in order to confirm whether the frame to be captured is the transformed transformed data, it can be determined whether or not the data corresponding to the frame includes a substitution mark.

At this time, when the frame corresponds to at least one deformation data, the image data can be captured by restoring the picture data corresponding to the frame among at least one picture data.

At this time, it is possible to restore the picture data corresponding to the frame mapped with the deformation data corresponding to the frame among the at least one deformation data.

For example, it is possible to retrieve transformed data corresponding to a frame in a mapping table for mapping and storing at least one transformed data and at least one transformed transformed data on an application execution screen. The application execution screen can be restored with the image data mapped to the searched transformed data and stored in the table.

In addition, picture data corresponding to a frame in the mapping table may be obtained by using a replacement mark included in the deformation data corresponding to the frame. For example, each of the at least one deformation data may have a different replacement mark, and when the replacement mark is mapped together with the mapping table, the replacement mark may be searched as an address value to obtain the mapped image data .

At this time, a method of mapping at least one transformed data and at least one picture data to each other on the application execution screen may be various methods other than a method using a mapping table.

At this time, it is possible to capture an image corresponding to the changed portion compared with the previous frame of the frame. For example, it is possible to compare a current frame with a previous frame among a large number of frames constituting an application execution screen, and to judge a difference part between two frames as a changed part and capture it as an image. In addition, when the changed portion is detected as a plurality of regions on the frame, one region including a plurality of regions may be captured as an image, or a plurality of regions may be captured as a plurality of images.

At this time, if the frame does not correspond to at least one deformation data, the image can be captured without performing restoration. In other words, since the capturing part of the image is not a substituted part, capturing can be performed directly without restoration.

In addition, in the image cloud streaming service method of replacing data according to an embodiment of the present invention, the image is still image encoded and transmitted to the terminal (S640).

At this time, still image encoding can be performed by selecting a method corresponding to an image among a plurality of still image encoding methods.

At this time, the still image encoding method can be determined in consideration of the load generated in the cloud streaming server, the service speed, the image quality of the image, or the performance of the terminal receiving and rendering the encoded image. For example, to improve the speed of the cloud streaming service, you can compress the image with a palette PNG encoding method that has a high compression ratio and low load. In addition, if it is desired to provide a good image quality without regard to the load, the image can be compressed using the PNG 32-bit encoding method or the JPEG encoding method.

In addition, although not shown in FIG. 6, the image cloud streaming service method using data replacement according to an embodiment of the present invention transmits and receives information related to a plurality of terminals through a communication network such as the network shown in FIG. Particularly, according to an embodiment of the present invention, a request for a cloud streaming service can be received from a terminal, and an execution result of an application corresponding to a cloud streaming service requested by the terminal can be provided to the terminal.

At this time, the terminal can receive the application execution result from the cloud streaming server with respect to the requested cloud streaming service.

Although not shown in FIG. 6, the image cloud streaming service method using data replacement according to an exemplary embodiment of the present invention stores various information generated in the cloud streaming service process according to an exemplary embodiment of the present invention do.

According to an embodiment, the storage module for storing various information may be configured independently of the cloud streaming server to support the function for the cloud streaming service. At this time, the storage module may operate as a separate mass storage and may include control functions for performing operations.

In addition, the cloud streaming server configured as described above may be implemented as one or more servers.

On the other hand, the cloud streaming server can store information in the device by loading the memory. In one implementation, the memory is a computer-readable medium. In one implementation, the memory may be a volatile memory unit, and in other embodiments, the memory may be a non-volatile memory unit. In one implementation, the storage device is a computer-readable medium. In various different implementations, the storage device may comprise, for example, a hard disk device, an optical disk device, or any other mass storage device.

By using the image cloud streaming service method through the data substitution, it is possible to reduce the resources of the server required for rendering, thereby improving the efficiency of the overall system.

In addition, the service quality can be maintained, but the cloud streaming system can be operated more effectively. By processing only the changed image and providing it to the user terminal, high-end application execution screens can be provided even in low-end terminals.

FIG. 7 is a flowchart illustrating an image cloud streaming service method according to an exemplary embodiment of the present invention.

Referring to FIG. 7, an image cloud streaming service method using data replacement according to an embodiment of the present invention searches picture data on an application execution screen (S710). At the time of the cloud streaming service, since the user does not see the screen in which the application execution screen is rendered, it may not be necessary to render it with high quality. That is, it can be said that it is not necessary to render the picture data with good quality.

Therefore, in the present invention, in order to save resources used in rendering the picture data in the cloud streaming server, it is possible to perform rendering after replacing picture data with deformation data having a smaller capacity. You can search for picture data.

Thereafter, the retrieved picture data is replaced with deformation data whose data capacity is reduced (S720).

At this time, the at least one modified data included in the application execution screen may include substitution markers. Substitution markers can be used to determine if the object to be captured is transformed data when performing capturing at a later time.

At this time, at least one picture data and at least one transformed data may be mapped and replaced.

At this time, the substitution markers may be stored together when the transformed data and the picture data are mapped and stored. In addition, the substitution tag may be included in a unique form for each transformed data, or may include a substitution tag of the same type.

At this time, at least one picture data and at least one transformed data may be mapped and stored in the mapping table. For example, a mapping table can be created, and picture data corresponding to transformed data and transformed data can be stored for each item of the table.

Thereafter, the application execution screen substituted with the transformed data is rendered (S730).

Rendering is the process of creating images from multiple scenes using a computer program. A scene file contains objects with precisely defined language or data structures, which can include an array of shapes representing the virtual scene, viewpoints, texture mapping, lighting, shading information, and so on. The data contained in such a scene file can be rendered to produce a digital image or raster graphics image file as a result. The rendering method is technically very different, but it is the same in that it creates a two-dimensional picture from the three-dimensional rendering stored in the scene file along the graphics pipeline through a rendering device such as a graphics processing unit (GPU). The GPU is also a device designed to help a central processing unit (CPU) perform complex rendering calculations.

Thereafter, a frame to capture an image to be transmitted to the terminal is detected on the rendered application execution screen (S740).

In this case, it is possible to detect intervals in which there is little change between frames among the frames corresponding to the execution screen of the rendered application, and to detect a frame in which the image is to be captured in a section where the change between frames is small. For example, it may be inefficient to provide an image-based cloud streaming service because there are a large number of images to be captured with a large number of frames between frames. Therefore, the service can be performed through the cloud streaming technique based on the video codec and the image can be captured in the changed frame in order to perform the image based cloud streaming service only in a section where the change between the frames is small.

Thereafter, it is determined whether or not a replacement mark is included in the detected frame (S745).

If the image is captured from the transformed transformed data at the time of rendering, the captured image is degraded in order to reduce the capacity, so that the user may be provided with a degraded image. Accordingly, the transformed data can be restored to the original picture data and captured by the user in order to provide the service by ensuring the image quality in the same manner as the basic method.

At this time, if the frame includes a substitution mark indicating that at least one picture data is replaced, it can be determined that the frame corresponds to at least one piece of transformed data. When replacing data, the transformed data to be substituted with the picture data may include a substitution mark to indicate that the corresponding data has been replaced. Accordingly, in order to confirm whether the frame to be captured is the transformed transformed data, it can be determined whether or not the data corresponding to the frame includes a substitution mark.

If it is determined in step S745 that the substitution mark is included, it is determined that the frame has been replaced and the corresponding frame is restored as picture data (S750).

At this time, it is possible to restore the picture data corresponding to the frame mapped with the deformation data corresponding to the frame among the at least one deformation data.

For example, it is possible to retrieve transformed data corresponding to a frame in a mapping table for mapping and storing at least one transformed data and at least one transformed transformed data on an application execution screen. The application execution screen can be restored with the image data mapped to the searched transformed data and stored in the table.

In addition, picture data corresponding to a frame in the mapping table may be obtained by using a replacement mark included in the deformation data corresponding to the frame. For example, each of the at least one deformation data may have a different replacement mark, and when the replacement mark is mapped together with the mapping table, the replacement mark may be searched as an address value to obtain the mapped image data .

At this time, a method of mapping at least one transformed data and at least one picture data to each other on the application execution screen may be various methods other than a method using a mapping table.

Thereafter, the image is captured from the reconstructed picture data (S760).

At this time, it is possible to capture an image corresponding to the changed portion compared with the previous frame of the frame. For example, it is possible to compare a current frame with a previous frame among a large number of frames constituting an application execution screen, and to judge a difference part between two frames as a changed part and capture it as an image. In addition, when the changed portion is detected as a plurality of regions on the frame, one region including a plurality of regions may be captured as an image, or a plurality of regions may be captured as a plurality of images.

If it is determined in step S745 that the substitution mark is not included, it is determined that the frame is not replaced and the image is captured without performing the restoration (S760). In other words, since the capturing part of the image is not a substituted part, capturing can be performed directly without restoration.

Thereafter, the captured image is still image encoded by a still image encoding method (S770).

At this time, the still image encoding method can be determined in consideration of the load generated in the cloud streaming server, the service speed, the image quality of the image, or the performance of the terminal receiving and rendering the encoded image. For example, to improve the speed of the cloud streaming service, you can compress the image with a palette PNG encoding method that has a high compression ratio and low load. In addition, if it is desired to provide a good image quality without regard to the load, the image can be compressed using the PNG 32-bit encoding method or the JPEG encoding method.

Thereafter, the still image encoded image is transmitted to the user terminal (S780).

FIG. 8 is a flowchart illustrating an image cloud streaming service process through data replacement according to an exemplary embodiment of the present invention. Referring to FIG.

8, an image cloud streaming service process through data substitution according to an exemplary embodiment of the present invention starts by executing an application by a web server 810 and transmitting an application execution screen to a communication unit of the cloud streaming server 110 (S802).

Thereafter, the communication unit of the cloud streaming server 110 receives the application execution screen (S804) and transfers it to the replacement rendering unit.

 Thereafter, the replacement rendering unit of the cloud streaming server 110 searches the application execution screen for the picture data (S806).

At this time, in the cloud streaming service, since the user does not see a screen on which the application execution screen is rendered, it may not be necessary to render the application with high quality. That is, it can be said that it is not necessary to render the picture data with good quality.

Therefore, in the present invention, in order to save resources used in rendering the picture data in the cloud streaming server, it is possible to perform rendering after replacing picture data with deformation data having a smaller capacity. You can search for picture data.

Subsequently, the substitution rendering unit replaces the searched picture data with transformed data whose data capacity is reduced (S808).

At this time, the at least one modified data included in the application execution screen may include substitution markers. Substitution markers can be used to determine if the object to be captured is transformed data when performing capturing at a later time.

At this time, at least one picture data and at least one transformed data may be mapped and replaced.

At this time, the substitution markers may be stored together when the transformed data and the picture data are mapped and stored. In addition, the substitution tag may be included in a unique form for each transformed data, or may include a substitution tag of the same type.

At this time, at least one picture data and at least one transformed data may be mapped and stored in the mapping table. For example, a mapping table can be created, and picture data corresponding to transformed data and transformed data can be stored for each item of the table.

Thereafter, the substitution rendering unit renders the application execution screen substituted with the transformed data (S810).

Rendering is the process of creating images from multiple scenes using a computer program. A scene file contains objects with precisely defined language or data structures, which can include an array of shapes representing the virtual scene, viewpoints, texture mapping, lighting, shading information, and so on. The data contained in such a scene file can be rendered to produce a digital image or raster graphics image file as a result. The rendering method is technically very different, but it is the same in that it creates a two-dimensional picture from the three-dimensional rendering stored in the scene file along the graphics pipeline through a rendering device such as a graphics processing unit (GPU). The GPU is also a device designed to help a central processing unit (CPU) perform complex rendering calculations.

Thereafter, the frame detection unit of the cloud streaming server 110 detects a frame to capture an image to be transmitted to the terminal 120-1 from the rendered application execution screen (S812).

In this case, it is possible to detect intervals in which there is little change between frames among the frames corresponding to the execution screen of the rendered application, and to detect a frame in which the image is to be captured in a section where the change between frames is small. For example, it may be inefficient to provide an image-based cloud streaming service because there are a large number of images to be captured with a large number of frames between frames. Therefore, the service can be performed through the cloud streaming technique based on the video codec and the image can be captured in the changed frame in order to perform the image based cloud streaming service only in a section where the change between the frames is small.

Thereafter, the capture unit of the cloud streaming server 110 determines whether a replacement mark is included in the detected frame (S814).

If the image is captured from the transformed transformed data at the time of rendering, the captured image is degraded in order to reduce the capacity, so that the user may be provided with a degraded image. Accordingly, the transformed data can be restored to the original picture data and captured by the user in order to provide the service by ensuring the image quality in the same manner as the basic method.

At this time, if the frame includes a substitution mark indicating that at least one picture data is replaced, it can be determined that the frame corresponds to at least one piece of transformed data. When replacing data, the transformed data to be substituted with the picture data may include a substitution mark to indicate that the corresponding data has been replaced. Accordingly, in order to confirm whether the frame to be captured is the transformed transformed data, it can be determined whether or not the data corresponding to the frame includes a substitution mark.

If it is determined in step S814 that the replacement mark is included, it is determined that the frame has been replaced and the corresponding frame is recovered as picture data (S816).

At this time, it is possible to restore the picture data corresponding to the frame mapped with the deformation data corresponding to the frame among the at least one deformation data.

For example, it is possible to retrieve transformed data corresponding to a frame in a mapping table for mapping and storing at least one transformed data and at least one transformed transformed data on an application execution screen. The application execution screen can be restored with the image data mapped to the searched transformed data and stored in the table.

In addition, picture data corresponding to a frame in the mapping table may be obtained by using a replacement mark included in the deformation data corresponding to the frame. For example, each of the at least one deformation data may have a different replacement mark, and when the replacement mark is mapped together with the mapping table, the replacement mark may be searched as an address value to obtain the mapped image data .

At this time, a method of mapping at least one transformed data and at least one picture data to each other on the application execution screen may be various methods other than a method using a mapping table.

Thereafter, an image is captured from the reconstructed picture data (S818).

At this time, it is possible to capture an image corresponding to the changed portion compared with the previous frame of the frame. For example, it is possible to compare a current frame with a previous frame among a large number of frames constituting an application execution screen, and to judge a difference part between two frames as a changed part and capture it as an image. In addition, when the changed portion is detected as a plurality of regions on the frame, one region including a plurality of regions may be captured as an image, or a plurality of regions may be captured as a plurality of images.

If it is determined in step S814 that the substitution mark is not included, it is determined that the frame is not replaced and the image is captured without performing the restoration (S818). In other words, since the capturing part of the image is not a substituted part, capturing can be performed directly without restoration.

Thereafter, the streaming unit of the cloud streaming server 110 performs still image encoding of the captured image using a still image encoding method (S820).

At this time, the still image encoding method can be determined in consideration of the load generated in the cloud streaming server, the service speed, the image quality of the image, or the performance of the terminal receiving and rendering the encoded image. For example, to improve the speed of the cloud streaming service, you can compress the image with a palette PNG encoding method that has a high compression ratio and low load. In addition, if it is desired to provide a good image quality without regard to the load, the image can be compressed using the PNG 32-bit encoding method or the JPEG encoding method.

Thereafter, the still image encoded image is transmitted to the user terminal 120-1 (S822).

Thereafter, the terminal 120-1 renders the received image (S824) and displays it to the user (S826).

The image cloud streaming service method through data substitution according to the present invention may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Includes all types of hardware devices that are specially configured to store and execute magneto-optical media and program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions may include machine language code such as those generated by a compiler, as well as high-level language code that may be executed by a computer using an interpreter or the like. Such a hardware device may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

As described above, the cloud streaming service system according to the present invention, the image cloud streaming service method using data substitution, and the apparatus therefor are not limited to the configuration and method of the above-described embodiments, The examples may be constructed by selectively combining all or a part of each embodiment so that various modifications can be made.

According to the present invention, at least one piece of picture data included in an application execution picture is replaced with at least one piece of transformed data having a reduced capacity, and a frame to be captured is detected from the rendered application execution picture, A frame may be restored to at least one picture data according to whether the frame corresponds to at least one piece of transform data to capture an image, and the still image may be encoded and transmitted to the terminal. Furthermore, it is possible to operate the cloud streaming server more efficiently by saving resources used for rendering in the image-based cloud streaming service.

110: Cloud streaming servers 120-1 to 120-N:
130: Network 210:
220: displacement rendering unit 230: frame detection unit
240: Capture unit 250: Streaming unit
260: storage unit 310: frames
311, 312: frame 410: previous frame
420: current frame 430: captured image
510: mapping table

Claims (10)

A substitution rendering unit that substitutes and renders at least one picture data included in an application execution picture with at least one modified data having a reduced capacity;
A frame detector for detecting a frame to capture an image to be transmitted to the terminal on the rendered application execution screen;
A capture unit for capturing the image by restoring the frame to the at least one picture data according to whether the frame corresponds to the at least one deformation data; And
A still image encoding unit for encoding the still image and transmitting the still image to the terminal,
Wherein the server comprises: The method according to claim 1,
The capture unit
Wherein the frame determining unit determines that the frame corresponds to the at least one transformed data when the frame includes a substitution mark indicating that the at least one picture data is replaced. The method of claim 2,
The capture unit
And when the frame corresponds to the at least one transformed data, restores the picture data corresponding to the frame among the at least one picture data to capture the picture. The method of claim 3,
The substitution rendering unit
Wherein the at least one image data and the at least one transformed data are mapped and replaced. The method of claim 4,
The capture unit
And restores picture data corresponding to the frame mapped with the transformed data corresponding to the frame among the at least one transformed data. The method according to claim 1,
The capture unit
And captures the image corresponding to the changed portion compared to a previous frame of the frame. The method of claim 2,
The capture unit
And to capture the image without performing the restoration if the frame does not correspond to the at least one deformation data. Replacing at least one picture data included in the application execution picture with at least one modified data whose capacity is reduced;
Detecting a frame to capture an image to be transmitted to the terminal on the rendered application execution screen;
Capturing the image by restoring the frame to the at least one picture data according to whether the frame corresponds to the at least one deformation data; And
Encoding the still image and transmitting the still image to the terminal
Wherein the image cloud streaming service method comprises: The method of claim 8,
The step of capturing
And checking whether the frame includes a substitution mark indicating that the at least one picture data is replaced,
If the replacement indicator is included, determines that the frame corresponds to the at least one deformation data. ≪ Desc / Clms Page number 13 > The method of claim 9,
The step of capturing
And if the frame corresponds to the at least one deformation data, restores picture data corresponding to the frame among the at least one picture data to capture the image.

Images