KR102313530B1 - System for cloud streaming service, method of image cloud streaming service using split screen and apparatus for the same - Google Patents

Abstract

A cloud streaming service system, an image cloud streaming service method using screen division, and an apparatus therefor are disclosed. Receive the application execution screen, classify the application execution screen into a plurality of regions based on the layout, determine the number of divisions for each of the plurality of regions based on the complexity of each region, and divide the plurality of regions according to the number of divisions It is possible to generate a plurality of capture regions by dividing the image, capture an image in at least one changeable capture region among the plurality of capture regions, compress the captured image using a still image encoding method, and transmit the captured image to the user's terminal. It is possible to significantly reduce the amount of data transmitted during the image cloud streaming service, thereby improving the speed of the cloud streaming service.

Description

Cloud streaming service system, image cloud streaming service method using screen division, and device therefor

The present invention relates to a cloud streaming service system capable of reducing the data size of an image to be captured by dividing an execution screen of an application into several areas, a method for an image cloud streaming service using the division of a capture area, and an apparatus therefor.

The rapid development of the Internet has resulted in a rapid increase in personal communication speed, and this improvement in communication speed is like downloading or uploading large amounts of data by accessing a computer located at a remote location, or using a remote computer control program as if it were a remote computer. It provides an environment where you can use a remote computer as if you were logged in locally.

In addition, as applications driven in a mobile communication terminal such as a smart phone are developed in various ways, virtualization technologies for driving applications requiring high performance in a user terminal with relatively low performance have been widely proposed.

Among them, a screen virtualization base that runs an application on the server, compresses the driving screen through video encoding, and transmits it to the client, and the client plays the transmitted video to have the same effect as if the application is running on its own terminal. of cloud streaming services are in the spotlight.

The cloud streaming service basically applied the video codec-based cloud streaming technique. However, even in the case of servicing a static screen such as a menu display, the entire screen is unnecessarily captured and the video codec is used to operate, which is inefficient as a whole system.

Therefore, when servicing a static screen, it is possible to provide a cloud streaming service by capturing only the changed part of the static screen, and to reduce the size of the service data, the screen is divided into several areas according to a certain standard An image-based cloud streaming service technology that can only serve an area is urgently emerging.

Korean Patent Laid-Open Patent No. 2010-0111711, published on October 15, 2010 (Title: Video data streaming method, video data decoding method, and one or more computing device readable media)

An object of the present invention is to reduce the amount of data delivered to a user by providing an image cloud streaming service only to a changed area among an application execution screen divided into several areas.

In addition, it is an object of the present invention to improve the service speed by reducing the amount of data transmitted during the image cloud streaming service.

In addition, it is an object of the present invention to reduce the amount of data processed when the cloud streaming server provides a service to prevent significant delay in cloud streaming.

In addition, an object of the present invention is to provide a high-spec application execution screen even in a low-spec terminal by processing only the changed image on the application execution screen and providing it to the user terminal.

Cloud streaming server according to the present invention for achieving the above object, the receiving unit for receiving the application execution screen; a region classification unit for classifying the application execution screen into a plurality of regions based on a layout; a division determining unit that determines the number of divisions for each of the plurality of areas based on the complexity of each area; a division unit dividing the plurality of areas according to the number of divisions to generate a plurality of capture areas; and a streaming unit that captures an image in at least one changeable capture area among the plurality of capture areas, compresses the captured image using a still image encoding method, and transmits the captured image to a user's terminal.

In this case, the division determining unit may determine the number of divisions so that the number of the plurality of capture areas does not exceed an acceptable limit number in the user's terminal.

In this case, the division determining unit may determine which level of complexity for each region corresponds to one of a first level, a second level, and a third level, and determine the number of divisions according to the level.

In this case, the division determining unit may determine the number of divisions to be one when the level corresponds to the third level that is not more complicated than the first level and the second level.

In this case, the complexity of each region may be included in a descriptor corresponding to each of the plurality of regions.

In this case, when there is a change in the adjacent capture areas among the plurality of capture areas, the streaming unit may recognize the adjacent capture areas as one capture area and capture the image.

In this case, the streaming unit may detect at least one capture area with the change by comparing the current frame with the previous frame among the frames of the application execution screen.

In addition, the image cloud streaming service method using the screen division according to the present invention, receiving an application execution screen; classifying the application execution screen into a plurality of regions based on a layout; determining the number of divisions for each of the plurality of areas based on the complexity of each area, and dividing the plurality of areas according to the number of divisions to generate a plurality of capture areas; and capturing an image in at least one changeable capture area among the plurality of capture areas, compressing the captured image using a still image encoding method, and transmitting the captured image to a user's terminal.

In this case, in the determining step, the number of divisions may be determined so that the number of the plurality of capture areas does not exceed an acceptable limit number in the user's terminal.

In this case, the determining may include determining whether the level of complexity for each region corresponds to any one of a first level, a second level, and a third level, and the number of divisions may be determined according to the level.

In this case, in the determining step, when the level corresponds to the third level that is not more complicated than the first level and the second level, the number of divisions may be determined as one.

In this case, the complexity of each region may be included in a descriptor corresponding to each of the plurality of regions.

In this case, the transmitting may include recognizing the adjacent capture areas as one capture area and capturing the image when there is a change in the adjacent capture areas among the plurality of capture areas.

In this case, the transmitting may detect at least one capture area with the change by comparing the current frame and the previous frame among the frames of the application execution screen.

According to the present invention, it is possible to reduce the amount of data delivered to the user by providing an image cloud streaming service only to the changed area among the application execution screen divided into several areas.

In addition, the present invention can improve the service speed by reducing the amount of data transmitted during the image cloud streaming service.

In addition, the present invention can prevent significant delay in cloud streaming by reducing the amount of data processed when the service is provided by the cloud streaming server.

In addition, the present invention can provide a high-spec application execution screen even in a low-spec terminal by processing only the changed image on the application execution screen and providing it to the user terminal.

1 is a block diagram showing a cloud streaming service system according to an embodiment of the present invention.
FIG. 2 is a block diagram illustrating an example of the cloud streaming server shown in FIG. 1 .
3 is a diagram illustrating an example in which an application execution screen is divided according to the present invention.
4 is a diagram illustrating another example in which an application execution screen is divided according to the present invention.
5 is a diagram illustrating a process of detecting a capture area by comparing frames of an application execution screen according to an embodiment of the present invention.
6 is a diagram illustrating an image cloud streaming service method using screen division according to an embodiment of the present invention.
7 is a diagram illustrating in detail an image cloud streaming service method using screen division according to an embodiment of the present invention.
8 is a diagram illustrating an image cloud streaming service process using screen division according to an embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, detailed descriptions of well-known functions or configurations that may obscure the gist of the present invention in the following description and accompanying drawings will be omitted. Also, it should be noted that throughout the drawings, the same components are denoted by the same reference numerals as much as possible. The embodiments of the present invention are provided in order to more completely explain the present invention to those of ordinary skill in the art. Accordingly, the shapes and sizes of elements in the drawings may be exaggerated for clearer description.

The terms or words used in the present specification and claims described below should not be construed as being limited to their ordinary or dictionary meanings, and the inventor is appropriate as a concept of terms for describing his invention in the best way. It should be interpreted as meaning and concept consistent with the technical idea of the present invention based on the principle that it can be defined in Accordingly, the embodiments described in this specification and the configurations shown in the drawings are only the most preferred embodiment of the present invention, and do not represent all of the technical spirit of the present invention. It should be understood that there may be equivalents and variations. In addition, terms such as first, second, etc. are used to describe various components, and are used only for the purpose of distinguishing one component from other components, and are not used to limit the components.

1 is a block diagram showing a cloud streaming service system according to an embodiment of the present invention.

Referring to FIG. 1 , the cloud streaming service system according to an embodiment of the present invention includes a cloud streaming server 110 , terminals 120-1 to 120-N, and a network 130 .

Cloud streaming server 110 receives the application execution screen.

In addition, the cloud streaming server 110 classifies the application execution screen into a plurality of areas based on the layout.

In addition, the cloud streaming server 110 determines the number of divisions for each of the plurality of areas based on the complexity of each area.

In this case, the number of divisions may be determined so that the number of the plurality of capture areas does not exceed the limit number acceptable to the user's terminal.

In this case, it may be determined which level of complexity for each region corresponds to one of the first level, the second level, and the third level, and the number of divisions may be determined according to the level.

In this case, when the level corresponds to a third level that is less complicated than the first level and the second level, the number of divisions may be determined as one.

In this case, the complexity of each region may be included in a descriptor corresponding to each of the plurality of regions.

In addition, the cloud streaming server 110 generates a plurality of capture areas by dividing the plurality of areas corresponding to the number of divisions.

In addition, the cloud streaming server 110 captures an image in at least one capture area with a change among a plurality of capture areas, and compresses the captured image in a still image encoding method to the user's terminal 120-1 to 120- to N).

In this case, when there is a change in the adjacent capture areas among the plurality of capture areas, the adjacent capture areas may be recognized as one capture area and an image may be captured.

At this time, the current frame and the previous frame among the frames of the application execution screen may be compared to detect at least one capture area having a change.

The terminals 120-1 to 120-N receive the application execution screen corresponding to the cloud streaming service from the cloud streaming server 110 and provide it to the user.

In addition, each of the terminals 120-1 to 120-N is a device that is connected to a communication network and can execute an application based on a cloud computing system, and is not limited to a mobile communication terminal, and includes all information and communication devices, multimedia terminals, wired terminals, It may be various terminals such as a fixed terminal and an IP (Internet Protocol) terminal. In addition, each of the terminals 120-1 to 120-N is a mobile phone, PMP (Portable Multimedia Played), MID (Mobile Internet Device), smartphone (Smart Phone), desktop (Desktop), tablet computer (Tablet PC), notebook It may be a mobile terminal having various mobile communication specifications, such as a note book, a net book, a personal digital assistant (PDA), a smart TV, and an information communication device.

In addition, the terminals 120-1 to 120-N receive various information, such as number and character information, and receive signals input in connection with setting various functions and controlling functions of the terminals 120-1 to 120-N. It can be transmitted to the control unit through the input unit. In addition, the input unit of the terminals 120-1 to 120-N may be configured to include at least one of a keypad and a touchpad that generate an input signal according to a user's touch or manipulation. At this time, the input unit of the terminals 120-1 to 120-N is configured in the form of a single touch panel (or touch screen) together with the display unit of the terminals 120-1 to 120-N, so that input and The display function can be performed at the same time. In addition, as the input unit of the terminals 120-1 to 120-N, all types of input means that may be developed in the future may be used in addition to input devices such as a keyboard, a keypad, a mouse, and a joystick. In particular, the input unit of the terminals 120-1 to 120-N according to the present invention may transmit an input signal for uploading or downloading content based on cloud computing to the control unit of the terminals 120-1 to 120-N.

In addition, the display unit of the terminals 120-1 to 120-N may display information about a series of operation states and operation results that occur while the functions of the terminals 120-1 to 120-N are performed. Also, the display unit of the terminals 120-1 to 120-N may display menus of the terminals 120-1 to 120-N and user data input by the user. Here, the display unit of the terminals 120-1 to 120-N includes a liquid crystal display (LCD), an ultra-thin liquid crystal display (TFT-LCD, Thin Film Transistor LCD), and a light emitting diode (LED, Light Emitting Diode). , organic light emitting diode (OLED, Organic LED), active organic light emitting diode (AMOLED, Active Matrix OLED), retina display (Retina Display), flexible display (Flexible display) and three-dimensional (3 Dimension) display, etc. have. At this time, when the display unit of the terminals 120-1 to 120-N is configured in the form of a touch screen, the display unit of the terminals 120-1 to 120-N functions as an input unit of the terminals 120-1 to 120-N. You can do some or all of them. In particular, the display unit of the terminals 120-1 to 120-N according to the present invention may display information related to the execution of content provided based on cloud computing on a screen.

In addition, the storage unit of the terminals 120-1 to 120-N is a device for storing data, and includes a main memory and an auxiliary memory, and is an application necessary for the functional operation of the terminals 120-1 to 120-N. program can be saved. The storage unit of the terminals 120-1 to 120-N may largely include a program area and a data area. Here, when each function is activated in response to a user's request, the terminals 120-1 to 120-N execute corresponding application programs under the control of the control unit to provide each function. In particular, the storage unit of the terminals 120-1 to 120-N according to the present invention can store an operating system for booting the terminals 120-1 to 120-N, a program for uploading or downloading content based on cloud computing, etc. have. In addition, the storage unit of the terminals 120-1 to 120-N may store a content DB for storing a plurality of contents and information of the terminals 120-1 to 120-N. In this case, the content DB includes execution data for executing the content and attribute information on the content, and content usage information according to the content execution may be stored. And, the information of the terminals 120-1 to 120-N may include terminal specification information.

In addition, the communication unit of the terminals 120-1 to 120-N may perform a function for transmitting and receiving data through the cloud streaming server 110 and the network 130 . Here, the communication unit of the terminals 120-1 to 120-N may include an RF transmitting means for up-converting and amplifying the frequency of the transmitted signal, and an RF receiving means for low-noise amplifying the received signal and down-converting the frequency. . The communication unit of the terminals 120-1 to 120-N may include at least one of a wireless communication module and a wired communication module. In addition, the wireless communication module is a configuration for transmitting and receiving data according to a wireless communication method, and when the terminals 120-1 to 120-N use wireless communication, a wireless network communication module, a wireless LAN communication module, and a wireless fan communication module Using any one of the data can be transmitted and received to the cloud streaming server (110). In addition, the wired communication module is for transmitting and receiving data by wire. The wired communication module may connect to the network 130 through a wire and transmit/receive data to/from the cloud streaming server 110 . That is, the terminals 120-1 to 120-N may connect to the network 130 using a wireless communication module or a wired communication module, and may transmit/receive data to and from the cloud streaming server 110 through the network 130 . In particular, the network 130 according to the present invention may communicate with the cloud streaming server 110 or other terminals 120-1 to 120-N to transmit and receive data required to upload or download content based on cloud computing.

In addition, the control unit of the terminal devices 120-1 to 120-N may be a process device for driving an operating system (OS, Operation System) and each configuration. For example, the control unit is a cloud streaming server 110 . When accessing the cloud streaming server 110 through a separate service application, it is possible to control the overall process of executing the service application according to the user's request, and simultaneously with the execution of the cloud It is possible to control the request to use the service to be transmitted to the streaming server 110, and at this time, it is possible to control so that information of the terminals 120-1 to 120-N required for user authentication is transmitted together.

In addition, the controller of the terminals 120-1 to 120-N may execute specific content stored in the storage unit of the terminals 120-1 to 120-N according to a user's request. In this case, the controller may store the content use history according to the content execution as content use information.

In addition, the control unit of the terminals 120-1 to 120-N performs cloud streaming together with execution data for executing the content, content information including attribute information about the content, and content use information, which is information according to the content use history. It can be uploaded by sending it to the server 110 . Thereafter, the control unit can delete the uploaded content by transmitting to the cloud streaming server 110 from the storage unit of the terminals 120-1 to 120-N according to the user's request, and accessing the cloud streaming server 110 to Content may be executed and used through the cloud streaming server 110 .

In addition, the control unit of the terminals (120-1 to 120-N) may be controlled to be stored in the storage after accessing the cloud streaming server 110 to download the content from the other terminals (120-1 to 120-N), , when executing content through the cloud streaming server 110, it is also possible to control the content to be executed after receiving only the data necessary for execution.

The network 130 is a concept that provides a path for transferring data between the cloud streaming server 110 and the terminals 120-1 to 120-N, and encompasses both existing networks and networks that can be developed in the future. . For example, the network 130 is a wired/wireless local area network that provides communication of various information devices within a limited area, a mobile communication network that provides communication between mobile bodies and between the mobile body and the outside of the mobile body, and communication between the earth station and the earth station using satellites. It may be a satellite communication network providing Meanwhile, the transmission method standard of the network 130 is not limited to the existing transmission method standard, and may include all transmission method standards to be developed in the future. In addition, the network used between the cloud streaming server 110 and the terminals 120-1 to 120-N in FIG. 1 may be different from the network used between the terminals 120-1 to 120-N, It may be the same.

FIG. 2 is a block diagram illustrating an example of the cloud streaming server shown in FIG. 1 .

Referring to FIG. 2 , the cloud streaming server 110 shown in FIG. 1 includes a receiving unit 210 , a region classifying unit 220 , a division determining unit 230 , a dividing unit 240 , a streaming unit 250 and storage. part 260 .

The receiver 210 receives an application execution screen.

In this case, the application execution screen may be received through a communication network such as the network shown in FIG. 1 . In addition, a request for a cloud streaming service may be received from the terminal.

At this time, it is possible to receive an application execution screen from the application server for the cloud streaming service requested by the terminal.

The region classification unit 220 classifies the application execution screen into a plurality of regions based on the layout.

In the web application server, each component of the application must be effectively arranged and displayed in a limited space called a frame, and this can be called a layout. Such a layout configuration can be obtained through the source code of the web application server. For example, if you check the information of the semantic tag, which is the layout configuration tag, you can know the layout structure on the frame.

A few examples of semantic tags, which are layout configuration tags, can be used to create a header area of a web page that is mainly used to display a logo through the <header> tag. In addition, the <footer> tag can be used to create the bottom area of a web page that is mainly used to indicate copyright, and the <nav> tag can be used to create a menu area for the web page. In addition, the main content area can be created through the <article> tag, and an area containing additional content can be created on the left or right side of the page through the <aside> tag, which is usually used as a quick menu or advertisement area. .

Accordingly, the frame corresponding to the application execution screen may be classified into regions corresponding to the layout structure.

In this case, the classified regions may be different according to the layout of the corresponding frame. For example, since several pages may exist in one application, regions may be classified based on a layout according to each page.

The division determining unit 230 determines the number of divisions for each of the plurality of areas based on the complexity of each area.

For example, in order to more efficiently use the limited resources of the cloud streaming server in the case of an image-based cloud streaming service, only the difference between the previous screen and the newly entered screen of the application execution screen should be sent to the user terminal.

At this time, it is possible to check whether differences are included in each of the areas that are primarily classified based on the layout, so that only the areas with differences are encoded and transmitted to the terminal. However, among the areas classified based on the layout, the area including the main content of the application may have a complicated configuration or a large amount of change may occur. Therefore, when processing the area including the main content, the cloud streaming server may perform many calculations, and thus the load may increase.

In order to solve such a problem, in the present invention, it is possible to further divide the area primarily classified based on the layout by checking the complexity of each area that affects the amount of computation of the cloud streaming server.

In this case, it is possible to determine the number of divisions into which the firstly classified regions are to be divided by using the complexity for each region capable of predicting the amount of computation when processing the corresponding region. For example, it may be assumed that the application execution screen is classified into three regions corresponding to the first region, the second region, and the third region based on the layout. Thereafter, the complexity of each region of the first region, the second region, and the third region may be checked, respectively. If the first region has a greater complexity for each region than the second region or the third region, the cloud streaming server may perform the most calculations when processing the first region. Accordingly, the number of divisions can be determined and divided so that only a part having a difference among the first area can be processed to reduce the amount of calculation.

In this case, the number of divisions may be determined so that the number of the plurality of capture areas does not exceed the limit number acceptable to the user's terminal.

In this case, the capture area may be an area generated by dividing each of a plurality of areas classified based on a layout, and all areas after division may be a capture area. For example, assuming that there are a first area, a second area, and a third area classified based on the layout, if the first area is divided into two and the second area and the third area are divided into three each, the total Eight capture areas can be created.

Also, a region in which the number of divisions is determined to be one may be recognized as a capture region without division. For example, assuming that there are a first area and a second area classified based on the layout, if the first area is divided into two but the number of divisions of the second area is determined to be 1 and thus is not divided, the second area is A total of three capture areas may be generated by recognizing the capture area as it is.

Accordingly, it is possible to determine the number of divisions so that the number of the plurality of capture regions generated in this way does not exceed an acceptable limit number according to the performance of the user's terminal, that is, a number that does not cause a problem in simultaneous processing in the user's terminal. For example, if it is assumed that the number that can be simultaneously processed by the user's terminal is 10, the number of divisions may be determined so that the total number of generated capture regions does not exceed 10.

In this case, it may be determined which level of complexity for each region corresponds to one of the first level, the second level, and the third level, and the number of divisions may be determined according to the level. For example, it can be assumed that the complexity of each domain is calculated as a number from 1 to 100, and that the more the complexity of each domain is closer to 100, the more complex the corresponding domain is. In this case, a relatively complex region with a complexity of each region included in 100 to 70 is set to the first level, an intermediate-level region included in 70 to 30 is set to the second level, and a relatively simple region included in 30 to 0 is set to the third level. can be judged as

Accordingly, since the complexity of a specific region can be predicted according to which level the specific region corresponds to, the number of divisions can be set in advance according to each level. For example, since the first level is a more complex area than the second or third level, you can set the number of divisions of 3 or 4, and set the number of divisions to 1 so that the second level is not divided into two and the third level is not divided. It can be set as a dog.

In this case, the number of divisions that can be set in advance may be adjusted according to the number that can be simultaneously processed by the user terminal. For example, for a terminal capable of simultaneously processing more than 10 capture areas, it can be set to be divided into 4, 3, and 1, respectively, for each of the first level, the second level, and the third level, and the number of captures of about 8 For a terminal with relatively low performance that can process only regions at the same time, it may be set to be divided into three, two, and one for each of the first level, the second level, and the third level, respectively. That is, the number of divisions corresponding to the level of complexity for each region may be prepared in various types, and the type according to the performance of the user terminal may be applied and used.

In this case, when the level corresponds to a third level that is less complicated than the first level and the second level, the number of divisions may be determined as one. That is, a simple region whose complexity for each region is not higher than the first level or the second level can be prevented from being further divided by determining the number of divisions to one. For example, in the layout, the header area mainly representing information, logos, dates, etc. may not change much compared to the area representing content. However, when the header area is divided and processed, it may be inefficient because all unnecessary divided areas need to be checked even though no change occurs.

Accordingly, the number of regions corresponding to the third level of low complexity for each region is determined to be one, so that it is controlled not to be further divided.

In this case, the complexity of each region may be included in a descriptor corresponding to each of the plurality of regions. For example, the descriptor may include information about the layout, source code information of a web application server constituting the layout, or table information about a layout structure included in the source code. That is, information related to the layout of the application execution screen required to calculate the complexity for each region may be included.

In addition, the descriptor may be received together when the cloud streaming server receives the application execution screen from the web application server, or may be received separately from the application execution screen.

The division unit 240 divides the plurality of areas according to the number of divisions to generate a plurality of capture areas.

In this case, all of the divided capture areas may have the same width. That is, the capture regions may be generated by dividing them into equal parts according to the number of divisions.

In addition, the capture areas may be divided in various ways according to the settings of the administrator of the cloud streaming service system. For example, it may be divided vertically or horizontally at the same size, or divided to have the same width although not in a uniform shape.

The streaming unit 250 captures an image in at least one changeable capture area among a plurality of capture areas, compresses the captured image using a still image encoding method, and transmits the captured image to the user's terminal.

The video codec-based cloud streaming technique can perform encoding by capturing all frames corresponding to the screen on which the application operates. However, if the frame-to-frame change is not large on the screen on which the application is running, still image encoding is performed by capturing only the area of change of the frame that has changed compared to the previous frame, as in the image-based cloud streaming technique, and displayed on the user's terminal device. The display can be displayed in such a way that the parts except the change area are shown the same and only the change area is changed.

In this case, when there is a change in the adjacent capture areas among the plurality of capture areas, the adjacent capture areas may be recognized as one capture area and an image may be captured. For example, it may be assumed that the first capture area and the second capture area are adjacent to each other, and there is a change in the two capture areas. At this time, since the cloud streaming server captures images in the first capture area and the second capture area, respectively, and performs still image encoding, it is possible to unnecessarily perform two processing steps. Therefore, the cloud streaming service can be performed more quickly and efficiently by combining the first capture area and the second capturing area to recognize the third capture area, and performing image capture and still image encoding for the third capture area.

At this time, the current frame and the previous frame among the frames of the application execution screen may be compared to detect at least one capture area having a change. For example, if the current frame is changed compared to the previous frame when the current frame and the previous frame are compared, at least one capture area with a change among a plurality of capture areas generated by dividing the current frame may be detected. have.

In addition, a screen corresponding to the detected capture area may be captured as an image and compressed using a still image encoding method.

In this case, the captured image may have various types or sizes according to an application execution screen or a capture area.

In this case, the still image encoding method may be determined in consideration of the load generated in the cloud streaming server 110, service speed, image quality, or performance of a terminal that receives and renders the encoded image. For example, in order to improve the speed of a cloud streaming service, an image may be compressed using a palette PNG encoding method that has a high compression rate and a low load. In addition, if you want to provide a good image quality regardless of the load, you can compress the image using a PNG32bit encoding method or a JPEG encoding method.

In this case, it is possible to detect sections in which the changes between frames are small among the application frames, and capture images in the sections in which the changes between frames are small. For example, it may be inefficient to provide an image-based cloud streaming service because the number of images to be captured is large in a section where there is a lot of change between frames. Therefore, in such a section with many changes, the service is performed through the video codec-based cloud streaming technique, and the image of the changed capture area can be captured to perform the image-based cloud streaming service only in the section with little change between frames. .

The storage unit 260 stores various information generated in the process of the cloud streaming service according to the embodiment of the present invention as described above.

According to an embodiment, the storage unit 260 may be configured independently of the cloud streaming server 110 to support a function for a cloud streaming service. In this case, the storage unit 260 may operate as a separate mass storage and may include a control function for performing an operation.

In addition, the cloud streaming server 110 configured as described above may be implemented as one or more servers.

On the other hand, the cloud streaming server 110 is equipped with a memory can store information in the device. For one implementation, the memory is a computer-readable medium. In one implementation, the memory may be a volatile memory unit, and in another implementation, the memory may be a non-volatile memory unit. In one embodiment, the storage device is a computer-readable medium. In various different implementations, the storage device may include, for example, a hard disk device, an optical disk device, or some other mass storage device.

Through such a cloud streaming server 110, it is possible to effectively capture the part where a change occurs in the application execution screen, so that the limited resources of the cloud streaming server 110 can be used more efficiently.

In addition, since the capacity of image data transmitted to the user's terminal can be reduced, the transmission speed can be improved, thereby improving the overall cloud streaming service speed.

In addition, since high-spec applications can be executed even in low-spec user terminals, it is possible to reduce the cost of replacing the terminal in order for the user to use the high-spec applications.

3 is a diagram illustrating an example in which an application execution screen is divided according to the present invention.

Referring to FIG. 3 , it is possible to check the application execution screen divided according to the present invention.

It can be seen that the application execution screen shown in FIG. 3 is classified into a simple text area 310 , a poster area 320 , and a text area 330 according to the layout of the web application server.

The simple text area 310 of FIG. 3 may include text or correspond to an area displaying a date, etc. so that the corresponding application execution screen is an execution screen providing VOD.

The poster area 320 may be an area providing a poster of a VOD provided by a corresponding application. For example, it may include poster images such as movies, broadcast programs, and animations that can be provided as VOD.

In this case, since the poster area 320 is an area representing main content of the corresponding application, it may correspond to an area in which changes occur frequently. In addition, since images such as movie posters are displayed using various colors, the complexity of each area may correspond to a higher level than that of the simple text area 310 or the text area 330 .

Accordingly, the poster area 320 may be divided like the divided poster areas 322 to 328 of FIG. 3 to perform a cloud streaming service. In this case, the number of divisions of the poster area 320 may be determined to be four, and each of the divided poster areas 322 to 328 may have the same width as shown in FIG. 3 .

The text area 330 may include a description of the image shown in the poster area 320 . That is, since it may be an area including a text description, it is determined that the complexity of each area is low and the number of divisions may be determined as one. Also, the simple text area 310 may not be divided by determining that the complexity of each area is low, and determining the number of divisions to be one, similarly to the text area 330 .

Accordingly, in the application execution screen shown in FIG. 3 , a total of six capture areas may be generated, and an image-based cloud streaming service may be performed by detecting a frame change of the application execution screen based on each capture area.

4 is a diagram illustrating another example in which an application execution screen is divided according to the present invention.

Referring to FIG. 4 , it can be seen that the layout is changed in the application execution screen described in FIG. 3 .

The application execution screen shown in FIG. 4 may be classified into a menu list area 410 to 440 and a menu display area 450 based on the layout.

The menu list areas 410 to 440 may be screens showing menus that can be selected from the current application execution screen. For example, the menu may include a menu for executing various commands, such as executing or stopping a file or ending an application.

The menu display area 450 may be an area representing content that is executed when a menu of the menu list areas 410 to 440 is selected. Alternatively, when a menu in the menu list area 410 to 440 is selected, a window for confirming whether to perform the corresponding menu to the user may be displayed on the menu display area 450 .

In this case, since the menu list areas 410 to 440 may include text for the corresponding menu, it is determined that the complexity for each area is low, and the number of divisions of each menu list area 410 to 440 can be determined as one. .

In addition, since the menu display area 450 can provide various screens such as executing content or opening a window, it is determined that the complexity of each area is higher than that of the menu list area 410 to 440, and the number of divisions is 2 or more. can be decided with

5 is a diagram illustrating a process of detecting a capture area by comparing frames of an application execution screen according to an embodiment of the present invention.

Referring to FIG. 5 , in the process of detecting a capture area by comparing frames of an application execution screen according to an embodiment of the present invention, a previous frame 510 and a current frame 520 of the application execution screen may be compared first.

Looking at the previous frame 510 of the application execution screen, it can be seen that the application execution screen is classified into six areas corresponding to A, B, C, D, E, and F based on the layout.

At this time, if the current frame 520 of the application execution screen is checked, it is confirmed that the regions corresponding to B, D and F among the regions constituting the previous frame 510 are changed to B', D' and F', respectively. can

Accordingly, the cloud streaming server can detect regions corresponding to B ', D ' and F ' that are different in the current frame 520 as compared to the previous frame 510 as changed capture regions 532 to 536. .

Thereafter, images may be captured in the detected changed capture regions 532 to 536 corresponding to each region, and the captured image may be compressed using a still image encoding method and transmitted to the user's terminal.

In this case, since regions corresponding to B', D', and F' are all adjacent, three regions may be recognized as one capture region, and an image may be captured corresponding to one region.

In this way, by recognizing several adjacent capture areas as one capture area and performing capture and still image encoding, a pipeline processing process that may be repeatedly performed can be processed more efficiently. In addition, such processing may reduce the load generated by the cloud streaming server, and may bring the effect of saving the limited resources of the cloud streaming server.

6 is a diagram illustrating an image cloud streaming service method using screen division according to an embodiment of the present invention.

Referring to FIG. 6 , the image cloud streaming service method using screen division according to an embodiment of the present invention receives an application execution screen (S610).

In this case, the application execution screen may be received through a communication network such as the network shown in FIG. 1 . In addition, a request for a cloud streaming service may be received from the terminal.

At this time, it is possible to receive an application execution screen from the application server for the cloud streaming service requested by the terminal.

In addition, the image cloud streaming service method using screen division according to an embodiment of the present invention classifies the application execution screen into a plurality of areas based on the layout (S620).

In the web application server, each component of the application must be effectively arranged and displayed in a limited space called a frame, and this can be called a layout. Such a layout configuration can be obtained through the source code of the web application server. For example, if you check the information of the semantic tag, which is the layout configuration tag, you can know the layout structure on the frame.

A few examples of semantic tags, which are layout configuration tags, can be used to create a header area of a web page that is mainly used to display a logo through the <header> tag. In addition, the <footer> tag can be used to create the bottom area of a web page that is mainly used to indicate copyright, and the <nav> tag can be used to create a menu area for the web page. In addition, the main content area can be created through the <article> tag, and an area containing additional content can be created on the left or right side of the page through the <aside> tag, which is usually used as a quick menu or advertisement area. .

Accordingly, the frame corresponding to the application execution screen may be classified into regions corresponding to the layout structure.

In this case, the classified regions may be different according to the layout of the corresponding frame. For example, since several pages may exist in one application, regions may be classified based on a layout according to each page.

In addition, the image cloud streaming service method using screen division according to an embodiment of the present invention determines the number of divisions for each of a plurality of areas based on the complexity of each area, and divides the plurality of areas according to the number of divisions. A plurality of capture areas are generated (S630).

For example, in order to more efficiently use the limited resources of the cloud streaming server in the case of an image-based cloud streaming service, only the difference between the previous screen and the newly entered screen of the application execution screen should be sent to the user terminal.

At this time, it is possible to check whether differences are included in each of the areas that are primarily classified based on the layout, so that only the areas with differences are encoded and transmitted to the terminal. However, among the areas classified based on the layout, the area including the main content of the application may have a complicated configuration or a large amount of change may occur. Therefore, when processing the area including the main content, the cloud streaming server may perform many calculations, and thus the load may increase.

In order to solve such a problem, in the present invention, it is possible to further divide the area primarily classified based on the layout by checking the complexity of each area that affects the amount of computation of the cloud streaming server.

In this case, it is possible to determine the number of divisions into which the firstly classified regions are to be divided by using the complexity for each region capable of predicting the amount of computation when processing the corresponding region. For example, it may be assumed that the application execution screen is classified into three regions corresponding to the first region, the second region, and the third region based on the layout. Thereafter, the complexity of each region of the first region, the second region, and the third region may be checked, respectively. If the first region has a greater complexity for each region than the second region or the third region, the cloud streaming server may perform the most calculations when processing the first region. Accordingly, the number of divisions can be determined and divided so that only a part having a difference among the first area can be processed to reduce the amount of calculation.

In this case, the number of divisions may be determined so that the number of the plurality of capture areas does not exceed the limit number acceptable to the user's terminal.

In this case, the capture area may be an area generated by dividing each of a plurality of areas classified based on a layout, and all areas after division may be a capture area. For example, assuming that there are a first area, a second area, and a third area classified based on the layout, if the first area is divided into two and the second area and the third area are divided into three each, the total Eight capture areas can be created.

Also, a region in which the number of divisions is determined to be one may be recognized as a capture region without division. For example, assuming that there are a first area and a second area classified based on the layout, if the first area is divided into two but the number of divisions of the second area is determined to be 1 and thus is not divided, the second area is A total of three capture areas may be generated by recognizing the capture area as it is.

Accordingly, it is possible to determine the number of divisions so that the number of the plurality of capture regions generated in this way does not exceed an acceptable limit number according to the performance of the user's terminal, that is, a number that does not cause a problem in simultaneous processing in the user's terminal. For example, if it is assumed that the number that can be simultaneously processed by the user's terminal is 10, the number of divisions may be determined so that the total number of generated capture regions does not exceed 10.

In this case, it may be determined which level of complexity for each region corresponds to one of the first level, the second level, and the third level, and the number of divisions may be determined according to the level. For example, it can be assumed that the complexity of each domain is calculated as a number from 1 to 100, and that the more the complexity of each domain is closer to 100, the more complex the corresponding domain is. In this case, a relatively complex region with a complexity of each region included in 100 to 70 is set to the first level, an intermediate-level region included in 70 to 30 is set to the second level, and a relatively simple region included in 30 to 0 is set to the third level. can be judged as

Accordingly, since the complexity of a specific region can be predicted according to which level the specific region corresponds to, the number of divisions can be set in advance according to each level. For example, since the first level is a more complex area than the second or third level, you can set the number of divisions of 3 or 4, and set the number of divisions to 1 so that the second level is not divided into two and the third level is not divided. It can be set as a dog.

In this case, the number of divisions that can be set in advance may be adjusted according to the number that can be simultaneously processed by the user terminal. For example, for a terminal capable of simultaneously processing more than 10 capture areas, it can be set to be divided into 4, 3, and 1, respectively, for each of the first level, the second level, and the third level, and the number of captures of about 8 For a terminal with relatively low performance that can process only regions at the same time, it may be set to be divided into three, two, and one for each of the first level, the second level, and the third level, respectively. That is, the number of divisions corresponding to the level of complexity for each region may be prepared in various types, and the type according to the performance of the user terminal may be applied and used.

In this case, when the level corresponds to a third level that is less complicated than the first level and the second level, the number of divisions may be determined as one. That is, a simple region whose complexity for each region is not higher than the first level or the second level can be prevented from being further divided by determining the number of divisions to one. For example, in the layout, the header area mainly representing information, logos, dates, etc. may not change much compared to the area representing content. However, when the header area is divided and processed, it may be inefficient because all unnecessary divided areas need to be checked even though no change occurs.

Accordingly, the number of regions corresponding to the third level of low complexity for each region is determined to be one, so that it is controlled not to be further divided.

In this case, the complexity of each region may be included in a descriptor corresponding to each of the plurality of regions. For example, the descriptor may include information about the layout, source code information of a web application server constituting the layout, or table information about a layout structure included in the source code. That is, information related to the layout of the application execution screen required to calculate the complexity for each region may be included.

In addition, the descriptor may be received together when the cloud streaming server receives the application execution screen from the web application server, or may be received separately from the application execution screen.

In this case, all of the divided capture areas may have the same width. That is, the capture regions may be generated by dividing them into equal parts according to the number of divisions.

In addition, the capture areas may be divided in various ways according to the settings of the administrator of the cloud streaming service system. For example, it may be divided vertically or horizontally at the same size, or divided to have the same width although not in a uniform shape.

In addition, the image cloud streaming service method using screen division according to an embodiment of the present invention captures an image in at least one changeable capture area among a plurality of capture areas, and compresses the captured image in a still image encoding method. and transmits it to the user's terminal (S640).

The video codec-based cloud streaming technique can perform encoding by capturing all frames corresponding to the screen on which the application operates. However, if the frame-to-frame change is not large on the screen on which the application is running, still image encoding is performed by capturing only the area of change of the frame that has changed compared to the previous frame, as in the image-based cloud streaming technique, and displayed on the user's terminal device. The display can be displayed in such a way that the parts except the change area are shown the same and only the change area is changed.

In this case, when there is a change in the adjacent capture areas among the plurality of capture areas, the adjacent capture areas may be recognized as one capture area and an image may be captured. For example, it may be assumed that the first capture area and the second capture area are adjacent to each other, and there is a change in the two capture areas. At this time, since the cloud streaming server captures images in the first capture area and the second capture area, respectively, and performs still image encoding, it is possible to unnecessarily perform two processing steps. Therefore, the cloud streaming service can be performed more quickly and efficiently by combining the first capture area and the second capturing area to recognize the third capture area, and performing image capture and still image encoding for the third capture area.

At this time, the current frame and the previous frame among the frames of the application execution screen may be compared to detect at least one capture area having a change. For example, if the current frame is changed compared to the previous frame when the current frame and the previous frame are compared, at least one capture area with a change among a plurality of capture areas generated by dividing the current frame may be detected. have.

In addition, a screen corresponding to the detected capture area may be captured as an image and compressed using a still image encoding method.

In this case, the captured image may have various types or sizes according to an application execution screen or a capture area.

In this case, the still image encoding method may be determined in consideration of the load generated in the cloud streaming server 110, service speed, image quality, or performance of a terminal that receives and renders the encoded image. For example, in order to improve the speed of a cloud streaming service, an image may be compressed using a palette PNG encoding method that has a high compression rate and a low load. In addition, if you want to provide a good image quality regardless of the load, you can compress the image using a PNG32bit encoding method or a JPEG encoding method.

In this case, it is possible to detect sections in which the changes between frames are small among the application frames, and capture images in the sections in which the changes between frames are small. For example, it may be inefficient to provide an image-based cloud streaming service because the number of images to be captured is large in a section where there is a lot of change between frames. Therefore, in such a section with many changes, the service is performed through the video codec-based cloud streaming technique, and the image of the changed capture area can be captured to perform the image-based cloud streaming service only in the section with little change between frames. .

In addition, although not shown in FIG. 6 , the image cloud streaming service method using screen division according to an embodiment of the present invention stores various information generated in the process of the cloud streaming service according to the embodiment of the present invention as described above. do.

By using such an image-based cloud streaming service method, it is possible to reduce the load that occurs on the cloud streaming server, and according to the reduced load, it is possible to secure the number of users who can connect at the same time, which is a more effective image-based cloud streaming service. can provide

7 is a diagram illustrating in detail an image cloud streaming service method using screen division according to an embodiment of the present invention.

Referring to FIG. 7 , the image cloud streaming service method using screen division according to an embodiment of the present invention receives an application execution screen (S702).

Thereafter, the received application execution screen is classified into a plurality of regions based on the layout (S704).

In this case, information related to the layout may be obtained based on the source code of the web application server.

Thereafter, for each of the plurality of classified regions, it is determined whether the level of complexity for each region corresponds to a first level ( S706 ).

In this case, the complexity of each region may be included in a descriptor corresponding to each of the plurality of regions. In addition, it is possible to calculate the complexity of each region as a numerical value, and determine whether the complexity of each region corresponds to the first level according to whether the numerical value corresponds to the first level.

If it is determined in step S706 that the level of complexity for each region is the first level, the number of divisions is determined corresponding to the first level (S708).

At this time, the number of divisions corresponding to the first level may be set in advance through the cloud streaming service system manager.

Thereafter, a plurality of regions may be divided according to the determined number of divisions ( S710 ). For example, it may be assumed that the application execution screen is classified into a first area and a second area based on the layout. In this case, if it is determined that the level of complexity for each region of the first region is the first level, the first region may be divided into the number of divisions corresponding to the first level.

If it is determined in step S706 that the level of complexity for each area is not the first level, it is determined whether the level of complexity for each area corresponds to the second level for each of the plurality of classified areas ( S712 ).

In this case, the second level may correspond to a level having a lower complexity for each domain than the first level, that is, less complex than the first level.

If it is determined in step S712 that the level of complexity for each region is the second level, the number of divisions is determined corresponding to the second level (S714).

At this time, the number of divisions corresponding to the second level may also be set in advance through the cloud streaming service system manager in the same way as the number of divisions corresponding to the first level.

In this case, the number of divisions may be determined such that the number of the plurality of capture regions finally generated does not exceed the limit number that is acceptable to the user's terminal. For example, if the number of simultaneous processing in the user's terminal is 10, the number of the determined number of divisions may be adjusted so that the capture area does not exceed 10.

Thereafter, a plurality of regions may be divided according to the determined number of divisions ( S710 ).

If it is determined in step S712 that the level of complexity for each area is not the second level, the level of complexity for each area is determined as the third level, and the number of divisions is determined to be one corresponding to the third level (S716). That is, it is determined that the region should not be divided due to the low complexity of each region, and the number of divisions may be determined to be 1 so that the corresponding region is not divided.

Thereafter, since the number of divisions is 1, the corresponding area is not divided, and the corresponding area is recognized as a capture area as it is (S718).

Thereafter, frames of the application execution screen are compared to detect a changed capture area among a plurality of capture areas generated by performing division ( S720 ).

Thereafter, at least one changeable capture area among the plurality of capture areas is detected ( S722 ).

In this case, at least one capture area including the changed portion may be detected by comparing the previous frame and the current frame of the application execution screen.

Thereafter, an image is captured corresponding to the detected at least one capture region ( S724 ).

In this case, when adjacent capture areas exist among the at least one capture area, the adjacent capture areas may be recognized as one capture area and an image may be captured.

Thereafter, the captured image is compressed using a still image encoding method (S726).

In this case, the still image encoding method may be selected in consideration of the load generated by the cloud streaming server, service speed, image quality, or performance of a terminal that receives and renders the encoded image. For example, in order to improve the speed of a cloud streaming service, an image may be compressed using a palette PNG encoding method that has a high compression rate and a low load. In addition, if you want to provide a good image quality regardless of the load, you can compress the image using a PNG32bit encoding method or a JPEG encoding method.

Thereafter, the image-based cloud streaming service may be provided by transmitting the still image-encoded image to the user's terminal (S728).

In this case, the user's terminal may provide the application execution screen by rendering the still image-encoded and transmitted image and displaying it to the user.

8 is a diagram illustrating an image cloud streaming service process using screen division according to an embodiment of the present invention.

Referring to FIG. 8, in the image cloud streaming service process using screen division according to an embodiment of the present invention, the application server first executes an application at the user's request (S802).

After that, the application server transmits the application execution screen to the cloud streaming server 110 (S804).

At this time, the application server may transmit the application execution screen to the cloud streaming server 110 through a communication network such as a network.

The cloud streaming server 110 receives the application execution screen through the receiver (S806).

The cloud streaming server 110 checks the layout of the application execution screen received through the region classification unit (S808), and classifies the application execution screen into a plurality of regions based on the layout (S810).

At this time, the cloud streaming server 110 may check the layout based on the source code corresponding to the application execution screen.

Thereafter, the division determining unit of the cloud streaming server 110 checks the complexity for each region for each of the plurality of regions (S812), and determines the number of divisions for the plurality of regions based on the complexity for each region (S814) ).

In this case, the complexity of each region may be included in a descriptor corresponding to each of the plurality of regions, and the number of divisions is determined by determining which level of complexity for each region corresponds to one of the first, second, and third levels. can

In addition, the number of divisions may be determined so that the number of the plurality of capture regions generated through division does not exceed a limit number that can be accommodated in the user's terminal 120 - 1 .

Thereafter, the division unit of the cloud streaming server 110 generates a plurality of capture areas by dividing each of the plurality of areas corresponding to the determined number of divisions (S816).

At this time, the widths of the plurality of capture areas may be equally divided and divided, and the division method may be variously set by the administrator of the cloud streaming service system.

Thereafter, the frames of the application execution screen are compared in the streaming unit of the cloud streaming server 110 (S818).

Thereafter, according to a result of comparing the frames, at least one capture area with a change among the plurality of capture areas is detected, and an image corresponding to the detected at least one capture area is captured ( S820 ).

For example, by comparing a previous frame and a current frame of the application execution screen, a changed capture area among a plurality of capture areas may be detected.

In this case, if at least one detected capture area is in a state of being adjacent to each other, the adjacent capture areas may be recognized as one capture area and an image may be captured.

Thereafter, the captured image is compressed using a still image encoding method (S822), and the encoded image is transmitted to the terminal 120-1 (S824).

At this time, it can be determined in consideration of the load generated in the cloud streaming server 110, service speed, image quality, or performance of a terminal that receives and renders the encoded image.

The user's terminal 120-1 receives and renders the encoded image (S826).

In this case, since only the image of the changed part of the application execution screen is rendered, the time taken for rendering and the amount of load generated during rendering may be less than when using the existing video-based cloud streaming service.

Thereafter, by displaying the rendered image to the user through the display module of the terminal 120-1 (S828), the application execution screen may be provided to the user.

In this way, only the changed image on the application execution screen is compressed and transmitted, and the image-based cloud service is more efficient than the existing cloud streaming service by providing the service by dividing the area so that parts with many changes in the application execution screen can be included at once. A streaming service can be provided.

The image cloud streaming service method using screen division according to the present invention may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the present invention, or may be known and available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic such as floppy disks. - Includes magneto-optical media, and any form of hardware device specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions may include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. Such hardware devices may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

As described above, in the cloud streaming service system according to the present invention, the image cloud streaming service method using screen division, and the apparatus therefor, the configuration and method of the embodiments described above are not limitedly applicable, but the above embodiment Examples may be configured by selectively combining all or part of each embodiment so that various modifications can be made.

According to the present invention, the application execution screen is received, the application execution screen is classified into a plurality of regions based on the layout, the number of divisions for each of the plurality of regions is determined based on the complexity of each region, and the plurality of regions are divided. A plurality of capture areas are generated by dividing according to the number of divisions, an image is captured in at least one capture area with a change among the plurality of capture areas, and the captured image is compressed using a still image encoding method to be transmitted to the user's terminal. can be transmitted Furthermore, by remarkably reducing the amount of data processed by the cloud streaming server in the case of an image-based cloud streaming service, it is possible to prevent delay due to the amount of load generated by the server, thereby providing a smoother cloud streaming service.

110: cloud streaming server 120-1~ 120-N: terminal
130: network 210: receiver
220: region classification unit 230: division determining unit
240: division unit 250: streaming unit
260: storage 310: simple text area
320: poster area 322 to 328: divided poster area
330: text area 410~ 440: Menu list area
450: Menu display area 510: Previous frame
520: Current frame 532 to 536: Changed capture area

Claims (10)

a receiver for receiving an application execution screen;
a region classification unit that primarily classifies the application execution screen into a plurality of regions based on a layout;
a division determining unit for determining the number of divisions for each of the plurality of areas based on the complexity of each area corresponding to each of the plurality of areas;
a division unit for generating a plurality of capture areas by secondarily dividing the plurality of areas according to the number of divisions; and
A streaming unit that captures an image in at least one changeable capture area among the plurality of capture areas, compresses the captured image using a still image encoding method, and transmits it to a user's terminal
including,
The complexity of each area is
Cloud streaming server, characterized in that it is determined in consideration of the amount of computation when processing the corresponding area. ◈Claim 2 was abandoned when paying the registration fee.◈ The method according to claim 1,
The division determining unit
Cloud streaming server, characterized in that for determining the number of divisions so that the number of the plurality of capture areas does not exceed the number of acceptable limits in the user's terminal. ◈Claim 3 was abandoned when paying the registration fee.◈ 3. The method according to claim 2,
The division determining unit
A cloud streaming server, characterized in that the level of complexity for each region determines which level of the first level, the second level, and the third level corresponds to, and determines the number of divisions according to the level. delete delete delete delete receiving an application execution screen;
first classifying the application execution screen into a plurality of regions based on a layout;
The number of divisions for each of the plurality of regions is determined based on the complexity of each region corresponding to each of the plurality of regions, and the plurality of regions are divided secondarily according to the number of divisions to generate a plurality of capture regions. generating; and
capturing an image in at least one changeable capture area among the plurality of capture areas, compressing the captured image using a still image encoding method, and transmitting the captured image to a user's terminal;
including,
The complexity of each area is
Image cloud streaming service method using screen division, characterized in that it is determined in consideration of the amount of computation when processing the corresponding area. delete delete

Images