KR20160109805A - System for cloud streaming service, method of image cloud streaming service using split of changed image and apparatus for the same - Google Patents

Abstract

Disclosed are a system for cloud streaming service, and a method and apparatus for image cloud streaming service through division of a changed image. The method for image cloud streaming service through division of a changed image may comprise the steps of: generating a first region including a changed part of an application execution screen; determining whether to divide the first region by referring to characteristics of the first region, and generating a plurality of second regions by dividing the first region based on the changed part by using a determined division method when the first region is determined to be divided; detecting at least one of the second regions corresponding to the changed part; and capturing an image so that the image corresponds to the at least one of the second regions, compressing the captured image by using a still image encoding method, and transmitting the compressed image to a terminal of a user. Accordingly, the amount of data transmitted during image cloud streaming service can be significantly reduced, thereby improving speed of the cloud streaming service.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a cloud streaming service system, a cloud streaming service system, an image cloud streaming service method using divided image division, and a device for such an image cloud streaming service method.

The present invention relates to a cloud streaming service system capable of reducing the amount of data to be processed by processing an image by dividing a changed area on an application execution screen in an image-based cloud streaming service and improving a processing speed, an image cloud To a streaming service method and apparatus therefor.

The rapid development of the Internet has resulted in a rapid increase in the communication speed of an individual. The improvement in the communication speed can be achieved by downloading or uploading a large amount of data by accessing a computer located at a remote place, or by using a remote computer control program, As well as providing an environment in which a remote computer can be used.

In addition, as a variety of applications have been developed for mobile communication terminals such as smart phones, many virtualization technologies have been proposed for driving applications requiring high performance in relatively low performance user terminals.

Among them, the application is driven on the server, the driving screen is compressed through video encoding and transmitted to the client, and the client reproduces the transmitted video to generate a screen virtualization Cloud streaming service is becoming popular.

The cloud streaming service basically adopts the cloud streaming method based on the video codec. However, even when a static screen such as a menu display is serviced, the entire screen is unnecessarily captured and operated using a video codec, which makes the overall system ineffective.

Accordingly, it is possible to capture only the changed image of the static portion on the execution screen of the application executed according to the user request and to provide the captured image to the user's terminal. In order to reduce the data amount of the changed image, Based cloud-streaming service technology.

Korean Patent Publication No. 2010-0111711, published October 15, 2010 (titled video data streaming method, video data decoding method, and one or more computing device readable media)

It is an object of the present invention to reduce the amount of data to be processed by the cloud streaming server by minimizing the captured area by dividing the changed area of the application execution screen.

It is also an object of the present invention to improve the concurrent connection rate by reducing the load generated in the cloud streaming server in an image-based cloud streaming service.

It is another object of the present invention to provide a more effective service by improving the service speed according to the reduced data amount by dividing the changed area.

It is another object of the present invention to provide a convenient service for users by preventing a delay in service provision in a cloud streaming server.

It is another object of the present invention to provide a high-performance application execution screen even in a low-end terminal by processing only the changed image on the application execution screen and providing it to the user terminal.

According to an aspect of the present invention, there is provided a cloud streaming server comprising: a first region generator for generating a first region including a changed portion of an application execution screen; A division determining unit for determining whether to divide by considering characteristics of the first area; A division unit for determining a division method based on the changed part when the division is performed and dividing the first area according to the division method to generate a plurality of second areas; An area detecting unit detecting at least one second area corresponding to the changed part of the plurality of second areas; And a streaming unit for capturing an image corresponding to the at least one second area, compressing the captured image in a still image encoding manner, and transmitting the compressed image to a terminal of the user.

In this case, the dividing unit may divide a plurality of segments corresponding to " the number of horizontal divisions times the number of the vertical divisions " in consideration of at least one of the position of the changed portion in the first region and the ratio of the changed portion in the first region, One of the schemes can be determined by the division scheme.

In this case, the dividing unit may determine the dividing scheme so that the number of the plurality of second regions does not exceed the predetermined reference dividing number when the ratio of the changed portion in the first region is equal to or greater than a predetermined ratio.

In this case, the dividing unit may determine the dividing scheme so that the number of the plurality of second regions does not exceed the limit that can be accommodated in the user terminal, and may divide the plurality of second regions equally have.

At this time, the area detecting unit may further divide the at least one second area based on the partial area when the changed part corresponds to a partial area of the at least one second area.

In this case, the first area generator may compare the frame of the application execution screen to detect the changed part, and may generate the first area including the changed part in a form corresponding to the rectangle.

At this time, the streaming unit may capture the second regions adjacent to each other among the at least one second region into one image.

In this case, when the first area is not divided, the streaming unit may capture and encode an image corresponding to the first area and transmit the image to the terminal.

At this time, the division determining unit may determine whether the division is performed in consideration of the characteristic including at least one of the size of the region and the number of colors.

According to another aspect of the present invention, there is provided an image cloud streaming service method using segmentation of a changed image, the method comprising: generating a first region including a changed portion of an application execution screen; Determining whether to divide by considering characteristics of the first region, and dividing the first region according to a division method determined based on the changed portion when the division is performed to generate a plurality of second regions ; Detecting at least one second region corresponding to the changed portion of the plurality of second regions; And capturing an image corresponding to the at least one second region, compressing the captured image in a still image encoding manner, and transmitting the compressed image to a user terminal.

In this case, the step of generating the plurality of second areas may include a step of dividing the number of the divided parts by the number of the divided parts of the first area, Can be determined in accordance with the division scheme.

In this case, the step of generating the plurality of second areas may include the step of, when the ratio of the changed part in the first area is equal to or greater than a predetermined ratio, The division method can be determined.

In this case, the step of generating the plurality of second areas may determine the division scheme so that the number of the plurality of second areas does not exceed the limit number that can be accommodated in the terminal of the user, Can be evenly divided.

At this time, the detecting step may further divide the at least one second area based on the partial area when the changed part corresponds to a partial area of the at least one second area.

In this case, the step of generating the first area may detect the changed part by comparing the frames of the application execution screen, and may generate the first area including the changed part in a form corresponding to the rectangle.

At this time, the transmitting step may combine the second areas adjacent to each other of the at least one second area into one image.

In this case, in the case where the first area is not divided, the transmitting step may capture and encode an image corresponding to the first area and transmit the image to the terminal.

In this case, the step of generating the plurality of second areas may determine whether the division is performed considering the characteristic including at least one of the size of the area and the number of colors.

According to the present invention, it is possible to reduce the amount of data processed by the cloud streaming server by minimizing the area captured by dividing the changed area of the application execution screen.

In addition, the present invention can improve the concurrent connection rate by reducing the load generated in the cloud streaming server in the image-based cloud streaming service.

In addition, the present invention can provide a more effective service by improving the service speed according to the reduced data amount by dividing the changed area.

In addition, the present invention prevents a delay in providing a service in a cloud streaming server, thereby providing a more convenient service to users.

In addition, according to the present invention, only the changed image is processed on the application execution screen and provided to the user terminal, thereby providing a high-performance application execution screen even in low-end terminals.

1 is a block diagram illustrating a cloud streaming service system according to an embodiment of the present invention.
2 is a block diagram illustrating an example of the cloud streaming server shown in FIG.
3 is a diagram illustrating an example of a first region divided according to the present invention.
4 is a diagram illustrating a process of capturing an image through further division of a second area according to an embodiment of the present invention.
FIG. 5A is a diagram illustrating an example of determining a division scheme according to the present invention.
FIG. 5B is a diagram illustrating another example of determining a division scheme according to the present invention.
6 is a diagram illustrating a process of generating a first region by comparing frames of an application execution screen according to an embodiment of the present invention.
FIG. 7 is a diagram illustrating an image cloud streaming service method using segmentation of a changed image according to an exemplary embodiment of the present invention. Referring to FIG.
8 is a detailed view illustrating an image cloud streaming service method using segmentation of a changed image according to an embodiment of the present invention.
9 is a flowchart illustrating an image cloud streaming service process using segmentation of a changed image according to an exemplary embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description and the accompanying drawings, detailed description of well-known functions or constructions that may obscure the subject matter of the present invention will be omitted. It should be noted that the same constituent elements are denoted by the same reference numerals as possible throughout the drawings. Embodiments of the present invention are provided to more fully describe the present invention to those skilled in the art. Accordingly, the shapes and sizes of the elements in the drawings and the like can be exaggerated for clarity.

The terms and words used in the present specification and claims should not be construed to be limited to ordinary or dictionary meanings and the inventor is not limited to the concept of terminology for describing his or her invention in the best way. It should be interpreted as meaning and concept consistent with the technical idea of the present invention. Therefore, the embodiments described in the present specification and the configurations shown in the drawings are merely the most preferred embodiments of the present invention, and not all of the technical ideas of the present invention are described. Therefore, It is to be understood that equivalents and modifications are possible. Also, the terms first, second, etc. are used for describing various components and are used only for the purpose of distinguishing one component from another component, and are not used to define the components.

1 is a block diagram illustrating a cloud streaming service system according to an embodiment of the present invention.

Referring to FIG. 1, a cloud streaming service system according to an embodiment of the present invention includes a cloud streaming server 110, terminals 120-1 to 120-N, and a network 130. FIG.

The cloud streaming server 110 generates a first area including a changed portion of the application execution screen.

At this time, the changed portion is detected by comparing the frame of the application execution screen, and a first region including the changed portion can be generated in a form corresponding to the rectangle.

In addition, the cloud streaming server 110 determines whether or not to divide the data in consideration of the characteristics of the first area.

At this time, it is possible to determine whether or not to divide by considering the characteristic including at least one of the size of the area and the number of colors.

In addition, the cloud streaming server 110 determines a division method based on a changed part when dividing is performed, and divides the first area according to the division method to generate a plurality of second areas.

In this case, considering at least one of the position of the changed portion in the first region and the ratio of the changed portion in the first region, any one of the plurality of division methods corresponding to 'number of horizontal division times multiplied by vertical division number' It can be determined by a division method.

In this case, when the ratio of the changed portion in the first region is equal to or greater than a predetermined ratio, the partitioning method can be determined such that the number of the plurality of second regions does not exceed the predetermined reference division number.

In this case, the division method may be determined such that the number of the plurality of second regions does not exceed the allowable number in the user terminal, and the plurality of second regions may be evenly divided so that the sizes of the plurality of second regions are the same.

In addition, the cloud streaming server 110 detects at least one second region corresponding to the changed portion of the plurality of second regions.

At this time, if the changed portion corresponds to a part of at least one second area, at least one second area may be further divided based on the part of the area.

In addition, the cloud streaming server 110 captures an image corresponding to at least one second area, compresses the captured image in a still image encoding manner, and transmits the compressed image to the user terminal.

At this time, the second regions adjacent to each other among the at least one second region may be combined and captured as one image.

At this time, if the first area is not divided, the image can be captured and encoded corresponding to the first area and transmitted to the terminal.

The terminals 120-1 to 120-N receive an application execution screen corresponding to the cloud streaming service from the cloud streaming server 110 and provide them to the user.

The terminals 120-1 to 120-N are connected to a communication network and are capable of executing applications on the basis of a cloud computing system. The terminals 120-1 to 120-N are not limited to the mobile communication terminal but may be any information communication device, multimedia terminal, A fixed terminal and an IP (Internet Protocol) terminal. Each of the terminals 120-1 to 120-N may be a mobile phone, a portable multimedia player (PMP), a mobile Internet device (MID), a smart phone, a desktop, a tablet PC, A mobile terminal having various mobile communication specifications such as a notebook computer, a notebook computer, a netbook, a personal digital assistant (PDA), a smart TV, and an information communication device.

The terminals 120-1 to 120-N receive various kinds of information such as numeric and character information, set various functions, and input signals related to the function control of the terminals 120-1 to 120-N And can be transmitted to the control unit through the input unit. The input unit of the terminals 120-1 to 120-N may include at least one of a keypad and a touchpad for generating an input signal according to a user's touch or operation. At this time, the input units of the terminals 120-1 to 120-N are configured in the form of one touch panel (or touch screen) together with the display units of the terminals 120-1 to 120-N, Display function can be performed at the same time. The input unit of the terminals 120-1 to 120-N may be any type of input unit that can be developed in addition to an input unit such as a keyboard, a keypad, a mouse, a joystick, and the like. In particular, the input units of the terminals 120-1 to 120-N according to the present invention can transmit input signals for uploading or downloading contents based on cloud computing to the control units of the terminals 120-1 to 120-N.

In addition, the display unit of the terminals 120-1 to 120-N can display information on a series of operation states, operation results, and the like that occur during the performance of the functions of the terminals 120-1 to 120-N. In addition, the display units of the terminals 120-1 to 120-N can display menus of the terminals 120-1 to 120-N and user data input by the user. The display units of the terminals 120-1 to 120-N may be a liquid crystal display (LCD), a thin film transistor LCD (TFT-LCD), a light emitting diode (LED) An organic light emitting diode (OLED), an organic light emitting diode (AMOLED), an active matrix OLED, a retina display, a flexible display, and a three-dimensional display have. At this time, when the display units of the terminals 120-1 to 120-N are configured as touch screens, the display units of the terminals 120-1 to 120-N function as the input units of the terminals 120-1 to 120- Some or all of them. In particular, the display unit of the terminals 120-1 to 120-N according to the present invention can display information related to execution of content provided on a cloud computing basis on a screen.

The storage units of the terminals 120-1 to 120-N are devices for storing data, and include a main storage device and an auxiliary storage device, and are used for applications required for functional operations of the terminals 120-1 to 120- You can save the program. The storage units of these terminals 120-1 to 120-N may largely include a program area and a data area. Here, when the terminals 120-1 to 120-N activate the respective functions in response to a request from the user, the terminals 120-1 to 120-N provide the respective functions by executing the corresponding application programs under the control of the controller. In particular, the storage units of the terminals 120-1 to 120-N according to the present invention may store an operating system for booting the terminals 120-1 to 120-N, a program for uploading or downloading contents on the basis of cloud computing have. In addition, the storage units of the terminals 120-1 to 120-N may store information of a content DB storing a plurality of contents and information of the terminals 120-1 to 120-N. At this time, the content DB includes execution data for executing the content and attribute information about the content, and content usage information according to the execution of the content can be stored. The information of the terminals 120-1 to 120-N may include terminal specification information.

In addition, the communication units of the terminals 120-1 to 120-N may perform a function of transmitting and receiving data through the cloud streaming server 110 and the network 130. [ Here, the communication unit of the terminals 120-1 to 120-N may include RF transmitting means for up-converting and amplifying the frequency of the transmitted signal, RF receiving means for low-noise amplifying the received signal and down-converting the frequency . The communication units of the terminals 120-1 to 120-N may include at least one of a wireless communication module and a wired communication module. In the case where the terminals 120-1 to 120-N use wireless communication, the wireless communication module is a module for transmitting and receiving data according to a wireless communication method. The wireless communication module, the wireless LAN communication module, The data can be transmitted / received to / from the cloud streaming server 110 by using any one of them. The wired communication module is for transmitting / receiving data by wire. The wired communication module may connect to the network 130 through a wired network and transmit / receive data to / from the cloud streaming server 110. That is, the terminals 120-1 to 120-N access the network 130 using a wireless communication module or a wired communication module and transmit and receive data to and from the cloud streaming server 110 through the network 130. [ In particular, the network 130 according to the present invention can communicate with the cloud streaming server 110 or other terminals 120-1 to 120-N to transmit / receive data necessary for uploading or downloading content based on cloud computing.

The control unit of the terminal devices 120-1 to 120-N may be an operating system (OS) and a process unit for driving each configuration. For example, the control unit may include a cloud streaming server 110, When accessing the cloud streaming server 110 through a separate service application, it is possible to control the entire process of executing the service application according to the request of the user, and at the same time, It is possible to control the streaming server 110 to transmit the service use request and control the information of the terminals 120-1 to 120-N necessary for user authentication to be transmitted together.

In addition, the control units of the terminals 120-1 to 120-N can execute the specific contents stored in the storage units of the terminals 120-1 to 120-N according to the request of the user. At this time, the control unit may store the content usage history according to the execution of the content as the content usage information.

In addition, the control unit of the terminals 120-1 to 120-N may execute execution data for executing the content, content information including attribute information about the content, and content usage information, which is information according to the content usage history, And uploaded to the server 110 for uploading. Then, the controller transmits the uploaded content to the cloud streaming server 110, deletes the uploaded content from the storage unit of the terminals 120-1 to 120-N according to the user's request, connects to the cloud streaming server 110 The content may be executed through the cloud streaming server 110 and used.

In addition, the control units of the terminals 120-1 to 120-N may access the cloud streaming server 110 to download the content from the other terminals 120-1 to 120-N and control the content to be stored in the storage unit , It is also possible to control the content to be executed after receiving only data necessary for execution at the time of executing the content through the cloud streaming server 110.

The network 130 provides a path for transferring data between the cloud streaming server 110 and the terminals 120-1 to 120-N, and is a concept covering both existing networks and future developable networks . For example, the network 130 may be a wired / wireless local area network that provides communication of various information devices within a limited area, a mobile communication network that provides communication between mobile objects and mobile objects outside the mobile object, Or a wired / wireless communication network, or a combination of two or more. Meanwhile, the transmission scheme standard of the network 130 is not limited to the existing transmission scheme standard, and may include all transmission scheme standards to be developed in the future. In addition, the network used between the cloud streaming server 110 and the terminals 120-1 to 120-N in FIG. 1 may be different from the network used between the terminals 120-1 to 120-N, It may be the same.

2 is a block diagram illustrating an example of the cloud streaming server shown in FIG.

2, the cloud streaming server 110 shown in FIG. 1 includes a communication unit 210, a first area generating unit 220, a division determining unit 230, a division unit 240, an area detection unit 250, A streaming unit 260, and a storage unit 270.

The communication unit 210 transmits and receives information related to a plurality of terminals through a communication network such as the network shown in FIG. In particular, the communication unit 210 according to the embodiment of the present invention receives a request for the cloud streaming service from the terminal and provides an application execution result screen corresponding to the cloud streaming service requested by the terminal to the terminal.

The first area generating unit 220 generates a first area including a changed portion of the application execution screen. The application execution screen may be a screen resulting from executing an application on the application server according to a user's request. That is, the cloud streaming server 110 may receive the result of executing the application on the application server without executing the application on the user's terminal. At this time, only the portion of the application execution screen in which the change has occurred can be provided to the user terminal through the image-based cloud streaming service.

 At this time, the changed portion is detected by comparing the frame of the application execution screen, and a first region including the changed portion can be generated in a form corresponding to the rectangle. For example, it is possible to compare a current frame with a previous frame among a large number of frames constituting an application execution screen, and to detect a difference part between two frames as a changed part. Further, since the changed portion can be detected as a plurality of regions on the frame, it is possible to generate the first region of the rectangular shape so as to cover all the changed portions.

The division determination unit 230 determines whether or not to divide by considering the characteristics of the first area. Since the first area is an area including all the changed parts of the application execution screen, the part that has not actually changed according to the position and number of the changed part in the application execution screen can also be included in the first area. For example, if there is a changed part in the upper left corner and a lower right corner in the application execution screen, the first area generated so as to include both parts may substantially coincide with the frame of the application execution screen. Accordingly, if the first area is divided and processing of an unnecessary part is minimized when the still image is encoded, the first area can be divided and services can be performed.

At this time, it is possible to determine whether or not to divide by considering the characteristic including at least one of the size of the area and the number of colors. For example, when the size of the first area is similar to the size of the application execution screen, the probability that the unchanged part of the first area is included in the first area may be high. Therefore, in such a case, it can be determined that the first area is divided. For example, if it is assumed that the size corresponding to 50% of the frame size is a preset divided reference size, it can be determined that the division is performed when the size of the first area is equal to or larger than a predetermined division reference size.

Also, in the case of a screen requiring a large number of colors according to the application execution screen, a large load may be generated in the still image encoding even if the size of the changed portion is small. Therefore, in such a case, it is possible to provide an efficient service by capturing an image so as to correspond to a part that is changed as much as possible through division of the first area, and then performing still image encoding. For example, assuming that the number of predetermined divided reference colors is N, if the number of colors constituting the first area is N or more, it can be determined that the first area is divided.

The partitioning unit 240 determines a partitioning method based on the changed part when partitioning is performed, and creates a plurality of second areas by dividing the first area according to the partitioning method.

The division method may be information corresponding to how many times the division is performed through at least one of the horizontal division and the vertical division when the first region is divided. At this time, it is possible to determine the most efficient partitioning method considering the changed part included in the first area. In addition, each divided region divided by the first region may correspond to the second regions. If the first region is not divided, the first region itself may be recognized as the second region.

In this case, considering at least one of the position of the changed portion in the first region and the ratio of the changed portion in the first region, any one of the plurality of division methods corresponding to 'number of horizontal division times multiplied by vertical division number' It can be determined by a division method.

For example, when the changed part in the first area is disposed horizontally long at the bottom, the first area may be divided by horizontally so that one second area may be divided so as to include the changed part as much as possible. That is, the vertical division may not be performed so as not to unnecessarily divide the changed portion by dividing the number of the horizontal division number by the number of the vertical division number corresponding to '2 X 1' or '3 X 1'.

In addition, considering the ratio of the size of the changed area to the size of the entire area of the first area, the partitioning method in which the number of second areas is large and the number of second areas is small is generated. You can decide. For example, if the ratio of the changed portion in the first region is large, if the first region is divided into a large number, the number of second regions detected for image capture is large, which may be ineffective in still image encoding. That is, when the ratio of the changed portion in the first region is large, even if the image is captured by dividing it into a small number, the weight of the unchanged portion may be small, so that the influence of the still image encoding may not be significant.

At this time, if the ratio of the changed portion in the first region is equal to or greater than a predetermined ratio, the partitioning method can be determined so that the number of the plurality of second regions does not exceed the predetermined number. For example, assuming that the predetermined ratio is 80% and the predetermined number of division is 4, if the ratio of the changed portion in the first region is 80% or more, '1 X 2', '2 X 1' One of the division methods in which the number of the second regions is 4 or less, such as 1 X 3 ', 3 X 1', 1 X 4 ', 2 X 2', or 4 X 1 ' The first area can be divided into two.

At this time, the division method is determined such that the number of the plurality of second areas does not exceed the allowable number in the user's terminal. For example, it is possible to set the number of users that can simultaneously process in the terminal without causing a problem to be acceptable in the terminal of the user. Therefore, the allowable limit number may be set differently according to the performance of the user terminal. For example, assuming that the number of simultaneous processes in the user's terminal is 10, the division method can be determined such that the total number of the generated second regions does not exceed 10.

The region detection unit 250 detects at least one second region corresponding to the changed portion of the plurality of second regions. As described above, among the plurality of second regions generated by dividing the first region, only the region corresponding to the changed portion is detected and processed, thereby saving resources used in processing the unchanged portion in the cloud streaming server. In addition, unnecessary encoding is not performed and the processing speed can be improved.

At this time, if the changed portion corresponds to a part of at least one second area, at least one second area may be further divided based on the part of the area. For example, if the region corresponding to the second region corresponds to only the half of the lower portion, the second region may be further divided by the cloud streaming server to still image encode only the portion corresponding to the lower end of the second region .

In addition, it may be determined whether to further divide the second area in consideration of the ratio of some area based on the size of the second area. For example, if some areas correspond to more than 90% of the second areas, the process of performing additional partitions may be more inefficient. Therefore, it is possible to determine the ratio of the partial area to the second area based on the efficiency of the additional partitioning and use the ratio as a criterion for determining whether to further partition the area.

The streaming unit 260 captures an image corresponding to at least one second area, compresses the captured image in a still image encoding manner, and transmits the compressed image to the user terminal.

The cloud streaming technique based on the video codec can capture and encode all the frames corresponding to the screen on which the application operates. However, when the frame-to-frame change on the screen on which the application operates is not large, the still-image encoding is performed by capturing only the change area of the changed frame as compared with the previous frame like the image-based cloud streaming technique, It is possible to display the parts except for the change area in the same manner and display only the change area.

In this case, it is possible to detect intervals in which frames among the frames of the application execution screen are small, and capture the images in a section where there is little change between frames. For example, it may be inefficient to provide an image-based cloud streaming service because there are a large number of images to be captured with a large number of frames between frames. Accordingly, in such a period, a service can be performed through a cloud streaming technique based on a video codec, and an image of a changed capture area can be captured in order to perform an image-based cloud streaming service only in a period in which a change between frames is small .

Therefore, in the image-based cloud streaming technique, an image of at least one second area including the change area can be captured and still image encoded, such as still image encoding, by capturing only the change area.

At this time, the image to be captured may vary in image type or size depending on the application execution screen or the second area to be captured.

In addition, the still image encoding method can be determined in consideration of the load generated in the cloud streaming server 110, the service speed, the image quality of the image, or the performance of the terminal receiving and rendering the encoded image. For example, to improve the speed of the cloud streaming service, you can compress the image with a palette PNG encoding method that has a high compression ratio and low load. In addition, if it is desired to provide a good image quality without regard to the load, the image can be compressed using the PNG 32-bit encoding method or the JPEG encoding method.

At this time, the second regions adjacent to each other among the at least one second region may be combined and captured as one image. That is, all of the images corresponding to at least one second area must be captured. Still image encoding by capturing second areas, which are adjacent to each other and can be captured with one image, as an image corresponding to each area is inefficient Lt; / RTI > Accordingly, the adjacent second regions can be combined into one region so as to be captured into one image so as to be captured as one image of at least one second region.

At this time, if the first area is not divided, the image can be captured and encoded corresponding to the first area and transmitted to the terminal. For example, it may be more efficient to perform the still image encoding without dividing the first area when determining whether the first area is divided according to the characteristics of the first area. In such a case, the image may be captured to correspond to the first area, the still image may be still image encoded and transmitted to the user terminal.

The storage unit 270 stores various information generated in the cloud streaming service process according to the embodiment of the present invention as described above.

According to an embodiment, the storage unit 270 may be configured independently of the cloud streaming server 110 to support a function for the cloud streaming service. At this time, the storage unit 270 may operate as a separate mass storage and may include a control function for performing operations.

In addition, the cloud streaming server 110 configured as described above may be implemented as one or more servers.

On the other hand, the cloud streaming server 110 can store information in the memory on which the memory is mounted. In one implementation, the memory is a computer-readable medium. In one implementation, the memory may be a volatile memory unit, and in other embodiments, the memory may be a non-volatile memory unit. In one implementation, the storage device is a computer-readable medium. In various different implementations, the storage device may include, for example, a hard disk device, an optical disk device, or any other mass storage device.

By providing an image-based cloud streaming service through the cloud streaming server 110, it is possible to minimize the still image encoding region unnecessarily.

In addition, resources of the cloud streaming server 110 can be saved, and the service efficiency can be improved by increasing the number of users connecting at the same time as the resources to be saved.

In addition, since the size of the data transmitted to the user terminal can be reduced, the transmission speed can be improved and a smooth service can be provided to the user.

3 is a diagram illustrating an example of a first region divided according to the present invention.

Referring to FIG. 3, it can be seen that the first area divided according to the present invention is divided into a partitioning scheme corresponding to '4 X 3' having 4 horizontal divisions and 3 vertical divisions.

In this case, the first area may be generated in the form of a rectangle including all the changed parts 302 to 308 in the application execution screen.

In this case, each of the divided second regions may be represented by x and y, respectively, with respect to the upper left corner. For example, the second area corresponding to the drawing symbol 302 is (0, 0), the second area corresponding to the drawing symbol 304 is (1, 1), the second area corresponding to the drawing symbol 306 is ), And the second area corresponding to the drawing symbol 308 can be represented by (3, 2).

In this case, the expressions of x and y are not limited to numbers but can be variously expressed. Numbers can be expressed in various ways without being limited to those starting from zero.

At this time, the first area can be divided so that the size of each second area is the same. For example, based on the width w and the height h of the first area, it is possible to equally divide the number of horizontal divisions and the number of vertical divisions, respectively.

The cloud streaming server corresponds to the second regions corresponding to the changed portions of the second regions shown in FIG. 3, namely (0, 0), (1, 1), (2, 1) And still image encode the image of the second regions. (1, 0), (2, 0), (3, 0), (0, 1), (3, 1) 2, 2) may be unnecessarily still image encoded.

4 is a diagram illustrating a process of capturing an image through further division of a second area according to an embodiment of the present invention.

Referring to FIG. 4, it can be seen that 12 second regions are created by dividing the first region into the 4X3 division scheme.

In this case, the second region corresponding to (0, 0), (1, 0), (2, 2) and (3, 2) among the 12 second regions includes the changed portions 402 to 408 . However, in the case of the second region corresponding to (2, 2) and (3, 2), it can be seen that the changed portions 406 and 408 included in the second region correspond to the lower region of the second region. Thus, the second region corresponding to (2, 2) and (3, 2) may perform further segmentation to correspond to the changed portions 406, 408.

Thereafter, in the cloud streaming server, it is possible to improve the efficiency of the cloud streaming service by capturing an image in an additional divided generated area and still image encoding the captured image.

At this time, it is possible to determine whether to perform additional division by checking the ratio of the changed parts 402 to 408 in the second area. For example, if the proportions of the changed portions 406 and 408 in the second region corresponding to (2, 2) and (3, 2) are more than 90%, respectively, . Therefore, it is possible to determine the ratio of the changed part based on the efficiency based on the additional partitioning, while using the ratio of the changed part to the second area as a criterion for determining whether to further partition.

FIG. 5A is a diagram illustrating an example of determining a division scheme according to the present invention.

Referring to FIG. 5A, it is possible to determine which partitioning scheme is more efficient according to the ratio of the changed portion in the first areas 510, 511, 520, and 521. FIG.

It can be seen that the first regions 510 and 511 correspond to the changed portions 512 as compared to the first regions 520 and 521.

At this time, as in the first area 510, a result of still image encoding is divided into '4 X 3' and '2 X 2' like the first area 511, One result can be the same. However, in the case of dividing by the division method of '4 X 3' as in the first area 510, since the second area is generated more than the division method of '2 X 2', if it is assumed that the changed parts are not adjacent, The number of times the image encoding is performed may be increased. Therefore, although the same result occurs, the number of times of still image encoding is increased, so that the division into the first area 510 may be more inefficient than that of the first area 511. [

Therefore, if the specific area occupied by the changed portion 512 is large as in the first areas 510 and 511 of FIG. 5A, the partitioning scheme can be determined such that the number of the second areas is reduced.

In addition, it can be seen that the first regions 520 and 521 correspond to the changed portions 522 as compared to the first regions 510 and 511.

At this time, if still image encoding is performed by dividing the image data into the 2X2 'division method like the first area 520, as in the case of the still image encoding using the 4X3 division method like the first area 521 Resulting in unnecessarily large still image encoding of unchanged portions.

Therefore, if the weight occupied by the changed portion 522 is small, as in the first regions 520 and 521, the partitioning method can be determined so that the number of the second regions is large and the unchanged portion can be excluded as much as possible.

FIG. 5B is a diagram illustrating another example of determining a division scheme according to the present invention.

Referring to FIG. 5B, it is possible to determine which partitioning scheme is more efficient depending on the position of the changed portion in the first areas 530, 531, 540, and 541. FIG.

It can be seen that the first areas 530 and 531 are located on the left side of the first areas 530 and 531.

At this time, if the first region 530 is divided into a division scheme of '1 X 3' as in the first region 530, it may be the same as still image encoding of the first region 530. However, in the case of dividing by the division method of '3 X 1' as in the first area 531, the number of the generated second areas is the same as that of the first area 530, .

It can also be seen that the first areas 540 and 541 are located at the lower ends of the first areas 540 and 541.

In this case, if the first area 540 is divided into a 3 × 1 division mode, it may be the same as still image encoding of the first area 540. However, in the case of dividing by the division method of '1 X 3' like the first area 541, the number of the generated second areas is the same as the division of the first area 540, but the number of the first areas 530 and 531 ) As in the case of the still image encoding.

Accordingly, it is possible to reduce the size of the image to be still image encoded by determining the division method depending on where the changed portions 532 and 542 exist in the first region as shown in FIG. 5B. In addition, as the size of the still image to be encoded is reduced, the overall service efficiency can be improved, thereby saving resources of the cloud streaming server.

6 is a diagram illustrating a process of generating a first region by comparing frames of an application execution screen according to an embodiment of the present invention.

Referring to FIG. 6, in the process of comparing the frames of the application execution screen and generating the first region according to an embodiment of the present invention, the process of generating the first region is performed by comparing the previous frame 610 and the current frame 620 Can be compared.

For example, assuming that the previous frame 610 and the current frame 620 are composed of nine layouts as shown in FIG. 6, a portion corresponding to B, E, and I of the previous frame 610 is referred to as a current frame (620), it can be seen that B ', E' and I '.

Thus, the first region 630 may be generated to include all of the changed B ', E', and I '.

In this case, since the first area 630 is formed in the form of a rectangle including all of the changed parts, the first area 630 corresponds to C, F, and H, which are not changed when the previous frame 610 and the current frame 620 are compared May also be included in the first area 530.

Then, in the cloud streaming server, the region corresponding to B ', E' and I 'in the first region 630 is generated as a second region through the division on the generated first region, and the capture and still image encoding Can be performed.

FIG. 7 is a diagram illustrating an image cloud streaming service method using segmentation of a changed image according to an exemplary embodiment of the present invention. Referring to FIG.

Referring to FIG. 7, an image cloud streaming service method using segmentation of a changed image according to an embodiment of the present invention generates a first region including a changed portion of an application execution screen (S710). The application execution screen may be a screen resulting from executing an application on the application server according to a user's request. That is, the cloud streaming server may receive only the result of executing the application on the application server without executing the application on the user's terminal. At this time, only the portion of the application execution screen in which the change has occurred can be provided to the user terminal through the image-based cloud streaming service.

 At this time, the changed portion is detected by comparing the frame of the application execution screen, and a first region including the changed portion can be generated in a form corresponding to the rectangle. For example, it is possible to compare a current frame with a previous frame among a large number of frames constituting an application execution screen, and to detect a difference part between two frames as a changed part. Further, since the changed portion can be detected as a plurality of regions on the frame, it is possible to generate the first region of the rectangular shape so as to cover all the changed portions.

In addition, the image cloud streaming service method using the segmentation of the changed image according to an embodiment of the present invention determines whether or not the image cloud streaming service is divided in consideration of the characteristics of the first region (S715). Since the first area is an area including all the changed parts of the application execution screen, the part that has not actually changed according to the position and number of the changed part in the application execution screen can also be included in the first area.

For example, if there is a changed part in the upper left corner and a lower right corner in the application execution screen, the first area generated so as to include both parts may substantially coincide with the frame of the application execution screen. Accordingly, if the first area is divided and processing of an unnecessary part is minimized when the still image is encoded, the first area can be divided and services can be performed.

At this time, it is possible to determine whether or not to divide by considering the characteristic including at least one of the size of the area and the number of colors. For example, when the size of the first area is similar to the size of the application execution screen, the probability that the unchanged part of the first area is included in the first area may be high. Therefore, in such a case, it can be determined that the first area is divided. For example, if it is assumed that the size corresponding to 50% of the frame size is a preset divided reference size, it can be determined that the division is performed when the size of the first area is equal to or larger than a predetermined division reference size.

Also, in the case of a screen requiring a large number of colors according to the application execution screen, a large load may be generated in the still image encoding even if the size of the changed portion is small. Therefore, in such a case, it is possible to provide an efficient service by capturing an image so as to correspond to a part that is changed as much as possible through division of the first area, and then performing still image encoding. For example, assuming that the number of predetermined divided reference colors is N, if the number of colors constituting the first area is N or more, it can be determined that the first area is divided.

As a result of the determination in step S715, if the first area is divided, the image cloud streaming service method using the divided images according to the embodiment of the present invention divides the first area corresponding to the division method determined based on the changed part, To generate a plurality of second areas (S720).

The division method may be information corresponding to how many times the division is performed through at least one of the horizontal division and the vertical division when the first region is divided. At this time, it is possible to determine the most efficient partitioning method considering the changed part included in the first area. In addition, each divided region divided by the first region may correspond to the second regions. If the first region is not divided, the first region itself may be recognized as the second region.

In this case, considering at least one of the position of the changed portion in the first region and the ratio of the changed portion in the first region, any one of the plurality of division methods corresponding to 'number of horizontal division times multiplied by vertical division number' It can be determined by a division method.

For example, when the changed part in the first area is disposed horizontally long at the bottom, the first area may be divided by horizontally so that one second area may be divided so as to include the changed part as much as possible. That is, the vertical division may not be performed so as not to unnecessarily divide the changed portion by dividing the number of the horizontal division number by the number of the vertical division number corresponding to '2 X 1' or '3 X 1'.

In addition, considering the ratio of the size of the changed area to the size of the entire area of the first area, the partitioning method in which the number of second areas is large and the number of second areas is small is generated. You can decide. For example, if the ratio of the changed portion in the first region is large, if the first region is divided into a large number, the number of second regions detected for image capture is large, which may be ineffective in still image encoding. That is, when the ratio of the changed portion in the first region is large, even if the image is captured by dividing it into a small number, the weight of the unchanged portion may be small, so that the influence of the still image encoding may not be significant.

At this time, if the ratio of the changed portion in the first region is equal to or greater than a predetermined ratio, the partitioning method can be determined so that the number of the plurality of second regions does not exceed the predetermined number. For example, assuming that the predetermined ratio is 80% and the predetermined number of division is 4, if the ratio of the changed portion in the first region is 80% or more, '1 X 2', '2 X 1' One of the division methods in which the number of the second regions is 4 or less, such as 1 X 3 ', 3 X 1', 1 X 4 ', 2 X 2', or 4 X 1 ' The first area can be divided into two.

In this case, the division method may be determined such that the number of the plurality of second regions does not exceed the allowable number in the user terminal, and the plurality of second regions may be evenly divided so that the sizes of the plurality of second regions are the same. For example, it is possible to set the number of users that can simultaneously process in the terminal without causing a problem to be acceptable in the terminal of the user. Therefore, the allowable limit number may be set differently according to the performance of the user terminal. For example, assuming that the number of simultaneous processes in the user's terminal is 10, the division method can be determined such that the total number of the generated second regions does not exceed 10.

Also, the image cloud streaming service method using segmentation of changed images according to an embodiment of the present invention detects at least one second region corresponding to a changed portion of the plurality of second regions (S730). As described above, among the plurality of second regions generated by dividing the first region, only the region corresponding to the changed portion is detected and processed, thereby saving resources used in processing the unchanged portion in the cloud streaming server. In addition, unnecessary encoding is not performed and the processing speed can be improved.

At this time, if the changed portion corresponds to a part of at least one second area, at least one second area may be further divided based on the part of the area. For example, if the region corresponding to the second region corresponds to only the half of the lower portion, the second region may be further divided by the cloud streaming server to still image encode only the portion corresponding to the lower end of the second region .

In addition, it may be determined whether to further divide the second area in consideration of the ratio of some area based on the size of the second area. For example, if some areas correspond to more than 90% of the second areas, the process of performing additional partitions may be more inefficient. Therefore, it is possible to determine the ratio of the partial area to the second area based on the efficiency of the additional partitioning and use the ratio as a criterion for determining whether to further partition the area.

According to another aspect of the present invention, there is provided an image cloud streaming service method using segmentation of a changed image, the method comprising: capturing an image corresponding to at least one second area; compressing the captured image using a still image encoding method, (S740).

The cloud streaming technique based on the video codec can capture and encode all the frames corresponding to the screen on which the application operates. However, when the frame-to-frame change on the screen on which the application operates is not large, the still-image encoding is performed by capturing only the change area of the changed frame as compared with the previous frame like the image-based cloud streaming technique, It is possible to display the parts except for the change area in the same manner and display only the change area.

In this case, it is possible to detect intervals in which frames among the frames of the application execution screen are small, and capture the images in a section where there is little change between frames. For example, it may be inefficient to provide an image-based cloud streaming service because there are a large number of images to be captured with a large number of frames between frames. Accordingly, in such a period, a service can be performed through a cloud streaming technique based on a video codec, and an image of a changed capture area can be captured in order to perform an image-based cloud streaming service only in a period in which a change between frames is small .

Therefore, in the image-based cloud streaming technique, an image of at least one second area including the change area can be captured and still image encoded, such as still image encoding, by capturing only the change area.

At this time, the image to be captured may vary in image type or size depending on the application execution screen or the second area to be captured.

Also, the still image encoding method can be determined in consideration of the load generated in the cloud streaming server, the service speed, the image quality of the image, or the performance of the terminal receiving and rendering the encoded image. For example, to improve the speed of the cloud streaming service, you can compress the image with a palette PNG encoding method that has a high compression ratio and low load. In addition, if it is desired to provide a good image quality without regard to the load, the image can be compressed using the PNG 32-bit encoding method or the JPEG encoding method.

At this time, the second regions adjacent to each other among the at least one second region may be combined and captured as one image. That is, all of the images corresponding to at least one second area must be captured. Still image encoding by capturing second areas, which are adjacent to each other and can be captured with one image, as an image corresponding to each area is inefficient Lt; / RTI > Accordingly, the adjacent second regions can be combined into one region so as to be captured into one image so as to be captured as one image of at least one second region.

If it is determined in step S715 that the first area is not divided, the image cloud streaming service method using the segmentation of the changed image according to an embodiment of the present invention may capture the image corresponding to the first area, The still image encoding method, and transmits the compressed image to the user terminal (S750). For example, it may be more efficient to perform the still image encoding without dividing the first area when determining whether the first area is divided according to the characteristics of the first area. In such a case, the image may be captured to correspond to the first area, the still image may be still image encoded and transmitted to the user terminal.

Although not shown in FIG. 7, the image cloud streaming service method using segmentation of a changed image according to an embodiment of the present invention transmits and receives information related to a plurality of terminals through a communication network such as the network shown in FIG. 1, do. In particular, a request for the cloud streaming service is received from the terminal, and an application execution result screen corresponding to the cloud streaming service requested by the terminal is provided to the terminal.

Although not shown in FIG. 7, the image cloud streaming service method using segmentation of a changed image according to an embodiment of the present invention may include various information generated in a cloud streaming service process according to an exemplary embodiment of the present invention, / RTI >

8 is a detailed view illustrating an image cloud streaming service method using segmentation of a changed image according to an embodiment of the present invention.

Referring to FIG. 8, an image cloud streaming service method using segmentation of a changed image according to an exemplary embodiment of the present invention receives an application execution screen according to a user request from an application server (S802).

At this time, an application execution screen can be received through a communication network such as the network shown in Fig.

Thereafter, frames of the application execution screen are compared to generate a first area including the changed portion (S804).

At this time, the changed part can be detected by comparing the frames of the application execution screen, and the first area including the changed part can be generated in a form corresponding to the rectangle.

Thereafter, the characteristic of the first area is analyzed to determine whether the first area is divided (S806).

Thereafter, it is determined whether the size of the area corresponding to the characteristic of the first area and the number of colors are equal to or greater than predetermined reference values (S808).

At this time, it is possible to determine whether to divide or not based on the determination result of step S808. For example, if the size of the first area is equal to or larger than a predetermined division reference size, it can be determined that the division is performed. In addition, it may be determined that the division is performed when the number of colors constituting the first area is equal to or greater than the predetermined division reference color number.

As a result of the determination in step S808, if it is determined to be equal to or greater than the reference value, it is determined that the division is to be performed and the division method is determined based on the changed part (S810).

At this time, if it is determined as a result of the judgment in the step S808, it is judged that the division is not performed, and the image is captured corresponding to the first area (S824).

 In this case, considering at least one of the position of the changed portion in the first region and the ratio of the changed portion in the first region, any one of the plurality of division methods corresponding to 'number of horizontal division times multiplied by vertical division number' It can be determined by a division method.

At this time, if the ratio of the changed portion in the first region is equal to or greater than a predetermined ratio, the partitioning method can be determined so that the number of the plurality of second regions does not exceed the predetermined number.

At this time, the division method can be determined such that the number of the plurality of second areas does not exceed the allowable number at the user's terminal.

Thereafter, the first regions are divided according to the determined division method to generate a plurality of second regions (S812).

At this time, it is possible to evenly divide the plurality of second areas so that they are equal in size.

Thereafter, it is determined whether there is a region to be further divided among the plurality of second regions generated through the division (S814).

If it is determined in step S814 that there is a region to be further divided, additional division is performed (S816).

Thereafter, at least one second region corresponding to the changed portion of the plurality of second regions is detected (S818).

If it is determined in step S814 that there is no additional divided area, step S818 is performed to detect at least one second area.

Thereafter, an image is captured corresponding to at least one second area (S820).

At this time, the second regions adjacent to each other among the at least one second region may be combined and captured as one image.

Thereafter, the captured image is compressed by the still image encoding method (S822).

At this time, if the first region is not divided and the captured image corresponding to the first region exists by performing the step S824, the captured image corresponding to the first region may be compressed in the still image encoding manner.

In this case, the still image encoding method can be determined in consideration of the load generated in the cloud streaming server 110, the service speed, the image quality of the image, or the performance of the terminal receiving and rendering the encoded image.

Thereafter, the still image encoded image is transmitted to the user terminal (S826).

9 is a flowchart illustrating an image cloud streaming service process using segmentation of a changed image according to an exemplary embodiment of the present invention.

Referring to FIG. 9, in step S902, an image cloud streaming service process using segmentation of a changed image according to an embodiment of the present invention executes an application according to a user request in an application server.

Thereafter, the application server transmits an application execution screen corresponding to the result of executing the application to the communication unit of the cloud streaming server 110 (S904).

At this time, the application server can transmit an application execution screen through a communication network such as the network shown in Fig.

Thereafter, the communication unit of the cloud streaming server 110 receives the application execution screen and transmits the application execution screen to the first region generating unit of the cloud streaming server 110 (S906).

Thereafter, the first area creating unit of the cloud streaming server 110 compares the frames of the application execution screen (S908) and creates a first area including the changed portion (S910).

At this time, the changed portion is detected by comparing the frame of the application execution screen, and a first region including the changed portion can be generated in a form corresponding to the rectangle.

Thereafter, the division determination unit of the cloud streaming server 110 determines whether or not to divide by considering the characteristics of the first area (S912).

At this time, it is possible to determine whether or not to divide by considering the characteristic including at least one of the size of the area and the number of colors. For example, if it is assumed that the size corresponding to 50% of the frame size is a preset divided reference size, it can be determined that the division is performed when the size of the first area is equal to or larger than a predetermined division reference size. For example, assuming that the predetermined number of divided reference colors is N, if the number of colors constituting the first area is N or more, it can be determined that the first area is divided.

As a result of the determination in step S912, the division unit of the cloud streaming server 110 determines the division method based on the changed part (S914).

In this case, considering at least one of the position of the changed portion in the first region and the ratio of the changed portion in the first region, any one of the plurality of division methods corresponding to 'number of horizontal division times multiplied by vertical division number' It can be determined by a division method.

At this time, if the ratio of the changed portion in the first region is equal to or greater than a predetermined ratio, the partitioning method can be determined so that the number of the plurality of second regions does not exceed the predetermined number.

At this time, the division method is determined such that the number of the plurality of second areas does not exceed the allowable number in the user's terminal.

Thereafter, the first area is divided according to the division method to generate a plurality of second areas (S916).

Thereafter, the region detection unit of the cloud streaming server 110 detects at least one second region corresponding to the changed portion of the plurality of second regions (S918).

At this time, if the changed portion corresponds to a part of at least one second area, at least one second area may be further divided based on the part of the area.

Thereafter, the streaming unit of the cloud streaming server 110 captures an image corresponding to at least one second area (S920). If it is determined in step S912 that the image is not divided, step S914 to step S918 are omitted and image corresponding to the first area is captured (step S920).

Thereafter, the captured image is compressed by the still image encoding method (S922), and the still image encoded image is transmitted to the user terminal 120-1 (S924).

Thereafter, the user terminal 120-1 may render the still image encoded image (S926) and display it to the user (S928) to provide the image-based cloud streaming service.

The image cloud streaming service method using segmentation of a changed image according to the present invention may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Includes all types of hardware devices that are specially configured to store and execute magneto-optical media and program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions may include machine language code such as those generated by a compiler, as well as high-level language code that may be executed by a computer using an interpreter or the like. Such a hardware device may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

As described above, the cloud streaming service system according to the present invention, the image cloud streaming service method using divided image division, and the apparatus therefor are not limited to the configuration and method of the embodiments described above, The embodiments may be configured so that all or some of the embodiments may be selectively combined so that various modifications may be made.

According to the present invention, a first area including a changed part of an application execution screen is generated, and it is determined whether or not to divide the first area in consideration of the characteristics of the first area, and when the division is performed, The method comprising: generating a plurality of second regions by dividing a first region, detecting at least one second region corresponding to a changed portion of the plurality of second regions, capturing an image corresponding to the at least one second region, The captured image can be compressed by the still image encoding method and transmitted to the user terminal. Further, the amount of data processed in the image-based cloud streaming service can be reduced, and the service speed can be improved according to the reduced amount of data, thereby making it possible to provide a more effective service to the users.

110: Cloud streaming servers 120-1 to 120-N:
130: Network 210:
220: First area generating unit 230:
240: division unit 250:
260 streaming unit 270 storage unit
302 ~ 308: Changed parts
402 to 408, 512, 522, 532, and 542:
510, 511, 520, 521, 530, 531, 540, 541, 630:
610: previous frame 620: current frame

Claims (10)

A first area generator for generating a first area including a changed part of the application execution screen;
A division determining unit for determining whether to divide by considering characteristics of the first area;
A division unit for determining a division method based on the changed part when the division is performed and dividing the first area according to the division method to generate a plurality of second areas;
An area detecting unit detecting at least one second area corresponding to the changed part of the plurality of second areas; And
A streaming unit for capturing an image corresponding to the at least one second region, compressing the captured image in a still image encoding manner,
Wherein the server comprises: The method according to claim 1,
The divider
Considering the at least one of the position of the changed part in the first area and the ratio of the changed part in the first area to the number of the divided part in the first area, Is determined by the division method. The method of claim 2,
The divider
Wherein the determination unit determines the division scheme so that the number of the plurality of second areas does not exceed a predetermined reference division number when the ratio of the changed part in the first area is equal to or greater than a predetermined ratio. The method of claim 3,
The divider
Wherein the dividing method is determined so that the number of the plurality of second areas does not exceed the limit number that can be accommodated in the terminal of the user, and the dividing method is equally divided so that the plurality of second areas are equal in size. server. The method of claim 4,
The area detecting unit
Wherein the at least one second region is further divided based on the partial region if the changed portion corresponds to a portion of the at least one second region. The method of claim 5,
The first area generator
Wherein the controller detects the changed portion by comparing frames of the application execution screen, and generates the first region including the changed portion in a form corresponding to a rectangle. The method according to claim 1,
The streaming unit
And the second regions adjacent to each other among the at least one second region are combined into one image. The method of claim 7,
The streaming unit
And when the first region is not divided, captures and encodes an image corresponding to the first region and transmits the captured image to the terminal. The method according to claim 1,
The division determination unit
And determines whether the division is to be performed in consideration of the characteristic including at least one of a size of a region and a number of colors. Generating a first area including a changed portion of the application execution screen;
Determining whether to divide by considering characteristics of the first region, and dividing the first region according to a division method determined based on the changed portion when the division is performed to generate a plurality of second regions ;
Detecting at least one second region corresponding to the changed portion of the plurality of second regions; And
Capturing an image corresponding to the at least one second region, compressing the captured image in a still image encoding manner, and transmitting the compressed image to a user terminal
The image cloud streaming service method according to claim 1,

Images