KR100761010B1 - Screen information management method and system using access direct of video memory - Google Patents

Abstract

A method and a system for processing screen information by directly accessing a video memory are provided to receive a screen image required for generating a moving picture in a level of memory copy and process detection of screen change at high speed. An image processor includes a video drive(312) providing the video memory to an OS(Operating System)(15), capturing a screen displayed in a remote computer, a screen image alteration detection processor(313), and an image converting process(315). The screen image alteration detection processor captures the altered screen by comparing a current screen read from the video memory(311) with the previous screen, and stores the altered screen image to a storage memory(314). A transmitter includes a load balance process adjusting a transfer load ratio, a transfer process(317) compressing/encoding the captured screen image and transferring a remote recording client, a connection managing process(318) controlling/managing login/logout and security of the connected remote recording client, and an input handling process(319) controlling the OS by receiving a control event from the remote recording client having priority.

Description

Screen information management method and system using video memory direct access

1 is a system configuration diagram showing a screen information processing system using a direct access to a video memory according to a first embodiment of the present invention;

2 is a system configuration diagram illustrating a screen information processing system using a direct access to a video memory according to a second embodiment of the present invention;

3 is a functional block diagram showing a remote support server applied to the screen information processing system according to FIG. 2;

4 is a functional block diagram showing a remote recording client applied to the screen information processing system according to FIG. 2;

5 is a system configuration diagram illustrating a screen information processing system using direct access to a video memory according to a third embodiment of the present invention;

6 is a functional block diagram showing a remote support server applied to the screen information processing system according to FIG. 5;

7 is a reference diagram illustrating (a) a split screen and (b) a block size of a capture screen image applied to the present invention;

8 is a flowchart illustrating a method of processing screen information using direct access to a video memory according to a fourth embodiment of the present invention;

FIG. 9 is a flowchart illustrating a detailed operation of performing a comparison change inspection of a screen in the screen information processing method of FIG. 8;

10 is a flowchart illustrating a method of processing screen information using direct access to a video memory according to a fifth embodiment of the present invention;

FIG. 11 is a flowchart illustrating a detailed operation of the screen memory copying step in the screen information processing method according to FIG. 10.

12 is a flowchart illustrating a detailed operation of performing a comparison change inspection of a screen in the screen information processing method of FIG. 10;

FIG. 13 is a flowchart illustrating a detailed operation of a capturing screen image transmitting step in the screen information processing method of FIG. 10;

14 is a flowchart illustrating a detailed operation of the video generation step in the screen information processing method of FIG. 10;

15 is a flowchart illustrating a method of processing screen information using direct access to a video memory according to a sixth embodiment of the present invention;

FIG. 16 is a flowchart illustrating a detailed operation of performing a comparison change inspection of a screen in the screen information processing method of FIG. 15.

<Explanation of symbols for main parts of the drawings>

100: remote computer 200: administrator computer

300: remote computer 310: remote support server

311: video memory 312: video drive

313: screen image change inspection process 314: storage memory

315: image conversion process 316: load balancing process

317: Transmission process 318: Connection management process

319: Input Processing Process 400: Administrator Computer

410: remote recording process 411: viewer object

412: Remote screen storage buffer 413: Recording process

414: Connection Manager Process 415: Preview Process

500: remote computer 510: remote support server

511: video memory 512: video drive

513: screen image change inspection process 514: storage memory

515: Image Conversion Process 516: Load Balance Process

517: transfer process 518: connection management process

519: input processing process 600: administrator computer

610: remote recording client

The present invention relates to a method and a system for processing screen information using direct access to a video memory, and more particularly, to obtain screen data at a high speed by directly reading the contents of a screen through a video memory, and to a grid-shaped block. Screen information processing method using direct access to video memory, which makes it possible to stably provide the screen image required to generate a video by performing the screen change inspection at a high speed by comparing the divided screen with the previous screen for each block unit area; and It's about that system.

In particular, the present invention includes a separate video drive operating in an operating system (OS) operating system area, which provides a video memory that is directly accessible to an application program, thereby capturing the screen displayed on the monitor. It is implemented at the level of copying.

In general, Windows installed in a computer includes a memory buffer for displaying a screen in order to display an image on a monitor. If this memory buffer is directly accessible to the user program, the CPU can be used at the level of simply copying the memory without any extra effort.

However, the above areas are areas of the OS, which is an operating system, and thus cannot be accessed by general applications. For this reason, Windows has a separate application program interface (API) for capturing the screen displayed on the monitor, and uses the application program interface (API) to capture the screen on the monitor.

A method of obtaining screen information displayed on a monitor of a computer as described above uses an application program interface (API) to capture a screen with an advantage of not using additional software. This method of obtaining screen information has the following disadvantages.

1) slow speed

2) The display of the window stops at the point of screen capture on the monitor (capturing many screens in a short time shows that the screen freezes while capturing).

3) CPU load rate is high.

4) The speed of screen capture is affected by the hardware (graphics card).

5) Some screens cannot be captured (e.g. video screens, some graphic objects, etc.)

6) You cannot capture the screen 100% the same.

As described above, the method of acquiring screen information using an existing application program interface (API) not only consumes a large amount of CPU to capture a screen, but also affects the operation of other programs running on a computer. Control also affects the overall system operation.

In addition, a method of obtaining screen information using an existing application program interface (API) provides a function of capturing and obtaining a screen displayed on a monitor and providing the acquired screen image. In the screen change check to see if the change has been made, it is difficult to implement a fast screen change check by comparing the entire screen of the current screen and the previous screen.

Accordingly, the present invention has been made to solve the above-mentioned conventional problems, an object of the present invention is that the screen image required to generate a moving picture is obtained at the level of memory copy and the detection of the screen change can be implemented at high speed. The present invention provides a method and system for processing screen information using video memory direct access.

In addition, another object of the present invention is to provide a video memory that replaces the existing display buffer, so that the screen image is obtained and provided at a low CPU load rate to affect the operation of other programs running on the computer. The present invention provides a method and system for processing screen information using video memory direct access so that the entire system for remote control can be stably operated.

In addition, another object of the present invention is to provide a screen information processing method and a system using a direct access to the video memory, so that the processing speed of screen acquisition can be implemented at a higher speed than when capturing a screen by a conventional application program interface (API) method To provide.

In addition, another object of the present invention is that it is possible to capture both the video and some graphic objects that can not be captured by the existing application program interface (API) method provides a control environment of the form closest to the actual computer when remote control The present invention provides a method and system for processing screen information using video memory direct access.

According to a first aspect of the present invention, there is provided a manager computer connected to at least one remote computer and the at least one remote computer through the Internet or an in-house network, and the screen image required to generate a moving image is generated from the manager computer. A screen information processing system provided by the remote computer for processing and providing, wherein the remote computer captures the screen displayed on the monitor, and the screen of the changed area is captured by changing the captured screens with a previous capture screen. Screen information using video memory direct access, characterized in that for capturing the next screen and transmitting the captured screen image captured through the change inspection process to the manager computer to generate a video file through recording on the manager computer. wife It discloses a system.

According to a second aspect of the present invention, there is provided a manager computer connected to at least one remote computer and at least one remote computer through the Internet or an in-house network, and the screen image required to generate a moving image is generated from the manager computer. A screen information processing system provided by the remote computer for processing and providing, wherein the remote support server mounted on the remote computer captures a screen displayed on the monitor of the remote computer, and the screen is provided from a video memory that can be directly accessed by an application program. Captures the screen in a way that is read directly, captures the next screen in such a way that the screen of the changed area is captured by the change inspection with the previous capture screen, and captures the captured screen image captured by the change inspection process to the manager computer. Transmits the tube Party computer remote client recording a mounted on discloses a picture information processing system using the video memory directly accessible, characterized in that for generating a video file from a capture screen receiving images and recording transmitted from the remote supporting server.

According to a third aspect of the present invention, there is provided a manager computer equipped with at least one remote computer and a remote recording client connected to the at least one remote computer via the Internet or an in-house network, and remote recording of the manager computer. A screen information processing system that obtains and processes a screen image required to generate a video from a client. The remote support server mounted on the remote computer provides a video memory to an operating system OS and captures a screen displayed on the remote computer. A video drive that controls the screen output of the captured screen image captured, reads the current screen from the video memory of the video drive and captures the changed screen through a comparison change test with the previous screen and stores the changed screen image An image processing means including a screen image change inspection process for storing the image into a screen image, and an image conversion process for converting the captured screen image into an image suitable for the remote recording client; And a load balancing process for adjusting a transmission load rate, a transmission process for compressing and encrypting the captured screen image, and then transmitting the captured screen image to the remote recording client, and managing and securing login and out of remote recording clients connected through the Internet or an in-house network. And a connection management process for controlling and managing a control, and an input processing process for receiving a control event from a corresponding remote recording client having control of a plurality of remote recording clients connected through the connection management process and controlling a corresponding OS. Processing means; wherein the image processing means includes any one or more of a video drive, a screen image change inspection process, and an image conversion process, wherein the transfer processing means includes a load balancing process, a transmission process, and a contact process. Any of the control process, and an input processing process starts a screen information processing system using the video memory directly accessible to be configured to include one or more.

According to a fourth aspect of the present invention, at least one remote computer and a manager computer are connected through the Internet or an in-house network, and a screen image necessary for generating a moving image from the manager computer is obtained and processed by the remote computer. A screen information processing method provided, comprising: accessing one of the one or more remote computers by receiving an access request from the administrator computer; Capturing a screen displayed on its monitor by the remote computer connected to the manager computer; The remote computer performing a comparison change check with a previous capture screen to capture a next screen; And transmitting the captured screen image captured by the remote computer through a comparison change inspection process to the manager computer.

In the fifth invention for achieving the above object, one or more remote computers equipped with a remote support server, and a manager computer equipped with a remote recording client for creating a plurality of viewer objects is connected via the Internet or an in-house network, A screen information processing method for obtaining and processing a screen image for generating a moving image from the remote recording client by providing the remote support server, the remote recording client accessing one of the remote support servers through a corresponding viewer object; Copying, by the remote support server connected to the remote recording client, a screen displayed on a monitor of a remote computer by reading directly from a video memory; Performing a comparison change check on whether the screen has been updated on the screen image copied by the remote support server; Transmitting, by the remote support server, the captured screen image captured through the comparison change inspection process of the screen to the remote recording client through the corresponding viewer object; And generating, by the remote recording client, a moving image through recording of the captured screen images received through the corresponding viewer object.

According to a sixth aspect of the present invention, one or more remote computers equipped with a remote support server and an administrator computer equipped with a remote recording client that generates a plurality of viewer objects are connected through the Internet or an in-house network. A screen information processing method of obtaining and processing a screen image required for generating a video from the remote recording client by the remote support server, wherein the remote support server opens a video memory provided by a video drive to obtain a screen address. step; Copying screen data by directly reading a current screen displayed on a monitor of a remote computer from a screen address obtained by the remote support server; Performing a comparison change check on whether the screen has been updated on the screen image copied by the remote support server; And transmitting, by the remote support server, the captured screen images captured through the comparison change inspection process of the screen to the connected remote recording client.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. First of all, in adding reference numerals to the components of each drawing, it should be noted that the same reference numerals are used as much as possible even if displayed on different drawings. In addition, in describing the present invention, when it is determined that the detailed description of the related well-known configuration or function may obscure the gist of the present invention, the detailed description thereof will be omitted.

1 is a system configuration diagram illustrating a screen information processing system using direct access to a video memory according to a first embodiment of the present invention.

As shown in FIG. 1, the screen information processing system according to the first embodiment of the present invention includes at least one remote computer 100 and an administrator computer 200, and at least one remote computer 100 and an administrator. The computer 200 is connected via the Internet 11 or the internal network 12, and all data is transmitted and received through a communication method of TCP / IP.

The remote computer 100 and the manager computer 200 include a keyboard 13 and a mouse 14 as input means. In addition, various input devices that can be used in the computer may be used.

As shown in FIG. 1, the remote computer 100 captures a screen displayed on a monitor. At this time, the captured screens are captured in a manner in which the screen of the changed area is captured through the change inspection with the previous captured screen.

Here, the remote computer 100 divides the screen read during the change check with the previous capture screen into a grid-shaped block, as shown in FIG. Detect changes in

At this time, the comparison test of each divided block is compared based on the diagonal line, the horizontal center line, and the vertical center line of the block, and the grid-shaped block is preferably formed with a size of 56 dots × 56 dots.

Here, in the first embodiment of the present invention, a grid-shaped block is divided into a size of 56 dots × 56 dots, but this is only an example and is not limited thereto. The size may be changed according to a setting of an administrator. have.

As such, the remote computer 100 captures a screen in a predetermined specific time unit and performs a change inspection process for each block unit, thereby providing a capture screen image necessary for generating a video in the manager computer 200.

The remote computer 100 continuously captures the screens displayed on the monitor, and transmits the captured screen images captured through the change inspection process to the manager computer 200 through TCP / IP.

Thereafter, the manager computer 200 receives the captured screen image transmitted from the remote computer through TCP / IP and generates a video file through recording.

Then, the generated video file is played by a media player which is driven by the operation of the administrator.

In the first invention as described above, in acquiring and processing a capture screen image necessary for generating a video, the next screen is divided into grid-shaped blocks, and the change of the screen is performed by performing a change inspection on the previous screen and each block unit area. Not only can it be detected quickly, but it also reduces the load on the CPU, which makes the entire system stable.

2 is a system configuration diagram showing a screen information processing system using a direct access to a video memory according to a second embodiment of the present invention, and FIG. 3 is a functional block diagram showing a remote support server applied to the screen information processing system according to FIG. 4 is a functional block diagram illustrating a remote recording client applied to the screen information processing system according to FIG. 2.

As shown in FIG. 2, the screen information processing system according to the second embodiment of the present invention includes at least one remote computer 300 and an administrator computer 400, and at least one remote computer 300 and an administrator. The computer 400 is connected via the Internet 11 or the company network 12, and all data is transmitted and received through a communication method of TCP / IP.

In addition, the at least one remote computer 300 and the manager computer 400 are each provided with a keyboard 13 and a mouse 14 as input means, in addition to the various input devices that can be used in the computer can be used.

First, the remote computer 300 installs and mounts a remote support server 310 that supports remote control, and the remote support server 310 includes a video memory 311 and a video drive 312 as shown in FIG. 3. ), Screen image change inspection process 313, storage memory 314, image conversion process 315, load balance process 316, transfer process 317, connection management process 318, and input processing process 319. It includes.

The video memory 311 is a directly accessible memory of an application program and is provided as a display memory to the OS 15 as an operating system, and the video drive 312 captures and captures a screen displayed on the remote computer 300. Controls the screen output of one capture screen image.

The screen image change inspection process 313 is a process for capturing whether a screen has been changed in units of blocks and capturing an image of the changed block. The screen change is captured through the comparison change inspection of the data and the changed screen image is stored in the storage memory 314.

In this case, the screen image change inspection process 313 divides the current screen read directly from the video memory 311 into a grid-shaped block in a change inspection with the previous captured screen, and compares the unit screen of each divided block by the unit area. Detect changes in the screen and the current screen. Here, the comparison test for each unit area of each block is compared based on the oblique line, the horizontal center line, and the vertical center line of the block, and each block having a grid shape is preferably formed with a size of 56 dots × 56 dots.

Here, in the second embodiment of the present invention, a grid-shaped block is divided into a size of 56 dots × 56 dots, but this is only an example and is not limited thereto. The size may be changed according to a setting of an administrator. have.

The image conversion process 315 performs a high-speed conversion process on the captured capture screen image into an image suitable for the remote recording client 410 and outputs it.

Here, the image conversion process 315 converts the 32-bit captured screen image of the captured original into one of 8 bits, 16 bits, and 24 bits according to a specified color level of the remote recording client 410.

The load balancing process 316 is a process for preventing a high transmission load when a specific area of the changed screen is changed at a high speed, and serves to control and adjust the transmission load ratio.

The transmission process 317 compresses and encrypts the high-speed converted captured screen image through the image conversion process 315 and then transmits the captured screen image to the remote recording client 410, and the connection management process 318 is performed on the Internet 11 or in-house. Controlling and managing login / out management and security processing of the remote recording clients 410 connecting through the network 12, the input processing process 319 is a plurality of remote recording clients (connected through the connection management process (318) 410 receives a control event from a corresponding remote recording client 410 having a control right and controls the OS 15 corresponding thereto.

The remote support server 310 having the above configuration captures the screen displayed on the monitor of its own remote computer 300, but directly reads the screen from the video memory 311, which is directly accessible by an application program. Capture the screen in a way, and check the change with the previous capture screen to capture the next screen in a way that the screen of the changed area is captured.

Here, in the comparative change inspection of the capture screen, the screen image change inspection process 313 captures the screen in a specific time unit set under the control of the remote support server 310, and performs a change inspection process in a block-by-block scanning manner. .

Thereafter, the remote support server 310 transmits the captured screen image captured through the change checking process to the manager computer 400.

Meanwhile, the manager computer 400 may install and mount the remote recording client 410, and the remote recording client 410 may include one or more viewer objects 411 and a remote screen storage buffer 412 as shown in FIG. 4. , Recording process 413, connection manager process 414, and preview process 415.

One or more viewer objects 411 are connected to each remote support server 310 mounted on one or more remote computers 300 to perform direct communication in a TCP / IP manner, and the remote screen storage buffer 412 may include one or more viewers. The capture screen image received through the viewer object 411 is stored in the specific area.

The recording process 413 receives the capture screen image from the remote screen storage buffer 412 and performs timing control for setting the number of frames per second to be stored during recording, and image control for setting the screen size and image quality during recording. Create a video by recording a capture screen image.

The connection manager process 414 manages the state of one or more viewer objects 411 and automatically performs a reconnection process when the connection with the remote support server 310 in communication is lost. In this case, the connection manager process 414 may be set to be manually connected according to the initial connection setting of the user.

The preview process 415 executes a preview of a corresponding remote screen and provides it to the client user when a preview event command is input before generating a video by the client user. Here, the preview process 415 may be excluded from the configuration of the remote recording client 410.

The remote recording client 410 having the above configuration receives the capture screen image transmitted from the remote support server 310 and generates a video file through recording.

Then, the generated video file is played by a media player which is driven by the operation of the administrator.

According to the second invention as described above, it is possible to copy the screen data at a high speed by directly reading the contents of the screen if necessary through the video memory, and divide the next screen into a grid-shaped block in detecting the screen change. By detecting the change in the previous screen and the area of each block unit, it is possible to detect the change of the screen at a high speed and accordingly, the entire system can be stably operated at a low load rate.

5 is a system configuration diagram showing a screen information processing system using a direct access to a video memory according to a third embodiment of the present invention, and FIG. 6 is a functional block diagram showing a remote support server applied to the screen information processing system according to FIG. Is also.

The screen information processing system according to the third embodiment of the present invention includes an administrator computer 600 equipped with one or more remote computers 500 and a remote recording client 610, as shown in FIG. One or more remote computers 500 and a manager computer 600 are connected via the Internet 11 or an in-house network 12, and all data is transmitted and received through a communication method of TCP / IP.

In addition, the at least one remote computer 500 and the manager computer 600 are provided with a keyboard 13 and a mouse 14 as input means. In addition, various input devices that can be used in the computer may be used.

First, the remote computer 500 installs and mounts a remote support server 510 supporting remote control, and the remote support server 510 includes a video memory 511 and a video drive 512 as shown in FIG. 6. ), Screen image change inspection process 513, storage memory 514, image conversion process 515, load balance process 516, transfer process 517, connection management process 518, and input processing process 519 It includes.

The video memory 511 is a directly accessible memory of an application program and is provided as a display memory to the OS 15 as an operating system, and the video drive 512 captures and captures a screen displayed on the remote computer 500. Controls the screen output of one capture screen image.

The screen image change inspection process 513 is a process for capturing whether the screen has been changed in units of blocks to capture an image of the changed block, and reads the current screen from the video memory 511 of the video drive 512 to transfer the image. Comparing with the screen, the changed screen is captured through the change inspection, and the changed screen image is stored in the storage memory 514.

In this case, the screen image change inspection process 513 divides the current screen read directly from the video memory 511 into a grid-shaped block as shown in FIG. The change in the previous screen and the current screen is detected by comparing the unit area of the block.

Here, the comparison test for each unit area of each block is compared based on the oblique line, the horizontal center line, and the vertical center line of the block, and each block in a grid form has a size of 56 dots × 56 dots vertically as shown in FIG. Preferably formed.

At this time, in the third embodiment of the present invention, the grid-shaped block is divided into 56 56 dots × 56 dots in size, but this is only an example and is not limited thereto. The size may be changed according to the administrator's setting. have.

The image conversion process 515 performs a high-speed conversion process on the captured capture screen image into an image suitable for the remote recording client 610, and preferably outputs the 32-bit capture screen image of the captured original to the remote recording client ( 610) is converted into one of 8bit, 16bit, 24bit according to the specified color level.

The load balancing process 516 is a process for preventing a high transmission load when a specific area of the changed screen is changed at a high speed, and adjusts the load ratio by controlling the transmission load ratio, and the transmission process 517 is an image conversion process. 515 compresses and encrypts the captured screen image which has been converted at high speed, and then transmits the captured screen image to the remote recording client 610, and the connection management process 518 is connected remotely through the Internet 11 or the corporate network 12. It manages login / out management and security processing of the recording clients 610, and the input processing process 519 is a corresponding remote recording with the control right among the plurality of remote recording clients 610 connected through the connection management process 518. The control event is received from the client 610 by receiving the control event corresponding thereto.

The remote support server 510 having the above configuration captures the screen displayed on the monitor of the remote computer 500 of the user, and directly reads the screen from the video memory 511 to which the application program is directly accessible. Capture the screen in a way, and check the change with the previous capture screen to capture the next screen in a way that the screen of the changed area is captured.

Here, the change inspection of the capture screen captures the screen in a specific time unit set by the screen image change inspection process 513 under the control of the remote support server 510, and performs the change inspection process in a block-by-block scanning manner.

Thereafter, the remote support server 510 transmits the captured screen image captured through the change checking process to the remote recording client 610 of the manager computer 600.

According to the third invention as described above, in acquiring and processing the screen image required to generate a moving image, it is possible not only to quickly copy the screen data by directly reading the contents of the screen displayed on the monitor, In the detection, the next screen is divided into grid-shaped blocks to perform a change inspection for each previous block and each block unit area, thereby providing a high speed change detection.

8 is a flowchart illustrating a method of processing screen information using direct access to a video memory according to a fourth embodiment of the present invention, and FIG. 9 is a step of performing a comparison change inspection of a screen in the screen information processing method of FIG. 8. The operation flowchart showing the detailed operation process of.

The screen information processing method using the direct access to the video memory according to the fourth embodiment of the present invention will be described with reference to the system configuration of the first embodiment of the present invention.

First, the manager computer 200 is connected to one of the remote computer 100 is connected via the Internet 11 or the company network 12 (S110), the remote computer 100 is connected to the manager computer 200 is Capture the screen displayed on his monitor (S120).

Next, the remote computer 100 performs a comparison change check with the previous capture screen to capture the next screen (S130).

Here, in the step S130 of performing the screen change inspection, as illustrated in FIG. 9, the remote computer 100 reads the current screen displayed on the monitor (S131), and reads the current screen of FIG. 7 (a). After dividing the grid into block units (S132) and comparing the previous screen to the unit area of the divided block (S133), the unit detects the change in each block unit area of the current screen and captures the screen of the changed area. (S134).

In this case, the comparison inspection of each block is preferably compared with the previous screen by scanning based on the diagonal line, the horizontal center line, and the vertical center line of the block, the grid-shaped block is preferably formed in the size of 56 dots × 56 dots vertically. Do.

Next, the remote computer 100 transmits the captured screen image captured through the comparison change inspection process to the manager computer 200 (S140), and the manager computer 200 generates a video through recording of the received capture screen image. (S150).

According to the fourth aspect of the present invention, when detecting a change in a screen, the next screen is divided into blocks having a grid shape, and the change screen is detected at a high speed by performing a change inspection for the previous screen and each block unit area. It has the effect of providing the capture screen image at high speed at the load rate.

10 is a flowchart illustrating a method of processing screen information using direct access to a video memory according to a fifth embodiment of the present invention, and FIGS. 11 to 14 are screens using video memory direct access according to a fifth embodiment of the present invention. In the information processing method, an operation flow chart showing the detailed operation of the screen memory copying step, performing a comparison change inspection of the screen, transmitting a capture screen image, and generating a video.

The screen information processing method using the video memory direct access according to the fifth embodiment of the present invention will be described with reference to the system configuration of the second embodiment of the present invention.

First, the remote recording client 410 is connected to one of the remote support server 310 connected through the Internet 11 or the company network 12 through the viewer object (S210).

Next, the remote support server 310 connected to the remote recording client 410 copies the screen displayed on the monitor of the remote computer 300 by reading directly from the video memory 311 (S220).

Here, in step S220 of copying the screen, as shown in FIG. 11, the remote support server 310 opens the video memory 311 provided by the video drive 312 to obtain an address of the screen (S221). The screen data is copied from the imported screen address (S222), and then the open video memory 311 is closed (S223).

Next, the remote support server 310 performs a comparison change check whether the screen is updated on the copied screen image (S230).

Here, in the step S230 of performing the screen change inspection, as shown in FIG. 12, a screen copied directly by the remote support server 310 from the video memory 311 as shown in FIG. And dividing the block into blocks (S231), and comparing the previous screen with the previous screen (S232).

In this case, as shown in (b) of FIG. 7, the lattice-shaped block is preferably formed with a size of 56 dots × 56 dots vertically, and the comparison inspection of the blocks is performed by scanning based on the diagonal line, the horizontal center line, and the vertical center line of the block. It is determined whether or not the screen is updated by comparing with the previous screen.

Next, the remote support server 310 transmits the captured screen image captured through the comparison change inspection process of the screen to the remote recording client 410 through the corresponding viewer object 411 (S240).

In this case, as illustrated in FIG. 13, in step S240, the high speed conversion process is performed to an image suitable for the remote recording client 410 to transmit the captured screen image captured by the remote support server 310. S241), a process of compressing and encrypting the captured screen image subjected to the fast conversion process (S242).

Here, the high-speed conversion processing means processing the 32-bit captured screen image of the captured original into one of 8bit, 16bit, and 24bit according to the designated color level of the remote recording client 410.

Next, the remote recording client 410 generates a video through recording of the capture screen images received through the viewer object 411 (S250).

14, the remote recording client 410 receives the captured screen image from the remote support server 310 through the corresponding viewer object 411 (S251), and then remote recording as illustrated in FIG. 14. The client 410 controls the number of frames per second to be recorded, the screen size and the image quality according to the set timing control and the image control (S252), and the next remote recording client 410 captures the captured screen image according to the timing control and the image control. Recording to generate a video (S253).

According to the fifth aspect of the present invention, the screen data is changed by copying screen data by directly reading the contents of the screen, dividing the next screen into grid-shaped blocks, and performing a change inspection on the previous screen and each block unit area. Fast detection provides the effect that the screen image required to generate the video at low load rates can be obtained and provided.

FIG. 15 is a flowchart illustrating a method of processing screen information using direct access to a video memory according to a sixth embodiment of the present invention, and FIG. 16 is a step of performing a comparison change inspection of a screen in the screen information processing method of FIG. The operation flowchart showing the detailed operation process of.

The screen information processing method using the video memory direct access according to the sixth embodiment of the present invention will be described with reference to the system configuration of the third embodiment of the present invention.

First, the remote support server 510 opens the video memory 511 provided by the video drive 512 to obtain and obtain an address of the screen (S310).

Next, the remote support server 510 copies the screen data by directly reading the current screen displayed on the monitor of the remote computer 500 from the imported screen address (S320).

Next, the remote support server 510 performs a comparison change check whether the screen is updated on the copied screen image (S330).

Here, in step S330 of performing a screen change inspection, as illustrated in FIG. 7A, a screen copied directly from the video memory 511 by the remote support server 510 is grid-like as shown in FIG. And dividing the block into blocks (S331), and comparing the previous screen with the previous screen (S332).

In addition, the grid-shaped block is preferably formed with a size of 56 dots × 56 dots vertical, but not limited thereto, the size of the block can be changed according to the user's setting.

In addition, the comparison inspection of the block scans based on the oblique line, the horizontal center line, and the vertical center line of the block to determine whether the screen is updated or not compared to the previous screen.

Next, the remote support server 510 transmits the captured screen image captured through the comparison change inspection process of the screen to the connected remote recording client 610 (S340).

In the sixth invention as described above, in obtaining and processing the screen image required to generate a video, the screen data is quickly copied as well as the next screen is grid-shaped by directly reading the contents of the screen displayed on the monitor. By dividing into blocks of blocks, change inspection is performed on each of the previous screen and each block unit area, thereby providing a high speed detection function according to the screen change.

Although the present invention has been described in more detail with reference to the embodiments, the present invention is not necessarily limited to these embodiments, and various modifications can be made without departing from the spirit of the present invention. Therefore, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of the present invention.

As described above, the screen information processing method and system using the direct access to the video memory according to the present invention, the screen data obtained by directly reading the contents of the screen through the video memory and divided into a grid-shaped block By comparing the previous screen with each block area, it is possible to perform the screen change check, and it is possible to copy the screen data necessary for generating the video at high speed and to detect the change check of the captured screen at high speed. It has an effect.

In addition, the present invention is obtained by processing the screen image required for generating a video at a low CPU load rate so that the entire system for remote control can be stably operated without adversely affecting the operation of other programs running on the computer To provide the effect.

In addition, the present invention is faster than the screen capture by the conventional application program interface (API) method, and does not affect the screen display of the window, as well as constant without affecting the performance of the graphics card The effect is to provide a uniform level of speed.

In addition, the present invention is capable of capturing both a video and some graphic objects that cannot be captured by the existing application program interface (API) method, and has an effect of providing a control environment that is closest to a real computer during remote control.

Claims (21)

A screen information processing system which comprises at least one remote computer and an administrator computer connected to the at least one remote computer via the Internet or an in-house network, and obtains and provides screen images necessary for generating a moving image from the remote computer. As The remote computer captures the screen displayed on the monitor, and captures the next screen in such a way that the screen of the changed area is captured through a change inspection with the previous screen. And transmitting the captured screen image captured through the change inspection process to the manager computer to generate a moving image file through recording on the manager computer. The method of claim 1, The remote computer divides the screen read during the change inspection with the previous capture screen into a grid-shaped block, and compares the change of the current screen by comparing the diagonal line, horizontal center line, and vertical center line of each divided block area. Screen information processing system using direct access to video memory, characterized in that the sensing. The method of claim 2, And the remote computer performs a change inspection process of a scanning method for each block unit at a predetermined specific time unit. A screen information processing system which comprises at least one remote computer and an administrator computer connected to the at least one remote computer via the Internet or an in-house network, and obtains and provides screen images necessary for generating a moving image from the remote computer. As The remote support server mounted on the remote computer captures the screen displayed on the monitor of the remote computer, and captures the screen by reading the screen directly from a video memory that is directly accessible by an application program, and displays the screen with the previous captured screen. The change check captures the next screen in such a way that the screen of the changed area is captured, and transfers the captured screen image captured through the change check process to the administrator computer. And a remote recording client mounted on the manager computer to receive a capture screen image transmitted from the remote support server and generate a video file through recording. The method of claim 4, wherein The remote support server provides a video memory to an operating system (OS) and captures a screen displayed on a remote computer and controls a screen output of the captured screen image, and displays a current screen from the video memory of the video drive. Screen image change inspection process for capturing the changed screen by reading and comparing it with the previous screen and storing the changed screen image in the storage memory, and converting the captured screen image into an image suitable for the remote recording client. Image processing means including an image conversion process to perform; And A load balancing process for adjusting the transmission load ratio, a transmission process for compressing and encrypting the captured screen image and then transmitting it to the remote recording client, login and out management and security processing of remote recording clients connected through the Internet or an in-house network. Transmission processing including a connection management process for controlling and controlling an input processing process for receiving a control event from a corresponding remote recording client having control of a plurality of remote recording clients connected through the connection management process and controlling a corresponding OS. Means; including, The image processing means includes at least one of a video drive, a screen image change inspection process, and an image conversion process, And the transmission processing means includes any one or more of a load balancing process, a transmission process, a connection management process, and an input processing process. The method of claim 5, The screen image change inspection process divides the current screen read directly from the video memory into a grid-shaped block when the change inspection with the previous captured screen is performed, and compares the previous screen and the current screen by unit area of each divided block. Screen information processing system using direct access to video memory, characterized in that the change is detected. The method of claim 6, The comparison test for each unit area of each block is performed by comparing the diagonal, horizontal, and vertical center lines of the blocks with reference to the video memory direct access method. The method of claim 5, And the image conversion process converts the 32-bit captured screen image of the captured original into one of 8bit, 16bit, and 24bit according to a specified color level of the remote recording client. The method of claim 4, wherein The remote recording client may include one or more viewer objects connected to each remote support server mounted on the one or more remote computers to perform direct communication; A remote screen storage buffer for storing a captured screen image received through the one or more viewer objects in a specific region; And A recording process of generating a moving image by receiving a capture screen image from the remote screen storage buffer and performing timing control for setting the number of frames per second to be stored during recording, and image control for setting the screen size and image quality at the time of recording; Screen information processing system using a video memory direct access, comprising a. The method of claim 9, The remote recording client may include: a connection manager process that manages a state of the one or more viewer objects and automatically performs a reconnection process when the connection with the remote support server in communication is lost; And A preview process of executing a preview of a corresponding remote screen when a preview event command is input before generating a video; Screen information processing system using a video memory direct access, characterized in that it further comprises at least one of. Configure a manager computer equipped with at least one remote computer and a remote recording client connected to the at least one remote computer via the Internet or an in-house network, and obtain and process the screen image required to generate a video from the remote recording client of the manager computer. As a screen information processing system to provide, The remote support server mounted in the remote computer provides a video memory to an OS, which is an operating system, and captures a screen displayed on the remote computer and controls a screen output of the captured screen image, the video memory of the video drive. A screen image change inspection process that reads the current screen from a comparison screen and compares it with a previous screen, captures the changed screen, and stores the changed screen image in a storage memory, and sends the captured screen image to the remote recording client. Image processing means including an image conversion process of performing conversion processing to a suitable image; And Load balancing process for adjusting the transmission load ratio, transmission process for compressing and encrypting the captured screen image and transmitting it to the remote recording client, login and out management and security processing of remote recording clients connected through the Internet or the corporate network. And a connection management process for controlling and managing a control, and an input processing process for receiving a control event from a corresponding remote recording client having control of a plurality of remote recording clients connected through the connection management process and controlling a corresponding OS. Treatment means; including, The image processing means includes at least one of a video drive, a screen image change inspection process, and an image conversion process, And the transmission processing means includes any one or more of a load balancing process, a transmission process, a connection management process, and an input processing process. The method of claim 11, The remote support server captures a screen displayed on the monitor of the remote computer, and captures the screen by reading the screen directly from a video memory accessible by an application program, and divides the screen into a grid block. And a change check comparing the previous captured screen with each block unit area, and then using the direct access to the video memory. A screen information processing method in which at least one remote computer and a manager computer are connected through an Internet or an in-house network, and the screen image necessary for generating a moving image from the manager computer is obtained from the remote computer and provided. One of the one or more remote computers accessing a connection request from the administrator computer; Capturing a screen displayed on a monitor of the remote computer connected to the manager computer; The remote computer performing a comparison change check with a previous capture screen to capture a next screen; And Transmitting, by the remote computer, the captured screen image captured by the comparison change inspection process to the manager computer; Screen information processing method using a video memory direct access comprising a. The method of claim 13, The performing of the change inspection of the screen may include: reading a current screen displayed on the monitor by the remote computer; Dividing the current screen read by the remote computer into units of a grid; Comparing the previous screen with each unit area of the divided block by the remote computer; And Detecting, by the remote computer, a change per block area of a current screen and capturing a screen of the changed area; Screen information processing method using a direct access to video memory, characterized in that comprises a. One or more remote computers equipped with a remote support server and a manager computer equipped with a remote recording client that has created a plurality of viewer objects are connected through the Internet or an in-house network, and the screen images necessary for generating a video from the remote recording client are displayed. As the screen information processing method that is obtained by processing provided by the remote support server, Connecting the remote recording client to one of the remote support servers through a corresponding viewer object; Copying, by the remote support server connected to the remote recording client, a screen displayed on a monitor of a remote computer by reading directly from a video memory; Performing a comparison change check on whether the screen has been updated on the screen image copied by the remote support server; Transmitting, by the remote support server, the captured screen image captured through the comparison change inspection process of the screen to the remote recording client through the corresponding viewer object; And Generating, by the remote recording client, a moving image by recording captured screen images received through the corresponding viewer object; Screen information processing method using a video memory direct access comprising a. The method of claim 15, The copying of the screen may include: opening, by the remote support server, a video memory provided by a video drive to obtain a screen address; Copying screen data from the screen address obtained by the remote support server; And Closing the video memory opened by the remote support server; Screen information processing method using a direct access to the video memory, characterized in that it comprises a. The method of claim 15, The performing of the screen change inspection may include: dividing the screen copied directly from the video memory by the remote support server in units of grid blocks; And Comparing, by the remote support server, whether a screen is updated for each unit area of a divided block with a previous screen; Screen information processing method using a direct access to video memory, characterized in that comprises a. The method of claim 15, The capturing screen image transmitting step may include: performing a fast conversion process to an image suitable for a remote recording client to which the capturing screen image captured by the remote support server is to be transmitted; And Compressing and encrypting the fast-converted capture screen image; Screen information processing method using a direct access to video memory, characterized in that comprises a. The method of claim 15, The generating of the video may include: receiving, by the remote recording client, a capture screen image through a corresponding viewer object; Controlling, by the remote recording client, the number of frames per second to be stored during recording, the screen size, and the image quality according to a set timing control and an image control; And Generating, by the remote recording client, a moving picture by recording a capture screen image according to timing control and image control; Screen information processing method using a direct access to video memory, characterized in that comprises a. One or more remote computers equipped with a remote support server and a manager computer equipped with a remote recording client that has created a plurality of viewer objects are connected through the Internet or an in-house network, and the screen images necessary for generating a video from the remote recording client are displayed. As the screen information processing method that is obtained by processing provided by the remote support server, Opening, by the remote support server, a video memory provided by a video drive to obtain an address of a screen; Copying screen data by directly reading a current screen displayed on a monitor of a remote computer from a screen address obtained by the remote support server; Performing a comparison change check on whether the screen has been updated on the screen image copied by the remote support server; And Transmitting, by the remote support server, the captured screen images captured through the comparison change inspection process of the screen to the connected remote recording client; Screen information processing method using a video memory direct access comprising a. The method of claim 20, The changing of the screen may include: dividing, by the remote support server, a screen copied directly from a video memory in units of grid blocks; And Comparing, by the remote support server, whether a screen is updated for each unit area of a divided block with a previous screen; Screen information processing method using a direct access to video memory, characterized in that comprises a.

Images