KR101088129B1 - Method, Apparatus and Recording Medium for Controlling Screen Output - Google Patents

Abstract

Embodiments of the present invention relate to a screen output control method, an apparatus, and a recording medium, and when specific information is input, combination image data is generated by combining specific image data with data of a specific application, and the combination data generated as described above is assigned to a specific application. It provides a screen output control method for controlling the screen output by outputting to the output screen.

According to an embodiment of the present invention, even when the output screen of a specific application related to a game or a graphic is a full screen operating in an exclusive mode, a screen of another application such as a movie may be added to the output screen of the specific application and output. It works.

Screen output, control, full screen

Description

Screen output control method, device and recording medium {Method, Apparatus and Recording Medium for Controlling Screen Output}

One embodiment of the present invention relates to a screen output control method, an apparatus and a recording medium. More particularly, the present invention relates to a screen output control method, an apparatus, and a recording medium which can add and output a playback screen of another application such as a movie to an output screen of a specific application related to a game or graphics in a computer system.

Conventionally, when a user executes a specific application related to a game or graphics in a computer system to display the output screen of the specific application in full screen, the specific application exclusively uses the video device associated with the screen output. As such, in order for a specific application related to a game or a graphic to maximize performance, the video device is assigned to only a specific active application to prevent another window from using the video device. The state that makes use exclusively is called "Exclusive Mode".

As such, when a particular application executed on the computer system is displayed in full screen and is in the exclusive mode, the other device that is executed is executed because the specific application is monopolizing the video device in the computer system even though other applications are executed. There is a problem that can not display the screen of the application.

In this background, it is an object of an embodiment of the present invention to provide a screen output control technique capable of adding and outputting a playback screen of another application such as a movie to an output screen of a specific application related to a game or graphics in a computer system. .

Further, another object of the embodiment of the present invention is to display the screen of another application such as a movie on the output screen of the specific application even when the output screen of the specific application related to the game or graphics in the computer system is the full screen running in the exclusive mode. In addition, the present invention provides a screen output control technique that can be output.

According to an embodiment of the present invention, an image reproduction management unit for generating an inter-process communication means and delivering the image data through the inter-process communication means when receiving a reproduction request for the image data; And after the dynamic link library file is loaded with the target application, if it is detected that the target application uses a graphical application programming interface (API), install an API hook, and after installation of the API hook, When the playback request is input, the playback request is transmitted to the video playback management unit to receive the video data through the inter-process communication means, and to add a playback screen for the received video data to the output screen of the target application. It provides a screen output control device comprising a screen output control unit.

In addition, an embodiment of the present invention, in the recording medium recording a program for executing the screen output control method, after the dynamic link library file is loaded with the target application, and for the image data through the dynamic link library file An interprocessor communication means generating function for generating an interprocess communication means upon receiving a reproduction request; And a computer implementing a video data transfer function for transferring the video data to a processor for output control through the inter-process communication means to add a playback screen on which the video data is displayed on an output screen of the target application. It provides a recording medium that can be read by.

In addition, an embodiment of the present invention, in the recording medium recording a program for executing the screen output control method, after the dynamic link library file is loaded with the target application, the graphical application programming interface (API) of the target application Detecting whether or not to use a graphic API; An API hook installation function for installing an API hook when the target application is detected to use the graphic API; A video data reception function of receiving the video data from a video playback related processor through an inter-process communication means when a playback request for video data is input after installation of the API hook; And a computer-readable recording medium having recorded thereon a program for implementing a screen output control function for adding a playback screen for the received image data to an output screen of the target application.

In addition, an embodiment of the present invention, the API hook installation step of installing an API hook when the target application is detected to use a graphical API; And a screen output control step of receiving video data from a video playback application at a recognized screen output time according to the installation of the API hook, and adding a playback screen of the transferred video data to an output screen of the target application. It provides a screen output control method characterized in that.

In addition, an embodiment of the present invention, the step of receiving specific information; Generating combination data by combining specific image data with data of a specific application according to the input specific information; And outputting the combination data to an output screen of the specific application.

As described above, according to an embodiment of the present invention, an effect of providing a screen output control technique for adding and outputting a play screen of another application such as a movie to an output screen of a specific application related to a game or graphics in a computer system. There is.

In particular, according to an embodiment of the present invention, even if the output screen of a specific application related to a game or graphics in a computer system is a full screen running in exclusive mode, the screen of another application such as a movie is added to the output screen of the specific application. There is an effect of providing a screen output control technology that can be added to the output.

Hereinafter, some embodiments of the present invention will be described in detail through exemplary drawings. In adding reference numerals to the components of each drawing, it should be noted that the same reference numerals are assigned to the same components as much as possible even though they are shown in different drawings. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

In addition, in describing the component of this invention, terms, such as 1st, 2nd, A, B, (a), (b), can be used. These terms are only for distinguishing the components from other components, and the nature, order or order of the components are not limited by the terms. If a component is described as being "connected", "coupled" or "connected" to another component, that component may be directly connected to or connected to that other component, but there may be another configuration between each component. It is to be understood that the elements may be "connected", "coupled" or "connected".

1 is a schematic diagram of a screen output control device 100 according to an embodiment of the present invention.

Referring to FIG. 1, the screen output control apparatus 100 according to an embodiment of the present invention includes an image reproduction management unit 110, a screen output control unit 120, and the like.

The video reproduction management unit 110 specifies a dynamic link library (DLL) file and executes hook installation for the computer system or the target application 10 including the screen output control apparatus 100. After making a request to, when receiving a reproduction request for the image data, an inter-process communication (IPC) means 130 is generated to transmit the image data to be reproduced through the IPC means 130. do. In response to a request for hook installation, the screen output controller 120 may include a DLL file inserted into the target application 10 by the computer system or the target application 10 including the screen output control apparatus 100. After being loaded with), if the target application 10 is detected to use a graphical API (Application Programming Interface, hereinafter referred to as “API”), it installs an API hook and installs the API hook. When a reproduction request for data is input, the reproduction request is transmitted to the image reproduction management unit 110 to receive the image data through the IPC means 130 generated by the image reproduction management unit 110, and to reproduce the received image data. By adding the screen to the output screen of the target application 10, the screen output is controlled.

When the video reproduction management unit 110 requests the computer system or the target application 10 to designate a hook by specifying a DLL file, the DLL system is inserted into the target application 10 by the computer system or the target application 10. And loaded with the target application 10.

As described above, as a method for loading a DLL file together with another application, a method of inserting a DLL file into the target application 10 in response to a hook installation request (which is referred to as "DLL Injection") is used. This DLL injection method is just one example of various methods for loading a DLL file with another application, and depending on the implementation method, the DLL file is loaded with another application, such as a fake DLL method. It can be implemented in any way you can. However, in the entirety of the present specification, for convenience of description, a DLL injection method of inserting a DLL file together with another application and inserting the DLL file into the target application 10 according to a hook installation request. It is assumed that it uses.

As mentioned above, the DLL file mentioned above is a target when an input event of the target application 10 or a window of the target application 10 is activated in response to a request for hook installation of the video reproduction management unit 110. It is inserted into the application 10 and loaded with the target application 10.

After the DLL file is loaded with the target application 10, the screen output control unit 120 detects whether the target application 10 uses the graphic API, and thus the target application 10 uses the graphic API. If detected, install an API hook. The screen output control unit 120 may recognize the screen output time by performing API hooking to change the code of the graphic API according to the installation of the API hook, and perform the API hooking at the recognized screen output time. In this case, the changed code (code of the DLL file) may be executed.

 If it is detected whether the target application 10 uses the graphic API, and the target application 10 is detected not to use the graphic API, the screen output control unit 120 may determine a DLL file (this DLL file is the target application 10). API hook that is different from the DLL file that is loaded with) and used to control the screen output, which means a general DLL file used by the target application 10). Can be installed.

Meanwhile, the screen output controller 120 detects whether the target application 10 uses the graphic API, and if the target application 10 detects the use of the graphic API, the code of the event-related API according to the installation of the API hook. By additionally performing API hooking to change, the event delivery time can be recognized, and at the recognized event delivery time, the changed code (code of the DLL file) can be executed according to the API hooking.

In this case, the screen output controller 120 confirms the processing result by transmitting an input event to a user interface (UI) framework for a key or mouse related input. According to the result of the check, the target application 10 is notified of the input event.

The screen output control unit 120 described above has its own UI framework when the target application 10 displays a new scene on the output screen after installing the API hook related to the graphic API code change and / or the event API code change. After checking whether or not to initialize, outputs the contents of the initialized own UI framework on the playback screen, and if the playback request for the video data is input and the current status is the playback status, the IPC means 130 sends a playback request. Through the IPC means 130 generated by the video playback management unit 110, the video data is transmitted to the video playback management unit 110.

When the UI framework is not initialized, the screen output control unit 120 loads the position information, the hierarchical structure, the font data, and the image data for the playback screen, and performs the IPC means (for the operation synchronization with the video playback management unit). By initializing 130, it is possible to initialize its own UI framework.

As described above, when the screen output controller 120 transmits a playback request for video data to the video playback management unit 110 through the socket, the video playback management unit 110 generates the IPC means 130. The video reproduction management unit 110 may use a message method, a clipboard method, a data copy method, and a dynamic data exchange method for sharing data and operations between processes with the target application 10. DDE: Dynamic Data Exchange, File Mapping, Mail Slot, Pipe, Socket, Remote Procedure Call (RPC), and Component Objects The IPC means 130 may be generated by one of a model (COM) method.

As an example, when the video reproduction management unit 110 generates the shared memory as the IPC means 130 according to the file mapping method, the video reproduction management unit 110 stores (copy) the image data in the generated shared memory and displays the screen. The output control unit 120 reads the image data stored in the shared memory, so that the image data is transferred from the image reproduction management unit 110 to the screen output control unit 120.

As described above, when the screen output controller 120 receives the video data through the IPC means 130 generated by the video reproduction management unit 110, the screen output controller 120 receives the received video data from the target application 10. By outputting the data in combination with), referring to FIG. 5, a reproduction screen 510 for the received image data is added to the output screen 520 of the target application 10.

The output screen 520 of the target application 10 mentioned above may be a full screen operating in an exclusive mode that monopolizes the video device.

The above-mentioned "target application 10" refers to an application in which the screen output control unit 120 (which may be a DLL file) is loaded together in response to a hook installation request of the video playback application. The target application 10 Examples include game applications and graphic applications (eg, CAD, CAM, 3D Authoring Tool, etc.), but are not limited thereto, and may be all applications installed and executable in a computer system.

The image reproduction manager 110 and the screen output controller 120 may be software modules that are programmed and implemented for screen output control according to an embodiment of the present invention.

The video playback management unit 110 may be implemented as a "video playback application" such as a video player, and the screen output control unit 120 may be a "dynamic link library (DLL) file" itself or a "dynamic link library." It can be a specific application running by a (DLL) file.

In the following description, the video reproduction management unit 110 is described as a video reproduction application, and the screen output control unit 120 is also described as a DLL. In addition, the image reproduction management unit 110, which may be an image reproduction application, and the screen output control unit 120, which may be a DLL, and the target application 10 are executed or installed in a computer system. As a whole system that injects a DLL file into the target application 10 in response to a hook installation request of a playback application, it is a Windows OS, a Macintosh OS, a Unix / Linux, and an embedded OS. And so on.

2 is a flowchart illustrating a screen output control method according to an embodiment of the present invention.

2, the screen output control method provided by the screen output control apparatus 100 according to an embodiment of the present invention, hook installation request step (S200), graphic API use detection step (S202), API hook installation A step S204, a playback request delivery step S206, an IPC means generation step S208, an image data delivery step S210, a screen output control step S212, and the like.

In the hook installation request step (S200), the video reproducing application designates a DLL file and requests the hook installation from the computer system or the target application 10. In the graphic API use detection step (S202), after the DLL file is loaded with the target application 10 according to the hook installation, the screen output control unit 120 operating by the DLL file is the graphic of the target application 10. Detect whether API is used. In the API hook installation step (S204), the screen output control unit 120 installs the API hook when it is detected that the target application 10 uses the graphic API. In the playback request delivery step (S206), if the playback request for the video data is input after the installation of the API hook, the screen output control unit 120 transmits the playback request to the video playback application. In the IPC means generating step (S208), the video playback application received the playback request generates the IPC means 130. In the image data delivery step (S210), the image reproducing application transmits the image data to the screen output controller 120 through the generated IPC means 130. In the screen output control step (S212), the screen output controller 120 adds a playback screen for the video data received through the IPC means 130 to the output screen of the target application 10.

The hook installation request step S200 described above is a step for loading a DLL file together with the target application 10. The hook installation request step S200 is a method for loading a DLL file together with another application. This step is performed by assuming that a DLL injection method of inserting a DLL file into the target application 10 in response to a hook installation request is performed. As a method for loading a DLL file together with other applications, in addition to the above-described DLL injection method, depending on the implementation method, it may be implemented by any method such as a fake DLL method. Before step S202, instead of the hook installation request step S200, a step in which another manner for loading a DLL file with another application may be performed.

Here, the output screen of the target application 10 may be a full screen running in an exclusive mode exclusive of the video device.

The screen output control method according to the embodiment of the present invention described above is divided into a process performed by the image reproduction application, which is the image reproduction management unit 110, and a process performed by the screen output control unit 120, and each process Will be described with reference to FIGS. 3 and 4, respectively.

3 is a flowchart illustrating a process performed by an image reproduction application, which is an image reproduction management unit 110 included in the screen output control apparatus 100, in the screen output control method according to an exemplary embodiment of the present invention.

Referring to FIG. 3, while a video reproducing application is executed, a specific DLL (screen output control unit 120) is designated to request a hook installation to a computer system (an OS such as a Windows OS is mounted), or to specify a specific DLL. The hook application is directly requested to the target application 10 (S300).

In this case, when a hook installation request is made to the computer system or the target application 10, the screen output control unit 120 is loaded for all applications executed in the computer system (this is called the target application 10). At this time, the process of loading the DLL (screen output control unit 120) with the target application 10 is referred to as "DLL injection" or "injection". Here, as an "injection method" that loads the DLL (screen output control unit 120) together with the target application 10, a hook (the hook at this time is called a "system hook") is directly installed on the computer system, which is the above-described method. There is an injection method for requesting, an injection method for directly requesting hook installation to the target application 10 by manipulating the memory of the target application 10, and any injection method.

Referring to FIG. 3, after the video installation application makes a hook installation request (S300) with the computer system or the target application 10, the video playback application waits for a user input indicating a playback request for video data to be played back through the video playback application ( S302). When the corresponding image data is loaded (S304) in response to a reproduction request for the image data in the user input waiting (S302), the IPC means 130 generates the loaded image data. In this case, referring to FIG. 3, the video reproducing application generates a shared memory which is one of the IPC means 130 (S306). Thereafter, the image reproducing application stores the image data stored in the computer in the shared memory created above (S308). In this way, it is determined whether the image data stored while storing the image data in the shared memory is the image data corresponding to the end of the corresponding image (S308). If there is no image data to be stored in the shared memory at the end of the image, the user input again. Wait (S302).

The screen output control method including the process performed by the image reproducing application described above with reference to FIG. 3 may be implemented in a program and recorded in a computer-readable recording medium.

A screen output control method including a process performed by an image reproducing application includes a hook installation request function for requesting a hook installation by specifying a DLL file, and a DLL file being loaded together with the target application 10 in response to the hook installation request. After that, if a playback request for the video data is received, an IPC means generating function for generating the IPC means 130 and a playback screen on which the video data is displayed on the output screen of the target application 10 through the IPC means 130 are provided. Implement the image data transfer function for transferring the image data to the screen output control unit 120 (DLL) to add a.

Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, which are also implemented in the form of a carrier wave (for example, transmission over the Internet). It also includes. The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.

In addition, functional programs, codes, and code segments for implementing the present invention can be easily inferred by programmers in the art to which the present invention belongs.

In the case of using a file mapping type shared memory as the IPC means, in the above-described video data transfer function, the video data is stored in the shared memory generated by the video playback application, and the screen output control unit 120 (DLL) shares the shared memory. The image data stored in is read. Through this, the image data transfer function may be performed.

4 is a flowchart illustrating a process performed by the screen output controller 120 included in the screen output control apparatus 100 in the screen output control method according to an embodiment of the present invention.

Referring to FIG. 4, in response to a hook installation request by an image reproducing application, a DLL file inserted into the target application 10 is loaded together with the target application 10, and then a screen output control unit operated by the DLL file ( 120 performs the processes in FIG.

When the DLL file inserted into the target application 10 is loaded with the target application 10, the screen output controller 120 operated by the DLL file examines the DLL file used by the target application 10. It is checked whether the target application 10 uses the graphic API (S400).

Accordingly, when it is determined that the target application 10 uses the graphic API, the code of the graphic API is changed (S406). Here, changing the code of the graphics API is called "API hooking", which is to manipulate the operation according to the existing code of the graphics API to the desired operation. In addition, in addition to changing the code of the graphic API (S406), in order to process the event of the target application 10 in the UI framework, API hooking to change the code of the event API related to the event processing is performed (S408).

On the other hand, if the target application 10 checks whether the graphical API is used (S400), if the target application 10 does not use the graphical API, the API hooking on the DLL loading-related API is performed (S402). It is determined whether the loading is the DLL loading for the graphic API (S404), and if the DLL loading is the DLL loading for the graphic API, API hooking is performed to change the code of the graphic API (S406). Performing API hooking on the DLL loading-related API (S402) may load the DLL directly in order to use the graphic API in the target application 10 after the screen output controller 120 is loaded. API hooking is done for the API that loads.

Through the above-described processes (S400, S406 and S408), the DLL file inserted into the target application 10 is finished loading with the target application 10.

Thereafter, it is determined whether the target application 10 draws a new scene on the output screen (S410). If it is determined that the target application 10 draws a new scene on the output screen, the code of the screen output control unit 120 is executed at the time to be drawn on the screen according to the API hooking result of the graphic API, and the UI framework is executed. Check whether it is initialized (S412).

If it is determined that the UI framework has not been initialized, the UI framework is initialized (S414). That is, the IPC means 130 is initialized to load position information and hierarchical structure for representing a window, font and image data for screen output, and synchronize operation with an image reproducing application.

As a result of the inspection, if the UI framework is initialized, the contents of the UI framework are output to the screen, and it is determined whether the current state is a reproduction state for reproducing the video data (S412). As a result of the determination as to whether it is in the playback state, in the playback state, it is checked whether there is a shared memory generated by the video playback application (S418). As a result of checking whether the shared memory is generated, if the shared memory is generated, the shared data is read, and the read image data is combined with the data of the target application 10 and set to output to the screen (S420). In this case, referring to FIG. 5, the output screen 510 is added with a specific size to a specific position of the output screen 520 of the target application 10. The size and position of the reproduction screen 510 of the image data may be determined according to a user setting or a default setting.

If it is determined that the playback state is not a playback state, or if the shared memory is not created as a result of checking whether the shared memory is created, the logo screen data is combined with the data of the target application 10. It can be set to output to the screen (S422). At this time, the output screen, similar to Figure 5, the logo screen may be added in a specific size at a specific position of the output screen 520 of the target application 10. Here, the size and position of the logo screen may be determined according to a user setting or a default setting.

On the other hand, according to the result of the API hooking S408 for changing the event API code, the code of the screen output control unit 120 is executed at the time when the target application 10 should process the event. If the event is a key or mouse related input, it passes the event to the UI framework to confirm the processing result, and if the verification result is true, the target application 10 is not notified of the event, and if the verification result is false, the event is sent to the target application 10. Tells.

On the other hand, when the user request or playback of the video data is completed, and the screen output control unit 120 is unloaded, all of the changed code part is deleted by performing the API hooking, and the original code (graphic API code, Event API code, etc.) In addition, the use of the shared memory generated by the image reproducing application for the screen output control is terminated.

A screen output control method including a process performed by the screen output controller 120 described above with reference to FIG. 4 may be implemented in a program and recorded in a computer-readable recording medium.

The screen output control method including the process performed by the screen output control unit 120, after the DLL file is inserted into the target application 10 in response to the hook installation request, the DLL file is loaded with the target application 10 A function of detecting whether to use the graphic API of the target application 10, a function of detecting whether to use the graphic API, an API hook installation function to install an API hook when the target application 10 is detected to use the graphic API, and an API hook. After installation of the video data, if the playback request for the video data is input to the video playback application to the video data receiving function to receive the video data via the IPC means, and the playback screen for the received video data target application (10) Implements a screen output control function that adds to the output screen of).

Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, which are also implemented in the form of a carrier wave (for example, transmission over the Internet). It also includes. The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.

In addition, functional programs, codes, and code segments for implementing the present invention can be easily inferred by programmers in the art to which the present invention belongs.

According to another embodiment of the present invention, a screen output control method includes an API hook that installs an API hook when the target application 10 detects using a graphic API by a hook installation request or another method of a video playback application. And a screen output control step of adding the playback screen of the received video data to the output screen of the target application 10 after receiving the video data at the recognized screen output time according to the installation of the API hook. Here, the output screen of the target application 10 may be a full screen operating in an exclusive mode that monopolizes the video device in the computer system.

Another embodiment of the present invention, the step of receiving the specific information related to the playback request or the screen output control, etc. of the image data, and the specific application data 10 (eg game application, etc.) according to the specific information input; Generating combination data by combining the data with the data; and outputting the combined data to the output screen of the specific application 10. Here, the output screen of the specific application 10 may be a full screen running in the exclusive mode.

As described above, according to an exemplary embodiment of the present invention, a computer system may add and output a playback screen of another application (eg, a video playback application) to an output screen of a specific application 10 related to a game or graphics. It has the effect of providing a screen output control technology.

In particular, according to an embodiment of the present invention, even if the output screen of the specific application 10 related to a game or graphics in the computer system is a full screen running in exclusive mode, other applications such as movies (for example, a video playback application) It is effective to provide a screen output control technique that can be output by adding the screen of the specific application 10 to the output screen.

In the above description, all elements constituting the embodiments of the present invention are described as being combined or operating in combination, but the present invention is not necessarily limited to the embodiments. In other words, within the scope of the present invention, all of the components may be selectively operated in combination with one or more. In addition, although all of the components may be implemented in one independent hardware, each or all of the components may be selectively combined to perform some or all functions combined in one or a plurality of hardware. It may be implemented as a computer program having a. Codes and code segments constituting the computer program may be easily inferred by those skilled in the art. Such a computer program may be stored in a computer readable storage medium and read and executed by a computer, thereby implementing embodiments of the present invention. The storage medium of the computer program may include a magnetic recording medium, an optical recording medium, a carrier wave medium, and the like.

In addition, the terms "comprise", "comprise" or "having" described above mean that the corresponding component may be included, unless otherwise stated, and thus excludes other components. It should be construed that it may further include other components instead. All terms, including technical and scientific terms, have the same meanings as commonly understood by one of ordinary skill in the art unless otherwise defined. Terms commonly used, such as terms defined in a dictionary, should be interpreted to coincide with the contextual meaning of the related art, and shall not be construed in an ideal or excessively formal sense unless explicitly defined in the present invention.

The foregoing description is merely illustrative of the technical idea of the present invention, and various changes and modifications may be made by those skilled in the art without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of the present invention.

1 is a schematic diagram of a screen output control apparatus according to an embodiment of the present invention;

2 is a flowchart illustrating a screen output control method according to an embodiment of the present invention;

3 is a flowchart illustrating a process performed by an image reproduction management unit included in a screen output control apparatus in a screen output control method according to an embodiment of the present invention;

4 is a flowchart illustrating a process performed by a screen output controller included in a screen output control apparatus in the screen output control method according to an embodiment of the present invention;

5 is a diagram exemplarily illustrating that a playback screen for image data is added to an output screen of a target application by a screen output control method according to an exemplary embodiment of the present invention.

<Description of Symbols for Main Parts of Drawings>

10: Target Application

100: display control device

110: video playback management unit

120: screen output control unit

130: interprocess communication means

510: playback screen of the video playback application

520: output screen of the target application

Claims (16)

An image reproduction management unit generating an inter-process communication means and delivering the image data through the inter-process communication means when receiving a reproduction request for the image data; And After the dynamic link library file is loaded with the target application, if it is detected that the target application uses a graphical application programming interface (API), an API hook is installed, and after installation of the API hook, the playback of the image data is performed. When the request is input, the playback request is transmitted to the video playback management unit to receive the video data through the inter-process communication means, and a screen output for adding the playback screen for the received video data to the output screen of the target application. Including a control unit, And the output screen of the target application is a full screen operating in an exclusive mode that exclusively the video device. The method of claim 1, The video reproduction management unit, Message sharing, clipboard, data copying, dynamic data exchange, file mapping, mailslot, pipe, socket, remote procedure call, and the like for data sharing and operation sharing between processes with the target application. And generating the inter-process communication means by one of a component object model method. 3. The method of claim 2, The image reproduction management unit generates a shared memory as the inter-process communication means according to the file mapping method, and stores the image data in the shared memory, and the screen output controller reads the image data stored in the shared memory. , And the image data is transferred from the image reproduction management unit to the screen output control unit. The method of claim 1, The dynamic link library file, In response to a request for hook installation of the video reproduction management unit, when an input event of the target application is generated or a window of the target application is activated, the screen output control device is inserted into the target application and loaded together with the target application. . The method of claim 1, The screen output control unit, If the target application is detected to use the graphical API, by performing an API hook to change the code of the graphical API according to the installation of the API hook, And recognizing a screen output time point, and executing the changed code at the recognized screen output time point. The method of claim 1, The screen output control unit, And detecting that the target application does not use the graphic API, after performing API hooking for an API that loads a dynamic link library file, and installing the API hook. The method of claim 1, The screen output control unit, After installing the API hook, when the target application displays a new scene on the output screen, After checking whether your own user interface framework is initialized, Outputs the initialized contents of the user interface framework to the playback screen, and when the playback request for the video data is input and the current status is the playback status, the playback request is transmitted through the inter-process communication means. And transmitting the image data to the reproduction management unit through the inter-process communication means. The method of claim 7, wherein The screen output control unit, If the own user interface framework is not initialized, Initializing the user interface framework by loading location information, hierarchical structure, font data and image data for the playback screen and initializing the inter-process communication means for synchronizing operation with the video playback management unit. Display control device. The method of claim 1, The screen output control unit, And outputting the received image data in combination with the data of the target application, thereby adding the reproduction screen for the received image data to the output screen of the target application. The method of claim 1, The screen output control unit, If the target application is detected to use the graphical API, by additionally performing an API hook to change the code of the event-related API according to the installation of the API hook, And recognizing an event delivery time point and executing the changed code at the recognized event delivery time point. The method of claim 10, The screen output control unit, And an input event to a user interface framework for a key or mouse related input to confirm a processing result, and to notify the target application of the input event according to the verification result. delete A recording medium having recorded thereon a program for executing a screen output control method, An inter-processor communication means generating function for generating an inter-process communication means when receiving a reproduction request for image data through the dynamic link library file after the dynamic link library file is loaded with the target application; And Image data transfer function for transferring the image data to a processor related to output control through the inter-process communication means to add a reproduction screen on which the image data is displayed on the output screen of the target application. A computer-readable recording medium that records a program that implements the program. A recording medium having recorded thereon a program for executing a screen output control method, Detecting whether to use a graphic API to detect whether the target application uses a graphic API after the dynamic link library file is loaded with the target application; An API hook installation function for installing an API hook when the target application is detected to use the graphic API; A video data reception function of receiving the video data from a video playback related processor through an inter-process communication means when a playback request for video data is input after installation of the API hook; And A screen output control function for adding a playback screen for the received image data to an output screen of the target application as a full screen operating in an exclusive mode exclusive of a video device. A computer-readable recording medium that records a program that implements the program. An API hook installation step of installing an API hook when the target application is detected to use a graphic API; And A screen output control step of receiving video data from a video playback application at a recognized screen output time according to the installation of the API hook, and adding a playback screen of the transferred video data to an output screen of the target application; And the output screen of the target application is a full screen operating in an exclusive mode that exclusively the video device. Receiving specific information; Generating combination data by combining specific image data with data of a specific application according to the input specific information; And Outputting the combination data to an output screen of the specific application; , &Lt; / RTI & The output screen of the particular application is a screen output control method, characterized in that the entire screen running in the exclusive mode (Exclusive Mode).

Images