KR20090097111A - Apparatus and method for controlling the shared screen in the multipoint conference system - Google Patents

Abstract

An apparatus for controlling a shared screen in a multilateral electronic conference system and a method thereof are provided to prevent an application screen which is required for only a presenter and is not wanted to be transmitted from being transmitted to everyone. A hiding processing module(130) hides a screen which has to be hidden during the image capturing, and then extracts a screen which does not correspond to the object which has to be hidden. A conference module(110) receives the object which has to be hidden from a user. When a screen is shared for the electronic conference, the conference module transmits the extracted screen to terminals participating in the electronic conference. A window hooking module(120) monitors the new generated window and selectively sets up the hiding processing for the generated window.

Description

Apparatus and Method for Controlling the Shared Screen in the Multipoint Conference System

The present invention relates to an apparatus and method for controlling a shared screen in a multi-party electronic conference system, and more particularly, to a presenter's conference system toolbar and a user interface in a screen sharing service of a multi-party electronic conference system. In addition, the present invention relates to a shared screen control device and a method for setting a screen such as a selected external application to be hidden to other attendees.

With the development of the Internet, it is common to conduct meetings by sharing video, audio, and various documents among remote users. In particular, such as screen sharing, the presenter's PC screen is immediately transmitted to specific and multiple conference attendees without the need for uploading the document of the presenter. to be.

Screen sharing is a technology that divides into master and host so that the whole screen of the host or the shared area screen of a specific area is transmitted to the master in real time so that the other party can see it. The remote control provides a function that allows the master to manipulate the keyboard and mouse while viewing the screen of the host in the screen sharing state. Representative products among these products include pcAnywhere and VNC.

Furthermore, screen sharing in e-meeting is a service concept that extends to 1: N including 1: 1, and the presenter's screen is transmitted to a large number of participants in real time so that the presentation and meeting can be conducted. The biggest advantage is that screen sharing transmits the presenter's PC screen as it is.

However, the UI screen of the meeting system obstructs the presenter's screen, and the screen such as the chat window provided by the meeting system is visible to other participants, thus preventing the smooth presentation. In order to switch the sharing mode such as writing and execute various menus such as chat, the conference system inevitably provides a UI such as a toolbar, and since such a system generally supports full screen, such a UI is used for screen sharing. It becomes visible to other participants.

In order to solve such a problem, the prior art has attempted to prevent unnecessary parts from being transmitted from the presenter's screen by sharing only the screen except the toolbar and the UI area, or supporting auto-hiding of the toolbar and the UI. However, excluding the toolbar and UI area causes a problem that part of the presentation screen is fixedly excluded, and the auto-hiding function of the toolbar and the UI solves this problem to some extent, but uses the functions of the hidden toolbar and the UI. In order to reappear the hidden toolbar, the original problem of sharing unnecessary areas reappears.

This problem caused a great restriction on the UI layout expression of various information and functions that must be continuously expressed in the conference system. In addition to the UI of the conference system, various presentation screens for presentations to the presenter and the UI of external applications that should not be shared for security purposes are known in the related art. It was just showing the screen of images.

Therefore, the present invention solves the problem that the application screen is also transmitted only to the presenter or not desired to be transmitted, and when the other participant is remotely controlling the presenter's screen, the mouse and keyboard events generated by the controller are already present. It is an object of the present invention to provide a shared screen control device and a method for blocking the transmission to an application which is hidden.

Electronic conferencing sharing screen control apparatus according to an aspect of the present invention comprises a hidden processing module for hiding the screen that is a hidden setting target, and extracts a screen that does not correspond to the hidden setting target when screen capture for sharing; A conference module for receiving a target to be hidden from a user and transmitting the extracted screen to the electronic conference attendee terminal when the screen is shared for the electronic conference; And a window hooking module for monitoring newly created windows and selectively hiding the newly created windows.

The conferencing module may control the concealment processing module to conceal at least one of a toolbar or a user interface provided by the electronic conference sharing screen control apparatus.

The hidden setting target received from the user may be any one of a specific window, a currently running application, or a window depending on an application to be executed later.

At this time, the window hooking module monitors a window generated by the currently running application or an application to be executed later, and controls to hide the application when an application currently executed or application information to be executed later is input from a user. It may be characterized by.

The hidden processing module may be configured to perform a hidden process by assigning a transparent window property to a window for performing a hidden process.

In this case, the electronic conference sharing screen control apparatus may further include a graphic hooking module that blocks the graphic output when a graphic output corresponding to the hidden window is requested, wherein the hidden processing module is a transparent window in an operating system. If the setting function is not supported, the hiding process may be performed using the graphic hooking module.

Preferably, the conferencing module may ignore the command when receiving a command to be delivered to a hidden processed object from another electronic conference terminal other than the conference module.

More preferably, the conference module may control to hide the hidden object on the screen of the electronic conference shared screen processing apparatus when another electronic conference terminal other than the user has the remote control right.

In this case, when the conference module recovers the remote control right from the other electronic conference terminal, the conference module may control to output the hidden object to a screen on the electronic conference shared screen processing apparatus.

According to another aspect of the present invention, there is provided a method for controlling an e-conferencing shared screen, comprising: receiving, by the e-conferencing shared screen control apparatus, a target to be hidden from a user; A process of concealing a screen which is a hidden setting target, and extracting a screen that does not correspond to a hidden setting target and transmitting the screen to the electronic conference participant terminal during screen capture for sharing by the electronic meeting sharing screen control apparatus; And monitoring the newly created window and selectively hiding the newly created window.

The electronic conference sharing screen control device may hide at least one of a toolbar or a user interface provided by the electronic conference.

The hidden setting target received from the user may be any one of a specific window, a currently running application, or a window depending on an application to be executed later.

In this case, the step of monitoring the newly created window and selectively hiding the newly created window may include: monitoring a window generated by a currently running application or an application to be executed later, and inputting the generated window. It may be characterized in that the hiding process.

On the other hand, the process of hiding the screen that the e-meeting shared screen control target is the hidden setting, it may be characterized in that the hidden process by giving a transparent window property to the window for the hiding process.

In addition, the process of hiding the screen that is the target to be set hidden by the e-meeting shared screen control device, if a graphic output corresponding to the window for the hiding process is requested, performing the hiding process by blocking the graphic output. It may also be characterized.

Preferably, the method of controlling the e-meeting shared screen may further include ignoring the command when receiving a command to be delivered to a hidden object from another e-meeting terminal.

More preferably, the method of controlling the e-meeting sharing screen may further include controlling to hide the hidden object on the screen of the e-meeting sharing screen processing apparatus when another e-meeting terminal other than the user has the remote control right. have.

In this case, when the remote control right is recovered from the other e-conferencing terminal, the method may further include controlling to output the hidden processed object to the screen on the e-conferencing shared screen processing apparatus.

According to the shared screen control device and the method according to the present invention, the presenter can still see the presenter's toolbar, user interface, or additionally selected screens of the external application in the screen sharing service of the electronic conference system. In other cases, the hidden screen is sent to other participants.

Therefore, the part of the screen hidden by the hidden window is transmitted instead, so that it may appear as if it did not exist, thereby providing the presenter with the user interface of the conference system without restriction of expression. At the same time, it solves the problem that the contents of the presentation are obscured and improves the convenience and security for the smooth presentation process by not transmitting the window screen contents that need security.

In document meetings, they are often shared in full screen mode, and screen sharing in real time is particularly powerful in screen meetings. Can be applied as

Furthermore, when another participant wishes to remotely control the presenter's screen while the present invention is applied, the conference system can automatically deliver the keyboard and mouse events generated by the controller to the application that is already hidden. When remote control is granted to a participant other than the presenter or the presenter, the hidden window can be hidden from the actual screen as well as the screen sharing transmission screen.

The present invention is more suitable for the electronic conference system, which is a multi-party service, but also has excellent compatibility in that it can be applied to all screen sharing and remote control solutions.

Hereinafter, an apparatus and method for controlling a shared screen in a multi-party electronic conference system according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of an apparatus for controlling a shared meeting screen according to an embodiment of the present invention.

As shown in FIG. 1, the apparatus 100 for controlling e-meeting sharing screen may include a conference module 110, a window hooking module 120, a hidden window setting module 130, and a graphic hooking module 140. Can be.

The meeting module 100 performs a process of displaying an output screen of a toolbar and a user interface on its own meeting system when sharing the screen in a situation such as an electronic meeting, showing it to the presenter himself and hiding it from other participants. . Such a process is referred to as a hiding process in the present invention. The hidden process is performed by the conference module 100 using the hidden window setting module 130 at the beginning of execution.

In addition, the conference module 100 may provide a tool such as a dialog box that the user can select so that the presenter can hide an unrelated external window or application other than the electronic conference related window while the electronic conference is in progress. have.

 The user may input a specific window, the name of the currently running application or the name and execution path of an application to be executed later using the provided dialog box. The conference module 100 may perform the hidden process by calling the hidden window setting module 130 for the window selected by the user or the input application.

The meeting module 100 hides the toolbar, the user interface, the window, and the like, which are to be hidden, and then captures a screen and transmits the screen to another electronic conference participant terminal.

The hidden window setting module 130 is a component that controls to hide a toolbar, a user interface, and a target window of an additional selected external application according to the control of the conference module 100 or the window hooking module 120.

To share the presenter's screen and send it to other meeting participants, you need to capture the presenter's display screen. In order to capture the screen, the Microsoft Windows operating system generally uses a Graphic Device Interface (GDI) API.

In addition, the hidden window setting module 130 outputs the target window of the toolbar, user interface, or additionally selected external application of the electronic conferencing system on the presenter's actual screen, but must hide it as it did not exist on the captured screen for transmission.

For this capturing process, you can use any method that supports the specific window hiding process in the operating system. However, when the operating system does not support a specific window hiding process, the hidden window setting module 130 controls the graphic hooking module 140 to perform a graphic API hooking process to perform an emulation process of hiding a specific window.

On the other hand, when supporting a transparent window processing layered window API such as Microsoft Windows 2000 or higher operating system, the hidden window setting module 130 layered window properties of the toolbar, user interface or any window that is the target of the hidden setting This is done by adding an attribute and setting it to a transparent window.

The graphic hooking module 140 is a component for invalidating or blocking a display output when a graphic application programming interface (API) corresponding to a window set to be hidden at the time of screen capture is called.

Hooking here may be described as follows. For example, if A module hooks API of B function, when A API is called, A module executes before API of B function, and optionally calls original API so that normal processing is performed. It is to make progress.

That is, when the graphic API for outputting the hidden window is called, the graphic hooking module 140 executes before the graphic API to block the display output.

Meanwhile, the window hooking module 120 of the present invention corresponds to a component for monitoring newly created windows and selectively hiding when detecting a newly created window.

As described above, the present invention provides a function of hiding a specific window of an external application input by a user or an entire window of an application. In the case of a specific window, the operation ends with one hidden setting.

However, in the case of an application, a hidden setting should be made for all windows dependent on the application. In addition, there may be a window that the application creates continuously after the hidden setting. The window hooking module 120 monitors a window that is continuously generated and controls to set a hidden window.

In addition, the present invention also provides a function for automatically hiding when an application not currently executed is executed later. To this end, the electronic conference sharing screen control apparatus 100 may receive an application name and an execution path from a user. The window hooking module 120 monitors windows generated when an application that receives information is executed and hides the windows.

FIG. 2 is a diagram illustrating a specific operation process of the conference module shown in FIG. 1.

The conference module 110 first loads the graphic hooking module 140 and the window hooking module 120 when the operation starts (S201 and S202). The loaded graphic hooking module 140 and the window hooking module 120 continue to operate until the end of the operation of the conference module 110 or the e-meeting system ends.

Thereafter, the conference module 110 controls the hidden window setting module 130 to hide the toolbar and various user interfaces of the electronic conference system (S203). The hidden processing performed by the hidden window setting module 130 will be described in more detail with reference to FIG. 5.

In addition, the conference module 110 outputs an interface such as a dialog box for receiving a window or an application to be hidden from the user (S204). The meeting module 110 determines whether the user selects a window or an application to be hidden through the dialog box output in step S204 (S205).

If an arbitrary window or application is input from the user, the conference module 110 controls the hidden window setting module 130 to hide the selected window or application (S206).

After the hiding process is completed, the conference module 110 performs other electronic conference related processes (S207).

The conference module 110 determines whether the conference system ends (S208). If the electronic conference system is terminated, the conference module 110 ends its operation. If the electronic conference system is not terminated, the conference module 110 proceeds to step S205 to determine whether the user additionally inputs window or application information to be hidden.

FIG. 3 is a diagram illustrating a specific operation process of the graphic hooking module shown in FIG. 1.

The graphic hooking module 140 starts its operation through the loading process of the conference module 110 according to step S201 of FIG. 2.

The graphic hooking module 140 resides itself throughout the operating system (S301), and then starts a hooking process for monitoring a graphic API such as an application (S302).

When the hooking process is performed for any graphic API, the graphic hooking module 140 may be executed before the API is used when an application outputs the screen.

The graphic hooking module 140 determines whether the hooked API is called (S303). If the hooked API is not called, the steps of S304 to S307 do not need to proceed, and the process proceeds directly to S308.

On the other hand, when the hooked API is called, the graphic hooking module 140 determines whether the hooked API is the API called in the process of the conference module 110 to capture the screen (S304). In addition, the graphic hooking module 140 determines whether an API call is a call to a window that is set to be hidden (S305).

If both the determination of S304 and the determination of S305 are Yes, the graphic hooking module 140 hides or invalidates the screen of the corresponding API as if the screen of the corresponding window did not exist (S306).

If the determination of S304 or S305 is No, that is, if any API call is not a call for screen capture or a call to a window that is set to be hidden, the graphic hooking module 140 may not use the original API. The call is controlled to be output normally (S307).

After completing the above process, the graphic hooking module 140 determines whether the electronic conference system is terminated (S308). If the electronic conference system is not terminated, the graphic hooking module 140 proceeds to step S302 to wait for another API call. On the other hand, when the electronic conference system is terminated, the graphic hooking module 140 ends the operation.

4 is a diagram illustrating a specific operation process of the window hooking module illustrated in FIG. 1.

Like the graphic hooking module 140, the window hooking module 120 is loaded by the conference module 110 in operation S202.

Like the graphic hooking module 140, the window hooking module 120 also resides throughout the operating system.

The window hooking module 120 resides throughout the operating system and performs a hooking process for monitoring window generation of all applications (S402). When the window hooking module 120 performs a hooking process, the window hooking module 120 may detect a window newly created in all applications.

The window hooking module 120 determines whether a newly generated window is detected (S403). If the newly created window does not exist, the window hooking module 120 proceeds to step S406 without any further processing.

When detecting a newly generated window, the window hooking module 120 determines whether the detected window corresponds to a window which is set to be hidden and a window belonging to an application (S404).

If the window detected in step S404 is a hidden window or a window belonging to an application, the window hooking module 120 controls the hidden window setting module 130 to immediately hide a newly created window (S405). ).

After controlling to hide the newly generated window as described above, the window hooking module 120 detects whether the electronic conference system is terminated (S406). If the electronic conference system is not terminated, the window hooking module 120 proceeds to step S403 and detects whether another window is generated while remaining throughout the operating system.

Of course, if the electronic conference system is terminated in step S406, the window hooking module 120 will terminate the operation.

FIG. 5 is a diagram illustrating a specific operation process of the hidden window setting module shown in FIG. 1.

The hidden window setting module 130 is started by calling the conference module 110 or the window hooking module 120 to set the window or application to be hidden.

First, the hidden window setting module 130 receives parameter information of a window or an application to be hidden from a module (eg, the conference module 110 or the window hooking module 120) that calls itself (S501). ).

The hidden window setting module 130 determines whether the received parameter information is information on a window and an application currently being executed (S502).

If the parameter information received in the determination of S502 is not information about a window or an application currently running, the hidden window setting module 130 adds these information to the hidden setting management list (S506). Thereafter, the hidden window setting module 130 ends the operation and immediately returns.

On the other hand, in step S502, if the received parameter information is information on a currently running window and application, the hidden window setting module 130 checks whether the operating system supports a transparent window function such as a layered window of Microsoft Windows (S503). .

If the transparent window function is supported by the operating system, the hidden window setting module 130 performs a hidden process on windows that depend on a window or an application to be hidden by using the function (S504).

For example, the hidden window setting module 130 may perform a hidden process by adding a layered window attribute to all windows that depend on a window or application that is a hidden setting target and setting it as a transparent window.

If the operating system does not support such a layered window function in step S503, the hidden window setting module 130 controls the graphic hooking module 140 to immediately process hidden windows for the windows or applications dependent on the hidden processing target. (S505).

Finally, the hidden window setting module 130 adds the window or application input from the user to the hidden setting management list (S506), and controls to hide the window or application immediately even if the window or application is called later. Thereafter, the hidden window setting module 130 ends the operation.

When another participant is remotely controlling the screen of the presenter who is shared with the screen, a problem may occur in that a keyboard or mouse event generated by the controller is transmitted to an application that is set to be hidden. Hereinafter, a method for solving such a problem will be described.

6 is a diagram illustrating a method of using a hidden window function and a remote control function in parallel according to another embodiment of the present invention.

In detail, FIG. 6 illustrates a process of processing a keyboard and mouse event generated by a remote controller in the conference module 110 of the presenter side electronic conference sharing screen control apparatus 100.

The meeting module 110 of the electronic meeting sharing screen control apparatus 100 is in a state in which the current electronic meeting screen is shared, and checks whether the present meeting side is presenter (S601).

If the presenter is not presenter in the screen sharing state, the conference module 110 proceeds to step S606 in which other conference related processes are performed. If the presenter is in the screen sharing state, the following steps S602 to S605 are performed.

The conference module 110 of the presenter-side shared screen control device determines whether a keyboard or mouse event generated by another participant having a remote control right has been received (S602).

In addition, the conference module 110 determines whether a keyboard or mouse event generated by another participant is delivered to the window in which the event is currently hidden (S603). If the event is not received, the process proceeds to step S606 without performing an event related operation (steps S604 to S605).

If the event delivered from another participant with remote control is delivered to the hidden window, the conference module 110 ignores or blocks the event so that the event is not delivered to the hidden window (S604). After ignoring or blocking the event, the conference module 110 continues with other conference related processes (S606).

If the keyboard or mouse event generated by the other participant is not delivered to the currently hidden window, in step S603, the conference module 110 controls the event to be processed normally (S605).

After the event-related operation control, the conference module 110 checks whether the electronic conference system is terminated (S607). When the electronic conference system is terminated, the conference module 110 also terminates the operation. If the conference system is not terminated, the conference module 110 proceeds to step S601 to repeat the operation.

7 is a diagram illustrating a control method when a remote control right is changed according to another embodiment of the present invention.

The meeting module 110 of the electronic meeting sharing screen control apparatus 100 checks whether a change of the remote controller is made (S701).

The meeting module 110 determines whether the remote control right is returned to the presenter (S702). If the remote control right has been recovered to the presenter, it controls to output the hidden windows on the actual display of the electronic meeting shared screen control apparatus 100 (S703).

If the remote control right is not given to the presenter but is given to another participant in step S702, the conference module 110 controls the hidden window to be hidden not only on the screen sharing transmission screen but also on the actual screen (S704).

Through this, it is possible to fundamentally solve the problem that the keyboard and mouse events generated by the remote controller can be applied to the hidden window of the presenter's electronic conference sharing screen control device.

As such, processing a specific window to be shown or not seen on an actual screen rather than a shared screen can be implemented using a window API of Microsoft Windows.

As such, after the control according to the change of the remote controller, the conference module 110 performs other conference related processes (S705). In addition, the conference module 110 checks whether the electronic conference system is terminated (S706). When the electronic conference system is terminated, the conference module 110 also terminates the operation. If the conference system is not terminated, the conference module 110 proceeds to step S701 to repeat the operation.

Although the present invention has been described in detail through the representative embodiments, those skilled in the art to which the present invention pertains can make various modifications without departing from the scope of the present invention. I will understand. Therefore, the scope of the present invention should not be limited to the described embodiments, but should be defined by the claims below and equivalents thereof.

1 is a block diagram of an apparatus for controlling a shared meeting screen according to an embodiment of the present invention.

FIG. 2 is a diagram illustrating a specific operation process of the conference module shown in FIG. 1.

3 is a view illustrating a specific operation process of the graphic hooking module 140 shown in FIG. 1.

4 is a view illustrating a specific operation process of the window hooking module shown in FIG. 1.

5 is a view illustrating a specific operation process of the hidden window setting module shown in FIG.

6 is a diagram illustrating a method of using a hidden window function and a remote control function in parallel according to another embodiment of the present invention.

7 is a view showing a control method when a remote control right is changed according to another embodiment of the present invention.

<Description of Signs for Main Parts of Drawings>

100: electronic conference sharing screen control device 110: conference module

120: window hooking module 30: hidden window configuration module

140: graphic hooking module

Claims (18)

A hidden processing module configured to hide a screen that is a hidden setting target when capturing a screen for sharing and extract a screen that does not correspond to a hidden setting target; A conference module for receiving a target to be hidden from a user and transmitting the extracted screen to the electronic conference attendee terminal when the screen is shared for the electronic conference; And An electronic meeting shared screen control device including a window hooking module for monitoring newly created windows and selectively hiding the newly created windows. The method of claim 1, The conference module, And control the at least one of a toolbar or a user interface provided by the e-meeting shared screen control device. The method of claim 1, Hidden setting target received from the user, The apparatus for controlling an electronic meeting shared screen, characterized in that it is one of a specific window, a currently running application, and a window depending on an application to be executed later. The method of claim 3, The window hooking module, If the user receives the currently running application or application information to be executed later, the shared screen of the electronic meeting, characterized in that for monitoring the window generated by the currently running application or the application to be executed later, and to hide it controller. The method of claim 1, The hidden processing module, The electronic meeting shared screen control device, characterized in that the hiding process is performed by assigning a transparent window property to the window for the hiding process. The method of claim 5, The electronic conference sharing screen control device further includes a graphic hooking module that blocks the graphic output when a graphic output corresponding to the hidden window is requested. The hidden processing module is an electronic conference sharing screen control device, characterized in that if the operating system does not support the transparent window setting function to perform the hidden processing using the graphic hooking module. The method according to any one of claims 1 to 6, The conference module, When receiving a command to be delivered to the hidden object from the other e-meeting terminal other than the self, the e-meeting shared screen control device, characterized in that for ignoring the command. The method according to any one of claims 1 to 6, The conference module, The electronic conference sharing screen control apparatus, characterized in that if the other electronic conference terminal other than the user has a remote control right, the hidden object is controlled to be hidden on the screen on the electronic conference sharing screen processing apparatus. The method of claim 8, The conference module, And when the remote control right is recovered from the other e-meeting terminal, controlling the hidden object to be output to a screen on the e-meeting shared screen processing apparatus. The electronic conference sharing screen control device receives a target to be hidden from the user input; The electronic meeting sharing screen control device hides a screen which is a hidden setting target when capturing a screen for sharing, and extracts a screen that does not correspond to the hidden setting target and transmits the screen to an electronic conference participant terminal; And The apparatus for controlling an e-meeting shared screen includes monitoring a newly created window and selectively hiding the newly created window. The method of claim 10, The electronic meeting shared screen control method of the electronic meeting shared screen control method, characterized in that for hiding at least one of a toolbar or a user interface provided by the electronic meeting. The method of claim 10, Hidden setting target received from the user, The method of controlling a shared meeting screen, characterized in that one of a specific window, a currently running application, or a window depending on an application to be executed later. The method of claim 12, Monitoring the newly created window and selectively hiding the newly created window; And monitoring a window generated by a currently running application or an application to be executed later received from a user, and hiding the generated window. The method of claim 10, The process of hiding the screen of the e-conferencing shared screen control target is set hidden, Method of controlling the shared meeting screen, characterized in that the hiding process by giving a transparent window property to the window for the hiding process. The method of claim 10, The process of hiding the screen of the e-conferencing shared screen control target is set hidden, If the graphic output corresponding to the window for the hiding process is requested, the method of controlling the shared meeting screen, characterized in that to perform the hiding process by blocking the graphic output. The method according to any one of claims 10 to 15, And receiving a command to be delivered to a hidden processed object from another e-meeting terminal other than the self, and ignoring the command. The method according to any one of claims 10 to 15, If the e-conferencing terminal other than the self has a remote control right, controlling the e-conferencing shared screen further comprises the step of hiding the hidden object on the screen on the e-meeting shared screen processing apparatus. The method of claim 17, And when the remote control right is recovered from the other e-meeting terminal, controlling the hidden subject to be output to a screen on the e-meeting shared screen processing apparatus.

Images