KR20090104655A - Method and Apparatus of Presentation Application Control for Multipoint Conference System - Google Patents

Abstract

PURPOSE: A presentation application control method for multilateral video conference system and an apparatus thereof are provided to improve the convenience on a screen of a presentation application while recording a screen. CONSTITUTION: A presentation application control method is as follows on a multilateral electronic conference screen. A presentation application control device inputs a command for controlling the throughout presentation application by a presentation process module(120). The presentation application control device delivers the presentation application and produces the event corresponding to the inputted function. The presentation application is transmitted and synchronized to the participant.

Description

Method and apparatus for controlling presentation application for multi-party e-conferencing system {Method and Apparatus of Presentation Application Control for Multipoint Conference System}

The present invention relates to a method and an apparatus for controlling a presentation application for a multi-party electronic conference system. More particularly, the present invention relates to a screen sharing service of a multi-party electronic conference system. Activate the function detected in the toolbar and menu of the conference system, and upon receiving the activated function from the user, generate a keyboard and mouse event corresponding to the function to the presentation application, and display the page of the presentation application. The present invention relates to a control apparatus and a method for automatically switching back to a writing state after synchronizing the presenter's screen to other participants until the screen transition or animation progress is completed.

With the development of a documentless conference culture, more and more people are using their PCs to make presentations, and presentation applications such as Microsoft's Powerpoint have become a popular and universal means of presentation. It is used with various presentation applications for presentations in various electronic conferencing solutions, screen sharing, and writing monitors.

Screen sharing of e-conferencing solution is emerging as a convenient presentation method by transmitting presenter's PC screen to specific and multiple conference participants without the need for presenters to upload documents. .

The edition is a very useful service mode for the user to write additional figures, lines and texts on the presentation screen to provide additional explanations of the data. The general implementation of the writing works using Microsoft's Powerpoint as an example. When Microsoft Powerpoint is in full screen, the screen displayed is the top-level window that appears before the other windows. When writing mode is executed, the last screen contents are remembered, and the writing window is activated at the top of the power point to display the stored contents as if the actual PowerPoint actual screen is displayed. In this state, it is a general writing system to write down the various lines, figures, and writings provided by the writing.

The use of writing in an e-meeting can usually take three forms: a whiteboard sharing method that writes on a blank screen, such as Paint in Microsoft Windows, and a presentation application that can process meeting material for presentation. There is document sharing, which is a method of embedding in conference program itself by using interface technology such as technology to process conference data or converting and sharing it into its own document format. Finally, a presentation application is shared and processed using screen sharing. There is a screen sharing method.

Since the writing function is very frequently used during a meeting, it is a generalized function that a document sharing writing function can switch to another page so that the writing can be continued after the page switching. Since screen sharing is not a sharing of page concepts, the related art does not provide such a function. Therefore, even if you are presenting a page concept screen such as a Powerpoint slide show during screen sharing, you cannot use the rewriting function after turning the page like the document sharing writing, so manually turn off the writing mode, turn the page, and finish the intermediate process such as animation. After confirming, it is necessary to select writing mode again, which is a hassle.

The present invention provides a presentation application in all solutions that support writing, such as screen sharing processing and writing on a similar type of writing monitor and screen recording for generating educational content for e-learning. It can be applied when you want to use it efficiently.

The present invention relates to a method and apparatus for controlling a presentation application for a multi-party electronic conference system, and more particularly, to execute a presentation application in a screen sharing service of a multi-party electronic conference system and use it with a writing. In the prior art, when the writing mode is not used, a keyboard and mouse event is generated to switch pages of the presentation application. However, during writing, the writing mode is manually released by the user and the pages are switched to animate. After confirming the completion, it solves the problem of having to switch back to writing mode directly and provides an improved control method to minimize the input from the user so that the meeting proceeds faster than the prior art and the user's mistakes are minimized. To have its purpose.

According to an aspect of the present invention, there is provided a method of controlling a presentation application during a screen sharing of a multi-party electronic conference, comprising: receiving a command for controlling a presentation application in an electronic conference writing mode; Generating, by the presentation application control device, an event corresponding to an input function and delivering the event to the presentation application; Synchronizing by transmitting a screen during the presentation application to other participants according to the event; And stopping the screen synchronization and returning to the writing mode when the operation of the presentation application according to the event is completed.

The generating of the event corresponding to the input function by the apparatus for controlling the presentation application and delivering the event to the presentation application may include delivering at least one of a keyboard event and a mouse event to the presentation application. .

The process of combining at least one of the keyboard event and the mouse event to the presentation application may include inputting the keyboard event or mouse event directly into a message queue of the presentation application or applying a global level to the entire window. It may be characterized by playing the event.

The apparatus for controlling a presentation application may further include detecting a screen display situation of the presentation application before receiving a command for controlling the presentation application.

The apparatus for controlling presentation application may further include selectively activating or deactivating an input button or a menu according to a detected screen display situation of the presentation application.

The apparatus for controlling a presentation application may receive a command for controlling a presentation application through at least one of the activated input button or a menu.

The detecting of the screen display situation of the presentation application may include detecting the screen display situation of the presentation application by inspecting at least one of class information or resource information of the presentation application window.

Completion of the operation of the presentation application according to the event is performed by performing screen capture at a predetermined time interval and comparing the previous capture screen with the captured screen after the predetermined time interval, and determining whether the two captured screens are the same. It can be characterized by.

Completion of the operation of the presentation application according to the event may be determined for a maximum time to be compared.

Completion of the presentation application operation according to the event may be determined using a resource information obtained by hooking a page change completion event or a presentation application using ActiveX.

According to another aspect of the present invention, an apparatus for controlling presentation application during a screen sharing of a multi-party electronic conference includes: a screen switching completion sensing module configured to determine whether the presentation application is completed; When a command for controlling the presentation application is received in the writing mode of the conference system, an event according to the input function is generated and transferred to the presentation application, and the screen switching completion detection module is performed. A writing processing module for controlling to return to writing mode again when detecting the completion of the operation of the presentation application; And a screen sharing transmission and synchronization module for transmitting and synchronizing the operation screen of the screen switched presentation application to other attendees.

The writing processing module may combine and transmit at least one of a keyboard event and a mouse event to the presentation application.

In this case, the writing processing module directly inputs a keyboard event or a mouse event into a message queue of the presentation application, or plays a global level event that can be applied to the entire window to convert the keyboard event or mouse event to the presentation application. It may be characterized in that the transmission.

The apparatus for controlling presentation application according to the present invention may further include a screen state detection module for detecting a screen display situation of the presentation application.

The screen state detection module may selectively activate or deactivate an input button or a menu according to a screen display situation of the detected presentation application.

The writing processing module may receive a command for controlling a presentation application through at least one of the activated input button or a menu.

Preferably, the screen state detection module may detect a screen display state of the presentation application by inspecting at least one of class information or resource information of the presentation application window.

The screen transition completion detection module executes screen capture at predetermined time intervals, compares a previous capture screen with a captured screen after the predetermined time interval, and the presentation application according to the event when the two screen contents are the same. It may be characterized by determining that the operation of is completed.

The screen change completion detection module may be configured to determine a maximum time to be compared and determine an operation completion of the presentation application.

The screen change completion detection module may use resource information obtained by hooking a page change completion event or the presentation application using ActiveX.

The present invention detects the screen display state of the currently running presentation in the screen sharing service of the multi-party electronic conference system to set the activation and deactivation to operate the corresponding function detected in the toolbar and menu of the conference system, and the user After inputting the activated function from the presenter or the corresponding control authority, the keyboard and mouse events corresponding to the function are randomly generated and delivered to the presentation application, and when the screen transition and animation progress of the application page are completed. By synchronizing the presenter's screen to other attendees and then automatically switching back to the writing state, it is faster than the prior art and minimizes a malfunction due to a user's mistake.

The present invention can be applied not only to the multi-party electronic conference system, but also to all the solutions that support writing on the screen of the presentation application while recording the screen for creating the writing content for the writing monitor and e-learning. .

Hereinafter, a method and an apparatus for controlling a presentation application for a multi-party electronic conference system according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram illustrating an apparatus for controlling a presentation application and a method thereof according to an embodiment of the present invention.

As shown in FIG. 1, the presentation application control device 100 includes a conference module 110, a writing processing module 120, a screen state detection module 130, a screen change completion detection module 140, a screen sharing transmission, and the like. It may be configured to include a synchronization module 150.

The conferencing module 110 corresponds to a component that controls the overall electronic conferencing system. In particular, it creates a user interface for conducting meetings and performs initialization of various other modules. The control operation of the conference module 110 will be described in more detail with reference to FIG. 2.

The key functions of the writing processing module 120 include a function of detecting a current screen state of a presentation application when it is in a writing mode, a function of causing a screen change such as a page to the corresponding application, and a function of detecting whether a screen switching is completed. In charge of

The screen state detection module 130 is called by the writing processing module 120 and performs a function of detecting a current screen state of a presentation application.

The screen change completion detection module 140 is a component that determines whether the screen change of the presentation application is completed.

Lastly, the screen sharing and synchronization module 150 transmits the presenter's screen to another electronic conference participant terminal to perform sharing and synchronization.

FIG. 2 is a diagram illustrating a specific operation process of the conference module shown in FIG. 1.

When the operation module 110 of the electronic conference application control apparatus 100 according to the present invention starts, the conference module 110 generates a user interface for conducting the electronic conference and performs an initialization operation (S201).

First, the meeting module 110 determines whether the presenter is sharing the screen through a command such as starting screen sharing (S202). If the screen sharing is not performed, the writing mode is not activated, so proceed to step S206 to proceed with other conference related processes.

If it is determined in step S202 that screen sharing is being performed, the conference module 110 checks whether the mode is changed to the writing mode (S203).

If the writing mode is released, the conference module 110 controls to perform a transmission and synchronization operation for screen sharing (S204). On the other hand, in the case of switching to the writing mode in step S203, the conference module 110 finally processes the writing on the background of the screen-transmitted and synchronized screen sharing process (S205).

In addition, after performing the process for proceeding with other meetings (S206), the conference module 110 determines whether the electronic conference system is terminated (S207).

If the electronic conferencing system is terminated, the conferencing module 110 ends its operation. On the other hand, if the electronic conference system is not terminated, the conference module 110 proceeds to step S202 and repeats steps S202 to S207.

As described above, writing is processed only when screen sharing is in progress, and writing mode is automatically released when screen sharing is stopped. If only writing mode is released, screen sharing transmission and synchronization are performed again. This progression continues until the conference system is terminated.

3 is a diagram illustrating a specific control operation of the writing processing module illustrated in FIG. 1.

First, the writing processing module 120 detects a current screen state of the electronic conference application (S301).

Here, automatically detecting the current screen state of the application means checking the type of the application and distinguishing whether the current screen is in the full screen state or the normal screen state.

In addition, the type of application means, for example, distinguishing whether the currently running application is Microsoft's Powerpoint or other third-party presentation solution. This is because each application has different operations of keyboard and mouse depending on the development company, and therefore requires separate processing.

This application detection is very useful because it can tell the user whether the function can work normally when providing the previous page, next page, start slide show, finish show, and so on.

When you want to know the state of the application, you can determine by checking the class information of the window and the resource information of the application, and can use an appropriate method according to the type of the application to support.

When the detection of the current application and its screen state is completed in step S301, the writing processing module 120 activates or deactivates an input button or a menu of a function according to the detection result (S302). By activating or deactivating the input button or menu, the user can be informed of the status of a function that can be input.

The writing processing module 120 determines whether a corresponding function is input through an input button or a menu activated by the user (S303).

If a function activated by the user is input, the writing processing module 120 switches the screen to the corresponding application in the writing mode. The easiest way is to randomly generate a keyboard or mouse event and deliver it to the application (S304).

You can choose to trigger an event by placing it directly in the application's message queue and playing a keyboard or mouse event at a global level that can be applied to the entire window.

Both methods can have their advantages and disadvantages. If you want to switch screens while covering the application with the writing pane, you will use the method of putting directly on the message queue.

If the writing pane is off, playing at the global level will be easier.However, in order for keyboard or mouse events at the global level to be properly delivered to the target application, the input application must have input focus set. In order for the mouse event to be delivered normally, the application must exist as the topmost window at the location of the mouse event. If you do not turn off the writing window, you do not want to show the process of the screen transition to the attendees. If you do so, the process of switching the screen is shown to the attendees.

Thereafter, the writing processing module 120 determines whether the screen switching of the corresponding application is completed using the screen switching completion detection module (S305). Until the application screen switching is completed, the screen sharing must be continuously transmitted and synchronized (S306). After the screen conversion is completed, the writing processing module 120 stops the screen sharing transmission and synchronization (S307) and proceeds to the writing state.

4 is a diagram illustrating a specific operation process of the screen state detection module shown in FIG. 1.

Since the screen state detection module 130 detects the state of the current screen, in order to initialize the previous state, the screen state detection module 130 first initializes the state detection variable (S401). The screen state detection module 130 determines whether the highest application among the running applications except the conference system is an application that supports screen switching in the conference system (S402).

If in step S402 the top application is an application that does not support screen switching in the conference system, the screen state detection module 130 immediately terminates the operation. On the other hand, if the top application supports the screen switching in the conference system in step S402 proceeds to step S403.

The screen state detection module 130 determines the type of the application, and determines whether the application is a powerpoint of Microsoft Corporation (S403). If the top-level application is a Microsoft Powerpoint, the screen state detection module 130 determines whether the full screen window is being executed (S405).

If the full screen window is being executed, the screen state detection module 130 may set to activate the show end, previous page, and next page functions (S406). If it is not running in the full screen window, the screen state detection module 130 activates to use the slide show function (S407).

If the application is not the powerpoint in step S403, the screen state detection module 130 sets the detection for the application (S408). Thereafter, the screen state detection module 130 controls to activate a possible function through the resource and window state of the corresponding application (S409).

FIG. 5 is a diagram illustrating a specific operation process of the screen change completion detection module shown in FIG. 1.

The screen change completion detection module 140 captures the application area and stores it as image 1 (S501).

Thereafter, the screen change completion detection module 140 waits for a predetermined time t (S502). After waiting for a predetermined time, the screen switching completion detecting module 140 captures the application area and stores the screen as an image 2 (S503).

The screen change completion detection module 140 determines whether the image 1 and the image 2 are different (S504). If the image 1 and the image 2 are not different, it is determined that the screen change is completed and the operation ends.

If image 1 and image 2 are different in step S504, it is determined that the screen is being switched, and image 1 is copied to image 2 (S505). Thereafter, it is determined whether the maximum check time for detecting the screen change completion has elapsed (S506).

If the maximum check time elapses, the screen phone completion detection module 140 ends the operation.

A universally available method for detecting the completion of an application's transition is to run a screen capture at regular intervals, compare the previous captured screen (image 1) with the current captured screen (image 2) How to check

If the screen contents are different, it can be determined that the screen is still changing. If you use this method, it is advisable to set a maximum time for comparison to avoid exceptions that may be misleading by other external factors.

In the case of Microsoft's Powerpoint, when it is controlled by ActiveX interface, it can receive events such as page transition completion. Receiving an event using the interface provided by the application or hooking the application and checking the resource information to detect the completion can be more quickly determined, but the hooking process of the application, etc. This has the disadvantage of complicated implementation.

FIG. 6 is a diagram illustrating a detailed process of the screen sharing transmission and synchronization module shown in FIG. 1.

In the multi-party electronic conference screen sharing system, the screen sharing transmission and synchronization module 150 captures the presenter's screen to achieve screen sharing transmission and synchronization (S601), and transmits the captured contents to all other attendees. (S602).

The screen sharing transmission and synchronization module 150 waits until all of the transmitted data is transferred and synchronized (S603).

Although the present invention has been described in detail through the representative embodiments, those skilled in the art to which the present invention pertains can make various modifications without departing from the scope of the present invention with respect to the embodiments described above. Will understand. Therefore, the scope of the present invention should not be limited to the described embodiments, but should be defined by the claims below and equivalents thereof.

1 is a block diagram of an apparatus for controlling a presentation application and a method thereof according to an embodiment of the present invention.

FIG. 2 is a diagram illustrating a specific operation process of the conference module shown in FIG. 1.

3 is a diagram illustrating a specific control operation of the writing processing module illustrated in FIG. 1.

4 is a diagram illustrating a specific operation process of the screen state detection module illustrated in FIG. 1.

5 is a view illustrating a specific operation process of the screen change completion detection module shown in FIG.

FIG. 6 illustrates a detailed process of the screen sharing transmission and synchronization module shown in FIG. 1.

<Description of the symbols for the main parts of the drawings>

100: presentation application control device

110: conference module

120: writing processing module

130: screen detection module

140: screen change complete detection module

150: screen sharing transmission and synchronization module

Claims (20)

In the method of controlling the presentation application when sharing the multi-party electronic conference screen, The presentation application control apparatus may include receiving a command for controlling a presentation application in an electronic conference writing mode; Generating, by the presentation application control device, an event corresponding to an input function and delivering the event to the presentation application; Synchronizing by transmitting a screen during the presentation application to other participants according to the event; And Stopping the screen synchronization and returning to the writing mode when the operation of the presentation application according to the event is completed. The method of claim 1, The generating of the event corresponding to the input function by the presentation application control device and delivering it to the presentation application, And transmitting at least one of a keyboard event and a mouse event to the presentation application. The method of claim 2, Delivering at least one of the keyboard event or the mouse event to the presentation application, And inputting the keyboard event or mouse event directly into the message queue of the presentation application or playing a global level event that can be applied to the entire window. The method of claim 1, The apparatus for controlling presentation application further comprising the step of detecting a screen display situation of the presentation application before receiving a command for controlling the presentation application. The method of claim 4, wherein The apparatus for controlling presentation application further comprising selectively activating or deactivating an input button or a menu according to a detected screen display situation of the presentation application. The method of claim 5, The presentation application control device, And a command for controlling a presentation application through at least one of the activated input button or a menu. The method according to any one of claims 4 to 6, Detecting the screen display situation of the presentation application, And detecting a screen display situation of the presentation application by inspecting at least one of class information and resource information of the presentation application window. The method of claim 1, Completion of the operation of the presentation application according to the event, And performing screen capture at predetermined time intervals and determining whether the previous capture screen is identical to the captured screen after the predetermined time interval. The method of claim 8, Completion of the operation of the presentation application according to the event, And determining for the maximum time to be compared. The method of claim 1, Completion of the presentation application operation according to the event, Method for controlling the presentation application, characterized in that by using the page conversion complete event using the ActiveX or the resource information obtained by hooking the presentation application (Hooking). A device for controlling a presentation application when sharing a multi-party electronic conference screen, A screen switching completion detection module determining whether the operation of the presentation application is completed; When a command for controlling the presentation application is received in the writing mode of the conference system, an event according to the input function is generated and transferred to the presentation application, and the screen switching completion detection module is performed. A writing processing module for controlling to return to writing mode again when detecting the completion of the operation of the presentation application; And And a screen sharing transmission and synchronization module configured to transmit and synchronize an operation screen of the screen-switched presentation application to other attendees. The method of claim 11, The writing processing module, And delivering at least one of a keyboard event and a mouse event to the presentation application. The method of claim 12, The writing processing module, The keyboard event or mouse event is delivered to the presentation application by directly inputting the keyboard event or mouse event to the message queue of the presentation application or by playing a global level event that can be applied to the entire window. Presentation application control device. The method of claim 11, And a screen state sensing module configured to detect a screen display situation of the presentation application. The method of claim 14, The screen state detection module, And selectively activate or deactivate an input button or a menu according to the detected screen display situation of the presentation application. The method of claim 15, The writing processing module, And a command for controlling a presentation application through at least one of the activated input button or a menu. The method according to any one of claims 14 to 16, The screen state detection module, And at least one of class information and resource information of the presentation application window to detect a screen display situation of the presentation application. The method of claim 11, The screen conversion completion detection module, The screen capture is executed at predetermined time intervals, and the previous captured screen is compared with the captured screen after the predetermined time interval. A presentation application control device. The method of claim 18, The screen conversion completion detection module, And determining a maximum time for comparison and determining the completion of the operation of the presentation application. The method of claim 11, The screen conversion completion detection module, And a page change completion event using an ActiveX or resource information obtained by hooking the presentation application.

Images