TWI636691B - Method of switching videoconference signals and the related videoconference system - Google Patents

Abstract

The invention discloses a video picture intelligent switching method and a system thereof. First, start the video screen intelligent switching system, including shooting the conference room video and playing digital presentation. Then, start the video conference connection command, so that the system chooses to output the conference room audio and video. Thereafter, the briefing share instruction is initiated to cause the system to select to output a digital presentation. When the real-time status of the digital presentation changes, the video screen intelligent switching system automatically selects and outputs the digital presentation. When the real-time status of the digital briefing has not changed after the preset time, the video screen intelligent switching system automatically selects and outputs the conference room video and audio. The invention automatically and instantly switches the video and audio screen according to the briefing playing state of the system, thereby ensuring the continuity and correctness of the video conference.

Description

Video picture intelligent switching method and system thereof

The present invention relates to a video conferencing system, and more particularly to a video image intelligent switching method and system thereof for automatically performing signal source switching discrimination.

Video technology enables long-distance transmission of voice, video, data and other signals together. The video conferencing system consists of a multipoint control unit (MCU) and terminal equipment. Each terminal device corresponds to a conference room, wherein the terminal device of the conference room where the speaker is located has a video capture and transmission function, can capture the sound and image of the speaker conference room, and encodes the code to the multi-end controller. The multi-end controller processes the sound and the image, such as sound mixing, image forwarding or forming a multi-picture, and sends the processed sound and image to other terminal devices, and the other terminal device decodes and outputs the sound of the speaker's conference room and Image for remote communication.

The general video conferencing system often uses the H.323 protocol, and the H.323 protocol contains the H.239 protocol. Among them, the H.323 communication protocol is a communication protocol for mutually transmitting video and audio and video, and the H.239 communication protocol is a communication protocol for mutually transmitting the content of the presentation. That is to say, the general video conferencing system has the function of transmitting video and video and audio and video content.

However, sometimes due to limitations of devices or videoconferencing protocols, video conferencing systems cannot simultaneously support multi-stream streams. For example, when the system's central processor is not efficient or the network transmission bandwidth is insufficient, the system cannot process the lens signal stream and the brief video signal stream instantaneously and simultaneously. In this case, the system can only send one of the lens signal stream and the brief video signal stream. When the speaker wants to share the presentation screen, the system replaces the original lens with the presentation content screen. Audio and video pictures. Conversely, if the system chooses to transmit the lens and video screen, the presentation content screen cannot be seen in the terminal conference room.

That is to say, sometimes in a video conference, the presentation content screen and the lens audio and video screen can only be transmitted one by one. The conventional method uses a manually operated controller for manual switching of the signal source. Specifically, in addition to the photographic lens, the computer that processes the briefing, the multi-terminal controller, and the network device, a speaker switching controller is additionally included in the speaker conference room. There is a button on the screen switching controller for manually switching the presentation content screen and the lens video screen. The speaker needs to transmit one of the two. For example, when the speaker wants to share the screen in the conference room, the conference control signal needs to be sent through the remote controller, and the MCU is requested to send the video and audio of the conference room. After receiving the control signal sent by the controller, the MCU will take the conference room lens. The audio and video signals are forwarded to other terminal devices, thus completing a screen switch.

Therefore, when the speaker is conducting a video conference, it is necessary to pay attention to the presentation of the transmitted lens screen, and then use the manual operation controller to switch the presentation content screen output, which is inconvenient to use. Conventional manual operation controller switching methods are prone to distraction or stagnation of the speaker, or the attendees miss the important information of the conference due to the wrong switching.

In order to ensure the continuity of the video conference and to switch the video and audio images in real time, the embodiment of the invention provides a method and system for intelligently switching video images.

According to the above object, a method for intelligently switching video pictures is as follows. Firstly, the video screen intelligent switching system is activated, including a shooting module for shooting the conference room audio and a presentation playing module for playing the digital presentation. Then, the video conference connection command is started, so that the video screen intelligent switching system selects and outputs the conference room video and audio. Thereafter, the briefing sharing instruction is started, so that the video screen intelligent switching system selects and outputs the digital briefing. When the real-time status of the digital presentation changes, the video screen intelligent switching system automatically selects and outputs the digital presentation. When the real-time status of the digital briefing has not changed after the preset time, the video screen intelligent switching system automatically selects and outputs the conference room video and audio.

According to the above object, the present invention provides an intelligent switching of video images. The system includes a photography module, a presentation playing module, a briefing recognition module and an output control module. The photography module is used to capture the conference room audio and video. The presentation play module is used to play digital presentations. The briefing recognition module is used to detect the immediate status of the digital presentation. The output control module is used to select one of the output conference room video and the output digital presentation. When the briefing recognition module detects that the real-time status of the digital briefing changes, the briefing identification module transmits the output briefing signal to the output control module, so that the output control module selects and outputs the digital briefing. When the instant messaging module detects that the instant state of the digital briefing has not changed after the preset time, the briefing identification module transmits and outputs the output photography signal to the output control module, so that the output control module selects and outputs the conference room video and audio.

By detecting the real-time status of the digital presentation, when the digital presentation is used, the video transmission screen can be automatically switched to the digital presentation without the need for the operator to perform the manual operation without the need for the operator's additional instructions. In addition, when the digital presentation is idle for a preset period of time, the system will automatically switch the video transmission screen to the conference room audio and video, which ensures the continuity of the video conference, and can instantly switch the video and audio images to enhance the information sharing in the video conference. The correctness.

100‧‧‧Video Screen Intelligent Switching System

102‧‧‧ meeting room audio and video

104‧‧‧Digital Newsletter

106‧‧‧ Speakers

110‧‧‧Photography module

120‧‧‧ Briefing Playback Module

130‧‧‧ Briefing Identification Module

132‧‧‧ Briefing Screen Detection Unit

134‧‧‧ Briefing operation detection unit

136‧‧‧ Brief report output detection unit

140‧‧‧Output control module

150‧‧‧Voice recognition module

152‧‧‧Voice Acceptance Unit

160‧‧‧Action Identification Module

162‧‧‧Action receiving unit

210~250‧‧‧Steps

1 is a schematic diagram showing a module of a video screen intelligent switching system according to a first embodiment of the present invention; and FIG. 2 is a schematic diagram showing the operation of the video screen intelligent switching system according to the first embodiment of the present invention; and FIG. 3 to FIG. A flow chart showing a method for intelligently switching video pictures of the first to fourth embodiments of the present invention.

The advantages and spirit of the present invention will be further understood from the following detailed description of the invention. The structure and use of the preferred embodiment of the present invention are described in detail below. It must be understood that the present invention provides a number of applicable innovative concepts that can be widely implemented under specific background art. This particular embodiment is shown by way of example only, and is not intended to limit the scope of the invention.

1 is a block diagram showing a video screen intelligent switching system 100 according to a first embodiment of the present invention; and FIG. 2 is a schematic diagram showing the operation of the video screen intelligent switching system 100 according to the first embodiment of the present invention. As shown in FIG. 1 , the video screen intelligent switching system 100 includes a camera module 110 , a presentation module 120 , a briefing module 130 , an output control module 140 , a voice recognition module 150 , and a motion recognition module 160 .

As shown in FIGS. 1 and 2, the photographing module 110 is used to photograph the conference room video 102. The conference room video 102 includes a conference room video signal and a conference room voice signal, such as the image and voice of the speaker 106, or an image including the speaker 106 video and the blackboard or the whiteboard. The photography module 110 can include a voice accepting unit 152 and an action receiving unit 162, for example, including a set of microphones and a set of video lenses. The voice accepting unit 152 is configured to receive the speaker 106 voice signal, and the action receiving unit 162 is configured to receive the speaker 106 motion signal.

The presentation play module 120 is, for example, an application for a notebook computer for playing a digital presentation 104. The instant status of the digital presentation 104 during playback may include an instant presentation screen, a presentation operation input command, and a presentation output audio. The briefing operation input command may include a keyboard operation signal, a mouse operation signal or a touchpad operation signal. The output control module 140 is configured to select one of the output conference room video 102 and the output digital presentation 104, such as an MCU.

The briefing recognition module 130 is configured to detect the immediate state of the digital presentation 104 during playback. For example, the briefing module 130 can include a briefing screen detecting unit 132, a briefing operation detecting unit 134, and a briefing output detecting unit 136 for detecting whether the real-time status of the digital presentation 104 is changed. . When the video screen intelligent switching system 100 detects that there is a change in the instant briefing screen, or detects a briefing operation input command or a briefing output audio, it is determined that the instantaneous state has changed.

Specifically, when the briefing screen detecting unit 132 detects that the instant briefing screen has changed, or when the briefing operation detecting unit 134 detects the briefing operation input instruction, or when the briefing output detecting unit 136 detects the briefing output. During the audio, the briefing recognition module 130 determines that the real-time status changes, and the briefing recognition module 130 transmits the output briefing signal to the output control module 140, thereby causing the output control module 140 to switch the video sharing screen to the digital presentation 104. For example, when the speaker 106 or other user When the notebook keyboard is pressed, the computer mouse is moved, the mouse button is pressed, or the touch panel is operated, the output control module 140 switches the sharing screen to the digital presentation 104. That is, when the briefing recognition module 130 detects that there is a change in the real-time status of the digital presentation 104, the output control module 140 selects to output the digital presentation 104.

On the other hand, when the briefing recognition module 130 detects that the instant state of the digital briefing 104 has not changed for a preset time, the briefing recognition module 130 transmits and outputs the output photography signal to the output control module 140, so that the output control module 140 selects the output conference. Room audio 102.

Accordingly, the briefing recognition module 130 and the output control module 140 of the present invention can automatically and instantly switch the video and audio images according to the briefing playing state, thereby ensuring the continuity and correctness of the video conferencing.

In addition to automatically switching the video screen by the system, the present invention can also switch the video screen according to the action of the speaker 106 or the voice command. The voice recognition module 150 is configured to determine whether the conference room voice signal is calling the digital presentation 104 or the conference room video 102. The voice recognition module 150 may pre-store several sets of switching preset commands, which may be pre-stored by the system or set by the user. For example, the "switching briefing" voice command is pre-stored to switch the video sharing screen to the digital presentation 104, and the "switching conference room" voice command is pre-stored to switch the video sharing screen to the conference room video 102.

During the video conference, the voice accepting unit 152 continuously receives the voice signal of the speaker 106. When the voice recognition module 150 determines that the conference room voice signal is calling the digital briefing 104, for example, the speaker 106 utters a "switching briefing" statement, voice. The recognition module 150 recognizes that the statement meets the pre-stored switching instruction, and then the voice recognition module 150 transmits the output summary signal to the output control module 140, so that the output control module 140 selects and outputs the digital presentation 104 to complete the video screen switching. . Similarly, when the voice recognition module 150 determines that the conference room voice signal is calling the conference room video 102, for example, the speaker 106 calls the "switch conference room" statement, and the camera module 110 receives the conference room voice signal and voice recognition. The module 150 recognizes that the statement conforms to the pre-stored switching command, and then the voice recognition module 150 transmits the output camera signal to the output control module 140, so that the output control module 140 selects and outputs the conference room video 102.

The action recognition module 160 is configured to determine whether the speaker 106 action signal is calling the digital presentation 104 or the conference room video 102. The set of switching preset commands may also be pre-stored in the motion recognition module 160. For example, the "clockwise circle" action command is pre-stored to switch the video sharing screen to the digital presentation 104, and the "counterclockwise circle" action command is pre-stored to switch the video sharing screen to the conference room video 102.

When the video conference is in progress, the action receiving unit 162 continuously receives the speaker 106 action signal. When the action recognition module 160 determines that the speaker 106 action signal is calling the digital briefing 104, for example, the speaker 106 uses the hand to draw a "clockwise circle". The action recognition module 160 recognizes that the action conforms to the pre-stored switching command, and then the action recognition module 160 transmits the output summary signal to the output control module 140, so that the output control module 140 selects and outputs the digital presentation 104, once completed. Video screen switching. Similarly, when the motion recognition module 160 determines that the speaker 106 motion signal is calling the conference room video 102, the output control module 140 selects and outputs the conference room video 102.

When the digital presentation 104 is turned off, the output control module 140 only needs to output the conference room video 102. The video screen intelligent switching system 100 does not need to select the output digital presentation 104, so the detection of the briefing identification module 130 can be turned off, and the system is reduced. The amount of work.

Accordingly, the video picture intelligent switching system 100 of the present invention can automatically and instantly switch the video and audio pictures according to the presentation playing status, thereby ensuring the continuity and correctness of the video meeting. In addition, the present invention can switch the video screen according to the action or voice command of the speaker 106, so that the conference is smoother.

The video screen intelligent switching system 100 will be described below based on the aforementioned video screen intelligent switching system 100. FIG. 3 is a schematic flow chart showing a method for intelligently switching a video screen according to the first embodiment of the present invention, and please refer to FIG. 1 and FIG. 2 together. As shown in FIGS. 1 to 3, first, step 210 activates the aforementioned video screen intelligent switching system 100 for video conferencing. Next, step 212 initiates a video conference connection command. When connected, the camera module 110 continuously captures the conference room video 102, and the output control module 140 selects to output the conference room video 102.

Thereafter, step 214 initiates a briefing sharing instruction, at which point the presentation playing module 120 begins playing the digital presentation 104. As shown in step 220, the output control module 140 The continuous selection digital presentation 104 is selected, and the shared video screen is a digital presentation 104. As shown in step 222, after the briefing sharing instruction is initiated, the briefing recognition module 130 continuously detects whether the instant status of the digital presentation 104 has changed.

As shown in step 224, in the case where the video screen is the digital presentation 104, if the immediate status of the digital presentation 104 changes within a preset time, for example, within 3 minutes, the output control module 140 determines that the user is Use the newsletter. The output control module 140 decides to maintain the status quo, that is, continues to stay on the briefing screen and outputs the digital presentation 104. If the video screen is output as the digital presentation 104, the method repeats steps 220 and 222 for detection.

As shown in step 226, if the instant state of the digital presentation 104 has not changed for a predetermined period of time, for example, no change after 3 minutes, the output control module 140 automatically switches to output the conference room video 102. As shown in step 240, the output control module 140 continuously outputs the conference room video 102, and the shared video screen is the conference room video 102. As shown in step 242, after the video conference screen is switched to the conference room video 102, the briefing recognition module 130 continues to detect the instant status of the digital presentation 104.

As shown in step 244, in the case where the video screen is the conference room video 102 (continued to step 242), if the instant state of the digital presentation 104 does not change, the output control module 140 maintains the output conference room video 102. That is, if the video screen output is the conference room video 102, the method repeats steps 240 and 242 for detection.

Returning to step 240 and step 242, if the video device is in the conference room video 102, if the real-time status of the digital presentation 104 changes, the output control module 140 determines that the user is using the briefing. As shown in step 246, the output control module 140 switches to output the digital presentation 104.

In the first embodiment, the switching of the video images is determined by the automatic detection of the briefing recognition module 130. In other embodiments, the present invention may also switch the video screen according to the action or voice command of the speaker 106. 4 and 5 are schematic flow charts showing a method for intelligently switching video images of the second and third embodiments of the present invention, and please refer to FIG. 1 and FIG. 2 together.

The second embodiment differs from the first embodiment in that the second embodiment There are three ways to switch the conference room video 102 to the digital presentation 104: the presentation identification module 130 detects, the speech recognition module 150 detects and the motion recognition module 160 detects. As shown in step 230 of FIG. 1 , FIG. 2 and FIG. 4 , when the speech recognition module 150 or the motion recognition module 160 detects that the speaker 106 is calling the digital presentation 104 by voice or motion, the control mode is output. The group 140 selects and outputs the corresponding digital presentation 104, and then repeats steps 220, 222 and 230 to perform the detection.

The difference between the third embodiment and the second embodiment is that the third embodiment can switch the conference room video 102 and the digital presentation 104 to each other by the aforementioned three methods. As shown in step 232 of FIG. 1 , FIG. 2 and FIG. 5 , when the speech recognition module 150 or the motion recognition module 160 detects that the speaker 106 is calling the conference room video 102 or the digital presentation 104, the output control is performed. The module 140 selects and outputs the corresponding conference room video 102 or digital presentation 104, and then repeats steps 220, 222, 230, and 232 to perform detection.

In the video conferencing of the present invention, the speaker 106 can also turn off the digital presentation 104. Figure 6 is a flow chart showing the method for intelligently switching the video screen according to the fourth embodiment of the present invention, and please refer to FIG. 1 and FIG. 2 together. As shown in step 250 of FIG. 6, when the digital presentation 104 is turned off, the output control module 140 only needs to output the conference room video 102, and the video screen intelligent switching system 100 does not need to select the output digital presentation 104, so the briefing can be closed. The detection of the identification module 130 reduces the workload of the system.

The techniques provided in the above embodiments can be implemented by various firmware, hardware devices, and software programs. The software program can be stored in a readable storage medium, such as a hard disk or a disc of a computer.

For example, the presentation play module 120 can be a computer application. The briefing recognition module 130, the output control module 140, the speech recognition module 150, the action receiving unit 162, and the motion recognition module 160 can be firmwares installed in the same computer. Alternatively, the video screen intelligent switching system 100 can be a set of independent hardware devices. The output video screen can be transmitted to the terminal display through a network device or other connection device, such as a projection device or a television in another conference room.

In summary, the video picture intelligent switching method and system thereof provided by the present invention can detect the real-time status of the digital presentation, and when the digital presentation is used, the central control system does not need to be operated manually without the need for additional instructions from the speaker. Will be able to The video transmission screen is automatically switched to the digital presentation. In addition, when the digital presentation is idle for a preset period of time, the system will automatically switch the video transmission screen to the conference room audio and video, which ensures the continuity of the video conference, and can instantly switch the video and audio images to enhance the information sharing in the video conference. Correctness.

The above is intended to be illustrative only and not limiting. Any equivalent modifications or alterations to the spirit and scope of the invention are intended to be included in the scope of the appended claims.

Claims (10)

A video picture intelligent switching method includes: starting a video picture intelligent switching system, the video picture intelligent switching system comprising: a photography module for capturing a conference room video; and a presentation playing module for playing a digital Briefing; launching a video conference connection command, so that the video screen intelligent switching system selects and outputs the conference room audio and video; starts a briefing sharing instruction, so that the video screen intelligent switching system selects and outputs the digital briefing; when the digital briefing is one of the instant When the state changes, the video screen intelligent switching system automatically selects and outputs the digital briefing; and when the instant state of the digital briefing has not changed for a preset time, the video screen intelligent switching system automatically selects and outputs the conference room audio and video. . The method of claim 1, wherein the instant state of the digital presentation comprises an instant briefing screen, a briefing operation input command or a briefing output audio, and the video screen intelligent switching system detects the instant briefing screen. When there is a change, or when the briefing operation input command or the briefing output audio is detected, it is determined that the instantaneous state has changed. A video screen intelligent switching system includes: a photography module for capturing a conference room video; a presentation playback module for playing a digital presentation; and a briefing recognition module for detecting one of the digital presentations And an output control module, configured to select one of outputting the conference room video and outputting the digital presentation; and when the briefing identification module detects that the real-time status of the digital presentation is changed, the briefing is recognized The module transmits an output briefing signal to the output control module, so that the output control module selects and outputs the digital briefing; and when the briefing identification module detects that the digital status of the digital briefing has not changed after a preset time The briefing recognition module transmits an output photography signal to the output control module, so that the output control module selects and outputs the conference room. Audio and video. The video screen intelligent switching system of claim 3, wherein the instant state of the digital presentation comprises an instant briefing screen, and the briefing recognition module comprises a briefing screen detecting unit for detecting the instant briefing Does the picture change? The video screen intelligent switching system of claim 3, wherein the instant state of the digital presentation comprises a briefing operation input command, and the briefing recognition module comprises a briefing operation detecting unit, the briefing operation detecting When the unit detects the instruction input instruction, it determines that the immediate status changes. The video screen intelligent switching system of claim 5, wherein the briefing operation input command comprises a keyboard operation signal, a mouse operation signal or a touchpad operation signal. The video screen intelligent switching system of claim 3, wherein the instant state of the digital presentation comprises a briefing output audio, and the briefing recognition module comprises a briefing output detecting unit, the briefing output detecting unit When the newsletter output audio is detected, it is determined that the instant state has changed. The video screen intelligent switching system of claim 3, wherein the conference room audio and video comprises a conference room voice signal, the video screen intelligent switching system further comprises: a voice recognition module, configured to determine the conference room voice The signal is calling the digital briefing or the conference room audio and video; when the voice recognition module determines that the conference room voice signal is calling the digital briefing, the output control module selects and outputs the digital briefing; and when the voice recognition The module determines that the conference room voice signal is to cause the output control module to select and output the conference room audio and video when calling the conference room audio and video. The video screen intelligent switching system according to claim 3, wherein the conference room audio and video includes a speaker motion signal, and the video screen intelligent switching system further includes: a motion recognition module, configured to determine the speaker motion The signal is calling the digital briefing or the conference room audio and video; When the motion recognition module determines that the speaker motion signal is calling the digital briefing, the output control module selects and outputs the digital briefing; and when the motion recognition module determines that the speaker motion signal is calling the conference In the room audio and video, the output control module selects and outputs the conference room audio and video. The video screen intelligent switching system of claim 3, wherein when the digital briefing is turned off, the output control module selects and outputs the conference room video and the detection of the briefing identification module is turned off.