TWI422227B - System and method for multimedia meeting - Google Patents

Description

Multimedia conference system and its service method

The present invention relates to a multimedia system, and more particularly to a multimedia conferencing system.

In large conferences, the audience behind the stage is often far from the speaker, and it is not easy to see the speaker's expression or hear the speech. Therefore, at the time of opening a large conference, multimedia devices such as a camera, a microphone, a large screen, and a speaker are usually required to assist the conference. The speaker uses the microphone to deliver a speech, and then the speaker expands the sound. Also, use the camera to shoot the speaker, and then project the image onto the big screen to facilitate viewing by people behind the stage.

However, when the speaker moves on the podium, it is often necessary to adjust the perspective of the camera to be able to actually capture the speaker. In addition to the performers, when a speaker asks a question, people in the audience usually see that they are not seen, which is quite inconvenient.

The invention provides a multimedia conference system and a service method thereof, which are convenient for shooting a speaker or a speaker in a conference.

The present invention provides a multimedia conference system including a microphone, an image capture unit, a control module, and a display device. The microphone is adapted to emit a first sound signal. The microphone has a first position detecting unit for detecting the position of the microphone and is adapted to emit a first position signal. The control module is adapted to receive the first position signal to drive the position of the image capturing unit toward the microphone to capture a first digital image by the first image capturing module. The display device is coupled to the image capturing unit to display the first digital image.

In an embodiment of the invention, the first image capturing module includes a face detecting unit for detecting a face contour in the first digital image, and the control module drives the first image capturing module. Adjust the image capture range so that the first digital image includes the face outline and the first microphone.

In an embodiment of the present invention, the multimedia conference system further includes a second microphone and a second image capturing module. The second microphone is adapted to emit a second sound signal, and the second microphone has a second position detecting unit for detecting the position of the second microphone and is adapted to emit a second position signal. The control module is adapted to receive the second position signal to drive the second image capturing module toward the second microphone to capture a second digital image by the second image capturing module. The control module determines whether the first microphone and the second microphone have a sound input control module. When the control module determines that the first microphone has a sound input, the display device displays the first image as a mother screen, and the control module determines the first When the microphone has no sound input and the second microphone has sound input, the display device displays the second digital image as the mother screen.

In an embodiment of the present invention, the multimedia conference system further includes a voice recognition module coupled to the control module and the display device to recognize the first voice signal as a text output to the display device.

In an embodiment of the invention, the multimedia conference system further includes a first wireless transmitter and a first wireless receiver. The first wireless transmitter is disposed on the first microphone and coupled to the first position detecting unit to transmit the first position signal and the first sound signal. The first wireless receiver is coupled to the control module, wherein the control module receives the first position signal and the first sound signal transmitted by the first wireless transmitter by the first wireless receiver.

The present invention further provides a multimedia conference service method, which is applicable to a multimedia conference system, and includes the following steps. First, a first position detecting unit detects the position of a first microphone and sends a first position signal. Then, according to the first position signal, a control module drives a position of the first image capturing module toward the first microphone. Then, the first image capturing module captures a first image. Thereafter, the first image is displayed by a display device.

In an embodiment of the present invention, the multimedia conference service method further includes the following steps. First, a face detection unit detects a face contour in the first digital image. Then, the control module receives the facial contour from the face detecting unit, and drives the first image capturing module of the image capturing unit to adjust the image capturing range thereof, so that the first digital image includes the facial contour and the first a microphone.

In an embodiment of the present invention, the multimedia conference service method further includes the following steps. First, a second position detecting unit detects the position of a second microphone and sends a second position signal. Then, according to the second position signal, the position of the second image capturing module facing the second microphone is driven by the control module. Then, the control module determines whether the first microphone and the second microphone have sound input. When the control module determines that the first microphone has a sound input, the display device displays the first image as a mother screen. When the control module determines that the first microphone has no sound input and the second microphone has sound input, the display device displays the second digital image as the mother screen.

In an embodiment of the present invention, the multimedia conference service method further includes the following steps. First, it is determined by the control module whether the first microphone is turned on. When the control module determines that the first microphone is not turned on, the first position detecting unit detects the position of the first microphone. When the control module determines that the first microphone is turned on, the first digital image is displayed by the display device.

In an embodiment of the present invention, the multimedia conference service method further includes recognizing a first audio signal of the first microphone as a text output to the display device by using a voice recognition module.

Based on the above, the first position detecting unit can obtain the position of the first microphone, and the first image capturing module faces the position of the first microphone by the control module. Therefore, during the movement of the user holding the first microphone, the first image capturing module can track the user directly, which is quite convenient. In addition, the present invention can also track the users holding the first microphone and the second microphone by using the first image capturing module and the second image capturing module respectively, and presenting them respectively on the mother-child screen. Therefore, the screen in which the user holding the first microphone and the second microphone interact can be effectively captured.

The above described features and advantages of the present invention will be more apparent from the following description.

FIG. 1A is a block diagram showing a multimedia conference system according to an embodiment of the present invention. Referring to FIG. 1A , the multimedia conference system 100 includes a first microphone 110 , a first image capture module 130 , a control module 140 , and a display device 150 . The first microphone 110 is for receiving sound. The first microphone 110 has a first position detecting unit 120 for detecting the position of the first microphone 110 and is adapted to emit a first position signal. In this embodiment, the first position detecting unit 120 is, for example, a gravity sensor (g-sensor) to sense the moving state of the first microphone 110.

The first image capturing module 130 is configured to capture a first digital image. In this embodiment, the first digital image may be a dynamic movie or a static photo. The control module 140 is coupled to the first position detecting unit 120 and the image capturing unit 130. The control module 140 is adapted to receive the first position signal from the first position detecting unit 120, and the control module 140 can also change the orientation of the first image capturing module 130. The display device 150 is coupled to the first image capturing module 130 to display the first digital image. Further, the first image capturing module 130, the control module 140, and the display device 150 can be integrated into a notebook computer (not shown), and the display device 150 can be a display, but not limited thereto.

FIG. 1B is a flowchart illustrating a multimedia conference service method according to an embodiment of the present invention. For convenience of description, the multimedia conference service method of FIG. 1B will be described below in conjunction with the multimedia conference system 100 of FIG. 1A. In one situation, the user can carry the notebook computer integrated with the first image capturing module 130, the control module 140 and the display device 150 to a conference occasion, and the notebook computer and the first microphone 110 A large screen (not shown) or a projector (not shown) for the conference occasion is connected.

Referring to FIG. 1A and FIG. 1B, the first step S110 is performed to detect the position of a first microphone 110 and issue a first position signal. At this time, a presenter can take the first microphone 110 to give a speech. Then, in step S120, a control module 140 drives a position of the first image capturing module 130 toward the first microphone 110 according to the first position signal. That is to say, the first image capturing module 130 is driven by the control module 140 to face the presenter. Then, in step S130, the first image capturing module 130 captures a first digital image. Then, in step S140, the first digital image is displayed by a display device 150. At this point, there will be a presenter's figure in the first digital image in the projector or on the big screen.

It is to be noted that, in the process of the presenter's speech, the control module 140 drives the first image capturing module 130 toward the first microphone according to the position information returned by the first position detecting unit 120. Therefore, regardless of the position where the presenter moves to the stage (not shown), the first image capturing module 130 can instantly capture the figure of the presenter.

2A is a block diagram showing a multimedia conference system according to another embodiment of the present invention. Referring to FIG. 1A and FIG. 2A, the multimedia conference system 200 is similar to the multimedia conference system 100, and similar components will not be described again. The multimedia conference system 200 includes a first microphone 210, a first image capturing module D1, a first wireless transmitter T1, a first wireless receiver R1, a second microphone 240, and a second image capturing module. Group D2, a second wireless transmitter T2, a second wireless receiver R2, a control module C, a voice recognition module 260, a face detection unit 270, a display device 280, a three-dimensional axis A and A drive motor M. In this embodiment, the first image capturing module D1, the first wireless receiver R1, the second position detecting unit 250, the second image capturing module D2, the second wireless receiver R2, and the control module C The speech recognition module 260, the face detection unit 270, and the display device 280 can be integrated into a notebook computer (not shown), but not limited thereto.

The second microphone 240 is adapted to emit a second sound signal, and has a second position detecting unit 250 for detecting the position of the second microphone 240 and for transmitting a second position signal. The second image capturing module D2 is coupled to the control module C for capturing a second digital image. The control module C receives the position of the second microphone 240 from the second position detecting unit 250 to drive the position of the second image capturing module D2 toward the second microphone 240 to be used by the second image capturing module D2. Take a second digital image.

In this embodiment, the driving motor M can drive the first capturing unit D1 and the second image capturing module D2 to rotate 360 degrees by the three-dimensional rotating shaft A. The control module C is coupled to the first microphone 210 and the second microphone 240 to determine whether the first microphone 210 and the second microphone 240 have sound input. The display device 280 is coupled to the second image capturing module D2 and the control module C.

Further, the first wireless transmitter T1 and the second wireless transmitter T2 are respectively disposed on the first microphone 210 and the second microphone 240, and are respectively coupled to the first position detecting unit 220 and the second position detecting unit 250. To transmit the position signals of the first microphone 210 and the second microphone 240. The first wireless receiver R1 and the second wireless receiver R2 are coupled to the control module C. The control module C receives the position signal of the first microphone 210 transmitted by the first wireless transmitter T1 by the first wireless receiver R1. And receiving, by the second wireless receiver R2, the position signal of the second microphone 240 transmitted by the second wireless transmitter T2.

In addition, the voice recognition module 260 is coupled to the first microphone 210 , the second microphone 240 , and the display device to recognize the sounds of the first microphone 210 and the second microphone 240 as text output to the display device 280 . The face detection unit 270 is coupled to the first image capturing module D1, the second image capturing module D2, and the control module C to detect a facial contour in the first digital image and the second digital image. . The control module C receives the facial contour from the facial detection unit to drive the first image capturing module D1 and the second image capturing module D2 toward the facial contour.

FIG. 2B is a flowchart illustrating a multimedia conference service method according to another embodiment of the present invention. For convenience of description, the multimedia conference service method of FIG. 2B will be described below in conjunction with the multimedia conference system 200 of FIG. 2A. Referring to FIG. 1A and FIG. 1B, step S202 is first performed. A first position detecting unit 220 detects the position of a first microphone 210 and sends a first position signal. Then, in step S204, the control module C determines whether the first microphone 210 is turned on. If yes, proceed to step S206, and the control module C determines whether the second microphone 210 is turned on. When the control module C determines that the first microphone 210 is turned on and the second microphone 240 is not turned on, step S208 is performed, and a first image capturing module D1 is driven to the first by a control module C according to the first position signal. The location of the microphone 210. Then, in step S210, a first digital image is captured by the first image capturing module D1. For example, when starting a large conference, the presenter can place the notebook on the table and let the first image capturing module D1 move with the position of the first microphone 210 of the presenter to shoot the presenter. .

Then, in step S212, a face detection unit 270 detects a face contour in the first digital image. Then, in step S214, the control module C receives the facial contour from the face detecting unit 270, and drives the first image capturing module D1 to adjust the image capturing range thereof, so that the first digital image includes the facial contour. And a first microphone 210. Then, in step S216, the first digital image is displayed by a display device 280. Then, in step S218, the voice of the first microphone 210 is recognized as a character output to the display device 280 by a voice recognition module 260. That is, in the process of moving and shooting the first image capturing module D1 along with the position of the first microphone 210 of the presenter, the face detecting unit 270 can use the face detecting unit 270 to clearly capture the image and transmit the image through the display. Device 280 is transmitted to the projector. In addition, the sound collected by the first microphone 210 can also be converted into text by the voice recognition module 260, and projected on a large screen.

In contrast, when the control module C determines that the first microphone 210 is turned on and the second microphone 240 is also turned on, step S220 is performed, and the first image capturing module D2 is driven by the control module C according to the second position signal. The position of the second microphone 240. Then, in step S222, a second digital image is captured by the second image capturing module D2. That is to say, when someone raises a hand to speak, the second image capturing module D2 is activated, and the position of the XYZ axis of the second microphone 240 of the speaker is detected by wireless to find the speaker. At this time, the face detection unit 270 can also actually capture the image of the speaker and transmit the image to the projector through the display device 280. In addition, the sound collected by the second microphone 240 is synchronously converted into characters by the voice recognition module 260, and projected on a large screen.

Then, in step S224, a control module C determines whether the first microphone 210 and the second microphone 240 have voice input. When the control module C determines that the first microphone 210 has a voice input, the process proceeds to step S226, and the display device 280 displays the first digital image as the mother screen. In contrast, when the control module C determines that the first microphone 210 has no sound input and the second microphone 240 has sound input, the process proceeds to step S228, and the display device 280 displays the second digital image as the parent screen. For example, when someone asks a question, that is, when the speaker's second microphone 240 is activated, the projected picture is switched to the mother-and-mother picture. When the first microphone 210 of the presenter has an audio input, the image of the presenter is set as the mother picture, and the questioner is the child picture. On the contrary, the picture is adjusted to each other.

In summary, the first position detecting unit can obtain the position of the first microphone, and the first image capturing module faces the position of the first microphone by the control module. Therefore, during the movement of the presenter holding the first microphone, the first image capturing module can track the presenter in real time, which is quite convenient. In addition, the first image capturing module and the second image capturing module respectively can track the presenter holding the first microphone and the questioner holding the second microphone, respectively, and present the presenter and the parent and child respectively. Questioner. Therefore, the interaction between the presenter and the questioner can be effectively captured. In addition, by detecting the presenter and the speaker in the first digital image and the second digital image by the face detecting unit, the audience in the meeting can clearly see the expressions of the presenter and the speaker. In addition, the speaker's speech and the speaker's question can be converted into text by the voice recognition module, and projected on the big screen, so that everyone can understand the content of the speaker's question and answer.

Although the present invention has been disclosed in the above embodiments, it is not intended to limit the invention, and any one of ordinary skill in the art can make some modifications and refinements without departing from the spirit and scope of the invention. The scope of the invention is defined by the scope of the appended claims.

100. . . Multimedia conference system

110, 210. . . First microphone

120, 220. . . First position detecting unit

130, D1. . . First image capture module

140, C. . . Control module

150, 280. . . Display device

200. . . Multimedia conference system

240. . . Second microphone

250. . . Second position detecting unit

260. . . Speech recognition module

270. . . Face detection unit

A. . . Three-dimensional shaft

D2. . . Second image capture module

M. . . Drive motor

T1. . . First wireless transmitter

T2. . . Second wireless transmitter

R1. . . First wireless receiver

R2. . . Second wireless receiver

S110~S140, S202~S228. . . step

FIG. 1A is a block diagram showing a multimedia conference system according to an embodiment of the present invention.

FIG. 1B is a flowchart illustrating a multimedia conference service method according to an embodiment of the present invention.

2A is a block diagram showing a multimedia conference system according to another embodiment of the present invention.

FIG. 2B is a flowchart illustrating a multimedia conference service method according to another embodiment of the present invention.

S110~S140. . . step

Claims (8)

A multimedia conference system includes: a first microphone adapted to emit a first audio signal, the first microphone having a first position detecting unit configured to detect a position of the first microphone and adapted to issue a a first position signal; a first image capturing module; a control module adapted to receive the first position signal to drive the position of the first image capturing module toward the first microphone The first image capture module captures a first digital image; a display device is coupled to the first image capture module to display the first digital image; and a voice recognition module coupled to the The control module and the display device output the first audio signal as text to the display device. The multimedia video conferencing system of claim 1, wherein the first image capturing module comprises a face detecting unit for detecting a face contour in the first digital image, and the control module The group drives the first image capturing module to adjust an image capturing range thereof, so that the first digital image includes the facial contour and the first microphone. The multimedia conference system of claim 1, further comprising: a second microphone adapted to emit a second audio signal, the second microphone having a second position detecting unit to detect the second a position of the microphone and adapted to emit a second position signal; and a second image capturing module, wherein the control module is adapted to receive the The second position signal is used to drive the second image capturing module toward the second microphone to capture a second digital image by the second image capturing module, wherein the control module is suitable for determining Whether the first microphone and the second microphone have a sound input control module, and when the control module determines that the first microphone has a sound input, the display device displays the first digital image as a mother screen, when the control module When the group determines that the first microphone has no sound input and the second microphone has sound input, the display device displays the second image as a mother screen. The multimedia conference system of claim 1, further comprising: a first wireless transmitter configured to be coupled to the first microphone and coupled to the first position detecting unit to transmit the first position signal and And the first wireless receiver is coupled to the control module, wherein the control module receives the first position signal transmitted by the first wireless transmitter by the first wireless receiver With the first sound signal. A multimedia conference service method, applicable to a multimedia conference system, comprising: detecting a position of a first microphone by a first position detecting unit and issuing a first position signal; and according to the first position signal, by using a The control module drives a position of the first image capturing module toward the first microphone; and the first image capturing module captures a first digital image; The first digital image is displayed by a display device; and a first audio signal of the first microphone is recognized as a text output to the display device by a voice recognition module. The multimedia conference service method of claim 5, further comprising: detecting, by a face detection unit, a face contour in the first digital image; and using the control module from the face The image detecting unit receives the contour of the face to drive the first image capturing module of the image capturing unit to adjust the image capturing range, so that the first digital image includes the facial contour and the first microphone. The multimedia conference service method of claim 5, further comprising: detecting, by a second position detecting unit, a position of the second microphone and transmitting a second position signal; according to the second position signal, The control module drives a position of the second image capturing module toward the second microphone; and the control module determines whether the first microphone and the second microphone have voice input; when the control module determines When the first microphone has sound input, the display device displays the first digital image as a mother screen; and when the control module determines that the first microphone has no sound input and the second microphone has sound input, the display device The second image is displayed as a mother screen. The multimedia conference service method of claim 5, further comprising: determining, by the control module, whether the first microphone is turned on; and when the control module determines that the first microphone is not turned on, a position detecting unit detects a position of the first microphone; and when the control module determines that the first microphone is turned on, displaying the first digital image by the display device.