KR20110112686A - Video conference apparatus and method - Google Patents

Abstract

TECHNICAL FIELD The present invention relates to a videoconferencing apparatus and method, and more particularly, to a videoconferencing apparatus and method for displaying an optimal image according to videoconferencing and serving a realistic videoconferencing service. As described above, the present invention includes at least one microphone which is pre-installed for a video conference broadcast and receives a voice signal; At least one camera for capturing a conferencer close to a location where the microphone is installed; And assigning priorities of the cameras to the microphones to set microphone and camera environment information, and controlling a speaker to speak through the microphones to be captured by the cameras in consideration of the microphone environment setting. : Picture In Picture) In video mode, the video conferencing screen is processed so that the speakers can talk to each other.In the PIP screen mode, drag the camera icon on the screen to move it to a segmented area of a specific PIP. Provided is a videoconferencing apparatus and method comprising a broadcast device for displaying and transmitting a conference image captured by a camera corresponding to a camera icon.

Description

Video conferencing device and method {VIDEO CONFERENCE APPARATUS AND METHOD}

TECHNICAL FIELD The present invention relates to a videoconferencing apparatus and method, and more particularly, to a videoconferencing apparatus and method for displaying an optimal image according to videoconferencing and serving a realistic videoconferencing service.

In general, video conferencing devices are conventionally used in corporations or research institutes to allow multiple people to have a meeting while looking at each other's faces at the same time by using dedicated equipment for screen synthesis, separation, and compression transmission.

However, the conventional video conferencing device has a problem in that a lot of separate equipment is required for real-time relay in displaying the video of the conference. In addition, every time the speaker speaks through the microphone, moving the camera to the speaker side to accurately focus and taking a meeting video and moving the speaker to shoot the video, smooth screen processing becomes a problem. In addition, there was a problem leading to a broadcast accident if you can not shoot quickly.

SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and an object thereof is to provide a videoconferencing apparatus and method capable of displaying an optimal image according to videoconferencing and serving a realistic videoconferencing service.

Another object of the present invention is to provide a video conferencing apparatus and method for providing a smooth video conferencing relay service by assigning a priority to a camera for each conference, and taking a picture of a speaker in consideration of the assigned camera priority. In providing.

It is still another object of the present invention to provide a video conferencing apparatus and method for enabling a camera to operate when a speaker operates a microphone to capture an image of the speaker.

It is still another object of the present invention to provide a video conferencing apparatus and method for dividing a screen to serve as a picture in picture (PIP) screen, and configuring and serving a screen facing each other.

In accordance with an aspect of the present invention, a video conferencing device includes: at least one microphone that is pre-installed for a video conference broadcast and receives a voice signal; At least one camera for capturing a conferencer close to a location where the microphone is installed; And assigning priorities of the cameras to the microphones to set microphone and camera environment information, and controlling a speaker to speak through the microphones to be captured by the cameras in consideration of the microphone environment setting. : Picture In Picture) In video mode, the video conferencing screen is processed so that the speakers can talk to each other.In the PIP screen mode, drag the camera icon on the screen to move it to a segmented area of a specific PIP. And a broadcasting apparatus that displays and transmits a conference image captured by a camera corresponding to the camera icon.

Preferably, the broadcasting device includes: a keypad having a button for setting a broadcasting environment according to a video conference, and a button for transmitting a broadcasting screen according to microphone setting and a video conference; A memory for storing microphone and camera environment setting information by giving priority to the camera and storing setting information according to a broadcasting environment; In consideration of the priorities of the cameras and the microphone environment information, the corresponding camera assigned to the voice input microphone is controlled to process and display and transmit the video conference image captured. In the PIP screen mode, the speakers face each other and talk to each other. Control the video to be displayed by switching the image to be displayed, and when the camera icon is dragged on the screen to a segmented area of a specific PIP, the conference image captured by the camera corresponding to the camera icon dragged on the segmented area is displayed and transmitted. A control unit for controlling the control unit to perform the control; And display screen data according to a broadcasting environment and a video conference image captured by a camera under the control of the controller, display a broadcast screen to be broadcast and a broadcast screen to be transmitted, and display a camera preset viewer window to display the basic camera. It includes a display unit for displaying the setting screen to set the preset value and the microphone environment.

Preferably, when the voice is not input through the microphone for a predetermined time and the power of the microphone is turned off, the controller switches to a view screen and replaces with another video to transmit a video conference video.

Preferably, the control unit, when the voice between the predetermined voice loudspeaker is input through the microphone to set the voice size interval to drive the camera assigned to the microphone, after the voice is delivered to the microphone, after a predetermined time the camera reacts Set the microphone start time (Mic Start) to display the video, and maintain the predetermined time even if another microphone is operated, and then end the microphone (Mic End) to display the video of the camera assigned to the other microphone. Set the microphone environment by setting).

Preferably, the controller controls the operation to be performed on the transmission screen for inserting subtitles into the video conference image captured by the at least one camera, and stops for a while, and then continues the file without interruption. To record video conferences.

Preferably, the controller automatically displays the speaker's name on one side in response to the video of the speaker of the video conference.

According to another aspect of the present invention, there is provided a video conferencing method comprising: displaying a main screen divided into a picture in picture (PIP) setting window, a microphone setting window, and a camera setting window for video conferencing; Setting a camera and microphone configuration, assigning a camera and a microphone number, assigning a camera to the designated microphone, prioritizing cameras, and setting a microphone environment; Initiating a video conferencing broadcast to capture a speaker speaking through the microphone in consideration of the priority of the camera and the microphone configuration; And processing and displaying a video conferencing screen so that a speaker can face an image when a PIP screen mode is executed during the video conference broadcast. In the PIP screen mode, a camera icon is dragged on a screen to divide a specific PIP. When moving to the selected area, the conference image captured by the camera corresponding to the camera icon dragged on the divided area is displayed and transmitted.

Preferably, the capturing may include: determining whether the voice exists in a predetermined voice size section when the voice is input through the microphone; If it is determined that the voice does not exist in a predetermined voice size section, determining that the voice is coughing or whispering not driving the camera assigned to the microphone; And determining that the preset microphone start time has elapsed if the voice exists in a predetermined voice size section, and if the microphone start time has elapsed, controlling the camera assigned to the microphone to speak through the microphone. Imaging the speaker.

Preferably, when the voice is input to another microphone, the microphone assigned to the next speaker's microphone is operated after the microphone end time of the microphone being used by the speaker currently being photographed has elapsed. The method further includes photographing a speaker who speaks through the voice.

Preferably, the video of the conference, the name of the speaker is automatically displayed on one side and sent.

Preferably, the priority of the camera is used as an index to allow the speaker to photograph a speaker using a microphone having a higher priority of the camera when the speaker speaks using a microphone assigned to the same camera.

According to the above-mentioned problem solving means, the present invention enables the camera to automatically capture the speaker that the microphone operates by the voice tracking function, thereby enabling quick and natural pseudo-relay without the need to check the speaker's microphone during the meeting. It has the effect of making it work.

In addition, by using the automatic arrangement of the PIP screen to enable the speaker to switch to the screen facing each other, there is an effect that can provide a realistic video conference service.

In addition, by assigning camera priorities, each speaker can be assigned a priority and a lower priority camera, and each camera captures the speaker's video in consideration of the priority and the priority. It is effective in eliminating the uneven smooth screen development caused by image capturing and serving a smooth and smooth screen.

1 is an exemplary diagram for explaining a screen configuration of a video conference apparatus according to an embodiment of the present invention.
2 is an exemplary view for explaining a setting screen according to an embodiment of the present invention.
3 is an exemplary view for explaining a preset viewer window according to an embodiment of the present invention.
4 to 6 are exemplary views for explaining a process of setting the automatic camera position adjustment function according to an embodiment of the present invention.
7 is an exemplary view for explaining a process of setting a project list according to an embodiment of the present invention.
8 is an exemplary view for explaining a preset list setting process according to an embodiment of the present invention.
9 is an exemplary view for explaining a camera list setting process according to an embodiment of the present invention.
10 is an exemplary view for explaining a PIP screen automatic arrangement function according to an embodiment of the present invention.
11 is an exemplary diagram for explaining a preset setting procedure according to an embodiment of the present invention.
12 and 13 are exemplary views for explaining a position lock function according to an embodiment of the present invention.
14 is a block diagram of a video conference device according to an embodiment of the present invention.
15A and 15B are flowcharts illustrating a video conferencing method according to an embodiment of the present invention.

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings, with reference to the parts necessary for understanding the operation and operation according to the present invention.

In the following description, specific details of the videoconferencing apparatus and method of the present invention are presented to provide a more general understanding of the present invention. It is to be understood that the present invention may be readily implemented without these specific details and also by modification thereof. It will be apparent to those of ordinary skill in the art.

1 is an exemplary diagram for explaining a screen configuration of a video conference apparatus according to an embodiment of the present invention.

Referring to FIG. 1, ① is a preview window for each camera, and is a window for checking a situation currently held by the camera. That is, as an example, the camera 1 to 4 of the camera provided for video conferencing shows the situation of each camera to prepare for the current transmission in advance.

② is an external source preview window and shows the prepared external data source such as source video and image. That is, each source material is shown in advance so that external materials such as a promotional video, a picture, a background image, and a PowerPoint document can be transmitted. This setting will be described below.

③ is a transmission monitor window, which shows a video to be sent last. That is, the screen displayed on the display window of the receiving side as the broadcast screen is shown.

④ is automatic position adjustment, broadcast relay and recording control window, which supports automatic position adjustment and relay / encoding operation. That is, the screen transmitted by each camera can be checked in advance, and when the camera coordinate is converted, the screen coordinate can be modified. The screen coordinate correction function automatically adjusts the position by checking the center point automatically when clicking the center part displayed on the screen with the mouse. Detailed description thereof will be described later. In addition, the Broadcasting and Recording Control window allows you to check the status of the Internet's real-time relay and encoding, the status of the relay / recording, "OnAir" for live broadcast to the Internet, "Record" for live recording, and stop recording. It consists of a "Stop Rec" button.

At this time, if you click the "Record" button, recording will proceed and it will be changed to "Pause" button. The "Pause" button is used to pause or stop the meeting. Record. This eliminates the need for cumbersome additional editing, because you can continue recording to a single file rather than creating multiple files.

(5) is a title playback window, which supports simultaneous transmission of up to four titles. In other words, it checks the logo and subtitle to send and manages still caption required for each layer consisting of 1 to 4, and manages to easily find and send the desired caption in the caption transmission window. do. Here, the setting related to the caption with the detailed control will be described in detail below.

⑥ is an audio window that supports the microphone audio status of each channel. In other words, the level status of each microphone channel can be checked at a glance, and it is necessary to accurately set the microphone level standard value to maximize the use of the "Auto PIP" and "Auto Control" functions. Here, the level checking and setting method will be described in detail below.

⑦ is the PIP setting window, which is a window for automatic camera control adjustment by PIP setting and microphone level.

⑧ is a switcher function window, and it is a control window that can directly send a source. In other words, promotional videos, photos, background images, and external materials help to select and send data separated into layers 1-4. You can also set autorun and dissolve times. Each sub control will be described in detail later.

⑨ is a detailed control window, which allows the user to manage the transmission of the camera manually, the title, the background, and the moving image. That is, detailed control such as camera detail setting, caption management and production (caption / caption make), video management, image management, wallpaper management, and encoding detail setting can be set.

Such a screen configuration for video conferencing of the video conferencing device according to the present invention has an intuitive and concise structure so that it can be easily used, and unnecessary menus are thoroughly excluded and anyone can easily make a video conference while watching the screen.

Next, detailed settings of the video conference of the video conference apparatus will be described.

2 is an exemplary view for explaining a setting screen according to an embodiment of the present invention.

Referring to FIG. 2, a schematic overview of the setting screen of the present invention, reference numeral 21 is an area for setting input values related to a camera input and a microphone input.

Reference numeral 22 is an area indicating the input source of the current camera from camera 1 to camera 4.

Reference numeral 23 denotes an area for checking a transmission screen according to a preset value, and may be set to Pan / Tilt / Zome.

Reference numeral 24 is a region where color correction functions such as Brightness, Contrast, Hue, Saturation, Sharpness, and De-Interlace can be specified.

Reference numeral 25 is an area for setting a preset value so that the camera and microphone can be linked.

Looking specifically at such a setting screen, first, input value setting for camera input and microphone input of reference numeral 21 has five input terminals (four camera input terminals and one external VGA input terminal), and up to 48 Image coordinates can be specified. VGA input is optional here.

After selecting the input camera to be set, select the camera controller (Cam Controller), specify the port (Cam Serial Port) and camera communication speed (Cam Serial Baud) to which the camera is connected, and specify the camera address number (Cam Address Num). .

After that, the microphone number and the control method according to the microphone are specified. Up to 32 microphones (16 analogs) can be specified here.In case of the microphone control method, if the general microphone is used, the auto mode is set and batch automatic management is performed.

In addition, it specifies the port where the microphone is connected (Mic Serial Port) and the microphone's communication speed (Mic Serial Baud).

Thereafter, the user (broadcasting party) sets the preset value by operating the camera while looking at the preset viewer window as shown in FIG. 3. At this time, click “↑, ↓, ←, →” button on the number pad to move the camera up, down, left and right. Use “+,-” key to zoom in / zoom out. can do.

In addition, the camera can be moved by clicking the move icon 31 in the preset viewer window, and zoom in / zoom out by clicking zoom in / zoom out in the preset viewer window. Here, an icon may be provided to allow a user to quickly select a desired zoom by adjusting a change in zoom speed when zooming in and out. So, for example, as shown in FIG. 3, the small square zoom icon slowly changes the zoom, and the large square zoom icon changes the zoom faster than the small square.

This preset viewer window displays a Menu icon and a Select icon, and when the displayed Menu icon and Select icon are selected, the basic menu for the camera can be viewed and selected.

In addition, a Home icon for moving the camera to a basic position, a Reset icon for initializing the camera, and a Focus Far icon and Focus Near icon for focusing the camera may be provided.

On the other hand, as shown by reference numeral 24, the color correction of the broadcast screen serves to adjust the brightness, contrast, hue, saturation and sharpness respectively.

In addition, as shown by reference numeral 24, when monitoring " Start On " of monitoring is set for monitoring and de-interlace setting, an image is sent to an external output terminal. In this case, if you only want to send via internet server, you can disable "Start On".

Here, de-interlace means converting interlaced video into progressive video. Here, the interlace method means that when displaying one image, only half of the horizontal line is displayed in one image program in the case of a TV. The progressive method is a representative example of a progressive scan method such as a computer monitor or a digital TV such as a PDP or LCD. This method means displaying one frame in all horizontal lines at once.

At this time, you may want to send by selecting (Crop) only the desired portion while watching the image through the preset viewer window. To do this, click the "Crop On" button provided in the preset viewer window, and the image adjustment icon is displayed on the left and right sides of the preset viewer window so that it can be cropped and transmitted by zooming in / out the corresponding image to be cropped.

In addition, how to set the automatic camera position adjustment function is necessary for the following reasons.

The automatic camera position adjustment function according to the present invention is to move the camera movement pointer to a specific area and click when the image is displayed, so that a point corresponding to the specific area is moved to be the center of the camera screen to capture an image. In order to move the camera in response to the distance moved through the camera movement pointer, it is necessary to calculate the movement distance.

It will be described with reference to the accompanying drawings to help understand this.

4 is an exemplary view for explaining a process of setting an automatic camera position adjustment function according to an embodiment of the present invention.

Referring to FIG. 4, first, when the "Calibrate On" button is clicked, "+" is displayed in the center of the preset viewer window as shown in FIG.

The "+" mark is used to set the reference value by calculating the moving distance of the camera because the selected position can be changed according to the difference of the zoom in / out value.

Then, if there is a desired center value by looking at the preset viewer window, as shown in (b) of FIG. 4, first, the center value is moved to the "+" mark on the upper left side, and the calculated value for the left coordinate is recognized when the right mouse button is pressed. . Then, as shown in (c) of FIG. 4, when the center value is moved to the "+" mark on the upper right side and the right mouse button is clicked, the movement distance calculation is completed, thereby completing the automatic camera position adjustment function setting.

When the setting is completed by the above-described process, when the area (position) corresponding to the reference numeral "100" is selected by the mouse in the preset viewer window of FIG. 5A, FIG. 5 moves the selected area to the center of the screen. You can see the preset viewer window as in (b).

The automatic camera position adjustment function is also applied to the camera controller window of the main screen, and there are two ways to automatically adjust the camera position as follows.

That is, the point click method of adjusting the camera position around the specific area when the point is selected after moving the point to a specific area as shown in FIG. 6 (a), and dragging the point as shown in FIG. 6 (b). There may be a drag method of adjusting the camera position around a specific area corresponding to the position of the pointer to be finally moved.

The following is a detailed setup of each camera corresponding to reference numeral 25. It specifies basic coordinates and settings for each camera and microphone.

Then, as shown in FIG. 7, the project name is specified, the project can be easily described as a large category that can manage each of the specified presets, if you need to generate a different set value for each standing committee, 1 as the project name It can be divided into 1st standing position and 2nd standing position to manage each preset value individually.

In FIG. 7, the Add button stores the set value in the Project List, and the Del button is deleted from the Project List. The Modify button modifies the selected item in the project list, the Load button loads the desired project, and the MicReset button initializes the microphone values.

After creating the project, set the preset.

When setting the preset, it is divided into the setting screen of Cam / Mic and View. Cam / Mic is composed mainly of people because audio is output along with screen, and maps and stores information about Camera (designated camera) and Mic (designated microphone) in Preset List.

A view is a screen that is automatically transmitted when there is no conversation or when a meeting is not in progress. Since a microphone is not generally required, the view is displayed as a camera, a view, and a cam in the preset list.

Next, the Preset List is set. As shown in FIG. 8, each microphone and a camera position value and detailed information to be exposed are basically set. This is commonly referred to as preset setting.

In FIG. 8, a preset list is a menu for designating a name for corresponding camera information.

Mic Max and Mic Min are menus that allow Auto Pip or Auto Control to a certain amount of sound (db) of the microphone.The camera responds automatically to sudden loud or whispering sounds such as coughing or shouting. Set the maximum and minimum values to prevent this from happening. That is, the voice size section is set so that only the voice in the set voice size section can be recognized as the speaker's speech.

Mic Start is a menu to set whether the camera responds after a predetermined time (sec) after the sound is transmitted to the microphone to display an image. This can prevent the camera from reacting automatically in response to simple expressions or short answers rather than speech.

Mic End is a setting value for displaying a camera image assigned to another microphone after maintaining a predetermined time (sec) even when another microphone is operated. The Mic End is maintained by displaying an image captured by the camera for a predetermined time. This menu allows you to do this.

Auto Take is a menu to set the delay time of transmission, which is to be able to cope with broadcasting accident in advance.

Name Count is a menu to set the number of display of subtitles sent automatically.

Name Start is a menu for setting a time for displaying an automatic subtitle after a predetermined time (sec) after the microphone operation.

Name End is a menu for setting a time for displaying an automatic subtitle for a predetermined time (sec).

In addition, the Add button registers and saves the set values in the preset list, the Del button deletes the preset set in the preset list, and the Modify button modifies the preset set in the preset list.

On the other hand, the camera setting registers and sets the information of the object to be captured according to the unique information of the camera and the position of the camera.

9 is an exemplary diagram for explaining a process of setting a camera list according to an embodiment of the present invention.

Referring to FIG. 9, the camera list setting is a setting process required for video conferencing according to the present invention, and helps to designate a control priority of a camera and a screen to be displayed when a PIP screen is sent.

For example, if there is a person named 1 and a person named 2, and both of them have the camera 1 set as the default, after the person 1 is finished speaking, if the person 2 is spoken immediately, one camera moves. The screen development is not smooth because it catches 2 people.

In addition, when the PIP is transmitted, the PIP value needs to be set separately because it is often transmitted to a person rather than a general camera composition in the portrait mode.

Here, Main Camera is the function to specify the preset to show in full screen mode, and PiP Camera is the function to specify the preset to show in PIP screen mode.

AutoName is a function that automatically transmits subtitles when the preset is sent to the screen. When A comes out, A's name automatically appears.

Left, Center, and Right are sent out in back-to-back form rather than facing each other in the 1: 1 PIP screen mode, but sometimes awkward scenes are produced. If the right ball is visible, if it is designated as Right, the screen as shown in FIG. 10 (b) is finally displayed on the screen before the direction setting as shown in FIG.

At this time, 'M1' button in the control window should be activated to enable automatic setting. For reference, the 'M0' button transmits the image (before direction setting) as it is in the camera screen.

Here, Add performs the function of storing the set value in the camera list, Del performs the function of deleting the camera value from the camera list, and Modify performs the function of modifying the camera value in the camera list.

Action performs a function to move directly to the selected camera value in the camera list. It checks whether the coordinates are correct and applies the same when double-clicking on the camera list.

CamOn turns on the camera, CamOff turns off the camera, and Reset resets the camera's communication line (buffer).

Also, if the conference is not smooth, the screen can be automatically switched.If there is no audio sound for some time, the time when the entire screen is turned off in the foreground or when the entire microphone is turned off (Background Time) If you specify), there is a Select Mode that sends only the selected screen when it is converted to the View screen, and there is a Random Mode that shows the specified View screen randomly when it is switched to the View screen.

Next, referring to FIG. 11, a procedure for setting a preset is described. (1) A preset name (such as a doctor's name) is designated in a preset list of reference numeral '111'. Preset names should not exceed 4 characters. Then, press the Add button existing at '112' to save the preset name.

(2) After that, click the desired Cam at '113' and select the camera to grab the preset so that it appears in the main Preset Viewer window.

(3) Designate Cam Address Num (Camera Number) of '114'. Set Address 1 as Cam 1, Number 2 as Cam 2, and Number 3 as Cam 3. It is obvious that the camera number must be correctly specified to operate normally.

(4) Next, specify Preset Num, select and register the microphone corresponding to the preset (the microphone can be set from MIC 1 ~ 32), or select View if you want to set the foreground or special preset without microphone. Specify.

(5) Then, specify the microphone type corresponding to the preset in MIC Controller, and if you select the preset number as View, go to next.

(6) After that, save the set camera value by clicking 'Add' button to the left of the camera list at '115' and press 'Calibrate on' button at '116' to adjust the Preset Viewer window. After changing to, modify detailed position values such as left, right, up, down, zoom in / zoom out in the Preset Viewer window of '117'.

(7) Next, the position of the face of the person (for example, the view of the face) among the Left / Center / Right existing at the reference numeral '111' is designated.

(8) After that, select the Modify button on the left of the camera list at '118' to modify / save the changed camera value and the setting of one camera preset value is completed.

(9) Meanwhile, in the case of setting the PIP screen mode, PiP Camera is selected at '111' and the above-described steps (2) to (8) are performed.

(10) After that, set the value to '2' by operating the Camera Priority lever existing at the reference numeral '111', select the Main Camera, and then perform the procedure of (2) to (8) described above. Specifies the camera value.

(11) Then, set the value to '2' by operating the Camera Priority lever existing at the reference numeral '111', select the PIP camera, and then perform the procedure of the above (2) to (8) to perform the new PIP value. Specify.

(12) The above-described processes (1) to (11) are continuously repeated until all preset values are specified.

At least two main cameras and two PIP cameras are preferably assigned to one preset.

When all the settings are completed through this process, select the return button to go to the main screen.

Next, detailed control of the video conference will be described.

First, if the camera coordinates are set based on the preset list created in setup, you can check the preset list in the main screen control box.

Then, drag the desired camera onto the control screen and move the camera to the preset coordinate value. Click the right mouse button and the screen will be sent out immediately.

Next, let's take a look at Auto Control and Auto Name.

If the speaker is activated and the speaker speaks, the microphone status is checked and automatically controlled by the speaker's camera. Even if you do not check the speaker one by one, it is very easy to proceed with the doctor relay and can be configured as a split PIP screen.

If Auto Name is checked, subtitles corresponding to the speaker are automatically sent.

As shown in FIG. 12, when the position lock button is released, the control window can be freely configured in a desired shape, and the basic PIP position value can be freely arranged, and the screen size and the PIP size can be freely changed. Can be.

After selecting the PIP, drag the desired camera to the corresponding window and click the right mouse button, and the PIP is sent out immediately. 13 is attached to the drawings.

The PIP doesn't have to fill in the two preset positions, just fill in one and right-click on it.

On the other hand, all PIP screens can be freely moved and modified when the position lock is released. In this way, the default PIP screen can be used in various ways through the position lock function.

If you apply 1: 1 split PIP, you can adjust the mouse wheel part to make the dividing line clear or blur like gradation effect.

Next, let's take a look at the microphone control setting process. Microphone control has Auto and Fifo setting menu.

Auto can be set to Mic only when Auto mode is selected. Only the number of mics designated by Mic can be used. Other microphones can be used only when the mic is off.

Fifo can specify both Mic and Rts. Mic is the number of microphones in use and Rts is the microphone in standby mode. Only the microphone you are using works, not the standby microphone. When the microphone is turned off, the microphone will operate in the standby order. Here, when the microphone is in use, it is displayed in red when it is in red.

14 is a block diagram showing a video conference apparatus according to an embodiment of the present invention.

Referring to FIG. 14, the video conferencing device 100 according to the present invention includes a camera 50, a microphone 60, a broadcasting device 70, a speaker 80, and the like.

The camera 50 is installed in a specific area in advance to broadcast a video conference, and captures a subject under the control of the broadcasting device 70. In this case, the camera 50 is a camera that can adjust a position, and in order to smoothly broadcast, at least one camera 50 is provided at different positions, and it is preferable to capture different subjects.

The microphone 60 receives a voice signal and transmits it to the broadcast device 70. The microphone 60 is preferably provided in consideration of the number of participants.

The broadcasting device 70 integrates functions such as a subtitler, switcher and encoder necessary for a broadcasting service into one, and transmits a caption and title according to a real-time transmission screen. In addition, the broadcasting device 70 enables to preview the camera / video / CG / external source in real time, and services to set the broadcasting environment on the main screen. In addition, the broadcast device 60 can easily control the caption layer because the caption can be directly controlled on the transmission screen during the real-time video conference broadcast. In addition, the broadcaster 70 displays the image on the main screen so that the caption and title can be set together with the image captured by the at least one camera 50. Thus, the broadcasting device 70 sets the video conference broadcasting environment with the setting information desired by the user. In addition, when the position of the conference subject (subject) corresponding to the basic preset value of the camera and the basic preset value is changed, the broadcasting device 70 selects a position corresponding to the changed conference position by using the automatic position adjustment function. The camera 50 is moved corresponding to the selected position. In addition, when the speaker of the video conference has a predetermined number of people, the broadcasting device 70 switches the screen so that the mutual speakers face to face and talk with each other using the PIP function. In addition, when the voice input through the microphone 60 is greater than the predetermined voice size set by the preset setting process of the microphone 60, the broadcaster 70 causes the camera 50 to react to automatically capture the speaker. In addition, if another microphone is operating in the operating microphone, the broadcasting apparatus 70 may display a captured image of the image by operating a camera assigned to the other microphone after a preset Mic End time (eg, 2 sec). In addition, when the preset Auto Take time elapses, the broadcasting device 70 operates the camera to capture an image according to the operation of another speaker's microphone. In addition, the broadcaster 70 selects a PIP during a video conference, and drags a specific camera icon among preset camera icons on the screen to a PIP window, and the image captured by the camera is transmitted to the PIP screen. Be sure to

The speaker 80 outputs the processed voice from the broadcast device 70 for processing the voice signal input through the microphone as voice in an audible frequency band.

The broadcast device 70 described above includes a keypad 71, a memory 73, a control unit 75, a display unit 77, and the like.

First, the keypad 71 is provided with a button for setting a broadcast environment in accordance with a video conference and a button for transmitting a broadcast screen for a video conference. Here, the keypad 71 may include a function button and a setting button according to a video conference broadcast.

In the memory 73, reference position information (basic coordinate information) for each camera 50 is set and stored, and camera information that should be operated when the microphone is operated is mapped and stored. In addition, the memory 73 stores movement distance information for each camera 50. In addition, the memory 73 stores detailed setting information for the video and audio, such as an image color value and a microphone recognition value. In addition, the recording broadcast is stored in the memory 73. In addition, the memory 73 stores camera information allocated corresponding to a microphone for video conferencing, and microphone setting information and camera setting information according to a microphone environment are stored.

The controller 75 processes the video conference image captured by the camera 50 to be displayed through the display unit 77, and processes the audio signal input through the microphone 60 to be output through the speaker 80. In addition, the video and audio signals are encoded to control the overall operation of the video conference broadcasting service. In addition, the controller 75 controls to set a broadcast environment for an optimal video conference broadcast service in consideration of broadcast characteristics. In other words, it is possible to make detailed settings for video and audio such as basic coordinate setting, automatic position adjustment, image color, and microphone recognition value for the camera as a broadcasting environment. In addition, the controller 75 divides the screen configuration of the display unit 77 into functions so that the user can easily service the broadcast as described above, so that the user interface screen can be easily set and operated by the user. Configure to display.

In other words, main screen is divided into camera preview window, external source preview window, transmission monitor window, automatic position adjustment and broadcast control window, title playback window, audio window, PiP setting window, switcher, and detailed control window. Be sure to

In addition, the controller 75 controls the operation to be performed on the transmission screen for inserting subtitles into the video conference image captured by the at least one camera 50. In addition, the control unit 75 supports WMV and H.264 based codecs, and when the multi-encoding function is used, the control unit 75 simultaneously encodes the VOD file in high quality and low quality with real time video conference broadcasting. In addition, the control unit 75 stops for a short time during a video conference or a break in the field, and controls to continuously record the file again without interruption. In addition, since the control unit 75 supports the pause function, the controller 75 stops for a short time during a meeting or a break in the field, and then controls the file to be continuously recorded without interruption. In addition, the controller 75 checks whether the voice input through the microphone 60 is equal to or greater than a predetermined voice size, and controls the camera 50 to capture an image of the microphone 60 to which voice is input. .

In addition, in the 1: 1 PIP screen mode, the controller 75 controls to display left and right sides of the image so that the speakers face each other. In addition, the controller 75 selects the PIP and drags the camera icon to the PIP screen to display and transmit a video conference image captured by the camera of the camera icon that is dragged and moved to the divided area of the PIP. do.

The display unit 77 displays the screen data according to the broadcasting environment setting and the video conference image captured by the camera 50 under the control of the control unit 75, and displays the broadcast screen and the broadcast screen to be transmitted. In addition, the display unit 77 displays a camera preset viewer window and displays a captured image of the corresponding camera so that a basic preset value of the camera can be set. In addition, the display unit 77 displays a microphone environment setting screen so that the microphone environment can be set.

15A and 15B are flowcharts illustrating a video conference method according to an embodiment of the present invention. First, in order to implement the videoconferencing method according to the present invention, it will be described under the assumption that the position of the camera 50 and the position of the microphone 60 are preferentially set according to the videoconferencing environment.

Referring to FIGS. 15A and 15B, first, when a user starts a video conference service by operating a button of a video conference device, the video conference device 100 transmits a monitor window, a preview window for each camera, and automatically adjusts and broadcasts a camera position. A main screen divided into a control window, a subtitle and title playback window, an audio window, a PiP setting window, a switcher, and a detailed control window is displayed (S1501).

Subsequently, the video conferencing device 100 designates the number of the camera 50 and the microphone 60 (S1503), and photographs a conference party (speaker) using the microphone 60 when the designated microphone 60 is operated. A setting process of allocating the camera 50 is performed (S1505). In this case, when the microphones are prioritized for each microphone, and the same camera is capturing the speaker using the microphone 60 having a higher priority, the speaker using the microphone 60 may be photographed using another camera having a higher priority. Make sure

In addition, the video conferencing apparatus 100 generates captions and titles in response to the video conference video to be transmitted or generates subtitles and titles in response to a signal input requesting the setting of the subtitles and titles to be processed together with the video conference video to be transmitted. The title is inserted and set in advance (S1507).

In addition, the video conferencing device 100 sets brightness, contrast, hue, saturation, and sharpness of an image (S1509).

Thereafter, the video conference apparatus 100 starts a video conference broadcast, and determines whether the voice exists in a predetermined voice size section when the voice is input through the microphone 60 for the video conference (S1511).

As a result of the determination, if the voice does not exist in the predetermined voice size section, the video conferencing device 100 determines that the microphone 60 determines that the voice is suddenly loud or whispering, such as a cough or a shout, rather than the speaker's voice. The assigned camera 50 is not driven (S1513). In addition, if the speaker is already speaking through the microphone, the camera which is capturing the speaker is maintained as it is to transmit the video conference broadcast screen.

However, as a result of the determination, if the voice exists in the predetermined voice size section, the video conferencing device 100 determines whether the predetermined microphone start time (Mic Start) has elapsed (S1515).

As a result of the determination, when the microphone start time elapses, the video conferencing device 100 controls the camera assigned to the microphone to capture a speaker who speaks through the microphone (S1517).

At this time, when a voice is input to another microphone, the video conferencing device 100 operates a camera assigned to the next speaker's microphone after the microphone end time of the microphone being used by the speaker currently being photographed has elapsed. The image of the speaking speaker is taken (S1519).

During the operation, when the video conferencing device 100 is requested to execute the PIP screen mode, the video conferencing device 100 executes the PIP screen mode (S1521), and converts and displays an image of the speakers facing each other in the divided screen area (S1523).

At this time, when the video conferencing device 100 drags a camera icon on a PIP screen and places it on a specific divided screen area, the video conferencing device 100 operates the camera corresponding to the camera icon to capture a video conference image and transmits the video conferencing image.

While the present invention has been described in connection with what is presently considered to be the most practical and preferred embodiment, it is to be understood that the invention is not limited to the disclosed embodiments, but is capable of various modifications within the scope of the invention. Therefore, the scope of the present invention should not be limited by the illustrated embodiments, but should be determined by the scope of the appended claims and equivalents thereof.

Claims (11)

At least one microphone pre-installed for a video conference broadcast to receive a voice signal;
At least one camera for capturing a conferencer close to a location where the microphone is installed; And
Priority of the camera is set for each microphone to set microphone and camera environment information, and control to capture a speaker who speaks through the microphone through the camera in consideration of the microphone environment setting. In video mode, the video conferencing screen is processed so that the speaker talks to each other in the screen mode, and in the PIP screen mode, when the camera icon is dragged on the screen and moved to a segmented area of a specific PIP, And a broadcast device for displaying and transmitting a conference image captured by a camera corresponding to a camera icon.
The method of claim 1, wherein the broadcast device,
A keypad having a button for setting a broadcasting environment according to a video conference, and a button for transmitting a broadcasting screen according to a microphone setting and a video conference;
A memory for storing microphone and camera environment setting information by giving priority to the camera and storing setting information according to a broadcasting environment;
In consideration of the priorities of the cameras and the microphone environment information, the corresponding camera assigned to the voice input microphone is controlled to process and display and transmit the video conference image captured. In the PIP screen mode, the speakers face each other and talk to each other. Control the video to be displayed by switching the image to be displayed, and when the camera icon is dragged on the screen to a segmented area of a specific PIP, the conference image captured by the camera corresponding to the camera icon dragged on the segmented area is displayed and transmitted. A control unit for controlling the control unit to perform the control; And
Under the control of the controller, the screen data according to the broadcasting environment setting and the video conference image captured by the camera are displayed, the broadcast screen to be broadcast and the broadcast screen to be transmitted are displayed, and the camera preset viewer window is displayed to display the basic preset of the camera. And a display unit for displaying a setting screen for setting a value and a microphone environment.
The method of claim 2, wherein the control unit,
If a voice is not input through the microphone for a predetermined time and the power of the microphone is turned off, the video conferencing device transmits a video conference video by switching to a view screen and replacing it with another video. .
The method of claim 2, wherein the control unit,
When a voice between a certain voice mechanism is input through a microphone, the voice size section is set so that the camera assigned to the microphone is driven, and after the voice is transmitted to the microphone, the camera reacts to display an image after a predetermined time. Set the microphone start time (Mic Start), and maintain the predetermined time even if other microphones are operated, and then set the microphone end time (Mic End) to display the video of the camera assigned to the other microphone. Video conferencing device, characterized in that for setting.
The method of claim 2, wherein the control unit,
It allows you to work on the playout screen, which allows you to insert subtitles into video conferencing video captured by at least one camera, and to record video conferencing continuously as a single file without stopping for a while. And a video conference device.
The method of claim 2, wherein the control unit,
And a speaker's name is automatically displayed on one side in response to the video of the speaker of the video conference being sent.
Displaying a main screen divided into a picture in picture (PIP) setting window, a microphone setting window, and a camera setting window for video conferencing;
Setting a camera and microphone configuration, assigning a camera and a microphone number, assigning a camera to the designated microphone, prioritizing cameras, and setting a microphone environment;
Initiating a video conferencing broadcast to capture a speaker speaking through the microphone in consideration of the priority of the camera and the microphone configuration; And
During the video conference broadcast, when the PIP screen mode is executed, the video conferencing screen is processed and displayed so as to be an image in which the speakers face each other and have a conversation.
In the PIP screen mode, when a camera icon is dragged on a screen and moved to a divided region of a specific PIP, the video conference method displays and transmits a meeting image captured by a camera corresponding to the dragged camera icon on the divided region. .
The method of claim 7, wherein the imaging step,
Determining whether the voice exists in a predetermined voice size section when the voice is input through the microphone;
If it is determined that the voice does not exist in a predetermined voice size section, determining that the voice is coughing or whispering not driving the camera assigned to the microphone; And
As a result of the determination, if the voice exists in a predetermined voice size section, it is determined whether the preset microphone start time (Mic Start) has elapsed, and when the microphone start time has elapsed, the speaker who controls the camera assigned to the microphone and speaks through the microphone. And imaging the video.
The method of claim 8, wherein the imaging step,
If a voice is input to another microphone, after the microphone end time of the microphone being used by the speaker currently being photographed has elapsed, the step of photographing the speaker speaking through the other microphone is performed by operating the camera assigned to the microphone of the next speaker. The video conferencing method further comprising.
The method of claim 7, wherein the conference video,
And a speaker's name is automatically displayed on one side and transmitted.
The method of claim 7, wherein the priority of the camera,
A video conferencing method, which is used as an indicator for allowing a speaker to photograph a speaker using a microphone having a high priority of the camera when a speaker uses a microphone assigned to the same camera.

Images