KR100333504B1 - Apparatus and method for controlling audio in a video conferencing system - Google Patents

Abstract

Disclosed is an apparatus and method for controlling an audio signal of a video conference system for continuously outputting an audio signal without interruption during a video conference. The device temporarily stores an audio signal including a predetermined meeting information in an input handle through a microphone, and the first network detector detects a signal transmission environment of the network and outputs a signal according to the detected signal transmission environment. The size and number are set, and the audio signal stored in the input handle is stored in the transmission buffer unit according to the set form. The second network detector detects a signal reception environment of the network and outputs a signal according thereto, and the receiving buffer unit having a size and number set according to the detection signal of the second network detector outputs an audio signal transmitted from the transmission buffer unit and transmitted through the network. Save it. The plurality of output handles are configured to store audio signals output from the reception buffer unit and output the audio signals through the speaker. It detects the network situation and stores and outputs the audio signal which is input accordingly, so that the audio signal can be transmitted or received without interruption in the middle, thereby enabling more effective video conferencing.

Description

Apparatus and method for controlling audio in a video conferencing system

The present invention relates to an audio control method of a video conference system, and more particularly, to an audio control method of a video conference system for outputting without interruption of a transmitted audio signal.

In the modern society, as the information and communication technology is rapidly developed, the video conferencing system in the remote area is increasing.

In general, video conferencing is a system for interactively exchanging various information such as video, voice, text, graphics, etc. on a network between two remote sites. That is, even if they are far away from other users in the distance, the most basic media for viewing and communicating with each other by a CCD camera or a camcorder are images and audio. Video conferencing systems are basically equipped with cameras, monitors, microphones, and speakers in each conference room to connect two-way video and audio lines.

A conventional video conferencing system will now be described with reference to the accompanying drawings.

1 is a view showing a schematic configuration of a video conference system according to the prior art.

As shown in FIG. 1, the first and second conference rooms have first and second audio devices 100a and 100b with microphones and speakers, video devices 102a and 102b with cameras and monitors, and first and second conference rooms, respectively. 2, the switching unit 104 and 106, the first and second codecs 108 and 110, and the first and second switching controllers 112 and 114.

First and second audio devices 100a and 100b for input and output of audio signals, and first and second video devices 102a and 102b for capturing and displaying images of the first conference room and the second conference room where the called party is located. ), First and second switching units 104 and 106 for selectively outputting the input audio and video signals, and first and second codecs 108 and 110 and the first and second codecs for analog or digital conversion of the input audio and video signals. And first and second switching controllers 112 and 114 for controlling switching operations of the second switching units 104 and 106. Here, the caller and the called party are mutually coupled through a network as a user terminal device used by each user in a multi-party video conferencing system.

The operation of the video conferencing system having the configuration as described above is as follows.

Assuming that the user of the first meeting room is the caller of the meeting and the user of the second meeting room is the caller, the appearance of the caller located in the first meeting room is taken by the first video device 102a, and the video signal according to the shooting is taken. The first codec 108 is digitally converted from the video signal output from the first switching unit 104 and transmitted to the second conference room through the network 120. The second codec 110 receives and converts an analog video signal transmitted through the network 120, and the analog converted video signal is displayed through the second video device 102b via the second switching unit 106. .

Meanwhile, an audio signal of a caller input through the first audio device 100a is input to the first codec 108 as the first switching unit 104 is switched by the control of the first switching control unit 112. The first codec 108 digitally converts an input audio signal and outputs the digital signal on the network 120. The second codec 110 analog converts and outputs an audio signal input through the network 120, and the analog converted audio signal corresponds to a switching operation of the second switching unit 106 by the second switching control unit 114. The call is output by the second audio device 100b so that the called party of the second conference room recognizes this.

Here, since the video conferencing system is the center of the video signal, the switching operation according to the input of the audio signals of the first and second switching units 104 and 106 is required by the caller to switch the switching. ) As a control signal is outputted. That is, when a caller inputs information necessary for a conference by using an audio signal and presses a certain button attached to a microphone, which is an audio device, the first and second switching controllers 112 and 114 process the audio signal. As the path is switched, an audio signal is transmitted.

Users of the first and second conference rooms can simultaneously perform a call or a called operation, thereby enabling bidirectional communication for transmitting or receiving an audio signal and a video signal.

The videoconferencing system according to the related art described above is provided for a time when the transmission of the audio signal is allocated when the caller of the first conference room wants to transmit a predetermined audio signal to the called party through a network to which a plurality of callers of the second conference room are connected. If the transmission of another caller is not completed or before the transmission is completed, the transmission of the audio signal is resumed after a certain time after the transmission of the audio signal is stopped.

Another example of a conventional video conferencing system transmits information required for a conference by a video signal or a chat by using a whiteboard instead of an audio signal.

The videoconferencing system according to the prior art is cumbersome, requiring the caller to press a button of the audio device to input the audio signal.

In addition, there is a problem in that the free movement of the caller or the callee of the conference is limited when the video signal by a chat using a whiteboard or a computer is used instead of the transmission of the conference information using the audio signal.

In addition, since the situation of the network, which is the connection channel, cannot be detected, the transmission of the audio signal of one caller is interrupted by the transmission of the audio signal of another caller during the transmission of the audio signal of one caller through the network. There is also a problem.

Accordingly, an object of the present invention is to provide an audio control apparatus and method of a video conferencing system which continuously detects a network situation and stores and outputs an audio signal to be transmitted or received accordingly in a buffer.

1 is a view showing a schematic configuration of a video conference system according to the prior art.

2 is a block diagram illustrating an audio control apparatus of a video conference system according to the present invention.

FIG. 3 is a block diagram illustrating bidirectional communication between the first caller and the called party of FIG. 2.

4 is a flowchart for performing audio signal transmission of a video conference system according to the present invention.

5 is a flowchart for performing audio signal reception of a video conferencing system according to the present invention.

♣ Explanation of symbols for main part of drawing ♣

200-1 to 200-N: first to Nth callers

204-1 to 204-N: First to Nth input handles

206-1 to 206-N: first to Nth network detection units

306-1 to 306-N: first to Nth output handles

According to an aspect of the present invention in order to achieve the above object, via the microphone temporarily stores an audio signal including a predetermined meeting information in the input handle, the first network sensor detects the network signal transmission environment accordingly A signal is output, and the size and number are set according to the detected signal transmission environment, and the audio signal stored in the input handle is stored in the transmission buffer unit according to the set form. The second network detector detects a signal reception environment of the network and outputs a signal according thereto, and the receiving buffer unit having a size and number set according to the detection signal of the second network detector outputs an audio signal transmitted from the transmission buffer unit and transmitted through the network. Save it. The plurality of output handles provide an audio control apparatus of a video conference system configured to store audio signals output from a reception buffer unit and output the same through a speaker.

According to another embodiment of the present invention, there is provided a method for temporarily storing an input audio signal, detecting a transmission environment of a network, transmitting an audio signal in a form set according to the detected transmission environment, and a network. A method of controlling an audio signal of a video conferencing system, comprising: detecting a reception environment of a signal; storing the audio signal transmitted according to the detected reception environment, and outputting the audio signal through a speaker.

According to another aspect of the present invention, there is provided a computer readable recording medium tangibly embodying a program consisting of instructions executable by a computer in order to carry out the characteristic method described above.

According to another aspect of the present invention, in a multi-party video conferencing system in which a plurality of user terminals are combined through a network, the user terminal receives and stores an audio signal applied through the network and divides the audio signal into a predetermined size. A reception buffer unit for outputting and including at least one reception buffer; An audio device that converts an audio signal into sound and outputs the sound; An apparatus for controlling an audio signal of a multi-party video conferencing system, comprising a plurality of output handles that alternately receive and store an output of the reception buffer and alternately output the output to the speaker.

According to a preferred embodiment, the receiving and storing operation of the plurality of output handles and the output operation of the plurality of output handles are performed by a separate thread operating independently, the user terminal monitors the situation of the network, The apparatus may further include a network detector configured to control the size and the number of the reception buffers included in the reception buffer unit based on the monitoring result.

Hereinafter, an audio control apparatus and method thereof of a video conference system according to the present invention will be described with reference to the accompanying drawings. However, the present invention is not limited or limited by the following examples.

FIG. 2 is a block diagram illustrating an audio control apparatus of a video conferencing system according to the present invention. FIG. 3 is a block diagram illustrating two-way communication between a first caller and a called party of FIG. 2. A flowchart for performing audio control of a video conferencing system according to the invention.

As shown in FIG. 2, the audio control apparatus of the video conferencing system according to the present invention includes a first audio device 202 having an microphone (not shown), an input handle 204-1, and a first network sensing unit. 206-1, a first caller 200-1 composed of a first transmission buffer section 208-1, a first-first network sensing section 302, a reception buffer section 304, and a plurality of outputs The first caller 200- by the network 400 consists of a first-first audio device 308 having handles 306-1,306-2, ..., 306-N and a speaker (not shown). And a first callee 300 connected with 1).

Here, the first input handle 204-1 includes an input information unit 210 and an input buffer 212, and the first transmission buffer unit 208-1 includes first to Nth transmission buffers 214-1 and 214-. 2, ...). The reception buffer unit 304 includes first to Nth reception buffers 310-1, 310-2, 310-3,..., And the first output handle 360-1 includes an output information unit 312 and an output buffer ( 314, the second to Nth output handles 360-2,..., 306 -N have the same configuration as the first output handle 360-1, and the network 400 includes a telephone exchange network, It can comprise with ISDN (broadband information communication network).

Referring to the configuration of the audio control device of the video conferencing system according to the present invention configured as described above in more detail as follows.

The input information unit 210 in the first input handle 204-1 of the first caller 200-1 continuously detects an audio signal input through the first audio device 202, and inputs the input audio signal. Temporarily stored in the buffer 212. The first network detector 206-1 detects a situation of the connected network 400 and outputs a detection signal accordingly. The first transmission buffer unit 208-1 transmits both the magnitude of the audio signal to be transmitted at one time and the audio signal stored in the input buffer 212 by the detection signal output from the first network detection unit 206-1. The number can be set to store the audio signal for transmission through the network 400 accordingly. Here, a plurality of callers 200-1, 200-2,..., 200 -N having the same configuration as that of the first caller 200-1 and connected to the network 400 to transmit an audio signal can also be connected.

In addition, the 1-1 network detection unit 302 detects the network 400 and outputs a detection signal according thereto, and the reception buffer unit 304 by the first caller 200-1 according to the detection signal. First to Nth reception buffers 310-1, 310-2, 310-3,... Are prepared to appropriately receive the transmitted audio signal, and store the audio signal transmitted through the network 400. The output information unit 312 of the first output handle 306-1 adjusts the size of the output buffer 314 to properly output the audio signal to the first called party 300 through the 1-1 audio device 308. Size is set for each output buffer 314, ..., which is set by the respective output information units 312, ... of each output handle 306-1, 306-2, ..., 306-N. As many audio signals are stored, and output audio signals to the first called party 300 through the 1-1 first audio device 308. At this time, the output buffers 314, ..., which are sized to be output at one time by the respective output information units 312, ... of the respective output handles 306-1, 306-2, ..., 306-N, are received. Composed of first to Nth output handles 306-1,306-2, ..., 306-N sufficient to output all audio signals stored in the buffer units 310-1, 310-2, 310-3, ... do.

The operation of the audio signal control apparatus of the video conferencing system according to the present invention configured as described above is as follows.

The first caller 200-1 inputs an audio signal through the first audio device 202, and the input information unit 210 of the first input handle 204-1 continuously receives input information of the input audio signal. And the audio signal is stored in the input buffer 212 according to the detection. The first network detector 206-1 detects the situation of the network 400, that is, at what point in time and how much of the audio signal can be transmitted through the network 400. The first transmission buffer unit 208-1 is the size and the input buffer of the first to Nth transmission buffers (214-1, 214-2,...) According to the detection signal of the first network detection unit (206-1). After setting the number of transmission buffers suitable for transmitting the audio signals stored in the 212, the audio signal output from the input buffer 212 is stored.

The audio signal stored in the first transmission buffer unit 208-1 is transmitted to the first called party 300 through the network 400. Here, the audio signals of the second to Nth callers 200-2,..., 200 -N other than the first caller 200-1 also operate in the same operation as the first caller 200-1. Are stored in the respective input buffers 212, ... in each of the input handles 204-1, 204-2, ..., 204-N. First called party 300 after being stored in each transmission buffer section 208-1, 208-2, ..., 208-N for transmission on the network 400 in response to detection by. Is sent to

Subsequently, the first-first network detection unit 302 detects a situation of the network 400, and according to the detection signal, the first to Nth reception buffers 310-1 and 310-2 of the reception buffer unit 304. The size and number of ..) are set. In order that audio signals transmitted by the first to Nth callers 200-1, 200-2,..., 200 -N are transmitted to the reception buffer unit 304 of the set size and number through the network 400. Are stored accordingly. At this time, the caller's first to Nth network detectors 206-1, 206-2,..., 206 -N and the callee's 1-1 network detector 302 operate synchronously.

Each output information unit 312, ... in each output handle 306-1, 306-2, ..., 306-N detects the output information such as which sound quality to output the audio signal, and accordingly outputs each output. The sizes of the buffers 314,... Are stored, and store the audio signals output from the reception buffer unit 304 according to the determined sizes. The audio signals stored in the output buffers 314,... Of the plurality of output handles 306-1, 306-2,..., 306 -N are output through the speaker of the first-first audio device 308. .

Here, as shown in FIG. 3, the first caller 200-1 may not only configure the configuration of FIG. 2 for transmitting an audio signal but also receive a first network sensing unit (not shown) to receive an audio signal transmitted through the network 400. According to the output information of the first-first receiving buffer unit 500 and the first audio device 202 storing the audio signal received through the network 400 in a predetermined form in accordance with the detection signal of the 206-1) -1 is composed of a plurality of output handles 502-1, 502-2, ... which store the audio signal input from the reception buffer unit 500 and output it through the first audio device 202. The internal configuration is the same as that of each part of the first callee 300 shown in FIG.

In addition, as shown in FIG. 3, the first callee 300 may receive the audio signal input through the 1-1 audio device 308 as well as the configuration of FIG. 2 for receiving the audio signal transmitted through the network 400. Storing the audio signal input from the first-first input handle 520 according to a detection signal of the first-first input handle 520 and the first-first network detection unit 302 in a predetermined form. After that, it is composed of the first-first transmission buffer unit 522 to be transmitted to the network 400, and the detailed internal configuration of each unit is the same as the first caller 200-1 shown in FIG.

By the above configuration, the first caller 200-1 and the first callee 300 can perform bidirectional communication that can transmit or receive an audio signal.

The audio signal control method of the video conferencing system according to the present invention configured and operated as described above will be described with reference to FIGS. 4 and 5.

First, it is determined whether an audio signal for calling a first callee 300 located in another conference room is input through each audio device of the first to Nth callers 200-1, 200-2,..., 200 -N. Continuously detecting (S500), when an audio signal is input, the input audio signal is temporarily stored in each input buffer 212, ... in each input handle 204-1, 204-2, ..., 204-N. Save (S501).

The situation is detected by the network 400 by the first to N th network sensing units 206-1, 206-2,..., 206 -N (S502). That is, it detects at what time and in what size audio signal is transmitted. The size of each transmission buffer unit 208-1, 208-2, ..., 208-N according to the detection signal of the first to Nth network detection units 206-1, 206-2, ..., 206-N and After setting the number (S503), the respective output handles 204-1, 204-2, ..., 204-N are output to each of the set transmission buffer units 208-1, 208-2, ..., 208-N. The audio signal is stored (S504). The first to Nth callers 200-1, 200-2,..., 200-by continuous detection of the network 400 status of each network sensing unit 206-1, 206-2,..., 206 -N. If the network 400 of the first called party 300 to be called by N) is connected (S505), it is stored in each transmission buffer section 208-1,208-2, ..., 208-N. The audio signal is transmitted to the first called party 300 through the network 400 (S506).

Subsequently, the situation of the network 400 by the first-first network detection unit 302 of the first callee 300 is detected (S600), and according to the detection signal of the first-first network detection unit 302. The size and number of receive buffers of the receive buffer unit 304 for receiving the transmitted audio signal are set (S601). The audio signal transmitted and received through the network 400 is stored in the set reception buffer 304 (S602), and each output buffer in the plurality of output handles 306-1, 306-2,..., 306 -N is stored. The audio signal is stored at (314, ...) (S603). At this time, each output buffer (314, ...) is set by the output information section (312, ...), the appropriate size to output the audio signal through the speaker of the 1-1 audio device 308, The audio signal of the receive buffer 304 is stored in each of the output buffers 314,... In this case, each output buffer 314 is stored in a size capable of outputting for about 1 second, and the stored audio signal is output through the speaker of the first-first audio device 308 (S604). The caller 300 will be called. The first-first network detection unit 302 continuously detects whether the first called party 300 is connected to the network 400 (S605) and repeatedly performs the above steps, thereby receiving the received audio signal first-first. 1 outputs continuously through the audio device 308.

Here, a thread is used to output audio signals stored in the output buffers 314, ... in each output handle 306-1, 306-2, ..., 306-N through the speaker. The output buffers 314,... Are stored with an audio signal that can be output for about 1 second, so that the thread is executed once per second.

The audio control apparatus and method of the video conferencing system according to the present invention configured and operated as described above, after multiple callers detect an audio signal to be transmitted to the called party, store the situation in each transmission buffer accordingly. Print on the network. In addition, the called party detects the situation of the network and accordingly stores the audio signals transmitted through the network in a plurality of receiving buffers, and temporarily stores them in the plurality of output buffers according to the output order for output through the speaker. .

The audio control apparatus and method of the video conferencing system according to the present invention detects the situation of the network, the caller for transmitting the audio signal and the called party receiving the transmitted audio signal, and transmits or receives the audio signal accordingly, Since the audio signal can be transmitted or received without interruption, there is an effect that the video conference can be conducted more efficiently.

In addition, a separate action is not required by a user to transmit or receive an audio signal, and there is an effect that a plurality of users can simultaneously transmit an audio signal.

Although the above has been described with reference to a preferred embodiment of the present invention, those skilled in the art to which the present invention pertains without departing from the spirit and scope of the invention as set forth in the claims below It will be appreciated that modifications and variations can be made.

Claims (14)

In a video conferencing system connected by a predetermined network, An input handle for temporarily storing an input audio signal; A first network detector configured to detect a signal transmission state of the network and output a signal according to the signal transmission situation; A transmission buffer unit for setting a size and number of buffers for storing the audio signals stored in the input handle according to the detected signal transmission situation, and storing the audio signals in the set buffer and outputting the audio signals; A second network detector for detecting a signal reception state of the network and outputting a signal accordingly; A reception buffer unit for setting a size and number of buffers for storing audio signals transmitted through the network according to the detected signal reception situation, and for storing audio signals in the set buffers; And And a plurality of output handles for storing and outputting an audio signal output from the reception buffer unit. The method of claim 1, And the input handle comprises an input information unit for detecting information of the input audio signal, and an input buffer for temporarily storing the audio signal output from the input information unit. The method of claim 1, And the transmission buffer unit comprises a plurality of buffers whose size and number are set according to the detected transmission situation. The method of claim 1, And the reception buffer unit comprises a plurality of buffers whose size and number are set according to the detected reception situation. The method of claim 1, The output handle stores an output information unit for detecting output information for outputting an audio signal output from the reception buffer unit through a speaker, and stores the audio signal having a size set according to the detected output information and outputs the same through the speaker. An audio signal control apparatus for a video conference system comprising an output buffer. An audio signal control method of a videoconferencing system for conducting a conference over a predetermined network, the videoconferencing system including a plurality of transmission buffers and a reception buffer, Temporarily storing an input audio signal; Detecting a transmission state of the network; Setting a size and number of the transmission buffers according to the detected transmission situation; Storing and transmitting the audio signal in a transmission buffer in which the size and number are set; Detecting a reception condition of the network; Setting a size and a number of the reception buffers according to the detected reception situation; And storing the received audio signal in a reception buffer in which the size and number are set, and outputting the received audio signal through a speaker. The method of claim 6, The transmitting of the audio signal may include setting a transmission size and a number of times of the audio signal according to the detected transmission situation. The method of claim 6, The outputting through the speaker may include: temporarily storing a reception size and a number of times of the audio signal according to the detected reception situation; And storing and outputting the audio signal according to the output information of the speaker. The method of claim 6, The transmitting and receiving situation detection step is performed synchronously audio signal control method of a video conference system. The method of claim 6, And outputting through the speaker is performed by a thread. A computer readable recording medium tangibly embodying a program consisting of instructions executable by a computer to perform the method of any one of claims 6 to 10. In a multi-party video conferencing system in which a plurality of user terminals are coupled through a network, The user terminal, A reception buffer unit which receives, stores, and outputs an audio signal applied through the network in a predetermined size and includes at least one reception buffer; An audio device that converts an audio signal into sound and outputs the sound; A plurality of output handles that alternately receive and store the output of the receiving buffer and then alternately output the output to the speaker Audio signal control apparatus of a multi-party video conferencing system comprising a. The method of claim 12, And receiving and storing the plurality of output handles and outputting the plurality of output handles are performed by separate threads operating independently. The method of claim 12, The user terminal further includes a network sensing unit for monitoring the network situation and controlling the size and number of the receiving buffers included in the receiving buffer unit based on the monitoring result. Signal control device.