KR101668702B1 - Video conference device and method for providing a video conference service - Google Patents

Abstract

A video conference apparatus and a method for providing a video conference service are disclosed. The network interface unit receives the video conference video. The control unit checks an object area in an image frame included in the video conference image received by the network interface unit, checks the ratio of the object area in the image frame, and adjusts the volume gain according to the confirmation result. According to the video conferencing apparatus and method for providing video conferencing service according to the present invention, it is possible to provide a customized video conferencing service suitable for a conference situation to a user because an appropriate volume is provided at a position of the other party conferencer in the received video conferencing video.

Description

TECHNICAL FIELD [0001] The present invention relates to a video conferencing apparatus and a video conferencing service providing method,

The present invention relates to a video conference apparatus and a video conference service providing method, and more particularly, to a video conference apparatus and a method thereof for providing a video conference service.

Currently, a system for multiparty video conferencing in a mobile environment consists of each terminal and a video conferencing server. When two or more people attended a videoconference, the way in which a speaker was selected among the participants and the video of the speaker was sent to all the videoconference attendees was developed at an early stage.

Gradually, in the case of small-scale video conferences with less than five attendees, a method is required to satisfy the requirements for viewing the video of all the participants on the terminal. Currently, the most widely known method is to use the terminal users In order to generate images of the remaining participants, a video image encoded by each terminal is received from a server, decoded, and a decoded image is combined to form a new image, which is then re-encoded and transmitted to each user. This method requires a video encoding server that decodes video images received from a plurality of terminals and encodes a new video suitable for each receiver in the video conference video system server in order to generate images of participants other than terminal users at each terminal As a result, a high computation amount in the server and a delay in transmission time due to decoding / encoding occur.

An object of the present invention is to provide a video conferencing apparatus and a video conferencing service providing method capable of providing a video conferencing service in accordance with a video conferencing situation.

According to another aspect of the present invention, there is provided a method for providing a video conferencing service, the method comprising: receiving a video conference video; checking an object region in an image frame included in the received video conference video; Determining a ratio of the area occupied by the image frame to the image frame, and adjusting a volume gain according to the confirmation result. Here, the object region may be one of a face region and a skin region.

The checking of the object region may further include calculating skin color information of the image frame and checking the object region based on the calculated skin color information.

Preferably, in the step of adjusting the volume gain, when the ratio is equal to or greater than a preset ratio value, the volume gain may be reduced.

Preferably, in the step of adjusting the volume gain, the volume gain may be increased when the ratio is less than a preset ratio value.

Preferably, in the step of adjusting the volume gain, when the ratio is within a preset range, the volume gain can be maintained.

Preferably, when automatic volume control is set, the volume gain can be adjusted.

Preferably, the video conference service providing method may further include displaying the broadcast image when the object region is not identified.

Preferably, the video conferencing service providing method includes receiving an RF (Radio Frequency) broadcasting signal, demodulating the received RF broadcasting signal, and converting the demodulated RF broadcasting signal into a video signal, And selectively displaying at least one of the demultiplexed video signal and the video conference video according to the set service mode.

Preferably, the video conference service providing method further includes a step of receiving an IP packet including a broadcast signal and selectively displaying at least one of the received broadcast signal and the video conference video according to the set service mode .

According to another aspect of the present invention, there is provided a video conferencing apparatus including a network interface unit for receiving a video conferencing video, an object area checking unit for checking an object area in an image frame included in the received video conferencing video, And a controller for checking a ratio of the area occupied in the image frame and adjusting a volume gain according to the confirmation result. Here, the object region may be one of a face region and a skin region.

Preferably, the controller calculates skin color information of the image frame and confirms the object area based on the calculated skin color information.

Preferably, the controller may decrease the volume gain when the ratio is equal to or greater than a preset ratio value.

Preferably, the control unit may increase the volume gain when the ratio is equal to or less than a preset ratio value.

Preferably, the control unit can maintain the volume gain when the ratio is within a preset range.

Preferably, the control unit may adjust the volume gain when automatic volume control is set.

Preferably, when the object region is not confirmed, the controller may control the display of the broadcast image.

Preferably, the video conference apparatus includes a tuner for receiving an RF (Radio Frequency) broadcast signal, a demodulator for demodulating the received RF broadcast signal and outputting a stream signal, And a display unit for displaying at least one of the received video conference video and the demultiplexed video signal according to the set service mode.

Preferably, the network interface unit further receives an IP packet including a broadcast signal, and the control unit controls to selectively display at least one of the received broadcast signal and the video conference video according to the set service mode have.

According to the video conferencing apparatus and method for providing video conferencing service according to the present invention, it is possible to provide a customized video conferencing service suitable for a conference situation to a user because an appropriate volume is provided at a position of the other party conferencer in the received video conferencing video.

FIG. 1 is a configuration diagram of a preferred embodiment of a video conferencing system according to the present invention,
2 is a block diagram showing a configuration of a preferred embodiment of the video conferencing apparatus according to the present invention.
FIGS. 3A to 3D are diagrams showing a screen in which a face area is recognized;
FIGS. 4A and 4B are diagrams showing a screen in which a skin region is recognized,
5 is a view showing an embodiment of a reference table for volume gain adjustment,
FIG. 6 is a flowchart illustrating a method of providing a video conference service according to an exemplary embodiment of the present invention. Referring to FIG.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. The configuration and operation of the present invention shown in the drawings and described by the drawings are described as at least one embodiment, and the technical idea of the present invention and its core configuration and operation are not limited thereby.

Although the terms used in the present invention have been selected in consideration of the functions of the present invention, it is possible to use general terms that are currently widely used, but this may vary depending on the intention or custom of a person skilled in the art or the emergence of new technology. Also, in certain cases, there may be a term selected arbitrarily by the applicant, in which case the meaning thereof will be described in detail in the description of the corresponding invention. Therefore, it is to be understood that the term used in the present invention should be defined based on the meaning of the term rather than the name of the term, and on the contents of the present invention throughout.

1 is a block diagram showing a configuration of a preferred embodiment of a video conferencing system according to the present invention.

Referring to FIG. 1, the video conferencing system 100 according to the present invention may include a server 110 and video conferencing devices 121, 123, and 125. The server 110 and the video conferencing apparatuses 121, 123, and 125 may be connected through the Internet and may be connected through a private network communication network. Here, the private network communication network may be implemented by a communication network such as a Public Switched Data Network (PSDN), an Integrated Services Digital Network (ISDN), and an Ethernet.

Also, the video conferencing devices 121, 123, and 125 may be connected to the Internet or a private network communication network through a wireless LAN. Here, the wireless LAN may be an IEEE 802.11 based wireless LAN. The video conferencing apparatuses 121, 123, and 125 can directly connect and transmit data without relaying the server 110, and can provide a video conferencing service.

The server 110 can provide a video conferencing service to the video conferencing devices 121, 123, The server 110 relays the connection between the video conferencing apparatuses 121, 123 and 125. In addition, the server 110 may integrate the video signals so as to receive the video signals from the video conferencing devices 121, 123, and 125 and display them on one screen, and provide them to the video conferencing devices. The server 110 also receives voice signals from the video conferencing devices 121, 123, and 125 and generates voice signals to be transmitted to the video conferencing devices 121, 123, and 125 based on the received voice signals, Lt; / RTI > Here, the server 110 may be a server of the SKYPE system.

The video conferencing devices 121, 123, and 125 may be implemented as information processing devices capable of displaying A / V signals. That is, the video conferencing devices 121, 123, and 125 may be mobile phones, a smart phone, a notebook computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a portable multimedia player (PMP) And may be a fixed terminal such as a digital TV, a desktop computer, or the like.

2 is a block diagram showing a configuration of a preferred embodiment of the video conferencing apparatus according to the present invention.

2, the video conferencing apparatus 200 according to the present invention includes a voice receiving unit 205, a voice processing unit 210, a control unit 215, a display unit 220, a user interface unit 225, a camera 230 A video processing unit 235, a network interface unit 240, a storage unit 245, a tuner unit 250, a demodulation unit 255, and a demultiplexing unit 260. The video conferencing apparatuses 121, 123, and 125 of FIG. 1 may be the video conferencing apparatus 200.

The voice receiving unit 205 records the voice and outputs the recorded voice signal. Here, the voice receiving unit 205 may be micro-implemented.

The voice processing unit 210 compresses the voice signal output from the voice receiving unit 205. Here, the speech processing unit 210 can compress the speech signal using the international standard algorithms H.261, H.263, and H.264.

Also, the voice processing unit 210 restores the voice signal received by the network interface unit 240. Here, the voice processing unit 210 can restore the voice signal using the corresponding algorithm according to the algorithm in which the voice signal is compressed.

The camera 230 captures an image of a subject and generates a captured image signal.

The image processing unit 235 compresses the generated picked-up image signal to generate a video signal. If the signal output from the camera 230 is an analog signal, the image processing unit 235 includes an A / D conversion unit to convert the analog signal output from the camera 230 into a digital signal, Can be compressed. Here, the image processing unit 235 can compress the captured image signal using the international standard algorithms H.261, H.263, and H.264.

The image processing unit 235 restores the video signal output from the network interface unit 240. Here, the image processing unit 235 can restore the video signal using the corresponding algorithm according to the compressed image signal, and H.261, H.263, and H.264 can be used as the compression algorithm.

The control unit 215 controls so that the audio signal output from the audio processing unit 210 and the video signal output from the video processing unit 235 are transmitted to the other video conferencing apparatus or video conferencing server connected to the communication network through the network interface unit 240 do. Here, the audio signal and the video signal can be multiplexed and transmitted, and can be transmitted individually.

The control unit 215 controls the voice and video signals received by the network interface unit 240 to be transmitted to the voice processing unit 210 and the video processing unit 235, respectively.

The control unit 215 confirms the object region in the image frame included in the image signal restored by the image processing unit 235. [ Then, the controller 215 checks the ratio of the identified object area in the image frame. Then, the control unit 215 adjusts the volume gain according to the confirmation result. Here, the object region may be one of a face region and a skin region. The video signal restored by the video processing unit 235 may be a signal in which the video conference video is compressed. Also, the volume of the voice signal restored by the voice processing unit 210 can be adjusted and displayed according to the adjusted volume gain.

In some embodiments, the controller 215 can identify the face region in an image frame using an algorithm using face symmetry, an algorithm using hair color and face color, and an algorithm using face contour.

In another embodiment, the control unit 215 may calculate skin color information in an image frame, and may identify the skin area based on the calculated skin color information.

The control unit 215 may adjust the volume gain when the automatic volume control is set and not adjust the volume when the automatic volume control is not set. Here, the automatic volume control can be set to the default, and the automatic volume control can be changed according to the user's command.

If the object region is not identified, the control unit 215 can mute the screen on which the video conference is displayed. At this time, the control unit 215 may control the broadcast signal received by the tuner unit 250 or the network interface unit 240 to be automatically displayed on the screen.

The network interface unit 240 receives packets received from the network and transmits the packets to the network. The network interface unit 240 may receive an IP packet including a broadcast signal or Internet service data from a service providing server through a network. Here, the broadcast signal may be a real-time broadcast signal, and the Internet service data may be data for the Internet service. The Internet service includes information services such as CoD (Content on Demand) service, YouTube service, weather, news, local information and search, entertainment services such as games and karaoke, communication services such as TV mail and TV SMS Means a service that can be provided over the Internet. Accordingly, in the present invention, the video conferencing apparatus includes a network TV, a web TV, and a broadband TV.

The network interface unit 240 receives audio signals and video signals from the server 110 or the video conference devices 121, 123, Here, the received voice signal and the video signal may be multiplexed with each other or individually transmitted. Also, the voice signal and the video signal can be transmitted through a dedicated line, respectively, and can be included in the payload of the IP packet and transmitted.

The network interface unit 240 transmits the audio signal output from the audio processing unit 210 and the video signal output from the video processing unit 235 to the server 110 or the video conferencing apparatuses 121, Here, the network interface unit 240 can transmit the voice signal and the video signal through different circuits, and can multiplex the voice signal and the video signal and transmit the voice signal and the video signal on one line. In addition, the network interface unit 240 may transmit the voice signal and the video signal in the form of an IP packet.

The user interface unit 225 receives a user command for requesting the user to set or cancel automatic volume control or a service mode change command for requesting the user to change the service mode. The control unit 215 changes the service mode according to the inputted service mode change command. If the service mode indicates IPTV broadcasting, the control unit 215 controls the display unit 220 to display a broadcast signal included in the IP packet received from the network interface unit 240. [ If the service mode indicates RF broadcast, the controller 215 controls the display unit 220 to display the RF broadcast signal received from the tuner unit 250. [ If the service mode indicates a video conference, the control unit 215 controls the display unit 220 to display the video conference video. Here, the RF broadcast may be one of a cable broadcast, a satellite broadcast, and a sky wave broadcast, and may be a broadcast received through the tuner unit.

The service mode may also indicate multiple modes. When the service mode indicates the multi-mode, the control unit 215 can control the display unit 220 to display all the services included in the multi-mode. That is, when the service mode indicates RF broadcasting and video conference, the control unit 215 controls the display unit 220 to simultaneously display the RF broadcasting signal and the video conference video on the screen.

The user interface unit 225 may receive an auxiliary service mode change command for requesting the user to change the auxiliary service mode. Here, the auxiliary service mode indicates a service to be displayed when the video conference screen is muted. That is, when the object area is not confirmed in the video conference video, the control unit 215 can mute the screen on which the video conference video is displayed and control the service indicated by the auxiliary service mode to be automatically displayed on the screen. Here, the service indicated by the auxiliary service mode includes a broadcasting service and an internet service, and the broadcasting service may be one of a cable broadcasting service, a satellite broadcasting service, an over-the-air broadcasting service, and an IPTV broadcasting service.

The storage unit 245 may store a program for each signal processing and control in the control unit 215, and may store a video signal, a voice signal, or a data signal subjected to signal processing. The storage unit 245 may also function to temporarily store the audio signal and the video signal output to the audio processing unit 210 and the video processing unit 235. [

The storage unit 245 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory) RAM, ROM (EEPROM, etc.), or the like.

The tuner unit 250 selects an RF broadcast signal corresponding to a channel selected by a user from among RF (Radio Frequency) broadcast signals received through an antenna, and outputs the selected RF broadcast signal as an intermediate frequency signal, Conversion. For example, if the selected RF broadcast signal is a digital broadcast signal, it is converted into a digital IF signal (DIF), and if the selected RF broadcast signal is an analog broadcast signal, it is converted into an analog baseband image or voice signal (CVBS SIF). That is, the tuner unit 250 can process a digital broadcast signal or an analog broadcast signal.

In addition, the tuner unit 250 can receive RF carrier signals of a single carrier according to an Advanced Television System Committee (ATSC) scheme or RF carriers of a plurality of carriers according to a DVB (Digital Video Broadcasting) scheme.

According to another embodiment of the present invention, the video conferencing apparatus 200 may include at least two tuner units. In a case where at least two tuner units are provided, the second tuner unit selects an RF broadcast signal corresponding to a channel selected by the user among the RF broadcast signals received through the antenna, similar to the first tuner unit, Frequency signal or a baseband image or voice signal.

In addition, the second tuner unit may sequentially select RF broadcast signals of all broadcast channels stored through the channel memory function among the received RF broadcast signals, and convert the RF broadcast signals into an intermediate frequency signal, a baseband image, or a voice signal. And the second tuner unit may periodically perform the conversion operation of all the broadcast channels. Therefore, the video conferencing apparatus 200 can display images of the broadcast signals converted through the first tuner unit, and can provide images of various channels converted through the second tuner unit in a thumbnail format. In this case, the first tuner unit converts a main RF broadcast signal selected by the user into an intermediate frequency signal, a baseband image or a voice signal, and the second tuner sequentially / periodically selects all RF broadcast signals except for the main RF broadcast signal It can be converted into an intermediate frequency signal or a baseband image or a voice signal.

The demodulator 255 receives the digital IF signal DIF converted by the tuner 250 and performs a demodulation operation. For example, when the digital IF signal output from the tuner unit 250 is the ATSC scheme, the demodulation unit 255 performs 8-VSB (8-Vestigal Side Band) demodulation. As another example, when the digital IF signal output from the tuner unit 250 is a DVB scheme, the demodulator unit 255 performs CODDMA (Coded Orthogonal Frequency Division Modulation) demodulation.

Also, the demodulator 255 may perform channel decoding. For this, the demodulator 255 includes a Trellis decoder, a de-interleaver, and a Reed Solomon decoder to perform trellis decoding, deinterleaving, Solomon decoding can be performed.

The demodulation unit 255 may perform demodulation and channel decoding and then output a stream signal TS. At this time, the stream signal may be a signal in which a video signal, a voice signal, or a data signal is multiplexed. For example, the stream signal may be an MPEG-2 TS (Transport Stream) multiplexed with an MPEG-2 standard video signal, a Dolby AC-3 standard audio signal, or the like. Specifically, the MPEG-2 TS may include a header of 4 bytes and a payload of 184 bytes.

Further, in the case of a video conferencing apparatus having at least two tuner units, a corresponding number of demodulating units may be provided. The demodulator may be provided separately according to the ATSC scheme and the DVB scheme.

The demultiplexer 260 demultiplexes the stream signal output from the demodulator 255 into a video signal, a voice signal or a data signal and outputs the demultiplexed signal to the video processor 235, the audio processor 210 and the controller 215 . The video processor 235 may restore the video signal output from the demultiplexer 260 and output the video signal to the display 220. The audio processor 210 may restore the audio signal output from the demultiplexer 260 And output it to the display unit 220.

FIGS. 3A to 3D are views showing a screen in which an object region is recognized. FIG.

3A to 3D, a screen 310, a screen 320, a screen 330, and a screen 340 are screens displaying image frames included in the received video conference images.

The control unit 215 can recognize the face area 312 as an object area on the screen 310. [ Here, the control unit 215 can recognize the face area 312 using an algorithm using face symmetry, an algorithm using hair color and face color, and an algorithm using the face contour.

3A, since the face area 312 occupies more than 60% of the entire area of the screen 310, the control unit 215 lowers the volume gain to 0.9 level. The fact that the face area 312 occupies more than 60% of the entire area may mean that the position of the other party of the video conference with the camera is close to that, so that the received video conference audio signal can be largely output, The video conferencing apparatus 200 according to the present invention can automatically adjust the volume gain so that the video conferencing voice signal is output at an appropriate size.

In FIG. 3B, the face area 322 occupies a range between less than 60% and greater than 20% in the entire area of the screen 320, so that the control unit 215 maintains the volume gain at 1.0. The fact that the face area 322 is in a range of less than 60% of the entire area and more than 20% of the entire area may mean that the position of the other end of the video conference with the camera is appropriate, Do not adjust the volume gain.

Also, in FIG. 3C, the face area 332 occupies 20% or less in the entire area of the screen 330, so that the control unit 215 increases the volume gain to 1.1 level. The fact that the face area 332 occupies 20% or less of the entire area may mean that the position of the other party of the video conference with the camera is long, and thus the received video conference voice signal may be outputted small, The video conferencing apparatus 200 according to the present embodiment automatically adjusts the volume gain so that the video conferencing voice signal is output at an appropriate size.

Also, since the object area is not confirmed on the screen 340 in FIG. 3D, the control unit 215 can mute the video conference screen. In addition, the control unit 215 may control the broadcast signal received from the network interface unit 240 or the tuner unit 250 to be displayed on the screen. In the future, when the face region is confirmed on the received video conference video, the control unit 215 can control the video conference video to be displayed again on the screen.

FIGS. 4A and 4B are views showing a screen in which a skin region is recognized. FIG.

4A and 4B, the screen 410, the screen 420, the screen 440, and the screen 440 refer to a screen on which image frames included in the received video conference image are displayed, respectively.

The control unit 215 can recognize the skin area 412 from the screen 410 to the object area. The control unit 215 calculates skin color information on the screen 410 and recognizes the area 412 having a pixel value corresponding to the skin color as the skin area using the calculated skin color information.

4A, the skin area 412 occupies 80% or more of the entire area of the screen 410, so that the control unit 215 lowers the volume gain to 0.9 level. The fact that the skin area 412 occupies 80% or more of the entire area may mean that the position of the other party of the video conference with the camera is close to that of the camera, The video conferencing apparatus 200 according to the present invention can automatically adjust the volume gain so that the video conferencing voice signal is output at an appropriate size.

4B, the skin area 422 occupies a range between less than 80% and greater than 40% in the entire area of the screen 420, so that the control unit 215 maintains the volume gain at 1.0. The fact that the skin area 422 is in a range of less than 80% of the entire area and in a range of more than 40% may mean that the position of the other party of the video conference with the camera is proper, Do not adjust the volume gain separately.

4C, the skin area 432 occupies less than 40% of the entire area of the screen 430, so that the control unit 215 increases the volume gain to 1.1 level. The fact that the skin area 432 occupies 40% or less of the entire area may mean that the position of the other party of the video conference with the camera is far and thus the received video conference audio signal may be outputted small, The video conferencing apparatus 200 according to the present embodiment automatically adjusts the volume gain so that the video conferencing voice signal is output at an appropriate size.

In addition, since the object area is not confirmed on the screen 440 in FIG. 4D, the control unit 215 can mute the video conference screen. In addition, the control unit 215 may control the broadcast signal received from the network interface unit 240 or the tuner unit 250 to be displayed on the screen. In the future, when the skin area is confirmed on the received video conference video, the control unit 215 can control the video conference video to be displayed again on the screen.

5 is a diagram showing an embodiment of a reference table for volume gain adjustment.

Referring to FIG. 5, the storage unit 245 may store a reference table 500 for volume gain adjustment. The reference table 500 may include a value indicating the amount of adjustment of the volume gain depending on the range.

The reference table 400 includes a value indicating the amount of adjustment of the volume gain within the range by dividing the range of the proportion of the object area occupied by the entire area of the image frame into 'upper', 'middle' and 'lower' . Here, the division of the range of the ratio can be set as a default, and can be set differently according to the user's command. For example, 'phase' may range from 80% or more, 'middle' may range from less than 80% to over 40%, and 'bottom' may range from less than 40%. Here, the adjustment amount of the volume gain may be a value set at the time of product production, and may be a value adjusted by the user. In addition, the corrected adjustment amount can be initialized to the value set at the time of product production. At this time, the video conferencing apparatus can provide the above menu for initializing the corrected adjustment amount to a value set at the time of product production.

The control unit 215 can adjust the volume gain using the reference table 500. [ When the ratio of the object region is included in the 'phase', the control unit 215 lowers the volume gain to 0.9 level. If the ratio of the object area is included in 'middle', the control unit 215 maintains the volume gain at 1.0. If the ratio of the object area is included in the lower part, the controller 215 raises the ballroom gain to 1.1 level.

FIG. 6 is a flowchart illustrating a method of providing a video conference service according to an exemplary embodiment of the present invention. Referring to FIG.

Referring to FIG. 6, the network interface 240 receives a video signal and a voice signal (S600). Here, the video signal may be a signal in which the video conference video is compressed, and the audio signal may be a signal in which the video conference audio is compressed. The network interface unit 240 can receive video signals and audio signals from the server 110 or the video conferencing apparatuses 121, 123 and 125 and can receive the data signals together with video signals and audio signals, The multiplexed signal can be received.

The image processing unit 235 restores the received image signal, and the voice processing unit 210 restores the voice signal (S605). The video processing unit 270 and the audio processing unit 210 can restore the video signal and the audio signal using the corresponding algorithms according to the algorithm in which the video signal and the audio signal are compressed, respectively, and H.261, H.263 And H.264 can be used.

The control unit 215 confirms whether automatic volume control is set (S610). Here, automatic volume control may be set to the default. Also, the control unit 215 can release or re-set the automatic volume control according to a user command.

The control unit 215 confirms the object region in the image frame included in the restored image signal (S615). Here, the object region may be one of a face region and a skin region.

If the object area is confirmed, the control unit 215 calculates the ratio of the confirmed object area to the corresponding image frame (S620).

The control unit 215 confirms to which range the calculated ratio belongs (S625). Here, the controller 215 can check whether the calculated ratio is greater than or equal to a preset first rate value, and can confirm whether or not the calculated rate is greater than a preset second rate value.

If the calculated ratio is greater than or equal to the preset first ratio value, the control unit 215 decreases the volume gain (S630). Here, the control unit 215 can adjust the volume gain using the reference table 500 shown in FIG.

If the calculated ratio is smaller than the first ratio value set in advance and larger than the preset second ratio value, the control unit 215 maintains the volume gain (S635). Here, the control unit 215 can adjust the volume gain using the reference table 500 shown in FIG.

If the calculated ratio is equal to or less than the preset second ratio value, the control unit 215 increases the volume gain (S640). Here, the control unit 215 can adjust the volume gain using the reference table 500 shown in FIG.

The display unit 220 displays the restored voice signal according to the adjusted volume gain (S645).

If the object area is not confirmed, the control unit 215 controls to mute the image-displayed image (S650). Here, the control unit 215 may control the broadcast image to be automatically displayed. The broadcast signal including the broadcast image may be received by the network interface unit 240 and the tuner unit 250, and may be one of a cable broadcast image, a terrestrial broadcast image, a satellite broadcast image, and an IPTV broadcast image.

The present invention can also be embodied as computer-readable codes on a computer-readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer apparatus is stored. Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and may be implemented in the form of a carrier wave (for example, transmission via the Internet) . The computer-readable recording medium may also be distributed to networked computer devices so that computer readable code can be stored and executed in a distributed manner.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is clearly understood that the same is by way of illustration and example only and is not to be taken by way of limitation in the embodiment in which said invention is directed. It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the scope of the appended claims.

Claims (20)

Receiving video and audio signals of a video conference from at least one external device;
Extracting an object region from an image frame included in a video signal of a video conference received from the at least one external device;
Determining a ratio of the extracted object region to the image frame;
According to the determination, when the ratio is equal to or greater than a predetermined upper limit value, the volume gain is decreased, and when the ratio is lower than a predetermined lower limit value, the volume gain is increased, and if the ratio is lower than the upper limit value to the lower limit value Adjusting the volume gain to be maintained; And
And outputting the modulated voice signal according to the adjusted volume gain. The method according to claim 1,
Wherein the object region is one of a face region and a skin region. The method according to claim 1,
Wherein identifying the object region comprises:
Calculating skin color information of the image frame; And
And checking the object region based on the calculated skin color information. delete delete delete The method according to claim 1,
And when the automatic volume control is set, the volume gain is adjusted. The method according to claim 1,
And displaying the broadcast image if the object region is not identified. The method according to claim 1,
Receiving an RF (Radio Frequency) broadcast signal;
Demodulating the received RF broadcast signal;
Demultiplexing the demodulated RF broadcast signal into a video signal, a voice signal, and a data signal; And
And selectively displaying at least one of the demultiplexed video signal and the video conference video. The method according to claim 1,
Receiving an IP packet including a broadcast signal; And
And selectively displaying at least one of the received broadcast signal and the video signal of the video conference. A network interface unit for receiving a video signal and a voice signal of a video conference from at least one external device;
A voice processing unit for processing a voice signal received from the at least one external device; And
And a controller for controlling the network interface unit and the voice processing unit,
The controller comprising:
Extracting an object region from an image frame included in a video signal of a video conference received from the at least one external device, determining a ratio of the extracted object region to the image frame,
According to the determination, when the ratio is equal to or greater than a predetermined upper limit value, the volume gain is decreased, and when the ratio is lower than a predetermined lower limit value, the volume gain is increased, and if the ratio is lower than the upper limit value to the lower limit value , Adjusts to maintain the volume gain, and
And controls the voice processor to output a modulated voice signal according to the adjusted volume gain. 12. The method of claim 11,
Wherein the object region is one of a face region and a skin region. 12. The method of claim 11,
The controller comprising:
Wherein the skin color information of the image frame is calculated and the object area is confirmed based on the skin color information. delete delete delete 12. The method of claim 11,
The controller comprising:
And adjusts the volume gain when automatic volume control is set. 12. The method of claim 11,
The controller comprising:
And controls the display unit to display the broadcast image if the object region is not confirmed. 12. The method of claim 11,
A tuner for receiving an RF (Radio Frequency) broadcast signal;
A demodulator for demodulating the received RF broadcast signal and outputting a stream signal;
A demultiplexer for demultiplexing the output stream signal into a video signal, a voice signal, and a data signal; And
And a display unit for displaying at least one of the received video conference video and the demultiplexed video signal according to the set service mode. 12. The method of claim 11,
Wherein the network interface unit further receives an IP packet including a broadcast signal,
Wherein the controller controls to selectively display at least one of the received broadcast signal and the video signal of the video conference.

Images