KR20120006675A - Video conference device and method of displaying video used in video conference - Google Patents

Abstract

PURPOSE: A video conference apparatus and image display method therefor are provided to control the image quality of a video conference image according to an average brightness level by calculating an average brightness level. CONSTITUTION: A video conference apparatus receives a video conference image(S500). The average brightness level of an image frame is calculated by the video conference apparatus(S515). The video conference apparatus controls an image quality element fro the display unit of the video conference image according to the calculated average brightness level(S520~S535). The video conference apparatus displays the image of the video conference according to the controlled image quality elements(S540).

Description

VIDEO CONFERENCE DEVICE AND METHOD OF DISPLAYING VIDEO USED IN VIDEO CONFERENCE}

The present invention relates to a videoconferencing apparatus and a method of displaying a videoconferencing image, and more particularly, to a videoconferencing apparatus and a method for providing a videoconferencing service.

Currently, a system for multi-party video conferencing in a mobile environment consists of a terminal and a video conference server. When two or more participants attended a videoconference, an early stage was developed in which a speaker was selected from the participants and the video of the speaker was transmitted to all videoconference participants.

Increasingly, in the case of small video conference with less than 5 attendees, there is a need for a method that satisfies the requirement of viewing the video of all attendees on the terminal. Currently, the most widely known method is to provide a terminal user to each terminal. In order to generate an image of the other participants except for the video, the video image encoded by each terminal is received by the server, decoded, and then a new image is formed by combining the decoded images, recoded, and transmitted to each user. This method requires a video encoding server that decodes video images received from multiple terminals and encodes a new image suitable for each receiver in order to generate images of the other participants except the terminal user in each terminal. As a result, there is a delay in transmission time due to high computational amount and decoding / coding in the server.

SUMMARY OF THE INVENTION The present invention has been made in an effort to provide a videoconferencing apparatus for displaying a customized image to a user by adjusting the quality of a videoconferencing image and a method of displaying the videoconferencing image.

According to an aspect of the present invention, there is provided a method of displaying a videoconferencing video according to the present invention, the method comprising: receiving a videoconferencing video, calculating an average brightness level of a video frame included in the received videoconferencing video; And adjusting the image quality factor for displaying the videoconferencing image according to the calculated average brightness level, and displaying the videoconferencing image according to the adjusted quality factor. Here, the image quality element may include at least one of brightness and sharpness.

The adjusting of the quality factor may include comparing the calculated average brightness level with a preset level value, and when the calculated average brightness level is greater than the level value, adjusting the quality factor. Reducing.

The adjusting of the quality factor may include comparing the calculated average brightness level with a preset level value and, if the calculated average brightness level is less than the level value, adjusts the value of the quality factor. Increasing may be included.

Preferably, in the adjusting of the image quality element, the image quality element may be adjusted by adjusting PSM (Picture Screen Mode) data.

Preferably, when automatic image quality adjustment is set, the step of adjusting the image quality element may be performed.

Preferably, the method for displaying a video conference video comprises receiving a radio frequency (RF) broadcast signal, demodulating the received RF broadcast signal, and converting the demodulated RF broadcast signal into a video signal, an audio signal, and a data signal. Demultiplexing may further include.

Preferably, in the displaying, at least one of the demultiplexed video signal and the video conference video may be selectively displayed according to the set service mode.

Preferably, the method for displaying the video conference video further comprises receiving an IP packet including a broadcast signal, wherein, in the displaying step, the received broadcast signal and the video conference video according to the set service mode are included. At least one may be selectively displayed.

In order to achieve the above technical problem, a video conference apparatus according to the present invention includes a network interface unit for receiving a video conference image, calculating an average luminance level of an image frame included in the received image, and calculating the average luminance level. The controller may include a controller configured to adjust an image quality element for displaying the video conference image, and a display unit configured to display the video conference image according to the adjusted image quality element. Here, the image quality element may include at least one of brightness and sharpness.

Preferably, the controller may compare the calculated average brightness level with a preset level value, and when the calculated average brightness level is greater than the level value, may reduce the value of the image quality element.

Preferably, the controller may compare the calculated average brightness level with a preset level value, and when the calculated average brightness level is smaller than the level value, increase the value of the quality factor.

Preferably, the control unit may adjust the picture quality mode by adjusting PSM (Picture Screen Mode) data.

Preferably, the controller may adjust the image quality element when automatic image quality control is set.

Preferably, the network interface unit may further receive an IP packet including a broadcast signal, and the controller may control at least one of the received broadcast signal and the video conference image to be displayed on a screen according to a set service mode.

Preferably, the videoconferencing apparatus includes a tuner for receiving a radio frequency (RF) broadcast signal, a demodulator for demodulating the received RF broadcast signal and outputting a stream signal, and converting the output stream signal into a video signal, an audio signal, It may include a demultiplexer for demultiplexing the data signal.

Preferably, the controller may control to display at least one of the received video conference video and the demultiplexed video signal according to a set service mode.

According to the videoconferencing apparatus and the method for displaying the videoconferencing video according to the present invention, the average brightness level of the received videoconferencing video is calculated and the image quality of the videoconferencing video is adjusted according to the calculated average brightness level. Custom videoconferencing video can be displayed.

1 is a block diagram showing a configuration of a preferred embodiment of a videoconferencing system according to the present invention,
2 is a block diagram showing the configuration of a preferred embodiment of a videoconferencing apparatus according to the present invention;
FIG. 3 is a diagram illustrating an embodiment of a PSM (Picture Screen Mode) setting screen, and FIG.
4 is a diagram illustrating an embodiment of a reference table for adjusting image quality; and
5 is a flowchart illustrating a process of performing a preferred embodiment of the method for displaying a videoconferencing image according to the present invention.

1 is a block diagram showing the configuration of a preferred embodiment of a videoconferencing system according to the present invention.

Referring to FIG. 1, the video conferencing system 100 according to the present invention may include a server 110 and video conferencing devices 121, 123, and 125. The server 110 and the video conferencing devices 121, 123, and 125 may be connected through the Internet, and may be connected through a private network communication network. The private network communication network may be implemented as a communication network such as a Public Switched Data Network (PSDN), an Integrated Services Digital Network (ISDN), and an Ethernet.

In addition, the video conferencing devices 121, 123, and 125 may be connected to the Internet or a private network communication network through a wireless LAN. The wireless LAN may be a wireless LAN based on IEEE 802.11. The video conferencing devices 121, 123, and 125 may be directly connected without relaying of the server 110 to transmit and receive data, and may provide a video conferencing service.

The server 110 may provide a video conferencing service to the video conferencing devices 121, 123, and 125. The server 110 relays the connection between the video conferencing devices 121, 123, and 125. In addition, the server 110 may provide a video signal to each video conferencing device by integrating the video signal to receive the video signals from each video conferencing device 121, 123, and 125 and display them on one screen. In addition, the server 110 receives a voice signal from each video conferencing device (121, 123, 125) and generates a voice signal to be transmitted to each video conferencing device (121, 123, 125) based on the received voice signal Can transmit The server 110 may be a server of the SKYPE system.

The video conferencing devices 121, 123, and 125 may be implemented as information processing devices capable of displaying A / V signals. That is, the video conferencing devices 121, 123, and 125 are mobile phones, smart phones, notebook computers, digital broadcasting terminals, personal digital assistants (PDAs), portable multimedia players (PMPs), navigation, and the like. The terminal may be a fixed terminal such as a digital TV, a desktop computer, or the like.

2 is a block diagram showing the configuration of a preferred embodiment of a videoconferencing apparatus according to the present invention.

2, the video conferencing device 200 according to the present invention includes a voice receiver 205, a voice processor 210, a controller 215, a display 220, a user interface 225, and a camera 230. ), An image processor 235, a network interface unit 240, a storage unit 245, a tuner unit 250, a demodulator 255, and a demultiplexer 260. The video conferencing devices 121, 123, and 125 of FIG. 1 may be the video conferencing device 200.

The voice receiver 205 records the voice and outputs the recorded voice signal. The voice receiver 205 may be implemented as a microphone.

The voice processor 210 compresses the voice signal output by the voice receiver 205. Here, the speech processor 210 may compress the speech signal using H.261, H.263, and H.264 which are international standard algorithms.

In addition, the voice processing unit 210 restores the voice signal received by the network interface unit 240. Here, the voice processor 210 may restore the voice signal using the corresponding algorithm according to the algorithm in which the voice signal is compressed.

The camera 230 photographs a subject to generate a captured image signal.

The image processor 235 compresses the generated captured image signal to generate an image signal. If the signal output from the camera 230 is an analog signal, the image processor 235 includes an A / D converter, converts the analog signal output from the camera 230 into a digital signal, and converts the converted digital signal. It can be compressed. Here, the image processor 235 may compress the captured image signal using H.261, H.263, and H.264 which are international standard algorithms.

In addition, the image processor 235 restores the image signal output from the network interface unit 240. Here, the image processor 235 may reconstruct the image signal using the corresponding algorithm according to the algorithm in which the image signal is compressed, and H.261, H.263, and H.264 may be used as the compression algorithm.

The controller 215 controls the audio signal output from the audio processor 210 and the video signal output from the video processor 235 to be transmitted to another video conference apparatus or video conference server connected to the communication network through the network interface 240. do. The audio signal and the video signal may be multiplexed and transmitted, and may be transmitted separately.

The controller 215 controls the voice signal and the video signal received by the network interface unit 240 to be transmitted to the voice processor 210 and the image processor 235, respectively.

The controller 215 calculates an average luminance level (VCS) of the image frame included in the image signal restored by the image processor 235. The controller 215 adjusts an image quality element for displaying the video signal according to the calculated average luminance level. The image quality element may include at least one of brightness and sharpness. The image signal reconstructed by the image processor 235 may be a signal obtained by compressing a video conference image.

In an embodiment, the controller 215 may adjust brightness and sharpness by adjusting pixel values of each pixel of the actual image frame in software.

In another embodiment, the controller 215 may adjust picture quality (PSM) data by adjusting PSM (Picture Screen Mode) data.

The controller 215 may adjust the image quality element for displaying the video signal when the automatic image quality control is set, and may not adjust the image quality element when the automatic image quality control is not set. The automatic image quality control may be set as a default and the automatic image quality control may be changed according to a user command.

The user interface unit 225 receives a user mode request for setting and releasing automatic picture quality adjustment or a service mode change command for changing the service mode from the user. The controller 215 changes the service mode according to the input service mode change command. If the service mode indicates IPTV broadcasting, the controller 215 controls the display 220 to display a broadcast signal included in the IP packet received from the network interface 240. If the service mode indicates RF broadcast, the controller 215 controls the display 220 to display the RF broadcast signal received from the tuner 250. If the service mode instructs videoconferencing, the controller 215 controls the display 220 to display the videoconferencing image. Herein, the service mode may indicate multiple modes. When the service mode indicates the multi-mode, the controller 215 may control the display 220 to display all the services included in the multi-mode. That is, if the service mode instructs the RF broadcast and video conferencing, the controller 215 controls the display unit 220 to display the RF release signal and the video conference image on the screen at the same time.

The network interface unit 240 receives the packets received from the network and transmits the packets to the network. The network interface unit 240 may receive an IP packet including a broadcast signal or Internet service data from a service providing server through a network. The broadcast signal may be a real time broadcast signal, and the Internet service data may be data about an Internet service. Internet services include CoD (Content's on Demand) services, YouTube services, information services such as weather, news, local information and search, entertainment services such as games and karaoke, and communication services such as TV mail and TV SMS (Short Message Service). It means a service that can be provided through the Internet. Accordingly, in the present invention, the video conference apparatus includes a network TV, a web TV, and a broadband TV.

The network interface unit 240 receives an audio signal and a video signal from the server 110 or the video conferencing devices 121, 123, and 125. The received audio signal and the video signal may be multiplexed with each other, or may be transmitted separately. In addition, the audio signal and the video signal may be transmitted through a dedicated line, respectively, and may be transmitted in a payload of an IP packet.

The network interface unit 240 transmits the audio signal output from the audio processor 210 and the video signal output from the video processor 235 to the server 110 or the video conferencing devices 121, 123, and 125. Here, the network interface unit 240 may transmit the audio signal and the video signal through different lines, and may multiplex the audio signal and the video signal and transmit the same to one line. In addition, the network interface unit 240 may transmit a voice signal and a video signal in the form of an IP packet.

The storage unit 245 may store a program for processing and controlling each signal in the controller 215, and may store a video signal, an audio signal, or a data signal that has been processed. In addition, the storage unit 245 may perform a function for temporarily storing the audio signal and the video signal output to the audio processor 210 and the image processor 235.

The storage unit 245 may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), It may be implemented as a storage medium of at least one type of RAM, ROM (EEPROM, etc.).

The tuner 250 selects an RF broadcast signal corresponding to a channel selected by a user from among RF (Radio Frequency) broadcast signals received through an antenna, and converts the selected RF broadcast signal into an intermediate frequency signal or a baseband video or audio signal. To convert. For example, if the selected RF broadcast signal is a digital broadcast signal, it is converted into a digital IF signal (DIF). If the analog broadcast signal is converted into an analog baseband video or audio signal (CVBS SIF). That is, the tuner 250 may process a digital broadcast signal or an analog broadcast signal.

Also, the tuner 250 may receive an RF broadcast signal of a single carrier according to the Advanced Television System Committee (ATSC) scheme or an RF broadcast signal of multiple carriers according to the digital video broadcasting (DVB) scheme.

According to another embodiment of the present invention, the videoconferencing apparatus 200 may include at least two tuner parts. When the second tuner unit includes at least two tuner units, the second tuner unit selects an RF broadcast signal corresponding to a channel selected by a user from among RF broadcast signals received through an antenna, similarly to the first tuner unit, and intermediates the selected RF broadcast signal. Convert to a frequency signal or baseband video or audio signal.

Also, the second tuner may sequentially select the RF broadcast signals of all the broadcast channels stored through the channel memory function among the received RF broadcast signals and convert the RF broadcast signals into intermediate frequency signals or baseband video or audio signals. The second tuner may periodically perform the conversion of all broadcast channels. Accordingly, the video conferencing device 200 may display images of the broadcast signals converted through the first tuner unit and provide images of various channels converted through the second tuner unit in the form of thumbnails. In this case, the first tuner unit converts the main RF broadcast signal selected by the user into an intermediate frequency signal or a baseband video or audio signal, and the second tuner unit sequentially and periodically selects all the RF broadcast signals except for the main RF broadcast signal. This may be converted into an intermediate frequency signal or a baseband video or audio signal.

The demodulator 255 receives a digital IF signal DIF converted by the tuner 250 and performs a demodulation operation. For example, when the digital IF signal output from the tuner 250 is an ATSC scheme, the demodulator 255 performs 8-VSB (8-Vestigal Side Band) demodulation. As another example, when the digital IF signal output from the tuner 250 is a DVB scheme, the demodulator 255 performs coded orthogonal frequency division modulation (COFDMA) demodulation.

In addition, the demodulator 255 may perform channel decoding. To this end, the demodulator 255 includes a trellis decoder, a de-interleaver, a reed solomon decoder, and the like. Soloman decryption can be performed.

The demodulator 255 may output a stream signal TS after performing demodulation and channel decoding. In this case, the stream signal may be a signal multiplexed with a video signal, an audio signal, or a data signal. For example, the stream signal may be an MPEG-2 Transport Stream (TS) multiplexed with an MPEG-2 standard video signal, a Dolby AC-3 standard audio signal, and the like. Specifically, the MPEG-2 TS may include a header of 4 bytes and a payload of 184 bytes.

In addition, in the case of a videoconferencing apparatus equipped with at least two tuners, a corresponding number of demodulators may be provided. The demodulator may be provided separately according to the ATSC scheme and the DVB scheme.

The demultiplexer 260 demultiplexes the stream signal output from the demodulator 255 into an image signal, an audio signal, or a data signal to output to the image processor 235, the audio processor 210, and the controller 215. Can be. The image processor 235 may restore the image signal output from the demultiplexer 260 and output the image signal to the display 220. The voice processor 210 restores the audio signal output from the demultiplexer 260. To be output to the display unit 220.

3 is a diagram illustrating an embodiment of a picture screen mode (PSM) setting screen.

Referring to FIG. 3, the controller 215 may adjust picture quality mode by adjusting PSM (Picture Screen Mode) data. The controller 215 may adjust a picture quality element for displaying a 3D image by adjusting brightness and sharpness among PSM data. Here, the PSM data may be stored in the storage unit 245.

In an embodiment, when the average luminance level APL is smaller than a preset level value, the controller 215 increases the value of '40', which is the currently set brightness, and '70', which is a value of sharpness. Let's do it. In addition, when the average luminance level APL is greater than a preset level value, the controller 215 decreases '40', which is a value of the currently set brightness. In addition, when the average luminance level is the same as the previously set level value, the controller 215 maintains '40' which is the currently set brightness and '70' which is the value of sharpness.

4 is a diagram illustrating an embodiment of a reference table for adjusting image quality.

Referring to FIG. 4, the storage unit 245 may store a reference table for adjusting image quality. The reference table may include a value indicating an amount of adjustment of an image quality element according to a range.

The reference table 400 divides the average luminance level APL into 'up', 'mid', and 'down' and includes a value indicating an adjustment amount of brightness and sharpness within a corresponding range. Here, the division of the average brightness level range may be a value set as a default and may be set differently according to a user command. For example, 'upper' may have an average luminance level (APL) of 80 or more, 'middle' may have an average luminance level (APL) of less than 80 and over 30, and 'low' has an average luminance level (APL) of 30. It may be

The controller 215 may adjust the image quality element using the reference table 400. When the average luminance level APL of the video frame included in the video conference image is included in the image, the controller 215 decreases the brightness by 10%. Herein, the increase and decrease amounts of brightness and sharpness may be values set at the time of product production or may be values adjusted by a user. In addition, the corrected increase and decrease can be initialized to the value set at the time of production. In this case, the videoconferencing apparatus may provide a menu for initializing the corrected increase and decrease amounts to a value set at the time of production of the product.

In addition, when the average luminance level APL of the video frame included in the video conference image is included in the middle, the controller 215 maintains brightness and clarity. When the average luminance level APL of the video frame included in the video conference image is included in the lower level, the controller 215 increases the brightness and the sharpness by 10%, respectively.

5 is a flowchart illustrating a process of performing a preferred embodiment of the method for displaying a videoconferencing image according to the present invention.

Referring to FIG. 5, the network interface unit 240 receives an image signal (S500). The video signal may be a signal in which a video conference video is compressed, and the network interface unit 240 may receive a video signal from the server 110 or the video conferencing devices 121, 123, and 125. In addition, the network interface unit 240 may receive an audio signal and a data signal together with the video signal, and may receive a multiplexed signal.

The image processor 235 restores the received image signal (S505). Here, the image processor 270 may reconstruct the image signal using the algorithm according to the algorithm in which the image signal is compressed, and H.261, H.263, and H.264 may be used as the compression algorithm.

The controller 215 checks whether automatic image quality adjustment is set (S510). The automatic image quality control may be set as a default, and the controller 215 may release or reset the automatic image quality control according to a user command.

The controller 215 calculates an average luminance level APL of the video frame included in the restored video signal (S515).

The control unit 215 checks in which range the calculated average luminance level APL belongs (S520). Herein, the controller 215 may check whether the calculated average luminance level APL is greater than or equal to a preset first level value, and determine whether the calculated average luminance level APL is smaller than a preset second level value.

If the average luminance level APL is equal to or greater than a first level value previously set, the controller 215 decreases an image quality element for displaying a restored image signal (S525). Here, the image quality element may include at least one of brightness and sharpness. In addition, the controller 215 may reduce the picture quality mode by reducing PSM (Picture Screen Mode) data stored in the storage 245. In addition, the controller 215 may adjust the image quality element using the reference table 400 illustrated in FIG. 4.

If the average luminance level APL is smaller than the first level value previously set and is equal to or greater than the second level value previously set, the controller 215 maintains an image quality element for displaying the restored video signal (S530). Here, the image quality element may include at least one of brightness and sharpness.

When the average luminance level APL is smaller than the second preset level value, the controller 215 increases the quality factor for displaying the reconstructed video signal. Here, the image quality element may include at least one of brightness and sharpness. In addition, the controller 215 may increase the picture quality mode by increasing PSM (Picture Screen Mode) data stored in the storage 245. In addition, the controller 215 may adjust the image quality element using the reference table 400 illustrated in FIG. 4.

The display 220 displays the reconstructed video signal according to the adjusted image quality factor (S540). Herein, the display unit 220 includes a video signal included in the broadcast signal received from the tuner unit 250, a video signal included in the broadcast signal received from the network interface unit 240, and video conferencing under the control of the controller 215. At least one of the image signals may be displayed. The controller 215 may control the display 220 to selectively display at least one of the image signals according to the set service mode. The service mode may be changed according to the service mode change command. The user interface unit 225 may receive a service mode change command from the user, and the controller 215 may change the service mode according to the received service mode change command.

The present invention can also be embodied as computer-readable codes on a computer-readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer apparatus is stored. Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and may be implemented in the form of a carrier wave (for example, transmission via the Internet) . The computer-readable recording medium may also be distributed to networked computer devices so that computer readable code can be stored and executed in a distributed manner.

Although the preferred embodiments of the present invention have been shown and described above, the present invention is not limited to the specific preferred embodiments described above, and the present invention belongs to the present invention without departing from the gist of the present invention as claimed in the claims. Various modifications can be made by those skilled in the art, and such changes are within the scope of the claims.

Claims (18)

Receiving a video conference video;
Calculating an average brightness level of a video frame included in the received video conference image;
Adjusting an image quality element for displaying the video conference image according to the calculated average luminance level; And
And displaying the videoconferencing image according to the adjusted picture quality element. The method of claim 1,
And the quality factor comprises at least one of brightness and clarity. The method of claim 1,
Adjusting the quality factor,
Comparing the calculated average luminance level with a preset level value; And
And if the calculated average luminance level is greater than the level value, reducing the value of the quality factor. The method of claim 1,
Adjusting the quality factor,
Comparing the calculated average luminance level with a preset level value; And
If the calculated average brightness level is less than the level value, increasing the value of the quality factor. The method of claim 1,
In the adjusting of the image quality factor,
A method of displaying videoconferencing video, characterized by adjusting image quality by adjusting PSM (Picture Screen Mode) data. The method of claim 1,
And when the automatic image quality adjustment is set, adjusting the image quality element. The method of claim 1,
Receiving a radio frequency (RF) broadcast signal;
Demodulating the received RF broadcast signal; And
And demultiplexing the demodulated RF broadcast signal into a video signal, an audio signal, and a data signal. The method of claim 7, wherein
In the displaying step,
And displaying at least one of the demultiplexed video signal and the video conference video according to the set service mode. The method of claim 1,
Receiving an IP packet including a broadcast signal,
In the display step,
And displaying at least one of the received broadcast signal and the video conference video according to the set service mode. A network interface unit for receiving a video conference image;
A controller configured to calculate an average luminance level of an image frame included in the received image and to adjust an image quality factor for displaying the video conference image according to the calculated average luminance level; And
And a display unit for displaying the video conference image according to the adjusted picture quality elements. The method of claim 10,
And the quality factor comprises at least one of brightness and clarity. The method of claim 10,
The control unit,
And comparing the calculated average luminance level with a preset level value, and when the calculated average luminance level is greater than the level value, decreases the value of the image quality element. The method of claim 10,
The control unit,
And comparing the calculated average luminance level with a preset level value, and increasing the value of the image quality element when the calculated average luminance level is smaller than the level value. The method of claim 10,
The control unit,
A video conferencing device characterized by adjusting image quality elements by adjusting PSM (Picture Screen Mode) data. The method of claim 10,
The control unit,
And adjusting the image quality element when automatic image quality control is set. The method of claim 10,
The network interface unit further receives an IP packet including a broadcast signal,
And the controller controls at least one of the received broadcast signal and the video conference image to be displayed on a screen according to a set service mode. The method of claim 10,
A tuner for receiving a radio frequency (RF) broadcast signal;
A demodulator for demodulating the received RF broadcast signal and outputting a stream signal; And
And a demultiplexer for demultiplexing the output stream signal into a video signal, an audio signal, and a data signal. The method of claim 17,
The control unit,
And at least one of the received video conference video and the demultiplexed video signal is displayed according to a set service mode.

Images