KR20170039629A - System for providing high-definition video communication and video process method of thereof, and computer readable medium for performing video call application - Google Patents

Abstract

According to the present invention, disclosed are a high-definition video call system capable of executing a high-definition video call between different devices without improving performance of a set-top TV set, a video processing method thereof, and a computer-recordable recording medium executing a video call application. The system comprises: a call request reception unit receiving a video call request from a broadcast reception device; an input unit receiving video and audio signals through a camera and a microphone according to a video call connection request received from a user; an encoder encoding the inputted video and audio signal to generate outgoing video call data; and a transmission unit transmitting the generated outgoing video call data to an external video call device through a network or the broadcast reception device. Therefore, using an existing wireless communication terminal without adopting additional technologies of a set-top box, a high-definition large screen video call is provided through the broadcast reception device (TV set) including a low specification set-top box.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a high-definition video communication system, an image processing method thereof, and a computer-readable recording medium for executing a video communication application. BACKGROUND OF THE INVENTION 1. Field of the Invention [0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a high-definition video call system, an image processing method thereof, and a computer readable recording medium for executing a video call application. More particularly, the present invention relates to a high- And more particularly, to a high-quality video communication system and a video processing method thereof, and a computer-readable recording medium for executing a video communication application.

Generally, digital TV not only provides broadcasting service in high quality through terrestrial broadcasting, but also processed various contents. Furthermore, recently, digital TV has also expanded its video call service using a set-top box.

This service is possible because it provides connection method based on internet data service using e-mail address as well as connection method based on telecommunication such as IMS. For example, Apple's face-time service can be a good example.

However, in order to provide a video call service, a video necessary for a call is captured using a USB camera, and a voice inputted together with the photographed video is encoded to be transmitted to a mobile phone or a digital TV of the other party, At this time, the digital TV or set-top box requires additional hardware configuration such as a camera or a microphone, and the performance of a digital TV or a set-top box must be increased due to an increase in load during processing for image encoding.

Moreover, the conventional digital TV has a problem that it is difficult to process a high-quality image of 1080P @ 30fps or higher due to a lack of a USB interface such as a USB camera.

In order to process such a high-definition image, a performance exceeding the encoding processing of a set-top box or a TV is required. Accordingly, there is a need for a new method for video call while watching video on a large screen of a TV without improving the performance of the current set-top box TV.

1. A video call system using an IP set-top box. 2. Description of the Related Art 2. A display device capable of providing a mobile communication video call and a method for providing a video call in the device.

SUMMARY OF THE INVENTION The present invention has been made in order to solve the above problems, and it is an object of the present invention to provide a mobile terminal capable of video call with high picture quality and a broadcast receiving apparatus capable of decoding and outputting a signal of a current video call, An image processing method thereof, and a computer-readable recording medium for executing a video call application.

The features of the present invention for achieving the objects of the present invention as described above and performing the characteristic functions of the present invention described below are as follows.

According to an embodiment of the present invention, there is provided a communication apparatus including a call request receiving unit receiving a video call request from a broadcast receiving apparatus, an input unit receiving an image signal and a voice signal through a camera and a microphone in response to a video call connection request from the user, An encoding unit for encoding a signal and a voice signal to generate outgoing video call data, and a transmitter for transmitting the generated outgoing video call data to an external video communication apparatus through a network.

Here, the transmitting unit may transmit the generated outgoing video call data to the broadcast receiving apparatus and may be transmitted to the external video communication apparatus. The wireless communication terminal may further include a pairing unit for performing a short-distance communication with the broadcast receiving apparatus.

Also, the pairing unit may pair with the broadcast receiving apparatus through the WIFI-type AP through the short distance communication.

The pairing unit may perform the pairing upon receiving the authentication information displayed on the broadcast receiving apparatus.

Also, the pairing unit may transmit the pairing information indicating whether or not the broadcast receiving apparatus is paired to the broadcast receiving apparatus, to the network server to transmit the pairing information to the address book server.

In addition, the transmitting unit may transmit the generated outgoing video call data to the external video communication apparatus through the AP in the WIFI format.

The wireless communication terminal may further include an interface unit for displaying a video call request received from the broadcast receiving apparatus and receiving a video call connection request from the user.

In addition, the call request receiving unit may receive information indicating that the video call connection is established from the broadcast receiving apparatus in response to the video call connection request.

The wireless communication terminal may further include a broadcast receiver control unit for decoding the received video call data received from the network in response to a video call connection request and controlling the display unit to display the decoded received video call data on a display screen of the broadcast receiver.

The wireless communication terminal may further include a remote control unit for performing a remote control function for controlling the broadcast receiving apparatus.

In addition, the wireless communication terminal may further include an address book providing unit for providing a remote address book to receive the video call connection request.

The wireless communication terminal may further include an input image display unit for displaying an image input through the input unit.

According to an embodiment of the present invention, there is provided a wireless communication terminal, comprising: a pairing unit for pairing with a wireless communication terminal; A decoding unit for decoding broadcast data received from the network and outputting the decoded broadcast data, a call request receiving unit for receiving a video call request from the network, a transmitting unit for transmitting the received video call request to the paired wireless communication terminal, And a receiving video call output unit for receiving the received video call data from the network in response to the video call connection request and decoding the received video call data through the decoding unit to control the output of the video and audio.

Here, the broadcast receiving apparatus may further include a source video communication data receiver for receiving the source video communication data encoded from the paired wireless communication terminal, and the transmitter may transmit the received source video communication data to the network.

Here, the pairing unit may pair with the wireless communication terminal through short-range wireless communication.

Also, the pairing unit can pair with the wireless communication terminal through short-range communication through a WIFI-type AP.

In addition, the pairing unit may perform pairing upon receipt of the authentication information displayed on the broadcast receiving apparatus through the wireless communication terminal.

In addition, the pairing unit may transmit the pairing information indicating whether or not the wireless communication terminal is paired to the network for transmitting the pairing information to the address book server.

The broadcast receiving apparatus may further include a broadcast output unit for outputting the broadcast data decoded from the decoding unit as a broadcast image and a broadcast sound, A part of the broadcast image area displayed through the broadcast output unit when the connection is connected, the partial area including a transparent or opaque area as an upper layer, control is performed such that a decoded image is preferentially displayed or broadcasted through the broadcast output unit It is possible to control so that a decoded image is displayed so as not to overlap with the image area and to output a decoded voice prior to the broadcast voice output through the broadcast output unit.

In addition, when the video call connection is established while the broadcast data is being output through the broadcast output unit, the received video call output unit preferentially decodes the decoded image in a part of the broadcast image area displayed through the broadcast output unit And control the voice of the video call so that the voice of the video call is outputted through the wireless communication terminal.

According to still another aspect of the present invention, there is provided a method for transmitting a video call request, the method comprising: receiving a video call request from a broadcast receiving apparatus in a call request receiving unit; receiving an image signal and a voice signal through a camera and a microphone, Generating an outgoing video call data by encoding an input video signal and an audio signal and transmitting the generated outgoing video call data to an external video communication apparatus through a network in a transmission unit, An image processing method of a wireless communication terminal is provided.

Herein, in the step of transmitting to the external video communication apparatus, the generated outgoing video call data may be transmitted to the broadcasting receiver and transmitted to the external video communication apparatus.

According to another aspect of the present invention, there is provided a method of controlling a mobile communication terminal, the method comprising: pairing a wireless communication terminal with a pairing unit, decoding broadcast data received from a network, Transmitting the received video call request to the paired wireless communication terminal, receiving the received video call data from the network in response to the video call connection request from the user, And outputting the decoded image and audio to be output through the decoding unit.

Here, the image processing method of the broadcast receiving apparatus may include receiving the outgoing video call data encoded from the paired wireless communication terminal by the outgoing video call data receiving unit, and transmitting the received outgoing video call data from the transmitting unit to the network As shown in FIG.

According to an embodiment of the present invention, there is provided a video communication application installed in a wireless communication terminal, comprising: receiving a video call request from a broadcast receiving apparatus; receiving a video call connection request from a user, Receiving an image signal and an audio signal through a microphone for inputting an image signal and an audio signal, generating an outgoing video call data by encoding the input image signal and an audio signal, and transmitting the generated outgoing video call data to the broadcast receiving apparatus or the network To the external video communication apparatus through the wireless communication terminal, the video communication application installed in the recording medium of the wireless communication terminal is provided.

According to another aspect of the present invention, there is provided a video call application installed in a broadcast receiving apparatus, the method comprising: pairing with a wireless communication terminal; decoding broadcast data received from a network; Receiving the received video call data from the network according to a video call connection request from the user, decoding the received video call data through the decoding unit, A video call application installed in a recording medium of the broadcast receiving apparatus is provided to execute a step of controlling the output of voice.

Here, the video call application may include a step of receiving the outgoing video call data encoded from the paired wireless communication terminal and transmitting the received outgoing video call data to the network, Can be installed.

As described above, according to the present invention, it is possible to provide a high-quality large-screen video call through a broadcast receiving apparatus (TV) including a low-set-top box using a conventional wireless communication terminal without introducing additional technology of a set- .

In addition, according to the present invention, there is an effect of providing a high-quality video call service by using a wireless communication terminal and a broadcast receiving apparatus without an external camera. In this case, the voice transmission can utilize the voice call function (e.g., one call) of the existing mobile terminal, and the video can provide a high-quality video call service while utilizing the TV.

Also, according to the present invention, the video and audio of the other party are viewed and listened through the TV or mobile terminal, and the voice and video are transmitted to the external video communication apparatus of the other party using the mobile terminal and the broadcast receiving apparatus, It has the effect of making calls.

Particularly, the present invention is capable of selectively making a video call without regard to a place. For example, it is possible to select a video call between mobile terminals in the outside, and to make a high-quality video call between a mobile terminal and an external video communication apparatus, a mobile terminal, a broadcast receiving apparatus, and an external video communication apparatus.

1 is a block diagram illustrating an example of a high-definition video call system according to an exemplary embodiment of the present invention.
FIG. 2 is a block diagram illustrating an example of the wireless communication terminal shown in FIG. 1 in more detail.
3 is a block diagram illustrating a further configuration of the wireless communication terminal shown in FIG.
FIG. 4 is a block diagram showing an example of the broadcast receiving apparatus shown in FIG. 1 in more detail.
5 is a display screen showing an example of a display screen according to execution of a reception video call output unit of the broadcast receiving apparatus shown in FIG.
FIG. 6 is a display screen showing another example of the state of the display screen according to the execution of the reception video call output unit shown in FIG.
7 is a flowchart illustrating an example of an image processing method according to an embodiment of the present invention.
8 is a flowchart showing an example of a method added to the image processing method shown in FIG.
9 is a flowchart illustrating another example of the image processing method according to an embodiment of the present invention.
FIG. 10 is a flowchart showing a more specific example of step S240 of the image processing method shown in FIG.
FIG. 11 is a flowchart specifically showing the step S240 of the image processing method shown in FIG. 9 as another example.
FIG. 12 is a block diagram showing an example of a recording medium installed in the wireless communication terminal shown in FIG. 1. Referring to FIG.
13 is a block diagram showing an example of a recording medium additionally provided to the broadcast receiving apparatus shown in FIG.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings, so that those skilled in the art can easily carry out the present invention. In the drawings, like reference numerals refer to the same or similar functions throughout the several views.

<Example of system>

1 is a block diagram showing an example of a high-definition video communication system according to an embodiment of the present invention.

1, a high-definition video call system 1000 according to an exemplary embodiment of the present invention includes a wireless communication terminal 100, a broadcast receiving apparatus 200, a network 300, an external video communication apparatus 400, And an address book server 500.

First, the wireless communication terminal 100 receives an image signal and a voice signal from a user, encodes the image signal and a voice signal, and generates outgoing video call data as a result of encoding. The generated outgoing video call data may be transmitted to the external video communication apparatus 400 through the broadcast receiving apparatus 200 and the network 300 or may be transmitted directly to the external video communication apparatus 400 through the network 300 Lt; / RTI &gt;

In this case, the external video communication apparatus 400 receiving the outgoing video call data may be any one of a digital TV, a smart TV, and an IP TV, a digital TV including a set-top box, a smart TV, and an IP TV.

As described above, the wireless communication terminal 100 is capable of processing originated video and audio, and is also involved in the received video and audio processing transmitted from the external video communication apparatus 400, for example, a wireless communication terminal or a digital TV can do.

For example, the wireless communication terminal 100 can receive a video call request received from the external video communication apparatus 400 through the broadcast receiving apparatus 200. At this time, the wireless communication terminal 100 and the broadcast receiving apparatus 200 are connected in advance through short-range communication such as wireless LAN, WiFi, Bluetooth communication or NFC communication, And receives a video call request from the broadcast receiving apparatus 200.

The wireless communication terminal 100 may notify the broadcast receiving apparatus 200 of the approval result in a short distance communication in response to the received video call request. In this case, the broadcast receiving apparatus 200 receives the received video call data from the external video communication apparatus 400. At this time, the received video call data means the outgoing video information related to the video call sent by the other party.

The broadcast receiving apparatus 200 can decode the received video call data through a decoding unit, and output an image and a voice. At this time, the output voice may be transmitted to the wireless communication terminal 100 according to a predetermined request between the wireless communication terminals 100.

For example, an image may be output on the display screen of the broadcast receiving apparatus 200, and the voice may be transmitted to the wireless communication terminal 100 in accordance with a predetermined request.

As described above, the broadcast receiving apparatus 200 plays a role of relaying a video call between the wireless communication terminal 100 and the external video communication apparatus 400 as described above. The broadcast receiving apparatus 200 may be one of a digital TV, an IPTV, and a smart TV, a digital TV including a set-top box, an IPTV, and a smart TV.

Further, the broadcast receiving apparatus 200 further receives broadcast data from the network 300 and displays at least one of the broadcast data and / or the received video call data on the display screen, or superimposes the two on the display screen It can also be displayed.

Such an example will be described in more detail below.

The network 300 may be configured without discriminating the communication mode such as a wired network or a wireless network formed between the broadcast receiving apparatus 200 and the external video communication apparatus 400. [

The external video communication apparatus 400 may receive the outgoing video communication data transmitted from the wireless communication terminal 100 through the broadcast receiving apparatus 200 and the network 300 or transmit the received video communication data to the wireless communication terminal 100. [ Through the network 300, and generates reception video call data as a response thereto, and transmits the reception video call data to the broadcast receiving apparatus 200 as described above.

To this end, the external video communication apparatus 400 may include at least one of a set-top box, a digital TV, and a counterpart's wireless communication terminal which can be connected to the network 300.

The external video communication apparatus 400 is a video communication apparatus of the other party corresponding to the wireless communication terminal 100 and / or the broadcast receiving apparatus 200 as described above. The external video communication apparatus 400 includes a digital TV, an IPTV And at least one of a smart TV and a wireless communication terminal, or may include at least one of a digital TV including a set-top box, an IPTV, a smart TV, and a wireless communication terminal.

Alternatively, the external video communication apparatus 400 may be configured in the same manner as the wireless communication terminal 100 and the broadcast receiving apparatus 200 described above or in a configuration corresponding to either of them. Or, it may mean a switching device of the network 300 for relaying a kind of video call data.

As described above, in this embodiment, the image related to the video call of the other party is outputted to the broadcast receiving apparatus 200, the audio related to the video call is selectively outputted to the broadcast receiving apparatus 200 and the wireless communication terminal 100, The video and audio related to the outgoing video call generated in the wireless communication terminal 100 may be transmitted to the external video communication apparatus 400 of the other party through the broadcast receiving apparatus 200 or may be directly transmitted to the external video communication apparatus 400 through the network 300. [ The video call can be carried out on the large screen and the high-quality video call can be performed through the low-capacity broadcast receiving apparatus 200 and / or the external video communication apparatus 400.

Lastly, the address book server 500 can receive and store the pairing information, which is a result of being paired between the broadcast receiving apparatus 200 and the wireless communication terminal 100, from the broadcast receiving apparatus 200 or the wireless communication terminal 100. The received pairing information may be used by the external video communication apparatus 400 to identify the broadcast receiving apparatus 200 or the wireless communication terminal 100.

For example, the external video communication apparatus 400 can access the address book server 500 and confirm that there is pairing information, so that the video communication data can be transmitted to the broadcasting receiver 200 of the other party.

However, if the pairing information is not confirmed, it can be known that the pairing is not performed between the wireless communication terminal 100 and the broadcast receiving apparatus 200, so that the external video communication apparatus 400 can transmit the received video call The mobile communication terminal 100 will immediately transmit the received video call data without sending the data.

Hereinafter, one aspect of the wireless communication terminal 100 will be described in detail.

<Examples of terminals>

2 is a detailed block diagram of an example of the wireless communication terminal 100 shown in FIG.

2, the wireless communication terminal 100 according to an exemplary embodiment of the present invention includes a call request receiving unit 110 receiving a video call request from the broadcast receiving apparatus 200, An input unit 120 for receiving an image signal and a voice signal through the camera 101 and the microphone 102, an encoding unit 130 for encoding the input image signal and voice signal to generate outgoing video call data, And a transmitting unit 140 transmitting the video call data to the broadcast receiving apparatus 200 or transmitting the video call data to the external video communication apparatus 400 through the network 300 or the WIFI AP.

Here, the video call connection request may be a request input by the user to make a video call to the external video communication apparatus 400 of the other party using the wireless communication terminal 100. [

<Additional Configuration Example of Terminal>

FIG. 3 is a block diagram showing a further configuration of the wireless communication terminal 100 shown in FIG.

3, the wireless communication terminal 100 according to an exemplary embodiment of the present invention includes a pairing unit 150, an interface unit 160, a broadcast receiving device control unit 170, a remote control unit 180, (190) and an input image display unit (195).

The wireless communication terminal 100 may further include a pairing unit 150 for receiving a video call request from the broadcast receiving apparatus 200 or transmitting the transmitted video call data to the broadcast receiving apparatus 200.

The pairing unit 150 performs a role of pairing the wireless communication terminal 100 and the broadcast receiving apparatus 200 through short-range communication. The pairing unit 150 may be a wireless LAN, a WIFI, a Bluetooth, a zigbee, a WFD, an ultra wideband (UWB), a Bluetooth low energy (BLE) (Near Field Communication), and the like.

Preferably, the WIFI AP can be used for short-distance communication between the pairing unit 150 and the broadcast receiving apparatus 200.

Furthermore, the pairing unit 150 can perform the pairing upon receipt of the authentication information displayed on the broadcast receiving apparatus 200.

For example, if the wireless communication terminal 100 displays authentication information arbitrarily generated in the broadcast receiving apparatus 200 when a pairing request is issued to the broadcast receiving apparatus 200, 100 and the authentication information displayed on the broadcast receiving apparatus 200 are the same, the pairing can be performed.

In addition, in one embodiment, the pairing unit 150 generates pairing information that is the result of the pairing when the pairing is performed between the broadcast receiving apparatuses 200, and transmits the pairing information to the address book server 500 through a network (e.g., mobile communication network) .

As described in FIG. 1, the pairing information may be used by the external video communication apparatus 400 to determine whether to send the video call data to the broadcast receiving apparatus 200 or the wireless communication terminal 100.

As described above, the pairing information is used so that the external video communication apparatus 400 can directly send the received video call data to the broadcast receiving apparatus 200 or the wireless communication terminal 100.

The interface unit 160 can receive a video call request from the broadcast receiving apparatus 200 to check whether the video call connection of the other party is requested from the broadcast receiving apparatus 200. [

In addition, the interface unit 160 may display the video call request received from the broadcast receiving apparatus 200 on the display screen. The video call request displayed on the display screen can be used to determine whether to make a video call between the broadcast receiving apparatus 200 and the wireless communication terminal 100 or between the wireless communication terminal 100 and the external video communication apparatus 400.

For example, in response to a displayed video call request, the broadcast receiving apparatus 200 performs a video call with the external video communication apparatus 400 of the other party or the wireless communication terminal 100 transmits a video call through the broadcast receiving apparatus 200 Can be performed.

Also, the interface unit 160 may receive a video call connection request from the user. The input video call connection request may be utilized in the input unit 120 as described above.

Next, the broadcast receiver control unit 170 decodes the received video call data received from the network 300 according to the video call connection request and transmits the decoded received video call data to the broadcast receiver 200 so as to be displayed on the display screen of the broadcast receiver 200. [ Can be controlled.

The broadcast receiving apparatus control unit 170 may control the broadcast receiving apparatus 200 to control the broadcast receiving apparatus 200 to receive and output a voice among the received video call data displayed on the broadcast receiving apparatus 200.

Next, the remote control unit 180 can perform a remote control function for controlling the broadcast receiving apparatus 200. [ For example, the broadcast receiving apparatus 200 can be controlled using the remote control unit 180 instead of the broadcast receiving apparatus control unit 170 described above.

Since the control object is similar to the function of the broadcast receiver control unit 170, the description thereof will be omitted.

Next, the address book provider 190 may provide the address book of the other party to receive the video call connection request as described above. At this time, the counterpart address book may be any one of ID, e-mail, telephone number, and IP address included in the external video communication apparatus 400 and capable of identifying the other party. Therefore, a video call connection request can be input through the other party's address book.

Finally, the input image display section 195 serves to display the image input through the input section 120 on the display screen. The image displayed on the display screen may be superimposed on the display screen together with other images.

&Lt; Example of Broadcast Receiving Apparatus >

FIG. 4 is a block diagram showing an example of the broadcast receiving apparatus shown in FIG. 1 in more detail.

4, a broadcast receiving apparatus 200 according to an exemplary embodiment of the present invention includes a pairing unit 210, a decoding unit 220, a call request receiving unit 230, a receiving video call output unit 240, An outgoing video call data receiving unit 250, And a transmission unit 260.

First, the pairing unit 210 performs a role of pairing the wireless communication terminal 100 and the broadcast receiving apparatus 200 through short-distance communication. The pairing unit 210 may be a wireless LAN, a Wi-Fi, a Bluetooth, a zigbee, a WFD, an ultra wideband (UWB) And a NFC (Near Field Communication) communication function.

Preferably, the WIFI AP can be used for short-distance communication between the pairing unit 150 and the broadcast receiving apparatus 200. Using the WIFI AP, it is possible to transmit or receive high-quality outgoing video call data and / or received video call data to the broadcast receiving apparatus 200.

Furthermore, the pairing unit 210 can perform the pairing upon receipt of the authentication information displayed on the broadcast receiving apparatus 200 through the wireless communication terminal 100. For example, if the wireless communication terminal 100 displays authentication information arbitrarily generated in the broadcast receiving apparatus 200 when a pairing request is issued to the broadcast receiving apparatus 200, 100 and the authentication information displayed on the broadcast receiving apparatus 200 are the same, the pairing can be performed.

In addition, when the pairing is performed between the wireless communication terminals 100, the pairing unit 210 may generate pairing information, which is a result of the pairing, and transmit the pairing information to the address book server 500 through a network (e.g., mobile communication network) .

1, the pairing information may be used by the external video communication apparatus 400 to determine which broadcast receiving apparatus 200 should send the received video communication data.

In this way, by using the pairing information, the external video communication apparatus 400 can easily transmit the received video call data to the designated broadcast receiving apparatus 200. [

Next, the decoding unit 220 may decode the broadcast data to receive the broadcast data from the network. The decoding unit 220 may be a codec.

The decoded broadcast data may be IPTV broadcast data including at least one of video data (e.g., still video, moving picture), voice data, image data, pop-up data, metadata and EPG data (Electronic Program Guide).

Next, the call request receiving unit 230 receives a video call request from the network 300. The received video call request may ultimately be the information requested from the external video communication device 400, for example, the wireless communication terminal of the other party and / or the broadcast receiving device.

The response to the video call request may be made in the broadcast receiving apparatus 200 or may be transmitted to the wireless communication terminal 100 so that the wireless communication terminal 100 may respond.

Next, the reception video call output unit 240 receives the video call connection request from the network 300 according to a video call connection request input from the user or a video call connection request received from the wireless communication terminal 100.

The received video call data is decoded through a decoding unit 220, for example, a codec (CODEC), so that the decoded picture and audio can be controlled so that the picture and sound are output to the output unit of the broadcast receiving apparatus 200.

Furthermore, the receiving video call output unit 240 may control the wireless communication terminal 100 to transmit the decoded image and / or voice to the wireless communication terminal 100 and output the decoded image and / or voice.

In this way, the decoded picture is outputted to the broadcast receiving apparatus 200 under the control of the reception video call output unit 240, and the voice is selectively outputted to the broadcast receiving apparatus 200 or the radio communication terminal 100 , And various options are available depending on the circumstances of the user.

Next, the outgoing video call data receiving unit 250 receives the outgoing video call data encoded from the paired wireless communication terminal 100. At this time, since the wireless communication terminal 100 encodes the outgoing video call data, the broadcast receiving apparatus 200 does not need to process the encoding. Therefore, it eliminates the need to install a high-specification set-top box.

Next, the transmitting unit 260 receives the video call request received by the call request receiving unit 230, transmits the received video call request to the paired wireless communication terminal 100, And can receive the approval result from the wireless communication terminal 100 through the short distance communication.

Accordingly, after the response result is received or the video call request of the call request receiving unit is processed, the receiving video call output unit 240 may be operated as described above.

Furthermore, the transmitting unit 260 may transmit the outgoing video call data received by the outgoing video call data receiving unit 250 to the external video communication apparatus 400 through the network 300.

In this case, the external video communication apparatus 400 may generate the reception video call data as a response to the source video communication data. The generated reception image call data may be transmitted to the reception image call output unit 240 described above via the network 300.

<Example of receiving video call output>

5 is a display screen showing an example of a display screen according to the execution of the reception video call output unit of the broadcast receiving apparatus shown in FIG.

5, the broadcast receiving apparatus 200 according to an exemplary embodiment of the present invention may further include a broadcast output unit 270.

The broadcast output unit 270 can output broadcast data including a broadcast image and a broadcast voice when it is decoded from the decoding unit 220. [ At this time, the broadcast image may be any one of a still image, a moving image, and an image image, and may be output in conjunction with EPG data (Electronic Program Guide).

In this case, the reception video call output unit 240 according to an embodiment stops the broadcast data when the video call is connected during the broadcast data output through the broadcast output unit 270, and transmits the video and / Or audio is output.

However, if a video call is connected during the broadcast data output through the broadcast output unit 270, the reception video call output unit 240 may preferentially prioritize a part of the broadcast image area displayed through the broadcast output unit 270 It is possible to control the broadcast image area so as to display the image related to the decoded video call (the video related to the video call of the other party or the video call related to the video call transmitted from the wireless terminal 100).

At this time, a part of the area of the broadcast image area may include a transparent or opaque area as an upper layer. Thus, in some areas of the transparent or opaque area, an image associated with the video call may be displayed in preference to the broadcast image.

Furthermore, the reception video call output unit 240 may control the broadcast voice and the decoded voice so that the decoded voice is output in priority to the broadcast voice output through the broadcast output unit 270. [

The decoded voice is voice information related to the video call transmitted from the external video communication apparatus 400 of the other party. However, the decoded voice may be transmitted to the wireless communication terminal 100 and output.

Ultimately, it can be said that the image of the other party in relation to the video call is outputted to the broadcast receiving apparatus 200, and the voice is outputted to the broadcast receiving apparatus 200 or the wireless communication terminal 100.

Alternatively, in one embodiment, the receiving video call outputting unit 240 may receive the video image from the broadcasting image output unit 270 and the decoded image (image related to the video call of the other party or transmitted from the wireless terminal 100) (I.e., a video related to a video call) is not overlapped with the display screen.

On the other hand, the reception video call output unit 240 can control the broadcast voice and the decoded voice so that the decoded voice is outputted in priority to the broadcast voice output through the broadcast output unit 270. [

As described above, in the present embodiment, it is preferable that the broadcast output screen is interrupted and the video call screen is outputted to the TV, but various examples may be taken such that the broadcast output screen is displayed as it is and the video call screen is displayed simultaneously or overlapping with the broadcast output screen .

In this case, the meaning of outputting the voice related to the video call may mean that the broadcast audio output is stopped, the voice related to the video call is outputted to the TV, the volume of the broadcast voice output is decreased, and the video call voice is controlled to be louder have.

&Lt; Another example of the reception video call output unit >

FIG. 6 is a display screen showing another example of the state of the display screen according to the execution of the reception video call output unit shown in FIG.

Referring to FIG. 6, the broadcast receiving apparatus 200 according to an embodiment of the present invention may further include a broadcast output unit 280.

The broadcast output unit 280 can output broadcast data including a broadcast image and a broadcast voice when it is decoded from the decoding unit 220. [ At this time, the broadcast image may be any one of a still image, a moving image, and an image image, and may be output in conjunction with EPG data (Electronic Program Guide).

In this case, when the video call is connected during the broadcast data output through the broadcast output unit 280, the reception video call output unit 240 according to the embodiment of the present invention transmits the broadcast image data It is possible to control the broadcast image area 104 such that a decoded image (including an image related to the received video call) is preferentially displayed in an upper layer form in a part of the area 104 (broadcast image layer).

As described above, when a decoded image (image layer) is preferentially displayed in an upper layer form, the broadcast image located in the lower layer can be turned off by touching it, thereby enabling the decoded image to be viewed or adjusting the decoded image size It can help me to watch bigger than broadcast video.

Furthermore, the reception video call output unit 240 controls the decoded voice to output a decoded voice prior to the broadcast voice output through the broadcast output unit 280, or controls the decoded voice or the pre- And can further control the decoded voice or the pre-decoded voice to be transmitted to the terminal 100 for output.

In this case, the voice associated with the video call is outputted prior to the broadcast voice. This means that the broadcast voice output is stopped and the voice related to the video call (reception) is outputted to the TV, or the voice output volume is reduced and the video call voice is heard It can mean control.

Preferably, however, it is preferable that the voice related to the video call (reception) is transmitted to the wireless communication terminal 100 and heard. It is possible to automatically control the voice communication related to the video call (reception) to be transmitted to the wireless communication terminal 100 when the wireless communication terminal 100 and the broadcast receiving apparatus 200 are paired, So that they can be transmitted in a corresponding manner.

<Example of Image Processing Method of Wireless Communication Terminal>

7 is a flowchart illustrating an example of an image processing method according to an embodiment of the present invention.

7, an image processing method (S100) according to an embodiment of the present invention encodes outgoing video call data input through the wireless communication terminal 100 and transmits it to the broadcast receiving apparatus 200 and the network 300, And receives the video call request transmitted from the external video communication apparatus 400 through the broadcast receiving apparatus 200 at the wireless communication terminal 100. [

In order to process the image, the image processing method (S100) may include steps S110 to S140. First, in step S110, the call request receiving unit 110 receives a video call request transmitted from the broadcast receiving apparatus 200. [

Thereafter, in step S120, an image signal and an audio signal may be input through the camera 101 and the microphone 102 in response to a video call connection request input from the user. The inputted video call connection request may be information input by the user to make a video call to the external video communication apparatus 400 of the other party using the wireless communication terminal 100. [

Thereafter, in step S130, the image signal and the voice signal input in step S120 are encoded to generate outgoing video call data in the encoding unit 130, and the generated outgoing video call data is received from the transmission unit 140, (140) to the broadcast receiving apparatus (200) or the external video communication apparatus (400).

The image processing method S100 is a method for receiving the video call request from the broadcast receiving apparatus 200 or transmitting the outgoing video call data to the broadcast receiving apparatus 200. The image processing method S100 is a method for transmitting the video call request to the pairing unit 150 of the wireless communication terminal 100 And performing a pairing operation between the wireless communication terminal 100 and the broadcast receiving apparatus 200 connected to each other through short-distance communication.

At this time, the pairing unit 150 may be a wireless LAN, a WIFI, a Bluetooth, a zigbee, a WFD, an ultra wideband (UWB), a Bluetooth low energy (BLE) Near Field Communication), and the like.

Preferably, the pairing unit 150 and the broadcast receiving apparatus 200 can perform pairing in the pairing unit 150 through short-distance communication between the pairing unit 150 and the broadcast receiving apparatus 200 through the WIFI-type AP.

Further, in step S150 according to an exemplary embodiment, the pairing unit 150 may perform pairing according to reception of the authentication information displayed on the broadcast receiving apparatus 200. [ For example, if the wireless communication terminal 100 displays authentication information arbitrarily generated in the broadcast receiving apparatus 200 when a pairing request is issued to the broadcast receiving apparatus 200, 100 and the authentication information displayed on the broadcast receiving apparatus 200 are the same, the pairing can be performed.

Accordingly, when the authentication between the wireless communication terminal 100 and the broadcast receiving apparatus 200 is completed and is paired via the short distance communication, the wireless communication terminal 100 receives the video call request as described above, To the broadcast receiving apparatus 200 or the external video communication apparatus 400 from the terminal 100.

In step S150, the pairing unit 150 generates pairing information, which is a result of the pairing, when the pairing unit 150 and the broadcast receiving apparatus 200 of the wireless communication terminal 100 are paired. To the address book server 500 through a network, for example, a mobile communication network.

The pairing information may be used by the external video communication apparatus 400 to determine which broadcast receiving apparatus 200 should send the received video call data.

At this time, the received video call data means the outgoing video information related to the video call sent by the other party.

In this way, by using the pairing information, the external video communication apparatus 400 can send the reception video communication data to the broadcast reception apparatus 200 directly.

&Lt; Additional Example of Image Processing Method in Wireless Communication Terminal >

8 is a flowchart showing an example of a method added to the image processing method shown in FIG.

Referring to FIG. 8, the image processing method (S100) according to an embodiment of the present invention may further include steps S160 through S190 and S195 in which image processing is performed in the wireless communication terminal 100.

First, in step S160, the interface unit 160 receives a video call request from the broadcast receiving apparatus 200 to confirm whether the video call connection of the other party is requested from the broadcast receiving apparatus 200 by the interface unit 160 have.

In addition, the step S160 may display the video call request received from the broadcast receiving apparatus 200 through the interface unit 160 on the display screen. The user can use the video call request displayed on the display screen to determine whether to make a video call using the broadcast receiving apparatus 200. [

In step S160, the interface unit 160 can receive a video call connection request input from the user. The input video call connection request can be utilized in the input unit 120 as described above.

In step S170, when the received video call data received from the network 300 is decoded by the broadcast receiving apparatus 200 in response to the video call connection request, the broadcast receiving apparatus 200 transmits the received video call data to the wireless communication terminal 200 Can be controlled by the broadcast receiving apparatus control section 170 of the broadcast receiving apparatus.

In step S170, the broadcast receiving apparatus 200 may control the broadcast receiving apparatus 200 so that at least one of the video and audio of the received video call data displayed on the broadcast receiving apparatus 200 is output from the broadcast receiving apparatus control unit 170 May be controlled by the broadcast receiver control unit 170. [

In step S180, the remote control unit 180 may perform a remote control function for controlling the broadcast receiving apparatus 200. [ For example, the function of the broadcast receiver control unit 170 described above can be controlled by using the remote control unit 180 instead of the broadcast receiver apparatus 200. [

In step S190, the address book providing unit 190 may provide the other party address book for receiving the video call connection request as described above. At this time, the counterpart address book may be any one of ID, e-mail, telephone number, and IP address included in the external video communication apparatus 400 and capable of identifying the other party. Accordingly, the input unit 120 can input a video call connection request using the counterpart address book.

Finally, in step S195, the image input through the input unit 120 can be displayed on the display screen of the wireless communication terminal 100 using the input image display unit 195. [ The image displayed on the display screen may be superimposed on the display screen together with other images.

&Lt; Example of image processing method in broadcast receiving apparatus >

9 is a flowchart illustrating another example of the image processing method according to an embodiment of the present invention.

Referring to FIG. 9, an image processing method (S200) according to an exemplary embodiment of the present invention may include steps S210 to S260 for pairing and image processing using a short distance communication in the broadcast receiving apparatus 200. FIG.

First, in step S210, the pairing unit 210 pairs the wireless communication terminal 100 and the broadcast receiving apparatus 200 through short-distance communication.

The pairing unit 210 involved in pairing may be a wireless LAN, a Wi-Fi, a Bluetooth, a zigbee, a WFD, an ultra wideband (UWB) ) And a NFC (Near Field Communication) communication function.

Preferably, the WIFI AP can be used to perform a short distance communication between the pairing unit 150 and the broadcast receiving apparatus 200. The WIFI-type AP can transmit the high-quality outgoing video call data from the wireless communication terminal 100 to the broadcast receiving apparatus 200 or the received video call data flowing through the network 300 to the broadcast receiving apparatus 200. [ (200).

In addition, the wireless communication terminal 100 can transmit / receive the outgoing video call data and the received video call data to / from the external video communication apparatus 400 through the network 300 or the WIFI type AP.

Further, in step S210, the pairing unit 210 performs pairing upon receipt of the authentication information displayed on the broadcast receiving apparatus 200 through the wireless communication terminal 100. [ For example, if the wireless communication terminal 100 displays authentication information arbitrarily generated in the broadcast receiving apparatus 200 when a pairing request is issued to the broadcast receiving apparatus 200, 100 and the authentication information displayed on the broadcast receiving apparatus 200 are the same, the pairing can be performed.

In step S210, when the broadcast receiving apparatus 200 and the wireless communication terminal 100 are paired, the pairing unit 210 may generate the pairing information, which is a pairing result. The generated pairing information may be transmitted to the address book server 500 through a network, for example, a mobile communication network.

The pairing information may be used by the external video communication apparatus 400 to determine which broadcast receiving apparatus 200 should send the received video call data.

As described above, by using the pairing information, the external video communication apparatus 400 can easily recognize whether the received video call data can be transmitted to the selected broadcast receiving apparatus 200.

In operation S220, the broadcast data may be decoded by the decoding unit 220 so that the broadcast data is received from the network 300 and the broadcast data is received from the broadcast receiving apparatus 200. At this time, the decoding unit 220 may be a codec.

The decoded broadcast data may be IPTV broadcast data including at least one of video data (e.g., still video, moving picture), voice data, image data, pop-up data, metadata and EPG data (Electronic Program Guide).

In step S230, the call request receiving unit 230 may receive a video call request from the network 300. [ The received video call request may be information requested from the external video communication apparatus 400, for example, the wireless communication terminal of the other party and / or the broadcast receiving apparatus.

The response to the video call request may be made in the broadcast receiving apparatus 200 or may be transmitted to the wireless communication terminal 100 so that the wireless communication terminal 100 may respond.

For example, the transmitting unit 260 receives a video call request from the call request receiving unit 230, and transmits the video call request to the wireless communication terminal 100 paired with the broadcasting receiving apparatus 200. As a response to the video call request, the transmission unit 260 can receive the approval result from the wireless communication terminal 100 through the paired short distance communication.

In step S240, a response to the video call connection request input from the user or the video call request from the wireless communication terminal 100, for example, the received video call data received from the network 300 in response to the received video call connection request, May be received by the receiving video call output unit (240).

The received video call data is decoded by a decoding unit, for example, a codec (CODEC), and the image and voice generated as a decoding result are output to the output unit of the broadcast receiving apparatus 200 under the control of the reception video call output unit 240 So that the decoded picture and voice can be controlled.

In step S250, the outgoing video call data received from the paired wireless communication terminal 100 may be received by the outgoing video call data receiving unit 250. This is because the broadcast receiving apparatus 200 does not need to process the encoding since the transmitted video call data has already been encoded in the wireless communication terminal 100. Therefore, it is unnecessary to install a high-specification set-top box.

Accordingly, in step S260, the outbound video call data received in step S250 may be transmitted from the transmission unit 260 to the external video communication apparatus 400 through the network 300. [

In this case, the external video communication apparatus 400 may generate the reception video call data as a response to the source video communication data. The generated reception image call data may be transmitted to the reception image call output unit 240 described above via the network 300.

&Lt; Example of Step S240 >

FIG. 10 is a flowchart showing a more specific example of step S240 of the image processing method shown in FIG.

Referring to FIG. 10, an image processing method (S200) according to an exemplary embodiment of the present invention uses a broadcast output unit 270 of a broadcast receiving apparatus 200 to output broadcast data input through a network 300 The method may further include step S270.

At this time, the broadcast data to be output may include a broadcast image and a broadcast voice. The broadcast image may be any one of a still image, a moving image, and an image image, and may be output in association with an EPG data (Electronic Program Guide).

In this case, step S240 according to an exemplary embodiment may be such that when the video call is connected during the broadcast data output through the broadcast output unit 270, the broadcast data is stopped at the received video call output unit 240, And the received video call output unit 240 can control the video and / or audio output (S241).

However, when the video call is connected during the broadcast data output through the broadcast output unit 270, the step S240 may be performed in the order of the video call decoded in preference to the partial area of the broadcast image region displayed through the broadcast output unit 270 The reception image call output unit 240 may control the broadcast image area to display an image (meaning an image related to a video call of the other party or a video call transmitted from the wireless terminal 100) (S242) .

At this time, a part of the area of the broadcast image area may include a transparent or opaque area as an upper layer. Thus, in some areas of the transparent or opaque area, an image associated with the video call may be displayed in preference to the broadcast image.

Further, in step S240, the received video call output unit 240 may control the broadcast audio and the decoded audio so that the decoded audio is output in preference to the broadcast audio output through the broadcast output unit 270 (S243) .

The decoded voice is voice information related to the video call transmitted from the external video communication apparatus 400 of the other party. However, the decoded voice may be transmitted to the wireless communication terminal 100 and output.

Ultimately, it can be said that the image of the other party in relation to the video call is outputted to the broadcast receiving apparatus 200, and the voice is outputted to the broadcast receiving apparatus 200 or the wireless communication terminal 100.

Alternatively, in operation S240, the broadcast image region and the decoded image displayed through the broadcast output unit 270 may be displayed on a display unit ) May be controlled by the reception video call output unit 240 so as not to overlap the display screen (S244).

In the aspect of voice output, the receiving video call output unit 240 may control the broadcast voice and the decoded voice so that a voice decoded prior to the broadcast voice output through the broadcast output unit 270 is outputted (S245).

As described above, in the present embodiment, it is preferable that the broadcast output screen is interrupted and the video call screen is outputted to the TV, but various examples may be taken such that the broadcast output screen is displayed as it is and the video call screen is displayed simultaneously or overlapping with the broadcast output screen .

In this case, the meaning of outputting the voice related to the video call may mean that the broadcast audio output is stopped, the voice related to the video call is outputted to the TV, the volume of the broadcast voice output is decreased, and the video call voice is controlled to be louder have.

&Lt; Other Example of Step S240 >

FIG. 11 is a flowchart specifically showing the step S240 of the image processing method shown in FIG. 9 as another example.

11, an image processing method (S200) according to an exemplary embodiment of the present invention controls broadcast data input through a network 300 using a broadcast output unit 270 of a broadcast receiving apparatus 200 The method may further include step S280.

At this time, the broadcast data to be output may include a broadcast image and a broadcast voice. The broadcast image may be any one of a still image, a moving image, and an image image, and may be output in association with an EPG data (Electronic Program Guide).

In this case, when the video call is connected during the broadcast data output through the broadcast output unit 280, the broadcast output unit 280 may transmit the broadcast data to the upper layer The received video call output unit 240 may control the broadcast image area so that the decoded picture (including the video related to the received video call) is displayed in a priority order (S245).

As described above, when a decoded picture is preferentially displayed in an upper layer form, the broadcast image positioned in the lower layer can be turned off by touching it, thereby enabling to view the decoded picture, or adjusting the decoded picture size It is possible to select various screens such as viewing.

In step S240, the received video call output unit 240 controls the decoded voice to output a decoded voice prior to the broadcast voice output through the broadcast output unit 280, or decoded voice or voice before being decoded The decoded voice or the pre-decoded voice to be output to the wireless communication terminal 100 may be further controlled by the receiving video call output unit 240 (S246).

In this case, the voice associated with the video call is outputted prior to the broadcast voice. This means that the broadcast voice output is stopped and the voice related to the video call (reception) is outputted to the TV, or the voice output volume is reduced and the video call voice is heard It can mean control.

Preferably, however, it is preferable that the voice related to the video call (reception) is transmitted to the wireless communication terminal 100 and heard. It is possible to automatically control the voice communication related to the video communication (reception) to be transmitted to the wireless communication terminal 100 when the wireless communication terminal 100 and the broadcast receiving apparatus 200 are paired, To be transmitted in correspondence with each other.

&Lt; Example of Recording Medium &

FIG. 12 is a block diagram showing an example of a recording medium installed in the wireless communication terminal 100 shown in FIG.

Referring to FIG. 12, the wireless communication terminal 100 according to an embodiment of the present invention may further include a computer-readable recording medium 100a. The computer-readable recording medium 101 may be embodied in the form of program instructions that may be executed through various computer components.

In this computer-readable recording medium 100a, an application program 100b in which program commands, data files, data structures, etc., alone or in combination can be recorded. The recorded application program 100b (also referred to as a &quot; video call application &quot;) may be those specially designed and configured for the present invention or may be available to those skilled in the computer software field.

Examples of the computer-readable recording medium 100a include magnetic media such as a hard disk, a floppy disk and a magnetic tape, optical recording media such as CD-ROM and DVD, magneto-optical media such as a floppy disk magneto-optical media), and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those generated by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules for performing the processing according to the present invention, and vice versa.

Here, the application program 100b recorded in the computer-readable recording medium 100a includes a step of receiving a video call request from the broadcast receiving apparatus 200, a step of receiving a video call connection request from the user, Receiving an image signal and a voice signal through a microphone 102 that receives a voice and an audio signal; generating outgoing video call data by encoding the inputted video signal and voice signal; To the external video communication apparatus 400 through the receiving apparatus 200 or the network 300. [ A specific example of each of these steps has been fully described in FIG. 7 described above, and a description thereof will be omitted.

On the other hand, the computer-readable recording medium 100a may be installed in the broadcast receiving apparatus 200 as well. Hereinafter, it is as follows.

13 is a block diagram showing an example of a recording medium installed in the broadcast receiving apparatus 200 shown in FIG.

Referring to FIG. 13, the broadcast receiving apparatus 200 according to an embodiment of the present invention may further include a computer-readable recording medium 200a. The characteristics of such a computer-readable recording medium 200a may have the same or similar characteristics as the computer-readable recording medium 100a of Fig. Therefore, the description thereof will be omitted in this embodiment.

An application program 200b may be installed in such a computer-readable recording medium 200a.

That is, an application program 200b (also referred to as a 'video call application') recorded on a computer-readable recording medium 200a may be configured to pair with the wireless communication terminal 100, receive broadcast data from the network 300 Receiving the video call request from the network 300, transmitting the received video call request to the paired wireless communication terminal 100, and transmitting the video call request to the paired wireless communication terminal 100. [ Receiving the video call data from the network 300 and decoding the received video call data through the decoding unit 220 and controlling the video and audio to be output.

In addition, the application program 200b recorded in the computer-readable recording medium 200a includes the steps of receiving the outgoing video call data encoded from the paired wireless communication terminal 100 and transmitting the outgoing video call data to the network 300). &Lt; / RTI &gt;

A concrete example of each of these steps has been fully described in FIG. 9 described above, and a description thereof will be omitted.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the exemplary embodiments or constructions. You can understand that you can do it. The embodiments described above are therefore to be considered in all respects as illustrative and not restrictive.

100: wireless communication terminal 101: camera
102: microphone 110: call request receiver
120: input unit 130: encoding unit
140: Transmitting unit 150: Pairing unit
160: interface unit 170: broadcast receiver control unit
180: remote control unit 190:
195: Input image display section 200: Broadcast receiving apparatus
210: Pairing unit 220: Decoding unit
230: call request receiving unit 240: receiving video call output unit
250: Outgoing video call data receiving unit 260:
270, 280: broadcast output unit 300:
400: external video communication device 500: address book server
1000: High-definition video call system

Claims (5)

When the external video communication apparatus transmits a video call request to the wireless communication terminal, it is determined whether the wireless communication terminal and the broadcast receiving apparatus are paired using the pairing information stored in the address book server, and the pairing information is stored in the address book server Transmits the received video call data to the wireless communication terminal, and transmits the received video call data to the broadcast receiver if the pairing information is stored in the address book server. The method according to claim 1,
If the pairing information is stored in the address book server,
And transmitting the received video call data to the wireless communication terminal through the broadcast receiving apparatus.
External video call device. The method according to claim 1,
The address book server,
Wherein the receiving unit receives the pairing information from the broadcast receiving apparatus or the wireless communication terminal and stores the received pairing information.
External video call device. The method according to claim 1,
The external video communication apparatus includes:
And the outgoing video communication data is received from the wireless communication terminal.
External video call device. The method according to claim 1,
If the pairing information is stored in the address book server,
Wherein the audio data of the received video call data is transmitted to the wireless communication terminal and the video data of the received video call data is transmitted to the broadcast receiving apparatus.
External video call device.

Images