KR20120039144A - Method for providing telephone service in network tv and the network tv - Google Patents

Abstract

PURPOSE: A method for providing telephone service using a network TV and a network TV thereof are provided to offer a new combined hybrid service without separating TV service and telecommunication service. CONSTITUTION: When a call request signal is received from an opponent's device, a network TV displays the identification information of a video call mode or a voice call mode(S1501,S1502). The network TV extracts caption data from broadcasting data(S1503). When the video call mode is processed, the network TV displays the video data in a first area(S1504). The network TV displays a video call screen in a second part. The network TV displays the extracted caption data in a third area.

Description

METHOD FOR PROVIDING TELEPHONE SERVICE IN NETWORK TV AND THE NETWORK TV}

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to network television technology, and more particularly, to a method for providing a telephone service using a network TV and to the network TV.

In recent years, various kinds of network TVs and the like have been discussed. In one embodiment of the network TV, unlike a conventional TV receiving limited data only through a broadcast network, a function of receiving and processing a larger amount of information in real time through a wired / wireless Internet network is expected. More specific embodiments of the network TV may include an internet protocol television (IPTV), a smart television (TV), a hybrid broadcast broadband television (HBBTV), and a digital television (DTV).

However, specific functions of the network TV are not yet defined, and in particular, a method of providing a more improved telephone system using the network TV has not been derived.

For example, in the existing TV, TV service and telephone service are separated, so that various needs of users cannot be satisfied.

In addition, according to the related art, a broadcast screen or audio is completely interrupted in a situation where a plurality of users watch TV.

Furthermore, according to the prior art, the UI (user interface) of the TV providing the telephone service is designed to be very limited, so that there is an extremely rare limitation of utilizing the telephone service using the TV.

One embodiment of the present invention is to provide one combined new hybrid service without separating the TV service and the telephone service.

In addition, another embodiment of the present invention is to provide a design method that can minimize the impact on TV service and telephone service in a situation where a plurality of users watching TV.

In addition, another embodiment of the present invention is to provide a user interface (UI) of a TV providing a telephone service to a user in a more customized form.

According to an embodiment of the present invention, a method of providing a telephone service using a network TV may include displaying video data among broadcast data received from at least one channel, and a call request signal from a device of the other party. If received, displaying information identifying a video call mode or a voice call mode; extracting caption data from the received broadcast data; and if the video call mode is executed, a first method of the network TV. Displaying the video data in an area, displaying a video call screen in a second area of the network TV, and displaying the extracted caption data in a third area of the network TV; and when the voice call mode is executed. Displaying the video data in a fourth area of the network TV. And displaying the extracted caption data in a fifth region of the network TV.

In addition, the network TV providing a telephone service according to an embodiment of the present invention, a display module for displaying video data of the broadcast data received from at least one or more channels, and receives a call request signal from the device of the other party A network interface, a detector for extracting caption data among the received broadcast data, and a control unit to output the video data to a first area of the display module, and to output a video call screen to a second area of the display module. And a controller for controlling the extracted caption data to be output to a third area of the display module.

According to one embodiment of the present invention, one combined new hybrid service is provided without separating the TV service and the telephone service.

In addition, according to another embodiment of the present invention, in a situation where a plurality of users watching TV, it provides a design method that can minimize the impact on TV service and telephone service.

In addition, according to another embodiment of the present invention, a user interface (UI) of a TV providing a telephone service is provided to the user in a more customized form.

More specific effects of the invention will be described later in detail in the table of contents.

1 is a diagram schematically showing an example of an entire broadcasting system including a network TV according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating an example of the network TV shown in FIG. 1 in more detail.
3 is a diagram illustrating an entire system including a network TV providing a telephone service according to an embodiment of the present invention.
FIG. 4 is a diagram illustrating specific modules of the network TV shown in FIG. 3.
5 is a diagram for guiding a video call mode and a voice call mode according to an embodiment of the present invention when a call is received.
6 is a diagram illustrating a process of switching broadcast audio to a mute state according to an embodiment of the present invention when a call is received.
7 is a diagram illustrating a screen for selecting whether to maintain a broadcast audio mute state or display caption captions when a call is received according to an embodiment of the present invention.
8 is a diagram for displaying caption data among broadcast data according to an embodiment of the present invention in the voice call mode.
FIG. 9 is a diagram of simultaneously displaying caption data and a video call screen among broadcast data according to an embodiment of the present invention.
FIG. 10 is a diagram for describing a first method of outputting a plurality of audio data according to one embodiment of the present invention.
FIG. 11 is a diagram for describing a second method of outputting a plurality of audio data according to one embodiment of the present invention.
12 is a diagram illustrating a process of adjusting the size of a video call screen according to one embodiment of the present invention.
13 is a diagram illustrating a process of adjusting the position of a video call screen according to one embodiment of the present invention.
14 is a diagram illustrating a first method of automatically customizing an audio output method using a face recognition sensor according to an embodiment of the present invention.
FIG. 15 is a diagram for a second method of automatically customizing an audio output method using a face recognition sensor according to one embodiment of the present invention.
16 is a flowchart illustrating a method of providing a telephone service using a network TV according to an embodiment of the present invention.
17 is a flowchart illustrating a method of providing a telephone service using a network TV according to another embodiment of the present invention.
FIG. 18 is a flowchart illustrating steps added after steps S1504 and S1505 of FIG. 17.
FIG. 19 is a flowchart illustrating steps added after steps S1504 and S1505 of FIG. 17.

Hereinafter, various embodiments of the present invention will be described in detail with reference to the accompanying drawings. Furthermore, the suffixes "module" and "unit" for components used in the following description are merely given in consideration of ease of writing the present specification, and the "module" and "unit" may be used interchangeably with each other. Can be designed in hardware or software.

On the other hand, the network TV described herein is, for example, an intelligent video display device that adds a computer support function to a broadcast reception function, and is faithful to the broadcast reception function but has an Internet function added thereto. It can be equipped with a more convenient interface such as a space remote control. In addition, by being connected to the Internet and a computer with the support of a wired or wireless Internet function, it is possible to perform functions such as e-mail, web browsing, banking or gaming. Standardized general-purpose operating systems may be used for these various functions.

Therefore, in the network TV described in the present invention, various applications can be freely added or deleted, for example, on a general-purpose OS kernel, so that various user-friendly functions can be performed. More specifically, the network TV may be, for example, an internet TV, an HBBTV, a smart TV, a DTV, or the like, and may be applicable to a smartphone in some cases.

BRIEF DESCRIPTION OF THE DRAWINGS The above and other features and advantages of the present invention will be more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which: FIG.

As used herein, terms used in the present invention are selected from general terms that are widely used in the present invention while taking into account the functions of the present invention, but these may vary depending on the intention or custom of a person skilled in the art or the emergence of new technologies. In addition, in certain cases, there is a term arbitrarily selected by the applicant, and in this case, the meaning will be described in the corresponding description of the invention. Therefore, it is intended that the terminology used herein should be interpreted based on the meaning of the term rather than on the name of the term, and on the entire contents of the specification.

1 is a diagram schematically showing an example of an entire broadcasting system including a network TV according to an embodiment of the present invention. Hereinafter, referring to FIG. 1, an example of an entire broadcasting system including a network TV according to an embodiment of the present invention will be described as follows.

As shown in FIG. 1, an entire broadcasting system including a network TV according to an embodiment of the present invention includes a content provider (CP) 10, a service provider (SP) 20, and a network. It may be divided into a network provider (NP) 30 and an HNED 40. The HNED 40 corresponds to, for example, a client 100 which is a network TV according to an embodiment of the present invention.

The content provider 10 produces and provides various contents. As shown in FIG. 1, the content provider 10 includes a terrestrial broadcaster, a cable system operator or a multiple system operator, a satellite broadcaster, and an internet broadcaster. An internet broadcaster, etc. may be exemplified, etc. In addition, the content provider 10 may provide various applications and the like in addition to the broadcast content.

The service provider 20 may provide a service package of contents provided by the content provider 10. For example, the service provider 20 of FIG. 1 may package and provide a first terrestrial broadcast, a second terrestrial broadcast, a cable MSO, satellite broadcast, various internet broadcasts, applications, and the like to a user.

Meanwhile, the service provider 20 may provide a service to the client 100 using a unicast or multicast scheme. The unicast method is a method of transmitting data 1: 1 between one sender and one receiver. For example, in the unicast method, when a receiver requests data from a server, the server may transmit data to the receiver according to the request. Multicasting is a method of transmitting data to a plurality of recipients of a specific group. For example, the server can send data to multiple pre-registered receivers at once. For such multicast registration, the Internet Group Management Protocol (IGMP) protocol may be used.

The network provider 30 may provide a network for providing a service to the client 100. The client 100 may establish a home network end user (HNED) to receive a service.

Meanwhile, as a means for protecting the transmitted content, conditional access or content protection may be used. As an example for receiving such restriction or protecting content, a method such as a cable card or a downloadable conditional access system (DCAS) may be used, but the present invention is not limited to such a design.

On the other hand, the client 100 can also provide content through the network. In this case, unlike the above, the client 100 may be a content provider, and the content provider 10 may receive content from the client 100. In the case of designing as described above, an interactive content service or a data service is possible.

FIG. 2 is a diagram illustrating an example of the network TV shown in FIG. 1 in more detail. Hereinafter, an example of the network TV shown in FIG. 1 will be described in more detail with reference to FIG. 2.

Network TV 200 according to an embodiment of the present invention, the network interface unit (Network Interface) 201, TCP / IP Manager (TCP / IP Manager) 202, Service Delivery Manager (Service Delivery Manager) (203) ), Demultiplexer (Demux) 205, PSI & (PSIP and / or SI) Decoder 204, Audio Decoder 206, Video Decoder 207, Display A / V and OSD Module (208), Service Control Manager (209), Service Discovery Manager (210), Metadata Manager (212), SI & Metadata DB (211), UI Manager 214, service manager 213, and the like.

The network interface unit 201 receives the packets received from the network and transmits the packets to the network. That is, the network interface unit 201 receives a service, content, and the like from a service provider through a network.

The TCP / IP manager 202 is involved in the packet transmission from the source to the destination for the packet received by the network TV 200 and the packet transmitted by the network TV 200. The TCP / IP manager 202 classifies the received packet to correspond to an appropriate protocol, and classifies the packet into a service delivery manager 205, a service discovery manager 210, a service control manager 209, and a metadata manager 212. Output the printed packet.

The service delivery manager 203 is responsible for controlling the received service data. For example, RTP / RTCP can be used to control real-time streaming data. When transmitting the real time streaming data using RTP, the service delivery manager 203 parses the received data packet according to the RTP and transmits it to the demultiplexer 205 or under the control of the service manager 213. Accordingly stored in the SI & Metadata DB (711). Then, the RTCP is used to feed back the network reception information to a server that provides a service.

The demultiplexer 205 demultiplexes the received packet into audio, video, program specific information (PSI) data, and the like, and transmits the demultiplexer 205 to the audio / video decoders 206 and 207 and the PSIP and / or SI decoder 204, respectively. do.

PSIP and / or SI Decoder 204 decodes service information such as, for example, Program Specific Information (PSI). That is, the PSIP and / or SI Decoder 204 receives and decodes the demultiplexed PSI section, the Program and Service Information Protocol (PSIP) section, or the Service Information (SI) section from the demultiplexer 205.

In addition, the PSIP and / or SI Decoder 204 decodes the received sections to create a database of service information, and stores the database of the service information in the SI & Metadata DB 211.

An audio / video decoder 206/207 decodes the video data and the audio data received at the demultiplexer 205. The audio data decoded by the audio decoder 206 and the video data decoded by the video decoder 207 are provided to the user through the display unit 208.

The UI manager 214 and the service manager 213 manage the overall state of the network TV 200, provide a user interface, and manage other managers.

The UI manager 214 provides a Graphic User Interface (GUI) for a user by using an OSD (On Screen Display) and the like, and receives a key input from the user to perform a receiver operation according to the input. For example, upon receiving a key input related to channel selection from a user, the key input signal is transmitted to the service manager 213.

The service manager 213 controls a manager associated with a service, such as a service delivery manager 203, a service discovery manager 210, a service control manager 209, and a metadata manager 212.

In addition, the service manager 213 creates a channel map and selects a channel using the channel map according to a key input received from the user interface manager 214. The service manager 213 receives service information of a channel from the PSIP and / or SI Decoder 204 and sets an audio / video packet identifier (ID) of the selected channel to the demultiplexer 205.

The service discovery manager 210 provides information necessary to select a service provider that provides a service. Upon receiving a signal regarding channel selection from the service manager 213, the service discovery manager 210 searches for a service using the information.

The service control manager 209 is responsible for selecting and controlling a service. For example, if a user selects a live broadcasting service like the conventional broadcasting method, IGMP or RTSP is used. If a user selects a service such as VOD (Video On Demand), RTSP is used to select and control the service. Perform The RTSP protocol may provide a trick mode for real time streaming. In addition, the service control manager 209 may initialize and manage a session through the IMC gateway using an IP multimedia subsystem (IMS) or a session initiation protocol (SIP). The protocols are one embodiment, and other protocols may be used depending on implementation.

The metadata manager 212 manages metadata associated with the service and stores the metadata in the SI & Metadata DB 211.

The SI & Metadata DB 211 selects service information decoded by the PSIP and / or SI Decoder 204, metadata managed by the metadata manager 212, and service providers provided by the service discovery manager 210. Save the necessary information. In addition, the SI & Metadata DB 211 may store setup data for the system.

The SI & Metadata DB 211 may be implemented using nonvolatile memory (NVRAM) or flash memory.

Meanwhile, the IG 250 is a gateway that collects functions necessary for accessing an IMS-based IPTV service.

3 is a diagram illustrating an entire system including a network TV providing a telephone service according to an embodiment of the present invention. Hereinafter, referring to FIG. 3, an overall system including a network TV for providing a telephone service according to an embodiment of the present invention will be described as follows.

As shown in FIG. 3, a network TV 300 providing a telephone service according to an embodiment of the present invention includes a camera 301, a speaker 302, a microphone 303, an Ethernet module 304, and a wireless interface. 305, and a headset 306, and the like.

The network TV 300, through the Ethernet module 304, is capable of communication connection with a mobile phone 310, a PC 320, and a TV 330 located at an external remote location. In addition, telephone communication is performed through a wired or wireless network.

The wireless interface 305 communicates wirelessly with the headset 306 (for example, WiFi, Bluetooth, etc.), and thus receives audio data or telephone connected external devices from the broadcast data received by the network TV 300. Can transmit and receive audio data. However, in FIG. 3, the wireless communication method is described as an example. However, the scope of the present invention is not limited thereto, and in principle, the scope of the present invention should be defined by the claims.

The speaker 302 selectively outputs audio data received from the network TV 300 or audio data received from a telephone-connected external device. In addition, the microphone 303 is a module that detects a voice of a user adjacent to the network TV 300 and may be used when, for example, a telephone connection with an external device.

In addition, the camera 301 is a module that photographs a user's appearance adjacent to the network TV 300 and may be used when, for example, a telephone connection with an external device. In particular, according to another embodiment of the present invention, the camera is also designed to be equipped with a face recognition sensor, it can be used to determine the number of adjacent users. Detailed description thereof will be described later.

FIG. 4 is a diagram illustrating specific modules of the network TV shown in FIG. 3. Hereinafter, referring to FIG. 4, specific modules of the network TV 300 shown in FIG. 3 will be described in detail.

As shown in FIG. 4, the network TV 400 according to an embodiment of the present invention includes a broadcast receiver 401, a detector 402, a display module 403, a controller 404, and a network interface 405. , A detector 406, a determiner 407, a microphone 408, a speaker 409, a headset 410, and the like. However, as shown in FIG. 4, the modules illustrated in FIG. 4 are not limited to the scope of the present invention, and in principle, the scope of the present invention should be defined by the claims.

The broadcast receiving unit 401 receives broadcast data from at least one channel. The broadcast receiving unit 401 may be designed as an interface for receiving IP information, for example, or may be designed as a tuner in some cases.

The display module 403 displays video data among the received broadcast data, and the network interface 405 receives a call request signal from a device of the other party. The network interface 405 can be designed, for example, as modules for processing an Internet telephony service or a VoIP service, and there is no particular limitation on the device of the counterpart. That is, the device of the other party may be the mobile phone 310, the PC 320, the TV 330 shown in FIG. 3, or may be an existing wired phone.

The detector 402 extracts caption data from the received broadcast data. Although not shown in FIG. 4, the detector 402 may be further designed to perform a function of converting a data format so that the extracted caption data can be output from the display module 403.

The controller 404 controls the video data to be output to the first area of the display module 403, controls the video call screen to be output to the second area of the display module 403, and displays the display. The extracted caption data is output to the third region of the module 403.

Therefore, according to an embodiment of the present invention designed as described above, the user can easily use the telephone service while watching the TV broadcast screen. In particular, there is an advantage that can maintain the pure function of the broadcast service and the telephone service at the same time as possible.

Further, when the voice call mode is executed, the controller 404 controls the video data to be output to the fourth area of the display module 403, and the fifth area of the display module 403. Control to output the extracted caption data. On the other hand, the above-described first region to the fifth region may be partially overlapped design, or may be designed as a completely different region that does not overlap at all.

In addition, in an embodiment of the present invention, a video call mode and a voice call mode are distinguished and designed, which will be described later in more detail with reference to FIGS. 5 to 7.

In addition, according to another embodiment of the present invention, the display module 403 displays a screen that guides the output type of the audio data of the broadcast data and the audio data transmitted from the device of the counterpart. Further, the control unit 404 transmits the audio data of the broadcast data to the first audio output module, and transmits the audio data transmitted from the device of the counterpart to the second audio output module. The first audio output module and the second audio output module correspond to, for example, a speaker 409 or a headset 410 of the network TV.

Therefore, according to another embodiment of the present invention designed as described above, it is possible to selectively output the high-weight audio data to the speaker or the headset according to the needs of the user (needs). A method of changing an output method of audio data according to another embodiment of the present invention will be described later in more detail with reference to FIGS. 8 to 9.

Furthermore, according to another embodiment of the present invention, the network TV 400 according to the detection unit 406 for detecting the total number of people by the face recognition sensor mounted on the network TV, and according to the detected total number of people, And a determination unit 407 for determining an output type of the audio data of the broadcast data and the audio data transmitted from the device of the counterpart. When the detected total number of people is two or more, the controller 404 transmits audio data of the broadcast data to the speaker 409, and transmits audio data transmitted from the device of the counterpart to the headset 410. do.

Therefore, according to another embodiment of the present invention designed as described above, there is an advantage that the user does not need to specifically set the audio output method. When there are a large number of adjacent users in front of the TV, it is difficult to have a number of headsets that satisfies all the multiple users. In consideration of this, the smart function that automatically outputs the voice data required by the caller to the headset and the existing broadcast to the speaker is introduced. On the other hand, if the user is alone, privacy is protected, so there is no need to output audio data related to the phone call through the headset. A method of automatically changing the output method of audio data in consideration of the number of users according to another embodiment of the present invention will be described later in detail with reference to FIGS. 12 to 13.

As described above, the network TV 400 corresponds to any one of, for example, smart TV, IPTV, HBBTV, and DTV.

5 is a diagram for guiding a video call mode and a voice call mode according to an embodiment of the present invention when a call is received. Hereinafter, a video call mode and a voice call mode according to an embodiment of the present invention will be described in detail with reference to FIG. 5.

According to an embodiment of the present invention, a general broadcast screen 500 is displayed as shown in FIG. 5. When the call request signal is received from the device of the counterpart while the general broadcast screen 500 is displayed, information for guiding this is displayed. As another example, as shown in FIG. 5, an indicator 510 for selecting whether to use a video call mode or a voice call mode is simultaneously displayed to a user who is watching a broadcast screen.

6 is a diagram illustrating a process of switching broadcast audio to a mute state according to an embodiment of the present invention when a call is received. FIG. 7 is a diagram illustrating a screen for selecting whether to maintain a broadcast audio mute state or display caption captions according to an embodiment of the present invention when a call is received.

When a call is received from the counterpart device, the guide screen as shown in FIG. 5 may be displayed. However, as shown in FIG. 6, the broadcast audio may be designed to automatically change to a mute state. Therefore, the user can enter the video telephone service without any special recognition.

Furthermore, as another embodiment, when either the video call mode or the voice call mode shown in FIG. 5 is selected, as shown in FIG. 7, a screen for selecting broadcast audio mute or caption display appears in a pop-up format. . The design considers both users who want captions and subtitles and those who do not.

On the other hand, the screen shown in FIG. 7 is not displayed every time a call comes in, it is also possible to design so that the caption is always displayed automatically when the user presets once. Hereinafter, a description will be given on the assumption that captions are automatically displayed, but the scope of the present invention is not limited only to these embodiments.

8 is a diagram for displaying caption data among broadcast data according to an embodiment of the present invention in the voice call mode. 9 is a diagram of simultaneously displaying caption data and a video call screen among broadcast data according to an embodiment of the present invention. Hereinafter, the video call mode and the voice call mode according to an embodiment of the present invention will be described in detail with reference to FIGS. 8 to 9.

If the voice call mode is selected, as shown in FIG. 8, the general broadcast screen 600 and the caption data 610 of the broadcast data are simultaneously displayed. Therefore, the user has an advantage of minimizing the interference on the broadcast screen 600 being viewed and at the same time confirming the voice data of the current broadcast as a subtitle.

On the other hand, when the video call mode is selected, as shown in FIG. 9, the caption data 710 of the general broadcast screen 700, the video call screen, and the broadcast data are simultaneously displayed. In particular, the video call screen may include at least one of video data 720 of the counterpart photographed by the camera of the calling device or video data 730 of the user, taken by the camera of the network TV, as shown in FIG. 9. It is designed to include. Therefore, the user can check both the broadcast screen 700 and the video call screens 720 and 730, and at the same time can check the audio data of the current broadcast as a subtitle.

FIG. 10 is a diagram for describing a first method of outputting a plurality of audio data according to one embodiment of the present invention. 11 is a diagram for describing a second method of outputting a plurality of audio data according to an embodiment of the present invention. Hereinafter, a method of selecting audio data of a telephone service according to user convenience will be described with reference to FIGS. 10 and 11. However, it will be described on the assumption that the video call mode, but the scope of the present invention is not limited thereto.

As shown in FIG. 10, the broadcast screen 800, the caption data 810, and the video call screens 820 and 830 are displayed as in the previous description. In FIG. 10, an item 840 is additionally provided to determine a method of outputting audio data of a video call. Accordingly, according to FIG. 10, audio data of a video call is output through a speaker of a network TV. In this case, the audio data of the broadcast data is output through the headset of the network TV.

As shown in FIG. 11, the broadcast screen 900, the caption data 910, and the video call screens 920 and 930 are displayed in the same manner as the previous description. In FIG. 11, an item 940 is additionally provided to determine a method of outputting audio data of a video call. Therefore, according to FIG. 11, audio data of a video call is output through a headset of a network TV. In this case, the audio data of the broadcast data is output through the speaker of the network TV.

12 is a diagram illustrating a process of adjusting the size of a video call screen according to one embodiment of the present invention. 13 is a diagram illustrating a process of adjusting the position of a video call screen according to an embodiment of the present invention. Hereinafter, an embodiment of arbitrarily changing the size or position of a video call screen will be described with reference to FIGS. 12 and 13.

As shown in FIG. 12, the broadcast screen 1000, the caption data 1010, and the video call screens 1020 and 1030 are displayed in the same manner as the previous description. In FIG. 12, the sizes of the video call screens 1020 and 1030 may be arbitrarily changed.

As shown in FIG. 13, the broadcast screen 1100, the caption data 1110, and the video call screens 1120 and 1130 are displayed in the same manner as the previous description. In FIG. 13, the size of the video call screens 1120 and 1130 may be arbitrarily changed. Accordingly, the user can easily set the ratio of the desired broadcast screen, the counterpart screen, and the ratio of the user's screen to his / her needs.

14 is a diagram illustrating a first method of automatically customizing an audio output method using a face recognition sensor according to an embodiment of the present invention. FIG. 15 is a diagram illustrating a second method of automatically customizing an audio output method using a face recognition sensor according to an embodiment of the present invention. Hereinafter, a method of automatically customizing an audio output method using a face recognition sensor will be described with reference to FIGS. 14 and 15.

As shown in FIG. 14, the broadcast screen 1200, the caption data 1210, and the video data 1220 of the counterpart are the same as in the previous description. However, in FIG. 14, other features exist in the camera 1260, the user's video data 1230, the face recognition area 1240, and the audio data output method item 1250 that is automatically changed.

According to an embodiment of the present invention, the camera 1260 is equipped with a face recognition sensor, and the face recognition sensor includes a face recognition unit and a face recognition area display unit.

The face recognition unit detects at least one or more faces from the image including the group person. The face recognition unit finds invariant features (face elements such as eyes, nose, and mouth, texture, and skin color) of the face by using a feature-based face detection method. Among the various features of the face, flesh color is the most frequently used method because it is less sensitive to movement, rotation, and size change of the face. In addition, the face template-based detection method borrowed by the face recognition unit creates several standard patterns for the face and stores the patterns for face detection. The patterns are then compared with the image one by one in the search window of the image to detect faces. As a method of face detection, there is a face detection method based on a recently used support vector machine (SVM). SVM-based methods are sub-sampling different areas from an image to learn about faces and non-faces (non-faces) through a learner, and then find faces in the input image.

The face recognition area display unit displays an area on the recognized faces. In the current face recognition function, a rectangular recognition zone, that is, a face recognition area, exists on the face of the subject, and the face recognition area increases or decreases in size depending on the distance between the subject and the lens 10. FIG. 14 illustrates an example 1240 in which a face recognition area is displayed according to a face recognition result of an image. The case where there is only one user adjacent to the network TV is illustrated.

Therefore, as a result of checking the area 1230 where the image captured by the camera 1260 equipped with the face recognition sensor is displayed, when only one user 1240 exists, the voice data of the telephone service is the speaker system 1250 of the network TV. Is printed via). Since the user is alone, the contents of the call may be transmitted through the speaker.

15, the broadcast screen 1300, the caption data 1310, the video data 1320 of the counterpart, and the camera 1360 are the same as in FIG. 14.

15 differs from FIG. 14 in that two users 1340 photographed through the camera 1360 exist. Therefore, unlike FIG. 14, in the case of FIG. 15, as a result of confirming the area 1330 where the image captured by the camera 1360 equipped with the face recognition sensor is displayed, the plurality of users 1340 exist, and thus the voice of the telephone service. The data is output through the headset system 1350, not the speaker of the network TV. In the case where there are a plurality of users, it is necessary to consider the privacy of the person making a telephone call, and this smart function can be provided to greatly improve the user's convenience.

16 is a flowchart illustrating a method of providing a telephone service using a network TV according to an embodiment of the present invention. Hereinafter, referring to FIG. 16, a method for providing a telephone service in three modes using a network TV according to an embodiment of the present invention will be described as follows. 16 to 19 are descriptions of the method invention, but the above-described drawings may be additionally interpreted and applied as necessary.

The network TV implemented according to an embodiment of the present invention receives a calling signal from a device of the counterpart (S1400). The network TV determines whether to maintain broadcast data currently being output (S1401). However, step S1401 may be performed automatically, or the user may select using a user interface (UI).

As a result of the determination (S1401), if the broadcast data currently being output is not maintained, a basic video call mode is entered (S1402). The network TV displays only a video call screen without a broadcast screen (S1403).

On the other hand, if the determination result (S1401) to maintain the currently output broadcast data, it is determined whether to select a video call (S1404). If the determination result 1404 is not selected, the TV-voice call mode is entered (S1405). In operation S1406, the network TV displays a broadcast screen and caption data. An example of step S1406 is shown in detail in FIG. 6.

On the other hand, if the determination result (S1404) is selected, enters the TV-video call mode (S1407). In operation S1408, the network TV displays a broadcast screen, a video call screen, and caption data. An example of step S1408 is shown in detail in FIG. 7.

17 is a flowchart illustrating a method of providing a telephone service using a network TV according to another embodiment of the present invention. Hereinafter, referring to FIG. 17, a method of providing a telephone service in two modes using a network TV according to an embodiment of the present invention will be described in detail.

Video data among the broadcast data received from at least one channel is displayed (S1500). It is determined whether a call request signal is received from the device of the counterpart (S1501). If the determination result (S1501) is not received, the process returns to step S1500.

On the other hand, when the determination result (S1501) is received, information identifying the video call mode or the voice call mode is displayed (S1502). Further, caption data is extracted from the received broadcast data (S1503).

Furthermore, when the video call mode is executed, the video data is displayed in the first area of the network TV, the video call screen is displayed in the second area of the network TV, and the extracted area is extracted in the third area of the network TV. The caption data is displayed (S1504).

Meanwhile, when the voice call mode is executed, the video data is displayed in the fourth region of the network TV and the extracted caption data is displayed in the fifth region of the network TV (S1505).

The video call screen may include, for example, at least one of an image photographed by a camera of the device of the other party or an image photographed by a camera of the network TV. In addition, the first to fifth regions may partially overlap or may be designed as completely different regions.

FIG. 18 is a flowchart illustrating steps added after steps S1504 and S1505 of FIG. 17. Hereinafter, a method invention added according to another embodiment of the present invention will be described with reference to FIG. 18.

After steps S1504 and S1505 of FIG. 17, the network TV according to another embodiment of the present invention displays a screen guiding an output type of audio data of the broadcast data and audio data transmitted from the device of the other party. (S1600). Specific examples of the step S1600 are shown in detail at 840 of FIG. 10 and 940 of FIG. 11.

Further, the network TV transmits the audio data of the broadcast data to the first audio output module (S1601), and transmits the audio data transmitted from the device of the other party to the second audio output module (S1602). The first audio output module and the second audio output module correspond to speakers or a headset of the network TV.

FIG. 19 is a flowchart illustrating steps added after steps S1504 and S1505 of FIG. 17. Hereinafter, referring to FIG. 19, a method invention added according to another embodiment of the present invention will be described.

After step S1504 and step S1505 of FIG. 17, the network TV according to another embodiment of the present invention detects the total number of people by the face recognition sensor mounted on the network TV (S1700). The network TV determines the output type of the audio data of the broadcast data and the audio data transmitted from the device of the counterpart according to the detected total number of people (S1701).

For step S1701, more specifically, for example, when the total number of people detected is two or more, audio data of the broadcast data is transmitted to a speaker of the network TV, and audio data transmitted from a device of the other party. Transmits to the headset of the network TV.

In this specification, both the invention and the invention of the method are explained, and the description of the two inventions can be supplementarily applied as necessary.

Method invention according to the present invention are all implemented in the form of program instructions that can be executed by various computer means can be recorded on a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tape, optical media such as CD-ROMs, DVDs, and magnetic disks, such as floppy disks. Magneto-optical media, and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

As described above, the present invention has been described by way of limited embodiments and drawings, but the present invention is not limited to the above embodiments, and those skilled in the art to which the present invention pertains various modifications and variations from such descriptions. This is possible.

Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined not only by the claims below but also by the equivalents of the claims.

300, 400: Network TV
301: camera
306, 410: Headset

Claims (14)

In the method of providing a telephone service using a network TV,
Displaying video data among broadcast data received from at least one channel;
If a call request signal is received from a device of the other party, displaying information identifying a video call mode or a voice call mode;
Extracting caption data from the received broadcast data;
When the video call mode is executed, the video data is displayed in the first area of the network TV, the video call screen is displayed in the second area of the network TV, and the extracted caption data is displayed in the third area of the network TV. Displaying the; And
When the voice call mode is executed, displaying the video data in a fourth region of the network TV and displaying the extracted caption data in a fifth region of the network TV.
Method for providing a telephone service using a network TV comprising a. The method of claim 1,
Displaying a screen guiding an output type of audio data of the broadcast data and audio data transmitted from a device of the counterpart;
Transmitting audio data of the broadcast data to a first audio output module; And
Transmitting audio data transmitted from a device of the other party to a second audio output module
The method of providing a telephone service using a network TV further comprising. The method of claim 2,
The first audio output module and the second audio output module,
Providing a telephone service using a network TV corresponding to a speaker or a headset of the network TV. The method of claim 1,
Detecting a total number of persons by a face recognition sensor mounted in the network TV; And
Determining an output type of audio data of the broadcast data and audio data transmitted from a device of the counterpart according to the total number of people detected;
The method of providing a telephone service using a network TV further comprising. The method of claim 4, wherein
When the total number of people detected is two or more,
Audio data of the broadcast data is transmitted to a speaker of the network TV, and
And providing audio service using a network TV to transmit audio data transmitted from a device of the other party to a headset of the network TV. The method of claim 1,
The video call screen,
And providing at least one of an image photographed by a camera of the device of the other party or an image photographed by a camera of the network TV. In the network TV providing telephone service,
A display module configured to display video data among broadcast data received from at least one channel;
A network interface for receiving a call request signal from a device of the other party;
A detector for extracting caption data from the received broadcast data; And
Control the video data to be output to the first area of the display module, control to output the video call screen to the second area of the display module, and output the extracted caption data to the third area of the display module. Control unit
Network TV providing telephone service including. The method of claim 7, wherein
The control unit,
When the voice call mode is executed, a network providing a telephone service for controlling the video data to be output to the fourth region of the display module and for controlling the output of the extracted caption data to the fifth region of the display module. TV. The method of claim 7, wherein
The display module includes:
And a network service for displaying a screen for guiding an output type of audio data of the broadcast data and audio data transmitted from a device of the counterpart. 10. The method of claim 9,
The control unit,
Transmit audio data of the broadcast data to a first audio output module, and
Network TV providing a telephone service for transmitting audio data transmitted from a device of the other party to a second audio output module. The method of claim 10,
The first audio output module and the second audio output module,
Network TV providing a telephone service corresponding to the speaker or the headset of the network TV. The method of claim 7, wherein
A detector which detects the total number of persons by a face recognition sensor mounted on the network TV; And
The determination unit determines the output type of the audio data of the broadcast data and the audio data transmitted from the device of the counterpart according to the detected total number of people.
Network TV providing telephone service further comprising. The method of claim 12,
When the total number of people detected is two or more,
The control unit,
Audio data of the broadcast data is transmitted to a speaker of the network TV, and
Network TV providing a telephone service for transmitting audio data transmitted from the device of the other party to the headset of the network TV. The method of claim 7, wherein
The network TV,
Network TV that provides telephone service corresponding to any one of smart TV, IPTV, HBBTV, and DTV.

Images