KR101687615B1 - Method for providing telephone service in network tv and the network tv - Google Patents

Abstract

A method of providing a telephone service using a network TV according to an exemplary embodiment of the present invention includes displaying video data among broadcast data received from at least one channel and receiving a call request signal from a device of the other party The method comprising the steps of: displaying information identifying a video call mode or a voice call mode when received, extracting caption data of the received broadcast data; and, when the video call mode is executed, Displaying the video data in a second area of the network TV and displaying the extracted caption data in a third area of the network TV and displaying the extracted caption data in a second area of the network TV, , Displaying the video data in a fourth area of the network TV And displaying the extracted caption data in a fifth area of the network TV.

Description

METHOD FOR PROVIDING TELEPHONE SERVICE IN NETWORK TV AND THE NETWORK TV,

The present invention relates to network television technology, and more particularly, to a method and system for providing telephone service using network TV.

Recently, various types of network TVs have been discussed. In an embodiment of the network TV, a function of receiving and processing a larger amount of information in real time via a wired / wireless Internet network is expected, unlike a conventional television receiving limited data only through a broadcasting network. More specific embodiments of the network TV may include Internet protocol television (IPTV), smart television, hybrid broadcast broadband television (HBBTV), digital television (DTV), and the like.

However, the specific functions of the network TV have not been defined yet, and a method for providing a more advanced telephone system using network TV has not been developed yet.

For example, in a conventional TV, a TV service and a telephone service are separated, and various needs of the user can not be satisfied.

Further, according to the related art, there has been a problem that broadcast screens and audio are completely interrupted in a situation where a plurality of users watch TV.

Further, according to the related art, since the UI (user interface) of the TV providing the telephone service is very limited, it is extremely rare to utilize the telephone service using the TV.

One embodiment of the present invention seeks to provide a combined new hybrid service without separating the TV service and the telephone service.

Another embodiment of the present invention is to provide a design method capable of minimizing the influence on a TV service and a telephone service in a situation where a plurality of users watch TV.

In another embodiment of the present invention, a user interface (UI) of a TV providing a telephone service is provided to a user in a more customized form.

A method of providing a telephone service using a network TV according to an exemplary embodiment of the present invention includes displaying video data among broadcast data received from at least one channel and receiving a call request signal from a device of the other party The method comprising the steps of: displaying information identifying a video call mode or a voice call mode when received, extracting caption data of the received broadcast data; and, when the video call mode is executed, Displaying the video data in a second area of the network TV and displaying the extracted caption data in a third area of the network TV and displaying the extracted caption data in a second area of the network TV, , Displaying the video data in a fourth area of the network TV And displaying the extracted caption data in a fifth area of the network TV.

A network TV providing a telephone service according to an embodiment of the present invention includes a display module for displaying video data among broadcast data received from at least one channel, a display module for receiving a call request signal from the other party's device A controller for controlling the display module to output the video data to a first area of the display module, and a video call screen is output to a second area of the display module, And controlling the output of the extracted caption data in a third area of the display module.

According to an embodiment of the present invention, a combined new hybrid service is provided without separating the TV service and the telephone service.

According to another embodiment of the present invention, there is provided a design method capable of minimizing the influence on a TV service and a telephone service in a situation where a plurality of users watch TV.

According to another embodiment of the present invention, a user interface (UI) of a TV providing a telephone service is provided to a user in a customized form.

The effects of the more specific invention will be described later in detail in the following table.

1 is a diagram schematically illustrating an example of an overall broadcasting system including a network TV according to an embodiment of the present invention.
2 is a diagram showing an example of the network TV shown in FIG. 1 in more detail.
3 is a diagram illustrating an entire system including a network TV providing a telephone service according to an embodiment of the present invention.
FIG. 4 is a diagram illustrating specific modules of the network TV shown in FIG.
FIG. 5 is a diagram for guiding a video call mode and a voice call mode according to an embodiment of the present invention when a call is received.
6 is a diagram illustrating a process of switching broadcast audio to a mute state according to an embodiment of the present invention when a telephone call is received.
FIG. 7 is a diagram illustrating a screen for selecting whether to keep a broadcast audio mute state or display a caption subtitle according to an embodiment of the present invention when a telephone call is received.
FIG. 8 is a diagram for displaying caption data among broadcast data according to an embodiment of the present invention when the apparatus is in a voice communication mode.
FIG. 9 is a view for simultaneously displaying caption data and a video call screen among broadcast data according to an embodiment of the present invention in a video call mode.
10 is a diagram for explaining a first method of outputting a plurality of audio data according to an embodiment of the present invention.
11 is a diagram for explaining a second method of outputting a plurality of audio data according to an embodiment of the present invention.
12 is a diagram illustrating a process of adjusting the size of a video call screen according to an embodiment of the present invention.
13 is a diagram illustrating a process of adjusting the position of a video call screen according to an embodiment of the present invention.
14 is a diagram illustrating a first method of automatically customizing an audio output method using a face recognition sensor according to an embodiment of the present invention.
15 is a diagram illustrating a second method of automatically customizing an audio output method using a face recognition sensor according to an embodiment of the present invention.
16 is a flowchart illustrating a method of providing a telephone service using a network TV according to an embodiment of the present invention.
17 is a flowchart illustrating a method of providing a telephone service using a network TV according to another embodiment of the present invention.
FIG. 18 is a flowchart including steps added after steps S1504 and S1505 in FIG.
FIG. 19 is a flowchart showing the steps added after steps S1504 and S1505 in FIG.

Hereinafter, various embodiments of the present invention will be described in detail with reference to the accompanying drawings. Furthermore, the suffix "module" and " part "for components used in the following description are given merely for ease of description, and the" module " It can be designed in hardware or software.

Meanwhile, the network TV described in this specification is an intelligent video display device that adds a computer support function to a broadcast reception function, for example, and is equipped with an Internet function while being faithful to a broadcast reception function, It can be equipped with a more convenient interface such as a space remote controller. Also, it can be connected to the Internet and a computer by the support of a wired or wireless Internet function, and can perform functions such as e-mail, web browsing, banking or game. A standardized general-purpose OS may be used for these various functions.

Therefore, the network TV described in the present invention can be freely added or deleted from various applications, for example, on a general-purpose OS kernel, so that various user-friendly functions can be performed. More specifically, the network TV may be, for example, an Internet TV, an HBBTV, a smart TV, a DTV, or the like, and may be applied to a smart phone in some cases.

BRIEF DESCRIPTION OF THE DRAWINGS The above and other features and advantages of the present invention will be more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which: FIG.

As used herein, terms used in the present invention are selected from general terms that are widely used in the present invention while taking into account the functions of the present invention, but these may vary depending on the intention or custom of a person skilled in the art or the emergence of new technologies. Also, in certain cases, there may be a term chosen arbitrarily by the applicant, in which case the meaning thereof will be described in the description of the corresponding invention. Therefore, it is intended that the terminology used herein should be interpreted based on the meaning of the term rather than on the name of the term, and on the entire contents of the specification.

1 is a diagram schematically illustrating an example of an overall broadcasting system including a network TV according to an embodiment of the present invention. Hereinafter, an overall broadcast system including a network TV according to an embodiment of the present invention will be schematically described with reference to FIG.

1, an overall broadcasting system including a network TV according to an embodiment of the present invention includes a content provider (CP) 10, a service provider (SP) 20, A network provider (NP) 30 and an HNED 40. The HNED 40 corresponds to, for example, a client 100 that is a network TV according to an embodiment of the present invention.

The content provider 10 produces and provides various contents. 1, a terrestrial broadcaster, a cable SO (System Operator), a MSO (Multiple System Operator), a satellite broadcaster, An Internet broadcaster, and the like may be exemplified. [0040] In addition, the content provider 10 may provide various applications in addition to the broadcast content.

The service provider 20 can provide the contents provided by the contents provider 10 in a service package. For example, the service provider 20 of FIG. 1 can package and provide the first terrestrial broadcast, second terrestrial broadcast, cable MSO, satellite broadcast, various Internet broadcasts, applications, etc. to the user.

Meanwhile, the service provider 20 can provide a service to the client 100 using a unicast or multicast method. The unicast method is a method of transmitting data 1: 1 between one sender and one receiver. For example, in a unicast method, when a receiver requests data from a server, the server can transmit data to the receiver upon request. The multicast method is a method of transmitting data to a plurality of receivers of a specific group. For example, the server can transmit data to a plurality of pre-registered receivers at once. An Internet Group Management Protocol (IGMP) protocol may be used for multicast registration.

The network provider 30 may provide a network for providing services to the client 100. The client 100 may be provided with a service by building a home network end user (HNED).

On the other hand, conditional access or content protection may be used as means for protecting transmitted contents. As an example of such a conditional access or content protection, a scheme such as a cable card (CableCARD) or a DCAS (Downloadable Conditional Access System) may be used, but the present invention is not limited thereto.

On the other hand, the client 100 can also provide the content through the network. In this case, conversely, conversely, conversely, the client 100 may be a content provider, and the content provider 10 may receive content from the client 100. [ In this case, there is an advantage that an interactive content service or a data service is possible.

2 is a diagram showing an example of the network TV shown in FIG. 1 in more detail. Hereinafter, an example of the network TV shown in FIG. 1 will be described in more detail with reference to FIG.

The network TV 200 according to an embodiment of the present invention includes a network interface 201, a TCP / IP manager 202 and a service delivery manager 203 A demultiplexer 205, a PSIP and / or SI decoder 204, an audio decoder 206, a video decoder 207, a display unit A / and OSD Module 208, a Service Control Manager 209, a Service Discovery Manager 210, a Metadata Manager 212, an SI & Metadata DB 211, A manager 214, and a service manager 213.

The network interface unit 201 receives packets received from the network and transmits packets to the network. That is, the network interface unit 201 receives services, contents, and the like from the service provider through the network.

The TCP / IP manager 202 is involved in delivering packets received from the network TV 200 and packets transmitted from the network TV 200, that is, from the source to the destination. Then, the TCP / IP manager 202 classifies the received packets so as to correspond to the appropriate protocols and classifies them into the service delivery manager 205, the service discovery manager 210, the service control manager 209, and the metadata manager 212 Lt; / RTI >

The service delivery manager 203 is responsible for controlling the received service data. For example, RTP / RTCP can be used to control real-time streaming data. When the real-time streaming data is transmitted using the RTP, the service delivery manager 203 parses the received data packet according to RTP and transmits it to the demultiplexer 205 or to the service manager 213 And stores it in the SI & Metadata DB 711. And feedbacks the network reception information to the server providing the service using the RTCP.

The demultiplexer 205 demultiplexes the received packets into audio, video, program specific information (PSI) data, and transmits them to the audio / video decoders 206 and 207 and the PSI & PSIP and / do.

The PSI & PSIP and / or SI Decoder 204 decodes service information such as PSI (Program Specific Information), for example. That is, the PSI & PSIP and / or SI decoder 204 receives and decodes the demultiplexed PSI section, the Program and Service Information Protocol (PSIP) section, or the SI (Service Information) section in the demultiplexer 205.

In addition, the PSI & PSIP and / or SI decoder 204 decodes the received sections to create a database of service information, and stores the database related to the service information in the SI & Metadata DB 211.

The audio / video decoder 206/207 decodes the video data and audio data received from the demultiplexer 205. [ The audio data decoded by the audio decoder 206 and the video data decoded by the video decoder 207 are provided to the user through the display unit 208.

The UI manager 214 and the service manager 213 manage the overall state of the network TV 200, provide a user interface, and manage other managers.

The UI manager 214 provides a GUI (Graphic User Interface) for the user using an OSD (On Screen Display) or the like, and receives a key input from the user to perform a receiver operation according to the input. For example, upon receipt of a key input from the user regarding channel selection, the key input signal is transmitted to the service manager 213.

The service manager 213 controls the manager associated with the service, such as the service delivery manager 203, the service discovery manager 210, the service control manager 209, and the metadata manager 212.

The service manager 213 also creates a channel map and selects a channel using the channel map according to the key input received from the user interface manager 214. The service manager 213 receives the service information of the channel from the PSI & PSIP and / or SI Decoder 204 and sets an audio / video PID (Packet Identifier) of the selected channel in the demultiplexer 205.

The service discovery manager 210 provides information necessary for selecting a service provider that provides the service. Upon receiving a signal regarding channel selection from the service manager 213, the service discovery manager 210 searches for the service using the information.

The service control manager 209 is responsible for selection and control of services. For example, when a user selects a service such as IGMP or RTSP when selecting a Live Broadcasting service such as an existing broadcasting method and selects a service such as VOD (Video On Demand), RTSP is used to select a service, control . The RTSP protocol may provide a trick mode for real-time streaming. Also, the service control manager 209 can initialize and manage a session through the IMC gateway using an IP Multimedia Subsystem (IMS) and a Session Initiation Protocol (SIP). The protocols are one embodiment, and other protocols may be used, depending on the implementation.

The metadata manager 212 manages the metadata associated with the service and stores the metadata in the SI & Metadata DB 211.

The SI & Metadata DB 211 selects the service information decoded by the PSI & PSIP and / or SI Decoder 204, the metadata managed by the metadata manager 212, and the service provider provided by the service discovery manager 210 Store the necessary information. In addition, the SI & Metadata DB 211 may store setup data and the like for the system.

The SI & Metadata DB 211 may be implemented using a nonvolatile RAM (NVRAM) or a flash memory.

Meanwhile, the IG 250 is a gateway that collects functions necessary for accessing an IMS-based IPTV service.

3 is a diagram illustrating an entire system including a network TV providing a telephone service according to an embodiment of the present invention. Hereinafter, an overall system including a network TV providing a telephone service according to an embodiment of the present invention will be described in detail with reference to FIG.

3, a network TV 300 providing a telephone service according to an embodiment of the present invention includes a camera 301, a speaker 302, a microphone 303, an Ethernet module 304, a wireless interface A headset 305, a headset 306, and the like.

The network TV 300 can communicate with the mobile phone 310, the PC 320, and the TV 330 remotely located outside the network TV 300 through the Ethernet module 304. In addition, telephone communication is performed through a wired / wireless network.

The wireless interface 305 is connected to the headset 306 through radio communication (for example, WiFi, Bluetooth, etc.) and thus receives audio data from the broadcast data received by the network TV 300, It is possible to transmit and receive audio data. However, the scope of the present invention is not limited thereto, and in principle, the scope of the present invention should be determined by the scope of the claims.

The speaker 302 selectively outputs audio data among broadcast data received by the network TV 300 or audio data received from a telephone-connected external device. The microphone 303 is a module that can detect voice of a user adjacent to the network TV 300, and can be used, for example, for connecting a telephone with an external device.

Further, the camera 301 is a module that can photograph a state of a user adjacent to the network TV 300, and can be used, for example, in a telephone connection with an external device. In particular, according to another embodiment of the present invention, the camera is designed to be equipped with a face recognition sensor so that it can be used to grasp the number of adjacent users. A detailed description thereof will be described later.

FIG. 4 is a diagram illustrating specific modules of the network TV shown in FIG. Hereinafter, with reference to FIG. 4, concrete modules of the network TV 300 shown in FIG. 3 will be described in more detail.

4, a network TV 400 according to an exemplary embodiment of the present invention includes a broadcast receiver 401, a detector 402, a display module 403, a controller 404, a network interface 405, A detection unit 406, a determination unit 407, a microphone 408, a speaker 409, and a headset 410. However, the modules shown in FIG. 4 are merely examples, and the scope of the present invention is not limited to FIG. 4. In principle, the scope of the present invention should be determined by the claims.

The broadcast receiving unit 401 receives broadcast data from at least one channel. The broadcast receiver 401 can be designed as an interface capable of receiving IP information, and may be designed as a tuner according to circumstances.

The display module 403 displays video data of the received broadcast data, and the network interface 405 receives a call request signal from the other party's device. The network interface 405 can be designed, for example, as modules for processing an Internet telephone service and a VoIP service, and there is no particular restriction on the other party's device. That is, the other party's device may be the mobile phone 310, the PC 320, the TV 330, or a conventional wired telephone shown in FIG.

The detector 402 extracts caption data among the received broadcast data. 4, the detector 402 may further be designed so as to perform a function of converting the data format so that the extracted caption data can be output from the display module 403. FIG.

The control unit 404 controls the video data to be output to the first area of the display module 403 and controls the video communication screen to be output to the second area of the display module 403, And controls the extracted caption data to be output to the third area of the module 403.

Therefore, according to the embodiment of the present invention, the user can easily use the telephone service while viewing the TV broadcast screen. Particularly, there is an advantage that the pure functions of broadcasting service and telephone service can be maintained at the same time.

Further, when the voice communication mode is executed, the control unit 404 controls the video data to be output to the fourth area of the display module 403, And controls to output the extracted caption data. On the other hand, the above-described first to fifth regions may be partially designed or may not be completely overlapped, i.e., completely different regions may be designed.

In addition, in the embodiment of the present invention, the video call mode and the voice call mode are distinguished from each other and will be described in more detail with reference to FIG. 5 to FIG.

According to another embodiment of the present invention, the display module 403 displays a screen for guiding the output type of the audio data of the broadcast data and the audio data transmitted from the other party's device. Further, the control unit 404 transmits the audio data of the broadcast data to the first audio output module, and transmits the audio data transmitted from the other device to the second audio output module. The first audio output module and the second audio output module correspond to, for example, the speaker 409 or the headset 410 of the network TV.

Therefore, according to another embodiment of the present invention, high-weighted audio data can be selectively output to a speaker or a headset according to the needs of the user. A method of changing the audio data output method according to another embodiment of the present invention will be described later in detail with reference to FIG. 8 to FIG.

In addition, according to another embodiment of the present invention, the network TV 400 includes a detection unit 406 for detecting the total number of persons by a face recognition sensor mounted on the network TV, And a determination unit (407) for determining the output type of the audio data of the broadcast data and the audio data transmitted from the other party's device. If the detected total number of persons is two or more, the control unit 404 transmits the audio data of the broadcast data to the speaker 409, and the audio data transmitted from the other party's device is transmitted to the headset 410 do.

Therefore, according to another embodiment of the present invention designed in this way, there is an advantage that the user does not need to set the audio output method in particular. When there are a large number of users adjacent to the TV, it is difficult to have a number of headsets satisfying all of a plurality of users. Taking this into consideration, the company introduced a smart function that automatically outputs the voice data required by the caller to the headset, and automatically outputs the existing broadcasts to the speaker. On the other hand, privacy is protected when the user is alone, so it will not be necessary to output the audio data related to the telephone call through the headset. A method of automatically changing the audio data output method in consideration of the number of users according to another embodiment of the present invention will be described later in detail with reference to FIG. 12 to FIG.

Meanwhile, as described above, the network TV 400 corresponds to any one of a smart TV, IPTV, HBBTV, and DTV.

FIG. 5 is a diagram for guiding a video call mode and a voice call mode according to an embodiment of the present invention when a call is received. Hereinafter, a video call mode and a voice call mode according to an embodiment of the present invention will be described in detail with reference to FIG.

According to an embodiment of the present invention, a general broadcasting screen 500 is displayed as shown in FIG. When a call request signal is received from the other party's device while the general broadcast screen 500 is being displayed, information for guiding the call request signal is displayed. As another example, as shown in FIG. 5, an indicator 510 for selecting whether to use a video communication mode or a voice communication mode is simultaneously displayed to the user who watched the broadcast screen.

6 is a diagram illustrating a process of switching broadcast audio to a mute state according to an embodiment of the present invention when a telephone call is received. 7 is a diagram illustrating a screen for selecting whether to keep a broadcast audio mute state or display a caption subtitle according to an embodiment of the present invention when a telephone call is received.

When a call is received from the other party device, the guidance screen as shown in FIG. 5 may be designed to be displayed. However, it is also possible to design the broadcast audio to automatically change to a mute state as shown in FIG. Thus, the user has the advantage of entering the video telephone service without any special recognition.

Furthermore, as another embodiment, when either the video telephone mode or the voice telephone mode shown in Fig. 5 is selected, a screen for selecting a broadcast audio mute or a caption display is displayed in a pop-up format as shown in Fig. 7 . It is designed considering both users who desire caption and caption, and users who do not.

On the other hand, it is also possible that the screen shown in FIG. 7 is not displayed every time a telephone call comes, and that the caption is automatically displayed whenever the user sets it once. Hereinafter, it is assumed that a caption is automatically displayed. However, the scope of the present invention is not limited to these embodiments.

FIG. 8 is a diagram for displaying caption data among broadcast data according to an embodiment of the present invention when the apparatus is in a voice communication mode. 9 is a view for simultaneously displaying caption data and a video call screen among broadcast data according to an embodiment of the present invention when the video call mode is used. Hereinafter, a video call mode and a voice call mode according to an embodiment of the present invention will be described in more detail with reference to FIGS. 8 to 9. FIG.

If the voice communication mode is selected, the general broadcast screen 600 and the caption data 610 of the broadcast data are simultaneously displayed as shown in FIG. Accordingly, the user has the advantage of minimizing disturbance to the broadcast screen 600 being watched, and simultaneously checking the voice data of the current broadcast with subtitles.

On the other hand, when the video call mode is selected, as shown in FIG. 9, the general broadcast screen 700, the video call screen, and the caption data 710 of the broadcast data are simultaneously displayed. Particularly, as shown in Fig. 9, the video call screen includes at least one of video data 720 of the other party photographed by the camera of the telephone device, or video data 730 of the person himself / herself . Accordingly, the user can simultaneously check the broadcasting screen 700 and the video call screens 720 and 730 while simultaneously checking the voice data of the current broadcasting through captions.

10 is a diagram for explaining a first method of outputting a plurality of audio data according to an embodiment of the present invention. 11 is a diagram for explaining a second method of outputting a plurality of audio data according to an embodiment of the present invention. Hereinafter, a method of selecting audio data of the telephone service according to the user's convenience will be described with reference to FIGS. 10 and 11. FIG. However, it is assumed that a video communication mode is used, but the scope of the present invention is not limited thereto.

As shown in FIG. 10, the broadcast screen 800, the caption data 810, and the video call screens 820 and 830 are displayed in the same manner as described above. In FIG. 10, an item 840 for determining the manner in which audio data of a video call is output is additionally provided. Therefore, according to Fig. 10, the audio data of the video call is outputted through the speaker of the network TV. In this case, the audio data of the broadcast data is output through the headset of the network TV.

11, the broadcast screen 900, the caption data 910, and the video call screens 920 and 930 are displayed in the same manner as described above. 11, an item 940 for determining the manner in which audio data of a video call is output is additionally provided. Thus, according to Fig. 11, the audio data of the video call is outputted through the headset of the network TV. In this case, the audio data of the broadcast data is outputted through the speaker of the network TV.

12 is a diagram illustrating a process of adjusting the size of a video call screen according to an embodiment of the present invention. 13 is a diagram illustrating a process of adjusting a position of a video call screen according to an embodiment of the present invention. Hereinafter, an embodiment for arbitrarily changing the size or position of a video call screen will be described with reference to FIGS. 12 and 13. FIG.

12, the broadcast screen 1000, the caption data 1010, and the video call screens 1020 and 1030 are displayed in the same manner as described above. 12, the sizes of the video call screens 1020 and 1030 can be arbitrarily changed.

As shown in FIG. 13, the broadcast screen 1100, the caption data 1110, and the video call screens 1120 and 1130 are displayed in the same manner as described above. 13, the sizes of the video call screens 1120 and 1130 can be arbitrarily changed. Therefore, the user can easily and conveniently set the ratio of the broadcast screen, the counterpart screen, and the screen of the user, which the user desires.

14 is a diagram illustrating a first method of automatically customizing an audio output method using a face recognition sensor according to an embodiment of the present invention. 15 is a diagram illustrating a second method of automatically customizing an audio output method using a face recognition sensor according to an embodiment of the present invention. Hereinafter, referring to FIGS. 14 and 15, methods for automatically customizing the audio output method using the face recognition sensor will be described.

As shown in FIG. 14, the broadcast screen 1200, the caption data 1210, and the video data 1220 of the other party are the same as those described above. 14, there are other features such as the camera 1260, the user's video data 1230, the face recognition area 1240, and the audio data output method item 1250 that is automatically changed.

According to one embodiment of the present invention, the camera 1260 is equipped with a face recognition sensor, and the face recognition sensor includes, for example, a face recognition unit and a face recognition area display unit.

The face recognition unit detects at least one face from the image including the group person. Face Recognition is a feature-based face detection method that finds invariant features of a face (facial elements such as eyes, nose, and mouth), texture, and skin color. Among the various facial features, skin coloration is the most widely used method because it is less sensitive to movement, rotation, and size change of face. In addition, the template-based detection method used by the face recognition unit creates some standard patterns for the face, and then stores the pattern for face detection. Then the patterns are compared one by one in the search window of the image and the face is detected. As a face detection method, there is a face detection method based on SVM (support vector machine) which is widely used recently. SVM-based methods are a method of sub-sampling different regions from an image to learn face and non-face (non-face parts) through a learning device and then finding faces in the input image.

The face recognition area display unit displays an area on the recognized faces. In the current face recognition function, there is a rectangular recognition zone, that is, a face recognition area on the face of the subject, and the size of the face recognition area increases or decreases according to the distance between the subject and the lens 10. FIG. 14 shows an example 1240 in which the face recognition area is displayed according to the face recognition result of the image. And one user is adjacent to the network TV.

Accordingly, if only one user 1240 exists as a result of checking the area 1230 in which the image photographed by the camera 1260 mounted with the face recognition sensor is displayed, the voice data of the telephone service is transmitted through the speaker system 1250 . Since the user is alone, the contents of the conversation may be transmitted through the speaker.

15, the broadcasting screen 1300, the caption data 1310, the video data 1320 of the other party, and the camera 1360 are the same as those described above with reference to FIG.

However, FIG. 15 differs from FIG. 14 in that there are two users 1340 photographed through the camera 1360. 15, since the area 1330 in which the image photographed by the camera 1360 equipped with the face recognition sensor is displayed, as a plurality of users 1340 exist, The data is output via the headset system 1350, not the speakers of the network TV. When there are a plurality of users, it is necessary to consider the privacy of the person making the telephone call. Such a smart function can be given to greatly improve convenience for the user.

16 is a flowchart illustrating a method of providing a telephone service using a network TV according to an embodiment of the present invention. Hereinafter, with reference to FIG. 16, a method of providing a telephone service in three modes using a network TV according to an embodiment of the present invention will be described as follows. On the other hand, FIGS. 16 to 19 illustrate the method of the invention and, if necessary, supplement and interpret the above-described drawings.

The network TV implemented according to an embodiment of the present invention receives a calling signal from a device of the other party (S1400). The network TV determines whether to keep the currently outputting broadcast data (S1401). However, the step S1401 may be performed automatically or may be selected by a user using a user interface (UI).

As a result of the determination (S1401), if it is not the case that the broadcast data currently being output is maintained, the basic video communication mode is entered (S1402). The network TV displays only a video call screen without a broadcast screen (S1403).

On the other hand, if it is determined that the broadcast data currently being output is maintained (S1401), it is determined whether to select a video call (S1404). If the determination result 1404 is not selected, the TV-voice communication mode is entered (S1405). Then, the network TV displays the broadcast screen and the caption data (S1406). An example of step S1406 is shown in detail in FIG.

On the other hand, if the determination result (S1404) is selected, the TV-video communication mode is entered (S1407). Then, the network TV displays a broadcast screen, a video call screen, and caption data (S1408). An example of step S1408 is shown in detail in FIG.

17 is a flowchart illustrating a method of providing a telephone service using a network TV according to another embodiment of the present invention. Hereinafter, a method of providing a telephone service in two modes using a network TV will be described in detail with reference to FIG. 17, in accordance with an embodiment of the present invention.

The video data among the broadcast data received from at least one channel is displayed (S1500). It is determined whether a call request signal is received from the other party's device (S1501). If the determination result in step S1501 is negative, the process returns to step S1500.

On the other hand, if the determination result (S1501) is received, information identifying the video call mode or the voice call mode is displayed (S1502). Further, caption data among the received broadcast data is extracted (S1503).

Further, when the video call mode is executed, the video data is displayed in a first area of the network TV, a video call screen is displayed in a second area of the network TV, And caption data is displayed (S1504).

If the voice communication mode is executed, the video data is displayed in a fourth area of the network TV and the extracted caption data is displayed in a fifth area of the network TV (S1505).

The video call screen includes at least one of, for example, an image captured by a camera of the other party's device or an image captured by a camera of the network TV. In addition, the first to fifth regions may be partially overlapped, or may be designed as completely different regions.

FIG. 18 is a flowchart including steps added after steps S1504 and S1505 in FIG. Hereinafter, a method according to another embodiment of the present invention will be described with reference to FIG.

17, the network TV according to another embodiment of the present invention displays a screen for guiding the output type of the audio data of the broadcast data and the audio data transmitted from the device of the other party (step S 1504) (S1600). A specific example of the step S1600 is shown in detail in 840 of FIG. 10 and 940 of FIG.

In addition, the network TV transmits the audio data of the broadcast data to the first audio output module (S1601), and transmits the audio data transmitted from the other party's device to the second audio output module (S1602). The first audio output module and the second audio output module correspond to a speaker or a headset of the network TV.

FIG. 19 is a flowchart showing the steps added after steps S1504 and S1505 in FIG. Hereinafter, a method according to another embodiment of the present invention will be described with reference to FIG.

In steps S 1504 and S 1505 of FIG. 17, the network TV according to another embodiment of the present invention detects the total number of persons by the face recognition sensor mounted on the network TV (S 1700). The network TV determines the output type of the audio data of the broadcast data and the audio data transmitted from the device of the other party according to the detected total number of people (S1701).

More specifically, for example, if the detected total number of persons is two or more, the audio data of the broadcast data is transmitted to the speaker of the network TV, and the audio data transmitted from the other party's device To the headset of the network TV.

In this specification, both the invention and the invention of the method are explained, and the description of the two inventions can be supplementarily applied as necessary.

The method inventions according to the present invention can all be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

While the invention has been shown and described with reference to certain preferred embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. This is possible.

Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined by the equivalents of the claims, as well as the claims.

300, 400: Network TV
301: Camera
306, 410: Headset

Claims (14)

A method for providing a telephone service using a network TV,
Displaying video data among broadcast data received from at least one channel;
Displaying information identifying a video call mode or a voice call mode when a call request signal is received from a device of the other party;
Extracting caption data among the received broadcast data;
Detecting a number of persons within a recognizable range by a face recognition sensor mounted on the network TV;
Transmitting audio data transmitted from the other party's device to a speaker of the network TV when the detected number of persons is one;
Transmitting the audio data transmitted from the other party's device to the headset of the network TV and transmitting the audio data of the broadcast data to the speaker of the network TV when the number of detected persons is two or more;
Displaying the video data in a first area of the network TV, displaying a video call screen in a second area of the network TV, and displaying the extracted caption data in a third area of the network TV when the video call mode is executed, ; And
Displaying the video data in a fourth area of the network TV and displaying the extracted caption data in a fifth area of the network TV when the voice call mode is executed
The method comprising the steps of: The method according to claim 1,
Displaying a screen for guiding audio data of the broadcast data and output types of audio data transmitted from the other party's device;
Transmitting audio data of the broadcast data to a first audio output module; And
Transmitting audio data transmitted from the other party's device to a second audio output module
The method comprising the steps of: 3. The method of claim 2,
Wherein the first audio output module and the second audio output module comprise:
And a network TV corresponding to the speaker or headset of the network TV. delete delete The method according to claim 1,
The video call screen includes:
Wherein the network TV comprises at least one of a video shot by a camera of the other party's device or a video shot by a camera of the network TV. A network TV providing a telephone service,
A display module for displaying video data among broadcast data received from at least one channel;
A detector for detecting a total number of persons within a range recognizable by a face recognition sensor mounted on the network TV;
A network interface for receiving a call request signal from a device of the other party;
A detector for extracting caption data among the received broadcast data; And
The control unit controls the video data to be output to the first area of the display module, controls the video communication screen to be output to the second area of the display module, and outputs the extracted caption data to the third area of the display module And a control unit for controlling the control unit,
Wherein,
And transmits the audio data transmitted from the other party's device to the speaker of the network TV when the detected number of persons is one,
Wherein the audio data transmitted from the other party's device is transmitted to the headset of the network TV and the audio data of the broadcast data is transmitted to the speaker of the network TV when the number of detected persons is two or more. Network TV providing. 8. The method of claim 7,
Wherein,
And controlling the video data to be output to the fourth area of the display module when the voice communication mode is executed and controlling the output of the extracted caption data to the fifth area of the display module TV. 8. The method of claim 7,
The display module includes:
And displays a screen guiding the output type of the audio data of the broadcast data and the audio data transmitted from the other party's device. 10. The method of claim 9,
Wherein,
Transmitting the audio data of the broadcast data to the first audio output module, and
And transmits the audio data transmitted from the other party's device to the second audio output module. 11. The method of claim 10,
Wherein the first audio output module and the second audio output module comprise:
A network TV providing a telephone service corresponding to the speaker or headset of the network TV. delete delete 8. The method of claim 7,
The network TV includes:
A network TV providing a telephone service corresponding to one of smart TV, IPTV, HBBTV, and DTV.

Images