WO2012144963A1 - Establishing audio and video communication by means of a camera and a microphone embedded in a television and the system that supports it - Google Patents

Abstract

The invention is a system wherein at least one audio receiver (7) capturing the audio information of the user and at least one image receiver (5) capturing the image of the user are integrated with said television (A) in order to provide video and audio communication between people via television (A) over a network interface input (3), comprising a digital media processor (12), wherein data coming from video and audio receivers (5,7) of the user and the other party are processed, running the client software located at the storage unit (11) embedded in said television (A), a video decoder and encoder (8) processing media image received from image receiver (5) and transmitting it to said digital media processor (12), an audio coder and decoder (13) processing audio information transmitted by audio receiver (7) and/or audio input transmitting it to said media processor (12), a client interface providing display of video and audio received from the opposite party and the user on its television (A) screen (15), making the video and audio adjustments, display of messaging information of the user and the opposite party on the television screen and a client interface controlling this client

Description

DESCRIPTION

ESTABLISHING AUDIO AND VIDEO COMMUNICATION BY MEANS OF A CAMERA AND A MICROPHONE EMBEDDED IN A TELEVISION AND THE

SYSTEM THAT SUPPORTS IT

The Related Art

The invention relates to VoIP client that provides to make VoIP protocol call comprising audio and/or high resolution image elements by working as embedded on a television software.

The invention relates in particular to a client that provides the television user to receive and/or send audio and/or high resolution image over the Internet protocol (IP) by help of a video image receiver and an audio receiver integrated with a television by using a presently available processor, a loudspeaker, a network adapter, a remote controller, audio and high resolution visual abilities of the television.

The Prior Art

The television is a communication system providing conversion of video and audio broadcast from a transmitter in electromagnetic waves thanks to electronic receivers with screen and loudspeaker back to video and audio. Televisions used today are devices generally having a processor, a network adapter and a remote control, capable of producing audio and high resolution video. In the prior art, on the existing hardware, there is not a client providing that a television user is capable of intercepting and/or sending audio and/or high resolution image over the Internet protocol (IP) by help of a video image receiver and an audio receiver integrated with the television set and an audio receiver and/or an image receiver embedded in the television, providing that client to receive and/or send audio and/or video. Applications used in the prior art are obtained through connection of an image receiver and/or an audio receiver to the television over USB (Universal Serial Bus) externally or through an external set-top box. VoIP (Voice over Internet Protocol) on, the other hand is a protocol providing to send audio and video information transmission over the Internet protocol. VoIP system can be defined logically as sending audio through digitisation of it and delivery to the recipient. In other words, VoIP provides making telephone calls over computer.

SIP (Session Initiation Protocol) on the other hand initiates sessions over IP networks for those wishing to communicate. A session is an interactive communication between two or more people over IP network. That may be a simple two-way telephone call or an instant messaging or a multi-media conferencing session wherein there is co-operation. People communicating with each other use symbolic addresses.

SIP supports integrated audio and multi-media services by means of audio powered e - commerce, Web page click and translate, partner lists and instant messaging and many more features. SIP session management is a key to supporting IP-based natural communication not between devices but people. By use of SIP, users can find each other and be in touch independent of media content and the numbers of participants, by means of separate computers, telephones, televisions and manual devices. SIP is a control protocol that Initiates, changes, terminates communication sessions between one or multiple number of participants. That protocol allows participants to agree on a series of compliant media type and supports user surfing by meeting and directing requests at valid position of each user. SIP supports the following functions:

- Name transformation and user location: allows people to find each other without knowing details of their device address or physical locations.

- Media calls: run calls providing agreement of all participants on common media and relevant technological details in a session.

- Session participant management: manages addition, deletion or transfer of participants.

- Session property changes: allow change of media used in a session while the session is in progress. Functions that Session Initiation Protocol (SIP) performs for setting up or terminate a session:

- Determination of user location,

- Determination of users that will participate the connection,

- Determination of capacities of ends and setting of parameters accordingly,

- Making calls and setting of call parameters on both ends,

- Management of the session.

During the research done on the Internet regarding video conferencing systems setup via television, American applications with publication numbers US20100171806 and US2007121599 and Chinese application with publication number CN101815198 have been encountered.

The invention numbered US20100171806 . and titled "TV With Internet Video Conferencing" relates to a television that can be connected to the Internet, comprising an image receiver and an audio receiver. Signals from the audio receiver and the image receiver are processed by an IP telephone module found in the television. After multi-channelled, they are sent to the address(es) one or multiple users selected over the Internet. The incoming video conference signals on the other hand are submitted to the user by means of a television screen and a loudspeaker. Here, with addition of IP telephone module, the invention has been provided with the ability to make VoIP audio/video calls. Data sent from the audio receiver and image receiver need to be processed through IP telephone module. This situation on the other hand produces the result of adding an extra module to the system, Since the processing is not at the level of software, it produces the consequence of occurrence of delays.

In the system belonging to the invention titled "Communication system based on set- top box and communication method", numbered CN101815198, an external set-top box not embedded in the television is used and the image receiver and the audio receiver communicate with that set-top box via wireless medium. With the help of set- top box, video received from the image receiver communicated wireless and audio information received from the audio receiver are sent to side of network by using SIP protocol and video information coming from the network via SIP protocol are converted to television signals on the set-top box. Converted data are transmitted to the television screen while audio information, on the other hand, to the loudspeaker of the remote controller. In this invention, use of separate device mounted to the television is obligatory. Furthermore, the audio receiver and the image receiver are not integrated with the television. Additionally, while incoming video is being presented on the television, the audio is given from a loudspeaker located at the controller. In conclusion, developments are being made in television systems, wherein image receiver and audio receiver are embedded, providing transmission of video and/or audio information received from users wishing to establish communication with each other to the other party over the Internet, therefore new embodiments that will eliminate the disadvantages mentioned above and will bring solutions to existing systems are needed.

Purpose of the Invention

The present invention relates to television systems meeting the requirements mentioned above, eliminating all the disadvantages and introducing some additional advantages, wherein image receiver and audio receiver are embedded, providing transmission of video and/or audio information received from users wishing to establish communication with each other to the other party over the Internet.

A purpose of the invention is to develop a system that provides intercepting and/or sending audio and/or high resolution image over the Internet protocol (IP) by use of presently available processor, loudspeaker, network adapter, remote controller audio and high resolution image capabilities of the television.

Another purpose of the invention is to provide practical application and low cost in the system by use of devices such as processor, loudspeaker, network adapter, remote controller that are available in the television.

Another purpose of the invention is to eliminate the need for a separate device such as set-top box, with image receiver and audio receiver embedded in the television. Thus, while gain is obtained from spatial use, formation of a heap of objects is prevented.

Therefore, at least one image receiver and at least one audio receiver are incorporated as embedded to the television in order to provide audio and/or video transmission power over the Internet protocol and it is earned with audio and/or video transmission and messaging capability over the Internet protocol (IP) by making use of other presently available components. Based on this, it is a further objective of the invention that the television performs a plurality of functions and customer satisfaction is increased.

To meet the objectives mentioned above, the invention is a system, embedded in a television, supporting establishment of communication, capturing audio information of the user via at least one audio receiver and capturing image of the user at least one image receiver in order to provide video and audio communication between people via television over the network interface input, comprising

- a digital media processor located at the read - only memory, embedded in said television, wherein data coming from video and audio receivers of the user and the other party are processed,

- a video decoder and encoder processing media image received from image receiver and transmitting it to said digital media processor,

- an audio coder and decoder processing audio information transmitted by audio receiver and/or audio input transmitting it to said media processor,

- a client interface providing display of video and audio received from the opposite party and the user on the television screen, making the video and audio adjustments, display of messaging information of the user and the opposite party on the television screen. To meet the objectives mentioned above, the invention comprises a client interface, an image interface comprising user image and image information of the opposite party with which the user is in communication. To meet the objectives mentioned above, the invention comprises a client interface, an image interface and a controller providing remote control of the other menus required and remote access. To meet the objectives mentioned above, the invention is a method for establishment of communication via at least one audio receiver capturing audio information of user and at least one image receiver capturing image of user embedded in the television in order to provide video and audio communication between people via television over the network interface input, wherein performing the operation steps of

- processing audio and video information of the user and the opposite party that is being communicated with in a digital media processor, - submission of the processed video information to the user via television screen, and audio information, on the other hand, via the loudspeaker. The structural and characteristic properties of the invention and all of its advantages will be understood more clearly from the figures provided below and from the detailed description written by making references to these figures and therefore, the evaluation should also be made by taking these figures and the detailed description into account.

Brief Description of the Drawings

To understand of the embodiment of present invention and its advantages with its additional components in the best way, it should be evaluated together with below described figures.

Figure 1 gives a block diagram of a sample application wherein the system which is the subject of the invention is applied to the television.

Figure 2 is a representative view of the television at the time of telecommunication established reciprocally between two people for purpose of communication.

The drawings do not need to be absolutely put to scales and details not essential to understand the present invention may have been omitted. Furthermore, the elements that are at least identical, or at least substantially have identical functions are illustrated with the same number. Reference Numbers

A. Television

1. Antenna

1.1. Antenna receiver

2. Device connection input

3. Network interface input

4. HDMI input

4.1. HDMI receiver

5. Image receiver

6. Audio input

7. Audio receiver

8. Video decoder and coder

9. Analogue digital converter

10. Data storage unit (RAM)

11. Storage unit (ROM, PROM, EPROM, EEPROM or FLASH ROM)

12. Digital media processor

13. Audio coder and decoder

14. Remote Controller

14.1. RC Receiver

15. Screen

16. Loudspeaker

VoIP: Voice over Internet Protocol

SIP: Session Initiation Protocol

IP: Internet Protocol

Detailed Description of the Invention

In this detailed description, the preferred embodiments of the television (A), which is the subject of the invention, are disclosed only for better understanding of the subject, and in a manner not constituting any restrictive effect.

Television (A) is a communication system providing conversion of video an audio broadcast in electromagnetic waves from a transmitter into images and sounds thanks to electronic receivers with a screen (15) and a loudspeaker (16), and an electronic device providing access to that communication system. With this invention, television (A) is earned the feature of embedded hardware and embedded software required in order to add the capacity to make VoIP calls over a network interface.

The television (A) which is the subject of the invention, comprises an image receiver (5) capturing image of user from the medium wherein said television (A) is located, also an audio receiver (7) capturing audio input of user from the medium wherein said television (A) is located. The image receiver (5), which is a camera, and the audio receiver (7), which is a microphone, are structured as embedded in the television (A).

The television (A) comprises a receiving antenna (1 ) collecting electromagnetic waves, a device connection input (2) providing establishment of connection of external hardware with the television (A) externally, a network interface input (3) providing the television (A) to be able to transmit data package to the network and receive package from the network, an HDMI input (4) having a high definition multimedia interface that supports carrying of developed and high definition video and multi-canal audio signals over a single cable, an analogue digital converter (9) providing transmission by converting analogue signals to digital ones, a data storage unit (RAM) (10) providing instantaneous access to data, a data storage unit (ROM) (1 1 ) wherein data required for operation of the device during production phase are stored, a digital media processor (12) processing multi-channel media data transmitted real - time and directing them to relevant units, an audio coder and decoder (13) to which audio information is transmitted and converting it to a processable state by the digital media processor (12), a controller (14) providing user with remote access to the system, a screen (15) on which images are shown to the user, a loudspeaker (16) converting electrical signals transmitted by audio coder and decoder (13) into sound vibrations (Figure 1 ).

The controller (14) has the buttons for remote control of client interface and user image interface and other menus which might be required and provides remote access to said components. Image receiver (5) camera provides image input required for transmission of user interface via the network interface after processed in the processing unit by capturing image of the user. The camera (5) can be one or multiple numbers, depending on the choice. With number of cameras (5) being in multiple number, image input required for capturing a 3 dimensional image of the user can be obtained. Audio receiver (7) microphone on the other hand captures audio information of the user, providing transmission of that audio input to the opposite party over the network interface after it is processed in the audio processor. The number of microphones (7) integrated with the television (A) can be in multiple number. In this way, user voice can be captured more clearly from long distances. The television (A) comprises hardware of a remote controller (14) externally and an image receiver (5) and an audio receiver (7), and software of an image interface and a client interface internally. Embedded hardware being the image receiver (5) and an audio receiver (7) are on television (A) frame. Client software comprising the user image interface, client interface software and the heap of VoIP are located at embedded in ROM, which is the storage unit (1 1 ) of the television (A). The client interface forming the basis of the system provides the user with turning on and off via the remote controller (14) to make calls, the opposite party and the user to make video and other adjustments before, during and thereafter, also optionally continuation of broadcasting of television (A) image in addition to call information. At the same time, it can display instantaneous messaging information of the user and the opposite party on the screen (15). The user image interface on the other hand being a part of the client interface, comprises the images of the user and the other party with whom the user is making a call and provides display of these images to the user.

The backbone of the system which is the subject of the invention is comprised of the digital media processor (12), to which

- The signals received from antenna (1 ) via antenna receiver (1 .1) are transmitted after being converted in the analogue digital converter (9),

- Audio and video information coming from the device connection input (for example; USB input) (2), and via the network interface input (3) over the Internet are transmitted,

- High definition video and multi-channel audio signals received from HDMI input (4), are transmitted after being processed in HDMI processor (4.1 ), - Media images captured via the image receiver (5) are transmitted after being processed in video decoder and coder (8),

- Analogue audio signals received from stereo audio input (6) and audio receiver (7) are transmitted by making them ready for processing in the audio coder and decoder (13) after being converted in the analogue digital converter

(9).

The digital media processor (12) directs the streaming multi-media data transmitted real-time to relevant units by processing them. Between RAM and FLASH ROM and audio coder and decoder (13), there is a bilateral interaction. It is the remote controller receiver (14.1 ) that transmits the signals coming from the remote controller (14) to the digital media processor (12). The client software typed in during production is located in ROM, which is the storage unit (1 1 ). VoIP protocol processor incorporated to the television as embedded can use, as VoIP protocol, one or more of

- SIP, Session Initiation Protocol

- P2PSIP, Peer-to-Peer SIP

- H.323,

- MGCP, Media Gateway Control Protocol

- NCS, Network-Based Call Signalling

- SS7, Signalling System 7

- H.248, Megaco protocols.

Mode of operation of the television (A) with which the image receiver (5) and the audio receiver (7) are integrated:

When the user runs the client interface software via the remote controller (14) of the television (A), the image of the user obtained from the image receiver (5) is displayed on the screen (15) in the image interface. The user uses the controller (14) via the client interface software and enters the user input required to make calls over VoIP protocol. That input can be a symbolic address or user name depending on the choice of the user. The input is sent to the network via the network interface input (3) of the television after being processed by the client software on FLASH ROM, which is the storage unit (1 1 ). In a successful call scenario, on the television (A) screen (15), there can be the image of the user obtained from the image receiver (5), the image of the opposite party, the instantaneous messaging information of the opposite party and the user, the client interface and, optionally, the television (A) broadcasting. The user can make calls with one or more people simultaneously and depending on his preference, there can be a mass video conferencing in question.

The calls coming to the user at a time when he is watching a television (A) program are displayed on the screen (15) by the client in a manner that will disturb the user at least. In the event that the user accepts the incoming call on the other hand the client displays images on different parts of the screen (A) concerning the call and the television (A) broadcast. By means of camera (5) and microphone (7) hardware incorporated as embedded to the television, communication with the devices comprising various network interfaces (3) is made possible over the network interface (3) under control of the embedded client software. In an alternative embodiment of the invention, the embedded client software of the system can act, for example, sort of an intruder alert by sensing the changes in an environment via the camera (5) and microphone (7) when the television is in stand-by mode and via VoIP protocol can alert various security units and/or preset telephone numbers, can relay the audio and/or video of the medium.

In another alternative embodiment of the invention, swaps can be made between the services provided by the VoIP client and the PSTN (Public Switched Telephone Network) services by connecting home phone to the television via RJ1 1 jack that can be incorporated to the system.

Claims

1. The invention is a system, embedded in a television (A), and audio information of user via at least one audio receiver (7) and capturing image of user via at least one image receiver (5), supporting establishment of communication via VoIP client software providing instant messaging with video and/or audio call and, co-working with television (A) input/output interfaces in order to provide video and audio communication between people over a network interface input (3) via television (A), and it is characterised in that; it comprises

- a client interface, wherein data coming from video and audio receivers (5,7) of the user and the other party are processed, controlling the digital media processor (12) located at the storage unit (1 1 ) embedded in said television (A),

- a video decoder and encoder (8) processing media image received from image receiver (5) and transmitting it to said digital media processor (12),

- an audio coder and decoder (13) processing audio information transmitted by audio receiver (7) and/or audio input transmitting it to said media processor (12),

- a client providing display of video and audio received from the opposite party and the user on the television (A) screen (15), making the video and audio adjustments, display of messaging information of the user and the opposite party on the television screen and a client interface controlling this client.

2. System according to Claim 1 , and it is characterised in that; said storage unit (1 1 ) is ROM.

3. System according to Claim 1 , and it is characterised in that; said client interface comprises image interface that comprises image of the user and image information of the other party with whom the user is communicating.

4. System according to Claim 1 and 3, and it is characterised in that; it comprises a controller (14) providing remote control of said client interface, and an image interface and other menus required and remote access.

5. The invention is a method for establishment of communication via VoIP client software providing instant messaging with video and/or audio call and, co- working with television (A) input/output interfaces in order to provide video and audio communication between people over a network interface input (3) via television (A), embedded in a television (A), and capturing audio information of user via at least one audio receiver (7) and capturing image of user via at least one image receiver (5) , and it is characterised in that; it performs the operation steps of

- processing audio and video information of the user and the opposite party that is being communicated with in a digital media processor (12),

- submission of the processed image information to the user via television (A) screen (15), and audio information, on the other hand, via the loudspeaker (16).