WO2014023042A1

WO2014023042A1 - Set top box based video conversation method and system

Info

Publication number: WO2014023042A1
Application number: PCT/CN2012/080298
Authority: WO
Inventors: 王风涛
Original assignee: 青岛海信宽带多媒体技术有限公司
Priority date: 2012-08-08
Filing date: 2012-08-17
Publication date: 2014-02-13
Also published as: CN102857729B; CN102857729A

Abstract

Disclosed are a set top box based video conversation method and system. The method comprises: a local set top box setting up a conversation with a set top box of a peer end, and sending a startaudio massage to a mobile phone; after receiving the startaudio massage, the mobile phone collecting acoustic information; coding the acoustic information into audio data, and sending the audio data to the set top box of the peer end; and meanwhile, the local set top box acquiring image information collected by a camera device, and coding the acquired image information into video data and sending the video data to the set top box of the peer end. Because the acoustic information can be acquired by the mobile phone and then sent to the set top box of the peer end, and the image information is acquired by the camera device and then sent to the set top box at the peer end, certain distance is kept from a user to the camera device, thereby facilitating photographing of the camera device, so as to obtain video images with good quality. Moreover, the mobile phone can be placed at the short distance from the user, and good acoustic quality can be obtained.

Description

Video call method and system based on set top box

Technical field

The present invention relates to communication technologies, and in particular, to a video call method and system. Background technique

With the development of technology, digitalization is getting more and more life. The PC has long been intelligent, and mobile phones and tablets are also becoming smarter in a large area, and TV TVs are becoming more intelligent in recent years. The current smart TV has the advantage of an application platform that is not available in traditional TV. Smart TVs enable a variety of application services such as network search, IP TV, video on demand, digital music, online news, and network video telephony based on set-top boxes. These application services are based on the set-top box connected to the network. With the popularity of WIFI technology, set-top boxes are becoming more and more popular through wireless network connections such as WIFI.

In the prior art based on the set-top box to implement the video call function, the video and audio are generally collected by the camera with the microphone; however, the camera with the microphone usually cannot simultaneously take care of the quality of the video and audio, because if the camera is away Too close, the video range is too small; if the camera is farther away, the quality of the collected sound is not good.

The patent document with the publication number 102387335A discloses a method and a system for realizing a visual call based on a mobile phone through a set top box. In the system, the mobile phone collects video and audio, and the mobile phone packages the collected audio and video data to the set top box, and the set top box Send to the other party's set-top box via the network. However, the method still has the mobile phone too close, the video range is too small; the mobile phone is far away, and the sound quality is not good. Moreover, in order for the mobile phone to collect audio and video at the same time, the user needs to put the mobile phone in front of the user, which does not meet the user's habit of using the mobile phone.

In summary, the prior art method of making a video call based on a set top box cannot simultaneously take into account the quality of video and audio. Summary of the invention

The embodiment of the invention provides a video call method and system based on a set top box, which can simultaneously consider the quality of video and audio.

According to an aspect of the present invention, a set-top box-based video calling method is provided, including: after a local set-top box establishes a call with a peer set-top box, sending a startaudio message to a mobile phone with which a communication connection is established; in the startaudio message Carrying the IP address and port information of the peer set top box;

After receiving the startaudio message, the mobile phone starts to collect sound information; After the information is encoded into audio data, the audio data is sent to the peer set top box according to the audio IP address and port information of the peer set top box; and,

After acquiring the image information collected by the camera device connected thereto, the local set top box encodes the acquired image information into video data and sends the image information to the peer set top box;

The peer set top box decodes the video data and the audio data, and plays the decoded sound and video through the connected TV.

Further, when the local set top box and the peer set top box end the call, the local set top box sends a stopaudio message to the mobile phone;

The mobile phone stops collecting sound information according to the received stopaudio message.

Further, before the local set top box sends a startaudio message to the mobile phone with which the communication connection is established, the method further includes:

The local set top box establishes a communication connection with the mobile phone before calling the peer set top box; or the local set top box receives the call of the opposite set top box, and before responding to the call of the opposite set top box, The mobile phone establishes a communication connection;

Alternatively, the local set top box establishes a communication connection with the mobile phone before receiving the call of the opposite set top box.

Further, after the local set top box establishes a communication connection with the mobile phone, the local set top box periodically sends a keepalive message to the mobile phone;

After the local set top box sends a keepalive message, if the response message returned by the mobile phone is not received within the set time period, the other device is switched to perform sound information collection.

The establishing, by the local set top box, the communication connection between the local set top box and the mobile phone is:

The local set top box scans the mobile phone in the same local area network by sending a broadcast message; if scanning a mobile phone, establishing a communication connection with the mobile phone; if scanning a plurality of mobile phones, prompting the user to make a selection, and establishing a communication connection with the mobile phone selected by the user ;

Alternatively, the local set top box establishes a communication connection with the mobile phone according to the IP address specified by the user. Further, the peer set top box sends video data to the local set top box; and

The peer mobile phone sends audio data to the local set top box; the peer mobile phone is a mobile phone that establishes a communication connection with the peer set top box;

The local set top box decodes the video data sent by the peer set top box and the audio data sent by the peer mobile phone, and plays the sound and video through the television connected thereto.

Preferably, before the local set top box sends the startaudio message to the mobile phone with which the communication connection is established, the method further includes: The local set top box determines that the audio collection device selected by the user is a mobile phone.

According to another aspect of the present invention, a set-top box-based video calling system is further provided, comprising: a local set top box, and a mobile phone having a communication connection with the local set top box;

The local set top box is configured to send a startaudio message to the mobile phone after establishing a call with the peer set top box; and obtain image information collected by the camera device connected thereto, and then encode the acquired image information into video data and send the image information to The peer-end set-top box; wherein the startaudio message carries the IP address and port information of the peer set-top box;

The mobile phone is configured to start collecting sound information after receiving the startaudio message; and after encoding the sound information into audio data, send the audio data to the office according to the audio IP address and port information of the peer set top box. Said the opposite set-top box. Said mobile phone sends a stopaudio message;

The mobile phone is further configured to stop collecting sound information according to the received stopaudio message.

Preferably, the local set top box is further configured to establish a communication connection with the mobile phone before calling the peer set top box;

Or the local set top box is further configured to establish a communication connection with the mobile phone after receiving the call of the opposite set top box and before responding to the call of the opposite set top box;

Alternatively, the local set top box is further configured to establish a communication connection with the mobile phone before receiving the call of the peer set top box.

Preferably, the local set top box is further configured to periodically send a keepalive message to the mobile phone after establishing a communication connection with the mobile phone; if the response message returned by the mobile phone is not received within a set time period, Switch other devices to collect sound information.

Preferably, the local set top box is further configured to: after receiving the video data sent by the peer set top box and the audio data sent by the peer mobile phone, and decoding the audio data transmitted by the connected mobile phone; The peer mobile phone is a mobile phone that establishes a communication connection with the peer set top box.

Preferably, the local set top box is further configured to determine that the audio collection device selected by the user is a mobile phone before sending the startaudio message to the mobile phone with which the communication connection is established.

According to another aspect of the present invention, a set top box is also provided, including:

a mobile communication module for establishing a communication connection with the mobile phone;

a video call control module, configured to send a call start notification to the mobile phone communication module after establishing a call with the peer set top box;

The mobile phone communication module is further configured to establish communication after receiving the call start notification The connected mobile phone sends a startaudio message; the startaudio message carries the IP address and port information of the peer set top box;

a video data encoding module, configured to acquire image information collected by an image capturing device connected to the set top box, and encode the acquired image information into video data;

The video call control module is further configured to send the video data encoded by the video data encoding module to the peer set top box.

Further, the video call control module is further configured to send a call end notification to the mobile phone communication module when the call with the peer set top box ends;

The mobile phone communication module is further configured to send a stopaudio message to the mobile phone after receiving the call end notification.

The communication connection between the mobile phone communication module and the mobile phone is specifically as follows:

The mobile phone communication module establishes a communication connection with the mobile phone before the video call control module calls the peer set top box;

Alternatively, the mobile phone communication module establishes a communication connection with the mobile phone before the video call control module receives the call of the opposite set top box.

Preferably, the video call control module is further configured to: after the mobile phone communication module establishes a communication connection with the mobile phone, periodically send a notification to the mobile phone communication module to detect that the connection is valid; and the mobile phone communication module detects according to the received Connecting a valid notification, sending a keepalive message to the mobile phone; if the response message returned by the mobile phone is not received within the set time period after the keepalive message is sent, the mobile phone communication module returns to the video call control module Invalid connection notification;

The video call control module is further configured to switch other devices to collect sound information after receiving the notification that the connection is invalid.

Further, the video call control module is further configured to receive video data sent by the peer set-top box and audio data sent by the peer mobile phone, where the peer mobile phone establishes a communication connection with the peer set-top box. Mobile phone;

The set top box further includes:

And a decoding module, configured to decode the audio and video data received by the video call control module, and send the audio and video data to the television connected to the set top box for playing.

Preferably, the system further comprises:

An audio collection device selection module for providing a user with a selectable audio collection device and determining an audio collection device selected by the user; The video call control module is further configured to determine that the selected audio collection device is a mobile phone before sending the call start notification to the mobile phone communication module.

According to another aspect of the present invention, a mobile phone is provided, including:

a local area network device connection module, configured to establish a communication connection with a device in the local area network, and receive a message sent by the device that establishes a communication connection in the local area network;

a message parsing module, configured to parse a message received by the local area network device connection module; if the message is a startaudio message, send an audio collection notification;

An audio collection and transmission module, configured to start collecting sound information after receiving the audio collection notification sent by the message parsing module; and encoding the audio information into audio data, according to the audio IP address and port carried in the startaudio message The information transmits the audio data.

Further, the message parsing module is further configured to: if the received message is parsed as a stopaudio message, send a stop audio collection notification to the audio collection and transmission module;

The audio collection and transmission module is further configured to stop collecting sound information according to the stopping the audio collection notification.

Further, the message parsing module is further configured to: if the received message is parsed as a keepalive message, return a response message by using the local area network device connection module.

The set-top box in the video call system of the embodiment of the present invention can send a message to the mobile phone, notify the mobile phone to collect the sound information, and send the sound information to the set-top box of the opposite end through the mobile phone; and acquire the image information through the camera device and then send the image information to the set-top box. In this way, the user can have a certain distance from the camera device, which is convenient for the camera device to obtain better quality video images; and the mobile phone can be placed at a close distance of the user to obtain better sound quality; The purpose of video quality. Moreover, the user can be in front of the TV, put the phone around or hold the ear (or through the phone's earphones) for video calls, and it is also in line with the user's usual habits. DRAWINGS

1 is a schematic diagram of a video call system based on a set top box according to an embodiment of the present invention;

2 is a flowchart of a video call method based on a set top box according to an embodiment of the present invention;

FIG. 3 is a block diagram showing the internal structure of a set top box and a mobile phone according to an embodiment of the present invention.

detailed description

The present invention will be further described in detail below with reference to the accompanying drawings. However, it should be noted that many of the details listed in the specification are only intended to provide the reader with a thorough understanding of one or more aspects of the present invention. The terms "module,""system," and the like, as used herein, are intended to include a computer-related entity such as, but not limited to, hardware, firmware, hardware and software combinations, software, or software in execution. For example, a module can be, but is not limited to: a process running on a processor, a processor, an object, an executable, a thread of execution, a program, and/or a computer. For example, an application running on a computing device and this computing device can both be modules. One or more modules may be located within a process and/or thread in execution.

The main idea of the present invention is that on the basis of the existing set top box supporting the WIFI and the network, the sound information is obtained by the mobile phone and then sent to the set top box of the opposite end, and the image information is acquired by the camera device disposed at the upper end of the television, and the set top box obtains the image information of the camera device. Sended to the other party's set-top box, the peer set-top box receives the sound information and image information and then plays the image and sound through the TV. In this way, the user can be separated from the camera device at the upper end of the TV, and the video range of the camera device can be larger, which is more suitable for the conference occasion; and the mobile phone can be placed at a close distance of the user, for example, at the user's side or even at the mouth. , or by talking on the phone's mic, you can get better sound quality. Moreover, the user can be in front of the TV, put the phone around or hold the ear (or through the phone's earphones) for video calls, and it is also in line with the user's usual habits.

The technical solutions of the embodiments of the present invention are described in detail below with reference to the accompanying drawings. The set-top box-based video call system of the embodiment of the present invention, as shown in FIG. 1, includes: a local set top box 101, a mobile phone 102 that has established a communication connection with the local set top box, an image capturing device 104 connected to the local set top box 101, and a local set top box 101. TV 105 and peer set top box 103.

A method for performing a video call in a set-top box-based video call system according to an embodiment of the present invention, as shown in FIG. 2, includes the following steps:

S201: The local set top box 101 establishes a call with the peer set top box 103.

The local set top box 101 is responsible for establishing a call with the peer set top box 103: the local set top box 101 acts as the calling party after the user runs the video calling program of the local set top box 101, and the peer set top box 103 acts as the called party established by the called party; The set top box 103 acts as a calling party, and the local set top box 101 acts as a call established by the called party. Specifically, the local set top box 101 signaling control protocol supports SIP (Session Initiation Protocol), and can be used as an IMS (Ip Multimedia Subsystem, IP Multimedia Subsystem) network video call terminal; its voice coding supports G711. ALAW/ULAW, G722, SILK codec; its video coding supports H.264 codec; its video capture uses camera device 104, and audio and video playback uses TV 105. The method for establishing a call between the local set top box 101 and the peer set top box 103 is a technique well known to those skilled in the art, and details are not described herein again. S202: After establishing a call with the peer set top box 103, the local set top box 101 sends a startaudio message (starting an audio call message) to the mobile phone 102.

Specifically, after establishing a call with the peer set top box 103, the local set top box 101 sends a startaudio message to the handset 102 that has previously established a connection with the local set top box 101, that is, the handset 102 establishes a communication connection with the local set top box 101 in advance. The startaudio message carries the audio IP address and port information of the peer set top box 103.

The local set top box 101 and the handset 102 can establish a connection at one of the following times: Opportunity A: The local set top box 101 establishes a communication connection with the handset 102 prior to calling the peer set top box 103.

Timing B: The local set top box 101 establishes a communication connection with the handset 102 after receiving the call to the peer set top box 103 and before responding to the call to the peer set top box 103.

Timing C: The local set top box 101 establishes a communication connection with the handset 102 before receiving the call to the peer set top box 103. Specifically, after the user selects the mobile phone as the collection device of the sound information after running the video call program of the local set top box 101, the local set top box 101 establishes a communication connection with the mobile phone 102.

The method for establishing the connection between the local set top box 101 and the mobile phone 102 can be as follows:

Method A: The local set top box 101 scans the mobile phone in the same local area network by sending a broadcast message; if a mobile phone is scanned, a communication connection is established with the mobile phone; if the local set top box 101 scans a plurality of mobile phones, the user is prompted to make a selection, and the user selects one of them. After the mobile phone, the local set top box 101 establishes a communication connection with the mobile phone selected by the user. Specifically, the local set top box 101 can establish a communication connection with the mobile phone through the WIFI. The method for establishing a communication connection between the local set top box 101 and the mobile phone in the same local area network is a technology well known to those skilled in the art, and details are not described herein again.

Method B: The local set top box 101 establishes a communication connection with the mobile phone of the IP address according to the IP address specified by the user.

After establishing a communication connection with the local set top box 101, the mobile phone 102 can display corresponding prompt information on the mobile phone.

S203: After receiving the startaudio message, the mobile phone 102 transfers to the call state, and starts collecting and obtaining the obtained sound information.

S204: After acquiring the sound information, the mobile phone 102 encodes the sound information into audio data, and sends the sound information to the peer set top box 103.

Specifically, after acquiring the voice information, the mobile phone 102 encodes and packages the voice information into an RTP data packet; and according to the audio IP (Internet Protocol) address of the peer set top box 103. And the port information, the RTP data packet is sent to the peer set top box 103.

S205: The local set top box 101 acquires image information acquired by the camera unit 104.

It should be noted here that, for the convenience of description, the steps are sequentially numbered in the present paper, but these sequential numbers do not mean a strict sequence in time;

In fact, the step of acquiring, by the local set top box 101, the image information collected by the camera device 104 in the step S203 may be the same as the step of collecting and acquiring the sound information by the mobile phone 102 in step S203 after the local set top box 101 establishes a call with the opposite set top box 103. get on.

S206: The local set top box 101 encodes the acquired image information into video data, and sends the image information to the peer set top box 103.

Specifically, the camera device 104 can be installed at a position with a better imaging effect. For example, the user needs to watch the image of the other party's caller playing on the television, usually located in front of the television, and the local camera device 104 is installed at the upper end of the television. It is easy to take pictures of users located in front of the TV.

The connection mode of the camera device 104 with the local set top box 101 can be either a wired connection or a wireless connection. After acquiring the image information, the camera device 104 transmits the image information to the local set top box 101, and the local set top box 101 encodes the acquired image information into video data, and then sends the image information to the peer set top box 103.

S207: The peer set top box 103 decodes the video data sent by the local set top box 101 and the audio data sent by the mobile phone 102, and performs video and audio playback through the television connected to the peer set top box 103.

S208: After receiving the audio and video data sent by the peer set top box 103, the local set top box 101 decodes and plays the audio and video through the television 105.

Alternatively, in step S208, the local set top box 101 decodes the video data sent by the peer set top box 103 and the audio data sent by the peer mobile phone 106, and plays the audio and video through the television 105. Similar to the above steps S201-S207, the peer mobile phone 106 is a mobile phone that establishes a communication connection with the peer set top box 103, and the peer set top box 103 also sends a startaudio message to the opposite mobile phone 106 after establishing a call with the local set top box 101. The peer mobile phone 106 collects the voice information according to the startaudio message, and after the voice information is encoded into the audio data, sends the audio data to the local set top box 101 according to the audio IP address and port information of the local set top box 101 carried in the startaudio message; The set top box 103 sends the video data to the local set top box 101. The local set top box 101 decodes the video data sent by the peer set top box 103 and the audio data sent by the peer mobile phone 106, and plays the audio and video through the television 105.

S209: When the call ends, the local set top box 101 will stopaudio (stop the audio call message) The message is sent to the handset 102.

S210: The mobile phone 102 ends the call state, stops collecting, and acquires the obtained sound information.

Preferably, after the local set top box 101 establishes a communication connection with the mobile phone 102, in order to ensure that the communication connection between the local set top box 101 and the mobile phone 102 remains normal, the local set top box 101 periodically sends a keepalive message to the mobile phone 102 (eg, every 120 seconds). (Keep valid message); After receiving the keepalive message, the mobile phone 102 returns a response message to the local set top box 101. After the local set top box 101 sends the keepalive message, if the local set top box 101 does not receive the response message returned by the mobile phone 102 within the set time period, the mobile phone 102 is considered to be in an abnormal state, and the local set top box 101 automatically switches other devices to collect sound information, for example, The default device, the MIC (Mike) that comes with the camera, collects sound information.

Alternatively, the local set top box 101 sends a keepalive message (maintaining a valid message) to the mobile phone 102 periodically (eg, every 120 seconds) after transmitting the startaudio message to the mobile phone 102, and before transmitting the stopaudio message to the mobile phone 102 to end the call; If the local set top box 101 does not receive the response message returned by the mobile phone 102 within the set time period, the mobile phone 102 is considered to be in an abnormal state, and the local set top box 101 automatically switches other devices to collect sound information, for example, switching to the default device, that is, the MIC of the camera itself. (Mike) collects sound information.

The local set top box 101 may specifically be a set top box based on an Android (Android) system; the mobile phone 102 may specifically be a mobile phone of the Android system.

Preferably, the local set top box 101 can also select the audio collection device before sending the startaudio message to the mobile phone 102. After determining that the audio collection device selected by the user is the mobile phone, the above steps S202-S208 are performed. If the audio collection device selected by the user is a microphone, the local set top box 101 uses the prior art method to collect audio and video information, and details are not described herein.

An internal structure of a set top box and a mobile phone according to an embodiment of the present invention is shown in FIG. 3.

The set top box includes: a mobile phone communication module 301, a video call control module 302, and a video data encoding module 303.

The mobile phone includes: a local area network device connection module 311, a message parsing module 312, and an audio collection and transmission module 313.

The functions of the above modules are described as follows:

The mobile phone communication module 301 of the set top box is used to establish a communication connection with the mobile phone. Specifically, the mobile phone communication module 301 can notify the mobile communication module 301 to establish a communication connection with the mobile phone before the video call control module 302 calls the opposite set top box. Or; the mobile phone communication module 301 is before the video call control module 302 receives the call of the opposite set top box, The mobile phone communication module 301 is notified to establish a communication connection with the mobile phone.

Correspondingly, the local area network device connection module 311 of the mobile phone establishes a communication connection with the device in the local area network, that is, the local area network device connection module 311 responds to the communication connection request of the set top box in the local area network, and establishes a communication connection with the local area network device connection module 311.

The set-top box mobile communication module 301 can send a message to the mobile phone after establishing a communication connection with the mobile phone.

The LAN device connection module of the mobile phone 311 can establish a communication connection with the set-top box, and then can receive the message sent by the set-top box (that is, the device that establishes the communication connection in the local area network).

The video call control module 302 of the set top box is configured to establish a call with the peer set top box, and send a call start notification to the mobile phone communication module 301 after the call is established;

After receiving the call start notification, the mobile phone communication module 301 sends a startaudio message to the mobile phone that establishes the communication connection; the startaudio message carries the IP address and port information of the peer set top box;

After receiving the message sent by the set top box, the local area network device connection module 311 of the mobile phone sends a message to the message parsing module 312 for parsing.

The message parsing module 312 of the mobile phone parses the message received by the local area network device connection module 311. If the message is parsed as a startaudio message, the audio collection and transmission module 313 sends an audio collection notification.

After receiving the audio collection notification sent by the message parsing module 312, the audio collection and transmission module 313 of the mobile phone starts to collect the audio information; and after encoding the audio information into the audio data, according to the audio IP address and port information carried in the startaudio message. The audio data is transmitted.

While the audio collection and transmission module 313 of the mobile phone collects the sound information, the video data encoding module 303 of the set top box acquires the image information collected by the camera device connected to the set top box, and encodes the obtained image information into video data;

The video call control module 302 of the set top box sends the video data encoded by the video data encoding module 303 to the peer set top box.

Further, the video call control module 302 of the set top box also sends a call end notification to the mobile phone communication module 301 when the call with the opposite set top box ends;

After receiving the call end notification, the mobile phone communication module 301 sends a startaudio message to the mobile phone.

After receiving the message sent by the set top box, the local area network device connection module 311 of the mobile phone sends a message to the message parsing module 312 for parsing. If the message parsing module 312 of the mobile phone parses the message received by the local area network device connection module 311 as a stopaudio message, sends a stop audio collection notification to the audio collection and transmission module 313; and the audio collection and transmission module 313 stops collecting according to the stop audio collection notification. Sound information. Further, after the mobile phone communication module 301 establishes a communication connection with the mobile phone, the video call control module 302 of the set top box periodically sends a notification to the mobile phone communication module 301 to detect that the connection is valid; the mobile phone communication module 301 sends a keepalive to the mobile phone according to the received notification that the connection is valid. If the message parsing module 312 of the mobile phone parses the message received by the local area network device connection module 311, if the message is a keepalive message, the local area network device connection module 311 returns a response message;

If the mobile phone communication module 301 does not receive the response message returned by the mobile phone within the set time period after transmitting the keepalive message, the mobile phone control module 302 returns a notification that the connection is invalid; the video call control module 302 receives the connection invalid. After the notification, switch other devices to collect sound information.

Further, the video call control module 302 of the set top box can also receive the video data sent by the peer set top box and the audio data sent by the peer mobile phone; wherein the peer mobile phone is a mobile phone that establishes a communication connection with the peer set top box; as well as

The set top box further includes: a decoding module 304.

The decoding module 304 is configured to decode the audio and video data received by the video call control module 302 and send the data to the television connected to the set top box for playing.

The set-top box in the video call system of the embodiment of the present invention can send a message to the mobile phone, notify the mobile phone to collect the sound information, and send the sound information to the set-top box of the opposite end through the mobile phone; and acquire the image information by the camera device and send the image information to the peer set-top box. . In this way, the user can have a certain distance from the camera device, which is convenient for the camera device to obtain better quality video images; and the mobile phone can be placed at a close distance of the user to obtain better sound quality; The purpose of video quality. Moreover, the user can be in front of the TV, put the phone around or hold the ear (or through the phone's earphones) for video calls, and it is also in line with the user's usual habits.

A person skilled in the art can understand that all or part of the steps of implementing the above embodiments can be completed by a program to instruct related hardware, and the program can be stored in a computer readable storage medium, such as: ROM/RAM, Disk, CD, etc.

The above description is only a preferred embodiment of the present invention, and it should be noted that those skilled in the art can also make several improvements and retouchings without departing from the principles of the present invention. It is considered as the scope of protection of the present invention.

Claims

Claim

1. A video call method based on a set top box, comprising:

After the local set-top box establishes a call with the peer set-top box, the startaudio message is sent to the mobile phone with which the communication connection is established; the startaudio message carries the IP address and port information of the peer set-top box;

After receiving the startaudio message, the mobile phone starts to collect sound information; after encoding the sound information into audio data, the audio data is sent to the pair according to the audio IP address and port information of the peer set top box. End set box; and,

2. The method of claim 1 further comprising:

When the local set top box and the opposite set top box end the call, the local set top box sends a stopaudio message to the mobile phone;

3. The method according to claim 1 or 2, before the local set top box sends a startaudio message to the mobile phone with which the communication connection is established, the method further includes:

4. The method of claim 3, after the local set top box establishes a communication connection with the mobile phone, further comprising:

The local set top box periodically sends a keepalive message to the mobile phone;

After the local set top box sends the keepalive message, if the response message returned by the mobile phone is not received within the set time period, the other device is switched to perform sound information collection.

The method of claim 4, wherein the local set top box establishes a communication connection with the mobile phone, specifically:

Alternatively, the local set top box establishes a communication connection with the mobile phone according to the IP address specified by the user.

6. The method of claim 4, further comprising:

The peer set top box sends video data to the local set top box; and

7. The method according to claim 4, before the local set top box sends a startaudio message to the mobile phone with which the communication connection is established, the method further includes:

The local set top box determines that the audio collection device selected by the user is a mobile phone.

8. A set-top box based video calling system, comprising: a local set top box; and a handset that establishes a communication connection with the local set top box;

The mobile phone is configured to start collecting sound information after receiving the startaudio message; and after encoding the sound information into audio data, send the audio data to the office according to the audio IP address and port information of the peer set top box. Said the opposite set-top box.

9. The system of claim 8 wherein: sending a stopaudio message;

10. The system of claim 8 or 9, wherein

The local set top box is further configured to establish a communication connection with the mobile phone before calling the peer set top box;

11. The system of claim 10, wherein

The local set top box is further configured to periodically send a keepalive message to the mobile phone after establishing a communication connection with the mobile phone; if the response message returned by the mobile phone is not received within a set time period, switch the other device to perform Sound information collection.

12. The system of claim 11 wherein:

The local set top box is further configured to: after receiving the video data sent by the peer set top box and the audio data sent by the peer mobile phone, decoding, and playing the sound and video through the television connected thereto; wherein, the opposite end The mobile phone is a mobile phone that establishes a communication connection with the peer set top box.

13. The system of claim 11 wherein:

The local set top box is further configured to determine that the audio collection device selected by the user is a mobile phone before sending the startaudio message to the mobile phone with which the communication connection is established.

14. A set top box comprising:

The mobile phone communication module is further configured to: after receiving the call start notification, send a startaudio message to the mobile phone that establishes the communication connection; the startaudio message carries the IP address and port information of the peer set top box;

a video data encoding module, configured to acquire image information collected by the camera device connected to the set top box, and encode the acquired image information into video data; The video call control module is further configured to send the video data encoded by the video data encoding module to the peer set top box.

15. The set top box of claim 14 wherein:

The video call control module is further configured to send a call end notification to the mobile phone communication module when the call with the peer set top box ends;

The set top box according to claim 14 or 15, wherein the mobile communication module establishes a communication connection with the mobile phone:

17. The set top box of claim 16 wherein:

The video call control module is further configured to periodically send a notification to the mobile phone communication module to detect that the connection is valid after the mobile phone communication module establishes a communication connection with the mobile phone;

The mobile phone communication module sends a keepalive message to the mobile phone according to the received notification that the connection is valid; if the response message returned by the mobile phone is not received within the set time period after the keepalive message is sent, the mobile phone communication The module returns a notification that the connection is invalid to the video call control module;

18. The set top box of claim 17 wherein:

The video call control module is further configured to receive the video data sent by the peer set top box and the audio data sent by the peer mobile phone; wherein the peer mobile phone is a mobile phone that establishes a communication connection with the peer set top box ; as well as

The set top box further includes:

a decoding module, configured to decode the audio and video data received by the video call control module Send to the TV connected to the set top box for playback.

19. The set top box of claim 17, further comprising:

Used to provide a user with a selectable audio capture device and to determine the audio capture device selected by the user;

The video call control module is further configured to determine that the selected audio collection device is a mobile phone before sending the call start notification to the mobile phone communication module.

20. A mobile phone, comprising:

21. The handset of claim 20, wherein

The message parsing module is further configured to: if the received message is parsed as a stopaudio message, send a stop audio collection notification to the audio collection and transmission module;

22. The handset of claim 21, wherein

The message parsing module is further configured to: if the received message is parsed as a keepalive message, return a response message by using the local area network device connection module.