CN111669661B - Television audio and video call system and method based on TRTC protocol - Google Patents
Television audio and video call system and method based on TRTC protocol Download PDFInfo
- Publication number
- CN111669661B CN111669661B CN202010580973.2A CN202010580973A CN111669661B CN 111669661 B CN111669661 B CN 111669661B CN 202010580973 A CN202010580973 A CN 202010580973A CN 111669661 B CN111669661 B CN 111669661B
- Authority
- CN
- China
- Prior art keywords
- video call
- protocol
- trtc
- user
- application
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
- H04N21/25866—Management of end-user data
- H04N21/25875—Management of end-user data involving end-user authentication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/142—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Computer Security & Cryptography (AREA)
- Computer Graphics (AREA)
- General Engineering & Computer Science (AREA)
- Telephonic Communication Services (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a television audio and video call system and method based on a TRTC (true push to talk) protocol, which comprises a video call TV end application, a user account system, a cloud server, an instant messaging IM (instant messaging) and a WeChat applet, wherein the video call TV end application is a video call application which acquires the authority of a Camera and a far-field microphone on an intelligent television and is compatible with the TRTC protocol; the user account system is used for judging whether the video call application is allowed to be used or not, and the cloud server is used for message forwarding and stream distribution of a specific object of the video call, and generating a unique roomID and an encrypted userSig; the instant messaging IM system is used for judging whether the user is in a video call application online state; the WeChat small program is a video call WeChat small program which is used for acquiring a camera and a microphone of the mobile phone and is compatible with a real-time audio and video TRTC protocol. The invention is beneficial to realizing the video call of the full platform intercommunication.
Description
Technical Field
The invention relates to the technical field of intelligent television communication, in particular to a television audio and video call system and method based on a TRTC protocol.
Background
Today, the development of the internet is more and more diverse, and the social needs of people are continuously upgraded. Unlike young people, the elderly have physiological deterioration in vision and hearing, so they prefer large screens. However, at present, a video call APP needs to be downloaded first for the smart television and the smart phone, and then a friend-friend circle is established, so that the video call can be normally performed, and the smart television and the smart phone are limited by various conditions, poor in experience and large in difficulty for the old to use. The WeChat is used as a super APP, 10 hundred million terminal users exist, and if audio and video communication can be directly carried out with the smart television on the WeChat, the usability of audio and video communication between the smart television and the smart phone can be improved, and user experience can be improved. The smart television is used as the largest screen of the consumption terminal, and a simple and easy-to-use audio and video call method and a simple and easy-to-use audio and video call system with the smart phone are lacked all the time.
Disclosure of Invention
In order to solve the technical problem, the invention provides a television audio and video call system and a television audio and video call method based on a TRTC (true push to talk) protocol, and the system can realize video call between intelligent television equipment and a WeChat applet.
In order to achieve the technical effect, the invention adopts the following technical scheme:
a television audio and video call system based on a TRTC protocol comprises a video call TV end application, a user account system, a cloud server, an instant messaging IM system and a WeChat applet;
the video call TV end application is a video call application which acquires the authority of a Camera and a far-field microphone on the smart television and is compatible with a real-time audio and video TRTC protocol;
the user account system is an account system of a registered user of the smart television and is used for judging whether the video call application is allowed to be used or not;
the cloud server is used for message forwarding and stream distribution of a specific object of the video call, and generating a unique roomID and an encrypted userSig;
the instant messaging IM system is used for judging whether a user is in a video call application online state;
the WeChat small program is a video call WeChat small program which acquires a camera and a microphone of the mobile phone and is compatible with a real-time audio and video TRTC protocol.
The further technical scheme is that the TRTC protocol is combined with a TBS WebRTC real-time audio and video protocol, and the TRTC protocol can be used as long as the application of the TBS is accessed no matter the television is a WeChat applet or an intelligent television.
The further technical scheme is that the encrypted userSig is used for performing login authentication on a user to confirm whether the user is real or not.
Further, the RoomID is used to uniquely identify a room, and is a number within a range of a U agent 32 that is self-maintained and distributed.
The invention also provides a television audio and video communication method based on the TRTC protocol, which comprises the following steps:
step 1: the intelligent television video call application logs in a user account system; the information that the user successfully logs in, namely the userID, is transmitted to the cloud server; the cloud server generates an encrypted userSig, and logs in an IM system by using userID and userSig to acquire an online message of a user;
step 2: the video call WeChat small program logs in a user account system; the information that the user successfully logs in, namely the userID, is transmitted to the cloud server; the cloud server generates an encrypted userSig, and logs in an IM system by using userID and userSig to acquire an online message of a WeChat applet user;
and step 3: when a user dials a mobile phone number of the other party in the intelligent television video call application, the cloud acquires a user account ID corresponding to the mobile phone number, and then sends a self-defined and dialing signal and a roomID acquired from the cloud in real time to the account through the instant messaging IM system;
and 4, step 4: when the video call wechat applet user agrees to accept the video call request of the opposite party, starting a real-time audio and video TRTC protocol and joining the room corresponding to the received roomID, sending a self-defined acceptance signaling after the joining of the room is successful, and joining the same room after the calling party receives the self-defined acceptance signaling to start the video call.
And 5: the video call application of the intelligent television performs one-way coding on pictures and sounds on the intelligent television through a TRTC (true tone correlation test) protocol and uploads the pictures and the sounds to a cloud server, and the video call WeChat applet acquires streaming data from the cloud, decodes the streaming data through the TRTC protocol and displays the streaming data on a real-time call interface;
step 6: the video call wechat applet performs one-way coding on the pictures and sounds on the wechat applet through a TRTC protocol and uploads the pictures and sounds to the cloud server, and the intelligent television video call application acquires streaming data from the cloud, decodes the streaming data through the TRTC protocol and displays the streaming data on a real-time call interface.
A further technical scheme is that when the smart television video call application is started in step 1, the login state of the user account system is obtained, if the user account system is not logged in, the user account system is skipped to for login or registration, after the login is successful, the smart television application receives a broadcast notification and is ready to log in the instant messaging IM system, after the smart television obtains the userID, the cloud-going terminal obtains the userSig, and the userSig are used for logging in the instant messaging IM system.
A further technical scheme is that when the video call wechat applet receives the call request in the step 4, the acceptance or rejection can be selected, and if the rejection is detected, a self-defined rejection signaling is replied to the calling party; if the room is accepted, the called party starts a real-time audio and video TRTC protocol and joins the room corresponding to the received roomID, a user-defined acceptance signaling is sent after the room is successfully joined, and the calling party joins the same room after receiving the self-defined acceptance signaling and starts to carry out video call.
Compared with the prior art, the invention has the following beneficial effects: the invention is beneficial to realizing the video call of the full platform intercommunication. The method provides coverage of the smart television, the mobile phone, the client SDK and the cloud API, and the terminal user can also use TRTC protocol service in the WeChat applet. No matter the calling party or the called party, the APP does not need to be downloaded additionally, high-quality and low-jamming audio and video communication can still be guaranteed, and the audio and video communication between the smart television and the mobile phone is easy to use.
Drawings
Fig. 1 is a basic flow chart of a real-time audio/video call of a smart television based on a TRTC protocol.
Detailed Description
The invention will be further explained and explained with reference to the drawings and the embodiments.
Example 1
A television audio and video call system based on a TRTC protocol comprises a video call TV end application, a user account system, a cloud server, an instant messaging IM system and a WeChat applet; the video call TV end application is a video call application which acquires the authority of a Camera and a far-field microphone on the smart television and is compatible with a real-time audio and video TRTC protocol; the user account system is an account system of a registered user of the smart television and is used for judging whether the video call application is allowed to be used or not; the cloud server is used for message forwarding and stream distribution of a specific object of the video call, and generating a unique roomID and an encrypted userSig; the instant messaging IM system is used for judging whether a user is in a video call application online state; the WeChat small program is a video call WeChat small program which acquires a camera and a microphone of the mobile phone and is compatible with a real-time audio and video TRTC protocol.
The further technical scheme is that the TRTC protocol is combined with a TBS WebRTC real-time audio and video protocol, and the TRTC protocol can be used as long as the application of the TBS is accessed no matter the television is a WeChat applet or an intelligent television. The encrypted userSig is used for performing login authentication and authentication on a user and confirming whether the user is real or not. The RoomID is used to uniquely identify a room, and is a number within the range of a U agent 32 that is self-maintained and assigned.
Example 2
As shown in fig. 1, in a method for real-time audio and video call of a smart television based on a TRTC protocol, when a video call application of the smart television is started, a login state of an instant messaging IM system is acquired, if it is detected that the IM system is not logged in, the video call application jumps to a user account system to guide a user to log in or register a user account, and after the user account is successfully logged in, the user account system transmits a user account ID (openid) to a smart television terminal, where the user account ID is a unique user ID generated based on a mobile phone number; after the smart television terminal obtains the user account ID, the smart television terminal goes to the cloud terminal to obtain the encrypted userSig; the encryption userSig is to perform hash encryption on key information such as user ID and the like once; the dynamic roommId room number is of a digital type, the cloud can be randomly designated, but two audio and video rooms in the same video call application cannot be allocated with the same roommId; the video call application starts to log in the instant messaging IM system by using the userID and the encrypted userSig.
The following method provides a solution for logging in an account of an instant messaging IM system: after the user successfully logs in the user account system, the video call cloud acquires the user name, the user nickname, the user head portrait URL user account ID (openID), the login type and the like of the user; the video call cloud generates a userID according to a user account ID (openID) and a login type, generally, the same user account ID (openID) has 2 userIDs which are a userID TV for logging in the intelligent television terminal and a userID MB for logging in the WeChat applet respectively; and logging in the instant messaging IM system by using the specific userID and the encrypted userSig.
Only after the instant communication IM system is successfully logged in, the user can enter the video call application and can dial the mobile phone number of the called party in the video call application, and the mobile phone number of the called party needs to be logged in the instant communication IM system; if the calling party does not log in the instant messaging IM system, the calling party cannot enter the video call application.
When a user dials a mobile phone number of the other party in the intelligent television video call application, the cloud acquires a user account ID corresponding to the mobile phone number, and then sends a self-defined and dialing signal and a roomID acquired from the cloud in real time to the account through the instant messaging IM system; when the video call wechat applet user agrees to accept the video call request of the opposite party, starting the real-time audio and video TRTC protocol and adding the room corresponding to the received roomID, if the room entering is successful, the TRTC protocol service recalls the interface parameters: when result is larger than 0, the house is successfully entered, the video call is started, a custom acceptance signaling is sent after the house is successfully joined, and a calling party joins the same house after receiving the custom acceptance signaling and starts the video call; when result is less than 0, the house entering fails, and the video call cannot be started; when the call is successfully entered, the video call fluency can be better emphasized by the coder decoder and the network component in the TRTC-based audio and video call system, and the call delay and the blocking rate are reduced.
In order to better realize the video call function, the video call TV end application comprises login, video call sending and receiving, emoticon sending and receiving, timing charging, contact and blacklist, setting, and other functions such as screen capture. The login function is mainly performed through a user account system, and userSig is obtained from the cloud; the called party is added into the room through the TRTC protocol service, and the calling party receives the message and also adds the message into the same room to carry out video call. The method comprises the steps that call timing is related, a terminal records call duration corresponding to a user account ID, the call duration is consumed during call, and after the call is finished, call timing information is uploaded to a cloud end to be stored. For better user experience, after the intelligent television terminal establishes a 'do not disturb mode' in the video call application setting and the 'do not disturb mode' is started, the called party does not receive the roomID any more, and therefore the best video call experience of the user is guaranteed.
Although the present invention has been described herein with reference to the illustrated embodiments thereof, which are intended to be preferred embodiments of the present invention, it is to be understood that the invention is not limited thereto, and that numerous other modifications and embodiments can be devised by those skilled in the art that will fall within the spirit and scope of the principles of this disclosure.
Claims (6)
1. A television audio and video call method based on a TRTC protocol is characterized in that the television audio and video call system based on the TRTC protocol is realized, and comprises a video call TV end application, a user account system, a cloud server, an instant messaging IM system and a WeChat applet;
the video call TV end application is a video call application which acquires the authority of a Camera and a far-field microphone on the smart television and is compatible with a real-time audio and video TRTC protocol;
the cloud server is used for message forwarding and stream distribution of a specific object of video call, and generating unique roomID and encryption userSig;
the instant messaging IM system is used for judging whether a user is in a video call application online state;
the WeChat small program is a video call WeChat small program which acquires a mobile phone camera, a microphone and a TRTC (real-time Audio/video communication) protocol;
the method comprises the following steps:
step 1: the method comprises the steps that a TV end application of the intelligent television video call logs in a user account system; the information that the user successfully logs in, namely the userID, is transmitted to the cloud server; the cloud server generates an encrypted userSig, and logs in an IM system by using userID and userSig to acquire an online message of a user;
step 2: the video call WeChat small program logs in a user account system; the information that the user successfully logs in, namely the userID, is transmitted to the cloud server; the cloud server generates an encrypted userSig, and logs in an IM system by using userID and userSig to acquire an online message of a WeChat applet user;
and step 3: when a user dials a mobile phone number of the other party in the intelligent television video call application, the cloud acquires a user account ID corresponding to the mobile phone number, and then sends a self-defined dialing signal and a roomID acquired from the cloud in real time to the account through the instant messaging IM system;
and 4, step 4: when the video call wechat applet user agrees to accept the video call request of the opposite party, starting a real-time audio and video TRTC protocol and joining the room corresponding to the received roomID, sending a self-defined acceptance signaling after the joining of the room is successful, and joining the same room after the calling party receives the self-defined acceptance signaling to start video call;
and 5: the video call application of the intelligent television performs one-way coding on pictures and sounds on the intelligent television through a TRTC (true tone correlation test) protocol and uploads the pictures and the sounds to a cloud server, and the video call WeChat applet acquires streaming data from the cloud, decodes the streaming data through the TRTC protocol and displays the streaming data on a real-time call interface;
step 6: the video call wechat applet performs one-way coding on the pictures and sounds on the wechat applet through a TRTC protocol and uploads the pictures and sounds to the cloud server, and the intelligent television video call application acquires streaming data from the cloud, decodes the streaming data through the TRTC protocol and displays the streaming data on a real-time call interface.
2. The TRTC protocol-based television audio/video call method according to claim 1, wherein the TRTC protocol is a TBS WebRTC real-time audio/video protocol, and the TRTC protocol can be used by any application accessing the TBS, regardless of whether the application is a wechat applet or a smart television.
3. The TRTC protocol-based television audio/video call method according to claim 1, wherein the encrypted userSig is used to perform login authentication and authentication for a user to determine whether the user is authentic.
4. The TRTC protocol-based television audio-video call method according to claim 1, wherein said roommid is used to uniquely identify a room, and is a number within a range of one agent 32 which is self-maintained and assigned.
5. The TRTC protocol-based television audio/video call method according to claim 1, wherein in step 1, when the smart television video call application is started, a login state of the user account system is obtained, if the smart television video call application does not log in, the smart television application jumps to the user account system to log in or register, after the login is successful, the smart television application receives a broadcast notification and prepares to log in an instant messaging IM system, and after the smart television obtains a userID, the cloud end obtains a userSig, and logs in the instant messaging IM system using the userID and the userSig.
6. The TRTC protocol-based television audio/video call method according to claim 1, wherein in step 4, when the video call wechat applet receives the call request, it may choose to accept or reject, and if reject, it replies a custom reject signaling to the calling party; if the room is accepted, the called party starts a real-time audio and video TRTC protocol and joins the room corresponding to the received roomID, a user-defined acceptance signaling is sent after the room is successfully joined, and the calling party joins the same room after receiving the self-defined acceptance signaling and starts to carry out video call.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010580973.2A CN111669661B (en) | 2020-06-23 | 2020-06-23 | Television audio and video call system and method based on TRTC protocol |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010580973.2A CN111669661B (en) | 2020-06-23 | 2020-06-23 | Television audio and video call system and method based on TRTC protocol |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111669661A CN111669661A (en) | 2020-09-15 |
| CN111669661B true CN111669661B (en) | 2021-06-22 |
Family
ID=72389586
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010580973.2A Active CN111669661B (en) | 2020-06-23 | 2020-06-23 | Television audio and video call system and method based on TRTC protocol |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111669661B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112261338B (en) * | 2020-10-12 | 2023-01-31 | Oppo广东移动通信有限公司 | Video call method, video call device, electronic equipment and computer-readable storage medium |
| CN112333190B (en) * | 2020-11-05 | 2024-05-03 | 深圳Tcl新技术有限公司 | Session control method, session control device, and computer-readable storage medium |
| CN112565852A (en) * | 2020-12-03 | 2021-03-26 | 深圳创维－Rgb电子有限公司 | Multi-device interaction method and device, electronic device and storage medium |
| CN113595873B (en) * | 2021-07-05 | 2023-04-18 | 深圳康佳电子科技有限公司 | Communication method and device based on conversation tool, terminal equipment and storage medium |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7263614B2 (en) * | 2002-12-31 | 2007-08-28 | Aol Llc | Implicit access for communications pathway |
| TW200735628A (en) * | 2006-03-01 | 2007-09-16 | Myson Century Inc | Method, apparatus and system for call forward through internet |
| CN102075799A (en) * | 2010-12-31 | 2011-05-25 | 中国华录集团有限公司 | Set top box system capable of realizing video telephone function in cable television network |
| CN104954724B (en) * | 2015-05-20 | 2018-01-23 | 南京创维信息技术研究院有限公司 | A kind of video call switching method, Intelligent television terminal, mobile terminal and system |
| CN104918132A (en) * | 2015-06-05 | 2015-09-16 | Tcl集团股份有限公司 | Method and system for smart television audio and video communication |
| CN106331564A (en) * | 2015-06-20 | 2017-01-11 | 联芯科技有限公司 | Method for MIFI terminal to achieve VOLTE audio-video conversation and terminal system |
| CN105792015B (en) * | 2016-03-04 | 2019-06-21 | 深圳Tcl数字技术有限公司 | Far-end network connection method and system based on smart television |
| CN106331573A (en) * | 2016-08-31 | 2017-01-11 | 上海斐讯数据通信技术有限公司 | Video call method and system |
| CN106454543A (en) * | 2016-12-06 | 2017-02-22 | 四川长虹电器股份有限公司 | Television video call system and method based on WebRTC (Web Real Time Communication) |
| CN111225230B (en) * | 2020-02-20 | 2022-10-04 | 腾讯科技（深圳）有限公司 | Management method and related device for network live broadcast data |
-
2020
- 2020-06-23 CN CN202010580973.2A patent/CN111669661B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN111669661A (en) | 2020-09-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111669661B (en) | Television audio and video call system and method based on TRTC protocol | |
| US7283154B2 (en) | Systems and methods for videoconference and/or data collaboration initiation | |
| US9888046B2 (en) | Systems, methods and media for identifying and associating user devices with media cues | |
| CN108347337B (en) | Conference communication method and device | |
| CN101534412A (en) | Method for realizing video conference notification and device | |
| JP2006501744A (en) | Media communication method and apparatus | |
| CN1792083A (en) | Conference call facility. | |
| TW200401554A (en) | A method and an apparatus for registering a user in a group communication network | |
| US10079940B2 (en) | Broadcasting system | |
| KR20060087912A (en) | System and method for transmitting alerting of mobile terminal in wireless communication system | |
| US20180310033A1 (en) | Computer implemented method for providing multi-camera live broadcasting service | |
| CN111385666B (en) | Communication link establishing method, device, equipment and storage medium | |
| CN111372092A (en) | Communication link establishing method, device, equipment and storage medium | |
| KR100699253B1 (en) | Apparatus and method for posting video data and audio data to web in video telephony of mobile communication terminal | |
| JP5684386B2 (en) | Web-based access to video content associated with voicemail | |
| CN1984373B (en) | System and method for providing multimedia contents in a communication system | |
| US20150020120A1 (en) | Methods and apparatus for supporting sharing of content between mobile communications devices and home based devices | |
| CN108322429B (en) | Recording control method in real-time communication, real-time communication system and communication terminal | |
| CN108307138A (en) | Can telecommunication video system and video method | |
| KR101531198B1 (en) | Call connecting process apparatus and method providing for authentication process using push message | |
| KR100573174B1 (en) | Method and System for Providing Background Music During Mobile Phone Conversation by Using VoIP Ring-Back-Tone | |
| CN112637676B (en) | Multimedia file processing method, system, communication device and readable storage medium | |
| CN111698571B (en) | Public network mirroring method, terminal and computer readable storage medium | |
| CN112261490B (en) | Video sharing method and device, application function entity and dialing software system | |
| CN115604045A (en) | Online conference fusion method and device and computer storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |