CN113179424B - System and method for realizing live talk-back based on external network public number - Google Patents
System and method for realizing live talk-back based on external network public number Download PDFInfo
- Publication number
- CN113179424B CN113179424B CN202110236339.1A CN202110236339A CN113179424B CN 113179424 B CN113179424 B CN 113179424B CN 202110236339 A CN202110236339 A CN 202110236339A CN 113179424 B CN113179424 B CN 113179424B
- Authority
- CN
- China
- Prior art keywords
- mobile terminal
- live broadcast
- media stream
- server
- regional center
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 43
- 238000013507 mapping Methods 0.000 claims abstract description 23
- 230000003993 interaction Effects 0.000 claims abstract description 22
- 238000004891 communication Methods 0.000 claims abstract description 9
- 230000000977 initiatory effect Effects 0.000 claims description 6
- 239000000523 sample Substances 0.000 claims description 3
- 238000006243 chemical reaction Methods 0.000 description 8
- 230000008569 process Effects 0.000 description 7
- 230000009471 action Effects 0.000 description 3
- 238000012544 monitoring process Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234309—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L51/00—User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
- H04L51/04—Real-time or near real-time messaging, e.g. instant messaging [IM]
- H04L51/046—Interoperability with other network applications or services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/06—Protocols specially adapted for file transfer, e.g. file transfer protocol [FTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/233—Processing of audio elementary streams
- H04N21/2335—Processing of audio elementary streams involving reformatting operations of audio signals, e.g. by converting from one coding standard to another
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
- H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/6437—Real-time Transport Protocol [RTP]
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention provides a system and a method for realizing live talk back based on an external network public number. The invention relates to the technical field of communication. The scheme of the invention is as follows: firstly, a mobile terminal sends a live broadcast request to a cloud server; the cloud server forwards the live broadcast request to the regional center through Nginx; mapping the port to a cloud server through Frpc, and matching a corresponding machine room through a live broadcast request by the regional center; the computer room receives the live broadcast request, collects the media stream on the site of the computer room and transmits the media stream to the regional center; the regional center transcodes the media stream and then maps an intranet port of the transcoded media stream to a cloud server; the mobile terminal can access the transcoded media stream through a cloud server port; and the mobile terminal performs voice interaction with the computer room according to the transcoded media stream. And secondly, the system comprises a mobile terminal, a cloud server, an area center and a machine room. The invention can interconnect the equipment in the outer network and the equipment in the machine room inner network through the inner and outer double network card equipment, thereby realizing the function of live broadcasting and talkback of the machine room in the public number.
Description
Technical Field
The invention relates to the technical field of communication, in particular to a system and a method for realizing live talk back based on an external network public number.
Background
With social progress, the number of communication rooms and the number of devices are increased day by day, the requirement for fine operation is improved, and live broadcast talkback is used as an effective supervision mode and plays an increasingly important role in the whole process.
The equipment and the system on the market can only support single intranet or single extranet access, and cannot realize extranet access to intranet equipment and intercommunication interaction through ways such as the public number.
Disclosure of Invention
The invention aims to provide a method for realizing live broadcast talkback based on an external network public number, which can interconnect equipment in an external network and equipment in a machine room intranet by means of technical means such as internal and external double network card equipment, a streaming media conversion protocol and the like, thereby realizing the live broadcast talkback function of the machine room in the public number.
The embodiment of the invention is realized by the following steps:
in a first aspect, an embodiment of the present application provides a method for implementing live broadcast intercom based on an extranet public number, including the following steps:
the mobile terminal sends a live broadcast request to the cloud server;
the cloud server receives a live broadcast request and forwards the live broadcast request to the regional center through Frpc internal and external network mapping and Nginx;
the regional center matches a corresponding machine room through the live broadcast request and forwards the live broadcast request to the machine room;
the machine room receives the live broadcast request, collects the media stream of the machine room on site and transmits the media stream to the regional center;
the regional center receives the media stream and transcodes the media stream;
the cloud server receives the transcoded media stream and transmits the transcoded media stream to the mobile terminal;
and the mobile terminal performs voice interaction with the computer room according to the transcoded media stream.
In some embodiments of the present invention, the media stream includes audio data and video data.
In some embodiments of the present invention, the port through which the mobile terminal performs voice interaction with the computer room according to the transcoded media stream includes: an IOS side and a non-IOS side.
In some embodiments of the present invention, the voice interaction between the mobile terminal and the machine room through the IOS terminal includes the following steps:
the mobile terminal forms a voice packet through WeChatJSSDK, uploads the voice packet to a public server and informs a working server of successful uploading at the same time;
the public server uploads the voice packet and makes a feedback result, and the voice packet is forwarded to the regional center through the cloud server by adopting Frpc internal-external network mapping and Nginx;
the regional center downloads a corresponding voice file from a public number server through a feedback result, and decodes the voice file through FFmpeg to generate an audio stream;
and the regional center is transmitted to the corresponding machine room through the Websocket.
In some embodiments of the present invention, the voice interaction between the mobile terminal and the computer room through the non-IOS terminal includes the following steps:
the mobile terminal takes in the voice packet through a browser and mobile equipment, and forwards the voice packet to the regional center through a cloud server by adopting Frpc internal and external network mapping and Nginx;
the voice packet in the center of the region is decoded through FFmpeg to generate an audio stream;
and the regional center is transmitted to the corresponding machine room through the Websocket.
In a second aspect, an embodiment of the present application provides a system for implementing live talk back based on an extranet public number, including a mobile terminal, a cloud server, a regional center, and a machine room:
a mobile terminal: for initiating live and intercom services;
cloud server: the system comprises a mobile terminal, a regional center and a media stream, wherein the mobile terminal is used for receiving a live broadcast request of the mobile terminal, forwarding the live broadcast request to the regional center through Frpc internal-external network mapping and Nginx, and transmitting the media stream processed by the regional center to the mobile terminal initiating the request;
the center of the area: the server is used for receiving the live broadcast request of the cloud server and matching the corresponding computer room, and decoding the voice packet through FFmpeg to generate an audio stream;
machine room: the method is used for collecting the media stream of the machine room on site and the voice packet sent by the center of the playing area.
In some embodiments of the present invention, the port for voice packet interaction between the mobile terminal and the machine room includes: IOS end and non-IOS end.
In some embodiments of the present invention, the IOS terminal further includes a public number server, and the public number server uploads the voice packet and makes a feedback result, and transmits the feedback result to the mobile terminal.
In some embodiments of the present invention, the area center includes a media server and a communication server:
the media server: the media stream decoder is used for decoding the media stream generated after the live broadcast and talkback requests are sent out;
the communication server: for receiving and sending out voice packets.
In some embodiments of the present invention, the machine room includes a camera probe module and a voice module.
Compared with the prior art, the embodiment of the invention has at least the following advantages or beneficial effects:
a method for realizing live broadcast talkback based on an external network public number comprises the following steps:
the mobile terminal sends a live broadcast request to the cloud server;
the cloud server receives a live broadcast request and forwards the live broadcast request to the regional center through Frpc internal and external network mapping and Nginx;
the regional center matches a corresponding machine room through the live broadcast request and forwards the live broadcast request to the machine room;
the machine room receives the live broadcast request, collects the media stream of the machine room on site and transmits the media stream to the regional center;
the regional center receives the media stream and transcodes the media stream;
the cloud server receives the transcoded media stream and transmits the transcoded media stream to the mobile terminal;
and the mobile terminal performs voice interaction with the computer room according to the transcoded media stream.
In the embodiment, the method breaks through the video monitoring protocol stack and the live broadcast protocol stack, and has perfect RTSP/RTMP support. The method comprehensively supports H265/H264/AAC/G711/OPUS. The method interconnects the equipment in the external network and the equipment in the machine room and the internal network through the technical means of internal and external double network card equipment, streaming media conversion protocol and the like, thereby realizing the live broadcasting talkback function of the machine room in the public number.
The utility model provides a system for realize live talkback based on outer net public number, includes mobile terminal, cloud ware, regional center and computer lab:
a mobile terminal: used for sending the live broadcast request and sending the voice packet;
cloud server: the system comprises a mobile terminal, a regional center and a server, wherein the regional center is used for receiving a live broadcast request of the mobile terminal and forwarding the live broadcast request to the regional center through Frpc internal and external network mapping and Nginx;
the center of the area: the server is used for receiving the live broadcast request of the cloud server and matching the corresponding computer room, and decoding the voice packet through FFmpeg to generate an audio stream;
machine room: the method is used for collecting the media stream of the machine room on site.
In the embodiment, a watcher sends a live broadcast request and a voice packet to a cloud server through a mobile terminal; the cloud server receives a live broadcast request of the mobile terminal, and forwards the live broadcast request to the regional center through Frpc internal-external network mapping and Nginx; the regional center receives a live broadcast request of the cloud server and matches with a corresponding computer room, and decodes the voice packet through FFmpeg to generate an audio stream; the machine room collects the media stream on site in the machine room and feeds the media stream back to the public number; on the other hand, the non-IOS mobile terminal can talk back with live broadcasting personnel through the process, and the equipment in the outer network is interconnected with the equipment in the machine room inner network through technical means such as regional center double-network card equipment, streaming media conversion protocol and the like, so that the live broadcasting talk-back function of the machine room in the public number is realized.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope, and those skilled in the art can also obtain other related drawings based on the drawings without inventive efforts.
Fig. 1 is a schematic diagram of a method for implementing live broadcast talkback based on an extranet public number according to an embodiment of the present invention;
fig. 2 is a schematic diagram of a system for implementing live broadcast intercom based on an extranet public number according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments. The components of the embodiments of the present application, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations.
Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without making any creative effort belong to the protection scope of the present application.
It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined or explained in subsequent figures.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus.
Some embodiments of the present application will be described in detail below with reference to fig. 1-2. The embodiments and features of the embodiments described below can be combined with one another without conflict.
Example 1
The method for realizing live broadcast talkback based on the external network public number comprises the following steps:
the mobile terminal sends a live broadcast request to the cloud server;
the cloud server receives a live broadcast request and forwards the live broadcast request to the regional center through Frpc internal and external network mapping and Nginx;
the regional center matches a corresponding machine room through the live broadcast request and forwards the live broadcast request to the machine room;
the machine room receives the live broadcast request, collects the media stream of the machine room on site and transmits the media stream to the regional center;
the regional center receives the media stream and transcodes the media stream;
the cloud server receives the transcoded media stream and transmits the transcoded media stream to the mobile terminal; and the mobile terminal performs voice interaction with the computer room according to the transcoded media stream.
In this embodiment, to solve the problem that the current devices and systems on the market can only support access to a single intranet or a single extranet, and cannot realize extranet access to intranet devices and intercom interaction through public numbers and other ways, in the method, the video live broadcast mode is as follows: a mobile terminal (public number) sends a live broadcast request to a cloud server; the cloud server receives a live broadcast request and forwards the live broadcast request to the regional center through Frpc internal and external network mapping and Nginx; the regional center matches a corresponding machine room through the live broadcast request, forwards the live broadcast request to the machine room and invokes live broadcast service; the computer room receives the live broadcast request, collects the media stream (audio data and video data) of the computer room field and transmits the media stream back to the regional center; the regional center receives the media stream and transcodes the media stream, and a viewer starting live broadcasting can watch the live broadcasting through a WeChat public number; on the other hand, after live broadcasting starts, watchers can talk back and communicate with live broadcasting personnel, and the mobile terminal performs voice interaction with a computer room according to transcoded media streams, and the method comprises the following specific steps (IOS end and non-IOS end): the mobile terminal forms a voice packet through WeChatJSSDK, uploads the voice packet to the WeChat server, and informs the public number server of successful uploading; the public number server uploads the voice packet file of the server to make a feedback result, and the voice packet file is forwarded to the regional center through the cloud server by adopting Frpc internal-external network mapping and Nginx; the region center downloads a corresponding voice file through a feedback result, and decodes the voice file through FFmpeg to generate an audio stream; the regional center is transmitted to a corresponding machine room through Websocket, and the field sound of the machine room is transmitted back to a public number end (a mobile terminal) through video live broadcast streams. On the other hand: the method for carrying out voice interaction between the mobile terminal and the machine room through the non-IOS terminal comprises the following steps: the mobile terminal logs in the voice packet through a browser and mobile equipment, and forwards the voice packet to the regional center through a cloud server by adopting Frpc internal and external network mapping and Nginx; the voice packet in the center of the region is decoded through FFmpeg to generate an audio stream; the regional center is transmitted to a corresponding machine room through Websocket, and the field sound of the machine room is transmitted back to a public number end (a mobile terminal) through video live broadcast streams. The live voice intercom service is developed based on C + +11, (RTSP/RTMP/HLS/HTTP-FLV/Websocket-FLV/GB 28181/HTTP-TS/Websocket-TS/HTTP-fMP4/Websocket-fMP4/MP 4), and protocol conversion is supported; in the method, a multiplexing/multithreading/asynchronous network IO mode is used for development, the concurrency performance is superior, and massive client connection is supported; the method supports linux, macos, ios, android and windows full platforms. The method supports the second on of the picture and the extremely low delay (within 500 milliseconds, the lowest delay can reach 100 milliseconds). The method breaks through a video monitoring protocol stack and a live broadcast protocol stack, and has perfect RTSP/RTMP support. The method comprehensively supports H265/H264/AAC/G711/OPUS. The method interconnects the equipment in the external network and the equipment in the machine room and the internal network through the technical means of internal and external double network card equipment, streaming media conversion protocol and the like, thereby realizing the live broadcasting talkback function of the machine room in the public number.
In some embodiments of the invention, the media stream comprises audio data and video data.
In this embodiment, the audio data and the video data of the live broadcasting personnel can be transmitted in the live broadcasting process.
In some embodiments of the present invention, the port through which the mobile terminal performs voice interaction with the computer room according to the transcoded media stream includes: an IOS side and a non-IOS side.
In this embodiment, the mobile terminal includes an IOS terminal and a non-IOS terminal, and live broadcast and talkback can be completed through the IOS mobile terminal and the non-IOS mobile terminal.
In some embodiments of the present invention, the voice interaction between the mobile terminal and the machine room through the IOS terminal includes the following steps:
the mobile terminal forms a voice packet through WeChatJSSDK, uploads the voice packet to a public server and informs a working server of successful uploading at the same time;
the public server uploads the voice packet and makes a feedback result, and the voice packet is forwarded to the regional center through the cloud server by adopting Frpc internal-external network mapping and Nginx;
the regional center downloads a corresponding voice file from the public number server through a feedback result, and decodes the voice file through FFmpeg to generate an audio stream;
and the regional center is transmitted to the corresponding machine room through the Websocket.
In this embodiment, the watcher of the IOS mobile terminal can talk back with the live broadcast staff through the above steps.
In some embodiments of the present invention, the voice interaction between the mobile terminal and the machine room through the non-IOS terminal includes the following steps:
the mobile terminal takes in the voice packet through a browser and mobile equipment, and forwards the voice packet to the regional center through a cloud server by adopting Frpc internal and external network mapping and Nginx;
the voice packet in the center of the region is decoded through FFmpeg to generate an audio stream;
and the regional center is transmitted to the corresponding machine room through the Websocket.
Example 2
The utility model provides a system for realize live talkback based on outer net public number, includes mobile terminal, cloud ware, regional center and computer lab:
a mobile terminal: for initiating live and intercom services;
cloud server: the system comprises a mobile terminal, a regional center and a media stream, wherein the mobile terminal is used for receiving a live broadcast request of the mobile terminal, forwarding the live broadcast request to the regional center through Frpc internal-external network mapping and Nginx, and transmitting the media stream processed by the regional center to the mobile terminal initiating the request;
the center of the area: the server is used for receiving the live broadcast request of the cloud server and matching the corresponding computer room, and decoding the voice packet through FFmpeg to generate an audio stream;
machine room: the method is used for collecting the media stream of the machine room on site and the voice packet sent by the center of the playing area.
In the embodiment, a watcher sends a live broadcast request and a voice packet to a cloud server through a mobile terminal; the cloud server receives a live broadcast request of the mobile terminal, and forwards the live broadcast request to the regional center through Frpc internal-external network mapping and Nginx; the regional center receives a live broadcast request of the cloud server and matches with a corresponding computer room, and decodes the voice packet through FFmpeg to generate an audio stream; the machine room collects the media stream on the site of the machine room and feeds the media stream back to the public number; on the other hand, the non-IOS mobile terminal can talk back with live broadcasting personnel through the process, and the equipment in the outer network is interconnected with the equipment in the machine room inner network through technical means such as regional center double-network card equipment, streaming media conversion protocol and the like, so that the live broadcasting talk-back function of the machine room in the public number is realized.
In some embodiments of the present invention, the port for voice packet interaction between the mobile terminal and the machine room includes: an IOS side and a non-IOS side.
In this embodiment, the watcher can watch live broadcast through the IOS terminal and the non-IOS terminal, and can also talk back with the live broadcast watcher.
In some embodiments of the present invention, the IOS terminal further includes a public number server, and the public number server feeds back the voice packet and transmits the feedback result to the mobile terminal.
In this embodiment, the watcher of the IOS terminal needs to upload the voice packet and make a feedback result through the public number server, and transmits the feedback result to the mobile terminal to talk back with the live broadcast personnel.
In some embodiments of the invention, the regional center comprises a media server and a messaging server:
the media server: the media stream decoder is used for decoding the media stream generated after the live broadcast and talkback requests are sent out;
the communication server: for receiving and sending out voice packets.
In this embodiment, the media server can decode the audio data and the video data after live broadcast, and the communication server can decode the talkback voice packet between the viewer and the live broadcast personnel.
In some embodiments of the invention, the machine room comprises a camera probe module and a voice module.
In this embodiment, the camera module and the voice module can support the normal live broadcast and talkback functions of live broadcast personnel.
To sum up, the method for realizing live broadcast talkback based on the external network public number provided by the embodiment of the application comprises the following steps:
the mobile terminal sends a live broadcast request to the cloud server;
the cloud server receives the live broadcast request and forwards the live broadcast request to the regional center through Frpc internal and external network mapping and Nginx;
the regional center matches a corresponding machine room through the live broadcast request and forwards the live broadcast request to the machine room;
the computer room receives the live broadcast request, collects the media stream on the site of the computer room and transmits the media stream to the regional center;
the regional center receives the media stream and transcodes the media stream;
the cloud server receives the transcoded media stream and transmits the transcoded media stream to the mobile terminal;
and the mobile terminal performs voice interaction with the computer room according to the transcoded media stream.
In the embodiment, the method breaks through the video monitoring protocol stack and the live broadcast protocol stack, and has perfect RTSP/RTMP support. The method fully supports H265/H264/AAC/G711/OPUS. The method interconnects the equipment in the external network and the equipment in the machine room and the internal network through the technical means of internal and external double network card equipment, streaming media conversion protocol and the like, thereby realizing the function of live broadcasting and talkback of the machine room in the public number.
The utility model provides a system for realize live talkback based on outer net public number, includes mobile terminal, cloud ware, regional center and computer lab:
a mobile terminal: used for sending the live broadcast request and sending the voice packet;
cloud server: the system comprises a mobile terminal, a regional center and a server, wherein the regional center is used for receiving a live broadcast request of the mobile terminal and forwarding the live broadcast request to the regional center through Frpc internal and external network mapping and Nginx;
the center of the area: the server is used for receiving the live broadcast request of the cloud server and matching the corresponding computer room, and decoding the voice packet through FFmpeg to generate an audio stream;
machine room: the method is used for collecting the media stream on the site of the computer room.
In the embodiment, a watcher sends a live broadcast request and a voice packet to a cloud server through a mobile terminal; the cloud server receives a live broadcast request of the mobile terminal, and forwards the live broadcast request to the regional center through Frpc internal-external network mapping and Nginx; the regional center receives a live broadcast request of the cloud server and matches with a corresponding computer room, and decodes the voice packet through FFmpeg to generate an audio stream; the machine room collects the media stream on site in the machine room and feeds the media stream back to the public number; on the other hand, the non-IOS mobile terminal can talk back with live broadcasting personnel through the process, and the equipment in the outer network is interconnected with the equipment in the machine room inner network through technical means such as regional center double-network card equipment, streaming media conversion protocol and the like, so that the live broadcasting talk-back function of the machine room in the public number is realized.
The above description is only a preferred embodiment of the present application and is not intended to limit the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.
It will be evident to those skilled in the art that the application is not limited to the details of the foregoing illustrative embodiments, and that the present application may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the application being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned.
Claims (10)
1. A method for realizing live broadcast talkback based on an external network public number is characterized by comprising the following steps:
the mobile terminal sends a live broadcast request to the cloud server;
the cloud server receives the live broadcast request and forwards the live broadcast request to an area center through Frpc internal and external network mapping and Nginx;
the regional center matches a corresponding machine room through the live broadcast request and forwards the live broadcast request to the machine room;
the machine room receives the live broadcast request, collects the media stream of the machine room on site and transmits the media stream to the regional center;
the regional center receiving the media stream and transcoding the media stream;
the cloud server receives the transcoded media stream and transmits the transcoded media stream to the mobile terminal;
and the mobile terminal performs voice interaction with the computer room according to the transcoded media stream.
2. The method of claim 1, wherein the media stream comprises audio data and video data.
3. The method of claim 1, wherein the port through which the mobile terminal performs voice interaction with the computer room according to the transcoded media stream comprises: IOS end and non-IOS end.
4. The method for realizing live broadcast talkback based on the extranet public number according to claim 3, wherein the voice interaction between the mobile terminal and the computer room through the IOS terminal comprises the following steps:
the mobile terminal forms a voice packet through WeChatJSSDK, uploads the voice packet to the public server and informs the public server of successful uploading;
the public number server uploads the voice packet and feeds back a result, and the voice packet is forwarded to the regional center through the cloud server by adopting Frpc internal-external network mapping and Nginx;
the regional center downloads a corresponding voice file from a public server through the feedback result, and decodes the voice file through FFmpeg to generate an audio stream;
and the area center is transmitted to the corresponding machine room through Websocket.
5. The method for realizing live broadcast talkback based on the extranet public number as claimed in claim 3, wherein the voice interaction between the mobile terminal and the computer room through the non-IOS terminal comprises the following steps:
the mobile terminal takes in the voice packet through a browser and mobile equipment, and forwards the voice packet to the regional center through the cloud server by adopting Frpc internal and external network mapping and Nginx;
the voice packet of the regional center is decoded through FFmpeg to generate an audio stream;
and the regional center is transmitted to a corresponding machine room through Websocket.
6. The utility model provides a system for realize live talkback based on outer net public number which characterized in that, includes mobile terminal, cloud ware, regional center and computer lab:
a mobile terminal: for initiating live and intercom services;
the cloud server: the system comprises a mobile terminal, a regional center and a media stream, wherein the regional center is used for receiving a live broadcast request of the mobile terminal, forwarding the live broadcast request to the regional center through Frpc internal-external network mapping and Nginx, and transmitting the media stream processed by the regional center to the mobile terminal initiating the request;
machine room: the system comprises a server room, a server and a server, wherein the server room is used for collecting media streams on the site of the server room and voice packets sent by a playing area center;
the center of the area: and the server is used for receiving the live broadcast request of the cloud server, matching the live broadcast request with the corresponding computer room, and decoding the voice packet through FFmpeg to generate an audio stream.
7. The system of claim 6, wherein the port for voice packet interaction between the mobile terminal and the machine room comprises: IOS end and non-IOS end.
8. The system of claim 7, wherein the IOS terminal further comprises a public number server, and the public number server uploads the voice packet and makes a feedback result, and transmits the feedback result to the mobile terminal.
9. The system of claim 6, wherein the regional center comprises a media server and a communication server:
the media server: the media stream decoder is used for decoding the media stream generated after the live broadcast and talkback request is sent out;
the communication server: for receiving and sending out the voice packets.
10. The system for realizing live talk according to claim 6, wherein the machine room comprises a camera probe module and a voice module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110236339.1A CN113179424B (en) | 2021-03-03 | 2021-03-03 | System and method for realizing live talk-back based on external network public number |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110236339.1A CN113179424B (en) | 2021-03-03 | 2021-03-03 | System and method for realizing live talk-back based on external network public number |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113179424A CN113179424A (en) | 2021-07-27 |
| CN113179424B true CN113179424B (en) | 2023-01-10 |
Family
ID=76921912
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110236339.1A Active CN113179424B (en) | 2021-03-03 | 2021-03-03 | System and method for realizing live talk-back based on external network public number |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113179424B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110545439A (en) * | 2019-08-29 | 2019-12-06 | 中邮科通信技术股份有限公司 | Rtmp multi-concurrent live broadcast system and method based on streaming media service |
| CN111698526A (en) * | 2020-06-10 | 2020-09-22 | 中邮建技术有限公司 | Method and system for realizing viewing of live video by scanning two-dimensional code |
| CN112055024A (en) * | 2020-09-09 | 2020-12-08 | 深圳市欢太科技有限公司 | Authority verification method and device, storage medium and electronic equipment |
| CN212137844U (en) * | 2020-06-16 | 2020-12-11 | 浙江捷峰电子有限公司 | Public environment monitoring online live broadcast system based on GD32 |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101695129B (en) * | 2009-10-09 | 2012-05-16 | 中兴通讯股份有限公司 | Method and system for realizing video monitoring by mobile terminal supporting multimodes |
-
2021
- 2021-03-03 CN CN202110236339.1A patent/CN113179424B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110545439A (en) * | 2019-08-29 | 2019-12-06 | 中邮科通信技术股份有限公司 | Rtmp multi-concurrent live broadcast system and method based on streaming media service |
| CN111698526A (en) * | 2020-06-10 | 2020-09-22 | 中邮建技术有限公司 | Method and system for realizing viewing of live video by scanning two-dimensional code |
| CN212137844U (en) * | 2020-06-16 | 2020-12-11 | 浙江捷峰电子有限公司 | Public environment monitoring online live broadcast system based on GD32 |
| CN112055024A (en) * | 2020-09-09 | 2020-12-08 | 深圳市欢太科技有限公司 | Authority verification method and device, storage medium and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113179424A (en) | 2021-07-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108055496B (en) | Live broadcasting method and system for video conference | |
| CN107846633B (en) | Live broadcast method and system | |
| US6944136B2 (en) | Two-way audio/video conferencing system | |
| CN106331581B (en) | Method and device for communication between mobile terminal and video network terminal | |
| CN112543297B (en) | Video conference live broadcast method, device and system | |
| US6603501B1 (en) | Videoconferencing using distributed processing | |
| CN101872555B (en) | Real-time interactive teaching system based on application-layer multicast services | |
| US9019372B2 (en) | Remote controlled studio camera system | |
| CN105610824B (en) | A kind of screen sharing method based on screen mirror image and RTSP Streaming Media frame | |
| CN106941629B (en) | Real-time live broadcast method based on SIP + RTP and RTMP protocol intercommunication | |
| CN102325181B (en) | Instant audio/video interactive communication method based on sharing service and instant audio/video interactive communication system based on sharing service | |
| US20170187986A1 (en) | Live streaming media method, publish side live, server and terminal | |
| WO2015168823A1 (en) | Interactive acknowledge system and method based on internet communications and streaming media live broadcast | |
| US20040170159A1 (en) | Digital audio and/or video streaming system | |
| WO2017107440A1 (en) | Streaming media live broadcasting method, releasing terminal, client terminal and system | |
| JP5139801B2 (en) | Interactive multimedia service system and method | |
| EP2645710A1 (en) | Method for monitoring terminal through ip network and mcu | |
| CN112019792A (en) | Conference control method, conference control device, terminal equipment and storage medium | |
| CN108282685A (en) | A kind of method and monitoring system of audio-visual synchronization | |
| CN102438119B (en) | Audio/video communication system of digital television | |
| EP3316546B1 (en) | Multimedia information live method and system, collecting device and standardization server | |
| CN110611639A (en) | Audio data processing method and device for streaming media conference | |
| CN113179424B (en) | System and method for realizing live talk-back based on external network public number | |
| CN111083427B (en) | Data processing method of embedded terminal and 4K video conference system | |
| US20100118113A1 (en) | System and method for multipoint video teleconferencing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |