CN113542906A - RTSP video-based webpage plug-in-free playing method - Google Patents
RTSP video-based webpage plug-in-free playing method Download PDFInfo
- Publication number
- CN113542906A CN113542906A CN202110816953.5A CN202110816953A CN113542906A CN 113542906 A CN113542906 A CN 113542906A CN 202110816953 A CN202110816953 A CN 202110816953A CN 113542906 A CN113542906 A CN 113542906A
- Authority
- CN
- China
- Prior art keywords
- video
- rtsp
- video stream
- protocol
- webpage
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
- H04N21/6437—Real-time Transport Protocol [RTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/75—Media network packet handling
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/08—Protocols for interworking; Protocol conversion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234336—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by media transcoding, e.g. video is transformed into a slideshow of still pictures or audio is converted into text
Abstract
The invention particularly relates to a webpage plug-in-free playing method based on RTSP video. The RTSP video-based webpage plug-in-free playing method comprises the steps that an RTSP protocol video stream output by a network camera is converted into a WebRTC protocol video stream, and the webpage plug-in-free playing of a video output by the network camera is realized; inputting the RTSP video stream output by the network camera into a reasoning model, and sending a reasoning result to a front-end webpage; and finally, overlaying the WebRTC protocol video stream and the inference result to the front-end webpage, and playing the front-end webpage in real time. The RTSP video-based webpage plug-in-free playing method is simple in implementation framework, low in resource consumption and suitable for various different engineering applications.
Description
Technical Field
The invention relates to the technical field of streaming video and artificial intelligence, in particular to a webpage plug-in-free playing method based on RTSP video.
Background
The RTSP (Real Time Streaming Protocol) Protocol is an application layer Protocol in the TCP/IP Protocol system that defines how a one-to-many application can efficiently transmit multi-video data over an IP network. The RTSP protocol supports the following operations:
1) retrieving videos from a video server: the user may submit a presentation description via HTTP or other methods. If the presentation is multicast, the presentation contains multicast addresses and ports for consecutive videos. If the presentation is sent to the user by unicast only, the user should provide the destination address for security.
2) The video server invites to the conference: the video server may be invited to attend an ongoing conference or to play back video, some or all of which are recorded. This mode is useful in distributed educational applications where parties in a meeting may take turns pressing remote control buttons.
3) Adding video to the existing lecture: it is particularly useful for live lectures, as the server tells the user that additional video content is available. Like in HTTP/1.1, RTSP requests may be handled by proxy, channel, and cache.
The network camera can provide the video stream of the RTSP, but the RTSP video stream cannot be directly played on the webpage.
WebRTC (Web Real-Time Communication) is an API supporting a Web browser to perform Real-Time voice conversation or video conversation, and realizes a Web-based video conference, and the Real-Time Communication capability can be achieved through JavaScript provided by the browser. The audio and video transmission process based on the WebRTC is as follows:
1) a, B are all connected to a signalling server (ws);
2) a, creating a local video and acquiring session description object (offer sdp) information;
3) a sends the session description object to B through the signaling server;
4) b, after receiving the signaling, B creates a local video and acquires information of a session description object (answer sdp);
5) sending the session description object to A through a signaling server;
6) a, B exchange ICE candidate address information;
7) video streams are exchanged and used.
In engineering, aiming at the prior technical scheme of the scene, RTSP video generated by a camera is subjected to model reasoning and result marking through a Deepstream application program frame to generate a frame-by-frame image, an SRS streaming media server is deployed, the image result of the Deepstream reasoning is pushed to an SRS (simple RTMP Server) server, a video stream of a WebRTC protocol can be generated, the video stream is locally pulled, and webpage plug-in-free playing of the reasoning result is realized. However, the scheme is complex in architecture, depends on the deep stream application framework and the SRS, and the deep stream application framework has large operation delay under the condition that local resources are insufficient.
In order to solve the problems, the invention provides a webpage plug-in-free playing method based on RTSP video, and aims to explore a scheme with simple structure and less resource consumption.
Disclosure of Invention
In order to make up for the defects of the prior art, the invention provides a simple and efficient RTSP video-based webpage plug-in-free playing method.
The invention is realized by the following technical scheme:
a webpage plug-in-free playing method based on RTSP video is characterized in that: the method comprises the following steps:
firstly, converting an RTSP (real time streaming protocol) video stream output by a network camera into a WebRTC (Web real time communication) protocol video stream to realize that a webpage plays a video output by the network camera without a plug-in;
secondly, inputting the RTSP video stream output by the network camera into a reasoning model, and sending a reasoning result to a front-end webpage;
and thirdly, overlaying the WebRTC protocol video stream and the inference result to a front-end webpage, and playing the front-end webpage in real time.
In the first step, a network camera is firstly installed, an RTSP protocol video stream address of a video is configured, and an engineering module for converting the RTSP protocol video stream into a WebRTC protocol video stream is written.
In the first step, an engineering module RTSPToWebRTC for converting RTSP protocol video stream into WebRTC protocol video stream is deployed, so that the protocol conversion of the video stream is realized, and the video stream address is transmitted to a front-end webpage.
And in the second step, deploying a reasoning model, accessing an RTSP (real time streaming protocol) video stream, identifying the face position by using the reasoning model, carrying out reasoning analysis on related labeling information, and sending the related labeling information to a front-end webpage.
In the second step, the inference result includes related label information and a graph, and the inference result is sent to the front-end webpage in a form of an MQTT (Message Queuing Telemetry Transport) protocol.
And in the third step, rendering MQTT reasoning information to an upper layer of the video, realizing real-time detection of the video stream, and performing front-end real-time video playing.
The inference model adopts a faceNet model.
The inference model adopts a face detection MTCNN (Multi-task masked connected computational Networks) model.
The invention has the beneficial effects that: the RTSP video-based webpage plug-in-free playing method is simple in implementation framework, low in resource consumption and suitable for various different engineering applications.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a schematic diagram of a RTSP video-based webpage plug-in-free playing method according to the present invention.
Detailed Description
In order to make those skilled in the art better understand the technical solution of the present invention, the technical solution in the embodiment of the present invention will be clearly and completely described below with reference to the embodiment of the present invention. It is to be understood that the described embodiments are merely exemplary of the invention, and not restrictive of the full scope of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The webpage plug-in-free playing method based on the RTSP video comprises the following steps:
firstly, converting an RTSP (real time streaming protocol) video stream output by a network camera into a WebRTC (Web real time communication) protocol video stream to realize that a webpage plays a video output by the network camera without a plug-in;
secondly, inputting the RTSP video stream output by the network camera into a reasoning model, and sending a reasoning result to a front-end webpage;
and thirdly, overlaying the WebRTC protocol video stream and the inference result to a front-end webpage, and playing the front-end webpage in real time.
In the first step, a network camera is firstly installed, an RTSP protocol video stream address of a video is configured, and an engineering module for converting the RTSP protocol video stream into a WebRTC protocol video stream is written.
In the first step, an engineering module RTSPToWebRTC for converting RTSP protocol video stream into WebRTC protocol video stream is deployed, so that the protocol conversion of the video stream is realized, and the video stream address is transmitted to a front-end webpage.
And in the second step, deploying a reasoning model, accessing an RTSP (real time streaming protocol) video stream, identifying the face position by using the reasoning model, carrying out reasoning analysis on related labeling information, and sending the related labeling information to a front-end webpage.
In the second step, the inference result includes related label information and a graph, and the inference result is sent to the front-end webpage in a form of an MQTT (Message Queuing Telemetry Transport) protocol.
The MQTT protocol is an instant messaging protocol designed for communication between remote sensors and control devices operating in low-bandwidth, unreliable networks with a limited amount of computing power, and has several main characteristics:
1) providing one-to-many message publishing using a publish/subscribe message schema, decoupling applications;
2) message transmission for load content shielding;
3) providing a network connection using TCP/IP;
4. there are three message publishing quality of service:
"at most once", message publishing relies entirely on the underlying TCP/IP network. Message loss or duplication can occur. This level can be used in situations where environmental sensor data is missing a read record for a time, since a second transmission will occur in the near future;
"at least once" to ensure that messages arrive, but message repetition may occur;
"once only", ensures that a message arrives once. This level can be used in situations where message duplication or loss can lead to incorrect results in a billing system;
5) small size transmission, small overhead (fixed length header is 2 bytes), minimized protocol exchange to reduce network traffic;
6) the Last wild and maintenance features are used to inform the mechanism about client aborts on various parties.
And in the third step, rendering MQTT reasoning information to an upper layer of the video, realizing real-time detection of the video stream, and performing front-end real-time video playing.
The inference model adopts a faceNet model.
The inference model adopts a face detection MTCNN (Multi-task masked connected computational Networks) model.
Finally, it should be noted that: although the present invention has been described in detail with reference to the foregoing embodiments, it will be apparent to those skilled in the art that changes may be made in the embodiments and/or equivalents thereof without departing from the spirit and scope of the invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (8)
1. A webpage plug-in-free playing method based on RTSP video is characterized in that: the method comprises the following steps:
firstly, converting an RTSP (real time streaming protocol) video stream output by a network camera into a WebRTC (Web real time communication) protocol video stream to realize that a webpage plays a video output by the network camera without a plug-in;
secondly, inputting the RTSP video stream output by the network camera into a reasoning model, and sending a reasoning result to a front-end webpage;
and thirdly, overlaying the WebRTC protocol video stream and the inference result to a front-end webpage, and playing the front-end webpage in real time.
2. The RTSP video-based web page plug-in-less playing method according to claim 1, characterized in that: in the first step, a network camera is firstly installed, an RTSP protocol video stream address of a video is configured, and an engineering module for converting the RTSP protocol video stream into a WebRTC protocol video stream is written.
3. The RTSP video-based web page plug-in-less playing method according to claim 2, wherein: in the first step, an engineering module RTSPToWebRTC for converting RTSP protocol video stream into WebRTC protocol video stream is deployed, so that the protocol conversion of the video stream is realized, and the video stream address is transmitted to a front-end webpage.
4. The RTSP video-based web page plug-in-less playing method according to claim 1, characterized in that: and in the second step, deploying a reasoning model, accessing an RTSP (real time streaming protocol) video stream, identifying the face position by using the reasoning model, carrying out reasoning analysis on related labeling information, and sending the related labeling information to a front-end webpage.
5. The RTSP video-based web page plug-in-less playing method according to claim 1 or 4, characterized in that: in the second step, the reasoning result comprises related marking information and a graph line, and the reasoning result is sent to the front-end webpage in the form of an MQTT protocol.
6. The RTSP video-based web page plug-in-less playing method according to claim 5, wherein: and in the third step, rendering MQTT reasoning information to an upper layer of the video, realizing real-time detection of the video stream, and performing front-end real-time video playing.
7. The RTSP video-based web page plug-in-free playing method of claim 4, wherein: the inference model adopts a faceNet model.
8. The RTSP video-based web page plug-in-free playing method of claim 4, wherein: the inference model adopts a face detection MTCNN model.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110816953.5A CN113542906A (en) | 2021-07-20 | 2021-07-20 | RTSP video-based webpage plug-in-free playing method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110816953.5A CN113542906A (en) | 2021-07-20 | 2021-07-20 | RTSP video-based webpage plug-in-free playing method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113542906A true CN113542906A (en) | 2021-10-22 |
Family
ID=78128847
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110816953.5A Pending CN113542906A (en) | 2021-07-20 | 2021-07-20 | RTSP video-based webpage plug-in-free playing method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113542906A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114244814A (en) * | 2021-12-13 | 2022-03-25 | 河南牧原智能科技有限公司 | Method for robot voice talkback and voice talkback service of pigsty and related product |
| CN115442348A (en) * | 2022-11-09 | 2022-12-06 | 成都华栖云科技有限公司 | Multi-protocol multi-terminal interaction-based real-time teaching interaction method and system |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106303430A (en) * | 2016-08-21 | 2017-01-04 | 贵州大学 | The method playing monitoring in real time without plug-in unit in browser |
| US20170289204A1 (en) * | 2015-04-21 | 2017-10-05 | Guangzhou Ucweb Computer Technology Co., Ltd. | Video playing method and device |
| CN109547844A (en) * | 2018-12-19 | 2019-03-29 | 网宿科技股份有限公司 | Audio/video pushing method and plug-flow client based on WebRTC agreement |
| CN110245291A (en) * | 2019-05-23 | 2019-09-17 | 广州至真信息科技有限公司 | A kind of display methods of business datum, device, computer equipment and storage medium |
| CN110532881A (en) * | 2019-07-30 | 2019-12-03 | 长江大学 | A kind of recognition of face security alarm method based on embedded artificial intelligent chip |
| CN111175958A (en) * | 2019-12-31 | 2020-05-19 | 杭州迪英加科技有限公司 | Remote consultation method and system for pathological section under microscope |
| CN112565234A (en) * | 2020-11-30 | 2021-03-26 | 武汉烽火众智数字技术有限责任公司 | Cross-network transmission system and method based on WebRTC |
| CN112804592A (en) * | 2021-01-11 | 2021-05-14 | 福建天泉教育科技有限公司 | RTSP live video forwarding method and terminal based on browser |
-
2021
- 2021-07-20 CN CN202110816953.5A patent/CN113542906A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170289204A1 (en) * | 2015-04-21 | 2017-10-05 | Guangzhou Ucweb Computer Technology Co., Ltd. | Video playing method and device |
| CN106303430A (en) * | 2016-08-21 | 2017-01-04 | 贵州大学 | The method playing monitoring in real time without plug-in unit in browser |
| CN109547844A (en) * | 2018-12-19 | 2019-03-29 | 网宿科技股份有限公司 | Audio/video pushing method and plug-flow client based on WebRTC agreement |
| CN110245291A (en) * | 2019-05-23 | 2019-09-17 | 广州至真信息科技有限公司 | A kind of display methods of business datum, device, computer equipment and storage medium |
| CN110532881A (en) * | 2019-07-30 | 2019-12-03 | 长江大学 | A kind of recognition of face security alarm method based on embedded artificial intelligent chip |
| CN111175958A (en) * | 2019-12-31 | 2020-05-19 | 杭州迪英加科技有限公司 | Remote consultation method and system for pathological section under microscope |
| CN112565234A (en) * | 2020-11-30 | 2021-03-26 | 武汉烽火众智数字技术有限责任公司 | Cross-network transmission system and method based on WebRTC |
| CN112804592A (en) * | 2021-01-11 | 2021-05-14 | 福建天泉教育科技有限公司 | RTSP live video forwarding method and terminal based on browser |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114244814A (en) * | 2021-12-13 | 2022-03-25 | 河南牧原智能科技有限公司 | Method for robot voice talkback and voice talkback service of pigsty and related product |
| CN115442348A (en) * | 2022-11-09 | 2022-12-06 | 成都华栖云科技有限公司 | Multi-protocol multi-terminal interaction-based real-time teaching interaction method and system |
| CN115442348B (en) * | 2022-11-09 | 2023-01-24 | 成都华栖云科技有限公司 | Multi-protocol multi-terminal interaction-based real-time teaching interaction method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108055496B (en) | Live broadcasting method and system for video conference | |
| CN109803111B (en) | Method and device for watching video conference after meeting | |
| CN1892649A (en) | Interactive news gathering and media production control system | |
| CN109309806B (en) | Video conference management method and system | |
| CN101873219B (en) | System for live broadcast of video conference on basis of application-layer multicast services | |
| CN113542906A (en) | RTSP video-based webpage plug-in-free playing method | |
| CN110417877B (en) | Audio and video service processing method and device | |
| CN110475094B (en) | Video conference processing method and device and readable storage medium | |
| CN110769310B (en) | Video processing method and device based on video network | |
| CN110191304B (en) | Data processing method, device and storage medium | |
| CN110049273B (en) | Video networking-based conference recording method and transfer server | |
| CN110191315B (en) | Monitoring and checking method and device based on video network | |
| CN111147789B (en) | Method, device and equipment for recording audio and video stream and storage medium | |
| CN110113558B (en) | Data processing method, device, system and computer readable storage medium | |
| CN110457575B (en) | File pushing method, device and storage medium | |
| CN109544879B (en) | Alarm data processing method and system | |
| CN110913162A (en) | Audio and video stream data processing method and system | |
| CN114040220A (en) | Live broadcasting method and device | |
| CN111405230B (en) | Conference information processing method and device, electronic equipment and storage medium | |
| CN110392275B (en) | Sharing method and device for manuscript demonstration and video networking soft terminal | |
| CN110392227B (en) | Data processing method, device and storage medium | |
| CN109698859B (en) | Data storage method and device based on video network | |
| CN111629277A (en) | Video data transmission method, device and computer readable storage medium | |
| CN111131751A (en) | Information display method and system for video networking conference | |
| CN110795008B (en) | Picture transmission method and device and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |