CN110661752A - Plug-in-free real-time video playing system and method - Google Patents

Plug-in-free real-time video playing system and method Download PDF

Info

Publication number
CN110661752A
CN110661752A CN201810699636.8A CN201810699636A CN110661752A CN 110661752 A CN110661752 A CN 110661752A CN 201810699636 A CN201810699636 A CN 201810699636A CN 110661752 A CN110661752 A CN 110661752A
Authority
CN
China
Prior art keywords
video
websocket
signaling
server
plug
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810699636.8A
Other languages
Chinese (zh)
Inventor
曾雄伟
方榆
巫海雄
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Hong Du Information Technology Co Ltd
Original Assignee
Guangzhou Hong Du Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Hong Du Information Technology Co Ltd filed Critical Guangzhou Hong Du Information Technology Co Ltd
Priority to CN201810699636.8A priority Critical patent/CN110661752A/en
Publication of CN110661752A publication Critical patent/CN110661752A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/75Media network packet handling
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L65/65Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/16Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
    • H04L69/161Implementation details of TCP/IP or UDP/IP stack architecture; Specification of modified or new header fields
    • H04L69/162Implementation details of TCP/IP or UDP/IP stack architecture; Specification of modified or new header fields involving adaptations of sockets based mechanisms
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/2187Live feed
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47202End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643Communication protocols
    • H04N21/6437Real-time Transport Protocol [RTP]

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • Human Computer Interaction (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention discloses a system and a method for playing a real-time video without a plug-in. The system comprises: the system comprises a browser, a streaming media server and a video source; the browser comprises a playing module, a video coding and decoding module and a first communication module; the streaming media server comprises a second communication module and an access module; a WebSocket channel is established between the first communication module and the second communication module; the first communication module comprises an RTSP/SIP client and a WebSocket client; the second communication module comprises an RTSP/SIP server and a WebSocket server. By adopting the system and the method for playing the real-time video without the plug-in, the real-time video without the plug-in can be played.

Description

Plug-in-free real-time video playing system and method
Technical Field
The invention relates to the field of internet video playing, in particular to a system and a method for playing a real-time video without a plug-in.
Background
The Web video playing generally refers to playing video in a browser container, and is mainly divided into real-time video playing and file video playing. Real-time video playing refers to real-time synchronous playing of image signals captured by equipment such as a video camera and a camera in real time; file video playback refers to playback of a file of historical video images, movies, or other video formats.
The currently commonly used technologies for Web video playback are as follows:
1) video playing plug-in technology: video playing plug-ins are implemented by other compilation languages such as C/C + +, for example: and the ocx plug-in and dll plug-in are embedded into the browser through an ActiveX technology to provide a video playing function.
2) H5video playing technology: through the new label < video > and the video source label < source > of H5, the video is packaged according to the specified format and then played.
However, the video playing plug-in technology realizes a video playing plug-in interface through an ActiveX technology, the browser calls the video playing plug-in interface through JavaScript to realize video playing, the video plug-in is installed at the browser end, various video streams are transmitted through a standard streaming media communication protocol, and the video plug-in can support decoding display of the video streams in various formats; however, since the plug-in is installed at the browser end, various settings need to be performed on the browser, which reduces the user experience and also reduces the security of the client, and this technology needs to install and register all components of the control for use, and often needs to reduce the related security settings of the browser before playing the video, therefore, the video playing plug-in technology has the following defects: (1) the data needs to be packed into an installation package and can be registered only by supporting a COM interface standard; (2) the plug-ins cannot be installed due to different operating environment problems of the browser end, and various problems need to be eliminated in the installation process; (3) in the using process, due to the conflict problem among the plug-ins, other software at the browser end can not be used; (4) client security cannot be guaranteed.
The existing H5video playing technology requests a video through an H5video tag and specifies a video file format and a video file path, no relevant support is provided for real-time video streams, and a file type playing mode cannot guarantee the real-time performance of the video; only some fixed format file playing modes can be supported, and file paths need to be specified, such as file formats like mp4, flv, hls and the like; the streaming playing mode is not supported, and video streams outside formats supported by H5video tags, such as H264 bare bit streams, PS streams and the like, cannot be played. The prior art is not mature enough and has many limitations.
Therefore, the existing video playing technology has the problems of complex plug-in installation, low client security and video playing blockage.
Disclosure of Invention
The invention aims to provide a system and a method for playing a video in real time without a plug-in, which aim to solve the problems that the plug-in is complex to install, the client security is low and the video playing is unsmooth in the prior art.
In order to achieve the purpose, the invention provides the following scheme:
a plug-in free real-time video playback system comprising: the system comprises a browser, a streaming media server and a video source;
the browser comprises a playing module, a video coding and decoding module and a first communication module; the streaming media server comprises a second communication module and an access module;
a WebSocket channel is established between the first communication module and the second communication module;
the browser is used for sending a video-on-demand signaling to the second communication module through the WebSocket channel through the first communication module; the video encoding and decoding module is used for encoding the processed video stream and playing the encoded video stream;
the streaming media server is used for receiving the video on demand signaling through the second communication module, converting the video on demand signaling into a video access signaling through the access module, and sending the video access signaling to the video source; the video processing device is also used for processing and transmitting the video stream sent by the video source to obtain a processed video stream;
and the video source is used for receiving the video access signaling and sending the video stream to the streaming media server according to the video access signaling.
Optionally, the browser specifically includes:
the first communication module comprises an RTSP/SIP client and a WebSocket client; the second communication module comprises an RTSP/SIP server and a WebSocket server;
the video communication protocol registration unit is used for establishing a WebSocket connection channel to a WebSocket server in the streaming media server through the WebSocket client, and registering a video communication protocol based on an SIP (Session initiation protocol) protocol or an RTP/RTCP (real-time transport control protocol) protocol to the WebSocket server through the WebSocket connection channel;
the WebSocket channel establishing unit is used for carrying out various signaling transmissions according to the video communication protocol and establishing a WebSocket channel; the plurality of signaling includes the video-on-demand signaling, the video access signaling, and the video stream.
Optionally, the streaming media server specifically includes:
the calling unit is used for calling the video-on-demand signaling initiated by the RTSP/SIP client;
and the first transmission unit is used for transmitting the video on demand signaling to the WebSocket server through the WebSocket channel, informing the RTSP/SIP server by the WebSocket server to analyze the video on demand signaling, converting the video on demand signaling into a video access instruction which can be identified by the access module, and sending the video access instruction to the video source.
Optionally, the streaming media server specifically includes:
and the video stream processing unit is used for sending the video stream to the WebSocket server, and then informing the RTSP/SIP server of processing by the WebSocket server to obtain the processed video stream.
Optionally, the method further includes:
and the processed video stream transmission subunit is used for transmitting the processed video stream to the WebSocket client through the WebSocket channel, and the WebSocket client transmits the processed video stream to the video coding and decoding module.
A plug-in-free real-time video playing method is applied to a plug-in-free real-time video playing system, and the plug-in-free real-time video playing system comprises: the system comprises a browser, a streaming media server and a video source; the browser comprises a playing module, a video coding and decoding module and a first communication module; the streaming media server comprises a second communication module and an access module;
the plug-in-free real-time video playing method comprises the following steps:
establishing a WebSocket channel;
the browser sends a video on demand signaling to the second communication module through the WebSocket channel through the first communication module;
the streaming media server receives the video on demand signaling through the second communication module, converts the video on demand signaling into a video access signaling through the access module, and sends the video access signaling to the video source;
the video source receives the video access signaling and sends the video stream to the streaming media server according to the video access signaling;
the streaming media server processes and transmits the video stream sent by the video source to obtain a processed video stream;
and the browser decodes the processed video stream through the video coding and decoding module, and the playing module plays the decoded video stream.
Optionally, the establishing of the WebSocket channel specifically includes:
the first communication module comprises an RTSP/SIP client and a WebSocket client; the second communication module comprises an RTSP/SIP server and a WebSocket server;
establishing a WebSocket connection channel to a WebSocket server in the streaming media server through the WebSocket client, and registering a video communication protocol based on an SIP (session initiation protocol) or an RTP/RTCP (real-time transport control protocol) protocol to the WebSocket server through the WebSocket connection channel;
carrying out multiple signaling transmission according to the video communication protocol, and establishing a WebSocket channel; the plurality of signaling includes the video-on-demand signaling, the video access signaling, and the video stream.
Optionally, the receiving, by the second communication module, the video-on-demand signaling, converting, by the access module, the video access signaling, and sending the video access signaling to the video source specifically includes:
calling the video-on-demand signaling initiated by the RTSP/SIP client;
and transmitting the video on demand signaling to the WebSocket server through the WebSocket channel, informing the RTSP/SIP server by the WebSocket server to analyze the video on demand signaling, converting the video on demand signaling into a video access instruction which can be identified by the access module, and transmitting the video access instruction to the video source.
Optionally, the processing and transmitting the video stream sent by the video source to obtain the processed video stream specifically includes:
and sending the video stream to the WebSocket server, and informing the RTSP/SIP server by the WebSocket server to process to obtain a processed video stream.
Optionally, the sending the video stream to the WebSocket server, and then the WebSocket server notifies the RTSP/SIP server to process the video stream, so as to obtain a processed video stream, and then the method further includes:
and transmitting the processed video stream to the WebSocket client through the WebSocket channel, and transmitting the processed video stream to the video coding and decoding module by the WebSocket client.
According to the specific embodiment provided by the invention, the invention discloses the following technical effects: the invention has proposed a real-time video playing system and method without plug-in, through setting up WebSocket channel between browser and streaming media server, realize RTSP, SIP, RTP, etc. streaming media communication control and transport protocol through WebSocket, do not need to install the video plug-in, can carry on the video stream transmission; meanwhile, the video stream is decoded by the video coding and decoding module, so that the H5video player label can support the H265/H264/MPEG4 related video format which is not supported by the native H5, and the video real-time performance can be met while the video plug-in is not installed.
In addition, because the video plug-in does not need to be installed, the safety of the client is improved; by adopting the streaming playing technology, the invention can carry out decoding display without waiting for the transmission of the video file, realizes the support of H5 to the real-time video and improves the playing efficiency of the H5 video.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without inventive exercise.
FIG. 1 is a block diagram of a real-time video playing system without plug-ins according to the present invention;
fig. 2 is a signaling interaction diagram for establishing a WebSocket channel provided by the present invention;
fig. 3 is a signaling interaction diagram of a transmission function for implementing a real-time video playing control signaling and a video stream through an SIP signaling according to the present invention;
FIG. 4 is a diagram illustrating signaling interaction for decoding by a decoding module according to the present invention;
fig. 5 is a flowchart of a plug-in-free real-time video playing method provided by the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The invention aims to provide a system and a method for playing a video in real time without a plug-in, which can solve the problems of complex plug-in installation, low client security and unsmooth video playing in the prior art.
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in further detail below.
Fig. 1 is a structural diagram of a real-time video playing system without plug-in, as shown in fig. 1, a real-time video playing system without plug-in includes: a browser 1, a streaming server 2 and a video source 3.
The browser 1 comprises a playing module, a video coding and decoding module and a first communication module; the streaming media server 2 comprises a second communication module and an access module; a WebSocket channel is established between the first communication module and the second communication module; the first communication module comprises an RTSP/SIP client and a WebSocket client; the second communication module comprises an RTSP/SIP server and a WebSocket server; the browser 1 is configured to send a video-on-demand signaling to the second communication module through the WebSocket channel by using the first communication module; the video encoding and decoding module is used for encoding the processed video stream and playing the encoded video stream; the streaming media server 2 is configured to receive the video-on-demand signaling through the second communication module, convert the video-on-demand signaling into a video access signaling through the access module, and send the video access signaling to the video source; the video processing device is also used for processing and transmitting the video stream sent by the video source to obtain a processed video stream; and the video source 3 is configured to receive the video access signaling and send the video stream to the streaming media server according to the video access signaling.
The access module mainly realizes the access functions of a video source, including playing control, video stream acquisition and the like; the servers of the first communication module and the second communication module mainly realize an SIP service function based on WebSocket and an RTSP service function based on WebSocket; the client sides of the first communication module and the second communication module mainly realize SIP client side function based on WebSocket and RTSP client side function based on WebSocket.
The video coding and decoding module mainly realizes two functions:
A. the decoding function of the video stream comprises the following video stream formats: H264/H265/MPEG4 video, PS-package-based H264/H265/MPEG4 video, TS-based H264/H265/MPEG4 video, etc.;
B. video recoding function: the video packaging of H264/H265/MPEG4 into MP4/FLV/HLS and other formats is realized;
the two functions are combined and realized through JavaScript, and plug-in-free playing real-time stream is realized. JavaScript is a script language supported by a browser natively, a new H5 standard provides a Media Source Extension technology, binary video streams can be directly controlled through the JavaScript and the H5Media Source Extension technology, and the browser can support real-time streaming video without installing plug-ins.
The display module mainly realizes the display function after video decoding, and comprises the following display modes:
A. rendering YUV data decoded by a video stream in modes of WebGL/H5Canvas labels and the like;
B. and rendering data such as MP4/FLV/HLS after Video recoding through an H5Video tag.
The plug-in-free real-time video playing system provided by the invention is explained by taking the video stream acquisition realized by SIP + RTP/RTCP as an example:
1. as shown in fig. 2, establishing a WebSocket channel:
(1) the server realizes the functions of WebSocket service, SIP service, RTP/RTCP service and the like;
(2) the browser realizes the functions of a WebSocket client, an SIP client, an RTP/RTCP client and the like;
(3) the browser establishes a WebSocket channel to the server;
(4) the browser registers a video communication protocol based on protocols such as SIP/RTP/RTCP with the server through the WebSocket channel.
2. As shown in fig. 3, the transmission function of the real-time video playing control signaling and the video stream is realized through the SIP signaling;
(1) a user (client program) initiates real-time video on demand by calling an SIP client;
(2) the SIP client transmits the video-on-demand signaling to the server through the WebSocket channel;
(3) after receiving the video on demand signaling, the WebSocket informs the SIP service to receive and analyze the signaling;
(4) the SIP service receives the on-demand signaling, analyzes the on-demand signaling and converts the on-demand signaling into an on-demand instruction of the video access end;
(5) the SIP service informs a video access service module to initiate video on demand after signaling conversion;
(6) the video access service initiates video on demand to a video source;
(7) the video source receives the order command and pushes the video stream to the video server;
(8) after receiving the video stream, the video server transmits the video stream to the client through the WebSocket channel;
(9) the client receives video stream data through a WebSocket channel;
(10) and after receiving the video stream, the client WebSocket channel informs a user (a client program) to process.
3. After the video stream is obtained through a communication module realized based on a WebSocket protocol, a front-end coding and decoding module based on JavaScript is also required to be realized to decode the video stream and decode the original data (YUV data) of the video stream;
(1) a user (client program) initiates real-time video on demand by calling an SIP client;
(2) after scheduling by the communication module, the user (client program) receives the video stream data (taking H264 as an example);
(3) a user (client program) decodes the H264 video stream by calling a front-end decoding module to generate YUV data;
(4) a user (client program) takes YUV data;
(5) rendering the YUV data by a user (client program) through a Canvas label control in the H5 standard;
(6) various cases can be realized by combining different communication modules and different decoding and playing modules, and similar cases belong to the solution of the patent and belong to the protection scope of the patent.
Fig. 5 is a flowchart of a method for playing a real-time video without a plug-in, as shown in fig. 5, the method for playing a real-time video without a plug-in includes:
step 501: and establishing a WebSocket channel.
The step 501 specifically includes: establishing a WebSocket connection channel to a WebSocket server in the streaming media server through the WebSocket client, and registering a video communication protocol based on an SIP (session initiation protocol) or an RTP/RTCP (real-time transport control protocol) protocol to the WebSocket server through the WebSocket connection channel; carrying out multiple signaling transmission according to the video communication protocol, and establishing a WebSocket channel; the plurality of signaling includes the video-on-demand signaling, the video access signaling, and the video stream.
Step 502: and the browser sends the video-on-demand signaling to the second communication module through the WebSocket channel through the first communication module.
Step 503: and the streaming media server receives the video on demand signaling through the second communication module, converts the video on demand signaling into a video access signaling through the access module, and sends the video access signaling to the video source.
The step 503 specifically includes: calling the video-on-demand signaling initiated by the RTSP/SIP client; and transmitting the video on demand signaling to the WebSocket server through the WebSocket channel, informing the RTSP/SIP server by the WebSocket server of analyzing the video on demand signaling, converting the video on demand signaling into a video access instruction which can be identified by the access module, and transmitting the video access instruction to the video source.
Step 504: and the video source receives the video access signaling and sends the video stream to the streaming media server according to the video access signaling.
Step 505: and the streaming media server processes and transmits the video stream sent by the video source to obtain a processed video stream.
The step 505 specifically includes: and sending the video stream to the WebSocket server, and informing the RTSP/SIP server by the WebSocket server to process to obtain a processed video stream.
Step 506: and the browser decodes the processed video stream through the video coding and decoding module, and the playing module plays the decoded video stream.
Said step 506 is followed by: and transmitting the processed video stream to the WebSocket client through the WebSocket channel, and transmitting the processed video stream to the video coding and decoding module by the WebSocket client.
The invention realizes the combined use of the streaming media communication control and transmission protocol, the front-end video coding and decoding and the H5 player through the WebSocket; front-end video codec and H5 player tab support for H265/H264/MPEG 4-related video formats not supported by native H5.
The plug-in-free real-time video playing system and method provided by the invention can obtain the following effects:
1. the user experience effect is good, video plug-ins do not need to be installed, and the video real-time performance is met;
2. the client-side safety is realized, and the safety setting of a browser is not required to be reduced to meet the video playing requirement;
3. the video playing efficiency is improved by adopting the streaming playing technology in the new scheme, so that decoding display can be carried out without waiting for the transmission of the video file, the support of H5 on real-time video is realized, and the video playing efficiency of H5 is improved.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. For the system disclosed by the embodiment, the description is relatively simple because the system corresponds to the method disclosed by the embodiment, and the relevant points can be referred to the method part for description.
The principles and embodiments of the present invention have been described herein using specific examples, which are provided only to help understand the method and the core concept of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, the specific embodiments and the application range may be changed. In view of the above, the present disclosure should not be construed as limiting the invention.

Claims (10)

1. A plug-in free real-time video playback system, comprising: the system comprises a browser, a streaming media server and a video source;
the browser comprises a playing module, a video coding and decoding module and a first communication module; the streaming media server comprises a second communication module and an access module;
a WebSocket channel is established between the first communication module and the second communication module;
the browser is used for sending a video-on-demand signaling to the second communication module through the WebSocket channel through the first communication module; the video encoding and decoding module is used for encoding the processed video stream and playing the encoded video stream;
the streaming media server is used for receiving the video on demand signaling through the second communication module, converting the video on demand signaling into a video access signaling through the access module, and sending the video access signaling to the video source; the video processing device is also used for processing and transmitting the video stream sent by the video source to obtain a processed video stream;
and the video source is used for receiving the video access signaling and sending the video stream to the streaming media server according to the video access signaling.
2. The plug-in-free real-time video playing system according to claim 1, wherein the browser specifically comprises: the first communication module comprises an RTSP/SIP client and a WebSocket client; the second communication module comprises an RTSP/SIP server and a WebSocket server;
the video communication protocol registration unit is used for establishing a WebSocket connection channel to a WebSocket server in the streaming media server through the WebSocket client, and registering a video communication protocol based on an SIP (Session initiation protocol) protocol or an RTP/RTCP (real-time transport control protocol) protocol to the WebSocket server through the WebSocket connection channel;
the WebSocket channel establishing unit is used for carrying out various signaling transmissions according to the video communication protocol and establishing a WebSocket channel; the plurality of signaling includes the video-on-demand signaling, the video access signaling, and the video stream.
3. The plug-in-free real-time video playing system according to claim 2, wherein the streaming media server specifically comprises:
the calling unit is used for calling the video-on-demand signaling initiated by the RTSP/SIP client;
and the first transmission unit is used for transmitting the video on demand signaling to the WebSocket server through the WebSocket channel, informing the RTSP/SIP server by the WebSocket server to analyze the video on demand signaling, converting the video on demand signaling into a video access instruction which can be identified by the access module, and sending the video access instruction to the video source.
4. The plug-in-free real-time video playing system according to claim 3, wherein the streaming media server specifically comprises:
and the video stream processing unit is used for sending the video stream to the WebSocket server, and then informing the RTSP/SIP server of processing by the WebSocket server to obtain the processed video stream.
5. The plug-in-free real-time video playback system of claim 4, further comprising:
and the processed video stream transmission subunit is used for transmitting the processed video stream to the WebSocket client through the WebSocket channel, and the WebSocket client transmits the processed video stream to the video coding and decoding module.
6. A plug-in-free real-time video playing method is characterized in that the plug-in-free real-time video playing method is applied to a plug-in-free real-time video playing system, and the plug-in-free real-time video playing system comprises: the system comprises a browser, a streaming media server and a video source; the browser comprises a playing module, a video coding and decoding module and a first communication module; the streaming media server comprises a second communication module and an access module;
the plug-in-free real-time video playing method comprises the following steps:
establishing a WebSocket channel;
the browser sends a video on demand signaling to the second communication module through the WebSocket channel through the first communication module;
the streaming media server receives the video on demand signaling through the second communication module, converts the video on demand signaling into a video access signaling through the access module, and sends the video access signaling to the video source;
the video source receives the video access signaling and sends the video stream to the streaming media server according to the video access signaling;
the streaming media server processes and transmits the video stream sent by the video source to obtain a processed video stream;
and the browser decodes the processed video stream through the video coding and decoding module, and the playing module plays the decoded video stream.
7. The plug-in-free real-time video playing method according to claim 6, wherein the establishing of the WebSocket channel specifically comprises:
the first communication module comprises an RTSP/SIP client and a WebSocket client; the second communication module comprises an RTSP/SIP server and a WebSocket server;
establishing a WebSocket connection channel to a WebSocket server in the streaming media server through the WebSocket client, and registering a video communication protocol based on an SIP (session initiation protocol) or an RTP/RTCP (real-time transport control protocol) protocol to the WebSocket server through the WebSocket connection channel;
carrying out multiple signaling transmission according to the video communication protocol, and establishing a WebSocket channel; the plurality of signaling includes the video-on-demand signaling, the video access signaling, and the video stream.
8. The plug-in-free real-time video playing method according to claim 7, wherein the receiving the video-on-demand signaling through the second communication module, converting the video-on-demand signaling into a video access signaling through the access module, and sending the video access signaling to the video source specifically comprises:
calling the video-on-demand signaling initiated by the RTSP/SIP client;
and transmitting the video on demand signaling to the WebSocket server through the WebSocket channel, informing the RTSP/SIP server by the WebSocket server to analyze the video on demand signaling, converting the video on demand signaling into a video access instruction which can be identified by the access module, and transmitting the video access instruction to the video source.
9. The system for playing a plug-in-free real-time video according to claim 8, wherein the processing and transmitting the video stream sent by the video source to obtain the processed video stream specifically comprises:
and sending the video stream to the WebSocket server, and informing the RTSP/SIP server by the WebSocket server to process to obtain a processed video stream.
10. The plug-in-free real-time video playing method according to claim 9, wherein the sending the video stream to the WebSocket server, and then the WebSocket server notifying the RTSP/SIP server to process the video stream, after obtaining the processed video stream, further comprises:
and transmitting the processed video stream to the WebSocket client through the WebSocket channel, and transmitting the processed video stream to the video coding and decoding module by the WebSocket client.
CN201810699636.8A 2018-06-29 2018-06-29 Plug-in-free real-time video playing system and method Pending CN110661752A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810699636.8A CN110661752A (en) 2018-06-29 2018-06-29 Plug-in-free real-time video playing system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810699636.8A CN110661752A (en) 2018-06-29 2018-06-29 Plug-in-free real-time video playing system and method

Publications (1)

Publication Number Publication Date
CN110661752A true CN110661752A (en) 2020-01-07

Family

ID=69026898

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810699636.8A Pending CN110661752A (en) 2018-06-29 2018-06-29 Plug-in-free real-time video playing system and method

Country Status (1)

Country Link
CN (1) CN110661752A (en)

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111107391A (en) * 2020-01-16 2020-05-05 深圳市信义科技有限公司 Distributed WEB plug-in-free video live broadcast method
CN111147947A (en) * 2020-01-10 2020-05-12 深圳市同洲电子股份有限公司 Websocket-based flv video transmission and webpage playing method
CN111245856A (en) * 2020-01-17 2020-06-05 深圳市乐唯科技开发有限公司 Method and system for playing real-time video by H5
CN111787399A (en) * 2020-07-23 2020-10-16 成都云盯科技有限公司 Video playing method, device and system
CN111901616A (en) * 2020-07-15 2020-11-06 天翼视讯传媒有限公司 H5/WebGL-based method for improving multi-view live broadcast rendering
CN111988585A (en) * 2020-08-17 2020-11-24 海宇星联(山东)智慧科技有限公司 Intelligent video transmission protocol suitable for satellite data communication network
CN112073809A (en) * 2020-08-09 2020-12-11 富盛科技股份有限公司 Method for supporting browser to play video with any coding format
CN112073675A (en) * 2020-09-17 2020-12-11 中邮科通信技术股份有限公司 Panoramic video conference system based on browser and working method thereof
CN112422508A (en) * 2020-10-19 2021-02-26 武汉烽火众智数字技术有限责任公司 Method and system for playing video in browser webpage
CN112437076A (en) * 2020-11-18 2021-03-02 广州供电局有限公司 Power grid video live broadcast platform and power grid video live broadcast method
CN112804543A (en) * 2020-12-31 2021-05-14 武汉兴图新科电子股份有限公司 Terminal and method for playing video and audio on demand by browser based on cloud video fusion platform
CN112822439A (en) * 2020-12-28 2021-05-18 江苏梨柳科技有限公司 Method for real-time access of monitoring video signal to spliced screen
CN112954392A (en) * 2021-04-07 2021-06-11 多彩贵州印象网络传媒股份有限公司 Platform for automatically realizing video format conversion processing
CN113824925A (en) * 2021-08-11 2021-12-21 南京国电南自电网自动化有限公司 WEB plug-in-free video monitoring system and method
CN113938656A (en) * 2021-10-27 2022-01-14 南京工业大学 Method for playing network monitoring camera video without plug-in and low delay by browser
CN114071242A (en) * 2021-11-16 2022-02-18 重庆赛迪奇智人工智能科技有限公司 Video playing method, video pushing device and electronic equipment
CN114095555A (en) * 2021-12-08 2022-02-25 金蝶医疗软件科技有限公司 Information acquisition method and related equipment

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103297445A (en) * 2012-02-22 2013-09-11 中国移动通信集团公司 Web terminal communication method and system based on IP multimedia network
CN103581699A (en) * 2013-11-04 2014-02-12 广州华工信元通信技术有限公司 Video playing method, streaming media server and streaming media playing system
CN106506525A (en) * 2016-11-29 2017-03-15 北京旷视科技有限公司 For playing the method and device of video flowing on a web browser
CN106817354A (en) * 2015-12-01 2017-06-09 阿里巴巴集团控股有限公司 A kind of video stream transmission method, equipment and system
US20170289214A1 (en) * 2016-04-04 2017-10-05 Hanwha Techwin Co., Ltd. Method and apparatus for playing media stream on web browser
CN107277004A (en) * 2017-06-13 2017-10-20 重庆扬讯软件技术股份有限公司 A kind of browser is without plug-in unit net cast method
CN107645491A (en) * 2016-07-21 2018-01-30 韩华泰科株式会社 Media flow transmission equipment and media serving device

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103297445A (en) * 2012-02-22 2013-09-11 中国移动通信集团公司 Web terminal communication method and system based on IP multimedia network
CN103581699A (en) * 2013-11-04 2014-02-12 广州华工信元通信技术有限公司 Video playing method, streaming media server and streaming media playing system
CN106817354A (en) * 2015-12-01 2017-06-09 阿里巴巴集团控股有限公司 A kind of video stream transmission method, equipment and system
US20170289214A1 (en) * 2016-04-04 2017-10-05 Hanwha Techwin Co., Ltd. Method and apparatus for playing media stream on web browser
CN107277612A (en) * 2016-04-05 2017-10-20 韩华泰科株式会社 Method and apparatus for playing Media Stream in web browser
CN107645491A (en) * 2016-07-21 2018-01-30 韩华泰科株式会社 Media flow transmission equipment and media serving device
CN106506525A (en) * 2016-11-29 2017-03-15 北京旷视科技有限公司 For playing the method and device of video flowing on a web browser
CN107277004A (en) * 2017-06-13 2017-10-20 重庆扬讯软件技术股份有限公司 A kind of browser is without plug-in unit net cast method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
张晓燕,单勇,符艳军: "《数字视频处理及应用》", 31 January 2014 *

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111147947B (en) * 2020-01-10 2021-12-10 深圳市同洲电子股份有限公司 Websocket-based flv video transmission and webpage playing method
CN111147947A (en) * 2020-01-10 2020-05-12 深圳市同洲电子股份有限公司 Websocket-based flv video transmission and webpage playing method
CN111107391A (en) * 2020-01-16 2020-05-05 深圳市信义科技有限公司 Distributed WEB plug-in-free video live broadcast method
CN111245856A (en) * 2020-01-17 2020-06-05 深圳市乐唯科技开发有限公司 Method and system for playing real-time video by H5
CN111901616A (en) * 2020-07-15 2020-11-06 天翼视讯传媒有限公司 H5/WebGL-based method for improving multi-view live broadcast rendering
CN111787399A (en) * 2020-07-23 2020-10-16 成都云盯科技有限公司 Video playing method, device and system
CN112073809A (en) * 2020-08-09 2020-12-11 富盛科技股份有限公司 Method for supporting browser to play video with any coding format
CN111988585A (en) * 2020-08-17 2020-11-24 海宇星联(山东)智慧科技有限公司 Intelligent video transmission protocol suitable for satellite data communication network
CN111988585B (en) * 2020-08-17 2022-04-29 海宇星联(山东)智慧科技有限公司 Video transmission method suitable for satellite data communication network
CN112073675A (en) * 2020-09-17 2020-12-11 中邮科通信技术股份有限公司 Panoramic video conference system based on browser and working method thereof
CN112422508A (en) * 2020-10-19 2021-02-26 武汉烽火众智数字技术有限责任公司 Method and system for playing video in browser webpage
CN112437076A (en) * 2020-11-18 2021-03-02 广州供电局有限公司 Power grid video live broadcast platform and power grid video live broadcast method
CN112822439A (en) * 2020-12-28 2021-05-18 江苏梨柳科技有限公司 Method for real-time access of monitoring video signal to spliced screen
CN112804543A (en) * 2020-12-31 2021-05-14 武汉兴图新科电子股份有限公司 Terminal and method for playing video and audio on demand by browser based on cloud video fusion platform
CN112954392A (en) * 2021-04-07 2021-06-11 多彩贵州印象网络传媒股份有限公司 Platform for automatically realizing video format conversion processing
CN112954392B (en) * 2021-04-07 2024-01-26 多彩贵州印象网络传媒股份有限公司 Platform for automatically realizing video format conversion processing
CN113824925A (en) * 2021-08-11 2021-12-21 南京国电南自电网自动化有限公司 WEB plug-in-free video monitoring system and method
CN113938656A (en) * 2021-10-27 2022-01-14 南京工业大学 Method for playing network monitoring camera video without plug-in and low delay by browser
CN114071242A (en) * 2021-11-16 2022-02-18 重庆赛迪奇智人工智能科技有限公司 Video playing method, video pushing device and electronic equipment
CN114095555A (en) * 2021-12-08 2022-02-25 金蝶医疗软件科技有限公司 Information acquisition method and related equipment

Similar Documents

Publication Publication Date Title
CN110661752A (en) Plug-in-free real-time video playing system and method
CN109788314B (en) Method and device for transmitting video stream data
CN102263959B (en) Direct broadcast transfer method and system
US20110032856A1 (en) Gateway apparatus, method and program
US20140139735A1 (en) Online Media Data Conversion Method, Online Video Playing Method and Corresponding Device
US20200366920A1 (en) Region of Interest (ROI) Request and Inquiry in a Video Chain
CN112866199B (en) Method for viewing GB/T28181 protocol-supporting equipment in Chrome browser
JP7100052B2 (en) Electronic device and its control method
EP2827596A1 (en) Transmitting and receiving method of multimedia video data and corresponding device
CN105049931B (en) The method and system that the video of format non-supporting in mobile terminal is converted
CN103916678A (en) Multimedia data transcoding method, transcoding device and multimedia data play system
CN108494792A (en) A kind of flash player plays the converting system and its working method of hls video flowings
CN114339382A (en) Video playing method, device, equipment and computer storage medium
CN113727184B (en) Video playing method, device, system, storage medium and electronic equipment
CN113938470A (en) Method and device for playing RTSP data source by browser and streaming media server
JPWO2010114092A1 (en) Distribution system and method, conversion apparatus and program
CN103873948A (en) Streaming media self-adaption matching transmission method, system and server
CN114745361A (en) Audio and video playing method and system for HTML5 browser
CN111131743A (en) Video call method and device based on browser, electronic equipment and storage medium
US9185421B2 (en) System and method for video transcoding
CN1939060B (en) Method and device for promoting flow type transmission of video frequency information
CN112312221A (en) Audio and video playing method, storage medium and device
CN114339146B (en) Audio and video monitoring method and device, electronic equipment and computer readable storage medium
KR20100072113A (en) Method and system for providing flash contents via mobile network and method and apparatus for converting flash contents
CN111787417B (en) Audio and video transmission control method based on artificial intelligence AI and related equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20200107

RJ01 Rejection of invention patent application after publication