CN106454416B - synchronous playback method and device - Google Patents
synchronous playback method and device Download PDFInfo
- Publication number
- CN106454416B CN106454416B CN201610919783.2A CN201610919783A CN106454416B CN 106454416 B CN106454416 B CN 106454416B CN 201610919783 A CN201610919783 A CN 201610919783A CN 106454416 B CN106454416 B CN 106454416B
- Authority
- CN
- China
- Prior art keywords
- receiving
- sending
- equipment
- message
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
- H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1069—Session establishment or de-establishment
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/40—Support for services or applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
- H04N21/2387—Stream processing in response to a playback request from an end-user, e.g. for trick-play
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
- H04N21/25808—Management of client data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/437—Interfacing the upstream path of the transmission network, e.g. for transmitting client requests to a VOD server
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Abstract
the invention discloses a synchronous playback method. When the server receives a synchronous playback request message sent by the receiving equipment, the synchronous playback request message is sent to the appointed sending equipment, because the appointed field of the synchronous playback request message carries the identifications of a plurality of front-end equipment needing synchronous playback, and the appointed sending equipment stores video monitoring data of the front-end equipment, after the server establishes a session between the receiving equipment and the appointed sending equipment through session configuration information of the sending equipment, the receiving equipment can synchronously receive the video monitoring data corresponding to each front-end equipment through the session, so that the preparation time required by synchronous playback among the front-end equipment is reduced, and the time synchronism of each video playback is ensured.
Description
Technical Field
The invention relates to the technical field of communication, in particular to a synchronous playback method. The invention also relates to a synchronous playback device.
background
GB/T28181-2016 technical requirements for information transmission, exchange and control of a public safety video monitoring networking system is a national standard proposed by the Ministry of public Security science and technology informatization, which is drafted by multiple units such as the national Security and Security alarm System standardization technical Committee (SAC/TC100) at the entrance and the Ministry of public Security. The standard specifies the interconnection structure, the basic requirements and the safety requirements of transmission, exchange and control, the technical requirements of control, transmission flow, protocol interface and the like in the public safety video monitoring networking system. The standard is suitable for scheme design, system detection and acceptance of a public safety video monitoring networking system and equipment development and production related to the system, and other information systems can be adopted by reference.
playback is the playing from some existing, recorded source, i.e. in the sense we refer to "playing". Due to the monitoring range limitation of a single camera, in many cases, a plurality of cameras monitoring the same large-area occasion (such as a square) need to be started, controlled and stopped for playback at the same time during playback, and in the playback process, the time points of the images decoded and displayed by the cameras are basically consistent, so as to help a user to master the overall situation of the large-area occasion and acquire effective information, namely, the synchronous playback derived on the basis of the playback.
In the standard, a message interaction flow of historical video and audio playback and media playback control in the playback process are defined, including normal play, fast play, slow play, picture pause, random drag and drop, and the like. The national standard does not define the message interaction mechanism and playback control for synchronous playback. Therefore, in the prior art, when synchronous playback is implemented, a requester of synchronous playback needs to start and control a plurality of playbacks that need to be synchronized as a plurality of separate playbacks when performing synchronous playback. In the process, not only is the starting time of synchronous playback long due to excessive mutual information among the synchronous playback requester, the server and the synchronous request sender, but also images of each camera are played back independently, so that control is inaccurate in the playback process, and the synchronous time error is large.
Therefore, how to ensure the time synchronism of the synchronous playback as much as possible on the basis of reducing the device information interaction, and further improve the efficiency of the synchronous playback becomes a technical problem to be solved urgently by those skilled in the art.
disclosure of Invention
in view of the problems in the prior art, the present invention provides a synchronous playback method for ensuring the accuracy of synchronous playback and reducing the amount of information interaction on the premise of implementing synchronous playing of video data of multiple front-end devices. The method is applied to a video system comprising a receiving device, a server and a sending device, and comprises the following steps:
when the server receives a synchronous playback request message sent by the receiving equipment, the server sends the synchronous playback request message to appointed sending equipment, wherein the appointed field of the synchronous playback request message carries the identification of a plurality of front-end equipment needing synchronous playback, and the appointed sending equipment stores video monitoring data of the front-end equipment;
And the server enables the receiving equipment and the appointed sending equipment to establish a session through the session configuration information of the sending equipment, so that the receiving equipment synchronously receives the video monitoring data corresponding to the front-end equipment through the session.
preferably, when the server receives a synchronous playback request message sent by the receiving device, the server sends the synchronous playback request message to a designated sending device, specifically:
Receiving a synchronous playback request message from the receiving device;
acquiring the specified field from a message header field of the synchronous playback request message;
Acquiring video sources corresponding to the front-end equipment according to the designated fields;
Taking the sending equipment for storing the video monitoring data of the video source as the appointed sending equipment;
and sending a synchronous playback request message carrying a special field to the sending equipment, wherein the special field is used for describing the identifier of each video source in the session.
preferably, when the video monitoring data of the video source is stored in the same sending device, the server establishes a session between the receiving device and the designated sending device through the session configuration information of the sending device, specifically:
Receiving a response message from the sending device, the response message including the configuration information and the identifier;
forwarding the response message to the receiving device, so that the receiving device sends a confirmation message to the sending device through the server after receiving the response message;
Receiving an acknowledgement message from the receiving device, and forwarding the acknowledgement message to the sending device, so that the sending device establishes a session with the receiving device after receiving the acknowledgement message.
preferably, when the video monitoring data of the video source is respectively stored in a plurality of sending devices, the server establishes a session between the receiving device and the designated sending device through session configuration information of the sending device, specifically:
receiving sub-response messages from the sending devices respectively, wherein the sub-response messages comprise configuration information of the sending devices and the identifiers;
generating the response message according to the configuration information carried by each sub-response message, and forwarding the response message to the receiving device, so that the receiving device sends a confirmation message to each sending device through the server after receiving the response message;
Receiving an acknowledgement message from the receiving device, and forwarding the acknowledgement message to each of the sending devices, so that each of the sending devices establishes a session with the receiving device after receiving the acknowledgement message.
preferably, after the server establishes a session between the receiving device and the specified sending device through the session configuration information of the sending device, the method further includes:
when the server receives playback control information sent by the receiving equipment, the server forwards the playback control information to the sending equipment, and feeds back the control response message to the receiving equipment after receiving the control response message replied by the sending equipment, wherein the specified field of the playback control information is consistent with the specified field of the synchronous playback request message;
When the server receives the disconnection message sent by the receiving equipment, the server sends a disconnection response message to the receiving equipment, sends the disconnection message to the sending equipment and receives the disconnection response message returned by the sending equipment.
correspondingly, the present application also proposes a server, which is applied in a video system including a receiving device, the server and a sending device, and the server includes:
The sending module is used for sending the synchronous playback request message to appointed sending equipment when the server receives the synchronous playback request message sent by the receiving equipment, wherein the appointed field of the synchronous playback request message carries the identification of a plurality of front-end equipment needing synchronous playback, and the appointed sending equipment stores video monitoring data of the front-end equipment;
And the processing module is used for establishing a session between the receiving equipment and the appointed sending equipment through the session configuration information of the sending equipment so as to enable the receiving equipment to synchronously receive the video monitoring data corresponding to each front-end equipment through the session.
Preferably, the sending module is specifically configured to:
Receiving a synchronous playback request message from the receiving device, acquiring the designated field from a message header field of the synchronous playback request message, acquiring video sources corresponding to the front-end devices according to the designated field, taking a sending device storing video monitoring data of the video sources as the designated sending device, and sending the synchronous playback request message carrying special fields to the sending device, wherein the special fields are used for describing identifiers of the video sources in the session.
Preferably, when the video monitoring data of the video source is stored in the same sending device, the processing module specifically includes:
a first receiving submodule configured to receive a response message from the transmitting apparatus, where the response message includes the configuration information and the identifier;
The forwarding sub-module is used for forwarding the response message to the receiving equipment so that the receiving equipment sends a confirmation message to the sending equipment through the server after receiving the response message;
And the second receiving submodule is used for receiving the confirmation message from the receiving equipment and forwarding the confirmation message to the sending equipment so that the sending equipment establishes a session with the receiving equipment after receiving the confirmation message.
preferably, when the video monitoring data of the video source is respectively stored in a plurality of sending devices, the processing module specifically includes:
A first receiving submodule, configured to receive sub-response messages from the respective transmitting apparatuses, where the sub-response messages include configuration information of the respective transmitting apparatuses and the identifiers;
A generating submodule, configured to generate the response message according to configuration information carried in each sub-response message, and forward the response message to the receiving device, so that the receiving device sends a confirmation message to each sending device through the server after receiving the response message;
And the second receiving submodule is used for receiving the confirmation message from the receiving equipment and forwarding the confirmation message to each sending equipment so that each sending equipment establishes a session with the receiving equipment after receiving the confirmation message.
preferably, the method further comprises the following steps:
the control module is used for forwarding the playback control information to the sending equipment when the server receives the playback control information sent by the receiving equipment, and feeding back the control response message to the receiving equipment after receiving the control response message replied by the sending equipment, wherein the specified field of the playback control information is consistent with the specified field of the synchronous playback request message;
And the disconnection module is used for sending a disconnection response message to the receiving equipment, sending the disconnection message to the sending equipment and receiving the disconnection response message returned by the sending equipment when the server receives the disconnection message sent by the receiving equipment.
Therefore, by applying the technical scheme of the application, when the server receives the synchronous playback request message sent by the receiving device, the synchronous playback request message is sent to the appointed sending device, because the appointed field of the synchronous playback request message carries the identifications of the front-end devices needing synchronous playback, and the appointed sending device stores the video monitoring data of the front-end devices, after the server establishes a session between the receiving device and the appointed sending device through the session configuration information of the sending device, the receiving device can synchronously receive the video monitoring data corresponding to the front-end devices through the session, so that the preparation time required by synchronous playback among the front-end devices is reduced, and the time synchronism of each video time is ensured.
drawings
fig. 1 is a schematic flowchart of a synchronous playback method proposed in the present application;
FIG. 2 is a schematic diagram illustrating a synchronous playback process of video recorded on the same storage device according to an embodiment of the present application;
FIG. 3 is a schematic illustration of a process for synchronized playback of video from the camera of FIG. 2 stored on different storage devices in an embodiment of the present application;
Fig. 4 is a schematic structural diagram of a server according to the present application.
Detailed Description
as described in the background art, the conventional requester of synchronous playback only processes as a plurality of individual playbacks when performing synchronous playback, and the playbacks are respectively started and controlled, so that not only are many messages exchanged and the starting time long, but also the control during the playback is inaccurate and the error of the synchronous time is large.
in order to solve the technical problems, the application provides a synchronous playback method, in a message flow initiating playback, information of a group of cameras needing playback is carried at the same time, the information is sent to an SIP (session initiation Protocol) server, the SIP server packages and transmits video of the cameras stored in the same storage device to a media stream receiver at one time according to video storage positions of the group of cameras, the media stream receives video of the cameras stored in different devices at the same port, the receiver unpacks the video and decodes the video, and the video is sent to different display panes for display, so that synchronous playback is realized.
as shown in fig. 1, a schematic flow chart of a synchronous playback method proposed by the present application includes the following steps:
s101, when the server receives a synchronous playback request message sent by the receiving device, the server sends the synchronous playback request message to a designated sending device, wherein the designated field of the synchronous playback request message carries the identification of a plurality of front-end devices needing synchronous playback, and the designated sending device stores video monitoring data of the front-end devices.
the application aims to synchronously play the historical videos of a plurality of front-end devices at the receiving device, and simultaneously reduces the information interaction among the receiving device, the sending device and the server. Therefore, compared with the scheme that the sending equipment of each front-end equipment interacts and plays back independently through the server, the method and the system for the synchronous playback of the front-end equipment have the advantages that firstly, on the basis of national standards, the synchronous playback request message sent to the server by the receiving equipment is correspondingly improved: and carrying the identifications of the plurality of front-end devices needing synchronous playback in a specified field of the synchronous playback request message. And the synchronous playback request message is sent to designated sending equipment by the server, and the sending equipment stores video monitoring data of a plurality of front-end equipment which need synchronous playback.
it should be noted that the synchronous playback request message in the solution of the present application may be a message type redefined by a technician, or may be implemented by a technician by modifying an existing playback request message within a framework of national standards. Therefore, except for expanding the specified field of the synchronous playback request message to carry the identifier of the front-end device which needs to perform synchronous playback, the specified field sets the media stream sequence number of the sending device side for the identifier of each front-end device which needs to perform synchronous playback; meanwhile, a message body of the playback request message (the type of the message body changes according to different current protocols) includes related indication fields, which include fields for indicating historical playback, playback channel, playback type, playback time period, port number of the receiving device, and receiving media type, and the like, and different field setting modes all belong to the protection scope of the present application.
Since the receiving device and the sending device establish a session with each other to transmit the video monitoring data (i.e., the historical media stream) of the front-end device on the framework of national standards, in a preferred embodiment of the present application, a synchronous playback request message sent from the server to the sending device carries a special field for describing an identifier of a session to be established in the future by a video source corresponding to each front-end device, so that the video monitoring data of a plurality of front-end devices can be transmitted independently and synchronously at one time.
Specifically, the flow of this step in the preferred embodiment is as follows:
step a) receiving a synchronous playback request message from the receiving device;
Step b) obtaining the specified field from the message header field of the synchronous playback request message;
step c) acquiring video sources corresponding to the front-end devices according to the designated fields;
Step d) taking the sending equipment for storing the video monitoring data of the video source as the appointed sending equipment;
step e) sending a synchronous playback request message carrying a special field to the sending device, wherein the special field is used for describing the identifier of each video source in the session.
in a specific application scenario, the application provides an end-to-end delivery service for data with real-time characteristics, such as interactive audio, video, etc., by using RTP. The specified field in this step is a Subject field, which is located in a header area in the synchronous playback request message, and after the SIP server acquires a plurality of video sources from the Subject field and further determines the sending device, the SIP server adds a y field description SSRC (synchronous source) value to the synchronous playback request message sent to the sending device. The SSRC is the source stream of RTP packets, represented in the RTP header by a 32-bit long synchronization source identifier, independent of the network address. This field is used to identify the synchronization source of the signal, and its value should be randomly selected to ensure that the SSRC identifications of any two synchronization sources in the RTP session are different.
And S102, the server enables the receiving equipment and the appointed sending equipment to establish a session through the session configuration information of the sending equipment, so that the receiving equipment synchronously receives the video monitoring data corresponding to the front-end equipment through the session.
After determining the sending device, the server needs to inform the receiving device about the relevant configuration information (e.g., IP, port, and media format of the sending media stream, etc.) and identifier of the sending device in order to establish a session between the receiving device and the sending device. However, due to the storage capacity of the device or the network arrangement, the video monitoring devices recorded by the front-end device are often not necessarily stored in the same storage device, and after the server determines the video source according to the identifier of the front-end device, the server can determine whether the video monitoring data to be transmitted is stored in the same sending device based on the video source. Based on the difference of the number of sending devices where the video monitoring data of the video source are located, the steps are divided into the following two cases:
(1) video monitoring data of video source is stored in same sending equipment
step a) receiving a response message from the sending device, the response message containing the configuration information and the identifier;
step b) forwarding the response message to the receiving device, so that the receiving device sends a confirmation message to the sending device through the server after receiving the response message;
Step c) receiving the confirmation message from the receiving device, and forwarding the confirmation message to the sending device, so that the sending device establishes a session with the receiving device after receiving the confirmation message.
(2) Video monitoring data of video source are respectively stored in a plurality of sending devices
Step a) receiving sub-response messages from each of the transmitting devices, respectively, the sub-response messages including configuration information of each of the transmitting devices and the identifier;
Step b) generating the response message according to the configuration information carried by each sub-response message, and forwarding the response message to the receiving device, so that the receiving device sends a confirmation message to each sending device through the server after receiving the response message;
step c) receiving the acknowledgement message from the receiving device, and forwarding the acknowledgement message to each sending device, so that each sending device establishes a session with the receiving device after receiving the acknowledgement message.
the above process realizes synchronous playback of video monitoring data of a plurality of front-end devices in a national standard framework, and can help a user to simultaneously check videos of a group of associated cameras within a period of time, so that useful information in historical videos in a large scene at the same time can be found. Meanwhile, in order to achieve uniform control of videos for these front-end devices (e.g., operations during playback, session cut-off, etc.), in a preferred embodiment of the present application, the corresponding processing is as follows:
when the server receives playback control information sent by the receiving equipment, the server forwards the playback control information to the sending equipment, and feeds back the control response message to the receiving equipment after receiving the control response message replied by the sending equipment, wherein the specified field of the playback control information is consistent with the specified field of the synchronous playback request message;
when the server receives the disconnection message sent by the receiving equipment, the server sends a disconnection response message to the receiving equipment, sends the disconnection message to the sending equipment and receives the disconnection response message returned by the sending equipment.
By applying the technical scheme of the application, when the server receives the synchronous playback request message sent by the receiving equipment, the synchronous playback request message is sent to the appointed sending equipment, because the appointed field of the synchronous playback request message carries the identifications of the plurality of front-end equipment needing synchronous playback, and the appointed sending equipment stores the video monitoring data of the front-end equipment, after the server establishes a session between the receiving equipment and the appointed sending equipment through the session configuration information of the sending equipment, the receiving equipment can synchronously receive the video monitoring data corresponding to the front-end equipment through the session, so that the preparation time required by synchronous playback among the plurality of front-end equipment is reduced, and the time synchronism of each video time is ensured.
In order to further illustrate the technical idea of the present invention, the technical solution of the present invention will now be described with reference to specific application scenarios. The difference of the storage positions of the videos based on the cameras with synchronous playback is described by two specific embodiments:
(1) The video of the synchronized playback cameras is stored on the same storage device
In the video system, a media stream receiver is used as a receiving device for initiating synchronous playback according to the instruction of a user and playing pictures of different cameras to the user according to returned video stream data, a media stream sender stores video data of each camera in the current video monitoring system before the current time, and an SIP server is a link between the media stream receiver and the media stream sender. The media stream receiver is a CS client, and assuming that a user starts synchronous playback of 4 cameras through the CS client, this embodiment regards these 4 cameras as a group, and the 4 camera encoding examples are as follows:
60000000001320000001
60000000001320000002
60000000001320000003
60000000001320000004
based on the above description, a schematic diagram of a synchronous playback process of videos recorded on the same storage device in an embodiment of the present application is shown in fig. 2, and includes the following steps:
s201, the media stream receiver sends an Invite message to the SIP server in the SDP protocol format.
a media stream receiver sends an Invite message to an SIP server, a message header field carries a Subject field, carries multiple sets of parameters such as a video source ID, a sender media stream sequence number, a media stream receiver ID, a receiving end media stream sequence number identifier, and the like, and indicates that the media stream receiver initiates synchronous Playback, a field s in an SDP message body is "Playback" to represent historical Playback, a field u represents a Playback channel ID and a Playback type, and a field t represents a Playback period, and a field m carries a port number of the media stream receiver and a received media type.
since the present application aims to achieve synchronous playback within the framework of the national standard through reasonably extended use of the Subject message, in this step, the contents of the Subject header contained in the Invite message are as follows:
60000000001320000001: sending end media stream sequence number 1, media stream receiver equipment encoding: receiving end media stream sequence number 1;
60000000001320000002: sending end media stream sequence number 2, media stream receiver device encoding: receiving end media stream sequence number 2;
60000000001320000003: sending end media stream sequence number 3, media stream receiver device encoding: receiving end media stream sequence number 3;
60000000001320000004: sending end media stream sequence number 4, media stream receiver device encoding: the receiving end media stream sequence number 4.
s202, the SIP server sends an Invite message of a server side to a media stream sender in an SDP protocol format;
After receiving the INVITE message, the SIP server obtains 4 video sources from the Subject field, and finds that videos of the 4 video sources are recorded on the same storage device after internal processing, that is, the media stream senders are the same device. The SIP server sends an Invite request to a media stream sender, the request carries a message body in a message 1, a field s is 'Playback' to represent historical Playback, a field u represents a Playback channel ID and a Playback type, a field t represents a Playback time period, a field m carries a media stream interface port number and a received media type, and a field y is added to describe an SSRC value. In this step, the contents of the Subject header contained in the Invite message are as follows:
60000000001320000001: sending end media stream sequence number 1, media stream receiver equipment encoding: receiving end media stream sequence number 1;
60000000001320000002: sending end media stream sequence number 2, media stream receiver device encoding: receiving end media stream sequence number 2;
60000000001320000003: sending end media stream sequence number 3, media stream receiver device encoding: receiving end media stream sequence number 3;
60000000001320000004: sending end media stream sequence number 4, media stream receiver device encoding: the receiving end media stream sequence number 4.
S203, the media stream sender receives the Invite request, replies a 200OK response to the SIP server, the response message carries an SDP message body, and the message body describes the IP, port, media format, 4 SSRC values and other contents of the media stream sent by the media stream sender.
s204, the SIP server forwards the message 3 to the media stream receiver.
s205, after the media stream receiver receives the 200OK response, the media stream receiver replies an ACK message to complete the Invite session establishment process with the SIP server.
s206, the SIP server forwards the message 5 to the media stream sender, and completes the Invite session establishment process with the media stream sender. Then, an RTP session is established between the media stream sender and the media stream receiver, and the media stream sender sends the code streams of 4 video sources to the media stream receiver in 1 RTP session.
S207, in the playback process, the media stream receiver controls the playback by sending an in-session Info message to the SIP server, wherein the in-session Info message includes operations of video pause, video play, fast video play, slow video play, random drag and drop play and the like, and the Subject field carries the same content as 1.
S208, the SIP server receives the message 7 and forwards the message to the media stream sender.
S209, the media stream sender replies to the 200OK response after receiving the message 8.
S210, the SIP server forwards the message 9 to the media stream recipient.
S211, the media stream receiver sends a BYE message to the SIP server, and the Invite session established by the messages 1, 4 and 5 and the media stream receiver is disconnected.
S212, the SIP server replies a 200OK response after receiving the BYE message, and the session is disconnected.
S213, the SIP server sends a BYE message to the media stream sender, and disconnects the Invite session established by the messages 2, 3 and 6 and the media stream sender.
And S214, the media stream sender replies a 200OK response after receiving the BYE message, and the session is disconnected.
the above scheme of the specific embodiment describes how to synchronously transmit video data, which are centrally stored in cameras of the same media stream sender, to the media stream receiver, and synchronously control and play back the video data. However, in practical situations, it is likely that the video data of multiple cameras are not stored in the same media stream sender. For this purpose, the present application also proposes corresponding embodiments for the case where the recordings of the synchronously played back cameras are stored on different storage devices. In a specific application scenario corresponding to this embodiment, the media stream receiver is a CS client. Assuming that the user needs to initiate synchronized playback of 2 cameras through the CS client, this particular embodiment treats these 2 cameras as a group, and subsequent embodiments are illustrated with the 2 camera codes being 60000000001320000001 and 60000000001320000002, respectively.
Fig. 3 is a schematic diagram illustrating a process of synchronously playing back videos of a video camera stored in different storage devices according to an embodiment of the present application. It should be noted that, since the processing manner of the flow except some steps is consistent with the method corresponding to fig. 2, the following description will mainly describe the steps different from the above specific examples, and specifically, the preferred embodiment includes the following steps:
s301, the media stream receiver sends an Invite message to the SIP server in the format of SDP protocol.
And S302 and S303, after the SIP server receives the INVITE message, the SIP server acquires 2 video sources from the Subject field, and after internal processing, the SIP server finds that the videos of the 2 video sources are not on the same storage device. The SIP server respectively sends Invite requests to a media stream sender and a media stream sender 2, the requests carry a message body in a message 1, a field s is 'Playback' to represent historical Playback, a field u represents a Playback channel ID and a Playback type, a field t represents a Playback time period, a field m carries a port number of a media stream receiver and a received media type, and a field y is respectively added to describe an SSRC value.
s304& S305, media sender 1 and media sender 2 respond to the Invite message of S302& S303, respectively, to reply to the SIP server with a 200ok message.
and S306, after receiving the messages of S304 and S305, the SIP server generates an ACK message and returns the ACK message to the media stream receiver, wherein 2 m fields in the message body, 1 m field with content from 4 and 1 m field from 5.
after the interaction of the media stream receiver, the SIP server and the media stream sender is completed through the messages, the media stream receiver receives the historical media streams of the two media stream senders at the same port, so that the synchronous playback processing of a plurality of cameras is realized, and the accuracy of the synchronous playback is ensured. After the subsequent user realizes the synchronous playback through the specific embodiment, if the control and disconnection functions of the synchronous playback need to be realized, it is only necessary to send corresponding messages to the media stream sender 1 and the media stream sender 2 through the SIP server, respectively.
Through the technical scheme of the specific embodiment, based on the existing national standard framework, the Subject header field carries a plurality of pieces of video source information, so that the message interaction between a media stream receiver and an SIP server and between the SIP server and a media stream sender is reduced, and the establishment time of the media stream is shortened. And a plurality of y fields are carried in the SDP message body, so that a plurality of historical media streams are carried in one SDP session, and the time synchronism among various historical videos is ensured.
In order to achieve the above technical object, the present application further provides a server applied in a video system including a receiving device, the server, and a sending device, as shown in fig. 4, including:
A sending module 410, configured to send a synchronous playback request message to an appointed sending device when the server receives the synchronous playback request message sent by the receiving device, where an appointed field of the synchronous playback request message carries identifiers of multiple front-end devices that need to be played back synchronously, and the appointed sending device stores video monitoring data of the front-end devices;
The processing module 420 establishes a session between the receiving device and the designated sending device through the session configuration information of the sending device, so that the receiving device receives the video monitoring data corresponding to each front-end device through the session synchronously.
in a specific application scenario, the sending module is specifically configured to:
receiving a synchronous playback request message from the receiving device, acquiring the designated field from a message header field of the synchronous playback request message, acquiring video sources corresponding to the front-end devices according to the designated field, taking a sending device storing video monitoring data of the video sources as the designated sending device, and sending the synchronous playback request message carrying special fields to the sending device, wherein the special fields are used for describing identifiers of the video sources in the session.
in a specific application scenario, when the video monitoring data of the video source is stored in the same sending device, the processing module specifically includes:
A first receiving submodule configured to receive a response message from the transmitting apparatus, where the response message includes the configuration information and the identifier;
The forwarding sub-module is used for forwarding the response message to the receiving equipment so that the receiving equipment sends a confirmation message to the sending equipment through the server after receiving the response message;
And the second receiving submodule is used for receiving the confirmation message from the receiving equipment and forwarding the confirmation message to the sending equipment so that the sending equipment establishes a session with the receiving equipment after receiving the confirmation message.
in a specific application scenario, when the video monitoring data of the video source is respectively stored in a plurality of sending devices, the processing module specifically includes:
A first receiving submodule, configured to receive sub-response messages from the respective transmitting apparatuses, where the sub-response messages include configuration information of the respective transmitting apparatuses and the identifiers;
a generating submodule, configured to generate the response message according to configuration information carried in each sub-response message, and forward the response message to the receiving device, so that the receiving device sends a confirmation message to each sending device through the server after receiving the response message;
and the second receiving submodule is used for receiving the confirmation message from the receiving equipment and forwarding the confirmation message to each sending equipment so that each sending equipment establishes a session with the receiving equipment after receiving the confirmation message.
in a specific application scenario, the method further includes:
the control module is used for forwarding the playback control information to the sending equipment when the server receives the playback control information sent by the receiving equipment, and feeding back the control response message to the receiving equipment after receiving the control response message replied by the sending equipment, wherein the specified field of the playback control information is consistent with the specified field of the synchronous playback request message;
and the disconnection module is used for sending a disconnection response message to the receiving equipment, sending the disconnection message to the sending equipment and receiving the disconnection response message returned by the sending equipment when the server receives the disconnection message sent by the receiving equipment.
therefore, by applying the technical scheme of the application, when the server receives the synchronous playback request message sent by the receiving device, the synchronous playback request message is sent to the appointed sending device, because the appointed field of the synchronous playback request message carries the identifications of the front-end devices needing synchronous playback, and the appointed sending device stores the video monitoring data of the front-end devices, after the server establishes a session between the receiving device and the appointed sending device through the session configuration information of the sending device, the receiving device can synchronously receive the video monitoring data corresponding to the front-end devices through the session, so that the preparation time required by synchronous playback among the front-end devices is reduced, and the time synchronism of each video time is ensured.
through the above description of the embodiments, those skilled in the art will clearly understand that the present invention may be implemented by hardware, or by software plus a necessary general hardware platform. Based on such understanding, the technical solution of the present invention can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a usb disk, a removable hard disk, etc.), and includes several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the method according to the implementation scenarios of the present invention.
Those skilled in the art will appreciate that the figures are merely schematic representations of one preferred implementation scenario and that the blocks or flow diagrams in the figures are not necessarily required to practice the present invention.
Those skilled in the art will appreciate that the modules in the devices in the implementation scenario may be distributed in the devices in the implementation scenario according to the description of the implementation scenario, or may be located in one or more devices different from the present implementation scenario with corresponding changes. The modules of the implementation scenario may be combined into one module, or may be further split into a plurality of sub-modules.
The above-mentioned invention numbers are merely for description and do not represent the merits of the implementation scenarios.
the above disclosure is only a few specific implementation scenarios of the present invention, however, the present invention is not limited thereto, and any variations that can be made by those skilled in the art are intended to fall within the scope of the present invention.
Claims (10)
1. a synchronized playback method for use in a video system including a receiving device, a server, and a transmitting device, the method comprising:
When the server receives a synchronous playback request message sent by the receiving equipment, the server sends the synchronous playback request message to appointed sending equipment, wherein the appointed field of the synchronous playback request message carries the identification of a plurality of front-end equipment needing synchronous playback, and the appointed sending equipment stores video monitoring data of the front-end equipment;
and the server enables the receiving equipment and the appointed sending equipment to establish a session through the session configuration information of the sending equipment, so that the receiving equipment synchronously receives the video monitoring data corresponding to the front-end equipment through the session.
2. the method according to claim 1, wherein when the server receives the synchronous playback request message from the receiving device, the server sends the synchronous playback request message to a specified sending device, specifically:
receiving a synchronous playback request message from the receiving device;
acquiring the specified field from a message header field of the synchronous playback request message;
Acquiring video sources corresponding to the front-end equipment according to the designated fields;
taking the sending equipment for storing the video monitoring data of the video source as the appointed sending equipment;
And sending a synchronous playback request message carrying a special field to the sending equipment, wherein the special field is used for describing the identifier of each video source in the session.
3. The method according to claim 2, wherein when the video monitoring data of the video source is stored in the same sending device, the server establishes a session between the receiving device and the specified sending device through the session configuration information of the sending device, specifically:
Receiving a response message from the sending device, the response message including the configuration information and the identifier;
Forwarding the response message to the receiving device, so that the receiving device sends a confirmation message to the sending device through the server after receiving the response message;
Receiving an acknowledgement message from the receiving device, and forwarding the acknowledgement message to the sending device, so that the sending device establishes a session with the receiving device after receiving the acknowledgement message.
4. the method according to claim 2, wherein when the video monitoring data of the video source is stored in a plurality of sending devices, respectively, the server establishes a session between the receiving device and the specified sending device through the session configuration information of the sending device, specifically:
Receiving sub-response messages from the sending devices respectively, wherein the sub-response messages comprise configuration information of the sending devices and the identifiers;
generating the response message according to the configuration information carried by each sub-response message, and forwarding the response message to the receiving device, so that the receiving device sends a confirmation message to each sending device through the server after receiving the response message;
receiving an acknowledgement message from the receiving device, and forwarding the acknowledgement message to each of the sending devices, so that each of the sending devices establishes a session with the receiving device after receiving the acknowledgement message.
5. The method of any one of claims 1-4, wherein after the server causes a session to be established between the receiving device and the designated sending device via the session configuration information of the sending device, further comprising:
When the server receives playback control information sent by the receiving equipment, the server forwards the playback control information to the sending equipment, and feeds back the control response message to the receiving equipment after receiving the control response message replied by the sending equipment, wherein the specified field of the playback control information is consistent with the specified field of the synchronous playback request message;
When the server receives the disconnection message sent by the receiving equipment, the server sends a disconnection response message to the receiving equipment, sends the disconnection message to the sending equipment and receives the disconnection response message returned by the sending equipment.
6. a server for use in a video system including a receiving device, the server, and a transmitting device, comprising:
the sending module is used for sending the synchronous playback request message to appointed sending equipment when the server receives the synchronous playback request message sent by the receiving equipment, wherein the appointed field of the synchronous playback request message carries the identification of a plurality of front-end equipment needing synchronous playback, and the appointed sending equipment stores video monitoring data of the front-end equipment;
And the processing module is used for establishing a session between the receiving equipment and the appointed sending equipment through the session configuration information of the sending equipment so as to enable the receiving equipment to synchronously receive the video monitoring data corresponding to each front-end equipment through the session.
7. The server according to claim 6, wherein the sending module is specifically configured to:
receiving a synchronous playback request message from the receiving device, acquiring the designated field from a message header field of the synchronous playback request message, acquiring video sources corresponding to the front-end devices according to the designated field, taking a sending device storing video monitoring data of the video sources as the designated sending device, and sending the synchronous playback request message carrying special fields to the sending device, wherein the special fields are used for describing identifiers of the video sources in the session.
8. the server according to claim 7, wherein when the video monitoring data of the video source is stored in the same sending device, the processing module specifically includes:
A first receiving submodule configured to receive a response message from the transmitting apparatus, where the response message includes the configuration information and the identifier;
the forwarding sub-module is used for forwarding the response message to the receiving equipment so that the receiving equipment sends a confirmation message to the sending equipment through the server after receiving the response message;
And the second receiving submodule is used for receiving the confirmation message from the receiving equipment and forwarding the confirmation message to the sending equipment so that the sending equipment establishes a session with the receiving equipment after receiving the confirmation message.
9. the server according to claim 7, wherein when the video monitoring data of the video source is stored in a plurality of sending devices, the processing module specifically includes:
A first receiving submodule, configured to receive sub-response messages from the respective transmitting apparatuses, where the sub-response messages include configuration information of the respective transmitting apparatuses and the identifiers;
A generating submodule, configured to generate the response message according to configuration information carried in each sub-response message, and forward the response message to the receiving device, so that the receiving device sends a confirmation message to each sending device through the server after receiving the response message;
and the second receiving submodule is used for receiving the confirmation message from the receiving equipment and forwarding the confirmation message to each sending equipment so that each sending equipment establishes a session with the receiving equipment after receiving the confirmation message.
10. The server according to any one of claims 6-9, further comprising:
the control module is used for forwarding the playback control information to the sending equipment when the server receives the playback control information sent by the receiving equipment, and feeding back the control response message to the receiving equipment after receiving the control response message replied by the sending equipment, wherein the specified field of the playback control information is consistent with the specified field of the synchronous playback request message;
And the disconnection module is used for sending a disconnection response message to the receiving equipment, sending the disconnection message to the sending equipment and receiving the disconnection response message returned by the sending equipment when the server receives the disconnection message sent by the receiving equipment.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610919783.2A CN106454416B (en) | 2016-10-21 | 2016-10-21 | synchronous playback method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610919783.2A CN106454416B (en) | 2016-10-21 | 2016-10-21 | synchronous playback method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106454416A CN106454416A (en) | 2017-02-22 |
| CN106454416B true CN106454416B (en) | 2019-12-13 |
Family
ID=58176840
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610919783.2A Active CN106454416B (en) | 2016-10-21 | 2016-10-21 | synchronous playback method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106454416B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109743555B (en) * | 2019-02-02 | 2020-09-08 | 视联动力信息技术股份有限公司 | Information processing method and system based on video network |
| CN110971873B (en) * | 2019-11-20 | 2021-04-20 | 武汉虹信技术服务有限责任公司 | Real-time monitoring method, monitoring system and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101291429A (en) * | 2008-06-02 | 2008-10-22 | 沈海涛 | Network video monitoring method and system |
| CN102045540A (en) * | 2009-10-20 | 2011-05-04 | 华为软件技术有限公司 | Video monitoring method, system and equipment |
| CN104168457A (en) * | 2014-08-18 | 2014-11-26 | 浙江宇视科技有限公司 | Method and device for playing multiple media streams on demand |
| EP3051809A1 (en) * | 2013-09-27 | 2016-08-03 | Hangzhou Hikvision Digital Technology Co., Ltd. | Intelligent video record playback method based on mobile information, and apparatus thereof |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1933594A (en) * | 2005-09-14 | 2007-03-21 | 王世刚 | Multichannel audio-video frequency data network transmitting and synchronous playing method |
| CN102710965B (en) * | 2012-05-29 | 2014-08-13 | 中国联合网络通信集团有限公司 | Video monitoring data acquisition method and system and special bearing network |
| CN104113727B (en) * | 2013-04-17 | 2017-09-12 | 华为技术有限公司 | A kind of method and apparatus of monitor video broadcasting, system |
| CN104519309A (en) * | 2013-09-27 | 2015-04-15 | 华为技术有限公司 | Video monitoring method, monitoring server and monitoring system |
-
2016
- 2016-10-21 CN CN201610919783.2A patent/CN106454416B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101291429A (en) * | 2008-06-02 | 2008-10-22 | 沈海涛 | Network video monitoring method and system |
| CN102045540A (en) * | 2009-10-20 | 2011-05-04 | 华为软件技术有限公司 | Video monitoring method, system and equipment |
| EP3051809A1 (en) * | 2013-09-27 | 2016-08-03 | Hangzhou Hikvision Digital Technology Co., Ltd. | Intelligent video record playback method based on mobile information, and apparatus thereof |
| CN104168457A (en) * | 2014-08-18 | 2014-11-26 | 浙江宇视科技有限公司 | Method and device for playing multiple media streams on demand |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106454416A (en) | 2017-02-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109889543B (en) | Video transmission method, root node, child node, P2P server and system | |
| AU2019240571B2 (en) | Reduced latency server-mediated audio-video communication | |
| EP2640099B1 (en) | Method, system and apparatus for providing stream media service | |
| TW201526654A (en) | System and method for implementing video calls | |
| EP3247121A1 (en) | Streaming media data transmission method, client and server | |
| CN103369305B (en) | Realize the method for speech talkback synchronization and playback in video monitoring system | |
| EP2472799A1 (en) | Method, apparatus and system for rapid acquisition of multicast realtime transport protocol sessions | |
| CN102694864A (en) | Method for achieving streaming media function by utilizing HTTP, streaming media server and system | |
| CN106454416B (en) | synchronous playback method and device | |
| CN110943977B (en) | Multimedia service data transmission method, server, equipment and storage medium | |
| CN108235111B (en) | Information sharing method and intelligent set top box | |
| CN111147789B (en) | Method, device and equipment for recording audio and video stream and storage medium | |
| RU2019107805A (en) | METHOD FOR MULTIPLEXING PORT AND SERVER IN VIDEO CONFERENCE SYSTEM AND MACHINE-READABLE MEDIA | |
| WO2019129125A1 (en) | Method and system for interaction between smart glasses and smart device, and storage medium | |
| US9936164B2 (en) | Media control method and device | |
| CN111803924B (en) | Multi-terminal synchronous display method and device for cloud game and readable storage medium | |
| CN108668151B (en) | Audio and video interaction method and device | |
| CN108616760B (en) | Live broadcasting method based on browser, server, anchor terminal and user terminal | |
| CN111212253B (en) | Monitoring processing method and device in video conference, electronic equipment and storage medium | |
| CN113612734A (en) | Cross-network remote court trial media stream transmission method and device | |
| EP2827584A1 (en) | Method, device, and system for implementing multi-party conference call by using set top box | |
| CN106941732B (en) | Reconnection method, reconnection system and WFD (Windows presentation device) | |
| CN111212052A (en) | Service processing method and device, electronic equipment and storage medium | |
| CN107548025B (en) | Position information sharing method and core network | |
| CN113098864B (en) | Data transmission system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20221103 Address after: 250101 4th floor, building 5, zone A2, Hanyu Jingu, Shunhua South Road, high tech Zone, Jinan City, Shandong Province Patentee after: Jinan Yushi Intelligent Technology Co.,Ltd. Address before: 2 / F, South Block, building 10, wanlun Science Park, 88 Jiangling Road, Binjiang District, Hangzhou City, Zhejiang Province, 310051 Patentee before: ZHEJIANG UNIVIEW TECHNOLOGIES Co.,Ltd. |
|
| TR01 | Transfer of patent right |