WO2023169066A1 - 监控回放控制方法、装置、存储介质及电子设备 - Google Patents
监控回放控制方法、装置、存储介质及电子设备 Download PDFInfo
- Publication number
- WO2023169066A1 WO2023169066A1 PCT/CN2022/144333 CN2022144333W WO2023169066A1 WO 2023169066 A1 WO2023169066 A1 WO 2023169066A1 CN 2022144333 W CN2022144333 W CN 2022144333W WO 2023169066 A1 WO2023169066 A1 WO 2023169066A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- monitoring
- data
- channel
- playback
- control
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/14—Session management
- H04L67/141—Setup of application sessions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Definitions
- This application relates to the technical field of the Internet of Things, and specifically relates to a monitoring playback control method, device, storage medium and electronic equipment.
- monitoring equipment generally supports storing recorded monitoring data locally.
- the video is generally pushed to the cloud through a relevant push protocol, and then the control terminal pulls the video from the cloud for playback. .
- the current method of uploading to the cloud and then streaming for playback takes a long time and is easily affected by the network, making the playback less controllable, which in turn leads to poor overall reliability of monitoring playback.
- the embodiments of this application provide a solution that can realize low-cost and highly controllable monitoring playback control and improve the reliability of monitoring playback.
- a monitoring playback control method includes: sending a communication establishment message to a monitoring device to establish an audio and video stream transmission channel and a data channel for point-to-point communication with the monitoring device; through the The audio and video stream transmission channel receives the monitoring data transmitted by the monitoring equipment, and plays the monitoring content based on the monitoring data; the monitoring equipment controls the transmission of the monitoring data through the data channel to control the monitoring content. Playing status.
- a monitoring playback control device includes an establishment module for sending a communication establishment message to a monitoring device to establish an audio and video stream transmission channel and data for point-to-point communication with the monitoring device. channel; a playback module, used to receive monitoring data transmitted by the monitoring equipment through the audio and video stream transmission channel, and play monitoring content based on the monitoring data; a control module, used to control the monitoring equipment through the data channel Transmit the monitoring data to control the playback status of the monitoring content.
- control module includes: an instruction generation unit, configured to generate a playback control instruction in response to a playback control operation; and an instruction sending unit, configured to send a playback control instruction to the monitoring device through the data channel.
- the playback control instruction is used to control the monitoring device to adjust the transmission of the monitoring data to control the playback status of the monitoring content.
- the playback module includes: a playback triggering unit for sending playback instructions to the monitoring device through the data channel, where the playback instructions carry target content information; a data playback unit for In receiving the monitoring data transmitted by the monitoring device through the audio and video streaming channel, the monitoring data corresponds to the target content information in the playback instruction.
- the establishment module includes: a message sending unit, used to send the communication establishment message to the monitoring device through a web page instant messaging protocol; a message receiving unit, used to receive the monitoring device a response message sent by the device through the web page instant messaging protocol; an endpoint establishment unit, configured to establish a local channel endpoint based on the response message; the monitoring device establishes a peer channel endpoint based on the communication establishment message; the local channel endpoint
- the audio and video stream transmission channel and data channel form point-to-point communication with the peer channel endpoint.
- a monitoring playback control method includes: receiving a communication establishment message sent by a control terminal; establishing an audio and video stream transmission channel for point-to-point communication with the control terminal device according to the communication establishment message. and a data channel; transmit monitoring data to the control terminal through the audio and video stream transmission channel, and the control terminal plays monitoring content based on the monitoring data; respond to the playback control instructions transmitted by the control terminal through the data channel , perform transmission control on the monitoring data to control the playback status of the monitoring content.
- a monitoring playback control device includes: a receiving module for receiving a communication establishment message sent by a control terminal; and a connection module for communicating with the control terminal according to the communication establishment message.
- the device establishes an audio and video stream transmission channel and a data channel for point-to-point communication; a transmission module is used to transmit monitoring data to the control terminal through the audio and video stream transmission channel, and the control terminal plays monitoring content based on the monitoring data; respond A module configured to perform transmission control on the monitoring data in response to a playback control instruction transmitted by the control terminal through the data channel, so as to control the playback state of the monitoring content.
- the transmission module includes: an instruction receiving unit, configured to receive a playback instruction sent by the control terminal through the data channel, where the playback instruction carries target content information; a data query unit, and a data transmission unit configured to send the monitoring data to the control terminal through the audio and video stream transmission channel.
- a storage medium has a computer program stored thereon.
- the computer program is executed by a processor of a computer, the computer is caused to execute the method described in the embodiment of the present application.
- an electronic device may include: a memory storing a computer program; and a processor reading the computer program stored in the memory to execute the method described in the embodiment of the present application.
- a communication establishment message is sent to the monitoring device to establish an audio and video stream transmission channel and a data channel for point-to-point communication with the monitoring device; monitoring data transmitted by the monitoring device is received through the audio and video stream transmission channel. , and play the monitoring content based on the monitoring data; control the transmission of the monitoring data by the monitoring device through the data channel to control the playback status of the monitoring content.
- the transmission and playback control of monitoring data are carried out respectively, so that the control terminal can achieve effective playback control of the monitoring data in the monitoring terminal in a point-to-point manner.
- the playback control process is low-cost and highly controllable, effectively improving the reliability of monitoring playback.
- Figure 1 shows a schematic diagram of a system to which embodiments of the present application can be applied.
- Figure 2 shows a flow chart of a monitoring playback control method according to an embodiment of the present application.
- Figure 3 schematically shows a flow chart of a monitoring playback control method according to another embodiment of the present application.
- Figure 4 shows a block diagram of a monitoring playback control device according to an embodiment of the present application.
- Figure 5 shows a block diagram of a monitoring playback control device according to another embodiment of the present application.
- Figure 6 shows a block diagram of an electronic device according to one embodiment of the present application.
- FIG. 1 shows a schematic diagram of a system 100 to which embodiments of the present application can be applied.
- the system 100 may include a control terminal 101 and a monitoring device 102.
- the control terminal 101 can be any computer device, such as a computer, a mobile phone, a smart watch, a home appliance, etc.
- the monitoring device 102 can be any device with monitoring data collection capabilities, such as a camera and a device equipped with a camera.
- control terminal 101 can: send a communication establishment message to a monitoring device to establish an audio and video stream transmission channel and a data channel for point-to-point communication with the monitoring device; receive data through the audio and video stream transmission channel The monitoring device transmits the monitoring data and plays the monitoring content based on the monitoring data; the monitoring device controls the transmission of the monitoring data through the data channel to control the playback status of the monitoring content.
- the monitoring terminal 102 can: receive a communication establishment message sent by the control terminal; establish an audio and video stream transmission channel and a data channel for point-to-point communication with the control terminal device according to the communication establishment message;
- the audio and video stream transmission channel transmits monitoring data to the control terminal, and the control terminal plays monitoring content based on the monitoring data; in response to the playback control instruction transmitted by the control terminal through the data channel, the monitoring data is Transmission control is performed to control the playback status of the monitored content.
- FIG. 2 schematically shows a flow chart of a monitoring playback control method according to an embodiment of the present application.
- the execution subject of the monitoring playback control method may be any device, such as the control terminal 101 shown in FIG. 1 .
- the monitoring playback control method may include steps S210 to S230.
- Step S210 Send a communication establishment message to the monitoring device to establish an audio and video stream transmission channel and data channel for point-to-point communication with the monitoring device;
- Step S220 Receive monitoring data transmitted by the monitoring device through the audio and video stream transmission channel , and play the monitoring content based on the monitoring data;
- step S230 control the transmission of the monitoring data by the monitoring device through the data channel to control the playback status of the monitoring content.
- the communication establishment message is a message used to inform the monitoring equipment to establish point-to-point communication.
- the audio and video stream transmission channel and data channel for point-to-point communication are established between the control terminal and the monitoring equipment. It is dedicated to monitoring equipment and control terminals.
- the monitoring equipment can transmit monitoring data to the monitoring equipment through the audio and video streaming transmission channel.
- the monitoring data is the monitored audio and video data.
- the control terminal receives high monitoring data through the audio and video streaming transmission channel and monitors content (such as video content) based on the monitoring data in real time. ) playback playback.
- control terminal When the control terminal plays the monitoring content in real time, it can control the transmission of the monitoring video by the monitoring device through the data channel to control the playback status of the monitoring content played on the control terminal in real time.
- the playback status is such as pause, double-speed playback, etc.
- steps S210 to S230 by establishing an audio and video stream transmission channel and a data channel for point-to-point communication, the transmission and playback control of monitoring data are respectively performed, so that the control terminal can control the monitoring terminal in a point-to-point manner.
- Monitoring data enables effective playback control.
- the playback control process is low-cost and highly controllable, effectively improving the reliability of monitoring playback.
- step S210 a communication establishment message is sent to the monitoring device to establish an audio and video stream transmission channel and a data channel for point-to-point communication with the monitoring device.
- step S210 is to send a communication establishment message to the monitoring device to establish an audio and video stream transmission channel and data channel for point-to-point communication with the monitoring device, including:
- the communication establishment message establishes a peer channel endpoint, and the audio and video stream transmission channel and data channel for point-to-point communication are formed between the local channel endpoint and the peer channel endpoint.
- the control terminal can send communication establishment messages to the monitoring device through the web page instant messaging protocol.
- the communication establishment message can carry the terminal data of the control terminal and the connection information required to connect to the control terminal.
- the connection information can include at least one type. Each connection information can include an IP address and a port.
- the communication establishment message is also formed by ICE candidates.
- the offer package and communication establishment message can be sent to the monitoring device through the signaling session (SDP, Session Description Protocol).
- SDP Session Description Protocol
- the control terminal Before sending a communication establishment message to the monitoring device, the control terminal can obtain the network address of the monitoring device through the hole punching server (STUN server), and send a communication establishment message to the monitoring device based on the network address.
- STUN server hole punching server
- the monitoring device can respond to the communication establishment message sent by the control terminal and send a response message to the control terminal.
- the response message can also carry the terminal data of the monitoring device and the connection information required to connect to the monitoring device.
- the connection information can include at least 1 Each connection information can include IP address and port.
- the response message is also an offer packet formed by ICE candidates.
- the response message can be sent to the control terminal through the signaling session (SDP, Session Description Protocol).
- SDP Session Description Protocol
- the monitoring device Before sending a response message to the control terminal, the monitoring device can obtain the network address of the control terminal through the hole punching server (STUN server) or the forwarding server (TURN server), and send a response message to the control terminal based on the network address.
- STUN server hole punching server
- TURN server forwarding server
- control terminal selects the target connection information according to the response message
- monitoring device selects the target connection information according to the communication establishment message, and establishes the peer channel endpoint and the local channel endpoint, and the peer channel endpoint and the local channel endpoint respectively.
- the audio and video stream transmission channel and data channel are formed for point-to-point communication.
- a point-to-point communication mechanism between the control terminal and the monitoring device can be established reliably and at low cost based on the web page instant messaging protocol to perform monitoring playback control.
- step S210 is to send a communication establishment message to the monitoring device to establish an audio and video stream transmission channel and a data channel for point-to-point communication with the monitoring device, including: sending a communication establishment message to the monitoring device based on a customized private protocol. message to establish an audio and video streaming channel and data channel for point-to-point communication with the monitoring device. This is more expensive but can also achieve point-to-point monitoring and playback control based on a customized private protocol.
- step S220 the monitoring data transmitted by the monitoring device is received through the audio and video streaming transmission channel, and the monitoring content is played based on the monitoring data.
- step S220 receiving monitoring data transmitted by the monitoring device through the audio and video stream transmission channel, includes:
- the target content information such as the monitoring time period and other information describing the characteristics of the monitoring data.
- the control terminal After proposing a point-to-point audio and video streaming transmission channel, the control terminal sends playback instructions to the monitoring equipment through the data channel, and can actively control the monitoring equipment to transmit the required monitoring data through the audio and video streaming transmission channel. Among them, the monitoring content corresponding to the monitoring data is played, such as dynamic audio and video pictures.
- step S220 receiving the monitoring data transmitted by the monitoring device through the audio and video stream transmission channel, includes: receiving the monitoring data transmitted by the monitoring device through the audio and video stream transmission channel, the Monitoring data is monitoring display data.
- the monitoring device After the monitoring device establishes a channel with the control terminal, it can automatically send monitoring display data to the control terminal.
- Monitoring display data such as a frame of monitoring data, can actively transmit its monitoring display data to the control terminal for recent or abnormal monitoring content.
- the control terminal can play monitoring content such as posters for display based on the monitoring display data.
- step S230 the transmission of the monitoring data by the monitoring device is controlled through the data channel to control the playback status of the monitoring content.
- step S230 controlling the transmission of the monitoring data by the monitoring device through the data channel to control the playback status of the monitoring content, includes:
- a playback control instruction is generated; the playback control instruction is sent to the monitoring device through the data channel, and the playback control instruction is used to control the monitoring device to adjust the transmission of the monitoring data, To control the playback status of the monitored content.
- Playback control operations are user operations on the control terminal. Each control operation can trigger the generation of corresponding control instructions.
- the control instructions can include pause/play, double-speed playback, jump and status synchronization, etc.
- the control instructions are sent to the monitoring equipment through the data channel, and the monitoring equipment can adjust the transmission of monitoring data according to the control instructions, and then the playback status of the playback content in the control terminal also changes accordingly.
- the control terminal can play monitoring content such as posters for display based on the monitoring display data.
- the playback control instruction can instruct the monitoring device to transmit the monitoring data corresponding to a selected poster, and control the terminal to further display a real-time dynamic monitoring screen based on the monitoring data.
- the control terminal plays monitoring content such as dynamic audio and video pictures according to the monitoring data.
- the playback control instruction can instruct the monitoring device to speed up the transmission of the monitoring data, so that the control terminal can further fast-forward the playback of the audio and video pictures.
- step S230 controlling the transmission of the monitoring data by the monitoring device through the data channel to control the playback status of the monitoring content, includes: controlling the terminal to unfreeze or freeze the data channel, To trigger the transmission control operation when the monitoring device performs thawing or freezing processing, and thereby control the playback status of the monitored content, strong control of monitoring playback can be achieved in some abnormal scenarios.
- FIG. 3 schematically shows a flow chart of a monitoring playback control method according to an embodiment of the present application.
- the execution subject of the monitoring playback control method may be any device, such as the monitoring device 102 shown in FIG. 1 .
- the meanings of each noun in the embodiment corresponding to Figure 3 are the same as those in the above-mentioned monitoring playback control method corresponding to the embodiment shown in Figure 2. Specific implementation details can be described in the reference method embodiment shown in Figure 2.
- the monitoring playback control method may include steps S310 to S340.
- Step S310 Receive the communication establishment message sent by the control terminal;
- Step S320 Establish an audio and video stream transmission channel and a data channel for point-to-point communication with the control terminal device according to the communication establishment message;
- Step S330 Use the audio and video stream transmission The channel transmits monitoring data to the control terminal, and the control terminal plays monitoring content based on the monitoring data;
- step S340 in response to the playback control instruction transmitted by the control terminal through the data channel, transmit the monitoring data Control to control the playback status of the monitored content.
- the communication establishment message is a message used to inform the monitoring equipment to establish point-to-point communication.
- the audio and video stream transmission channel and data channel for point-to-point communication are established between the control terminal and the monitoring equipment. It is dedicated to monitoring equipment and control terminals.
- the monitoring equipment can transmit monitoring data to the monitoring equipment through the audio and video streaming transmission channel.
- the monitoring data is the monitored audio and video data.
- the control terminal receives high monitoring data through the audio and video streaming transmission channel and monitors content (such as video content) based on the monitoring data in real time. ) playback playback.
- control terminal When the control terminal plays the monitoring content in real time, it can control the transmission of the monitoring video by the monitoring device through the data channel to control the playback status of the monitoring content played on the control terminal in real time.
- the playback status is such as pause, double-speed playback, etc.
- steps S310 to S340 by establishing an audio and video stream transmission channel and a data channel for point-to-point communication, the transmission and playback control of monitoring data are respectively performed, so that the control terminal can control the monitoring terminal in a point-to-point manner.
- Monitoring data enables effective playback control.
- the playback control process is low-cost and highly controllable, effectively improving the reliability of monitoring playback.
- step S330 transmitting monitoring data to the control terminal through the audio and video stream transmission channel, includes: receiving a playback instruction sent by the control terminal through the data channel, where the playback instruction carries target content. information; determine monitoring data corresponding to the target content information from locally pre-collected monitoring data; and send the monitoring data to the control terminal through the audio and video stream transmission channel.
- the target content information such as the monitoring time period and other information describing the characteristics of the monitoring data.
- the control terminal After proposing a point-to-point audio and video streaming transmission channel, the control terminal sends playback instructions to the monitoring equipment through the data channel, and can actively control the monitoring equipment to transmit the required monitoring data through the audio and video streaming transmission channel. Among them, the monitoring content corresponding to the monitoring data is played, such as dynamic audio and video pictures.
- step S320 establishing an audio and video stream transmission channel and a data channel for point-to-point communication with the control terminal device according to the communication establishment message, includes:
- the control terminal can send communication establishment messages to the monitoring device through the web page instant messaging protocol.
- the communication establishment message can carry the terminal data of the control terminal and the connection information required to connect to the control terminal.
- the connection information can include at least one type. Each connection information can include an IP address and a port.
- the communication establishment message is also formed by ICE candidates.
- the offer package and communication establishment message can be sent to the monitoring device through the signaling session (SDP, Session Description Protocol).
- SDP Session Description Protocol
- the control terminal Before sending a communication establishment message to the monitoring device, the control terminal can obtain the network address of the monitoring device through the hole punching server (STUN server), and send a communication establishment message to the monitoring device based on the network address.
- STUN server hole punching server
- the monitoring device can respond to the communication establishment message sent by the control terminal and send a response message to the control terminal.
- the response message can also carry the terminal data of the monitoring device and the connection information required to connect to the monitoring device.
- the connection information can include at least 1 Each connection information can include IP address and port.
- the response message is also an offer packet formed by ICE candidates.
- the response message can be sent to the control terminal through the signaling session (SDP, Session Description Protocol).
- SDP Session Description Protocol
- the monitoring device Before sending a response message to the control terminal, the monitoring device can obtain the network address of the control terminal through the hole punching server (STUN server) or the forwarding server (TURN server), and send a response message to the control terminal based on the network address.
- STUN server hole punching server
- TURN server forwarding server
- control terminal selects the target connection information according to the response message
- monitoring device selects the target connection information according to the communication establishment message, and establishes the peer channel endpoint and the local channel endpoint, and the peer channel endpoint and the local channel endpoint respectively.
- the audio and video stream transmission channel and data channel are formed for point-to-point communication.
- a point-to-point communication mechanism between the control terminal and the monitoring device can be established reliably and at low cost based on the web page instant messaging protocol to perform monitoring playback control.
- step S320 establishing an audio and video stream transmission channel and a data channel for point-to-point communication with the control terminal device according to the communication establishment message, includes: sending a response message to the control terminal based on a customized private protocol, so The control terminal sends a communication establishment message according to the private protocol to establish an audio and video stream transmission channel and a data channel for point-to-point communication with the monitoring device. This is more expensive but can also achieve point-to-point monitoring and playback control based on a customized private protocol.
- the embodiment of the present application also provides a monitoring playback control device based on the above-mentioned monitoring playback control method.
- the meanings of the nouns are the same as in the above-mentioned monitoring playback control method.
- Figure 4 shows a block diagram of a monitoring playback control device according to an embodiment of the present application.
- the monitoring playback control device 400 can be applied to a control terminal, and the monitoring playback control device 400 can include a creation module 410 , a playback module 420 and a control module 430 .
- the establishment module 410 can be used to send a communication establishment message to the monitoring device to establish an audio and video stream transmission channel and a data channel for point-to-point communication with the monitoring device; the playback module 420 can be used to receive the audio and video stream transmission channel through the audio and video stream transmission channel. Monitor the monitoring data transmitted by the monitoring device, and play the monitoring content based on the monitoring data; the control module 430 can be used to control the transmission of the monitoring data by the monitoring device through the data channel to control the playback status of the monitoring content .
- control module includes: an instruction generation unit, configured to generate a playback control instruction in response to a playback control operation; and an instruction sending unit, configured to send a playback control instruction to the monitoring device through the data channel.
- the playback control instruction is used to control the monitoring device to adjust the transmission of the monitoring data to control the playback status of the monitoring content.
- the playback module includes: a playback triggering unit for sending playback instructions to the monitoring device through the data channel, where the playback instructions carry target content information; a data playback unit for In receiving the monitoring data transmitted by the monitoring device through the audio and video streaming channel, the monitoring data corresponds to the target content information in the playback instruction.
- the establishment module includes: a message sending unit, used to send the communication establishment message to the monitoring device through a web page instant messaging protocol; a message receiving unit, used to receive the monitoring device a response message sent by the device through the web page instant messaging protocol; an endpoint establishment unit, configured to establish a local channel endpoint based on the response message; the monitoring device establishes a peer channel endpoint based on the communication establishment message; the local channel endpoint
- the audio and video stream transmission channel and data channel form point-to-point communication with the peer channel endpoint.
- Figure 5 shows a block diagram of a monitoring playback control device according to an embodiment of the present application.
- the monitoring playback control device 500 can be applied to monitoring equipment.
- the monitoring playback control device 500 can include a receiving module 510 , a connection module 520 , a transmission module 530 and a response module 540 .
- the receiving module is used to receive the communication establishment message sent by the control terminal; the connection module is used to establish the audio and video stream transmission channel and data channel of point-to-point communication with the control terminal device according to the communication establishment message; the transmission module is used to pass The audio and video stream transmission channel transmits monitoring data to the control terminal, and the control terminal plays monitoring content based on the monitoring data; a response module is used to respond to the playback control instructions transmitted by the control terminal through the data channel. , perform transmission control on the monitoring data to control the playback status of the monitoring content.
- the transmission module includes: an instruction receiving unit, configured to receive a playback instruction sent by the control terminal through the data channel, where the playback instruction carries target content information; a data query unit, and a data transmission unit configured to send the monitoring data to the control terminal through the audio and video stream transmission channel.
- embodiments of the present application also provide an electronic device, which may be a terminal or a server, as shown in Figure 6 , which shows a schematic structural diagram of the electronic device involved in the embodiment of the present application. Specifically:
- the electronic device may include components such as a processor 601 of one or more processing cores, a memory 602 of one or more computer-readable storage media, a power supply 603, and an input unit 604.
- a processor 601 of one or more processing cores a memory 602 of one or more computer-readable storage media
- a power supply 603 a power supply 603
- FIG. 6 does not constitute a limitation of the electronic device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange different components. in:
- the processor 601 is the control center of the electronic device, using various interfaces and lines to connect various parts of the entire computer device, by running or executing software programs and/or modules stored in the memory 602, and calling programs stored in the memory 602. Data, perform various functions of computer equipment and process data to provide overall monitoring of electronic equipment.
- the processor 601 may include one or more processing cores; preferably, the processor 601 may integrate an application processor and a modem processor, where the application processor mainly processes operating systems, user pages, application programs, etc. , the modem processor mainly handles wireless communications. It can be understood that the above modem processor may not be integrated into the processor 601.
- the memory 602 can be used to store software programs and modules.
- the processor 601 executes various functional applications and data processing by running the software programs and modules stored in the memory 602 .
- the memory 602 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the storage data area may store a program based on Data created by the use of computer equipment, etc.
- memory 602 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 602 may also include a memory controller to provide the processor 601 with access to the memory 602 .
- the electronic device also includes a power supply 603 that supplies power to various components.
- the power supply 603 can be logically connected to the processor 601 through a power management system, so that functions such as charging, discharging, and power consumption management can be implemented through the power management system.
- the power supply 603 may also include one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, power status indicators, and other arbitrary components.
- the electronic device may also include an input unit 604 that may be used to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.
- an input unit 604 may be used to receive input numeric or character information and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.
- the electronic device may also include a display unit and the like, which will not be described again here.
- the processor 601 in the electronic device will load the executable files corresponding to the processes of one or more computer programs into the memory 602 according to the following instructions, and the processor 601 will run the executable files stored in the computer program.
- the computer program in the memory 602 can realize various functions in the aforementioned embodiments of the present application.
- the processor 601 can perform the following steps:
- the processor 601 when controlling the transmission of the monitoring data by the monitoring device through the data channel to control the playback status of the monitored content, the processor 601 may execute: in response to playback control Operation, generate a playback control instruction; send the playback control instruction to the monitoring device through the data channel, the playback control instruction is used to control the monitoring device to adjust the transmission of the monitoring data to control the Monitor the playback status of content.
- the processor 601 when receiving the monitoring data transmitted by the monitoring device through the audio and video stream transmission channel, can execute: sending a playback instruction to the monitoring device through the data channel, The play instruction carries target content information; the monitoring data transmitted by the monitoring device through the audio and video stream channel is received, and the monitoring data corresponds to the target content information in the play instruction.
- the processor 601 when sending a communication establishment message to a monitoring device to establish an audio and video stream transmission channel and a data channel for point-to-point communication with the monitoring device, the processor 601 can execute: instant messaging protocol via web page , sending the communication establishment message to the monitoring device; receiving a response message sent by the monitoring device through the web page instant messaging protocol; establishing a local channel endpoint according to the response message, and the monitoring device based on the communication establishment message A peer channel endpoint is established, and the audio and video stream transmission channel and data channel for point-to-point communication are formed between the local channel endpoint and the peer channel endpoint.
- the processor 601 can perform the following steps: receive a communication establishment message sent by the control terminal; establish an audio and video stream transmission channel and a data channel for point-to-point communication with the control terminal device according to the communication establishment message; use the audio and video stream
- the transmission channel transmits monitoring data to the control terminal, and the control terminal plays monitoring content based on the monitoring data; in response to the playback control instructions transmitted by the control terminal through the data channel, the monitoring data is transmitted and controlled, To control the playback status of the monitored content.
- the processor 601 when transmitting monitoring data to the control terminal through the audio and video stream transmission channel, can execute: receiving a playback instruction sent by the control terminal through the data channel, The play instruction carries target content information; the monitoring data corresponding to the target content information is determined from locally pre-collected monitoring data; and the monitoring data is sent to the control terminal through the audio and video stream transmission channel.
- embodiments of the present application also provide a storage medium in which a computer program is stored, and the computer program can be loaded by the processor to execute steps in any method provided by the embodiments of the present application.
- the storage medium may include: read-only memory (ROM, Read Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disk, etc.
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
本申请公开了一种监控回放控制方法、装置、存储介质及电子设备，涉及物联网技术领域，所述方法包括：与监控设备建立音视频流传输通道和数据通道；通过音视频流传输通道接收监控设备传输的监控数据，并播放监控内容；通过数据通道控制监控数据的传输。本申请可以实现低成本及高可控性的监控回放控制，提升监控回放的可靠性。
Description
本申请涉及物联网技术领域，具体涉及一种监控回放控制方法、装置、存储介质及电子设备。
目前监控设备普遍支持将录制的监控数据存储于本地，对于存储在监控设备本地的监控的回放，一般是先通过基于相关的推流协议将视频推至云端，再由控制终端从云端拉流播放。
目前上传至云端然后拉流回放的方式，回放实现的流程较长容易受到网络的影响，使得回放可控性较差，进而导致监控回放的整体可靠性较差。
本申请实施例提供一种方案，可以实现低成本及高可控性的监控回放控制，提升监控回放的可靠性。
为解决上述技术问题，本申请实施例提供以下技术方案：
根据本申请的一个实施例，一种监控回放控制方法，所述方法包括：向监控设备发送通信建立消息，以与所述监控设备建立点对点通信的音视频流传输通道和数据通道；通过所述音视频流传输通道接收所述监控设备传输的监控数据，并基于所述监控数据播放监控内容；通过所述数据通道控制所述监控设备对所述监控数据的传输，以控制所述监控内容的播放状态。
根据本申请的一个实施例，一种监控回放控制装置，所述装置包括：建立模块，用于向监控设备发送通信建立消息，以与所述监控设备建立点对点通信的音视频流传输通道和数据通道；回放模块，用于通过所述音视频流传输通道接收所述监控设备传输的监控数据，并基于所述监控数据播放监控内容；控制模块，用于通过所述数据通道控制所述监控设备对所述监控数据的传输，以控制所述监控内容的播放状态。
在本申请的一些实施例中，所述控制模块，包括：指令生成单元，用于响应于播放控制操作，生成播放控制指令；指令发送单元，用于通过所述数据通道向所述监控设备发送所述播放控制指令，所述播放控制指令用于控制所述监控设备对所述监控数据的传输进行调整，以控制所述监控内容的播放状态。
在本申请的一些实施例中，所述回放模块，包括：播放触发单元，用于通过所述数据通道向所述监控设备发送播放指令，所述播放指令携带目标内容信息；数据回放单元，用于接收所述监控设备通过所述音视频流通道传输的所述监控数据，所述监控数据与所述播放指令中的所述目标内容信息对应。
在本申请的一些实施例中，所述建立模块，包括：消息发送单元，用于通过网页即时通信协议，向所述监控设备发送所述通信建立消息；消息接收单元，用于接收所述监控设备通过所述网页即时通信协议发送的响应消息；端点建立单元，用于根据所述响应消息建立本地通道端点，所述监控设备根据所述通信建立消息建立对端通道端点，所述本地通道端点与所述对端通道端点之间形成点对点通信的所述音视频流传输通道和数据通道。
根据本申请的一个实施例，一种监控回放控制方法，所述方法包括：接收控制终端发送的通信建立消息；根据所述通信建立消息与所述控制终端设备建立点对点通信的音视频流传输通道和数据通道；通过所述音视频流传输通道向所述控制终端传输监控数据，所述控制终端基于所述监控数据播放监控内容；响应于所述控制终端通过所述数据通道传输的播放控制指令，对所述监控数据进行传输控制，以控制所述监控内容的播放状态。
根据本申请的一个实施例，一种监控回放控制装置，所述装置包括：接收模块，用于接收控制终端发送的通信建立消息；连接模块，用于根据所述通信建立消息与所述控制终端设备建立点对点通信的音视频流传输通道和数据通道；传输模块，用于通过所述音视频流传输通道向所述控制终端传输监控数据，所述控制终端基于所述监控数据播放监控内容；响应模块，用于响应于所述控制终端通过所述数据通道传输的播放控制指令，对所述监控数据进行传输控制，以控制所述监控内容的播放状态。
在本申请的一些实施例中，所述传输模块，包括：指令接收单元，用于接收所述控制终端通过所述数据通道发送的播放指令，所述播放指令携带目标内容信息；数据查询单元，用于从本地预先采集的监控数据中确定所述目标内容信息对应的监控数据；数据传输单元，用于将所述监控数据通过所述音视频流传输通道发送至所述控制终端。
根据本申请的另一实施例，一种存储介质，其上存储有计算机程序，当所述计算机程序被计算机的处理器执行时，使计算机执行本申请实施例所述的方法。
根据本申请的另一实施例，一种电子设备可以包括：存储器，存储有计算机程序；处理器，读取存储器存储的计算机程序，以执行本申请实施例所述的方法。
本申请实施例中，向监控设备发送通信建立消息，以与所述监控设备建立点对点通信的音视频流传输通道和数据通道；通过所述音视频流传输通道接收所述监控设备传输的监控数据，并基于所述监控数据播放监控内容；通过所述数据通道控制所述监控设备对所述监控数据的传输，以控制所述监控内容的播放状态。
以这种方式，通过建立点对点通信的音视频流传输通道和数据通道，分别来进行监控数据的传输及回放控制，可以使得控制终端通过点对点的方式对监控终端中的监控数据实现有效的回放控制，回放控制过程低成本且可控性极高，有效提升监控回放的可靠性。
为了更清楚地说明本申请实施例中的技术方案，下面将对实施例描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本申请的一些实施例，对于本领域技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1示出了一种可以应用本申请实施例的系统的示意图。
图2示出了根据本申请的一个实施例的监控回放控制方法的流程图。
图3示意性示出了根据本申请的另一个实施例的监控回放控制方法的流程图。
图4示出了根据本申请的一个实施例的监控回放控制装置的框图。
图5示出了根据本申请的另一个实施例的监控回放控制装置的框图。
图6示出了根据本申请的一个实施例的电子设备的框图。
下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本申请保护的范围。
图1示出了一种可以应用本申请实施例的系统100的示意图。如图1所示，系统100可以包括控制终端101及监控设备102。控制终端101可以是任意的计算机设备，例如电脑、手机、智能手表以及家电设备等。监控设备102可以是任意具有监控数据采集能力的设备，例如摄像头以及安装有摄像头的设备等。
本示例的一种实施方式中，控制终端101可以：向监控设备发送通信建立消息，以与所述监控设备建立点对点通信的音视频流传输通道和数据通道；通过所述音视频流传输通道接收所述监控设备传输的监控数据，并基于所述监控数据播放监控内容；通过所述数据通道控制所述监控设备对所述监控数据的传输，以控制所述监控内容的播放状态。
本示例的一种实施方式中，监控终端102可以：接收控制终端发送的通信建立消息；根据所述通信建立消息与所述控制终端设备建立点对点通信的音视频流传输通道和数据通道；通过所述音视频流传输通道向所述控制终端传输监控数据，所述控制终端基于所述监控数据播放监控内容；响应于所述控制终端通过所述数据通道传输的播放控制指令，对所述监控数据进行传输控制，以控制所述监控内容的播放状态。
图2示意性示出了根据本申请的一个实施例的监控回放控制方法的流程图。该监控回放控制方法的执行主体可以是任意的设备，例如图1所示的控制终端101。
如图2所示，该监控回放控制方法可以包括步骤S210至步骤S230。
步骤S210，向监控设备发送通信建立消息，以与所述监控设备建立点对点通信的音视频流传输通道和数据通道；步骤S220，通过所述音视频流传输通道接收所述监控设备传输的监控数据，并基于所述监控数据播放监控内容；步骤S230，通过所述数据通道控制所述监控设备对所述监控数据的传输，以控制所述监控内容的播放状态。
通信建立消息即用于告知监控设备建立点对点通信的消息，根据通信建立消息控制终端与监控设备之间建立点对点通信的音视频流传输通道和数据通道，专用于监控设备与控制终端。
监控设备可以通过音视频流传输通道向监控设备传输监控数据，监控数据即监控的音视频数据，控制终端通过音视频流传输通道接收高监控数据，并实时基于监控数据进行监控内容（如视频内容）的回放播放。
控制终端在实时播放监控内容时，可以通过数据通道控制监控设备对监控视频的传输，来实时控制在控制终端播放的监控内容的播放状态，其中，播放状态例如暂停、倍速播放等等。
以这种方式，基于步骤S210至步骤S230，通过建立点对点通信的音视频流传输通道和数据通道，分别来进行监控数据的传输及回放控制，可以使得控制终端通过点对点的方式对监控终端中的监控数据实现有效的回放控制，回放控制过程低成本且可控性极高，有效提升监控回放的可靠性。
下面描述进行监控回放控制时，所进行的各步骤的具体过程。
在步骤S210中，向监控设备发送通信建立消息，以与所述监控设备建立点对点通信的音视频流传输通道和数据通道。
一种实施例中，步骤S210，向监控设备发送通信建立消息，以与所述监控设备建立点对点通信的音视频流传输通道和数据通道，包括：
通过网页即时通信协议，向所述监控设备发送所述通信建立消息；接收所述监控设备通过所述网页即时通信协议发送的响应消息；根据所述响应消息建立本地通道端点，所述监控设备根据所述通信建立消息建立对端通道端点，所述本地通道端点与所述对端通道端点之间形成点对点通信的所述音视频流传输通道和数据通道。
网页即时通信协议即WebRTC（Web Real-Time
Communication）协议，控制终端通过网页即时通信协议可以向监控设备发送通信建立消息。通信建立消息中可以携带控制终端的终端数据及连接至控制终端所需的连接信息，连接信息可以包括至少1种，每个连接信息可以包括IP地址及端口，该通信建立消息也即ICE candidates形成的offer包，通信建立消息可以通过信令会话（SDP，Session Description Protocol）发送至监控设备。向监控设备发送通信建立消息之前控制终端可以通过打洞服务器（STUN服务器）获得监控设备的网络地址，根据该网络地址向监控设备发送通信建立消息。
监控设备接收到控制终端发送的通信建立消息可以进行响应，向控制终端发送响应消息，响应消息中也可以携带监控设备的终端数据及连接至监控设备所需的连接信息，连接信息可以包括至少1种，每个连接信息可以包括IP地址及端口，该响应消息也即ICE candidates形成的offer包，响应消息可以通过信令会话（SDP，Session Description Protocol）发送至控制终端。向控制终端发送响应消息之前监控设备可以通过打洞服务器（STUN服务器）或转发服务器（TURN服务器）获得控制终端的网络地址，根据该网络地址向控制终端发送响应消息。
然后，控制终端根据响应消息，监控设备根据通信建立消息，两端进行协商（ICE协商）选定目标连接信息，分别建立对端通道端点与本地通道端点，对端通道端点与本地通道端点之间形成点对点通信的所述音视频流传输通道和数据通道。
以这种方式，基于网页即时通信协议可以可靠且低成本的建立控制终端与监控设备之间的点对点通信机制，来进行监控的回放控制。
一种实施例中，步骤S210，向监控设备发送通信建立消息，以与所述监控设备建立点对点通信的音视频流传输通道和数据通道，包括：基于自定义的私有协议向监控设备发送通信建立消息，以与所述监控设备建立点对点通信的音视频流传输通道和数据通道。这样成本较高但是也可以实现基于自定义的私有协议进行点对点的监控回放控制。
在步骤S220中，通过所述音视频流传输通道接收所述监控设备传输的监控数据，并基于所述监控数据播放监控内容。
一种实施例中，步骤S220，通过所述音视频流传输通道接收所述监控设备传输的监控数据，包括：
通过所述数据通道向所述监控设备发送播放指令，所述播放指令携带目标内容信息；接收所述监控设备通过所述音视频流通道传输的所述监控数据，所述监控数据与所述播放指令中的所述目标内容信息对应。
目标内容信息例如监控时间段等描述监控数据的特征的信息。在建议点对点的音视频流传输通道后，控制终端向监控设备通过数据通道发送播放指令，可以主动控制监控设备通过音视频流传输通道传输需要的监控数据。其中根据监控数据对应播放的监控内容例如动态的音视频画面。
一种实施例中，步骤S220，通过所述音视频流传输通道接收所述监控设备传输的监控数据，包括：接收所述监控设备通过所述音视频流通道传输的所述监控数据，所述监控数据为监控展示数据。
监控设备在于控制终端建立通道后，可以自动向控制终端发送监控展示数据，监控展示数据例如监控数据的一帧，针对最近或有异常的监控内容可以主动传输其监控展示数据至控制终端。控制终端可以根据监控展示数据播放用于展示的海报等监控内容。
在步骤S230中，通过所述数据通道控制所述监控设备对所述监控数据的传输，以控制所述监控内容的播放状态。
一种实施例中，步骤S230，通过所述数据通道控制所述监控设备对所述监控数据的传输，以控制所述监控内容的播放状态，包括：
响应于播放控制操作，生成播放控制指令；通过所述数据通道向所述监控设备发送所述播放控制指令，所述播放控制指令用于控制所述监控设备对所述监控数据的传输进行调整，以控制所述监控内容的播放状态。
播放控制操作即用户在控制终端上的操作，每种控制操作可以触发生成对应的控制指令，控制指令可以包括暂停/播放、倍速播放、跳转和状态同步等。
将控制指令通过数据通道发送至监控设备，监控设备可以根据控制指令对监控数据的传输进行调整，进而，控制终端中的播放内容的播放状态也随即变化。
一个示例中，控制终端可以根据监控展示数据播放用于展示的海报等监控内容。播放控制指令可以指示监控设备传输选定的某个海报对应的监控数据，控制终端中进一步根据监控数据实时动态的监控画面。一个示例中，控制终端根据监控数据对应播放的监控内容例如动态的音视频画面，播放控制指令可以指示监控设备加快传输监控数据，进而控制终端中可以进一步快进播放音视频画面。
一种实施例中，步骤S230，通过所述数据通道控制所述监控设备对所述监控数据的传输，以控制所述监控内容的播放状态，包括：控制终端对数据通道进行解冻或冻结处理，来触发监控设备执行解冻或冻结处理时的传输控制操作，进而控制监控内容的播放状态，可以在一些异常场景下实现监控回放的强控制。
图3示意性示出了根据本申请的一个实施例的监控回放控制方法的流程图。该监控回放控制方法的执行主体可以是任意的设备，例如图1所示的监控设备102。图3对应的实施例中各名词的含义与上述图2所示实施例对应的监控回放控制方法中相同，具体实现细节可以图2所示参考方法实施例中的说明。
如图3所示，该监控回放控制方法可以包括步骤S310至步骤S340。
步骤S310，接收控制终端发送的通信建立消息；步骤S320，根据所述通信建立消息与所述控制终端设备建立点对点通信的音视频流传输通道和数据通道；步骤S330，通过所述音视频流传输通道向所述控制终端传输监控数据，所述控制终端基于所述监控数据播放监控内容；步骤S340，响应于所述控制终端通过所述数据通道传输的播放控制指令，对所述监控数据进行传输控制，以控制所述监控内容的播放状态。
通信建立消息即用于告知监控设备建立点对点通信的消息，根据通信建立消息控制终端与监控设备之间建立点对点通信的音视频流传输通道和数据通道，专用于监控设备与控制终端。
监控设备可以通过音视频流传输通道向监控设备传输监控数据，监控数据即监控的音视频数据，控制终端通过音视频流传输通道接收高监控数据，并实时基于监控数据进行监控内容（如视频内容）的回放播放。
控制终端在实时播放监控内容时，可以通过数据通道控制监控设备对监控视频的传输，来实时控制在控制终端播放的监控内容的播放状态，其中，播放状态例如暂停、倍速播放等等。
以这种方式，基于步骤S310至步骤S340，通过建立点对点通信的音视频流传输通道和数据通道，分别来进行监控数据的传输及回放控制，可以使得控制终端通过点对点的方式对监控终端中的监控数据实现有效的回放控制，回放控制过程低成本且可控性极高，有效提升监控回放的可靠性。
一种实施例中，步骤S330，通过所述音视频流传输通道向所述控制终端传输监控数据，包括：接收所述控制终端通过所述数据通道发送的播放指令，所述播放指令携带目标内容信息；从本地预先采集的监控数据中确定所述目标内容信息对应的监控数据；将所述监控数据通过所述音视频流传输通道发送至所述控制终端。
目标内容信息例如监控时间段等描述监控数据的特征的信息。在建议点对点的音视频流传输通道后，控制终端向监控设备通过数据通道发送播放指令，可以主动控制监控设备通过音视频流传输通道传输需要的监控数据。其中根据监控数据对应播放的监控内容例如动态的音视频画面。
一种实施例中，步骤S320，根据所述通信建立消息与所述控制终端设备建立点对点通信的音视频流传输通道和数据通道，包括：
通过网页即时通信协议向所述控制终端发送响应消息，所述通信建立消息为所述控制终端通过网页即时通信协议发送的；根据所述通信建立消息建立对端通道端点，所述控制终端根据所述响应消息建立本地通道端点，所述本地通道端点与所述对端通道端点之间形成点对点通信的所述音视频流传输通道和数据通道。
网页即时通信协议即WebRTC（Web Real-Time
Communication）协议，控制终端通过网页即时通信协议可以向监控设备发送通信建立消息。通信建立消息中可以携带控制终端的终端数据及连接至控制终端所需的连接信息，连接信息可以包括至少1种，每个连接信息可以包括IP地址及端口，该通信建立消息也即ICE candidates形成的offer包，通信建立消息可以通过信令会话（SDP，Session Description Protocol）发送至监控设备。向监控设备发送通信建立消息之前控制终端可以通过打洞服务器（STUN服务器）获得监控设备的网络地址，根据该网络地址向监控设备发送通信建立消息。
监控设备接收到控制终端发送的通信建立消息可以进行响应，向控制终端发送响应消息，响应消息中也可以携带监控设备的终端数据及连接至监控设备所需的连接信息，连接信息可以包括至少1种，每个连接信息可以包括IP地址及端口，该响应消息也即ICE candidates形成的offer包，响应消息可以通过信令会话（SDP，Session Description Protocol）发送至控制终端。向控制终端发送响应消息之前监控设备可以通过打洞服务器（STUN服务器）或转发服务器（TURN服务器）获得控制终端的网络地址，根据该网络地址向控制终端发送响应消息。
然后，控制终端根据响应消息，监控设备根据通信建立消息，两端进行协商（ICE协商）选定目标连接信息，分别建立对端通道端点与本地通道端点，对端通道端点与本地通道端点之间形成点对点通信的所述音视频流传输通道和数据通道。
以这种方式，基于网页即时通信协议可以可靠且低成本的建立控制终端与监控设备之间的点对点通信机制，来进行监控的回放控制。
一种实施例中，步骤S320，根据所述通信建立消息与所述控制终端设备建立点对点通信的音视频流传输通道和数据通道，包括：基于自定义的私有协议向控制终端发送响应消息，所述控制终端根据所述私有协议发送的通信建立消息，以与所述监控设备建立点对点通信的音视频流传输通道和数据通道。这样成本较高但是也可以实现基于自定义的私有协议进行点对点的监控回放控制。
为便于更好的实施本申请实施例提供的监控回放控制方法，本申请实施例还提供一种基于上述监控回放控制方法的监控回放控制装置。其中名词的含义与上述监控回放控制方法中相同，具体实现细节可以参考方法实施例中的说明。图4示出了根据本申请的一个实施例的监控回放控制装置的框图。
如图4所示，监控回放控制装置400可以应用于控制终端，监控回放控制装置400中可以包括建立模块410、回放模块420以及控制模块430。
建立模块410可以用于向监控设备发送通信建立消息，以与所述监控设备建立点对点通信的音视频流传输通道和数据通道；回放模块420可以用于通过所述音视频流传输通道接收所述监控设备传输的监控数据，并基于所述监控数据播放监控内容；控制模块430可以用于通过所述数据通道控制所述监控设备对所述监控数据的传输，以控制所述监控内容的播放状态。
在本申请的一些实施例中，所述控制模块，包括：指令生成单元，用于响应于播放控制操作，生成播放控制指令；指令发送单元，用于通过所述数据通道向所述监控设备发送所述播放控制指令，所述播放控制指令用于控制所述监控设备对所述监控数据的传输进行调整，以控制所述监控内容的播放状态。
在本申请的一些实施例中，所述回放模块，包括：播放触发单元，用于通过所述数据通道向所述监控设备发送播放指令，所述播放指令携带目标内容信息；数据回放单元，用于接收所述监控设备通过所述音视频流通道传输的所述监控数据，所述监控数据与所述播放指令中的所述目标内容信息对应。
在本申请的一些实施例中，所述建立模块，包括：消息发送单元，用于通过网页即时通信协议，向所述监控设备发送所述通信建立消息；消息接收单元，用于接收所述监控设备通过所述网页即时通信协议发送的响应消息；端点建立单元，用于根据所述响应消息建立本地通道端点，所述监控设备根据所述通信建立消息建立对端通道端点，所述本地通道端点与所述对端通道端点之间形成点对点通信的所述音视频流传输通道和数据通道。
图5示出了根据本申请的一个实施例的监控回放控制装置的框图。
如图5所示，监控回放控制装置500可以应用于监控设备，监控回放控制装置500中可以包括接收模块510、连接模块520、传输模块530以及响应模块540。
接收模块，用于接收控制终端发送的通信建立消息；连接模块，用于根据所述通信建立消息与所述控制终端设备建立点对点通信的音视频流传输通道和数据通道；传输模块，用于通过所述音视频流传输通道向所述控制终端传输监控数据，所述控制终端基于所述监控数据播放监控内容；响应模块，用于响应于所述控制终端通过所述数据通道传输的播放控制指令，对所述监控数据进行传输控制，以控制所述监控内容的播放状态。
在本申请的一些实施例中，所述传输模块，包括：指令接收单元，用于接收所述控制终端通过所述数据通道发送的播放指令，所述播放指令携带目标内容信息；数据查询单元，用于从本地预先采集的监控数据中确定所述目标内容信息对应的监控数据；数据传输单元，用于将所述监控数据通过所述音视频流传输通道发送至所述控制终端。
应当注意，尽管在上文详细描述中提及了用于动作执行的设备的若干模块或者单元，但是这种划分并非强制性的。实际上，根据本申请的实施方式，上文描述的两个或更多模块或者单元的特征和功能可以在一个模块或者单元中具体化。反之，上文描述的一个模块或者单元的特征和功能可以进一步划分为由多个模块或者单元来具体化。
此外，本申请实施例还提供一种电子设备，该电子设备可以为终端或者服务器，如图6所示，其示出了本申请实施例所涉及的电子设备的结构示意图，具体来讲：
该电子设备可以包括一个或者一个以上处理核心的处理器601、一个或一个以上计算机可读存储介质的存储器602、电源603和输入单元604等部件。本领域技术人员可以理解，图6中示出的电子设备结构并不构成对电子设备的限定，可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置。其中：
处理器601是该电子设备的控制中心，利用各种接口和线路连接整个计算机设备的各个部分，通过运行或执行存储在存储器602内的软件程序和/或模块，以及调用存储在存储器602内的数据，执行计算机设备的各种功能和处理数据，从而对电子设备进行整体监控。可选的，处理器601可包括一个或多个处理核心；优选的，处理器601可集成应用处理器和调制解调处理器，其中，应用处理器主要处理操作系统、用户页面和应用程序等，调制解调处理器主要处理无线通讯。可以理解的是，上述调制解调处理器也可以不集成到处理器601中。
存储器602可用于存储软件程序以及模块，处理器601通过运行存储在存储器602的软件程序以及模块，从而执行各种功能应用以及数据处理。存储器602可主要包括存储程序区和存储数据区，其中，存储程序区可存储操作系统、至少一个功能所需的应用程序（比如声音播放功能、图像播放功能等）等；存储数据区可存储根据计算机设备的使用所创建的数据等。此外，存储器602可以包括高速随机存取存储器，还可以包括非易失性存储器，例如至少一个磁盘存储器件、闪存器件、或其他易失性固态存储器件。相应地，存储器602还可以包括存储器控制器，以提供处理器601对存储器602的访问。
电子设备还包括给各个部件供电的电源603，优选的，电源603可以通过电源管理系统与处理器601逻辑相连，从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。电源603还可以包括一个或一个以上的直流或交流电源、再充电系统、电源故障检测电路、电源转换器或者逆变器、电源状态指示器等任意组件。
该电子设备还可包括输入单元604，该输入单元604可用于接收输入的数字或字符信息，以及产生与用户设置以及功能控制有关的键盘、鼠标、操作杆、光学或者轨迹球信号输入。
尽管未示出，电子设备还可以包括显示单元等，在此不再赘述。具体在本实施例中，电子设备中的处理器601会按照如下的指令，将一个或一个以上的计算机程序的进程对应的可执行文件加载到存储器602中，并由处理器601来运行存储在存储器602中的计算机程序，从而实现本申请前述实施例中各种功能，如处理器601可以执行下述步骤：
向监控设备发送通信建立消息，以与所述监控设备建立点对点通信的音视频流传输通道和数据通道；通过所述音视频流传输通道接收所述监控设备传输的监控数据，并基于所述监控数据播放监控内容；通过所述数据通道控制所述监控设备对所述监控数据的传输，以控制所述监控内容的播放状态。
在本申请的一些实施例中，所述通过所述数据通道控制所述监控设备对所述监控数据的传输，以控制所述监控内容的播放状态时，处理器601可以执行：响应于播放控制操作，生成播放控制指令；通过所述数据通道向所述监控设备发送所述播放控制指令，所述播放控制指令用于控制所述监控设备对所述监控数据的传输进行调整，以控制所述监控内容的播放状态。
在本申请的一些实施例中，所述通过所述音视频流传输通道接收所述监控设备传输的监控数据时，处理器601可以执行：通过所述数据通道向所述监控设备发送播放指令，所述播放指令携带目标内容信息；接收所述监控设备通过所述音视频流通道传输的所述监控数据，所述监控数据与所述播放指令中的所述目标内容信息对应。
在本申请的一些实施例中，所述向监控设备发送通信建立消息，以与所述监控设备建立点对点通信的音视频流传输通道和数据通道时，处理器601可以执行：通过网页即时通信协议，向所述监控设备发送所述通信建立消息；接收所述监控设备通过所述网页即时通信协议发送的响应消息；根据所述响应消息建立本地通道端点，所述监控设备根据所述通信建立消息建立对端通道端点，所述本地通道端点与所述对端通道端点之间形成点对点通信的所述音视频流传输通道和数据通道。
如处理器601可以执行下述步骤：接收控制终端发送的通信建立消息；根据所述通信建立消息与所述控制终端设备建立点对点通信的音视频流传输通道和数据通道；通过所述音视频流传输通道向所述控制终端传输监控数据，所述控制终端基于所述监控数据播放监控内容；响应于所述控制终端通过所述数据通道传输的播放控制指令，对所述监控数据进行传输控制，以控制所述监控内容的播放状态。
在本申请的一些实施例中华，所述通过所述音视频流传输通道向所述控制终端传输监控数据时，处理器601可以执行：接收所述控制终端通过所述数据通道发送的播放指令，所述播放指令携带目标内容信息；从本地预先采集的监控数据中确定所述目标内容信息对应的监控数据；将所述监控数据通过所述音视频流传输通道发送至所述控制终端。
本领域普通技术人员可以理解，上述实施例的各种方法中的全部或部分步骤可以通过计算机程序来完成，或通过计算机程序控制相关的硬件来完成，该计算机程序可以存储于一计算机可读存储介质中，并由处理器进行加载和执行。
为此，本申请实施例还提供一种存储介质，其中存储有计算机程序，该计算机程序能够被处理器进行加载，以执行本申请实施例所提供的任一种方法中的步骤。
其中，该存储介质可以包括：只读存储器（ROM，Read
Only Memory）、随机存取记忆体（RAM，Random
Access Memory）、磁盘或光盘等。
由于该存储介质中所存储的计算机程序，可以执行本申请实施例所提供的任一种方法中的步骤，因此，可以实现本申请实施例所提供的方法所能实现的有益效果，详见前面的实施例，在此不再赘述。
本领域技术人员在考虑说明书及实践这里公开的实施方式后，将容易想到本申请的其它实施方案。本申请旨在涵盖本申请的任何变型、用途或者适应性变化，这些变型、用途或者适应性变化遵循本申请的一般性原理并包括本申请未公开的本技术领域中的公知常识或惯用技术手段。
应当理解的是，本申请并不局限于上面已经描述并在附图中示出的实施例，而可以在不脱离其范围的情况下进行各种修改和改变。
Claims (20)
- 一种监控回放控制方法，其中，所述方法包括：向监控设备发送通信建立消息，以与所述监控设备建立点对点通信的音视频流传输通道和数据通道；通过所述音视频流传输通道接收所述监控设备传输的监控数据，并基于所述监控数据播放监控内容；通过所述数据通道控制所述监控设备对所述监控数据的传输，以控制所述监控内容的播放状态。
- 根据权利要求1所述的方法，其中，所述通过所述数据通道控制所述监控设备对所述监控数据的传输，以控制所述监控内容的播放状态，包括：响应于播放控制操作，生成播放控制指令；通过所述数据通道向所述监控设备发送所述播放控制指令，所述播放控制指令用于控制所述监控设备对所述监控数据的传输进行调整，以控制所述监控内容的播放状态。
- 根据权利要求1所述的方法，其中，所述通过所述音视频流传输通道接收所述监控设备传输的监控数据，包括：通过所述数据通道向所述监控设备发送播放指令，所述播放指令携带目标内容信息；接收所述监控设备通过所述音视频流通道传输的所述监控数据，所述监控数据与所述播放指令中的所述目标内容信息对应。
- 根据权利要求1所述的方法，其中，所述向监控设备发送通信建立消息，以与所述监控设备建立点对点通信的音视频流传输通道和数据通道，包括：通过网页即时通信协议，向所述监控设备发送所述通信建立消息；接收所述监控设备通过所述网页即时通信协议发送的响应消息；根据所述响应消息建立本地通道端点，所述监控设备根据所述通信建立消息建立对端通道端点，所述本地通道端点与所述对端通道端点之间形成点对点通信的所述音视频流传输通道和数据通道。
- 根据权利要求1所述的方法，其中，所述向监控设备发送通信建立消息，以与所述监控设备建立点对点通信的音视频流传输通道和数据通道，包括：基于自定义的私有协议向监控设备发送通信建立消息，以与所述监控设备建立点对点通信的音视频流传输通道和数据通道。
- 根据权利要求1所述的方法，其中，所述通过所述音视频流传输通道接收所述监控设备传输的监控数据，包括：接收所述监控设备通过所述音视频流通道传输的所述监控数据，所述监控数据为监控展示数据。
- 根据权利要求1所述的方法，其中，所述通过所述数据通道控制所述监控设备对所述监控数据的传输，以控制所述监控内容的播放状态，包括：对所述数据通道进行解冻或冻结处理，来触发监控设备执行解冻或冻结处理时的传输控制操作，以控制监控内容的播放状态。
- 一种监控回放控制方法，其中，所述方法包括：接收控制终端发送的通信建立消息；根据所述通信建立消息与所述控制终端设备建立点对点通信的音视频流传输通道和数据通道；通过所述音视频流传输通道向所述控制终端传输监控数据，所述控制终端基于所述监控数据播放监控内容；响应于所述控制终端通过所述数据通道传输的播放控制指令，对所述监控数据进行传输控制，以控制所述监控内容的播放状态。
- 根据权利要求8所述的方法，其中，所述通过所述音视频流传输通道向所述控制终端传输监控数据，包括：接收所述控制终端通过所述数据通道发送的播放指令，所述播放指令携带目标内容信息；从本地预先采集的监控数据中确定所述目标内容信息对应的监控数据；将所述监控数据通过所述音视频流传输通道发送至所述控制终端。
- 根据权利要求8所述的方法，其中，所述根据所述通信建立消息与所述控制终端设备建立点对点通信的音视频流传输通道和数据通道，包括：通过网页即时通信协议向所述控制终端发送响应消息，所述通信建立消息为所述控制终端通过网页即时通信协议发送的；根据所述通信建立消息建立对端通道端点，所述控制终端根据所述响应消息建立本地通道端点，所述本地通道端点与所述对端通道端点之间形成点对点通信的所述音视频流传输通道和数据通道。
- 根据权利要求8所述的方法，其中，所述根据所述通信建立消息与所述控制终端设备建立点对点通信的音视频流传输通道和数据通道，包括：基于自定义的私有协议向控制终端发送响应消息，所述控制终端根据所述私有协议发送的通信建立消息，以与所述监控设备建立点对点通信的音视频流传输通道和数据通道。
- 一种监控回放控制装置，其中，所述装置包括：建立模块，用于向监控设备发送通信建立消息，以与所述监控设备建立点对点通信的音视频流传输通道和数据通道；回放模块，用于通过所述音视频流传输通道接收所述监控设备传输的监控数据，并基于所述监控数据播放监控内容；控制模块，用于通过所述数据通道控制所述监控设备对所述监控数据的传输，以控制所述监控内容的播放状态。
- 根据权利要求12所述的装置，其中，所述控制模块，包括：指令生成单元，用于响应于播放控制操作，生成播放控制指令；指令发送单元，用于通过所述数据通道向所述监控设备发送所述播放控制指令，所述播放控制指令用于控制所述监控设备对所述监控数据的传输进行调整，以控制所述监控内容的播放状态。
- 根据权利要求12所述的装置，其中，所述回放模块，包括：播放触发单元，用于通过所述数据通道向所述监控设备发送播放指令，所述播放指令携带目标内容信息；数据回放单元，用于接收所述监控设备通过所述音视频流通道传输的所述监控数据，所述监控数据与所述播放指令中的所述目标内容信息对应。
- 根据权利要求12所述的装置，其中，所述建立模块，包括：消息发送单元，用于通过网页即时通信协议，向所述监控设备发送所述通信建立消息；消息接收单元，用于接收所述监控设备通过所述网页即时通信协议发送的响应消息；端点建立单元，用于根据所述响应消息建立本地通道端点，所述监控设备根据所述通信建立消息建立对端通道端点，所述本地通道端点与所述对端通道端点之间形成点对点通信的所述音视频流传输通道和数据通道。
- 一种监控回放控制装置，其中，所述装置包括：接收模块，用于接收控制终端发送的通信建立消息；连接模块，用于根据所述通信建立消息与所述控制终端设备建立点对点通信的音视频流传输通道和数据通道；传输模块，用于通过所述音视频流传输通道向所述控制终端传输监控数据，所述控制终端基于所述监控数据播放监控内容；响应模块，用于响应于所述控制终端通过所述数据通道传输的播放控制指令，对所述监控数据进行传输控制，以控制所述监控内容的播放状态。
- 根据权利要求16所述的装置，其中，所述传输模块，包括：指令接收单元，用于接收所述控制终端通过所述数据通道发送的播放指令，所述播放指令携带目标内容信息；数据查询单元，用于从本地预先采集的监控数据中确定所述目标内容信息对应的监控数据；数据传输单元，用于将所述监控数据通过所述音视频流传输通道发送至所述控制终端。
- 根据权利要求16所述的装置，其中，所述连接模块，用于：通过网页即时通信协议向所述控制终端发送响应消息，所述通信建立消息为所述控制终端通过网页即时通信协议发送的；根据所述通信建立消息建立对端通道端点，所述控制终端根据所述响应消息建立本地通道端点，所述本地通道端点与所述对端通道端点之间形成点对点通信的所述音视频流传输通道和数据通道。
- 一种存储介质，其中，其上存储有计算机程序，当所述计算机程序被计算机的处理器执行时，使计算机执行权利要求1至7任一项所述的方法。
- 一种电子设备，其中，包括：存储器，存储有计算机程序；处理器，读取存储器存储的计算机程序，以执行权利要求1至7任一项所述的方法。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210222222.2 | 2022-03-09 | ||
| CN202210222222.2A CN114710706A (zh) | 2022-03-09 | 2022-03-09 | 监控回放控制方法、装置、存储介质及电子设备 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2023169066A1 true WO2023169066A1 (zh) | 2023-09-14 |
Family
ID=82169350
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2022/144333 WO2023169066A1 (zh) | 2022-03-09 | 2022-12-30 | 监控回放控制方法、装置、存储介质及电子设备 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN114710706A (zh) |
| WO (1) | WO2023169066A1 (zh) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114710706A (zh) * | 2022-03-09 | 2022-07-05 | 深圳Tcl新技术有限公司 | 监控回放控制方法、装置、存储介质及电子设备 |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150039760A1 (en) * | 2013-07-31 | 2015-02-05 | Avaya Inc. | Remotely controlling web real-time communications (webrtc) client functionality via webrtc data channels, and related methods, systems, and computer-readable media |
| CN110535871A (zh) * | 2019-09-09 | 2019-12-03 | 焦点教育科技有限公司 | 一种基于WebRTC的课堂实时视频投影方法及系统 |
| CN110557458A (zh) * | 2019-09-18 | 2019-12-10 | 北京水木畅想网络科技有限公司 | 远程控制娱乐终端的方法、装置及5g自助银行娱乐系统 |
| CN113206888A (zh) * | 2021-05-10 | 2021-08-03 | 创新奇智(上海)科技有限公司 | 基于rtsp的实时视频流传输方法及装置 |
| CN113949698A (zh) * | 2021-10-15 | 2022-01-18 | 深圳安德空间技术有限公司 | 基于Web RTC的探地雷达采集远程控制方法及系统 |
| CN114710706A (zh) * | 2022-03-09 | 2022-07-05 | 深圳Tcl新技术有限公司 | 监控回放控制方法、装置、存储介质及电子设备 |
-
2022
- 2022-03-09 CN CN202210222222.2A patent/CN114710706A/zh active Pending
- 2022-12-30 WO PCT/CN2022/144333 patent/WO2023169066A1/zh unknown
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150039760A1 (en) * | 2013-07-31 | 2015-02-05 | Avaya Inc. | Remotely controlling web real-time communications (webrtc) client functionality via webrtc data channels, and related methods, systems, and computer-readable media |
| CN110535871A (zh) * | 2019-09-09 | 2019-12-03 | 焦点教育科技有限公司 | 一种基于WebRTC的课堂实时视频投影方法及系统 |
| CN110557458A (zh) * | 2019-09-18 | 2019-12-10 | 北京水木畅想网络科技有限公司 | 远程控制娱乐终端的方法、装置及5g自助银行娱乐系统 |
| CN113206888A (zh) * | 2021-05-10 | 2021-08-03 | 创新奇智(上海)科技有限公司 | 基于rtsp的实时视频流传输方法及装置 |
| CN113949698A (zh) * | 2021-10-15 | 2022-01-18 | 深圳安德空间技术有限公司 | 基于Web RTC的探地雷达采集远程控制方法及系统 |
| CN114710706A (zh) * | 2022-03-09 | 2022-07-05 | 深圳Tcl新技术有限公司 | 监控回放控制方法、装置、存储介质及电子设备 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114710706A (zh) | 2022-07-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110266810B (zh) | 基于mqtt协议的消息接收方法、设备及存储介质 | |
| EP2933978B1 (en) | System for managing audiovideo streams using application layer structures in an avbnetwork | |
| CN103166941B (zh) | 一种数据分享的方法及装置 | |
| US8713336B2 (en) | Communication apparatus, power supply control method, display apparatus, communication method, and computer program product | |
| CN110535871B (zh) | 一种基于WebRTC的课堂实时视频投影方法及系统 | |
| KR20140066641A (ko) | 서버, 멀티미디어 기기 및 그들의 제어방법 | |
| WO2020043104A1 (zh) | 视频投屏方法、装置、计算机设备及存储介质 | |
| WO2016197866A1 (zh) | 网络唤醒方法、远程服务器和网络交换设备 | |
| CN108766422A (zh) | 语音设备的响应方法、装置、存储介质及计算机设备 | |
| CN112399190B (zh) | 音视频数据获取方法及其装置 | |
| CN112839238B (zh) | 投屏播放方法、装置和存储介质 | |
| EP3396899A1 (en) | System and method of multi-media conferencing between universal plug and play (upnp) enabled telephony devices and wireless area network (wan) devices | |
| US20220261217A1 (en) | Audio data processing method, server, and storage medium | |
| CN113741762A (zh) | 一种多媒体播放方法、装置、电子设备和存储介质 | |
| CN108712422A (zh) | 一种创建转码任务的方法和装置 | |
| WO2023169066A1 (zh) | 监控回放控制方法、装置、存储介质及电子设备 | |
| WO2009012701A1 (en) | A notification method, apparatus and system of real time streaming protocol event | |
| KR20070024183A (ko) | 데이터 전송 제어 방법 및 상기 방법에 의해 데이터를전송하는 네트워크 장치 | |
| WO2023165320A1 (zh) | 播放参数配置方法及装置 | |
| US20130067083A1 (en) | Transmitting Data Over Multiple Networks | |
| CN115134337A (zh) | 一种多场景下工业互联网设备数据传输控制方法及系统 | |
| CN109086123A (zh) | 应用会话的迁移方法、装置、终端、服务器及存储介质 | |
| CN110620943B (zh) | 基于多媒体接口的控制方法及装置 | |
| CN114025230A (zh) | 一种终端视频播放方法和相关装置 | |
| CN114338830A (zh) | 数据传输方法、装置、计算机可读存储介质及计算机设备 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22930685 Country of ref document: EP Kind code of ref document: A1 |