WO2024109872A1 - 一种视频监控播放方法和系统 - Google Patents
一种视频监控播放方法和系统 Download PDFInfo
- Publication number
- WO2024109872A1 WO2024109872A1 PCT/CN2023/133573 CN2023133573W WO2024109872A1 WO 2024109872 A1 WO2024109872 A1 WO 2024109872A1 CN 2023133573 W CN2023133573 W CN 2023133573W WO 2024109872 A1 WO2024109872 A1 WO 2024109872A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- video
- playback
- client
- streaming media
- media server
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 30
- 230000011664 signaling Effects 0.000 claims abstract description 24
- 230000007246 mechanism Effects 0.000 claims abstract description 10
- 238000012544 monitoring process Methods 0.000 claims description 15
- 230000004044 response Effects 0.000 claims description 7
- 239000000284 extract Substances 0.000 claims description 5
- 230000006835 compression Effects 0.000 abstract description 8
- 238000007906 compression Methods 0.000 abstract description 8
- 101100233916 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) KAR5 gene Proteins 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 101001121408 Homo sapiens L-amino-acid oxidase Proteins 0.000 description 1
- 102100026388 L-amino-acid oxidase Human genes 0.000 description 1
- 101100012902 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) FIG2 gene Proteins 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/20—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding
Definitions
- the present invention relates to the field of database technology, and in particular to a video monitoring and playing method and system.
- the video data before transmitting the video over the network, the video data needs to be encoded and compressed to reduce the network bandwidth occupied by the video data during network transmission.
- the media data is usually distributed and forwarded by the streaming media service.
- the requesting terminal can only decode and display the video data after receiving the I frame data. Therefore, the video data before receiving the I frame is invalid data, so the video screen cannot be displayed during the period from the requesting terminal to receiving the I frame data.
- the present invention provides a video surveillance playback method and system, which are used to improve the real-time display and low-latency playback of video surveillance playback without increasing the I frame frequency and changing the video encoding method.
- the present invention solves the technical problem that the existing video surveillance playback method reduces the time interval without video screen display by increasing the I frame frequency and changing the video encoding method, which not only reduces the efficiency of video encoding compression, but is also not suitable for distributing and forwarding video data through streaming media services.
- a first aspect of the present invention provides a video surveillance playback method, comprising:
- the client In response to the user's video surveillance playback request, the client sends a video surveillance playback request to the video acquisition front end or the streaming media server through SIP signaling, requesting to obtain the video surveillance screen, wherein the video surveillance playback request carries a real-time display priority flag and a delay priority flag;
- the video acquisition front end or streaming media server responds to the video surveillance playback request
- the video capture front-end or streaming media server supports real-time display priority but does not support delay priority, the video stream will be returned to the client starting from the encoded video encoded I frame closest to the requested playback time point, and the number of video frames from the I frame will be fed back to the client through SIP signaling;
- the client decodes and displays the video stream I frame immediately after receiving it.
- the video stream is returned to the client at the maximum rate starting from the video encoding I frame that has been encoded and is closest to the requested playback time point, and the number of video frames from the I frame is fed back to the client through SIP signaling until all the encoded first video data is sent, and then the second video data encoded in real time by the video acquisition front-end or streaming media server is sent at a normal speed;
- the client After receiving the video data, the client extracts the number of video frames from the I frame fed back by the video acquisition front end or the streaming media server to the playback request time point, and starts the fast playback mechanism until the video frames of the received first video data are played at the preset speed, and then returns to the normal playback speed to play the second video data.
- the preset speed is the maximum playback speed supported by the client.
- a second aspect of the present invention provides a video monitoring and playback system, including a client and a video acquisition front end or a streaming media server;
- the client is used to:
- a video surveillance playback request is sent to the video acquisition front end or the streaming media server through SIP signaling to request to obtain the video surveillance screen, wherein the video surveillance playback request carries a real-time display priority flag and a delay priority flag;
- the video acquisition front-end or streaming media server When the video acquisition front-end or streaming media server supports real-time display priority but does not support delay priority, it will immediately decode and display the video stream I frame upon receiving it;
- the video acquisition front-end or the streaming media server supports latency priority and supports latency priority
- the number of video frames from the I frame fed back by the video acquisition front-end or the streaming media server to the playback request time point is extracted, and the fast playback mechanism is started until the video frames of the received first video data are played at the preset speed, and then the normal playback speed is returned to play the second video data;
- the video capture front end or streaming media server is used to:
- the video stream is returned to the client starting from the encoded video encoded I frame closest to the requested playback time point, and the video frames closest to the I frame are returned to the client.
- the data is fed back to the client through SIP signaling;
- the video stream will be returned to the client at the maximum rate starting from the video encoding I frame that has been encoded and is closest to the requested playback time point.
- the number of video frames from the I frame will be fed back to the client through SIP signaling until all the encoded first video data are sent, and then the second video data encoded in real time by the video acquisition front end or streaming media server will be sent at normal speed.
- the preset speed is the maximum playback speed supported by the client.
- the video monitoring playback method provided by the present invention performs SIP signaling negotiation between a client and a video acquisition front end or a streaming media server. After the video acquisition front end or the streaming media server responds to a real-time display priority mark, an I frame is directly sent. When the client receives the I frame, it immediately decodes and displays the picture, thereby improving the real-time display of the picture. The video acquisition front end or the streaming media server responds to a delay priority mark, and the encoded video data is sent at a maximum rate. After the encoded video data is sent, the normal rate is returned to send the real-time encoded video data.
- the client realizes low end-to-end picture delay through a fast playback mechanism, thereby improving the real-time display of the video monitoring playback and the low delay of the playback without increasing the I frame frequency and changing the video encoding method.
- the existing video monitoring playback method solves the technical problem that the existing video monitoring playback method reduces the time interval without video picture display by increasing the I frame frequency and changing the video encoding method, which not only reduces the efficiency of video encoding compression, but is also not suitable for distributing and forwarding video data through a streaming media service method.
- the video surveillance playback system provided by the present invention is used to execute the video surveillance playback method provided by the present invention. Its principle and technical effects are the same as those of the video surveillance playback method provided by the present invention, and will not be described in detail here.
- FIG1 is a schematic flow chart of a video monitoring playback method provided in the present invention.
- Fig. 2 is a schematic diagram of video coding compression principle
- FIG3 is a schematic diagram of the structure of a video monitoring and playback system provided in the present invention.
- FIG. 1 an embodiment of a video surveillance playback method is provided in the present invention, including:
- Step 101 In response to a video surveillance playback request from a user, the client sends a video surveillance playback request to a video acquisition front end or a streaming media server through SIP signaling, requesting to obtain a video surveillance image, wherein the video surveillance playback request carries a real-time display priority flag and a delay priority flag.
- the video surveillance playback request is sent through the client.
- the client responds to the video surveillance playback request by sending the video surveillance playback request to the video acquisition front end or the streaming media server through the extended sip invite signaling, and requests the video acquisition front end or the streaming media server to obtain the video surveillance screen.
- the video surveillance playback request carries a real-time display priority flag and a delay priority flag.
- Step 102 The video acquisition front end or the streaming media server responds to the video monitoring playback request.
- Step 103 If the video acquisition front end or streaming media server supports real-time display priority but does not support delay priority, the video stream is returned to the client starting from the encoded video encoding I frame closest to the requested playback time point, and the number of video frames from the I frame is fed back to the client through SIP signaling.
- Step 104 Upon receiving the I frame of the video stream, the client immediately decodes and displays the video.
- the video sequence images are compressed in the IBBP...BBIBBP manner, where I frames are intra-frame data, B frames and P frames are inter-frame data, and an I frame data and a group of B frame and P frame data are collectively referred to as a group of sequences.
- I frame data the original image can be restored using its own frame information
- B frame and P frame data the I frame in the group of sequences is required as a reference frame.
- the access terminal has randomness and uncertainty when accessing, when the request command arrives, the image sequence is encoded to complete the I frame, and the first display of the video needs to wait for the next I frame to start before it can be decoded and the image screen can be displayed. Therefore, there is a certain screen delay between the video request and the video display, and this delay time depends on the number of intervals between I frame data during video encoding and the number of intervals between the current video screen and the next I frame when the video is opened.
- the video acquisition front end or the streaming media server responds to the video surveillance playback request. If the client prioritizes display in real time but does not support latency priority, it will find the encoded video encoded I frame closest to the requested playback time point from the cache, and then return the video stream to the client starting from the I frame, and calculate the number of video frames sent from the I frame relative to the requested playback time point, and feed back the number of video frames from the I frame to the client through SIP signaling. Since the client receives the video stream as an I frame, it can immediately decode and display the screen.
- Step 105 If the video acquisition front end or the streaming media server supports delay priority and supports delay priority, the video stream is returned to the client at the maximum rate starting from the video encoding I frame that has been encoded and is closest to the requested playback time point, and the number of video frames from the I frame is fed back to the client through SIP signaling until all the encoded first video data are sent, and then the second video data encoded in real time by the video acquisition front end or the streaming media server is sent at a normal speed.
- Step 106 After receiving the video data, the client extracts the number of video frames from the I frame fed back by the video acquisition front end or the streaming media server to the playback request time point, and starts the fast playback mechanism until the video frames of the received first video data are played at the preset speed, and then returns to the normal playback speed to play the second video data.
- the video stream will be returned to the client at the maximum rate starting from the encoded video encoding I frame that is closest to the requested playback time point, and the number of video frames from the I frame will be fed back to the client through SIP signaling until all the encoded first video data are sent, and then the second video data encoded in real time by the video acquisition front end or streaming media server will be sent at normal speed.
- the client After receiving the video data, the client extracts the number of video frames from the I frame fed back by the video acquisition front end or streaming media server to the playback request time point, starts the fast playback mechanism, and preferably plays at the maximum playback speed supported by the client until the video frame of the received first video data is played at the preset speed, and then returns to the normal playback speed to play the second video data, thereby achieving low latency of the end-to-end picture.
- the video monitoring playback method provided by the present invention performs SIP signaling negotiation between the client and the video acquisition front end or the streaming media server. After the video acquisition front end or the streaming media server responds to the real-time display priority mark, the I frame is directly sent. When the client receives the I frame, it immediately decodes and displays the picture, thereby improving the real-time display of the picture. The video acquisition front end or the streaming media server responds to the delay priority mark, and the encoded video data is sent at the maximum rate. After the encoded video data is sent, the normal rate is returned to send the real-time encoded video data.
- the client realizes the low delay of the end-to-end picture through the fast playback mechanism, thereby realizing the improvement of the real-time display of the picture and the low delay of the playback of the video monitoring playback without increasing the I frame frequency and without changing the video encoding method, thereby solving the problem that the existing video monitoring playback method increases the delay priority mark.
- the I frame frequency and the way of changing the video encoding to shorten the time interval without video display not only reduce the efficiency of video encoding compression, but also are not suitable for the technical problem of distributing and forwarding video data through streaming media services.
- a video monitoring and playback system including a client and a video acquisition front end or a streaming media server;
- the client is used to:
- a video surveillance playback request is sent to the video acquisition front end or the streaming media server through SIP signaling to request to obtain the video surveillance screen, wherein the video surveillance playback request carries a real-time display priority flag and a delay priority flag;
- the video acquisition front-end or streaming media server When the video acquisition front-end or streaming media server supports real-time display priority but does not support delay priority, it will immediately decode and display the video stream I frame upon receiving it;
- the video capture front end or streaming media server is used to:
- the video stream is returned to the client starting from the encoded video encoded I frame closest to the requested playback time point, and the number of video frames from the I frame is fed back to the client through SIP signaling;
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
本发明公开一种视频监控播放方法和系统，通过客户端与视频采集前端或流媒体服务端进行sip信令协商，流媒体服务端响应实时显示优先标识后，直接发送I帧，客户端在接收到I帧时立即进行解码和画面显示，通过视频采集前端或流媒体服务端响应时延优先标识，将已编码的视频数据按最大速率发送，在已编码视频数据发送完后再返回正常速率发送实时编码的视频数据，客户端通过快速播放机制降低时延。解决了现有的视频监控播放方法通过增加I帧频率和改变视频编码的方式来缩减无视频画面显示的时间间隔，不但降低了视频编码压缩的效率，也不适合通过流媒体服务方式对视频数据进行分发转发的技术问题。
Description
本发明涉及数据库技术领域，尤其涉及一种视频监控播放方法和系统。
当前视频在进行网络传输前需对视频数据进行编码压缩，以减少视频数据在网络传输对网络带宽的占用，为避免多人同时调用相同视频对网络带宽的占用，通常还采用流媒体服务方式对媒体数据进行分发转发，根据视频编码特性，请求终端仅在接收到I帧数据后，视频数据才能被解码并显示，因此，在接收到I帧前的视频数据均为无效数据，从而在请求终端直到接收到I帧数据期间视频画面无法显示，为缩减无视频画面显示的时间间隔，增加视频画面显示响应速度，通常要求调整视频采集设备视频压缩编码方式，增加I帧在视频编码时的频率，这样会降低视频编码压缩的效率，同时，由于流媒体服务器不能调整视频压缩编码方式，因此，这种方式也不适合通过流媒体服务方式对视频数据进行分发转发。无论是对于视频直播还是视频点播，从用户请求播放视频流到视频画面显示的这一过程占用时间过长，会降低用户体验。因此，如何设计在不增加I帧频率和不改变视频编码方式的情况下，提升视频监控播放的画面显示实时性和播放低时延性的视频播放方法，是本领域技术人员亟待解决的技术问题。
发明内容
本发明提供了一种视频监控播放方法和系统，用于在不增加I帧频率和不改变视频编码方式的情况下，提升视频监控播放的画面显示实时性和播放低时延性，解决了现有的视频监控播放方法通过增加I帧频率和改变视频编码的方式来缩减无视频画面显示的时间间隔，不但降低了视频编码压缩的效率，也不适合通过流媒体服务方式对视频数据进行分发转发的技术问题。
有鉴于此，本发明第一方面提供了一种视频监控播放方法，包括：
客户端响应于用户的视频监控播放请求，通过sip信令向视频采集前端或流媒体服务端发送视频监控播放请求，请求获取视频监控画面，其中，视频监控播放请求携带实时显示优先标识和时延优先标识；
视频采集前端或流媒体服务端对视频监控播放请求作出响应；
若视频采集前端或流媒体服务端支持实时显示优先，但不支持时延优先，则从已编码并距离请求播放时间点最近的视频编码I帧开始向客户端返回视频流，同时将距离I帧的视频帧数通过sip信令反馈给客户端；
客户端在接收到视频流I帧时立即进行解码和画面显示；
若视频采集前端或流媒体服务端支持时延优先，且支持时延优先，则从已编码并距离请求播放时间点最近的视频编码I帧开始采用最大速率向客户端返回视频流，同时将距离I帧的视频帧数通过sip信令反馈给客户端，直到将已编码的第一视频数据全部发送，再按正常速度发送视频采集前端或流媒体服务端实时编码的第二视频数据；
客户端在接收到视频数据后，提取视频采集前端或流媒体服务端反馈的I帧距离播放请求时间点的视频帧数，启动快速播放机制，直到将收到的第一视频数据的视频帧按预置倍速播放完成后，再返回正常播放速度播放第二视频数据。
可选地，预置倍速为客户端支持的最大播放倍速。
本发明第二方面提供了一种视频监控播放系统，包括客户端和视频采集前端或流媒体服务端；
客户端用于：
响应于用户的视频监控播放请求，通过sip信令向视频采集前端或流媒体服务端发送视频监控播放请求，请求获取视频监控画面，其中，视频监控播放请求携带实时显示优先标识和时延优先标识；
当视频采集前端或流媒体服务端支持实时显示优先，但不支持时延优先时，在接收到视频流I帧时立即进行解码和画面显示；
当视频采集前端或流媒体服务端支持时延优先，且支持时延优先时，在接收到视频数据后，提取视频采集前端或流媒体服务端反馈的I帧距离播放请求时间点的视频帧数，启动快速播放机制，直到将收到的第一视频数据的视频帧按预置倍速播放完成后，再返回正常播放速度播放第二视频数据；
视频采集前端或流媒体服务端用于：
对视频监控播放请求作出响应；
若支持实时显示优先，但不支持时延优先，则从已编码并距离请求播放时间点最近的视频编码I帧开始向客户端返回视频流，同时将距离I帧的视频帧
数通过sip信令反馈给客户端；
若支持时延优先，且支持时延优先，则从已编码并距离请求播放时间点最近的视频编码I帧开始采用最大速率向客户端返回视频流，同时将距离I帧的视频帧数通过sip信令反馈给客户端，直到将已编码的第一视频数据全部发送，再按正常速度发送视频采集前端或流媒体服务端实时编码的第二视频数据。
可选地，预置倍速为客户端支持的最大播放倍速。
从以上技术方案可以看出，本发明提供的视频监控播放方法和系统具有以下优点：
本发明提供的视频监控播放方法，通过客户端与视频采集前端或流媒体服务端进行sip信令协商，视频采集前端或流媒体服务端响应实时显示优先标识后，直接发送I帧，客户端在接收到I帧时立即进行解码和画面显示，提升了画面显示实时性，通过视频采集前端或流媒体服务端响应时延优先标识，将已编码的视频数据按最大速率发送，在已编码视频数据发送完后再返回正常速率发送实时编码的视频数据，客户端通过快速播放机制实现端到端画面的低时延，实现了在不增加I帧频率和不改变视频编码方式的情况下，提升视频监控播放的画面显示实时性和播放低时延性，解决了现有的视频监控播放方法通过增加I帧频率和改变视频编码的方式来缩减无视频画面显示的时间间隔，不但降低了视频编码压缩的效率，也不适合通过流媒体服务方式对视频数据进行分发转发的技术问题。
本发明提供的视频监控播放系统，用于执行本发明提供的视频监控播放方法，其原理和所取得的技术效果与本发明提供的视频监控播放方法相同，在此不再赘述。
为了更清楚的说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单的介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他相关的附图。
图1为本发明中提供的一种视频监控播放方法的流程示意图；
图2为视频编码压缩原理图；
图3为本发明中提供的一种视频监控播放系统的结构示意图。
为了使本技术领域的人员更好地理解本发明方案，下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。
为了便于理解，请参阅图1，本发明中提供了一种视频监控播放方法的实施例，包括：
步骤101、客户端响应于用户的视频监控播放请求，通过sip信令向视频采集前端或流媒体服务端发送视频监控播放请求，请求获取视频监控画面，其中，视频监控播放请求携带实时显示优先标识和时延优先标识。
需要说明的是，本发明实施例中，当用户有播放请求时，通过客户端发送视频监控播放请求，客户端在收到用户的视频监控播放请求之后，对视频监控播放请求作出响应，通过扩展的sip invite信令，向视频采集前端或流媒体服务端发送视频监控播放请求，向视频采集前端或流媒体服务端请求获取视频监控画面，视频监控播放请求携带实时显示优先标识和时延优先标识。
步骤102、视频采集前端或流媒体服务端对视频监控播放请求作出响应。
步骤103、若视频采集前端或流媒体服务端支持实时显示优先，但不支持时延优先，则从已编码并距离请求播放时间点最近的视频编码I帧开始向客户端返回视频流，同时将距离I帧的视频帧数通过sip信令反馈给客户端。
步骤104、客户端在接收到视频流I帧时立即进行解码和画面显示。
如图2所示，视频编码时针对视频序列图像按IBBP…BBIBBP方式进行压缩，其中I帧为帧内帧数据、B帧和P帧为帧间帧数据，一个I帧数据和一组B帧P帧数据统称为一组序列，解码I帧数据时利用自有帧信息即可复原原始图像，解码B帧和P帧数据时需该组序列内的I作为参考帧，因为访问终端访问时具有随机和不确定性，当请求命令到达时，图像序列编码以完成I帧，则首次显示视频需等待下一个I帧开始时才可解码、显示出图像画面。因此视频请求到视频显示之间存在一定画面延迟，此延迟时间取决于视频编码时I帧数据间的间隔数量以及执行视频打开时当前视频画面距离下一个I帧间的间隔数量。
本发明实施例中，视频采集前端或流媒体服务端在收到视频监控播放请求之后，对视频监控播放请求作出响应，若视频采集前端或流媒体服务端支持实
时显示优先，但不支持时延优先，则从缓存中找到已编码并距离请求播放时间点最近的视频编码I帧，然后从该I帧开始向客户端返回视频流，同时计算从该I帧开始相对请求播放时间点多发送的视频帧数，将距离I帧的视频帧数通过sip信令反馈给客户端。客户端由于接收到的视频流是I帧，因此可以立即进行解码和画面显示。
步骤105、若视频采集前端或流媒体服务端支持时延优先，且支持时延优先，则从已编码并距离请求播放时间点最近的视频编码I帧开始采用最大速率向客户端返回视频流，同时将距离I帧的视频帧数通过sip信令反馈给客户端，直到将已编码的第一视频数据全部发送，再按正常速度发送视频采集前端或流媒体服务端实时编码的第二视频数据。
步骤106、客户端在接收到视频数据后，提取视频采集前端或流媒体服务端反馈的I帧距离播放请求时间点的视频帧数，启动快速播放机制，直到将收到的第一视频数据的视频帧按预置倍速播放完成后，再返回正常播放速度播放第二视频数据。
需要说明的是，若视频采集前端或流媒体服务端支持时延优先，且支持时延优先，则从已编码并距离请求播放时间点最近的视频编码I帧开始采用最大速率向客户端返回视频流，同时将距离I帧的视频帧数通过sip信令反馈给客户端，直到将已编码的第一视频数据全部发送，再按正常速度发送视频采集前端或流媒体服务端实时编码的第二视频数据。客户端在接收到视频数据后，提取视频采集前端或流媒体服务端反馈的I帧距离播放请求时间点的视频帧数，启动快速播放机制，优选客户端支持的最大播放倍速进行播放，直到将收到的第一视频数据的视频帧按预置倍速播放完成后，再返回正常播放速度播放第二视频数据，实现了端到端画面的低时延。
本发明提供的视频监控播放方法，通过客户端与视频采集前端或流媒体服务端进行sip信令协商，视频采集前端或流媒体服务端响应实时显示优先标识后，直接发送I帧，客户端在接收到I帧时立即进行解码和画面显示，提升了画面显示实时性，通过视频采集前端或流媒体服务端响应时延优先标识，将已编码的视频数据按最大速率发送，在已编码视频数据发送完后再返回正常速率发送实时编码的视频数据，客户端通过快速播放机制实现端到端画面的低时延，实现了在不增加I帧频率和不改变视频编码方式的情况下，提升视频监控播放的画面显示实时性和播放低时延性，解决了现有的视频监控播放方法通过增加
I帧频率和改变视频编码的方式来缩减无视频画面显示的时间间隔，不但降低了视频编码压缩的效率，也不适合通过流媒体服务方式对视频数据进行分发转发的技术问题。
为了便于理解，请参阅图3，本发明中提供了一种视频监控播放系统，包括客户端和视频采集前端或流媒体服务端；
客户端用于：
响应于用户的视频监控播放请求，通过sip信令向视频采集前端或流媒体服务端发送视频监控播放请求，请求获取视频监控画面，其中，视频监控播放请求携带实时显示优先标识和时延优先标识；
当视频采集前端或流媒体服务端支持实时显示优先，但不支持时延优先时，在接收到视频流I帧时立即进行解码和画面显示；
当视频采集前端或流媒体服务端支持时延优先，且支持时延优先时，在接收到视频数据后，提取视频采集前端或流媒体服务端反馈的I帧距离播放请求时间点的视频帧数，启动快速播放机制，直到将收到的第一视频数据的视频帧按预置倍速播放完成后，再返回正常播放速度播放第二视频数据；
视频采集前端或流媒体服务端用于：
对视频监控播放请求作出响应；
若支持实时显示优先，但不支持时延优先，则从已编码并距离请求播放时间点最近的视频编码I帧开始向客户端返回视频流，同时将距离I帧的视频帧数通过sip信令反馈给客户端；
若支持时延优先，且支持时延优先，则从已编码并距离请求播放时间点最近的视频编码I帧开始采用最大速率向客户端返回视频流，同时将距离I帧的视频帧数通过sip信令反馈给客户端，直到将已编码的第一视频数据全部发送，再按正常速度发送视频采集前端或流媒体服务端实时编码的第二视频数据。
预置倍速为客户端支持的最大播放倍速。
以上所述，以上实施例仅用以说明本发明的技术方案，而非对其限制；尽管参照前述实施例对本发明进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围。
Claims (4)
- 一种视频监控播放方法，其特征在于，包括：客户端响应于用户的视频监控播放请求，通过sip信令向视频采集前端或流媒体服务端发送视频监控播放请求，请求获取视频监控画面，其中，视频监控播放请求携带实时显示优先标识和时延优先标识；视频采集前端或流媒体服务端对视频监控播放请求作出响应；若视频采集前端或流媒体服务端支持实时显示优先，但不支持时延优先，则从已编码并距离请求播放时间点最近的视频编码I帧开始向客户端返回视频流，同时将距离I帧的视频帧数通过sip信令反馈给客户端；客户端在接收到视频流I帧时立即进行解码和画面显示；若视频采集前端或流媒体服务端支持时延优先，且支持时延优先，则从已编码并距离请求播放时间点最近的视频编码I帧开始采用最大速率向客户端返回视频流，同时将距离I帧的视频帧数通过sip信令反馈给客户端，直到将已编码的第一视频数据全部发送，再按正常速度发送视频采集前端或流媒体服务端实时编码的第二视频数据；客户端在接收到视频数据后，提取视频采集前端或流媒体服务端反馈的I帧距离播放请求时间点的视频帧数，启动快速播放机制，直到将收到的第一视频数据的视频帧按预置倍速播放完成后，再返回正常播放速度播放第二视频数据。
- 根据权利要求1所述的视频监控播放方法，其特征在于，预置倍速为客户端支持的最大播放倍速。
- 一种视频监控播放系统，其特征在于，包括客户端和视频采集前端或流媒体服务端；客户端用于：响应于用户的视频监控播放请求，通过sip信令向视频采集前端或流媒体服务端发送视频监控播放请求，请求获取视频监控画面，其中，视频监控播放请求携带实时显示优先标识和时延优先标识；当视频采集前端或流媒体服务端支持实时显示优先，但不支持时延优先时，在接收到视频流I帧时立即进行解码和画面显示；当视频采集前端或流媒体服务端支持时延优先，且支持时延优先时，在接 收到视频数据后，提取视频采集前端或流媒体服务端反馈的I帧距离播放请求时间点的视频帧数，启动快速播放机制，直到将收到的第一视频数据的视频帧按预置倍速播放完成后，再返回正常播放速度播放第二视频数据；视频采集前端或流媒体服务端用于：对视频监控播放请求作出响应；若支持实时显示优先，但不支持时延优先，则从已编码并距离请求播放时间点最近的视频编码I帧开始向客户端返回视频流，同时将距离I帧的视频帧数通过sip信令反馈给客户端；若支持时延优先，且支持时延优先，则从已编码并距离请求播放时间点最近的视频编码I帧开始采用最大速率向客户端返回视频流，同时将距离I帧的视频帧数通过sip信令反馈给客户端，直到将已编码的第一视频数据全部发送，再按正常速度发送视频采集前端或流媒体服务端实时编码的第二视频数据。
- 根据权利要求3所述的视频监控播放系统，其特征在于，预置倍速为客户端支持的最大播放倍速。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211490583.1 | 2022-11-25 | ||
| CN202211490583.1A CN116156109A (zh) | 2022-11-25 | 2022-11-25 | 一种视频监控播放方法和系统 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2024109872A1 true WO2024109872A1 (zh) | 2024-05-30 |
Family
ID=86349702
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2023/133573 WO2024109872A1 (zh) | 2022-11-25 | 2023-11-23 | 一种视频监控播放方法和系统 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN116156109A (zh) |
| WO (1) | WO2024109872A1 (zh) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116156109A (zh) * | 2022-11-25 | 2023-05-23 | 天翼数字生活科技有限公司 | 一种视频监控播放方法和系统 |
| CN117880605B (zh) * | 2024-03-12 | 2024-05-14 | 深圳市诚立业科技发展有限公司 | 基于5g技术的短信视频快速播放方法及系统 |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2010031273A1 (zh) * | 2008-09-22 | 2010-03-25 | 华为技术有限公司 | 视频编码 / 解码方法、装置与视频播放方法、装置及系统 |
| US20180192090A1 (en) * | 2017-01-04 | 2018-07-05 | Beijing Baidu Netcom Science And Technology Co., Ltd. | Method of implementing audio and video live broadcast and server |
| CN112422508A (zh) * | 2020-10-19 | 2021-02-26 | 武汉烽火众智数字技术有限责任公司 | 一种在浏览器网页中播放视频的方法及系统 |
| US20220321928A1 (en) * | 2019-09-06 | 2022-10-06 | Joyme Pte. Ltd. | Method and apparatus for displaying video image, electronic device and storage medium |
| CN116156109A (zh) * | 2022-11-25 | 2023-05-23 | 天翼数字生活科技有限公司 | 一种视频监控播放方法和系统 |
-
2022
- 2022-11-25 CN CN202211490583.1A patent/CN116156109A/zh active Pending
-
2023
- 2023-11-23 WO PCT/CN2023/133573 patent/WO2024109872A1/zh unknown
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2010031273A1 (zh) * | 2008-09-22 | 2010-03-25 | 华为技术有限公司 | 视频编码 / 解码方法、装置与视频播放方法、装置及系统 |
| US20180192090A1 (en) * | 2017-01-04 | 2018-07-05 | Beijing Baidu Netcom Science And Technology Co., Ltd. | Method of implementing audio and video live broadcast and server |
| US20220321928A1 (en) * | 2019-09-06 | 2022-10-06 | Joyme Pte. Ltd. | Method and apparatus for displaying video image, electronic device and storage medium |
| CN112422508A (zh) * | 2020-10-19 | 2021-02-26 | 武汉烽火众智数字技术有限责任公司 | 一种在浏览器网页中播放视频的方法及系统 |
| CN116156109A (zh) * | 2022-11-25 | 2023-05-23 | 天翼数字生活科技有限公司 | 一种视频监控播放方法和系统 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116156109A (zh) | 2023-05-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2024109872A1 (zh) | 一种视频监控播放方法和系统 | |
| KR101737325B1 (ko) | 멀티미디어 시스템에서 멀티미디어 서비스의 경험 품질 감소를 줄이는 방법 및 장치 | |
| JP4936751B2 (ja) | 迅速なメディアチャネル切り替え機構、および該機構を含むアクセスネットワークノード | |
| WO2018196790A1 (zh) | 视频播放方法、设备及系统 | |
| CN100551042C (zh) | 利用单个请求协议支持多个视频流服务的接入/边缘节点 | |
| JP5366107B2 (ja) | メディア遅延を低減するための方法、装置およびシステム | |
| WO2010031273A1 (zh) | 视频编码 / 解码方法、装置与视频播放方法、装置及系统 | |
| JP2004080785A (ja) | 迅速なデジタル・チャンネル変更 | |
| JP2002314972A (ja) | 配信システムとその配信方法、及び配信プログラム | |
| WO2009039741A1 (fr) | Procédé et dispositif permettant la commutation de chaînes iptv | |
| CN111726657A (zh) | 直播视频的播放处理方法、装置及服务器 | |
| CN102761773A (zh) | 一种利用i帧改善iptv业务的用户体验的方法 | |
| WO2011153868A1 (zh) | 频道切换方法、装置及系统 | |
| CN110324580B (zh) | 一种基于视联网的监控视频播放方法及装置 | |
| WO2012167558A1 (zh) | 播放媒体文件的方法、终端、服务器和系统 | |
| WO2011000253A1 (zh) | 一种媒体流处理方法及通讯系统以及相关设备 | |
| CN107566918A (zh) | 一种视频分发场景下的低延时取流秒开方法 | |
| CN112752115A (zh) | 直播数据传输方法、装置、设备及介质 | |
| CN113141522B (zh) | 资源传输方法、装置、计算机设备及存储介质 | |
| CN112770122B (zh) | 一种在云导播台视频同步的方法及系统 | |
| CN107801049B (zh) | 一种实时视频传送、播放方法及装置 | |
| CN101489101B (zh) | 一种ip电视频道切换处理方法、装置和系统 | |
| TW200923780A (en) | System and method for remote live pause | |
| KR100848309B1 (ko) | 고속 버퍼링 스위치를 이용한 인터넷 방송 서비스 제공방법 및 그 장치 | |
| WO2011029369A1 (zh) | 一种视频编解码方法、系统及视频监控系统 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23893961 Country of ref document: EP Kind code of ref document: A1 |