WO2023202495A1 - Web端监控视频流低时延处理方法、装置、设备及介质 - Google Patents

Web端监控视频流低时延处理方法、装置、设备及介质 Download PDF

Info

Publication number
WO2023202495A1
WO2023202495A1 PCT/CN2023/088477 CN2023088477W WO2023202495A1 WO 2023202495 A1 WO2023202495 A1 WO 2023202495A1 CN 2023088477 W CN2023088477 W CN 2023088477W WO 2023202495 A1 WO2023202495 A1 WO 2023202495A1
Authority
WO
WIPO (PCT)
Prior art keywords
video stream
video
preset
web
playback speed
Prior art date
Application number
PCT/CN2023/088477
Other languages
English (en)
French (fr)
Inventor
王鹏
余明火
Original Assignee
深圳创维－Rgb电子有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳创维－Rgb电子有限公司 filed Critical 深圳创维－Rgb电子有限公司
Publication of WO2023202495A1 publication Critical patent/WO2023202495A1/zh

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/91—Television signal processing therefor
    • H04N5/93—Regeneration of the television signal or of selected parts thereof
    • H04N5/95—Time-base error compensation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements

Definitions

  • This application relates to the field of network camera display technology, and in particular to a low-latency processing method and device for WEB-side surveillance video streams, mobile terminal equipment and computer-readable storage media.
  • surveillance video stream displayed on the video processing component on the WEB side can be played in real time.
  • the two are limited to a certain extent, It can eliminate the delay of the surveillance video stream to a certain extent, but the preset period of the surveillance video stream is very demanding.
  • the preset period is too large. Directly using the frame skipping mechanism will cause the displayed surveillance video to be missing a large picture.
  • the preset period If the cycle is too small, there will be problems of frequent frame skipping and too fast frame chasing, which will extremely affect the user's viewing effect.
  • the main purpose of this application is to propose a low-latency processing method, device, mobile terminal equipment and computer-readable storage medium for WEB-side surveillance video streams, aiming to solve the existing video delay solutions that are highly restrictive and reduce The efficiency of video delay is low, which in turn affects the user’s viewing experience. technical issues.
  • the low-latency processing method for WEB-side surveillance video streams includes the following steps:
  • the playback mechanism of the video stream unit is adjusted to a frame skipping mechanism through the WEB end;
  • the playback speed of the video stream unit is adjusted through the WEB end, wherein adjusting the playback speed of the video stream unit means The playback mechanism of the video stream unit is adjusted to a frame chasing mechanism.
  • the step before the step of determining the delay of the video stream unit through the WEB side, the step further includes:
  • the WEB end After the WEB end creates a link to the surveillance video stream, it sends a request to receive the initial surveillance video stream to the surveillance video stream end so that the initial surveillance video stream can be imported into the link;
  • the WEB end Based on the initial surveillance video stream imported by the link, the WEB end creates a video stream buffer, and writes the initial surveillance video stream into the video stream buffer in a preset video format.
  • the method further includes:
  • the surveillance video stream in the video format is extracted through the WEB end, and based on the video processing component in the WEB end, the surveillance video stream is divided at preset intervals to obtain continuous Multiple video streaming units;
  • the video stream units are displayed one by one based on the video display component.
  • the step further includes:
  • the playback mechanism of the video stream unit will not be adjusted.
  • the step of adjusting the playback speed of the video stream unit through the WEB terminal includes:
  • the playback speed is not adjusted.
  • the step of adjusting the playback speed of the video stream unit through the WEB terminal includes:
  • the playback speed is adjusted to the second preset playback speed.
  • the low-latency processing method for WEB-side monitoring video streams further includes the following steps:
  • this application also provides a low-latency processing device for WEB-side monitoring video streams, wherein the device includes:
  • the judgment module is used to perform delay judgment on the preset period of the monitoring video stream through the WEB end, and judge whether the video delay time of the preset period exceeds the preset delay time;
  • An adjustment module configured to adjust the playback mechanism of the monitoring video stream to a frame skipping mechanism through the WEB end if the video delay time exceeds the preset frame chasing threshold
  • Adjusting the playback speed of the surveillance video stream means adjusting the playback mechanism of the surveillance video stream to a frame chasing mechanism.
  • the present application also provides a mobile terminal device.
  • the mobile terminal device includes a memory, a processor, and a computer program stored in the memory and executable on the processor.
  • the computer program is controlled by the processor. When executing, implement the steps of the above low-latency processing method for WEB-side monitoring video streams.
  • the present application also provides a computer-readable storage medium.
  • a computer program is stored on the computer-readable storage medium.
  • the above-mentioned WEB-side monitoring video stream is realized in low time. Delay the steps of the processing method.
  • This application plan combines existing video delay solutions and introduces a judgment mechanism on the basis of the combination, so that the WEB end can dynamically select the playback mechanism of the monitoring video stream according to the network environment, and through the video processing on the WEB end
  • the component processes and displays the surveillance video stream, divides the surveillance video stream into several video stream units based on the preset period, and calculates the video delay time of the video stream, so that the WEB end can better understand the current situation. Effective judgment is made on the playback mechanism required by the displayed video stream unit to avoid the loss of a large picture when the frame skipping mechanism is used when the preset period is too large. When the preset period is too small, there are frequent frame skipping and too fast frame chasing.
  • the WEB end can dynamically adjust the playback speed in the frame chasing mechanism according to the network conditions of the actual usage scenario, avoiding the negative consequences of frequent video buffering, and effectively reducing the limitations of using the playback mechanism to reduce video delay. sex.
  • Figure 1 is a schematic diagram of the terminal structure of the hardware operating environment involved in the embodiment of the present application.
  • Figure 2 is a schematic flowchart of an embodiment of a low-latency processing method for WEB-side monitoring video streams according to the present application
  • FIG. 3 is a schematic diagram of the detailed process of step S40 in Figure 2;
  • Figure 4 is a schematic flow chart of another embodiment of the low-latency processing method for WEB-side monitoring video streams according to the present application
  • Figure 5 is a schematic diagram of the prediction status of the prediction period.
  • the main solution of the embodiment of this application is to combine existing video delay solutions and introduce a judgment mechanism based on the combination, so that the WEB end can dynamically select the playback mechanism of the monitored video stream according to the network environment. And when the playback mechanism is a frame chasing mechanism, the video playback speed in the frame chasing mechanism can be dynamically adjusted according to the network conditions of the actual usage scenario.
  • the preset period is set to be small and low latency is pursued, it will It produces harmful consequences such as a large number of video frame skips and frequent video buffering. It is also sensitive to network fluctuations. If the preset period is set to a high value, the video will have a large number of missing images, which cannot effectively solve the problem of video delay.
  • This application provides a solution that enables the WEB end to better effectively judge the playback mechanism required for the currently displayed video stream unit, and to dynamically adjust the playback in the frame chasing mechanism according to the network conditions of the actual usage scenario. speed, effectively reducing the limitations of the playback mechanism, thereby achieving the effect of truly reducing video delay.
  • Figure 1 is a schematic diagram of the terminal structure of the hardware operating environment involved in the embodiment of the present application.
  • the low-latency processing device for WEB-side surveillance video streams in the embodiment of the present application may be a PC, or a portable terminal device with a display function such as a tablet computer or a portable computer.
  • the terminal may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002.
  • the communication bus 1002 is used to realize connection communication between these components.
  • the user interface 1003 may include a display screen (Display) and an input unit such as a keyboard (Keyboard).
  • the optional user interface 1003 may also include a standard wired interface and a wireless interface.
  • the network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a WI-FI interface).
  • the memory 1005 can be a high-speed RAM memory or a stable memory (non-volatile memory), such as a disk memory.
  • the memory 1005 may optionally be a storage device independent of the aforementioned processor 1001.
  • the WEB-side monitoring video stream low-latency processing device may also include a camera, RF (Radio Frequency, radio frequency) circuits, sensors, audio circuits, WiFi modules, etc.
  • sensors such as light sensors, motion sensors and other sensors.
  • the light sensor may include an ambient light sensor and a proximity sensor.
  • the ambient light sensor may adjust the brightness of the display screen according to the brightness of the ambient light.
  • the proximity sensor may turn off the display screen and/or when the mobile terminal moves to the ear. Backlight.
  • the gravity acceleration sensor can detect the magnitude of acceleration in various directions (generally three axes).
  • the mobile terminal can detect the magnitude and direction of gravity when stationary, and can be used to identify mobile terminal posture applications (such as horizontal and vertical screen switching, related games, magnetometer attitude calibration), vibration recognition related functions (such as pedometer, tapping), etc.; of course, the mobile terminal can also be equipped with other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor, etc., here No longer.
  • mobile terminal posture applications such as horizontal and vertical screen switching, related games, magnetometer attitude calibration
  • vibration recognition related functions such as pedometer, tapping
  • the mobile terminal can also be equipped with other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor, etc., here No longer.
  • the structure of the WEB-side surveillance video stream low-latency processing device shown in Figure 1 does not constitute a limitation on the WEB-side surveillance video stream low-latency processing device, and may include more or more features than those shown in the figure. Fewer parts, or combinations of certain parts, or different parts arrangements.
  • memory 1005 which is a computer storage medium, may include an operating system, a network communication module, a user interface module and a computer program.
  • the network interface 1004 is mainly used to connect to the backend server and communicate with the backend server;
  • the user interface 1003 is mainly used to connect to the client (user) and communicate with the client;
  • the processor 1001 may be used to call a computer program stored in memory 1005 and perform the following operations:
  • the playback mechanism of the video stream unit is adjusted to a frame skipping mechanism through the WEB end;
  • the playback speed of the video stream unit is adjusted through the WEB end, wherein adjusting the playback speed of the video stream unit means The playback mechanism of the video stream unit is adjusted to a frame chasing mechanism.
  • processor 1001 can call the computer program stored in the memory 1005 and also perform the following operations:
  • the WEB end Before the step of determining the delay of the video stream unit through the WEB end, the WEB end creates After the monitoring video stream is linked, a request to receive the initial monitoring video stream is sent to the monitoring video stream end so that the initial monitoring video stream can be imported into the link;
  • the WEB end Based on the initial surveillance video stream imported by the link, the WEB end creates a video stream buffer, and writes the initial surveillance video stream into the video stream buffer in a preset video format.
  • processor 1001 can call the computer program stored in the memory 1005 and also perform the following operations:
  • the video stream units are displayed one by one based on the video display component.
  • processor 1001 can call the computer program stored in the memory 1005 and also perform the following operations:
  • the video stream unit After the step of determining whether the video delay time of the video stream unit exceeds the preset delay time, if the video delay time of the video stream unit does not exceed the preset delay time, the video stream unit will not be played. The mechanism is adjusted.
  • processor 1001 can call the computer program stored in the memory 1005 and also perform the following operations:
  • the step of adjusting the playback speed of the video stream unit through the WEB end includes: predicting and calculating the playback speed of the video stream unit based on the WEB end, and determining whether the playback speed exceeds a first preset playback speed. speed;
  • the playback speed is not adjusted.
  • processor 1001 can call the computer program stored in the memory 1005 and also perform the following operations:
  • the step of adjusting the playback speed of the video stream unit through the WEB end includes: if the playback speed exceeds the first preset playback speed, adjusting the playback speed to the first preset playback speed. speed;
  • the playback speed is adjusted to the second preset playback speed.
  • processor 1001 can call the computer program stored in the memory 1005 and also perform the following operations:
  • the method for low-latency processing of WEB-side surveillance video streams also includes the following steps: if it is detected through the WEB end that the playback of the current video stream unit has ended, then detecting whether there is a next video stream unit in the surveillance video stream;
  • the WEB-side surveillance video stream low-latency processing device shown in Figure 1 also provides a WEB-side surveillance video stream low-latency processing device, including:
  • the judgment module is used to perform delay judgment on the preset period of the monitoring video stream through the WEB end, and judge whether the video delay time of the preset period exceeds the preset delay time;
  • An adjustment module configured to adjust the playback mechanism of the monitoring video stream to a frame skipping mechanism through the WEB end if the video delay time exceeds the preset frame chasing threshold
  • the playback speed of the surveillance video stream is adjusted through the WEB end, wherein adjusting the playback speed of the surveillance video stream means The playback mechanism of the surveillance video stream is adjusted to a frame chasing mechanism.
  • one embodiment of the present application provides a low-latency processing method for WEB-side surveillance video streams.
  • the low-latency processing method for WEB-side surveillance video streams includes:
  • Step S10 perform delay judgment on the video stream unit through the WEB (World Wide Web, Global Wide Area Network or World Wide Web) end to determine whether the video delay time of the video stream unit exceeds the preset delay time;
  • WEB World Wide Web, Global Wide Area Network or World Wide Web
  • video images are collected through IPC (IP Camera, network camera). Set, including encoding, ISP (Image Signal Processing, Image Signal Processing), etc., and convert the initial surveillance video stream format pushed to the WEB end into HTTP (Hyper Text Transfer Protocol, Hypertext Transfer Protocol) format through IPC. Conversion to HTTP format is because the WEB side used to process and display surveillance video streams is a distributed graphical information system based on hypertext and HTTP.
  • the surveillance video stream is divided into several groups of processing cycles with a preset time of T, that is, video stream units, and each video stream unit is processed.
  • Delay judgment Before making delay judgment on the video stream unit, it is necessary to obtain the video frame timestamp C of the current monitoring video stream, the video frame timestamp E of the last frame of the preset period and the current network environment. SpeedS. Because the video delay time of the video stream unit is obtained by calculating the video frame timestamp C of the current monitored video stream and the video frame timestamp E of the last frame of the preset period, the video delay time of the video stream unit is The calculation result is E-C.
  • the preset delay time can be set by the user, or it can be a delay time that can be received by the current playback environment obtained by the WEB end through calculation of the surveillance video stream.
  • the step before the step of determining the delay of the preset period of the monitoring video stream through the WEB end in step S10, the step further includes:
  • Step S11 After the WEB end creates a link to the surveillance video stream, it sends a request to receive the initial surveillance video stream to the surveillance video stream end so that the initial surveillance video stream can be imported into the link;
  • the WEB end After the WEB end creates a link to the monitoring video stream, it will make a request to the IPC for the monitoring video stream.
  • Step S12 Based on the initial surveillance video stream imported by the link, the WEB end creates a video stream buffer, and writes the initial surveillance video stream into the video stream buffer in a preset video format.
  • the WEB side After detecting the surveillance video stream sent by the IPC side, the WEB side will create a buffer to buffer the surveillance video playback data. After the creation is completed, the HTTP format video of the surveillance video stream sent by the IPC will be written into the buffer. middle.
  • the method further includes:
  • Step S13 Provide the surveillance video stream in the video format through the WEB end. Get, and based on the video processing component in the WEB end, divide the surveillance video stream at preset intervals to obtain multiple continuous video stream units;
  • Step S14 Display the video stream units one by one based on the video display component.
  • the video processing components used are the HTML5Video control and the flv.js open source script, but they are not limited to the above video processing components. Users can use different video processing components according to different actual usage scenarios.
  • the video image collection terminal in this embodiment is not limited to IPC. Any surveillance video stream sent by a terminal capable of video push can be effectively processed and displayed on the WEB side with low latency.
  • the surveillance video stream After extracting the surveillance video stream converted into HTTP format, the surveillance video stream needs to be processed through the video processing component that comes with the WEB end.
  • the extracted surveillance video stream is divided at the preset period T as the interval, and we can get Several video stream units with a preset period of T.
  • the video stream unit is continuous and uninterrupted.
  • the video stream units are displayed one by one through the video display component, and the delay judgment of the video stream unit on the WEB side is judged during the display process.
  • Step S20 If the video delay time of the video stream unit exceeds the preset delay time, determine whether the video delay time exceeds the preset frame pursuit threshold;
  • the playback mechanism suitable for the currently played video stream unit will be further determined, that is, the video delay time will be determined Whether the preset frame tracking threshold is exceeded, the playback mechanism on the WEB side can be dynamically selected based on the actual usage scenario.
  • the preset frame chasing threshold means that the video delay time within this threshold range can achieve the effect of frame chasing to reduce delay by adjusting the playback speed.
  • the method further includes:
  • Step S21 if the video delay time of the video stream unit does not exceed the preset delay time, the playback mechanism of the video stream unit is not adjusted;
  • Step S30 If the video delay time exceeds the preset frame chasing threshold, adjust the playback mechanism of the video stream unit to a frame skipping mechanism through the WEB end;
  • the video delay time of the currently played video stream unit exceeds the preset frame chasing threshold, it means that the current video delay time cannot be reduced by adjusting the playback speed.
  • the preset When the frame chasing threshold is equal to the preset time T, it means that it is possible to catch up with the real-time frame within a preset period only when using a playback speed exceeding 2 times the speed.
  • the viewing effect at this time is extremely poor, and it is very likely to be affected by the playback speed. Too fast causes the surveillance video stream to buffer.
  • the current playback mechanism of the surveillance video stream can only be adjusted to the frame skipping mechanism, that is, jumping directly to the preset The video frame timestamp E of the last frame of the cycle, thereby eliminating delays in monitoring video streams.
  • the above-mentioned delay situation usually only occurs in the initial stage of monitoring video stream playback and under special circumstances. After a relatively stable video stream connection is created on the WEB side, the video delay time rarely exceeds the preset tracking time. Frame threshold case.
  • Step S40 if the video delay time does not exceed the preset frame chasing threshold, adjust the playback speed of the video stream unit through the WEB end, wherein the playback speed of the video stream unit is adjusted. Adjustment refers to adjusting the playback mechanism of the video stream unit to a frame chasing mechanism.
  • the current video delay time of the currently played video stream unit does not exceed the preset frame chasing threshold, it means that the current video delay time can achieve the effect of frame chasing to reduce delay by adjusting the playback speed.
  • the preset frame tracking threshold is less than the preset time T, it means that you only need to use a playback speed of less than 2 times, such as 1.3 times, to catch up with the real-time frame within a preset period. Therefore, you only need to use the current monitoring video stream
  • the playback mechanism is adjusted to a frame chasing mechanism.
  • the playback speed of the surveillance video stream is dynamically adjusted based on the playback speed results predicted and calculated by the WEB side to avoid the inability of the existing frame chasing mechanism to intelligently dynamically adjust the playback speed based on the real-time network environment.
  • the playback speed caused by the adjustment is too small and cannot meet the requirements of real-time playback. When the playback speed is too fast, it affects the user's perception.
  • the WEB side can automatically switch the playback mechanism according to the actual playback situation.
  • the WEB end can better effectively judge the playback mechanism required for the currently displayed video stream unit and avoid preset cycles.
  • the frame skipping mechanism will cause the loss of a large picture.
  • the preset period is too small, there will be problems of frequent frame skipping and too fast frame chasing. This not only effectively reduces the monitoring video stream delay, but also improves the user's perception. .
  • an embodiment of the present application provides a method for low-latency processing of WEB-side monitoring video streams. Based on the embodiment shown in step S40 above, the video is processed through the WEB-side.
  • the steps to adjust the playback speed of the streaming unit include:
  • Step S41 Predict and calculate the playback speed of the video stream unit based on the WEB end, and determine whether the playback speed exceeds the first preset playback speed;
  • Step S42 if the playback speed exceeds the first preset playback speed, adjust the playback speed to the first preset playback speed
  • Step S43 if the playback speed does not exceed the first preset playback speed, the playback speed is not adjusted;
  • step S43 includes:
  • Step S44 If the playback speed does not exceed the first preset playback speed and the playback speed is less than the second preset playback speed, adjust the playback speed to the second preset playback speed.
  • the WEB end performs a pre-storage calculation of the expected cacheable video time F based on the current network environment speed S and the bit rate rate of the IPC pushed surveillance video stream, and the playback speed of the surveillance video stream.
  • the formula is:
  • the playback speed of the current surveillance video stream is:
  • the first preset playback speed is the highest playback speed acceptable to the user set by the user or calculated by the WEB end
  • the second preset playback speed is the maximum playback speed set by the user or calculated by the WEB end that can satisfy The minimum playback speed required for real-time playback.
  • the second preset playback speed value is smaller than the first preset playback speed value.
  • the current playback speed is set to 1.3.
  • P is less than 1.3 but does not exceed When it is greater than 1, the current playback speed will not be changed.
  • P is less than 1, it means that the current network speed is stuck and cannot meet the needs of real-time playback, so the current playback speed is set to 1.
  • the playback speed can be set according to different actual application scenarios to achieve adaptive and dynamic adjustment of the playback speed.
  • the WEB end is used to predict and calculate the playback speed of the surveillance video stream, so that the WEB end can dynamically adjust the playback speed of the surveillance video stream according to actual application scenarios.
  • one embodiment of the present application provides a low-latency processing method for WEB-side surveillance video streams.
  • the low-latency processing method for WEB-side surveillance video streams also includes:
  • Step S50 if it is detected through the WEB end that the playback of the current video stream unit has ended, detect whether there is a next video stream unit in the surveillance video stream;
  • Step S51 If there is a next video stream unit in the surveillance video stream, perform the step of delaying the video stream unit judgment through the WEB end;
  • Step S52 If there is no next video stream unit in the surveillance video stream, output information that the surveillance video stream has finished playing through the WEB terminal.
  • the WEB end needs to detect whether there is another unoperated video stream unit in the surveillance video stream. , to avoid incomplete playback caused by the lack of video stream units.
  • the output information of the end of the surveillance video stream playback can be the words "no surveillance video stream" output on the playback screen, the voice output prompt of the end of playback, etc.
  • an embodiment of the present application also provides a low-latency processing device for WEB-side surveillance video streams.
  • the low-latency processing device for WEB-side surveillance video streams includes:
  • the judgment module A10 is used to perform delay judgment on the preset period of the monitoring video stream through the WEB end, and judge whether the video delay time of the preset period exceeds the preset delay time;
  • the adjustment module A20 is configured to adjust the playback mechanism of the monitoring video stream to a frame skipping mechanism through the WEB end if the video delay time exceeds the preset frame chasing threshold;
  • the playback speed of the surveillance video stream is adjusted through the WEB end, wherein adjusting the playback speed of the surveillance video stream means The playback mechanism of the surveillance video stream is adjusted to a frame chasing mechanism.
  • embodiments of the present application also propose a mobile terminal device, which includes a memory, a processor, and a computer program stored on the memory and executable on the processor.
  • the computer program is When the processor executes, the steps of implementing the above low-latency processing method for WEB-side monitoring video streams are implemented.
  • this application also proposes a computer-readable storage medium.
  • a computer program is stored on the computer-readable storage medium.
  • the steps of the above-mentioned low-latency processing method for WEB-side monitoring video streams are implemented. .
  • the methods of the above embodiments can be implemented by means of software plus the necessary general hardware platform. Of course, they can also be implemented by over hardware, but in many cases the former is the better implementation.
  • the technical solution of the present application can be embodied in the form of a software product that is essentially or contributes to the existing technology.
  • the computer software product is stored in a storage medium (such as ROM/RAM) as mentioned above. , magnetic disk, optical disk), including several instructions to cause a terminal device (which can be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in various embodiments of this application.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本申请公开了一种WEB端监控视频流低时延处理方法、装置、设备及介质，该方法包括：将现有的播放机制进行整合并增加判断机制，通过WEB端判断视频流单元的视频延时时间是否超过预设延时时间；若超过预设延时时间，则判断视频延时时间是否超过预设追帧阈值；若超过预设追帧阈值，则通过WEB端将监控视频流的播放机制调整为跳帧机制；若未超过预设追帧阈值，则通过WEB端对监控视频流的播放速度进行调整。

Description

WEB端监控视频流低时延处理方法、装置、设备及介质
相关申请
本申请要求于2022年4月18日申请的、申请号为202210407454.5的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及网络摄像机的显示技术领域，特别涉及一种WEB端监控视频流低时延处理方法、装置、移动终端设备及计算机可读存储介质。
背景技术
在一些对监控视频流有着较高的时效性要求的应用场合，例如安防监控、远程医疗或智能生产等领域，要求在WEB端的视频处理组件上进行显示的监控视频流能够做到实时播放，但由于存在网络时延、缓存机制等因素，导致监控视频流一般都会存在极大的时延，如若不经过特殊的处理，在WEB端进行显示的监控视频流的时延会达到几秒到十几秒不等，更有甚者的时延会以分钟来计算，而现有的解决方案有两种，一种是采用跳帧机制，另一种是采用追帧机制，虽然这两者在一定程度上都能够消除监控视频流的时延，但对于监控视频流的预设周期要求很大，预设周期过大，直接采用跳帧机制会使得显示的监控视频存在大画面的缺失，预设周期过小，存在跳帧频繁和追帧过快的问题，极其影响用户的观看效果。
因此，现有的解决视频时延的方案对预设周期的限制性极大，并未能对显示的监控视频流进行灵活的调整从而起到真正降低视频时延的效果。
发明内容
本申请的主要目的是提出一种WEB端监控视频流低时延处理方法、装置、移动终端设备及计算机可读存储介质，旨在解决现有的视频延时的解决方案限制性大，且减低视频延时的效率较低，进而存在的影响用户观看体验的技 术问题。
为实现上述目的，本申请提供一种WEB端监控视频流低时延处理方法，所述WEB端监控视频流低时延处理方法包括以下步骤：
通过WEB端对视频流单元进行延时判断，判断所述视频流单元的视频延时时间是否超过预设延时时间；
若所述视频流单元的视频延时时间超过所述预设延时时间，则判断所述视频延时时间是否超过预设追帧阈值；
若所述视频延时时间超过所述预设追帧阈值，则通过所述WEB端将所述视频流单元的播放机制调整为跳帧机制；
若所述视频延时时间未超过所述预设追帧阈值，则通过所述WEB端对所述视频流单元的播放速度进行调整，其中，对所述视频流单元的播放速度进行调整指将所述视频流单元的播放机制调整为追帧机制。
在一实施例中，所述通过WEB端对视频流单元进行延时判断的步骤之前，还包括：
所述WEB端创建所述监控视频流的链接后，向监控视频流端发送接收初始监控视频流的请求，以使所述初始监控视频流能够导入所述链接中；
基于所述链接导入的所述初始监控视频流，所述WEB端创建视频流缓冲区，并将所述初始监控视频流以预设的视频格式写入所述视频流缓冲区中。
在一实施例中，所述将所述初始监控视频流以预设的视频格式写入所述视频流缓冲区中的步骤之后，还包括：
通过所述WEB端对所述视频格式中的所述监控视频流进行提取，并基于所述WEB端中的视频处理组件，将所述监控视频流以预设周期为间隔进行划分，得到连续的多个视频流单元；
基于视频显示组件将所述视频流单元进行逐个显示。
在一实施例中，所述判断所述视频流单元的视频延时时间是否超过预设延时时间的步骤之后，还包括：
若所述视频流单元的视频延时时间未超过预设延时时间，则不对所述视频流单元的播放机制进行调整。
在一实施例中，所述通过所述WEB端对所述视频流单元的播放速度进行调整的步骤包括：
基于所述WEB端对所述视频流单元的播放速度进行预测计算，判断所述播放速度是否超过第一预设播放速度；
若所述播放速度超过第一预设播放速度，则将所述播放速度调整为所述第一预设播放速度；
若所述播放速度未超过第一预设播放速度，则不对所述播放速度进行调整。
在一实施例中，所述通过所述WEB端对所述视频流单元的播放速度进行调整的步骤包括：
若所述播放速度超过所述第一预设播放速度，则将所述播放速度调整为所述第一预设播放速度；
若所述播放速度未超过第一预设播放速度且所述播放速度小于第二预设播放速度，则将所述播放速度调整为所述第二预设播放速度。
在一实施例中，所述WEB端监控视频流低时延处理方法还包括以下步骤：
若通过所述WEB端检测到当前的视频流单元的播放结束，则检测所述监控视频流是否还存在下一视频流单元；
若所述监控视频流还存在下一视频流单元，则执行所述通过WEB端对视频流单元进行延时判断的步骤；
若所述监控视频流不存在下一视频流单元，则通过所述WEB端输出所述监控视频流播放结束的信息。
此外，为实现上述目的，本申请还提供一种WEB端监控视频流低时延处理装置，其中，所述装置包括：
判断模块，用于通过WEB端对监控视频流的预设周期进行延时判断，判断所述预设周期的视频延时时间是否超过预设延时时间；
若所述预设周期的视频延时时间超过所述预设延时时间，判断所述视频延时时间是否超过预设追帧阈值；
调整模块，用于若所述视频延时时间超过所述预设追帧阈值，则通过所述WEB端将所述监控视频流的播放机制调整为跳帧机制；
若所述视频延时时间未超过所述预设追帧阈值，则通过所述WEB端对所 述监控视频流的播放速度进行调整，其中，对所述监控视频流的播放速度进行调整指将所述监控视频流的播放机制调整为追帧机制。
此外，为实现上述目的，本申请还提供一种移动终端设备，所述移动终端设备包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，所述计算机程序被处理器执行时实现上述WEB端监控视频流低时延处理方法的步骤。
此外，为实现上述目的，本申请还提供一种计算机可读存储介质，所述计算机可读存储介质上存储有计算机程序，所述计算机程序被处理器执行时实现上述WEB端监控视频流低时延处理方法的步骤。
本申请方案通过将现有的视频延时解决方案进行结合，并在结合的基础上引入判断机制，使得WEB端能够根据网络环境动态的选择监控视频流的播放机制，通过WEB端上的视频处理组件对监控视频流进行处理和显示，将监控视频流以预设周期为基础划分为若干个视频流单元，并通过对视频流的视频延时时间的计算，使得WEB端能够更好的对当前显示的视频流单元所需的播放机制进行有效的判断，避免预设周期过大时，使用跳帧机制存在的大画面的缺失，预设周期过小时，存在跳帧频繁和追帧过快的问题，通过引入计算模块，使得WEB端能够根据实际使用场景的网络情况来动态调整追帧机制中的播放速度，避免视频缓冲频繁的恶性结果，有效的减低了采用播放机制减低视频时延的限制性。
附图说明
图1是本申请实施例方案涉及的硬件运行环境的终端结构示意图；
图2为本申请WEB端监控视频流低时延处理方法一实施例的流程示意图；
图3为图2中步骤S40的细化流程示意图；
图4为本申请WEB端监控视频流低时延处理方法另一实施例的流程示意图；
图5为预测周期的预测状态示意图。
本申请目的的实现、功能特点及优点将结合实施例，参照附图做进一步说明。
具体实施方式
应当理解，此处所描述的具体实施例仅仅用以解释本申请，并不用于限定本申请。
本申请实施例的主要解决方案是：通过将现有的视频延时解决方案进行结合，并在结合的基础上引入判断机制，使得WEB端能够根据网络环境动态的选择监控视频流的播放机制，和在播放机制为追帧机制时，能够根据实际使用场景的网络情况来动态调整追帧机制中的视频播放速度。
由于现有技术中，WEB端播放监控视频流的播放机制存在的单一性和不可变化性，使得无论是跳帧机制还是追帧机制，如果预设周期设定较小，追求低延迟，则会产生视频大量跳帧、视频缓冲频繁等恶性结果，并且受网络波动影响敏感，如果预设周期设置较高，则视频会存在大量的画面缺失，并不能有效的解决视频延时的问题。
本申请提供一种解决方案，使得WEB端能够更好的对当前显示的视频流单元所需的播放机制进行有效的判断，并能够根据实际使用场景的网络情况来动态调整追帧机制中的播放速度，有效的减低了播放机制的限制性，从而达到真正减低视频时延的效果。
如图1所示，图1是本申请实施例方案涉及的硬件运行环境的终端结构示意图。
本申请实施例WEB端监控视频流低时延处理装置可以是PC，也可以是平板电脑、便携计算机等具有显示功能的可移动式终端设备。
如图1所示，该终端可以包括：处理器1001，例如CPU，网络接口1004，用户接口1003，存储器1005，通信总线1002。其中，通信总线1002用于实现这些组件之间的连接通信。用户接口1003可以包括显示屏(Display)、输入单元比如键盘(Keyboard)，可选用户接口1003还可以包括标准的有线接口、无线接口。网络接口1004可选的可以包括标准的有线接口、无线接口(如WI-FI接口)。存储器1005可以是高速RAM存储器，也可以是稳定的存储器(non-volatile memory)，例如磁盘存储器。存储器1005可选的还可以是独立于前述处理器1001的存储装置。
在一实施例中，WEB端监控视频流低时延处理装置还可以包括摄像头、 RF(Radio Frequency，射频)电路，传感器、音频电路、WiFi模块等等。其中，传感器比如光传感器、运动传感器以及其他传感器。具体地，光传感器可包括环境光传感器及接近传感器，其中，环境光传感器可根据环境光线的明暗来调节显示屏的亮度，接近传感器可在移动终端移动到耳边时，关闭显示屏和/或背光。作为运动传感器的一种，重力加速度传感器可检测各个方向上(一般为三轴)加速度的大小，静止时可检测出重力的大小及方向，可用于识别移动终端姿态的应用(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等；当然，移动终端还可配置陀螺仪、气压计、湿度计、温度计、红外线传感器等其他传感器，在此不再赘述。
本领域技术人员可以理解，图1中示出的WEB端监控视频流低时延处理装置结构并不构成对WEB端监控视频流低时延处理装置的限定，可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置。
如图1所示，作为一种计算机存储介质的存储器1005中可以包括操作系统、网络通信模块、用户接口模块以及计算机程序。
在图1所示的终端中，网络接口1004主要用于连接后台服务器，与后台服务器进行数据通信；用户接口1003主要用于连接客户端(用户端)，与客户端进行数据通信；而处理器1001可以用于调用存储器1005中存储的计算机程序，并执行以下操作：
通过WEB端对视频流单元进行延时判断，判断所述视频流单元的视频延时时间是否超过预设延时时间；
若所述视频流单元的视频延时时间超过所述预设延时时间，则判断所述视频延时时间是否超过预设追帧阈值；
若所述视频延时时间超过所述预设追帧阈值，则通过所述WEB端将所述视频流单元的播放机制调整为跳帧机制；
若所述视频延时时间未超过所述预设追帧阈值，则通过所述WEB端对所述视频流单元的播放速度进行调整，其中，对所述视频流单元的播放速度进行调整指将所述视频流单元的播放机制调整为追帧机制。
进一步地，处理器1001可以调用存储器1005中存储的计算机程序，还执行以下操作：
通过WEB端对视频流单元进行延时判断的步骤之前，所述WEB端创建 所述监控视频流的链接后，向监控视频流端发送接收初始监控视频流的请求，以使所述初始监控视频流能够导入所述链接中；
基于所述链接导入的所述初始监控视频流，所述WEB端创建视频流缓冲区，并将所述初始监控视频流以预设的视频格式写入所述视频流缓冲区中。
进一步地，处理器1001可以调用存储器1005中存储的计算机程序，还执行以下操作：
将所述初始监控视频流以预设的视频格式写入所述视频流缓冲区中的步骤之后，通过所述WEB端对所述视频格式中的所述监控视频流进行提取，并基于所述WEB端中的视频处理组件，将所述监控视频流以预设周期为间隔进行划分，得到连续的多个视频流单元；
基于视频显示组件将所述视频流单元进行逐个显示。
进一步地，处理器1001可以调用存储器1005中存储的计算机程序，还执行以下操作：
判断所述视频流单元的视频延时时间是否超过预设延时时间的步骤之后，若所述视频流单元的视频延时时间未超过预设延时时间，则不对所述视频流单元的播放机制进行调整。
进一步地，处理器1001可以调用存储器1005中存储的计算机程序，还执行以下操作：
通过所述WEB端对所述视频流单元的播放速度进行调整的步骤包括：基于所述WEB端对所述视频流单元的播放速度进行预测计算，判断所述播放速度是否超过第一预设播放速度；
若所述播放速度超过第一预设播放速度，则将所述播放速度调整为所述第一预设播放速度；
若所述播放速度未超过第一预设播放速度，则不对所述播放速度进行调整。
进一步地，处理器1001可以调用存储器1005中存储的计算机程序，还执行以下操作：
通过所述WEB端对所述视频流单元的播放速度进行调整的步骤包括：若所述播放速度超过所述第一预设播放速度，则将所述播放速度调整为所述第一预设播放速度；
若所述播放速度未超过第一预设播放速度且所述播放速度小于第二预设播放速度，则将所述播放速度调整为所述第二预设播放速度。
进一步地，处理器1001可以调用存储器1005中存储的计算机程序，还执行以下操作：
WEB端监控视频流低时延处理方法还包括以下步骤：若通过所述WEB端检测到当前的视频流单元的播放结束，则检测所述监控视频流是否还存在下一视频流单元；
若所述监控视频流还存在下一视频流单元，则执行所述通过WEB端对视频流单元进行延时判断的步骤；
若所述监控视频流不存在下一视频流单元，则通过所述WEB端输出所述监控视频流播放结束的信息。
进一步地，如图1所示的WEB端监控视频流低时延处理装置中还提供了一种WEB端监控视频流低时延处理装置，包括：
判断模块，用于通过WEB端对监控视频流的预设周期进行延时判断，判断所述预设周期的视频延时时间是否超过预设延时时间；
若所述预设周期的视频延时时间超过所述预设延时时间，判断所述视频延时时间是否超过预设追帧阈值；
调整模块，用于若所述视频延时时间超过所述预设追帧阈值，则通过所述WEB端将所述监控视频流的播放机制调整为跳帧机制；
若所述视频延时时间未超过所述预设追帧阈值，则通过所述WEB端对所述监控视频流的播放速度进行调整，其中，对所述监控视频流的播放速度进行调整指将所述监控视频流的播放机制调整为追帧机制。
参照图2，本申请一实施例提供一种WEB端监控视频流低时延处理方法，所述WEB端监控视频流低时延处理方法包括：
步骤S10，通过WEB(World Wide Web，全球广域网或万维网)端对视频流单元进行延时判断，判断所述视频流单元的视频延时时间是否超过预设延时时间；
在本实施例中，通过IPC(IP Camera，网络摄像头)进行视频图像的采 集，其中包括编码、ISP(Image Signal Processing，图像信号处理)等，并通过IPC将推送至WEB端的初始监控视频流格式转换为HTTP(Hyper Text Transfer Protocol，超文本传输协议)格式，之所以要转换为HTTP格式，是因为用于对监控视频流进行处理和显示的WEB端是一种基于超文本和HTTP的分布式图形信息系统。
通过WEB端上的视频处理组件对HTTP格式的初始监控视频流进行处理后，将监控视频流划分为若干组预设时间为T的处理周期，即视频流单元，并对每一个视频流单元进行延时判断，而在对视频流单元进行延时判断之前，需先获取当前监控视频流的视频帧时间戳C，预设周期的最后一帧的视频帧时间戳E和当前所处的网络环境速度S。因为视频流单元的视频延时时间是通过对当前监控视频流的视频帧时间戳C和预设周期的最后一帧的视频帧时间戳E进行计算获得的，故视频流单元的视频延时时间的计算结果为E-C。
其中，预设延时时间是既能是用户自行进行设定的，也能是WEB端通过对监控视频流进行计算后得出的当前播放环境所能接收的延时时间。
在一实施例中，步骤S10中通过WEB端对监控视频流的预设周期进行延时判断的步骤之前，还包括：
步骤S11，所述WEB端创建所述监控视频流的链接后，向监控视频流端发送接收初始监控视频流的请求，以使所述初始监控视频流能够导入所述链接中；
在本实施例中，WEB端在创建完监控视频流的链接之后，会向IPC进行监控视频流的请求。
步骤S12，基于所述链接导入的所述初始监控视频流，所述WEB端创建视频流缓冲区，并将所述初始监控视频流以预设的视频格式写入所述视频流缓冲区中。
在检测到IPC端发送的监控视频流后，WEB端会进行缓冲区的创建缓冲器，用于缓冲监控视频播放数据，创建完毕后，将IPC发送的监控视频流的HTTP格式视频写入缓冲区中。
在一实施例中，步骤S12中将所述初始监控视频流以预设的视频格式写入所述视频流缓冲区中的步骤之后，还包括：
步骤S13，通过所述WEB端对所述视频格式中的所述监控视频流进行提 取，并基于所述WEB端中的视频处理组件，将所述监控视频流以预设周期为间隔进行划分，得到连续的多个视频流单元；
步骤S14，基于视频显示组件将所述视频流单元进行逐个显示。
而在本实施例中，所用到的视频处理组件为HTML5Video控件和flv.js开源脚本，但并不限定与上述的视频处理组件，用户可根据实际使用场景的不同来使用不同的视频处理组件。
其次，本实施例中的视频图像的采集终端也不限定于IPC，任何可以进行视频推送的终端所发送出来的监控视频流，都可以在WEB端进行有效的低延时处理和显示。
对转化为HTTP格式的监控视频流进行提取后，还需通过WEB端自带的视频处理组件对监控视频流进行处理，以预设周期T为间隔，对提取的监控视频流进行划分，能得到若干个预设周期为T的视频流单元。
需注意的是，视频流单元是连续的，不间断的。
在处理得到连续的视频流单元后，通过视频显示组件将视频流单元进行逐个显示，而WEB端对视频流单元的延时判断是在显示的过程中进行判断的。
步骤S20，若所述视频流单元的视频延时时间超过所述预设延时时间，则判断所述视频延时时间是否超过预设追帧阈值；
若通过WEB端检测到当前播放的视频流单元的视频延时时间超过了预设延时时间，则说明监控视频流的时延性较高，按原本的播放机制进行播放会造成播放画面的卡顿，在本实施例中，在检测到当前播放的视频流单元的视频延时时间超过了预设延时时间，会进一步判断当前播放的视频流单元所适合的播放机制，即判断视频延时时间是否超过预设追帧阈值，使得WEB端的播放机制能够根据实际使用场景进行动态选择。
其中，预设追帧阈值是指在此阈值范围内的视频延时时间能够通过调整播放速度实现追帧降低时延的效果。
在一实施例中，步骤S20中判断所述视频流单元的视频延时时间是否超过预设延时时间的步骤之后，还包括：
步骤S21，若所述视频流单元的视频延时时间未超过预设延时时间，则不对所述视频流单元的播放机制进行调整；
若通过WEB端检测到当前播放的视频流单元的视频延时时间没有超过预设延时时间，则说明当前监控视频流的时延性较低，按原本的播放机制进行播放不会造成播放画面卡顿的现象，因此此时不对播放机制进行过多的调整，避免不必要的资源浪费。
步骤S30，若所述视频延时时间超过所述预设追帧阈值，则通过所述WEB端将所述视频流单元的播放机制调整为跳帧机制；
若通过WEB端检测到当前播放的视频流单元的视频延时时间超过预设追帧阈值，说明当前的视频延时时间已经不能够通过调整播放速度来实现时延的降低，例如，当预设追帧阈值等于预设时间T时，代表只有使用超过2倍速的播放速度时才有可能在一个预设周期内追上实时帧，但此时的观感效果极差，且极有可能因播放速度过快使得监控视频流进行缓冲状态。因此，为了避免延时造成的观看度不高和追帧过快造成的监控视频流频繁进入缓冲状态，只能将当前监控视频流的播放机制调整为跳帧机制，即直接跳转至预设周期的最后一帧的视频帧时间戳E，从而消除监控视频流的延迟。
但上述的延时情况通常只会在监控视频流播放的初始阶段和特殊的情况下才会发生，在WEB端创建了较为稳定的视频流连接后，极少存在视频延时时间超过预设追帧阈值的情况。
步骤S40，若所述视频延时时间未超过所述预设追帧阈值，则通过所述WEB端对所述视频流单元的播放速度进行调整，其中，对所述视频流单元的播放速度进行调整指将所述视频流单元的播放机制调整为追帧机制。
若通过WEB端检测到当前播放的视频流单元的视频延时时间未超过预设追帧阈值，则说明当前的视频延时时间能够通过调整播放速度实现追帧降低时延的效果，例如，当预设追帧阈值小于预设时间T时，代表只需采用2倍速以下的倍速播放速度，例如1.3倍数，就能在一个预设周期内追上实时帧，因此，只需将当前监控视频流的播放机制调整为追帧机制，根据WEB端预测计算的播放速度结果对监控视频流的播放速度进行动态化调整，避免现有的追帧机制中无法根据实时的网络环境对播放速度进行智能动态化调整造成的播放速度过小时，不能达到实时播放的要求，播放速度过快时对用户观感造成影响的问题。
在本实施例中，通过将现有的视频延时解决方案进行结合，使得WEB端 能够根据实际播放情况进行播放机制的自动切换，通过在结合的基础上引入判断机制，使得WEB端能够更好的对当前显示的视频流单元所需的播放机制进行有效的判断，避免预设周期过大时，使用跳帧机制存在的大画面的缺失，预设周期过小时，存在跳帧频繁和追帧过快的问题，即实现了有效降低监控视频流时延，又提升了用户的观感。
进一步的，参照图3和图5，本申请一实施例提供一种WEB端监控视频流低时延处理方法，基于上述步骤S40所示的实施例，所述通过所述WEB端对所述视频流单元的播放速度进行调整的步骤包括：
步骤S41，基于所述WEB端对所述视频流单元的播放速度进行预测计算，判断所述播放速度是否超过第一预设播放速度；
步骤S42，若所述播放速度超过第一预设播放速度，则将所述播放速度调整为所述第一预设播放速度；
步骤S43，若所述播放速度未超过第一预设播放速度，则不对所述播放速度进行调整；
在一实施例中，步骤S43中通过所述WEB端对所述视频流单元的播放速度进行调整的步骤包括：
步骤S44，若所述播放速度未超过第一预设播放速度且所述播放速度小于第二预设播放速度，则将所述播放速度调整为所述第二预设播放速度。
首先，WEB端根据当前所处的网络环境速度S和IPC推送监控视频流的码率rate对监控视频流的播放速度进行预计可缓存的视频时间F的预存计算，其公式为：
图5为一个预设周期的预测状态，其中的C’代表一个预测周期后理想的视频帧时间戳，E’代表预计缓存的视频帧时间戳，δ代表可接受延迟时间，由图可知：
E’＝E+F
C’＝E’-δ
由上述的计算结果可得当前监控视频流的播放速度为：
其中，第一预设播放速度为用户设定或WEB端所计算得出的用户所能接受的最高播放速度，而第二预设播放速度为用户设定或WEB端所计算得出的能够满足实时播放需要的最低播放速度。第二预设播放速度值小于第一预设播放速度值。
假设第一预设播放速度为1.3，第二预设播放速度为1，当P超过1.3但又未超过预设追帧阈值时，则将当前的播放速度设定为1.3，当P小于1.3但大于1时，则不对当前播放速度进行改变，当P小于1时，代表当前的网速存在卡顿，不能满足实时播放的需求，则将当前播放速度设定为1。
需注意的是，可根据实际应用场景的不同情况对播放速度进行设置，达到适应性的动态调整播放速度。
在本实施例中，通过WEB端对监控视频流的播放速度进行预测计算，使WEB端能够根据实际的应用场景对监控视频流的播放速度实现动态调整。
参考图4，本申请一实施例提供一种WEB端监控视频流低时延处理方法，所述WEB端监控视频流低时延处理方法还包括：
步骤S50，若通过所述WEB端检测到当前的视频流单元的播放结束，则检测所述监控视频流是否还存在下一视频流单元；
步骤S51，若所述监控视频流还存在下一视频流单元，则执行所述通过WEB端对视频流单元进行延时判断的步骤；
步骤S52，若所述监控视频流不存在下一视频流单元，则通过所述WEB端输出所述监控视频流播放结束的信息。
在本实施例中，因为一个监控视频流中存在多个视频流单元，因此在当前的视频流单元运转结束后，WEB端需对监控视频流是否还存在下一未运转的视频流单元进行检测，避免视频流单元的缺失导致播放的不完整性。
其中，输出的监控视频流播放结束的信息可为播放画面输出无监控视频流的字样、语音输出结束播放的提示等。
进一步的，本申请一实施例还提供一种WEB端监控视频流低时延处理装置，所述WEB端监控视频流低时延处理装置包括：
判断模块A10，用于通过WEB端对监控视频流的预设周期进行延时判断，判断所述预设周期的视频延时时间是否超过预设延时时间；
若所述预设周期的视频延时时间超过所述预设延时时间，判断所述视频延时时间是否超过预设追帧阈值；
调整模块A20，用于若所述视频延时时间超过所述预设追帧阈值，则通过所述WEB端将所述监控视频流的播放机制调整为跳帧机制；
若所述视频延时时间未超过所述预设追帧阈值，则通过所述WEB端对所述监控视频流的播放速度进行调整，其中，对所述监控视频流的播放速度进行调整指将所述监控视频流的播放机制调整为追帧机制。
此外，本申请实施例还提出一种移动终端设备，所述移动终端设备包括存储器、处理器、以及存储在所述存储器上并可在所述处理器上运行的计算机程序，所述计算机程序被处理器执行时实现上述WEB端监控视频流低时延处理方法的步骤。
此外，本申请还提出一种计算机可读存储介质，所述计算机可读存储介质上存储有计算机程序，所述计算机程序被处理器执行时实现上述WEB端监控视频流低时延处理方法的步骤。
需要说明的是，在本文中，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者系统不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者系统所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括该要素的过程、方法、物品或者系统中还存在另外的相同要素。
上述本申请实施例序号仅仅为了描述，不代表实施例的优劣。
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现，当然也可以通 过硬件，但很多情况下前者是更佳的实施方式。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来，该计算机软件产品存储在如上所述的一个存储介质(如ROM/RAM、磁碟、光盘)中，包括若干指令用以使得一台终端设备(可以是手机，计算机，服务器，空调器，或者网络设备等)执行本申请各个实施例所述的方法。
以上仅为本申请的优选实施例，并非因此限制本申请的专利范围，凡是利用本申请说明书及附图内容所作的等效结构或等效流程变换，或直接或间接运用在其他相关的技术领域，均同理包括在本申请的专利保护范围内。

Claims (15)

  1. 一种WEB端监控视频流低时延处理方法，其中，所述WEB端监控视频流低时延处理方法包括以下步骤：
    通过WEB端对视频流单元进行延时判断，判断所述视频流单元的视频延时时间是否超过预设延时时间；
    若所述视频流单元的视频延时时间超过所述预设延时时间，则判断所述视频延时时间是否超过预设追帧阈值；
    若所述视频延时时间超过所述预设追帧阈值，则通过所述WEB端将所述视频流单元的播放机制调整为跳帧机制；
    若所述视频延时时间未超过所述预设追帧阈值，则通过所述WEB端对所述视频流单元的播放速度进行调整，其中，对所述视频流单元的播放速度进行调整指将所述视频流单元的播放机制调整为追帧机制。
  2. 如权利要求1所述的WEB端监控视频流低时延处理方法，其中，通过WEB端对视频流单元进行延时判断，判断所述视频流单元的视频延时时间是否超过预设延时时间的步骤之前，还包括：
    通过WEB端上的视频处理组件对超文本传输协议的初始监控视频流进行处理；
    以预设周期为间隔，对所述监控视频流进行划分，得到若干个所述视频流单元。
  3. 如权利要求1所述的WEB端监控视频流低时延处理方法，其中，通过WEB端对视频流单元进行延时判断，判断所述视频流单元的视频延时时间是否超过预设延时时间的步骤之前，还包括：
    获取当前监控视频流的视频帧时间戳和预设周期的最后一帧的视频帧时间戳；
    根据所述当前监控视频流的视频帧时间戳和所述预设周期的最后一帧的视频帧时间戳，获取所述视频流单元的视频延时时间。
  4. 如权利要求3所述的WEB端监控视频流低时延处理方法，其中，所述通过所述WEB端对所述视频流单元的播放速度进行调整的步骤包括：
    所述WEB端根据当前所处的网络环境速度和监控视频流的码率获取预计可缓存的视频时间；
    根据所述预计可缓存时间，可接受延迟时间，所述视频延迟时间与所述预设周期获取所述视频流单元的播放速度。
  5. 如权利要求1所述的WEB端监控视频流低时延处理方法，其中，所述通过WEB端对视频流单元进行延时判断的步骤之前，还包括：
    所述WEB端创建所述监控视频流的链接后，向监控视频流端发送接收初始监控视频流的请求，以使所述初始监控视频流能够导入所述链接中；
    基于所述链接导入的所述初始监控视频流，所述WEB端创建视频流缓冲区；
    将所述初始监控视频流以预设的视频格式写入所述视频流缓冲区中。
  6. 如权利要求5所述的WEB端监控视频流低时延处理方法，其中，所述将所述初始监控视频流以预设的视频格式写入所述视频流缓冲区中的步骤之后，还包括：
    通过所述WEB端对所述视频格式中的所述监控视频流进行提取；
    基于所述WEB端中的视频处理组件，将所述监控视频流以预设周期为间隔进行划分，得到连续的多个视频流单元；
    基于视频显示组件将所述视频流单元进行逐个显示。
  7. 如权利要求1所述的WEB端监控视频流低时延处理方法，其中，所述判断所述视频流单元的视频延时时间是否超过预设延时时间的步骤之后，还包括：
    若所述视频流单元的视频延时时间未超过预设延时时间，则不对所述视频流单元的播放机制进行调整。
  8. 如权利要求1所述的WEB端监控视频流低时延处理方法，其中，所 述通过所述WEB端对所述视频流单元的播放速度进行调整的步骤包括：
    基于所述WEB端对所述视频流单元的播放速度进行预测计算，判断所述播放速度是否超过第一预设播放速度；
    若所述播放速度超过第一预设播放速度，则将所述播放速度调整为所述第一预设播放速度；
    若所述播放速度未超过第一预设播放速度，则不对所述播放速度进行调整。
  9. 如权利要求1所述的WEB端监控视频流低时延处理方法，其中，第一预设播放速度为用户设定或WEB端所计算得出的用户所能接受的最高播放速度，第二预设播放速度为用户设定或WEB端所计算得出的能够满足实时播放需要的最低播放速度，所述第二预设播放速度值小于所述第一预设播放速度值。
  10. 如权利要求9所述的WEB端监控视频流低时延处理方法，其中，所述通过所述WEB端对所述视频流单元的播放速度进行调整的步骤包括：
    若所述播放速度超过所述第一预设播放速度，则将所述播放速度调整为所述第一预设播放速度；
    若所述播放速度未超过所述第一预设播放速度且所述播放速度小于所述第二预设播放速度，则将所述播放速度调整为所述第二预设播放速度。
  11. 如权利要求1所述的WEB端监控视频流低时延处理方法，其中，所述WEB端监控视频流低时延处理方法还包括以下步骤：
    若通过所述WEB端检测到当前的视频流单元的播放结束，则检测所述监控视频流是否还存在下一视频流单元；
    若所述监控视频流还存在下一视频流单元，则执行所述通过WEB端对视频流单元进行延时判断的步骤；
    若所述监控视频流不存在下一视频流单元，则通过所述WEB端输出所述监控视频流播放结束的信息。
  12. 如权利要求1所述的WEB端监控视频流低时延处理方法，其中，输出的监控视频流播放结束的信息包括播放画面输出无监控视频流的字样和语音输出结束播放的提示。
  13. 一种WEB端监控视频流低时延处理装置，其中，所述装置包括：
    判断模块，用于通过WEB端对视频流单元进行延时判断，判断所述视频流单元的视频延时时间是否超过预设延时时间；
    若所述视频流单元的视频延时时间超过所述预设延时时间，判断所述视频延时时间是否超过预设追帧阈值；
    调整模块，用于若所述视频延时时间超过所述预设追帧阈值，则通过所述WEB端将所述视频流单元的播放机制调整为跳帧机制；
    若所述视频延时时间未超过所述预设追帧阈值，则通过所述WEB端对所述视频流单元的播放速度进行调整，其中，对所述视频流单元的播放速度进行调整指将所述视频流单元的播放机制调整为追帧机制。
  14. 一种移动终端设备，其中，所述移动终端设备包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，所述处理器执行计算机程序时实现权利要求1-12中任一项所述的WEB端监控视频流低时延处理方法的步骤。
  15. 一种计算机可读存储介质，其中，所述计算机可读存储介质上存储有计算机程序，所述计算机程序被处理器执行时实现权利要求1-12中任一项所述的WEB端监控视频流低时延处理方法的步骤。
PCT/CN2023/088477 2022-04-18 2023-04-14 Web端监控视频流低时延处理方法、装置、设备及介质 WO2023202495A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210407454.5A CN114710637A (zh) 2022-04-18 2022-04-18 Web端监控视频流低时延处理方法、装置、设备及介质
CN202210407454.5 2022-04-18

Publications (1)

Publication Number Publication Date
WO2023202495A1 true WO2023202495A1 (zh) 2023-10-26

Family

ID=82175338

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/088477 WO2023202495A1 (zh) 2022-04-18 2023-04-14 Web端监控视频流低时延处理方法、装置、设备及介质

Country Status (2)

Country Link
CN (1) CN114710637A (zh)
WO (1) WO2023202495A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114710637A (zh) * 2022-04-18 2022-07-05 深圳创维－Rgb电子有限公司 Web端监控视频流低时延处理方法、装置、设备及介质
CN115665486B (zh) * 2022-12-26 2023-03-21 理工全盛(北京)科技有限公司 用于无人机跟踪装置视频流web端播放的数据处理方法

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017210027A1 (en) * 2016-06-01 2017-12-07 Amazon Technologies, Inc. Catching up to the live playhead in live streaming
CN107846621A (zh) * 2017-09-28 2018-03-27 北京京东尚科信息技术有限公司 延时处理方法、系统和电子设备
CN111885334A (zh) * 2020-08-26 2020-11-03 杭州速递科技有限公司 一种音视频实时追帧缩小延迟的方法
CN114302230A (zh) * 2021-12-30 2022-04-08 苏州万店掌网络科技有限公司 一种前端播放组件优化方法、系统及存储介质
CN114710637A (zh) * 2022-04-18 2022-07-05 深圳创维－Rgb电子有限公司 Web端监控视频流低时延处理方法、装置、设备及介质

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107222715A (zh) * 2017-06-15 2017-09-29 杭州联吉技术有限公司 一种远程播放视频的方法、装置及计算机可读存储介质
CN107371061B (zh) * 2017-08-25 2021-03-19 普联技术有限公司 一种视频流播放方法、装置及设备

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017210027A1 (en) * 2016-06-01 2017-12-07 Amazon Technologies, Inc. Catching up to the live playhead in live streaming
CN107846621A (zh) * 2017-09-28 2018-03-27 北京京东尚科信息技术有限公司 延时处理方法、系统和电子设备
CN111885334A (zh) * 2020-08-26 2020-11-03 杭州速递科技有限公司 一种音视频实时追帧缩小延迟的方法
CN114302230A (zh) * 2021-12-30 2022-04-08 苏州万店掌网络科技有限公司 一种前端播放组件优化方法、系统及存储介质
CN114710637A (zh) * 2022-04-18 2022-07-05 深圳创维－Rgb电子有限公司 Web端监控视频流低时延处理方法、装置、设备及介质

Also Published As

Publication number Publication date
CN114710637A (zh) 2022-07-05

Similar Documents

Publication Publication Date Title
WO2023202495A1 (zh) Web端监控视频流低时延处理方法、装置、设备及介质
CN107948664B (zh) 直播间视频播放控制方法、装置及终端
KR101526081B1 (ko) 감시 카메라로 촬영된 디지털 비디오 스트림을 제어가능하게 시청하는 시스템 및 방법
US10447756B2 (en) Method and apparatus for improving quality of experience in sharing screen among devices, and recording medium thereof
KR102154800B1 (ko) 전자 장치의 데이터 스트리밍 방법 및 그 전자 장치
WO2017016339A1 (zh) 视频分享方法和装置、视频播放方法和装置
US10205879B2 (en) Electronic image stabilization frequency estimator
WO2021143479A1 (zh) 媒体流传输方法及系统
US8725947B2 (en) Cache control for adaptive stream player
US11930232B2 (en) Video playing control method, terminal device, server, and storage medium
US11249796B2 (en) Method and apparatus for enhanced assertion management in cloud media processing
US20140297883A1 (en) Method and apparatus for altering bandwidth consumption
JP2021505081A (ja) ビデオ伝送方法、ビデオ伝送装置、およびビデオ伝送システム、ならびにコンピュータ可読記憶媒体
US20130166769A1 (en) Receiving device, screen frame transmission system and method
US20120154678A1 (en) Receiving device, screen frame transmission system and method
TW201608898A (zh) 視訊會議處理方法及系統
CN113141541A (zh) 码率切换方法、装置、设备及存储介质
US20170171492A1 (en) Display control apparatus, imaging apparatus, and display control method
US20170070589A1 (en) Information processing device and recording medium
CN102547204B (zh) 接收装置、荧幕画面传输系统以及其传输方法
CN112887404B (zh) 一种音频传输控制方法、设备及计算机可读存储介质
US20210194610A1 (en) Monitoring video broadcasts
CN115278047A (zh) 拍摄方法、装置、电子设备和存储介质
CN109788372B (zh) 一种流媒体的播放方法及相关装置
CN112866745A (zh) 流媒体视频数据处理方法、装置、计算机设备和存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23791150

Country of ref document: EP

Kind code of ref document: A1