WO2015000337A1 - 视频传输方法及设备 - Google Patents

视频传输方法及设备 Download PDF

Info

Publication number
WO2015000337A1
WO2015000337A1 PCT/CN2014/077164 CN2014077164W WO2015000337A1 WO 2015000337 A1 WO2015000337 A1 WO 2015000337A1 CN 2014077164 W CN2014077164 W CN 2014077164W WO 2015000337 A1 WO2015000337 A1 WO 2015000337A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
data packet
video data
lost
frame
Prior art date
Application number
PCT/CN2014/077164
Other languages
English (en)
French (fr)
Inventor
刘继旺
王峰
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2015000337A1 publication Critical patent/WO2015000337A1/zh

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/637Control signals issued by the client directed to the server or network components
    • H04N21/6375Control signals issued by the client directed to the server or network components for requesting retransmission, e.g. of data packets lost or corrupted during transmission from server
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L1/00Arrangements for detecting or preventing errors in the information received
    • H04L1/12Arrangements for detecting or preventing errors in the information received by using return channel
    • H04L1/16Arrangements for detecting or preventing errors in the information received by using return channel in which the return channel carries supervisory signals, e.g. repetition request signals
    • H04L1/18Automatic repetition systems, e.g. Van Duuren systems
    • H04L1/1867Arrangements specially adapted for the transmitter end
    • H04L1/1874Buffer management
    • H04L1/1877Buffer management for semi-reliable protocols, e.g. for less sensitive applications like streaming video
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80Responding to QoS
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/24Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
    • H04N21/2402Monitoring of the downstream path of the transmission network, e.g. bandwidth available
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44209Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network

Definitions

  • the present invention relates to the field of network communication technologies, and in particular, to a video transmission method and device applied to a network video monitoring system.
  • the network video surveillance system includes a client, a video monitoring platform, and a video monitoring front end.
  • the front-end video is sent to the video monitoring platform, and the client requests the video stream from the video monitoring platform.
  • the front end of video surveillance has evolved from analog to digital, from standard definition to high definition.
  • the video of the client has a stuck, short interruption, etc., which is not smooth enough;
  • the key information of the client video is not clear enough (such as license plate characters, face avatars); when the user is watching real-time video, the user is most concerned about smooth and uninterrupted, and the mosaic of non-critical areas does not affect the overall monitoring effect.
  • the video used in the video surveillance field can be divided into two types:
  • Real-time video is required to generate real-time alerts to users to improve the timeliness and effectiveness of event processing. This requires better real-time video.
  • Video recording ... It is necessary to do post-processing of the video to make a judgment on the event that has occurred. This requires a higher quality video. For example, if the public security industry detects a certain case, it needs to be under certain circumstances.
  • the video # ⁇ multiple processing.
  • the protocols for transmitting video streams are the reliable Transmission Control Protocol (TCP) protocol and the unreliable User Datagram Protocol (UDP) protocol.
  • TCP Transmission Control Protocol
  • UDP Unreliable User Datagram Protocol
  • the most widely used method is to introduce an automatic repeat request (ARQ) mechanism in the UDP protocol.
  • the UDP protocol is a connectionless protocol.
  • the source and the terminal do not need to establish a connection.
  • the data is fetched from the source and the packet is thrown onto the network as much as possible.
  • the ARQ recovers the erroneous data message by the receiver requesting the sender to retransmit the erroneous data. This ensures transmission quality while maintaining transmission speed.
  • the embodiment of the invention provides a video transmission method and system, which solves the problem that the existing video transmission technology cannot provide video according to the video requirement of the user, and the cost of the device is high.
  • a video transmission method characterized in that the method comprises the following steps:
  • the video monitoring device detects whether the received video data packet is lost
  • the video monitoring device queries the video service type request sent by the user when the video data packet is lost; if the video service type request is the video type, the video source device sends a request for retransmitting the lost video data packet;
  • the video monitoring device queries the type of the lost video data packet when the video service type request is a real-time type; if the video data packet type is the I frame data, the video monitoring device sends a retransmission lost video data packet to the video source device.
  • the video monitoring device queries whether the network reaches the congestion threshold when the type of the video data packet is not the I frame data; if the network does not reach the congestion threshold, the video source device sends a request for retransmitting the lost video data packet;
  • the video monitoring device calculates the lost video data packet when the network reaches the congestion threshold, and sends a video playback notification to the video playback unit.
  • the video source type request includes: real time browsing, real time recording, video downloading, or video playback.
  • the calculation formula of the lost video data packet is:
  • the video packet for the frame For the first video packet of the lost frame, the video packet for the frame total;
  • a video transmission method characterized in that the method comprises the following steps:
  • the video source device encodes the video source by frame to obtain a video frame.
  • the video source device performs packetization on the video frame to obtain a video data packet.
  • the video source device sends the video data packet to the video monitoring device, and sends a video data packet corresponding to the retransmission request according to the retransmission request sent by the video monitoring device.
  • the video source device encodes a video source by using a frame, and the obtained video frame is specifically:
  • the video source device decomposes the video source into independent video frames, and encodes the independent video frames in chronological order to obtain video frames.
  • the video source device performs packetization on the video frame, and the obtained video data packet is specifically:
  • the video source device divides the video frame into video data packets according to a preset size, and encodes video data packets belonging to the same video frame.
  • the video source device sends the video data packet to a video monitoring device, and sends a retransmission request corresponding to the retransmission request sent by the video monitoring device.
  • the video package is specifically:
  • the video source device sends the video source to the video monitoring device in the form of a video data packet; the video monitoring device sends the information of the video data packet that needs to be retransmitted to the video source device, and the video source device according to the information of the video data packet, the corresponding The video data packet or the video frame corresponding to the video data packet is sent to the video monitoring device.
  • a video transmission device includes: a loss detection unit, configured to detect whether a received video data packet is lost;
  • the video service type query unit is configured to query a video service type request sent by the user when the video data packet is lost; and if the video service type request is a video type, send the video source device to the video source device. Retransmitting a request for a lost video packet;
  • a video data packet query unit configured to query a type of the lost video data packet if the video service type request is a real-time type; if the video data packet type is an I frame data, the video monitoring device sends a retransmission to the video source device Request for lost video packets;
  • the network query unit is configured to query whether the network reaches a congestion threshold when the type of the video data packet is not the I frame data; if the network does not reach the congestion threshold, send the retransmitted lost video data packet to the video source device.
  • the video data packet calculating unit is configured to calculate a lost video data packet when the network reaches a congestion threshold, and send a video playback notification to the video playing unit.
  • the loss detecting unit further includes: a counter, configured to count the lost video data packets.
  • the network query unit further includes: an alarm, configured to send an alarm signal when the network reaches a congestion threshold.
  • the fourth aspect provides a video transmission device, where the device includes: an encoding unit, configured to encode a video source by a frame to obtain a video frame;
  • a packetizing unit configured to perform packetization on the video frame to obtain a video data packet
  • a video data packet sending unit configured to send the video data packet to the video monitoring device, and send a video data packet corresponding to the retransmission request according to the retransmission request sent by the video monitoring device.
  • the coding unit includes:
  • a splitter that splits the video source into separate video frames.
  • the coding unit includes:
  • An encoder configured to encode the independent video frames in chronological order.
  • the video selection of the user is clearly known by querying the video type request sent by the user;
  • FIG. 1 is a flow chart of a first video transmission method of the present invention
  • FIG. 2 is a flow chart of a second video transmission method of the present invention.
  • FIG. 3 is a schematic structural diagram of a first video transmission device of the present invention.
  • FIG. 4 is a schematic structural diagram of a second video transmission device of the present invention.
  • FIG. 5 is a block diagram of an embodiment of the present invention.
  • the invention provides a video transmission method and device.
  • a flowchart of a video transmission method of the present invention is as shown in FIG. 1 , including the following steps:
  • the video monitoring device detects whether the received video data packet is lost, and if the video data packet is not lost, sends a video playback notification to the video playing unit;
  • the detecting whether the video data packet is lost is specifically: detecting whether the video data packet is lost one by one according to the encoding of the video data packet, and if the video data packet corresponding to the encoding is missing or the coding sequence is disordered, the video data packet is regarded as being lost.
  • the video monitoring device queries the video service type (real-time browsing, real-time recording, video downloading, or video playback) sent by the user; if the video service type request is the recording type, then the video source is The device issues a request to retransmit the lost video data packet;
  • the video service type request is a real-time request
  • the video monitoring device queries for the lost video data.
  • the type of the packet if the type of the video data packet is I frame data, the video monitoring device sends a request to the video source device to retransmit the lost video data packet;
  • the video monitoring device queries whether the network reaches the congestion threshold when the video data packet type is not the I frame data. If the network does not reach the congestion threshold, the video source device sends a retransmission to the video source device. Request for lost video packets;
  • the network reaches a congestion threshold, and the video monitoring device calculates the lost video data packet and sends a video playback notification to the video playback unit.
  • the calculated formula of the lost video data packet is:
  • the total number of video packets for the frame For the first video packet of the lost frame, the total number of video packets for the frame;
  • In ⁇ g is the averaging operation.
  • FIG. 3 A schematic structural diagram of a corresponding video transmission device is shown in FIG. 3, and the device includes:
  • the loss detecting unit 1 is configured to detect whether the received video data packet is lost, and if the video data packet is not lost, send a video playback notification to the video playing unit; wherein detecting whether the video data packet is lost is specifically: according to the encoding of the video data packet Detecting whether the video data packet is lost one by one, if it is found that the corresponding encoded video data packet is missing or the coding sequence is disordered, it is regarded as loss of the video data packet; the loss detecting unit 1 includes a counter for performing the lost video data packet. count.
  • the video service type query unit 2 is configured to query a video service type request sent by the user when the video data packet is lost; and if the video service type request is a video type, send a video data packet to the video source device to retransmit the lost video data packet.
  • the video data packet query unit 3 is configured to query the type of the lost video data packet if the video service type request is a real-time type; if the video data packet type is the I frame data, the video monitoring device sends a heavy weight to the video source device. a request to transmit a lost video packet;
  • the network query unit 4 is configured to query whether the network reaches a congestion threshold when the type of the video data packet is not the I frame data; if the network does not reach the congestion threshold, the retransmission is sent to the video source device.
  • the request for the lost video data packet; the network query unit 4 further includes an alarm for sending an alarm signal when the network reaches the congestion threshold.
  • the video data packet calculating unit 5 is configured to calculate a lost video data packet when the network reaches a congestion threshold, and send a video play notification to the video playing unit.
  • Another video transmission method of the present invention is characterized in that the method includes the following steps:
  • the video source device encodes a video source according to a frame to obtain a video frame;
  • the video source device decomposes the video source into independent video frames, and encodes the independent video frames in chronological order to obtain video frames.
  • the video source device performs packetization on the video frame to obtain a video data packet. Specifically, the video source device divides the video frame into video data packets according to a preset size, and encodes the video data packets belonging to the same video frame.
  • the video source device sends the video data packet to the video monitoring device, and sends a video data packet corresponding to the retransmission request according to the retransmission request sent by the video monitoring device. Specifically:
  • the video source device sends the video source to the video monitoring device in the form of a video data packet; the video monitoring device sends the information of the video data packet that needs to be retransmitted to the video source device, and the video source device according to the information of the video data packet, the corresponding The video data packet or the video frame corresponding to the video data packet is sent to the video monitoring device.
  • FIG. 4 A schematic structural diagram of a corresponding video transmission device is shown in FIG. 4, and the device includes:
  • the encoding unit 6 is configured to encode the video source by frame to obtain a video frame.
  • the encoding unit 6 includes: a splitter, configured to decompose the video source into independent video frames; and an encoder, configured to perform the independent The video frames are encoded in chronological order.
  • a packetizing unit 7 configured to perform packetization on the video frame to obtain a video data packet
  • the video data packet sending unit 8 is configured to send the video data packet to the video monitoring device, and send a video data packet corresponding to the retransmission request according to the retransmission request sent by the video monitoring device;
  • the packetizing unit 7 is connected; the packetizing unit 7 is connected to the video packet transmitting unit 8.
  • the video surveillance system consists of a video source device, a video surveillance device (including storage), and a client: the video source device includes a network camera, an analog camera, an encoder, and a digital video recorder.
  • Video surveillance equipment includes management servers, media servers, platform software, and disk arrays.
  • the client device is responsible for running the client software. After connecting to the server, different services can be selected, such as: live browsing, real-time recording, video downloading, video playback, and the like.
  • the video source device needs to do the following:
  • the video surveillance platform needs to do the following:
  • step 3 Detecting the video service type request sent by the client, whether it is a real-time video type or a video video type, if it is a real-time video type, performing step 3, if it is a video recording, executing step 5;
  • step 4 Check whether the network congestion condition reaches the preset congestion threshold. If the congestion threshold is not reached, go to step 5. If the congestion threshold is reached, go to step 6.
  • the frame data is divided into "video data packets, which represent the zth data packet of the frame (1 ⁇ ⁇ « ), which is used to represent the network congestion at the moment, and the network congestion is wide.
  • the value is represented by A
  • the P frame data is represented by P
  • the /frame data is represented by /. See the formula (1) for the conditions that need to be retransmitted, and the formula (2) for the conditions that do not need to be retransmitted.
  • the packet loss data calculated without retransmission is the formula (3).
  • the user selects the video and video service on the client side, and the video monitoring platform takes the video stream from the front end and transmits it to the client for viewing. During the viewing process, the platform detects the loss of video data. 4) Set the threshold ⁇ to 80, as follows:
  • the 8th video data packet is lost in the 5th frame data, and the frame data belongs to the /frame data, and is encoded into 200 video data packets, and the network congestion is swung in the 50-60 interval;
  • the 7th frame data is lost in the 10th and 15th video data packets, and the frame belongs to the P frame data, and is encoded into 50 video data packets, and f 7 is swung in the 80-90 interval;
  • the 17th frame data is lost in the 13th and 18th video data packets, the frame belongs to the P frame data, and is encoded into 45 video data packets, and f 17 is swung in the 40-50 interval;
  • the 34th frame data is lost in the 14th, 23rd, 33rd, etc. three video data packets, the frame belongs to / frame data, a total of 280 video data packets are encoded, K M swings in the 80-90 range;
  • the processing strategy is as follows:
  • the 8th video packet of the 5th frame requests the video source device to retransmit
  • the 13th and 18th video packets of the 17th frame request the video source device to retransmit;
  • the user selects the real-time video service on the client side, and the video monitoring platform takes the video stream from the front end and transmits it to the platform for recording.
  • the platform detected the packet loss of the video packet, assuming a threshold A of 80, as follows:
  • the 8th video data packet is lost in the 5th frame data, and the frame data belongs to the I frame data, and is encoded into 200 video data packets, and the network congestion is swung in the 50-60 interval;
  • the 7th frame data is lost in the 10th and 15th video data packets, and the frame belongs to the P frame data, and is encoded into 50 video data packets, and f 7 is swung in the 80-90 interval;
  • the 17th frame data is lost in the 13th and 18th video data packets, the frame belongs to the P frame data, and is encoded into 45 video data packets, and f 17 is swung in the 40-50 interval;
  • the 34th frame data is lost in the 14th, 23rd, 33rd and other three video packets, the frame belongs to the I frame data, and is encoded into 280 video data packets, and f 34 is swung in the 80-90 interval;
  • the processing strategy is as follows:
  • the 8th video packet of the 5th frame requests the video source device to retransmit
  • the 13th and 18th video packets of the 17th frame request the video source device to retransmit;
  • compositional connection relationship corresponding to the device of the present invention is as follows:
  • the video source device includes an encoding unit 6, a packetizing unit 7, and a video packet transmitting unit 8.
  • the encoding unit 6 and the packetizing unit 7 are connected; the packetizing unit 7 is connected to the video packet transmitting unit 8.
  • the client includes a control unit 9 and a video playback unit 10.
  • the video monitoring device includes a loss detecting unit 1, a video service type query unit 2, a video data packet query unit 3, a network query unit 4, and a video data packet calculating unit 5.
  • the loss detecting unit 1 is respectively connected to the video service type query unit 2, the video data packet transmitting unit 8 and the video playing unit 10; the video service type query unit 2 and the video data packet query unit 3, the video data packet transmitting unit 8 and the control, respectively
  • the unit 9 is connected;
  • the video data packet query unit 3 is respectively connected to the network query unit 4 and the video data packet transmitting unit 8;
  • the network query unit 4 is connected to the video data packet transmitting unit 8 and the video data packet computing unit 5, respectively;
  • the unit 5 is connected to the video playback unit 10.
  • the video source device is configured to encode the video source by the encoding unit 6 to obtain a video frame; the packetizing unit 7 subpackages the video frame to obtain a video data packet; the video data packet sending unit 8 The video data packet is sent to the video monitoring device, and the video data packet corresponding to the retransmission request is sent according to the retransmission request sent by the video monitoring device;
  • the loss detecting unit 1 of the video monitoring device detects whether the video data packet from the video packet transmitting unit 8 is lost, and if the video data packet is not lost, sends a video playback notification to the video playback unit 10 of the client; if the video data packet is lost
  • the video service type query unit 2 queries the video service type request sent by the control unit 9 of the client; if the video service type request is the video type, the video data packet sending unit 8 sends a request for retransmitting the lost video package.
  • the video data packet sending unit 8 resends the corresponding video data packet to the loss detecting unit 1 according to the request; if the video service type request is a real-time type, the video data packet query unit 3 queries the type of the lost video data packet; If the type of the video data packet is I frame data, the video data packet sending unit 8 sends a request for retransmitting the lost video data packet. Otherwise, the video data packet query unit 3 sends a network status query request to the network query unit 4; Unit 4 queries whether the network reaches The congestion threshold value, if the congestion threshold is not reached, sends a request for retransmission of the lost video data packet to the video data packet transmitting unit 8, otherwise, the network query unit 4 issues a calculation video data packet to the video data packet calculation unit 5. The request, video packet calculation unit 5 calculates the lost video data packet based on the other video data packets, and plays it through the video playback unit 10.
  • the present invention has different processing modes for different service types of users, and is more in line with the user's demand for video quality; for important I frames in the video, retransmission can ensure the authenticity of the video, and can satisfy the user's authenticity of the video.
  • the error concealment method can alleviate the network congestion, and can ensure that important information in the video stream is not lost.
  • aspects of the invention may be embodied as a system, method, or computer program product.
  • aspects of the invention, or possible implementations of various aspects may be in the form of an entirely hardware embodiment, an entirely software embodiment (including firmware, resident software, etc.), or a combination of software and hardware aspects, They are collectively referred to herein as "circuits,""modules," or “systems.”
  • aspects of the invention, or possible implementations of various aspects may take the form of a computer program product, which is a computer readable program code stored on a computer readable medium.
  • the computer readable medium can be a computer readable signal medium or a computer readable storage medium.
  • the computer readable storage medium includes, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any suitable combination of the foregoing, such as random access memory (RAM), read only memory (ROM), Erase programmable read-only memory (EPROM or flash memory), optical fiber, portable read-only memory (CD-ROM:).
  • the processor in the computer reads the computer readable program code stored in the computer readable medium, such that the processor can perform the functional actions specified in each step or combination of steps in the flowchart; A device that functions as specified in each block, or combination of blocks.
  • the computer readable program code can be executed entirely on the user's computer, partly on the user's computer, as a separate software package, partly on the user's computer and partly on the remote computer, or entirely on the remote computer or server.
  • the functions noted in the various steps of the flowchart, or in the blocks in the block diagrams may not occur in the order noted.
  • two steps, or two blocks, shown in succession may in fact be executed substantially simultaneously, or the blocks may sometimes be executed in the reverse order.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本发明公开了网络通信技术领域的视频传输方法及设备。本发明分别通过视频数据包是否丢失、用户发来的视频源类型请求、视频数据包的类型和网络是否达到拥塞阈值等步骤对是否重传视频数据进行判断。本发明根据视频业务类型、视频数据包类型及网络状况对视频进行选择性重传视频数据包,减小了网络负荷,在保证视频播放流畅性的同时最大限度的保证了视频数据的准确性。

Description

视频传输方法及设备 本申请要求于 2013 年 7 月 2 日提交中国专利局、 申请号为 201310275059.7、发明名称为"视频传输方法及设备"的中国专利申请的优 先权, 其全部内容通过引用结合在本申请中。
技术领域
本发明涉及网络通信技术领域, 特别涉及应用于网络视频监控系统 的视频传输方法及设备。
背景技术
网络视频监控系统包含客户端、 视频监控平台和视频监控前端, 前端釆 集视频发给视频监控平台, 客户端从视频监控平台请求视频流。 视频监控前 端由模拟发展为数字, 由标清发展为高清。
在现有的主流视频监控系统中, 均需要支持清晰度越来越高的摄像 机, 如 720P、 1080P的摄像机。 这样就带来了对网络带宽的要求越来越 高。 常见的问题有:
客户端的视频存在卡顿、 短暂中断等不够流畅;
客户端视频关键信息不够清晰 (如车牌字符、 人脸头像) ; 对于用户在观看实时视频时, 用户最关心的是流畅不中断, 非关键 区域小的马赛克并不会对整体监控效果产生影响。
对于用户在观看录像视频或者是播放下载的录像视频时, 最关心的 是视频是否清晰, 不清楚的视频在下载时需要重传以满足用户对清晰度 的要求, 否则在使用视频时会造成对关键事件的误判。
从用户使用视频的作用来看, 视频监控领域使用的视频可以分为两 种类型:
实时视频…需要对视频做实时处理以对用户产生实时的告警, 以提高事 件处理的及时性和有效性, 这种要求视频实时性更好。 如: 视频会议、 智能 分析中的行为分析;
录像视频…需要对视频做事后处理以对已发生事件做出判断依据, 这种 要求视频的质量更高。 如公安行业对某一件案件的侦破, 需要对某一场景下 的视频 #丈多种处理。
在视频监控领域中, 传输视频流的协议有可靠的传输控制协议 TCP ( Transmission Control Protocol )协议和不可靠的用户数据包协议 UDP ( User Datagram Protocol )协议。
为了保证在传输视频流时能使用到两个协议的优点, 目前使用较为广泛 的方式是: 在 UDP协议中引入自动重传请求 ARQ ( Automatic Repeat Request ) 机制。 UDP协议是一个无连接协议, 传输数据之前源端和终端不需要建立连 接, 当需要传送数据时就从源端抓取数据, 并尽可能的把数据包扔到网络 上。 ARQ是通过接收方请求发送方重传出错的数据来恢复出错数据报文。 这 样就可以在保证传输速度的同时保证传输质量。
现有技术方案在编码端需要做如下事情:
1.读取重传请求信息和数据信息单元;
2.将数据信息单元中的视频流打包后发送到解码端, 并计算包重要性;
3.统计包重要性的分布函数;
4.计算重传门限值, 根据发送速率、 丟包率、 网络可承载的数据包速率 等因素来计算;
5.判断是否重传丟包, 若丟包的包重要性值大于重传门限值, 则重传, 否则不重传;
在解码端需要做如下事情:
1.检测是否有丟包, 若在时延范围内没有收到包, 则认为该包已丟失, 否则认为没有丟包, 进行解码封装和视频解码;
2.如果判断该包丟失, 则将丟包的包序号作为重传请求发送到编码端 现有技术的缺点如下:
1.在编码端需要实现统计包重要性、 重传门限值、 判断是否重传等功 能, 对于编码端的性能要求很高, 也造成了成本高
2.对于釆用包重要性大于重传门限值来判断丟包是否需要重传, 仅仅包 重要性一个方面来考虑, 比较片面; 3.对于产生了丟包但是由于包重要性小于重传门限值引起的没有 重传的分组直接忽略会造成某帧无法解码或者在解码后出现马赛克情 况。
发明内容
本发明实施例提供了视频传输方法及系统, 以解决现有视频传输技术存 在的无法根据用户的视频需求提供视频、 设备成本高等不足。
为了解决上述技术问题, 本发明实施例公开了如下技术方案:
第一方面, 提供了一种视频传输方法, 其特征是, 该方法包括以下步 骤:
视频监控设备检测接收的视频数据包是否丟失;
视频监控设备在视频数据包丟失的情况下查询用户发来的视频业务类型 请求; 若视频业务类型请求为录像类型, 则向视频源设备发出重传丟失的视 频数据包的请求;
视频监控设备在视频业务类型请求为实时类型的情况下查询丟失的视频 数据包的类型; 若视频数据包的类型为 I帧数据, 则视频监控设备向视频源设 备发出重传丟失的视频数据包的请求;
视频监控设备在视频数据包的类型不为 I帧数据的情况下查询网络是否达 到拥塞阔值; 若网络没有达到拥塞阔值,则向视频源设备发出重传丟失的视频 数据包的请求;
视频监控设备在网络达到拥塞阔值的情况下计算丟失的视频数据包,并向 视频播放单元发送视频播放通知。
在第一方面的第一种可能的实现方式中, 所述视频源类型请求包括: 实 时浏览、 实时录像、 录像下载或录像回放。
在第一方面的第二种可能的实现方式中, 所述丟失的视频数据包的计算 公式为:
其中:
为丟失的 帧的第 I个视频数据包, 《为 帧的视频数据包 的总数;
ίΠ^为求均值操作。
第二方面, 提供了一种视频传输方法, 其特征是, 该方法包括以下步 骤:
视频源设备对视频源按帧进行编码, 得到视频帧;
视频源设备对所述视频帧进行分包, 得到视频数据包;
视频源设备将所述视频数据包发送给视频监控设备, 并根据所述视频监 控设备发来的重传请求发送重传请求对应的视频数据包。
在第二方面的第一种可能的实现方式中, 所述视频源设备对视频源按帧 进行编码, 得到视频帧具体为:
视频源设备对将视频源分解为独立的视频帧,对独立的视频帧按时间先后 顺序进行编码, 得到视频帧。
在第二方面的第二种可能的实现方式中, 所述视频源设备对所述视频帧 进行分包, 得到视频数据包具体为:
视频源设备将视频帧按预设大小分成视频数据包,并对属于同一个视频帧 的视频数据包进行编码。
在第二方面的第三种可能的实现方式中, 所述视频源设备将所述视频数 据包发送给视频监控设备, 并根据所述视频监控设备发来的重传请求发送重 传请求对应的视频数据包具体为:
视频源设备以视频数据包的形式将视频源发送给视频监控设备;视频监控 设备将需要重传的视频数据包的信息发送给视频源设备,视频源设备根据视频 数据包的信息,将对应的视频数据包或该视频数据包对应的视频帧发送给视频 监控设备。
第三方面, 提供了一种视频传输设备, 其特征是, 该设备包括: 丟失检测单元, 用于检测接收的视频数据包是否丟失;
视频业务类型查询单元, 用于在视频数据包丟失的情况下查询用户发来 的视频业务类型请求; 若视频业务类型请求为录像类型, 则向视频源设备发 出重传丟失的视频数据包的请求;
视频数据包查询单元, 用于在视频业务类型请求为实时类型的情况下查 询丟失的视频数据包的类型; 若视频数据包的类型为 I帧数据, 则视频监控设 备向视频源设备发出重传丟失的视频数据包的请求;
网络查询单元, 用于在视频数据包的类型不为 I帧数据的情况下查询网络 是否达到拥塞阔值; 若网络没有达到拥塞阔值,则向视频源设备发出重传丟失 的视频数据包的请求;
视频数据包计算单元, 用于在网络达到拥塞阔值的情况下计算丟失的视 频数据包, 并向视频播放单元发送视频播放通知。
在第三方面的第一种可能的实现方式中, 所述丟失检测单元还包括: 计数器, 用于对丟失的视频数据包进行计数。
在第三方面的第二种可能的实现方式中, 所述网络查询单元还包括: 报警器, 用于网络达到拥塞阔值时发出报警信号。
第四方面, 提供了一种视频传输设备, 其特征是, 该设备包括: 编码单元, 用于对视频源按帧进行编码, 得到视频帧;
分包单元, 用于对所述视频帧进行分包, 得到视频数据包;
视频数据包发送单元, 用于将所述视频数据包发送给视频监控设备, 并 根据所述视频监控设备发来的重传请求发送重传请求对应的视频数据包。
在第四方面的第一种可能的实现方式中, 所述编码单元包括:
拆分器, 用于将视频源分解为独立的视频帧。
在第四方面的第二种可能的实现方式中, 所述编码单元包括:
编码器, 用于对所述独立的视频帧按时间先后顺序进行编码。
本发明实施例中, 通过查询用户发来的视频类型请求, 清楚地知道了用 户的视频选择;
通过查询丟失的视频包的类型选择性重传重要的视频包, 既简化了步 骤, 又保证了实时视频的流畅显示, 增强了用户体验;
通过查询网络是否达到拥塞阔值, 选择性对视频包进行重传, 减 小了网络负荷, 提高了视频播放的流畅性。
附图说明
为了更清楚地说明本发明实施例或现有技术中的技术方案, 下面将对实 施例或现有技术描述中所需要使用的附图作一简单地介绍, 显而易见地, 下 面描述中的附图是本发明的一些实施例, 对于本领域普通技术人员来讲, 在 不付出创造性劳动的前提下, 还可以根据这些附图获得其他的附图。
图 1是本发明的第一种视频传输方法的流程图;
图 2是本发明的第二种视频传输方法的流程图;
图 3是本发明的第一种视频传输设备的结构示意图;
图 4是本发明的第二种视频传输设备的结构示意图;
图 5是本发明实施例的结构图。
具体实施方式
为使本发明实施例的目的、 技术方案和优点更加清楚, 下面将结合本发 明实施例中的附图, 对本发明实施例中的技术方案进行清楚地描述, 显然, 所描述的实施例是本发明一部分实施例, 而不是全部的实施例。 基于本发明 中的实施例, 本领域普通技术人员在没有做出创造性劳动前提下所获得的所 有其他实施例, 都属于本发明保护的范围。
为了解决现有视频传输技术存在的无法根据用户的视频需求提供视频、 设备成本高等不足。 本发明提出了视频传输方法及设备。
本发明的一种视频传输方法的流程图如图 1所示, 包括以下步骤: 视频监控设备检测接收的视频数据包是否丟失, 若视频数据包没有丟 失, 则向视频播放单元发送视频播放通知; 其中,检测视频数据包是否丟失具 体为: 按视频数据包的编码逐个检测视频数据包是否丟失, 若发现对应编码的 视频数据包缺失或所述编码顺序出现混乱, 则视为视频数据包发生丟失; 否则,若视频数据包出现丟失, 视频监控设备查询用户发来的视频业务类 型(实时浏览、 实时录像、 录像下载或录像回放等)请求; 若视频业务类型请 求为录像类型, 则向视频源设备发出重传丟失的视频数据包的请求;
否则,视频业务类型请求为实时请求,视频监控设备查询丟失的视频数据 包的类型; 若视频数据包的类型为 I帧数据, 则视频监控设备向视频源设备发 出重传丟失的视频数据包的请求;
否则, 视频数据包的类型不为 I帧数据, 视频监控设备查询视频数据包类 型不为 I帧数据时网络是否达到拥塞阔值; 若网络没有达到拥塞阔值, 则向视 频源设备发出重传丟失的视频数据包的请求;
否则, 网络达到拥塞阔值, 视频监控设备计算丟失的视频数据包, 并向视 频播放单元发送视频播放通知。
其中, 丟失的视频数据包的计算公式为: 其中:
.为丟失的 帧的第 I个视频数据包, 《为 帧的视频数据包 的总数;
in^g为求均值操作。
对应的视频传输设备的结构示意图如图 3所示, 该设备包括:
丟失检测单元 1 , 用于检测接收的视频数据包是否丟失, 若视频数据包没 有丟失, 则向视频播放单元发送视频播放通知; 其中,检测视频数据包是否丟 失具体为: 按视频数据包的编码逐个检测视频数据包是否丟失, 若发现对应编 码的视频数据包缺失或所述编码顺序出现混乱, 则视为视频数据包发生丟失; 丟失检测单元 1包括计数器, 用于对丟失的视频数据包进行计数。
视频业务类型查询单元 2 , 用于在视频数据包丟失的情况下查询用户发来 的视频业务类型请求; 若视频业务类型请求为录像类型, 则向视频源设备发 出重传丟失的视频数据包的请求;
视频数据包查询单元 3 , 用于在视频业务类型请求为实时类型的情况下查 询丟失的视频数据包的类型; 若视频数据包的类型为 I帧数据, 则视频监控设 备向视频源设备发出重传丟失的视频数据包的请求;
网络查询单元 4 , 用于在视频数据包的类型不为 I帧数据的情况下查询网 络是否达到拥塞阔值; 若网络没有达到拥塞阔值,则向视频源设备发出重传丟 失的视频数据包的请求; 网络查询单元 4还包括报警器, 用于网络达到拥塞阔 值时发出报警信号。
视频数据包计算单元 5 , 用于在网络达到拥塞阔值的情况下计算丟失的视 频数据包, 并向视频播放单元发送视频播放通知。
本发明的另一种视频传输方法, 其特征是, 该方法包括以下步骤: 视频源设备对视频源按帧进行编码, 得到视频帧; 具体为:
视频源设备对将视频源分解为独立的视频帧,对独立的视频帧按时间先后 顺序进行编码, 得到视频帧。
视频源设备对所述视频帧进行分包, 得到视频数据包; 具体为: 视频源设备将视频帧按预设大小分成视频数据包,并对属于同一个视频帧 的视频数据包进行编码。
视频源设备将所述视频数据包发送给视频监控设备, 并根据所述视频监 控设备发来的重传请求发送重传请求对应的视频数据包。 具体为:
视频源设备以视频数据包的形式将视频源发送给视频监控设备;视频监控 设备将需要重传的视频数据包的信息发送给视频源设备,视频源设备根据视频 数据包的信息,将对应的视频数据包或该视频数据包对应的视频帧发送给视频 监控设备。
对应的视频传输设备的结构示意图如图 4所示, 该设备包括:
编码单元 6 , 用于对视频源按帧进行编码, 得到视频帧; 所述编码单元 6 包括: 拆分器, 用于将视频源分解为独立的视频帧; 编码器, 用于对所述独立 的视频帧按时间先后顺序进行编码。
分包单元 7 , 用于对所述视频帧进行分包, 得到视频数据包;
视频数据包发送单元 8 , 用于将所述视频数据包发送给视频监控设备, 并 根据所述视频监控设备发来的重传请求发送重传请求对应的视频数据包; 所述编码单元 6和分包单元 7连接; 分包单元 7和视频数据包发送单元 8连 接。
以下通过一个实施例对本发明进行说明: 视频监控系统由视频源设备, 视频监控设备(包括存储), 以及客户端组 成: 视频源设备包含网络摄像机、 模拟摄像机、 编码器、 数字视频录像机
DVR ( Digital Video Recorder )等设备, 负责将现场图像压缩编码成媒体流以 便网络传输。 视频监控设备包括管理服务器、 媒体服务器、平台软件和磁盘阵 列等。 客户端设备负责运行客户端软件, 连接到服务器后, 可选择不同的业 务, 例如: 实况浏览、 实时录像、 录像下载、 录像回放等。
视频源设备需要做的事情如下:
1.对视频源进行编码, 并对每一帧编码数据进行分包;
2.在一定时间内, 当收到视频监控设备发出的重传请求时, 将緩存中的 需要重传的视频包重传;
视频监控平台需要做如下事情:
1.检测收到的视频数据包是否有丟包情况, 如果没有丟包, 则执行步骤 7 , 如果有丟包, 则执行步骤 2;
2.检测客户端发出的视频业务类型请求, 是属于实时视频类型还是录像 视频类型, 如果是实时视频类型, 则执行步骤 3 , 如果是录像视频, 则执行步 骤 5;
3.检测视频数据包是属于 I帧数据还是 P帧数据, 如果是 I帧数据, 则执行 步骤 5 , 如果不是 I帧数据, 则执行步骤 4;
4.检测网络拥塞情况是否达到预设的拥塞阔值, 如果没达到拥塞阔值, 则执行步骤 5 , 如果达到了拥塞阈值, 则执行步骤 6;
5.请求重传丟包数据;
6.使用緩存的视频包来计算丟失的视频包;
7.緩存数据, 播放视频;
假设 来代表一帧数据, 并且该帧数据被分成《个视频数据包, 用 .来 代表 帧第 z个数据包( 1≤ ≤« ) , 使用 来表示 ·时刻的网络拥塞情况, 网络拥塞的阔值使用 A来表示, P帧数据使用 P来表示, /帧数据使用 /来表 示。 需要重传的条件见公式 (1), 不需要重传的条件见公式 (2), 不重传时计算 出来的丟包数据为公式 (3)。
Figure imgf000011_0001
公式 (1)说明: 帧数据属于 /帧数据或者当前时刻网络拥塞情况小于等 于阔值。
Figure imgf000011_0002
公式 (2)说明: X帧数据属于 P帧数据或者当前时刻网络拥塞情况大于阔 值。
Xi=avg(Xl +- + XI_L +XI+L +-XN) XE P (3) 公式 (3)说明: 使用緩存的 帧数据平均值计算丟包数据 Xi。
举例如下:
一、 用户在客户端选择录像视频业务, 视频监控平台从前端取视频流, 传送到客户端供用户观看。 在观看过程中, 平台检测到了视频数据丟包情 况, 4叚设阔值^ 为 80, 如下:
1.第 5帧数据中丟失了第 8个视频数据包, 并且该帧数据属于 /帧数据, 一 共被编码分为了 200个视频数据包, 网络拥塞情况 在 50-60区间摆动;
2.第 7帧数据丟失了第 10和第 15个视频数据包, 并且该帧属于 P帧数据, 一共被编码分成了 50个视频数据包, f 7在80-90区间摆动;
3.第 17帧数据丟失了第 13和第 18两个视频数据包, 该帧属于 P帧数据, 一共被编码分成 45个视频数据包, f17在 40-50区间摆动;
4.第 34帧数据丟失了第 14、 第 23、 第 33等三个视频数据包, 该帧属于 /帧 数据, 一共被编码分成了 280个视频数据包, KM在 80-90区间摆动;
处理策略如下:
1.第 5帧的第 8个视频包请求视频源设备重传;
2.第 7帧的第 10和第 15个视频包不需要重传, 并且
+-- + X9+X +-- + Xu+Xl6+-- + X50) ·
^10 = ^15 =
48 3.第 17帧的第 13和第 18两个视频包请求视频源设备重传;
4.第 34帧的第 14、 第 23、 第 33三个视频包需要重传;
二、 用户在客户端选择实时视频业务, 视频监控平台从前端取视频流, 传送到平台进行录像。 在录像过程中, 平台检测到了视频包丟包情况, 假设 阔值 A为 80 , 如下:
1.第 5帧数据中丟失了第 8个视频数据包, 并且该帧数据属于 I帧数据, 一 共被编码分为了 200个视频数据包, 网络拥塞情况 在 50-60区间摆动;
2.第 7帧数据丟失了第 10和第 15个视频数据包, 并且该帧属于 P帧数据, 一共被编码分成了 50个视频数据包, f 7在80-90区间摆动;
3.第 17帧数据丟失了第 13和第 18两个视频数据包, 该帧属于 P帧数据, 一 共被编码分成 45个视频数据包, f17在 40-50区间摆动;
4.第 34帧数据丟失了第 14、 第 23、 第 33等三个视频包, 该帧属于 I帧数 据, 一共被编码分成了 280个视频数据包, f34在 80-90区间摆动;
处理策略如下:
1.第 5帧的第 8个视频包请求视频源设备重传;
2.第 7帧的第 10和第 15个视频包需要重传;
3.第 17帧的第 13和第 18两个视频包请求视频源设备重传;
4.第 34帧的第 14、 第 23、 第 33三个视频包需要重传;
这样的处理策略考虑了包重要性、 网络拥塞情况、 及用户业务场景。 对应本发明装置的组成连接关系如下:
视频源设备包括编码单元 6、 分包单元 7和视频数据包发送单元 8。 所述编 码单元 6和分包单元 7连接; 分包单元 7和视频数据包发送单元 8连接。
客户端包括控制单元 9和视频播放单元 10。
视频监控设备包括丟失检测单元 1、视频业务类型查询单元 2、视频数据包 查询单元 3、 网络查询单元 4和视频数据包计算单元 5。丟失检测单元 1分别与视 频业务类型查询单元 2、视频数据包发送单元 8和视频播放单元 10连接; 视频业 务类型查询单元 2分别与视频数据包查询单元 3、 视频数据包发送单元 8和控制 单元 9连接; 视频数据包查询单元 3分别与网络查询单元 4和视频数据包发送单 元 8连接; 网络查询单元 4分别与视频数据包发送单元 8和视频数据包计算单元 5连接; 视频数据包计算单元 5和视频播放单元 10连接。
首先, 视频源设备通过编码单元 6用于对视频源按帧进行编码, 得到视频 帧; 分包单元 7对所述视频帧进行分包, 得到视频数据包; 视频数据包发送单 元 8将所述视频数据包发送给视频监控设备, 并根据所述视频监控设备发来的 重传请求发送重传请求对应的视频数据包;
然后,视频监控设备的丟失检测单元 1检测来自视频包发送单元 8的视频数 据包是否丟失, 若视频数据包没有丟失, 则向客户端的视频播放单元 10发送 视频播放通知; 若视频数据包有丟失情况, 则通过视频业务类型查询单元 2查 询客户端的控制单元 9发来的视频业务类型请求; 若视频业务类型请求为录像 类型, 则向视频数据包发送单元 8发出重传丟失的视频包的请求, 视频数据包 发送单元 8根据请求将相应的视频数据包重新发送给丟失检测单元 1;若视频业 务类型请求为实时类型, 则通过视频数据包查询单元 3查询丟失的视频数据包 的类型; 若视频数据包的类型为 I帧数据, 则向视频数据包发送单元 8发出重 传丟失的视频数据包的请求, 否则, 视频数据包查询单元 3向网络查询单元 4 发出网络状态查询请求; 网络查询单元 4查询网络是否达到拥塞阔值, 若没有 达到拥塞阔值,则向视频数据包发送单元 8发出重传丟失的视频数据包的请求, 否则, 网络查询单元 4向通过视频数据包计算单元 5发出计算视频数据包的请 求, 视频数据包计算单元 5根据其他视频数据包计算丟失的视频数据包, 并通 过视频播放单元 10进行播放。
本发明对于用户的不同业务类型, 有不同的处理方式, 更加符合用户对 视频质量的需求; 对于视频中重要的 I帧, 重传才能保证视频的真实性, 才能 满足用户对视频的真实性需求; 对于视频中的 P帧, 在网络情况不好的时候, 使用错误遮蔽的方式可以减轻网络拥塞状况, 而且能够保证不丟失视频流中 重要信息。
本领域普通技术人员将会理解, 本发明的各个方面、 或各个方面的可能 实现方式可以被具体实施为系统、 方法或者计算机程序产品。 因此, 本发明 的各方面、 或各个方面的可能实现方式可以釆用完全硬件实施例、 完全软件 实施例 (包括固件、 驻留软件等等), 或者组合软件和硬件方面的实施例的形 式, 在这里都统称为 "电路" 、 "模块" 或者 "系统" 。 此外, 本发明的各 方面、 或各个方面的可能实现方式可以釆用计算机程序产品的形式, 计算机 程序产品是指存储在计算机可读介质中的计算机可读程序代码。
计算机可读介质可以是计算机可读信号介质或者计算机可读存储介质。 计算机可读存储介质包含但不限于电子、 磁性、 光学、 电磁、 红外或半导体 系统、 设备或者装置, 或者前述的任意适当组合, 如随机存取存储器 (RAM), 只读存储器 (ROM)、 可擦除可编程只读存储器(EPROM或者快闪存 储器) 、 光纤、 便携式只读存储器 (CD-ROM:)。
计算机中的处理器读取存储在计算机可读介质中的计算机可读程序代 码, 使得处理器能够执行在流程图中每个步骤、 或各步骤的组合中规定的功 能动作; 生成实施在框图的每一块、 或各块的组合中规定的功能动作的装 置。
计算机可读程序代码可以完全在用户的计算机上执行、 部分在用户的计 算机上执行、 作为单独的软件包、 部分在用户的计算机上并且部分在远程计 算机上, 或者完全在远程计算机或者服务器上执行。 也应该注意, 在某些替 代实施方案中, 在流程图中各步骤、 或框图中各块所注明的功能可能不按图 中注明的顺序发生。 例如, 依赖于所涉及的功能, 接连示出的两个步骤、 或 两个块实际上可能被大致同时执行, 或者这些块有时候可能被以相反顺序执 行。
以上所述, 仅为本发明的具体实施方式, 但本发明的保护范围并 不局限于此, 任何熟悉本技术领域的技术人员在本发明揭露的技术范 围内, 可轻易想到变化或替换, 都应涵盖在本发明的保护范围之内。 因此, 本发明的保护范围应所述以权利要求的保护范围为准。

Claims

权利要求
1、 一种视频传输方法, 其特征是, 该方法包括以下步骤:
视频监控设备检测接收的视频数据包是否丟失;
视频监控设备在视频数据包丟失的情况下查询用户发来的视频业务类型 请求; 若视频业务类型请求为录像类型, 则向视频源设备发出重传丟失的视 频数据包的请求;
视频监控设备在视频业务类型请求为实时类型的情况下查询丟失的视频 数据包的类型; 若视频数据包的类型为 I帧数据, 则视频监控设备向视频源设 备发出重传丟失的视频数据包的请求;
视频监控设备在视频数据包的类型不为 I帧数据的情况下查询网络是否达 到拥塞阔值; 若网络没有达到拥塞阔值,则向视频源设备发出重传丟失的视频 数据包的请求;
视频监控设备在网络达到拥塞阔值的情况下计算丟失的视频数据包,并向 视频播放单元发送视频播放通知。
2、 如权利要求 1所述的方法, 其特征是, 所述视频源类型请求包括: 实 时浏览、 实时录像、 录像下载或录像回放。
3、 如权利要求 1所述的方法, 其特征是, 所述丟失的视频数据包的计算 公式为:
Figure imgf000015_0001
其中:
.为丟失的 帧的第 I个视频数据包, 《为 帧的视频数据包 的总数;
ίΠ^为求均值操作。
4、 一种视频传输方法, 其特征是, 该方法包括以下步骤:
视频源设备对视频源按帧进行编码, 得到视频帧;
视频源设备对所述视频帧进行分包, 得到视频数据包;
视频源设备将所述视频数据包发送给视频监控设备, 并根据所述视频监 控设备发来的重传请求发送重传请求对应的视频数据包。
5、 如权利要求 4所示的方法, 其特征是, 所述视频源设备对视频源按帧进 行编码, 得到视频帧具体为:
视频源设备对将视频源分解为独立的视频帧,对独立的视频帧按时间先后 顺序进行编码, 得到视频帧。
6、 如权利要求 5所示的方法, 其特征是, 所述视频源设备对所述视频帧进 行分包, 得到视频数据包具体为:
视频源设备将视频帧按预设大 d、分成视频数据包,并对属于同一个视频帧 的视频数据包进行编码。
7、 如权利要求 6所示的方法, 其特征是, 所述视频源设备将所述视频数据 包发送给视频监控设备, 并根据所述视频监控设备发来的重传请求发送重传 请求对应的视频数据包具体为:
视频源设备以视频数据包的形式将视频源发送给视频监控设备;视频监控 设备将需要重传的视频数据包的信息发送给视频源设备,视频源设备根据视频 数据包的信息,将对应的视频数据包或该视频数据包对应的视频帧发送给视频 监控设备。
8、 一种视频传输设备, 其特征是, 该设备包括:
丟失检测单元, 用于检测接收的视频数据包是否丟失;
视频业务类型查询单元, 用于在视频数据包丟失的情况下查询用户发来 的视频业务类型请求; 若视频业务类型请求为录像类型, 则向视频源设备发 出重传丟失的视频数据包的请求;
视频数据包查询单元, 用于在视频业务类型请求为实时类型的情况下查 询丟失的视频数据包的类型; 若视频数据包的类型为 I帧数据, 则视频监控设 备向视频源设备发出重传丟失的视频数据包的请求;
网络查询单元, 用于在视频数据包的类型不为 I帧数据的情况下查询网络 是否达到拥塞阔值; 若网络没有达到拥塞阔值,则向视频源设备发出重传丟失 的视频数据包的请求; 视频数据包计算单元, 用于在网络达到拥塞阔值的情况下计算丟失的视 频数据包, 并向视频播放单元发送视频播放通知。
9、 如权利要求 8所述的设备, 其特征是, 所述丟失检测单元还包括: 计数器, 用于对丟失的视频数据包进行计数。
10、 如权利要求 8所述的设备, 其特征是, 所述网络查询单元还包括: 报警器, 用于网络达到拥塞阔值时发出报警信号。
11、 一种视频传输设备, 其特征是, 该设备包括:
编码单元, 用于对视频源按帧进行编码, 得到视频帧;
分包单元, 用于对所述视频帧进行分包, 得到视频数据包;
视频数据包发送单元, 用于将所述视频数据包发送给视频监控设备, 并 根据所述视频监控设备发来的重传请求发送重传请求对应的视频数据包。
12、 如权利要求 11所述的设备, 其特征是, 所述编码单元包括: 拆分器, 用于将视频源分解为独立的视频帧。
13、 如权利要求 12所述的设备, 其特征是, 所述编码单元包括: 编码器, 用于对所述独立的视频帧按时间先后顺序进行编码。
PCT/CN2014/077164 2013-07-02 2014-05-09 视频传输方法及设备 WO2015000337A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201310275059.7 2013-07-02
CN201310275059.7A CN104284135B (zh) 2013-07-02 2013-07-02 视频传输方法及设备

Publications (1)

Publication Number Publication Date
WO2015000337A1 true WO2015000337A1 (zh) 2015-01-08

Family

ID=52143081

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/077164 WO2015000337A1 (zh) 2013-07-02 2014-05-09 视频传输方法及设备

Country Status (2)

Country Link
CN (1) CN104284135B (zh)
WO (1) WO2015000337A1 (zh)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106331701A (zh) * 2015-06-15 2017-01-11 中兴通讯股份有限公司 一种刷新画面的方法和装置
CN105187909B (zh) * 2015-09-09 2019-05-14 深圳Tcl数字技术有限公司 终端检测录制音视频丢失的方法及装置
CN106059718B (zh) * 2016-05-05 2019-06-11 浙江宇视科技有限公司 一种数据重传方法及装置
JP6741065B2 (ja) * 2016-05-13 2020-08-19 富士通株式会社 通信装置、無線通信システム及び無線通信方法
CN109361935A (zh) * 2018-12-24 2019-02-19 广州微算互联信息技术有限公司 图片流视频传输方法与系统
CN110149515B (zh) * 2019-04-01 2021-06-04 西安万像电子科技有限公司 数据传输方法及装置
CN110769380A (zh) * 2019-10-31 2020-02-07 联想(北京)有限公司 视频分发方法及装置
CN113014501B (zh) * 2021-03-02 2022-12-16 中国联合网络通信集团有限公司 数据传输方法、系统、编码器及计算机可读存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1917639A (zh) * 2006-09-01 2007-02-21 北京天地互连信息技术有限公司 使用丢包重传的视频信号增强方法
CN101656747A (zh) * 2009-09-25 2010-02-24 深圳创维数字技术股份有限公司 流媒体数据的传输方法及系统
CN102006476A (zh) * 2010-11-19 2011-04-06 厦门雅迅网络股份有限公司 一种传输和接收实时视频数据的优化处理方法
TW201328257A (zh) * 2011-12-30 2013-07-01 Ind Tech Res Inst 協助tcp封包傳送的通訊系統與方法

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8031701B2 (en) * 2006-09-11 2011-10-04 Cisco Technology, Inc. Retransmission-based stream repair and stream join

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1917639A (zh) * 2006-09-01 2007-02-21 北京天地互连信息技术有限公司 使用丢包重传的视频信号增强方法
CN101656747A (zh) * 2009-09-25 2010-02-24 深圳创维数字技术股份有限公司 流媒体数据的传输方法及系统
CN102006476A (zh) * 2010-11-19 2011-04-06 厦门雅迅网络股份有限公司 一种传输和接收实时视频数据的优化处理方法
TW201328257A (zh) * 2011-12-30 2013-07-01 Ind Tech Res Inst 協助tcp封包傳送的通訊系統與方法

Also Published As

Publication number Publication date
CN104284135B (zh) 2017-11-24
CN104284135A (zh) 2015-01-14

Similar Documents

Publication Publication Date Title
WO2015000337A1 (zh) 视频传输方法及设备
US10542064B2 (en) Method, server side and system for computing bandwidth of network transmission of streaming media
CN110248256B (zh) 数据的处理方法及装置、存储介质和电子装置
WO2020192152A1 (zh) 视频传输的方法、根节点、子节点、p2p服务器和系统
US10230651B2 (en) Effective intra-frame refresh in multimedia communications over packet networks
US11363346B2 (en) Video service quality assessment method and apparatus
JP5402389B2 (ja) 電子会議システム、配信管理サーバ、データ制御方法、プログラム、及び記録媒体
CN113497792B (zh) 音视频通信方法、终端、服务器、计算机设备和存储介质
US10944973B2 (en) Estimation of video quality of experience on media servers
US9525874B2 (en) Transmitting apparatus and transmission method
BRPI0808629A2 (pt) Redução de efeitos de perda de pacotes em transmissões de vídeo.
CN1917639A (zh) 使用丢包重传的视频信号增强方法
WO2024056032A1 (zh) 解码、数据传输方法、装置、终端及服务器
KR20230002784A (ko) 오디오 및/또는 비디오 콘텐츠 전송을 위한 방법 및 서버
JP2014093584A (ja) 送信装置、送信方法、受信装置、受信方法およびコンピュータプログラム
CN113726817B (zh) 一种流媒体数据的传输方法、装置及介质
Kim et al. UDP-based extremely low latency streaming
CN104092982A (zh) 点对点实时视频传输方法及其传输系统
CN113905026A (zh) 一种流媒体视频数据处理方法、装置及存储介质
EP2908516A1 (en) Process for transmitting an ongoing video stream from a publisher to a receiver through a MCU unit during a live session
CN116055768B (zh) 一种精准确定视频观看时长的方法及系统
Bassey et al. Mitigating the effect of packet losses on real-time video streaming using psnr as video quality assessment metric
CN115696439A (zh) 数据传输方法、装置、设备及介质
Tafleen Fault Tolerance Strategies for Low-Latency Live Video Streaming
CN114866523A (zh) 一种基于udp的视频快速传输方法及系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14820494

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14820494

Country of ref document: EP

Kind code of ref document: A1