WO2014000278A1 - 视频数据传输方法及装置 - Google Patents

视频数据传输方法及装置 Download PDF

Info

Publication number
WO2014000278A1
WO2014000278A1 PCT/CN2012/077932 CN2012077932W WO2014000278A1 WO 2014000278 A1 WO2014000278 A1 WO 2014000278A1 CN 2012077932 W CN2012077932 W CN 2012077932W WO 2014000278 A1 WO2014000278 A1 WO 2014000278A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
video
indication information
priority
code stream
Prior art date
Application number
PCT/CN2012/077932
Other languages
English (en)
French (fr)
Inventor
池琛
白伟
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to EP12880171.9A priority Critical patent/EP2849393B1/en
Priority to CN201280003631.8A priority patent/CN103650431B/zh
Priority to PCT/CN2012/077932 priority patent/WO2014000278A1/zh
Publication of WO2014000278A1 publication Critical patent/WO2014000278A1/zh
Priority to US14/581,231 priority patent/US20150110168A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/70—Media network packetisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00—Traffic control in data switching networks
    • H04L47/10—Flow control; Congestion control
    • H04L47/38—Flow control; Congestion control by adapting coding or compression rate
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00—Traffic control in data switching networks
    • H04L47/50—Queue scheduling
    • H04L47/62—Queue scheduling characterised by scheduling criteria
    • H04L47/625—Queue scheduling characterised by scheduling criteria for service slots or service orders
    • H04L47/6275—Queue scheduling characterised by scheduling criteria for service slots or service orders based on priority
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/65—Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/762—Media network packet handling at the source 
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/764—Media network packet handling at the destination 
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/765—Media network packet handling intermediate
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
    • H04N19/37—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability with arrangements for assigning different transmission priorities to video input data or to video coded data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234327—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into layers, e.g. base layer and one or more enhancement layers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H04N21/2353—Processing of additional data, e.g. scrambling of additional data or processing content descriptors specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2381—Adapting the multiplex stream to a specific network, e.g. an Internet Protocol [IP] network
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41407—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00—Traffic control in data switching networks
    • H04L47/10—Flow control; Congestion control
    • H04L47/24—Traffic characterised by specific attributes, e.g. priority or QoS
    • H04L47/2408—Traffic characterised by specific attributes, e.g. priority or QoS for supporting different services, e.g. a differentiated services [DiffServ] type of service

Definitions

  • the present invention relates to the field of wireless communications, and in particular, to a video data transmission method and apparatus. Background technique
  • Scalable Video Coding is one of the encoding mechanisms of existing video data, which is characterized by being able to encode the original video into a scalable/layered video stream.
  • the SVC video code stream has a base layer and a number of enhancement layers.
  • the receiving terminal only needs to receive the base layer when the channel bandwidth is limited, and can decode and reply a video file that satisfies the basic quality. In the case of sufficient channel bandwidth, the receiving enhancement layer can be considered to decode and obtain high quality video files.
  • the SVC video stream is suitable for application in an LTE system, thereby enabling the LTE system to better transmit video data.
  • the LTE system differentiates the SVC video code stream according to different priorities of the base layer and the enhancement layer, thereby improving the experience of the user terminal.
  • the embodiment of the present invention provides a data transmission method, so that a base station or a mobile terminal can obtain priority and size information of a video stream in video transmission data in a simple manner in the obtained video transmission data.
  • a video data encoding method includes: Obtain video information;
  • the indication information includes a priority and a data amount of each data frame in the corresponding picture group data.
  • a video data transmission method includes:
  • the present invention provides a video data transmission method, where the method includes: receiving a video code stream through a downlink channel;
  • a resource request is sent to the base station according to the current downlink channel resource and the data amount of the video data packet.
  • a video encoding apparatus comprising:
  • a coding unit configured to encode the obtained video information into a video code stream, where the video code stream includes multiple picture group data
  • a base station Inserting a unit, setting indication information for the picture group data, and placing the indication information before the corresponding picture group data, where the indication information includes priority and data of each data frame in the corresponding picture group data the amount.
  • a base station includes:
  • a video stream acquisition unit configured to acquire a video code stream through a network
  • the indication information acquiring unit is configured to perform deep packet detection on the video code stream, and obtain instruction information corresponding to the picture group data and the picture group data;
  • a priority acquiring unit which acquires a priority of each data frame of the picture group data in the indication information
  • a data frame sending unit configured to send the data frame in the picture group data of the video code stream according to the priority order.
  • a handheld terminal comprising:
  • a receiving unit configured to receive a video code stream through a downlink channel
  • a detecting unit configured to: depth-detect the received video code stream and obtain indication information; and acquire, according to the obtained indication information, a size and a priority of each video data packet in the video code stream;
  • a requesting unit configured to send a resource request to the base station according to the current downlink channel resource and the size of the video data packet.
  • An embodiment of the present invention provides a method for transmitting video data, by detecting auxiliary indication information in a video code stream, or priority information and size information of a subsequent code stream, so that the base station can obtain the priority information and the size information according to the obtained
  • the video code stream is differentially transmitted, and the handheld terminal can also request the differentiated transmission video data from the base station according to the indication information in the received video code stream and the current channel resource status, without performing complete DPI detection and acquisition quality on the data packet.
  • Layered number, priority number, time stratification number and other information which reduces the detection complexity and improves the user's terminal experience.
  • FIG. 1 is a structural diagram of an application system of a video encoding method according to an embodiment of the present invention
  • FIG. 2 is a flowchart of a video encoding method according to an embodiment of the present invention.
  • FIG. 3 is a flowchart of another embodiment of a video encoding method according to an embodiment of the present invention.
  • FIG. 4 is a state reference diagram of a video encoding method according to an embodiment of the present invention.
  • FIG. 5 is a flowchart of another embodiment of a video data transmission method according to an embodiment of the present invention
  • FIG. 6 is a flowchart of still another embodiment of a video data transmission method according to an embodiment of the present invention
  • FIG. 8 is a schematic structural diagram of a video data transmission apparatus according to an embodiment of the present invention.
  • FIG. 9 is a schematic structural diagram of a video data transmission apparatus according to an embodiment of the present invention. detailed description
  • An embodiment of the present invention provides a method for transmitting video data, by detecting auxiliary indication information in a video code stream, or priority information and size information of a subsequent code stream, so that the base station can obtain the priority information and the size information according to the obtained
  • the video stream is differentiated and transmitted, and the handheld terminal can also request differentiated transmission video data from the base station according to the indication information in the received video stream and the current channel resource status, thereby improving the user terminal experience.
  • FIG. 1 is a system application architecture diagram of a video transmission method according to an embodiment of the present invention. It can be seen from FIG. 1 that the system architecture applied by the video transmission method provided by the embodiment of the present invention includes a video file service.
  • the severl0, the evolved base station eNB20, and the plurality of hand-held terminals UE30 accessing the evolved base station 20 through the downlink channel.
  • the server 10 may include, but is not limited to, a network server, which is capable of acquiring a video file captured by a user, compressing and encoding the video file, and transmitting the encoded file to the evolved base station 20, and then the evolved base station 20 transmits the video data through the downlink channel.
  • the video is transmitted to the handheld terminal UE 30, and the handheld terminal 30 decodes the video encoded file and plays the video file shown on the handheld terminal 30.
  • the network server encodes the video file uploaded by the user, and adds the indication information to the video code stream during the encoding, and the evolved base station 20 detects the video data, and after detecting the indication information, according to the indication information.
  • the video data is differentiated and transmitted to the channel, and the user terminal 30 can obtain the priority sequence and the data packet size of the subsequent video code stream after receiving the indication information, and refer to the current channel.
  • the resource status sends a differentiated resource request to the base station, thereby improving the experience of the user terminal watching the video file.
  • FIG. 2 is a flowchart of an embodiment of a video encoding method according to an embodiment of the present invention. As shown in FIG. 2, the method includes:
  • Step S201 acquiring video information
  • the video information obtained by the server may include, but is not limited to, a video file that is acquired by the user through a camera, downloaded through a website, or intercepted by a video.
  • Step S202 encoding the obtained video file into a video code stream, where the video code stream includes multiple picture group data;
  • the encoding device in the server for example, the encoder encodes the video file according to a set resolution, an encoding format, an encoding standard, a frame rate, and a code rate, and obtains a plurality of group group data (Group Of Picture, GOP). ).
  • the coding standard therein such as the SVC standard in H.264, obtains a scalable video code stream.
  • Step S203 setting indication information for the picture group data, and placing the indication information before the corresponding picture group data, where the indication information is used to indicate each number in the corresponding picture group data. According to the priority of the frame and the amount of data.
  • the indication information is added to the encoded picture group data to indicate the priority and size of different frames in the subsequent picture group data.
  • an indication packet may be set for each picture data group, or a plurality of picture group data may be shared by one indication packet.
  • the space occupied by this indication is much smaller than the size of the packet.
  • the representation form of the indication information may be agreed according to the terminal, the base station, and the server. For example, 00000 indicates that the priority is 1 and 10010 indicates that the priority is 2.
  • the packet size is usually based on 1.5K bytes per IP packet, and the subsequent packet occupies 15K bytes.
  • the size can be displayed as 001010. Fields that represent the size of the packet can be placed after the field that represents the priority.
  • the indication information may not directly indicate the priority, but the hierarchical information field or the frame coding type field is used to reflect the priority of different data frames in the picture group data.
  • the user terminal or the evolved base station can obtain the priority and size of the data packet in the subsequent group of picture group data by acquiring the indication information in the data stream stream data header, according to the priority and the data packet.
  • Size refer to the current channel conditions, and differentially transmit video data. For example, when the channel resources are tight, only the packets with higher priority are transmitted, so that the user can obtain basic video data to meet the basic playback requirements. In the case of sufficient channel resources, low-priority data packets are sent, so that users can obtain high-quality and clear video playback effects.
  • the video coding method provided by the foregoing embodiment adds the indication information to the video code stream, so that the base station does not need to deeply detect the real application of the data packet in the IP layer of the application layer, and can identify the size and priority of the IP packet.
  • the priority of the IP packets is differentiated and transmitted, thereby reducing the complexity and transmission delay, and improving the video viewing effect of the user.
  • the above embodiment is based on video coding, but those skilled in the art should understand that for the audio data coding with the layered coding architecture, the technology provided by the present invention can also be used, that is, the indication information is used to indicate subsequent audio.
  • the size and priority order of the data frames in the data so that the base station can obtain the size and the size of the data frames in the subsequent audio data according to the indication information in the indication information packet. Prioritized, differentiated transmission.
  • FIG. 3 is a flowchart of another embodiment of a video encoding method according to an embodiment of the present invention. As shown in the figure, the method includes:
  • Step S301 acquiring video information
  • the video information obtained by the server may include, but is not limited to, a video file that is acquired by the user through a camera, downloaded through a website, or intercepted by a video.
  • Step S302 encoding the obtained video file into a video code stream, where the video code stream includes multiple picture group data;
  • the encoding device in the server encodes the video file according to a set resolution, an encoding format, an encoding standard, a frame rate, and a code rate, and obtains a plurality of group group data (Group Of Picture, GOP). ).
  • the coding standard therein such as the SVC standard in H.264, obtains a scalable video code stream.
  • the H.264 SVC video is transmitted in LTE.
  • the encoding parameter GOP is 8, and the time stratification is 4.
  • the flow control is used in the encoder, so that the size and priority of each layer in the obtained coded stream are as shown in Table 1.
  • the encoding rule of one GOP data is IPB1B1B2B2B2B2B2, and the loop is repeated.
  • Each data frame can be As a Real-time Transmission Protocol (RTP), as shown in Figure 4.
  • RTP Real-time Transmission Protocol
  • Step S303 setting indication information for the picture group data, and placing the indication information before the corresponding picture group data, where the indication information includes priority and data of each data frame in the corresponding picture group data.
  • the amount Specifically, the indicator information is added to the encoded picture group data to indicate the priority and size of different frames in the subsequent picture group data.
  • the format of the indication message may be as shown in Table 2, and the priority and the size are sequentially arranged. It is also possible to set a data amount field of several identifier sizes after several priority fields.
  • the indication information shown in Table 3 can be added before the GOP data, that is, the indication information is added before the RTP packet 1 in the RTP packet corresponding to the IPB1B1B2B2B2B2. Indicates the size and priority order of each RTP packet in a set of RTP packets. As for the specific identification rules, the judgment can be made according to the actual agreement, and the description in the foregoing embodiment can be referred to.
  • an indication packet is set by using one picture group data as an example.
  • the same indication information packet may be shared.
  • adding one or more regular indication fields to the indication information packet to indicate a change rule of a data frame priority and a data frame size in the subsequent picture group data.
  • a special field bit indicates that the data frame size and priority in the subsequent picture group data are the same as the first picture group data.
  • the rules of the data frames in the subsequent plurality of picture group data may be separately identified.
  • the indication information may not directly indicate the priority, but the hierarchical information field or the frame coding type field is used to reflect the priority of different data frames in the picture group data.
  • Step S304 the video code stream after the addition of the indication information is decomposed into multiple IP packets.
  • the data packet information following the indication information packet may be in accordance with the law. Determine that the priority of 10 IP packets is 1, and the priority of 6 IP packets is 2, 4 The packet priority is 3, and the 4 packets have a priority of 4.
  • an indication packet only occupies the number of bytes of an IP packet, or less.
  • the base station after receiving the first indication information packet, the base station can know the priority and size of each frame in the subsequent picture group.
  • the out-of-order IP packets are reordered according to the sequence number in the RTP header, and different IP packets are differentiated and transmitted to the channel.
  • FIG. 5 is a flowchart of an embodiment of a video data transmission method according to an embodiment of the present invention. As shown in the figure, the method includes:
  • Step S501 acquiring a video code stream
  • the base station obtains the already encoded video code stream provided by the network through the network, for example, H.2264 SVC encoded video data.
  • Step S502 Perform deep packet detection on the obtained video code stream, and obtain instruction information corresponding to the picture group data and the picture group data.
  • the base station detects the obtained video code stream that includes multiple IP packets, and reorders the sequentially shuffled IP packets.
  • the reference information when sorting IP packets includes, but is not limited to, the serial number in the RTP header.
  • Step S503 Obtain a priority of each data frame of the picture group data in the indication information.
  • the change rule of the plurality of picture group data after the first picture group data is obtained in the indication information, for example, the priority and data of the data frame in the subsequent picture group data.
  • the frame size is the same as the first picture group data.
  • the base station may map the layer information field or the frame coding type field to the priority. information. Step S504, transmitting, according to the priority order, a data frame in the picture group data of the video code stream;
  • the base station After detecting the indication information packet in the video code stream, the base station reads the IP packet size and the priority information in the indication information packet, and sends the subsequent multiple data packets in the channel according to the priority order. For example, referring to the size of the subsequent IP packet in the indication information, it is determined whether the current channel resource is sufficient; if the channel resource is sufficient, the subsequent data packets may be sequentially transmitted regardless of the priority order. In the case that the channel resources are insufficient, the subsequent IP packets are selectively differentiated according to the priority indication in the indication information, so that the user terminal can also be satisfied if the channel resources are insufficient. Basic playback of required video files.
  • the base station may obtain the priority and size information of the data packet in the subsequent video code stream according to the indication information in the video code stream, and perform differential transmission according to the channel resource status and the data packet according to the priority. Deep packet inspection is performed for each frame of data to reduce the detection frequency. Improve transmission efficiency.
  • the above embodiment is based on video coding, but those skilled in the art should understand that for the audio data coding with the layered coding architecture, the technology provided by the present invention can also be used, that is, the indication information is used to indicate subsequent audio.
  • the size and priority order of the data frames in the data enable the base station to obtain the size and priority order of the data frames in the subsequent audio data according to the indication information in the indication information packet, and perform differential transmission.
  • FIG. 6 is a flowchart of a video data transmission method according to an embodiment of the present invention. As shown in FIG. 6, the method includes:
  • Step S601 Receive a video code stream by using a downlink channel.
  • the handheld terminal UE receives the video code stream under the base station in the channel, where the video code stream is multiple IP packets, and after receiving multiple IP packets, the IP packet is performed according to the serial number in the RTP packet. Sort.
  • Step S602 Deeply detecting the received video code stream and acquiring indication information. Specifically, the indication information is detected according to the header of the SEI indication information. In multiple data packets, multiple packets for the same picture group contain an indication packet.
  • Step S603 Obtain, according to the obtained indication information, a size and a priority of each video data packet in the video code stream;
  • the indication information packet includes priority and size information of multiple RTP data packets.
  • the indication information packet it can be known that there are 10 IP packets with a priority of 1 and 6 IP packets with a priority of 2, corresponding to the priority of the I frame. 1.
  • the priority of the P frame is 2.
  • the priority of the packets in multiple data frames can be known. Different from the prior art SEI packet indication method, the value gives specific priority information of a certain frame, and deep packet detection is required for each frame.
  • the UE may map the layer information field or the frame coding type field to the priority. information.
  • Step S604 Send a resource request to the base station according to the current downlink channel resource and the size and priority of the video data packet.
  • the handheld terminal UE can determine whether the current downlink channel resource is sufficient according to the learned data packet size. If sufficient, the flow control measure may not be taken. If the channel resource is insufficient, the priority in the indication information may be passed. Status, sending a resource request to the base station.
  • channel resources may also be requested from the base station according to the size and priority of subsequent video data packets obtained from the indication information packet. For example, if the channel resources are insufficient, the video data with a high priority can be requested to be transmitted on a channel occupying a small bandwidth. If the channel resources are sufficient, the resource difference request does not need to be considered.
  • the handheld terminal can learn the priority and size of different data packets in the subsequent video code stream according to the indication information in the obtained video code stream, and determine whether the current channel resource is sufficient according to the size of the data packet. In case of insufficient channel resources, priority is given to the base.
  • the station requests data. Avoid frequent deep detection of a packet and reduce data transmission delay.
  • the above embodiment is based on video coding, but those skilled in the art should understand that for the audio data coding with the layered coding architecture, the technology provided by the present invention can also be used, that is, the indication information is used to indicate subsequent audio.
  • the size and priority order of the data frames in the data enable the mobile phone to obtain the size and priority order of the data frames in the subsequent audio data according to the indication information in the indication information packet, and perform a differentiated resource request.
  • FIG. 7 is a schematic structural diagram of a video encoding apparatus according to an embodiment of the present invention, where the apparatus may be embodied as an encoder. As can be seen from the figure, the device comprises:
  • the acquiring unit 701 is configured to acquire video information, and send the obtained video information to the encoding unit 702;
  • the encoding unit 702 is configured to receive the video information acquired by the acquiring unit 701, and encode the video information into a video code stream, and send the video information to the insertion unit 703, where the video code stream includes a plurality of picture group data;
  • the insertion unit 703 is configured to receive 702 the video code stream sent by the coding unit, and set indication information for the picture group data in the video code stream, and place the indication information in the corresponding picture group data.
  • the indication information is used to indicate the priority and data amount of each data frame in the corresponding picture group data.
  • the video encoding device is used to implement the video data encoding method described in the foregoing embodiments, and the included units are only divided according to functional logic, but are not limited to the foregoing partitioning, as long as the corresponding functions can be implemented;
  • the specific names of the respective functional units are only for the purpose of facilitating mutual differentiation, and are not intended to limit the scope of protection of the present invention.
  • FIG. 8 is a schematic structural diagram of a video data transmission apparatus according to an embodiment of the present invention, where the video data transmission apparatus may be a base station, as shown in the figure, the apparatus includes:
  • the video code stream obtaining unit 801 is configured to obtain a video code stream through the network, and send the obtained video code stream to the indication information acquiring unit 802;
  • the indication information obtaining unit 802 is configured to receive the video code stream sent by the video code stream acquiring unit 801, perform deep packet detection on the video code stream, and obtain instruction information corresponding to the picture group data and the picture group data.
  • the priority obtaining unit 803 is configured to receive the indication information sent by the indication information acquiring unit 802, and acquire the picture group data in the indication information. After the priority of each data frame, the priority of each data frame is sent to the data frame transmitting unit 804;
  • the data frame sending unit 804 is configured to receive a priority of each data frame sent by the priority acquiring unit 803, and send a data frame in the picture group data of the video code stream according to the priority order.
  • the video data transmission and coding apparatus is used to implement the video data transmission method described in the embodiment of FIG. 5, and the included units are only divided according to functional logic, but are not limited to the above division, as long as the corresponding The functions of the functional units are only for the purpose of facilitating mutual differentiation and are not intended to limit the scope of the present invention.
  • FIG. 9 is a schematic structural diagram of a video data transmission apparatus according to an embodiment of the present invention.
  • the apparatus may be a computer or a handheld terminal.
  • the terminal includes:
  • the receiving unit 901 is configured to receive the video code stream sent by the receiving unit, and deeply detect the received video code stream, to obtain the indication information, and send the indication information to the detecting unit 902.
  • the received video code stream is detected by the depth and the indication information is obtained;
  • the obtaining unit 903 is configured to receive the indication information sent by the detecting unit 902, and learn, according to the obtained indication information, each of the video code streams.
  • the requesting unit 904 is configured to receive the data volume and priority of each video data packet sent by the acquiring unit 903, and send a resource request to the base station according to the current downlink channel resource and the size of the video data packet.
  • the above video data transmission device is used to implement the video data transmission described in the embodiment of FIG.
  • the method includes that each unit included is divided according to functional logic, but is not limited to the above division, as long as the corresponding function can be implemented; in addition, the specific names of the functional units are only for facilitating mutual differentiation, and are not used. To limit the scope of protection of the present invention.
  • the present invention provides an encoding method capable of reducing the detection complexity by taking video transmission data as an example.
  • the embodiment of the present invention can also be applied to the field of audio data encoding and transmission, and those skilled in the art. It should be easy to apply the encoding method and data transmission method provided by the present invention to the field of audio data transmission, and therefore the method provided by the present invention is applied to the transmission of audio data, and should also fall under the protection of the present invention.
  • the steps of a method or algorithm described in connection with the embodiments disclosed herein can be implemented in hardware, a software module executed by a processor, or a combination of both.
  • the software module can be placed in random access memory (RAM), memory, read only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or technical field. Any other form of storage medium known.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Engineering & Computer Science (AREA)
  • Library & Information Science (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Mobile Radio Communication Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本发明涉及一种视频数据编码方法和装置，所述方法包括：获取视频文件；将获取到的所述视频文件压缩为视频码流，所述视频码流包括多个图片组数据；在所述视频码流中的所述多个图片组数据中的每个图片组数据之前加入指示信息，所述用户终端或基站依据所述指示信息获知该指示信息之后的图片组数据中各数据帧的优先级和大小。本发明实施例提供的传输方法，通过检测视频码流中的辅助指示信息，或许后续码流的优先级信息和大小信息，使得基站能够依据获取到的优先级信息和大小信息对视频码流进行差异化传输，手持终端也能依据接收到的视频码流中的指示信息结合当前的信道资源状况，向基站请求差异化传输视频数据，从而提高用户的终端体验。

Description

视频数据传输方法及装置 技术领域
本发明涉及无线通信领域， 尤其涉及一种视频数据传输方法及装置。 背景技术
可分级视频编码（Scalable Video Coding, SVC )是现有视频数据的编码 机制中的一种， 其特点是能够将原始视频编码为可分级 /分层的视频码流。 该 种 SVC视频码流具有一个基本层和若干个增强层。接收终端在信道带宽受限 的情况下只需要接收基本层， 即可解码回复一个满足基本质量的视频文件。 在信道带宽充足的情况下， 可以考虑接收增强层， 以解码获取高质量的视频 文件。 SVC视频码流适合在 LTE系统中应用， 从而使 LTE系统更好传输视 频数据。 LTE系统将 SVC视频码流按照基本层和增强层的不同优先级， 进行 差异化传输， 从而提高用户终端的体验。
现有技术中， 此种技术需要对每个数据包都进行 DPI检测， 因此会造成 密集计算以及时延。 对于釆用私有协议和 DRM保护的视频数据， 信道无法 通过 DPI技术进行检测。 发明内容
本发明实施例的提供一种数据传输方法， 使得基站或移动终端能够在获 得的视频传输数据中通过简单的方式获取视频传输数据中视频流的优先级和 大小信息。
一方面， 提供了一种视频数据编码方法， 所述方法包括： 获取视频信息；
将所述视频信息编码为视频码流， 所述视频码流包括图片组数据； 为所述图片组数据设置指示信息， 并将所述指示信息置于对应的所述图 片组数据之前， 所述指示信息中包括对应的图片组数据中各数据帧的优先级 和数据量。
一方面， 提供了一种视频数据传输方法， 所述方法包括：
获取视频码流；
对所述视频码流进行深度包检测， 获取图片组数据和所述图片组数据对 应的指示信息；
获取所述指示信息中的所述图片组数据的每个数据帧的优先级； 根据所述优先级顺序发送所述视频码流的图片组数据中的数据帧。
一方面， 本发明提供了一种视频数据传输方法， 所述方法包括： 通过下行信道接收视频码流；
深度检测接收到的所述视频码流并获取指示信息；
依据获取到的所述指示信息获知所述视频码流中各视频数据包的数据量 和优先级；
根据当前下行信道资源和所述视频数据包的数据量， 向基站发送资源请 求。
一方面， 提供了一种视频编码装置， 该装置包括：
获取单元， 用以获取视频信息；
编码单元， 用以将获取到的所述视频信息编码为视频码流， 所述视频码 流包括多个图片组数据；
插入单元， 为所述图片组数据设置指示信息， 并将所述指示信息置于对 应的所述图片组数据之前， 所述指示信息中包括对应的图片组数据中各数据 帧的优先级和数据量。 一方面， 提供了一种基站， 所述基站包括：
视频码流获取单元， 用以通过网络获取视频码流；
指示信息获取单元,用以对所述视频码流进行深度包检测， 获取图片组数 据和所述图片组数据对应的指示信息；
优先级获取单元， 获取所述指示信息中的所述图片组数据的每个数据帧 的优先级；
数据帧发送单元， 用以根据所述优先级顺序发送所述视频码流的图片组 数据中的数据帧。
一方面， 提供了一种手持终端， 所述终端包括：
接收单元， 用以通过下行信道接收视频码流；
检测单元， 用以深度检测接收到的所述视频码流并获取指示信息； 获取单元， 依据获取到的所述指示信息获知所述视频码流中各视频数据 包的大小和优先级；
请求单元， 用以根据当前下行信道资源和所述视频数据包的大小， 向基 站发送资源请求。
本发明实施例提供一种视频数据的传输方法， 通过检测视频码流中的辅 助指示信息， 或许后续码流的优先级信息和大小信息， 使得基站能够依据获 取到的优先级信息和大小信息对视频码流进行差异化传输， 手持终端也能依 据接收到的视频码流中的指示信息结合当前的信道资源状况， 向基站请求差 异化传输视频数据， 不需要对数据包进行完全 DPI检测获取质量分层号、 优 先级号、 时间分层号等信息， 从而降低检测复杂度， 提高用户的终端体验。 附图说明
为了更清楚地说明本发明实施例中的技术方案， 下面将对实施例或现 有技术描述中所需要使用的附图作简单地介绍， 显而易见地， 下面描述中 的附图仅仅是本发明的一些实施例， 对于本领域普通技术人员来讲， 在不 付出创造性劳动性的前提下， 还可以根据这些附图获得其他的附图。
图 1为本发明实施例一种视频编码方法的应用系统架构图；
图 2为本发明实施例视频编码方法的流程图；
图 3是本发明实施例视频编码方法的另一实施例的流程图；
图 4是本发明实施例视频编码方法一种状态参考图；
图 5是本发明实施例视频数据传输方法另一种实施例的流程图； 图 6是本发明实施例视频数据传输方法的再一种实施例的流程图； 图 7是本发明实施例一种视频编码装置的结构示意图；
图 8是本发明实施例一种视频数据传输装置的结构示意图；
图 9是本发明实施例一种视频数据传输装置的结构示意图。 具体实施方式
为了使本发明的目的、 技术方案和优点更加清楚， 下面将结合附图对本 发明作进一步地详细描述， 显然， 所描述的实施例仅仅是本发明一部份实施 例， 而不是全部的实施例。 基于本发明中的实施例， 本领域普通技术人员在 没有做出创造性劳动前提下所获得的所有其它实施例， 都属于本发明保护的 范围。
本发明实施例提供一种视频数据的传输方法， 通过检测视频码流中的辅 助指示信息， 或许后续码流的优先级信息和大小信息， 使得基站能够依据获 取到的优先级信息和大小信息对视频码流进行差异化传输， 手持终端也能依 据接收到的视频码流中的指示信息结合当前的信道资源状况， 向基站请求差 异化传输视频数据， 从而提高用户的终端体验。
图 1是本发明实施例提供的视频传输方法的系统应用架构图。 由图 1可 见， 本发明实施例提供的视频传输方法所应用的系统架构包括视频文件服务 器 severl0、 演进基站 eNB20、 和通过下行信道接入演进基站 20的若干个手 持终端 UE30。
其中，服务器 10可以包括但不限定于网络服务器，该网络服务器能够获 取用户拍摄的视频文件， 并对视频文件进行压缩编码， 编码之后传输给演进 基站 20, 之后演进基站 20通过下行信道将视频数据传输给手持终端 UE30, 手持终端 30解码视频编码文件， 在手持终端 30上播放所示视频文件。 在本 发明实施例中， 网络服务器将用户上传的视频文件编码， 并在编码时在视频 码流中加入指示信息， 演进基站 20对视频数据进行检测， 检测到指示信息 之后， 依据指示信息中的优先级和 /或数据包大小信息， 对视频数据向信道中 进行差异化传输，而用户终端 30在接收到指示信息后就能够获知后续视频码 流的优先级顺序和数据包大小， 参考当前信道资源状况， 向基站发出差异化 的资源请求， 从而提高用户终端观看视频文件的体验。
图 2是本发明实施例提供的视频编码方法一种实施例的流程图， 由图 2 可见， 该方法包括：
步骤 S201 , 获取视频信息；
具体的， 服务器获取到的视频信息可以包括但不限定于用户通过摄像机 上传、 通过网站下载、 视频截取等方式获取的视频文件。
步骤 S202, 将获取到的所述视频文件编码为视频码流， 所述视频码流包 括多个图片组数据；
具体的， 服务器中的编码装置， 例如编码器将视频文件进行编码按照设 定的分辨率、 编码格式、 编码标准、 帧率和码率进行编码， 获得多个图片组 数据 (Group Of Picture, GOP)。 其中的编码标准例如 H.264中的 SVC标准， 获取可分级的视频码流。
步骤 S203 , 为所述图片组数据设置指示信息， 并将所述指示信息置于对 应的所述图片组数据之前， 所述指示信息用于指示对应的图片组数据中各数 据帧的优先级和数据量。
具体的， 在编码后的图片组数据中加入指示信息， 用来指示后续的图片 组数据中不同帧的优先级和大小。 在实际应用中， 可以给每一个图片数据组 都设置一个指示信息包，也可以多个图片组数据共享一个指示信息包的形式。
这个指示信息所占用的空间远小于数据包的大小。 所述指示信息的表现 形式， 可以根据终端、 基站和服务器进行约定。 例如以 00000表示优先级为 1 , 10010表示优先级为 2。 而关于数据包大小通常以每个 IP包占用 1.5K字 节为标准， 后续一个数据包占用 15K字节则， 大小可以显示为 001010。 表示 数据包大小的字段可以放在表示优先级的字段之后。
在实际应用中， 指示信息也可不直接指示优先级， 而是釆用分层信息字 段或帧编码类型字段， 来体现图片组数据中不同数据帧的优先级。
用户终端或演进基站在获取到视频码流之后， 通过获取视频码流数据头 中的指示信息就能够后获知后续一组图片组数据中的数据包的优先级和大 小， 根据优先级和数据包大小， 参考当前信道情况， 对视频数据进行差异化 传输。 例如在信道资源紧张时， 只传输优先级较高的数据包， 使得用户能够 获得基本的视频数据， 满足基本播放的需求。 而在信道资源充足的情况下， 下发低优先级的数据包，使得用户能够获得高质量和清晰度的视频播放效果。
通过上述实施例提供的视频编码方法， 在视频码流中加入指示信息， 使 得基站无需深度检测应用层的 IP报中数据报文的真正应用， 即可识别 IP包 的大小和优先级， 针对获取到的优先级对 IP包进行差异化传输， 从而降低复 杂度和传输时延， 提高用户端的视频观看效果。
上述实施例是以视频编码为例， 但是所属领域的技术人员应该理解， 对 于具备分层编码架构的音频数据编码， 也可以釆用本发明提供的技术， 也就 说釆用指示信息指示后续音频数据中数据帧的大小和优先级顺序， 使得基站 能够依据指示信息包中的指示信息， 获取后续音频数据中数据帧的大小和优 先级顺序， 进行差异化传输。
图 3是本发明实施例提供的视频编码方法的另一种实施例的流程图， 由 图可见， 所述方法包括：
步骤 S301 , 获取视频信息；
具体的， 服务器获取到的视频信息可以包括但不限定于用户通过摄像机 上传、 通过网站下载、 视频截取等方式获取的视频文件。
步骤 S302, 将获取到的所述视频文件编码为视频码流， 所述视频码流包 括多个图片组数据；
具体的， 服务器中的编码装置， 例如编码器将视频文件进行编码按照设 定的分辨率、 编码格式、 编码标准、 帧率和码率进行编码， 获得多个图片组 数据 (Group Of Picture, GOP)。 其中的编码标准例如 H.264中的 SVC标准， 获取可分级的视频码流。 例以在 LTE中传输 H.264 SVC视频为例。 假设编码参数 GOP为 8, 时间分 层为 4。 在编码器中釆用流控控制， 使得到的编码码流中各层数据包大小和 优先级如表 1所示， 其中一个 GOP数据的编码规律为 IPB1B1B2B2B2B2B2, 循环重复， 每一种数据帧可以作为一个实时传输协议包 （ Real-time transmission protocol , RTP ) , 如图 4所示。
Figure imgf000009_0001
表 1
步骤 S303, 为所述图片组数据设置指示信息， 并将所述指示信息置于对 应的所述图片组数据之前， 所述指示信息中包括对应的图片组数据中各数据 帧的优先级和数据量； 具体的， 在编码后的图片组数据中加入指示信息， 用来指示后续的图片 组数据中不同帧的优先级和大小， 指示消息的格式可如表 2所示， 优先级、 大小依次排列， 也可以是几个优先级字段之后设置几个标识大小的数据量字 段。
Figure imgf000010_0001
表 2
结合表 1中各数据帧的大小和优先级， 可以参考表 3.
SEI包头 1 15k 2 9k 3 6k 4 6k
表 3
表 3所示的指示信息可被加入在一个 GOP数据的前面，也就是在一组对 应 IPB1B1B2B2B2B2B2的 RTP包中 RTP包 1之前加入指示信息。 指示一组 RTP包中每个 RTP包的大小和优先级顺序。至于具体的识别规则可按照实际 约定进行判断， 可参考前述实施例中的描述。
前述实施例， 是以一个图片组数据设置一个指示信息包来作为举例， 实 际上， 若多个图片组数据的数据帧大小、 数据帧优先级相同或相似的情况， 可共享同一个指示信息包，在该指示信息包中加入一个或多个规律指示字段， 用以指示后续图片组数据中数据帧优先级和数据帧大小的变化规律。 例如， 通过一个特殊字段位指示后续图片组数据中， 数据帧大小和优先级与第一个 图片组数据相同。
若加入多个规律指示字段， 则可以分别标识后续的多个图片组数据中数 据帧的规律。
在实际应用中， 指示信息也可不直接指示优先级， 而是釆用分层信息字 段或帧编码类型字段， 来体现图片组数据中不同数据帧的优先级。
步骤 S304, 将加入所述指示信息之后的所述视频码流分解为多个 IP包； 具体的， ^没 IP包大小为 1.5K字节， 则在指示信息包后续的数据包信 息可以按照规律判断 10个 IP包的优先级为 1 , 6个 IP包的优先级为 2, 4个 包优先级为 3 , 4个包优先级为 4。 相比之下一个指示信息包只占用一个 IP 包的字节数， 或者更少。
通过上述实施例， 基站接收到第一个指示信息包之后， 就能够获知后续 一个图片组中各个帧的优先级和大小。 对乱序的 IP包按照 RTP包头中的序 列号进行重排序， 对不同的 IP包进行差异化向信道中传输。
图 5是本发明实施例提供的视频数据传输方法的一种实施例的流程图， 由图可见， 该方法包括：
步骤 S501 , 获取视频码流；
具体的， 基站通过网络获取到视频文件提供网络提供的已经编码好的视 频码流， 例如 H.2264 SVC编码的视频数据。
步骤 S502, 对获取到的视频码流进行深度包检测， 获取图片组数据和所 述图片组数据对应的指示信息；
具体的， 基站对获取到的包含多个 IP包的视频码流进行检测， 并且将顺 序打乱的 IP包进行重新排序。 对 IP包进行排序时的参考信息包括但不限定 于 RTP包头中的序列号。
并在收到的视频码流中检测指示信息 SEI, 并对指示信息中包含的优先 级和数据包大小信息进行识别；
步骤 S503 , 获取所述指示信息中的所述图片组数据的每个数据帧的优先 级；
若一个指示信息同时指示多个图片组数据， 则还需要在指示信息中获取 第一个图片组数据之后的多个图片组数据的变化规律， 例如后续图片组数据 中数据帧的优先级和数据帧大小， 都与第一个图片组数据相同。
在实际应用中， 指示信息若釆用分层信息字段或帧编码类型字段， 来体 现图片组数据中不同数据帧的优先级， 则基站可以将分层信息字段或帧编码 类型字段映射为优先级信息。 步骤 S504, 根据所述优先级顺序发送所述视频码流的图片组数据中的数 据帧；
具体地， 基站在视频码流中检测到指示信息包之后， 在该指示信息包中 读取 IP包大小和优先级信息，按照优先级顺序对后续的多个数据包在信道中 发送。例如，参考指示信息中后续 IP包的大小，判断当前信道资源是否充足； 如果信道资源充足则， 可不考虑优先级顺序， 对后续数据包依次传输。 而在 信道资源不充足的情况下， 则依据指示信息中的优先级指示， 对后续的 IP包 进行有选择的差异化传输， 从而使得用户终端在信道资源不充足的情况下， 也能获得满足基本播放要求的视频文件。
通过上述实施例， 基站可以依据视频码流中的指示信息， 获取后续视频 码流中数据包的优先级和大小信息， 针对信道资源状况和对数据包按照优先 级不同进行差异化传输， 避免对每一帧数据进行深度包检测， 降低检测频率。 提高传输效率。
上述实施例是以视频编码为例， 但是所属领域的技术人员应该理解， 对 于具备分层编码架构的音频数据编码， 也可以釆用本发明提供的技术， 也就 说釆用指示信息指示后续音频数据中数据帧的大小和优先级顺序， 使得基站 能够依据指示信息包中的指示信息， 获取后续音频数据中数据帧的大小和优 先级顺序， 进行差异化传输。
图 6是本发明实施例提供的一种视频数据传输方法的流程图， 由图 6可 见， 所述方法包括：
步骤 S601 , 通过下行信道接收视频码流；
具体的， 手持终端 UE在信道中接收基站下方的视频码流， 所述视频码流 为多个 IP包， 在接收到多个 IP包之后， 依据 RTP包的中的序列号， 将 IP包 进行排序。
步骤 S602, 深度检测接收到的所述视频码流并获取指示信息； 具体的，依据 SEI指示信息具有的包头，检测指示信息。在多个数据包中， 对于同一个图片组的多个数据包， 包含一个指示信息包。
步骤 S603 , 依据获取到的所述指示信息获知所述视频码流中各视频数据 包的大小和优先级；
具体的， 所述指示信息包中包含多个 RTP数据包的优先级和大小信息。 例如图 4所示的途中， 所述的指示信息包中， 可以获知， 优先级为 1的 IP包 有 10个， 优先级为 2的 ip包为 6个， 对应的就是 I帧的优先级为 1 , P帧的 优先级为 2。 只需深度检测一次， 就能获知多个数据帧中的数据包的优先级。 区别于现有技术 SEI包的指示方法中， 值给出某一帧的特定优先级信息， 对 每一帧都需要深度包检测。
在实际应用中， 指示信息若釆用分层信息字段或帧编码类型字段， 来体 现图片组数据中不同数据帧的优先级， 则 UE可以将分层信息字段或帧编码 类型字段映射为优先级信息。
步骤 S604, 根据当前下行信道资源和所述视频数据包的大小和优先级， 向基站发送资源请求。
具体的， 手持终端 UE, 能够根据获知的数据包大小， 判断当前下行信道 资源是否充足， 若充足， 则可以不釆取流控措施， 若信道资源不充足， 则可 以通过指示信息中的优先级状况， 向基站发送资源请求。
此外， 还可以依据从指示信息包中获取到的后续视频数据包的大小和优 先级， 向基站请求信道资源。 例如若信道资源不足， 则可以请求以占用带宽 较小的信道传输优先级高的视频数据， 若信道资源充足， 则无需考虑资源差 别请求。
通过上述实施例， 手持终端依据获取到的视频码流中的指示信息， 能够 获知后续视频码流中不同数据包的优先级和大小， 依据所述数据包的大小， 判定当前信道资源是否充足， 在信道资源不充足的情况下， 按照优先级向基 站请求数据。 避免对一个数据包进行频繁深度检测， 减少数据传输延时。 上述实施例是以视频编码为例， 但是所属领域的技术人员应该理解， 对 于具备分层编码架构的音频数据编码， 也可以釆用本发明提供的技术， 也就 说釆用指示信息指示后续音频数据中数据帧的大小和优先级顺序， 使得手机 能够依据指示信息包中的指示信息， 获取后续音频数据中数据帧的大小和优 先级顺序， 进行差异化资源请求。
图 7是本发明实施例提供的一种视频编码装置的结构示意图， 所述装置 可以具体表现为一种编码器。 由图可见， 所述装置包括：
获取单元 701 , 用以获取视频信息， 并将获取到的视频信息发送给编码 单元 702;
编码单元 702, 用以接收所述获取单元 701 获取到的视频信息， 将所述 视频信息编码为视频码流后， 发送给所述插入单元 703 , 所述视频码流包括 多个图片组数据；
插入单元 703 , 用以接收 702所述编码单元发送的视频码流， 并为所述 视频码流中的所述图片组数据设置指示信息， 将所述指示信息置于对应的所 述图片组数据之前， 所述指示信息用以指示对应的所述图片组数据中各数据 帧的优先级和数据量。
上述视频编码装置是用来实现前述实施例所述的视频数据编码方法， 所 包括的各个单元只是按照功能逻辑进行划分的， 但并不局限于上述的划分， 只要能够实现相应的功能即可； 另外， 各功能单元的具体名称也只是为了便 于相互区分， 并不用于限制本发明的保护范围。
图 8是本发明实施例提供的一种视频数据传输装置的结构示意图， 所述 视频数据传输装置具体可以是一种基站， 由图可见， 所述装置包括：
视频码流获取单元 801 , 用以通过网络获取视频码流， 并将获取的视频 码流发送给指示信息获取单元 802; 指示信息获取单元 802, 用以接收所述视频码流获取单元 801发送的视 频码流， 并对所述视频码流进行深度包检测， 获取图片组数据和所述图片组 数据对应的指示信息， 将获取的所述指示信息发送给优先级获取单元 803 ; 优先级获取单元 803 , 用以接收所述指示信息获取单元 802发送的指示 信息 ,并获取所述指示信息中的所述图片组数据的每个数据帧的优先级之后 , 将所述每个数据帧的优先级发送给数据帧发送单元 804;
数据帧发送单元 804, 用以接收所述优先级获取单元 803发送的每个数 据帧的优先级， 并根据所述优先级顺序发送所述视频码流的图片组数据中的 数据帧。
上述视频数据传输编码装置是用来实现图 5所述实施例所述的视频数据 传输方法， 所包括的各个单元只是按照功能逻辑进行划分的， 但并不局限于 上述的划分， 只要能够实现相应的功能即可； 另外， 各功能单元的具体名称 也只是为了便于相互区分， 并不用于限制本发明的保护范围。
图 9是本发明实施例提供的一种视频数据传输装置的结构示意图， 所述 装置可以为电脑或者手持终端， 由图可见， 该终端包括：
接收单元 901 , 用以接收所述接收单元发送的视频码流， 并深度检测接 收到的所述视频码流，以获取指示信息，将所述指示信息发送给检测单元 902; 检测单元 902, 用以深度检测接收到的所述视频码流并获取指示信息； 获取单元 903 , 用以接收所述检测单元 902发送的指示信息， 并依据获 取到的所述指示信息获知所述视频码流中各视频数据包的数据量和优先级， 之后将所述各视频数据包的数据量和优先级发送给请求单元 904;
请求单元 904, 用以接收所述获取单元 903发送的各视频数据包的数据 量和优先级， 并根据当前下行信道资源和所述视频数据包的大小， 向基站发 送资源请求。
上述视频数据传输装置是用来实现图 6所述实施例所述的视频数据传输 方法， 所包括的各个单元只是按照功能逻辑进行划分的， 但并不局限于上述 的划分， 只要能够实现相应的功能即可； 另外， 各功能单元的具体名称也只 是为了便于相互区分， 并不用于限制本发明的保护范围。
最后， 应该指出的是， 本发明是以视频传输数据为例， 提供一种能够减 低检测复杂度的编码方法， 本发明实施方式也可以应用在音频数据编码和传 输领域中， 所属领域的技术人员应该^ [艮容易将本发明所提供的编码方法和数 据传输方法应用到音频数据传输领域中， 因此对于音频数据的传输， 釆用了 本发明所提供的方法， 也应落入本发明的保护范围内。
专业人员应该还可以进一步意识到， 结合本文中所公开的实施例描述的 各示例的单元及算法步骤， 能够以电子硬件、 计算机软件或者二者的结合来 实现， 为了清楚地说明硬件和软件的可互换性， 在上述说明中已经按照功能 一般性地描述了各示例的组成及步骤。 这些功能究竟以硬件还是软件方式来 执行， 取决于技术方案的特定应用和设计约束条件。 专业技术人员可以对每 个特定的应用来使用不同方法来实现所描述的功能， 但是这种实现不应认为 超出本发明的范围。
结合本文中所公开的实施例描述的方法或算法的步骤可以用硬件、 处理 器执行的软件模块， 或者二者的结合来实施。 软件模块可以置于随机存储器 ( RAM ) 、 内存、 只读存储器（ROM ) 、 电可编程 ROM、 电可擦除可编程 ROM, 寄存器、 硬盘、 可移动磁盘、 CD-ROM, 或技术领域内所公知的任意 其它形式的存储介质中。
以上所述的具体实施方式， 对本发明的目的、 技术方案和有益效果进行 了进一步详细说明， 所应理解的是， 以上所述仅为本发明的具体实施方式而 已， 并不用于限定本发明的保护范围， 凡在本发明的精神和原则之内， 所做 的任何修改、 等同替换、 改进等， 均应包含在本发明的保护范围之内。

Claims

权 利 要 求 书
1、 一种视频数据编码方法， 其特征在于， 所述方法包括：
获取视频信息；
将所述视频信息编码为视频码流， 所述视频码流包括图片组数据； 为所述图片组数据设置指示信息， 并将所述指示信息置于对应的所述图 片组数据之前， 所述指示信息用以指示对应的所述图片组数据中各数据帧的 优先级和数据量。
2、 如权利要求 1 所述的方法， 其特征在于， 所述指示信息包括指示信 息包头， 和用以指示数据帧优先级的字段位和用以指示所述数据帧数据量的 字段位。
3、 如权利要求 2所述的方法， 其特征在于， 用以指示优先级的字段位 为帧编码类型字段位、 优先级字段位或分层信息字段位。
4、 如权利要求 1-3 任一项所述的方法， 其特征在于， 所述指示信息中 包括对应的一个图片组数据中各数据帧的优先级、 数据量以及后续的多个图 片组数据中各数据帧的优先级和数据量的变化规律。
5、 如权利要求 1-4任一项所述的方法， 其特征在于， 在所述视频码流 中的所述多个图片组数据中的每个图片组数据之前加入指示信息之后， 还包 括：
将加入所述指示信息之后的所述视频码流分解为多个 IP包。
6、 一种视频数据传输方法， 其特征在于， 所述方法包括：
获取视频码流；
对所述视频码流进行深度包检测， 获取图片组数据和所述图片组数据对 应的指示信息；
获取所述指示信息中的所述图片组数据的每个数据帧的优先级； 根据所述优先级顺序发送所述视频码流的图片组数据中的数据帧。
7、 如权利要求 6所述的视频数据传输方法， 其特征在于， 所述获取所 述指示信息中的所述图片组数据的每个数据帧的优先级之后还包括：
获取所述指示信息中的不同的图片组数据中的每个数据帧的优先级和大 小的变化规律。
8、 如权利要求 6或 7所述的方法， 其特征在于， 所述多个图片组数据 中的单个图片组数据进一步包括多个 RTP 包， 每个 RTP 包进一步包括多个 IP包；
所述获取指示信息和多个图片组数据之后还包括：
对所述多个 IP包按照所述 RTP包的包头中的序列号进行依序重排。
9、 如权利要求 6-8任一项所述的方法， 其特征在于， 根据所述优先级顺 序发送所述视频码流的图片组数据中的数据帧进一步包括：
依据所述指示信息中的优先级， 对所述 IP包进行传输。
10、 一种视频数据传输方法， 其特征在于， 所述方法包括：
通过下行信道接收视频码流；
深度包检测接收到的所述视频码流并获取指示信息；
依据获取到的所述指示信息获知所述视频码流中各视频数据包的数据量 和优先级；
根据当前下行信道资源和所述视频数据包的数据量， 向基站发送资源请 求。
11、 如权利要求 10所述的方法， 其特征在于， 所述向基站发送资源请求 进一步包括：
请求基站按照从所述指示信息中的优先级顺序发送所述视频数据包。
12、 一种视频编码装置， 其特征在于， 所述装置包括：
获取单元， 用以获取视频信息， 并将获取到的视频信息发送给编码单元； 编码单元， 用以接收所述获取单元获取到的视频信息， 将所述视频信息 编码为视频码流后， 发送给所述插入单元， 所述视频码流包括多个图片组数 据；
插入单元， 用以接收所述编码单元发送的视频码流， 并为所述视频码流 中的所述图片组数据设置指示信息， 将所述指示信息置于对应的所述图片组 数据之前， 所述指示信息用以指示对应的所述图片组数据中各数据帧的优先 级和数据量。
13、 如权利要求 12所述的装置， 其特征在于， 所述插入单元设置的指示 信息包括指示信息包头， 和用以指示数据帧优先级的字段位和用以指示所述 数据帧数据量的字段位。
14、 如权利要求 13所述的装置， 其特征在于， 所述用以指示优先级的字 段位为帧编码类型字段位、 优先级字段位或分层信息字段位。
15、 如权利要求 12-14任一项所述的装置， 其特征在于， 所述指示信息 中包括对应的一个图片组数据中各数据帧的优先级、 数据量以及后续的多个 图片组数据中各数据帧的优先级和数据量的变化规律。
16、 如权利要求 12-15任一项所述的装置， 其特征在于， 所述装置还包 括：
分解单元， 用以将加入所述指示信息之后的所述视频码流分解为多个 IP 包。
17、 一种视频数据传输装置， 其特征在于， 所述装置包括：
视频码流获取单元， 用以通过网络获取视频码流， 并将获取的视频码流 发送给指示信息获取单元；
指示信息获取单元， 用以接收所述视频码流获取单元发送的视频码流， 并对所述视频码流进行深度包检测， 获取图片组数据和所述图片组数据对应 的指示信息， 将获取的所述指示信息发送给优先级获取单元；
优先级获取单元， 用以接收所述指示信息获取单元发送的指示信息， 并 获取所述指示信息中的所述图片组数据的每个数据帧的优先级之后， 将所述 每个数据帧的优先级发送给数据帧发送单元；
数据帧发送单元， 用以接收所述优先级获取单元发送的每个数据帧的优 先级， 并根据所述优先级顺序发送所述视频码流的图片组数据中的数据帧。
18、 如权利要求 17所述的装置， 其特征在于， 所述多个图片组数据中的 单个图片组数据进一步包括多个 RTP包，每个 RTP包进一步包括多个 IP包， 所述装置还包括：
排序单元，用以对所述多个 IP包按照所述 RTP包的包头中的序列号进行 依序重排。
19、 如权利要求 18所述的装置， 其特征在于，
所述数据帧发送单元具体用于依据所述指示信息中的优先级， 对所述 IP 包进行传输。
20、 一种视频数据传输装置， 其特征在于， 所述装置包括：
接收单元， 用以通过下行信道接收视频码流， 并将所述视频码流发送给 检测单元；
检测单元， 用以接收所述接收单元发送的视频码流， 并深度检测接收到 的所述视频码流， 以获取指示信息， 将所述指示信息发送给获取单元；
获取单元， 用以接收所述检测单元发送的指示信息， 并依据获取到的所 述指示信息获知所述视频码流中各视频数据包的数据量和优先级， 之后将所 述各视频数据包的数据量和优先级发送给请求单元；
请求单元， 用以接收所述获取单元发送的各视频数据包的数据量和优先 级， 并根据当前下行信道资源和所述视频数据包的大小， 向基站发送资源请 求。
21、 一种视频传输系统， 其特征在于， 所述系统包括权利要求 13所述的 视频数据编码装置、 权利要求 19所述的视频数据传输装置和权利要求 22所 述的视频数据传输装置。
PCT/CN2012/077932 2012-06-29 2012-06-29 视频数据传输方法及装置 WO2014000278A1 (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
EP12880171.9A EP2849393B1 (en) 2012-06-29 2012-06-29 Method and device for transmitting video data
CN201280003631.8A CN103650431B (zh) 2012-06-29 2012-06-29 视频数据传输方法及装置
PCT/CN2012/077932 WO2014000278A1 (zh) 2012-06-29 2012-06-29 视频数据传输方法及装置
US14/581,231 US20150110168A1 (en) 2012-06-29 2014-12-23 Video data transmission method and apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2012/077932 WO2014000278A1 (zh) 2012-06-29 2012-06-29 视频数据传输方法及装置

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US14/581,231 Continuation US20150110168A1 (en) 2012-06-29 2014-12-23 Video data transmission method and apparatus

Publications (1)

Publication Number Publication Date
WO2014000278A1 true WO2014000278A1 (zh) 2014-01-03

Family

ID=49782118

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2012/077932 WO2014000278A1 (zh) 2012-06-29 2012-06-29 视频数据传输方法及装置

Country Status (4)

Country Link
US (1) US20150110168A1 (zh)
EP (1) EP2849393B1 (zh)
CN (1) CN103650431B (zh)
WO (1) WO2014000278A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108307194A (zh) * 2018-01-03 2018-07-20 西安万像电子科技有限公司 图像编码的传输控制方法及装置

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014189422A1 (en) * 2013-05-23 2014-11-27 Telefonaktiebolaget L M Ericsson (Publ) Transmitting node, receiving node and methods therein
US10666909B2 (en) * 2016-06-29 2020-05-26 Intel Corporation Methods and apparatus to perform remote monitoring
US10104677B2 (en) * 2017-03-13 2018-10-16 Microsoft Technology Licensing, Llc Code shortening at a secondary station
CN109194974B (zh) * 2018-09-28 2020-12-01 北京网高科技股份有限公司 用于网络视频直播的媒体低延迟通信方法与系统
CN111225238A (zh) * 2018-11-26 2020-06-02 华为技术有限公司 信息处理方法及相关设备
CN111124333A (zh) * 2019-12-05 2020-05-08 视联动力信息技术股份有限公司 电子白板显示内容同步的方法、装置、设备以及存储介质
CN111708505B (zh) * 2020-07-21 2021-01-01 全时云商务服务股份有限公司 桌面共享方法、装置和电子设备
CN112261319B (zh) * 2020-10-23 2022-12-06 宿迁海沁节能科技有限公司 一种8k+tv录制传输与播放的区块链服务方法
CN114866185B (zh) * 2022-03-25 2023-08-29 天津瑞发科半导体技术有限公司 一种传输多优先级数据帧的方法
WO2023184552A1 (zh) * 2022-04-02 2023-10-05 Oppo广东移动通信有限公司 一种数据传输方法及装置、通信设备

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5481312A (en) * 1994-09-12 1996-01-02 At&T Corp. Method of and apparatus for the transmission of high and low priority segments of a video bitstream over packet networks
CN101030938A (zh) * 2007-02-05 2007-09-05 北京大学 QoS自适应的P2P流媒体数据组织与传输系统及方法
CN101610257A (zh) * 2009-07-17 2009-12-23 北京邮电大学 一种互联网业务流的实时上下文感知与分级标记的方法
CN102244608A (zh) * 2011-06-09 2011-11-16 杭州米加科技有限公司 流媒体内容优先级自适应传输的方法

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5140417A (en) * 1989-06-20 1992-08-18 Matsushita Electric Co., Ltd. Fast packet transmission system of video data
JP2000350197A (ja) * 1999-06-02 2000-12-15 Hitachi Ltd 映像伝送方法とそれを用いた監視システム
KR100580158B1 (ko) * 1999-06-12 2006-05-15 삼성전자주식회사 화상 패킷 전송을 위한 무선통신 시스템
US7417989B1 (en) * 2003-07-29 2008-08-26 Sprint Spectrum L.P. Method and system for actually identifying a media source in a real-time-protocol stream
JP2006129248A (ja) * 2004-10-29 2006-05-18 Sanyo Electric Co Ltd 画像符号化方法および装置、ならびに画像復号方法および装置
US7668170B2 (en) * 2007-05-02 2010-02-23 Sharp Laboratories Of America, Inc. Adaptive packet transmission with explicit deadline adjustment
US20090103635A1 (en) * 2007-10-17 2009-04-23 Peshala Vishvajith Pahalawatta System and method of unequal error protection with hybrid arq/fec for video streaming over wireless local area networks
US8745677B2 (en) * 2009-06-12 2014-06-03 Cygnus Broadband, Inc. Systems and methods for prioritization of data for intelligent discard in a communication network

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5481312A (en) * 1994-09-12 1996-01-02 At&T Corp. Method of and apparatus for the transmission of high and low priority segments of a video bitstream over packet networks
CN101030938A (zh) * 2007-02-05 2007-09-05 北京大学 QoS自适应的P2P流媒体数据组织与传输系统及方法
CN101610257A (zh) * 2009-07-17 2009-12-23 北京邮电大学 一种互联网业务流的实时上下文感知与分级标记的方法
CN102244608A (zh) * 2011-06-09 2011-11-16 杭州米加科技有限公司 流媒体内容优先级自适应传输的方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2849393A4 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108307194A (zh) * 2018-01-03 2018-07-20 西安万像电子科技有限公司 图像编码的传输控制方法及装置

Also Published As

Publication number Publication date
EP2849393A4 (en) 2015-04-08
CN103650431B (zh) 2017-12-01
EP2849393B1 (en) 2019-08-28
EP2849393A1 (en) 2015-03-18
CN103650431A (zh) 2014-03-19
US20150110168A1 (en) 2015-04-23

Similar Documents

Publication Publication Date Title
WO2014000278A1 (zh) 视频数据传输方法及装置
CN109068147A (zh) 一种多媒体数据传输方法、装置以及相关设备
JP7496022B2 (ja) クライアント、サーバ、受信方法及び送信方法
WO2014086142A1 (zh) 一种视频图像的处理方法及装置
CN104284135B (zh) 视频传输方法及设备
CN109511011B (zh) 一种面向YouTube DASH加密视频的指纹数据库构建方法
CN105072506B (zh) 教学直播视频的传输方法及系统
CN1859579A (zh) 传输多媒体数据流的设备和方法
CN107948762A (zh) 直播视频的传输方法、装置和系统
EP2667625A2 (en) Apparatus and method for transmitting multimedia data in a broadcast system
WO2018058587A1 (zh) 一种视频质量的评估方法、评估装置和系统
CN114449291A (zh) 数据传输方法、设备及计算机存储介质
Zhang et al. An enlarging-the-capacity packet sorting covert channel
Sun et al. Quality-optimized and secure end-to-end authentication for media delivery
CN113543216B (zh) 媒体报文的传输方法、装置及系统
WO2015077960A1 (zh) 一种数据报文的传输方法和设备
JP2006319851A (ja) 携帯端末、ストリーミング通信システム、ストリーミング通信方法及びストリーミング通信プログラム
WO2022206016A1 (zh) 一种数据分层传输方法、装置及系统
JP2004349891A (ja) パケット送信装置、パケット受信装置、方法及びプログラム
US9344480B2 (en) Method of providing wireless data communication service using IP and apparatus thereof
CN114979793A (zh) 一种直播数据传输方法、装置、系统、设备和介质
JPWO2018142874A1 (ja) データ配信システム、データ配信方法、マーカ、フィルタ及びプログラム
CN114363676A (zh) 视频流传输方法、装置、设备及介质
CN106534137B (zh) 媒体流传输方法及装置
CN111030985A (zh) 一种数据包发送方法和装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12880171

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2012880171

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE