CN110225347A - Method of transmitting video data, device, electronic equipment and storage medium - Google Patents
Method of transmitting video data, device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN110225347A CN110225347A CN201910548319.0A CN201910548319A CN110225347A CN 110225347 A CN110225347 A CN 110225347A CN 201910548319 A CN201910548319 A CN 201910548319A CN 110225347 A CN110225347 A CN 110225347A
- Authority
- CN
- China
- Prior art keywords
- data packet
- equipment
- video data
- frame
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 65
- 238000003860 storage Methods 0.000 title claims abstract description 12
- 238000004891 communication Methods 0.000 claims abstract description 71
- 230000005540 biological transmission Effects 0.000 claims abstract description 32
- 239000000284 extract Substances 0.000 claims abstract description 22
- 230000004044 response Effects 0.000 claims description 31
- 238000012545 processing Methods 0.000 claims description 21
- 238000004590 computer program Methods 0.000 claims description 16
- 230000002159 abnormal effect Effects 0.000 claims description 15
- 238000004422 calculation algorithm Methods 0.000 claims description 15
- 238000012544 monitoring process Methods 0.000 claims description 14
- 238000005538 encapsulation Methods 0.000 claims description 13
- 230000008569 process Effects 0.000 claims description 12
- 238000000605 extraction Methods 0.000 claims description 11
- 238000002360 preparation method Methods 0.000 claims 1
- 230000002708 enhancing effect Effects 0.000 abstract description 5
- 238000012360 testing method Methods 0.000 description 26
- 238000010586 diagram Methods 0.000 description 23
- 230000000875 corresponding effect Effects 0.000 description 11
- 238000013461 design Methods 0.000 description 7
- 239000013598 vector Substances 0.000 description 7
- 230000006870 function Effects 0.000 description 5
- 125000004122 cyclic group Chemical group 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 238000012795 verification Methods 0.000 description 3
- 101100122750 Caenorhabditis elegans gop-2 gene Proteins 0.000 description 2
- 101100476639 Caenorhabditis elegans gop-3 gene Proteins 0.000 description 2
- 101000946275 Homo sapiens Protein CLEC16A Proteins 0.000 description 2
- 102100034718 Protein CLEC16A Human genes 0.000 description 2
- 238000005314 correlation function Methods 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 230000005856 abnormality Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 210000003127 knee Anatomy 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/177—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/65—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using error resilience
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
- H04N19/89—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
- H04N21/64723—Monitoring of network processes or resources, e.g. monitoring of network load
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Security & Cryptography (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
This application discloses a kind of method of transmitting video data, device and storage mediums, when the network quality of communication link is deteriorated, sending device extracts the key message in video data packet and generates the second data packet, video data packet and the second data packet are sent to receiving end together, the key message that the application can use in the second data packet recovers original video data, the reliability of video data transmission, the anti-packet loss ability that enhancing network quality deteriorates can be improved.
Description
Technical field
This application involves field of video processing more particularly to a kind of method of transmitting video data, device, electronic equipment and deposit
Storage media.
Background technique
For the ease of storing and transmitting for video content, it usually needs reduce the size of video content, that is, need video
Original contents element compressed, this technology is known as Video coding；It is corresponding with Video coding, when need to video carry out
When broadcasting, it is also desirable to be decoded accordingly to the video after coding, can just read picture and render display.
In the prior art, for the ease of decoding, and decoding efficiency is improved, encoder is carried out to multiple original images
It after coding, can generate multiple images group (group of pictures, GOP), encoder can read multiple when playing
GOP to be encoded, and needs that all coded datas is waited to read and finishes, can just be decoded, that is to say, that GOP is
The unit of encoding video pictures device and decoder accesses.
In general, GOP can be made of an I frame and multiple B frames or P frame, I frame is intra-coded frame, the of each GOP
One frame is a complete image；P frame is forward predicted frame, and record is change relative to I frame and adjacent previous P frame
Change, B frame is two-way interpolation frame, and the difference with P frame is, it can both refer to I frame or adjacent previous frame, can also be referred to
Adjacent following frame, i.e., P frame recording is variation relative to adjacent before and after frames.
Summary of the invention
The inventor of the present application discovered that: when the network quality of communication link is deteriorated, video data packet is in transmission process
It is easy to happen loss, such decoding end plays the phenomenon that video pictures are easy to happen Caton, and how to improve anti-packet loss ability is mesh
Preceding urgent problem to be solved.
In order to solve the above technical problems, the application provides a kind of method of transmitting video data, in the link of communication link
When quality is deteriorated, the second data packet is carried in data packet to be sent, the key frame generation loss reduced in video data is led
The problem of causing decoding failure, can be improved the reliability of video data transmission.
In a first aspect, this application provides a kind of method of transmitting video data, comprising:
The network quality parameters of communication link between first the first equipment of equipment monitoring and the second equipment, according to network
When mass parameter determines that the network state of communication link is abnormal, the first equipment obtains video data packet to be sent, video counts
It include at least one key frame according to packet；First equipment extracts the key message in video data packet, and the first equipment extracts video counts
It encapsulates to obtain the second data packet according to the key message in packet, and by key message progress data, key message includes video counts
According at least one key frame for including in packet；First equipment sends the second data packet and video data packet to the second equipment.Wherein,
First equipment can send the second data packet and video data packet simultaneously to the second equipment, or by the second data packet and video counts
Coded data packet is obtained after carrying out data encapsulation according to packet, then sends the coded data packet to the second equipment, the application is real
Apply example with no restriction.
In a kind of possible design, the network of the communication link between first the first equipment of equipment monitoring and the second equipment
Mass parameter, comprising:
First equipment sends the first data packet to the second equipment, can not carry information in the backpack body of the first data packet, the
Test mark is carried in the packet header of one data packet, test mark is for distinguishing different test process.First equipment receives second
The response bag that equipment is sent in response to the first data packet, response bag carry test mark；First equipment according to the first data packet and
The test carried in response bag, which identifies, determines that two packets have incidence relation.First equipment is according to the first data packet of transmission
The round-trip delay of communication link is calculated at the time of moment and reception response bag.
In a kind of possible design, when the network state for determining communication link according to network quality parameters is abnormal,
First equipment obtains video data packet to be sent, comprising:
When RTT is greater than duration threshold value, determine that the network state of communication link is abnormal；
Multiple figure GOP are obtained from the video data after coding；Wherein, the video data after the coding is according to original
What beginning video data obtained after being encoded；
At least one GOP progress data are encapsulated to obtain the video data packet.
It is described to encapsulate to obtain the second data packet by key message progress data in a kind of possible design, comprising:
Extract key frame all in the video data packet；
XOR operation is carried out to key frame all in the video data packet according to preconfigured mask table to be covered
Code data information；
Data encapsulation process, which is carried out, according to mask data information obtains second data packet.
In a kind of possible design, the first equipment sends the second data packet and video data packet to the second equipment, comprising:
The second data packet is handled to obtain check information according to checking algorithm；
Check information is added in the packet header of the second data packet；
The second data packet for adding check information and video data packet are subjected to the number after data encapsulation process is encoded
According to packet.
In a kind of possible design, key message further includes sequence parameter set and/or picture parameter set.
Second aspect, this application provides a kind of method of transmitting video data, comprising:
Second equipment receives video data packet and the second data packet from the first equipment；
In the case that crucial frame decoding of second equipment in video data packet fails, the mark of the key frame is obtained；
Second equipment extracts the key frame of mark instruction in the second data packet；
Second equipment is decoded to obtain original video data according to the key frame of extraction.
In a kind of possible design, the second equipment extracts the key frame of mark instruction in the second data packet, comprising:
Verify identified in the second data packet instruction key frame it is whether complete；
When verifying successfully, the key frame of mark instruction is extracted in the second data packet.
The another aspect of the application provides a kind of device, and the video data of above-mentioned first aspect or second aspect may be implemented
Transmission method.Such as described device can be chip (such as digital processing chip DSP or application processor chip) or service
Device.The corresponding software realization above method can be executed by software, hardware or by hardware.
It in one possible implementation, include processor, memory in the structure of described device；The processor quilt
It is configured to that described device is supported to execute corresponding function in above-mentioned application testing method.Memory is used to couple with processor,
Save the necessary program of described device (instruction) and/or data.Optionally, described device can also include communication interface for branch
Hold the communication between described device and other network elements.
In alternatively possible implementation, the apparatus may include the units for executing corresponding actions in the above method
Module.
In another possible implementation, including processor and R-T unit, the processor and the transmitting-receiving fill
Set coupling, the processor for executing computer program or instruction, with control the R-T unit carry out information reception and
It sends；When the processor executes the computer program or instruction, the processor is also used to realize the above method.Its
In, the R-T unit can be transceiver, transmission circuit or input/output interface.When described device is chip, the receipts
Transmitting apparatus is transmission circuit or input/output interface.
When described device is chip, transmission unit can be output unit, such as output circuit or communication interface；It connects
Receiving unit can be input unit, such as input circuit or communication interface.When described device is the network equipment, transmission unit
It can be transmitter or transmitter；Receiving unit can be receiver or receiver.
The another aspect of the application provides a kind of device, which includes: memory and processor；Wherein, the storage
Batch processing code is stored in device, and the processor executes each side for calling the program code stored in the memory
Method described in face.
The another aspect of the application has been mentioned for a kind of computer readable storage medium, in the computer readable storage medium
It is stored with instruction, when run on a computer, so that computer executes method described in above-mentioned various aspects.
The another aspect of the application provides a kind of computer program product comprising instruction, when it runs on computers
When, so that computer executes method described in above-mentioned various aspects.
According to the above embodiments, when the network quality of communication link is deteriorated, sending device is after sending coded treatment
Video data packet before, extract the key message in video data packet, data carried out to key message and encapsulate to obtain the second number
According to packet, video data packet and the second data packet are then sent to receiving device together, general receiving device is to video data packet
In the case where decoding failure, the key message that can use in the second data packet recovers original video data, can improve video
The reliability of data transmission, the anti-packet loss ability that enhancing network quality deteriorates.
Detailed description of the invention
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of application for those of ordinary skill in the art without creative efforts, can be with
It obtains other drawings based on these drawings.
Fig. 1 is network architecture diagram provided by the embodiments of the present application；
Fig. 2 is a kind of flow diagram of method of transmitting video data provided by the embodiments of the present application；
Fig. 3 is another flow diagram of method of transmitting video data provided by the embodiments of the present application；
Fig. 4 is another flow diagram of method of transmitting video data provided by the embodiments of the present application；
Fig. 5 is the interaction schematic diagram of method of transmitting video data provided by the embodiments of the present application；
Fig. 6 is a kind of structural schematic diagram of device provided by the embodiments of the present application；
Fig. 7 is a kind of another structural schematic diagram of device provided by the embodiments of the present application；
Fig. 8 is a kind of another structural schematic diagram of device provided by the embodiments of the present application.
Specific embodiment
It is with reference to the accompanying drawings and embodiments, right in order to which the objects, technical solutions and advantages of the application are more clearly understood
The application is further elaborated.It should be appreciated that specific embodiment described herein is only used to explain the application, and
It is not used in restriction the application.Meanwhile in the description of the present application, term " first ", " second " etc. are only used for distinguishing description, without
It can be interpreted as indication or suggestion relative importance.It will be clear to one skilled in the art that these details its
The application also may be implemented in its embodiment.In other situations, it omits to well-known system, device, circuit and side
The detailed description of method, so as not to obscure the description of the present application with unnecessary details.
Fig. 1 shows the exemplary of the method for transmitting video data that can be applied to the application or video data transmission device
System architecture 100.
As shown in Figure 1, system architecture 100 may include terminal device 100, first network 101, server 102, the second net
Network 103 and terminal device 104.First network 104 between terminal device 101 and server 102 for providing communication link
Medium, the second network 103 between terminal device 104 and server 102 for providing the medium of communication link.First network
101 and second network 103 may include various types of wired communications links or wireless communication link, such as: wire communication chain
Road includes optical fiber, twisted pair or coaxial cable, and wireless communication link includes bluetooth communications link, Wireless Fidelity (Wireless-
Fidelity, Wi-Fi) communication link or microwave communications link etc..
Wherein, the first equipment in the application and the second equipment can be any two equipment in system architecture, such as:
First equipment is terminal device 100, and the second equipment is server 102；Or first equipment be server 102, the second equipment be eventually
End equipment 104；Or first equipment be terminal device 100, the second equipment is terminal device 104 etc., and the application no longer carries out exhaustion.
Terminal device 100 between first network 101, server 102, the second network 103 and terminal device 104 by carrying out
Communication, terminal device 100 send message to server 102, and server 102 forwards messages to terminal device 104, terminal device
104 transmit the message to server 102, and server 102 forwards messages to terminal device 100, are achieved in terminal device 100
Communication between terminal device 104, the type of message of interaction includes control number between terminal device 100 and terminal device 104
According to and business datum.
Wherein, in this application, terminal device 100 is the terminal that student attends class, and terminal device 104 is the end of class-teaching of teacher
End；Or terminal device 100 is the terminal of class-teaching of teacher, terminal device 104 is the terminal that student attends class.Such as: business datum is
Video data, terminal device 100 lead to the first video data during camera acquisition student attends class, and terminal device passes through camera shooting
First video data is sent to server by the second video data during first 104 acquisition class-teaching of teacher, terminal device 100
102, the first video data is transmitted to terminal device 104 by server 102, and terminal device 104 shows the first video on interface
Data and the second video data；Second video data is sent to server 102 by terminal device 104, and server 102 is regarded second
Frequency shows the first video data and the second video data according to terminal device 100, terminal device 100 is transmitted to.
Wherein, the mode of attending class of the application can be one-to-one or one-to-many, i.e. the corresponding student or one of a teacher
A teacher corresponds to multiple students.Correspondingly, one is used for the terminal and a use of class-teaching of teacher in one-to-one teaching method
It is communicated between the terminal that student attends class；In one-to-many teaching method, one for the terminal of class-teaching of teacher and more
It is communicated between a terminal attended class for student.
Various communication customer end applications can be installed on terminal device 100 and terminal device 104, such as: video record
It is soft using, video playing application, interactive voice application, searching class application, timely means of communication, mailbox client, social platform
Part etc..
Terminal device 100 and terminal device 104 can be hardware, be also possible to software.When terminal device 101~103 is
When hardware, can be the various electronic equipments with display screen, including but not limited to smart phone, tablet computer, it is on knee just
Take formula computer and desktop computer etc..When terminal device 100 and terminal device 104 are software, it can be and install
It states in cited electronic equipment.It may be implemented in multiple softwares or software module (such as: for providing Distributed Services),
Also single software or software module may be implemented into, be not specifically limited herein.
When terminal device 100 and terminal device 104 are hardware, it is also equipped with display equipment and camera thereon,
Display equipment, which is shown, can be the various equipment for being able to achieve display function, and camera is for acquiring video data；Such as: display is set
It is standby to can be cathode-ray tube display (Cathode ray tubedisplay, abbreviation CR), light emitting diode indicator
(Light-emitting diode display, abbreviation LED), electronic ink screen, liquid crystal display (Liquid crystal
Display, abbreviation LCD), Plasmia indicating panel (Plasma display panel, abbreviation PDP) etc..User can use
Display equipment on terminal device 100 and terminal device 104, come information such as the texts, picture, video of checking display.
Server 102 can be to provide the server of various services, and server 102 can be hardware, be also possible to software.
When server 105 is hardware, the distributed server cluster of multiple server compositions may be implemented into, list also may be implemented into
A server.When server 102 is software, multiple softwares or software module may be implemented into (such as providing distribution
Service), single software or software module also may be implemented into, be not specifically limited herein.
It should be understood that the number of terminal device, network and server in Fig. 1 is only illustrative.It, can according to needs are realized
To be any number of terminal device, network and server.
In order to illustrate technical solution described herein, the following is a description of specific embodiments.
Referring to fig. 2, Fig. 2 is the flow diagram of method of transmitting video data provided by the embodiments of the present application, in the application
In embodiment, which comprises
The network quality parameters of communication link between S201, first the first equipment of equipment monitoring and the second equipment.
In general, the communication link between the first equipment and the second equipment indicates to be used between the first equipment and the second equipment
The link of data packet is transmitted, which may be the link that direct-connected formation is carried out between the first equipment and the second equipment,
It may be that the link formed is passed through by trunking between the first equipment and the second equipment.Communication link may be the first equipment
Link between the second equipment is also possible to the second equipment to the link between the first equipment, is also possible to simultaneously include the
One equipment between the second equipment link and the second equipment to the link between the first equipment.Network quality parameters are for assessing
The parameter of the network quality of communication link, network quality parameters include but is not limited to: round-trip delay, packet loss, in the bit error rate
It is one or more.
Wherein, the equipment for measuring communication link can be the first equipment, be also possible to the second equipment.Second device measuring is logical
When believing the network quality parameters of link, network quality parameters can be notified to the first equipment.Meanwhile first device measuring communication
After the network quality parameters of link, which can be notified to the second equipment.First equipment can be periodical
Monitoring communication link network quality parameters, it is pre-stored or be pre-configured that the period of monitoring can be the first equipment, the period
Length can determine according to actual needs, and the application is with no restriction.
S202, when the network state for determining communication link according to network quality parameters is abnormal, the first equipment obtain to
The video data packet of transmission.
In general, the first equipment determines that the network state of communication link, network state include just according to network quality parameters
Normal and abnormal two states.Optionally, the method for determining the network state of communication link can be the network quality for comparing measurement
The method of parameter and threshold value judges.
Such as: network quality parameters are packet loss, and the packet loss measured on the communication link is greater than packet loss threshold value
In the case of, the first equipment determines that the network state of the communication link is abnormality.It include the view after coding in video data packet
Frequency frame, includes at least one I frame in video data packet, I frame, that is, key frame, the mode packet of Video coding but is not limited to: audio view
Frequency stagger scheme (audio video interleaved, AVI), real-time media can bit rate (realmedia variable
Bitrate, RMVB), dynamic image expert group -2 (moving picture experts group, MPEG-2), Video coding -
1 (Video Codec 1, VC-1), H.264, MPEG-4, MPEG-2, WMA etc., specific coding principle can refer to existing volume
The description of code agreement, details are not described herein again.
S203, the first equipment extract the key message in video data packet, and key message progress data are encapsulated
To the second data packet.
In general, key message indicates in video data packet necessary information when being decoded, key message includes but not
It is limited to one of key frame, sequence parameter set SPS and picture parameter set or a variety of, key frame can be I frame.First equipment will
Key message carries out data and encapsulates to obtain the second data packet.Such as: the first equipment using redundant arithmetic to key message at
Reason obtains the second data packet, to improve the reliability of key message transmission.
S204, the first equipment send the second data packet and video data packet to the second equipment.
In general, the first equipment can send the second data packet and video data packet simultaneously to the second equipment, or by the
Two data packets and video data packet obtain coded data packet after carrying out data encapsulation, after then sending the coding to the second equipment
Data packet, the embodiment of the present application is with no restriction.
Implement the embodiment of the present application, when the network quality of communication link is deteriorated, sending device is after sending coded treatment
Video data packet before, extract the key message in video data packet, data carried out to key message and encapsulate to obtain the second number
According to packet, video data packet and the second data packet are then sent to receiving device together, general receiving device is to video data packet
In the case where decoding failure, the key message that can use in the second data packet recovers original video data, can improve video
The reliability of data transmission, the anti-packet loss ability that enhancing network quality deteriorates.
It is a kind of another flow diagram of method of transmitting video data provided by the embodiments of the present application, at this referring to Fig. 3
Apply in embodiment, which comprises
S301, the first equipment send the first data packet to the second equipment.
In general, the first data packet carries test mark, test mark is for distinguishing different test process, test mark
It can be serial number, such as: start to carry out being incremented by number for step-length with 1 with 1.First data packet includes packet header and backpack body, in packet header
The description information of the first data packet is carried, such as: one of test mark, check information, length information are a variety of, the first number
Data, as empty backpack body can not be carried according to the backpack body of packet.
Wherein, the first equipment also will record at the time of send the first data packet, and first data packet of transmission at the time of records
To local.
In one embodiment, the first equipment can send multiple the to the second equipment in the time interval of preset duration
One data packet, there is each first data packet different tests to identify, when the first equipment records the transmission of each first data packet
It carves.Such as: the first equipment sends multiple first data packets according to preset time interval, records each first data packet respectively
Sending instant.
S302, the first equipment receive the response bag that the second equipment is sent in response to the first data packet.
In general, parsing the test mark carried in the packet header of the first data packet after the second equipment receives the first data packet
Know, generates a response bag in response to first data packet, test mark is carried in the packet header of response bag.
Such as: the test for the test bag that the second equipment receives is identified as 0x01, and the second equipment generates a response bag, should
Also identical test mark 0x01 is carried in the packet header of response bag.
It should be understood that needing respectively each first data packet in the case that the first equipment receives multiple first data packets
Return to a response bag.
In one embodiment, one the first data packet of the every transmission of the first equipment will start timer, in timer expiry
After determine that first data packet sends failure, the timing length of timer can be arranged according to actual needs, and the application does not limit
System.Such as: timing length 5ms, the first equipment start timer when sending the first data packet, arrive in the timing length of timer
When, the corresponding response bag of the first data packet is not detected in the determination of the first equipment.
S303, the first equipment calculate communication link according at the time of sending the first data packet and at the time of receiving response bag
RTT。
Wherein, the first equipment will record the sending instant of the first data packet when sending the first data packet, then receive
The time of reception of the response bag is recorded when response bag, is calculated between the sending instant of the first data packet and the time of reception of response bag
RTT.
In one embodiment, the network quality parameters of communication link can be packet loss, and the first equipment calculates communication chain
The method of the packet loss on road may is that the first equipment sends multiple first data to the second equipment in preset time interval
Packet, each first data packet carry different test marks, and then the first equipment receives in the time interval sets from second
Standby response bag counts the quantity of response bag, according to the quantity of the quantity of the response bag received and the first data packet sent
Determine the packet loss of communication link.
Such as: the first equipment sends 100 the first data packets, Ge Ge to the second equipment between t1 moment and t2 moment
The test mark of one data packet is numbered from 1 to 100, then receives between t1 moment and t2 moment from the second equipment
Response bag counts the quantity of the response bag received, it is assumed that receives 80 response bags, determines that the packet loss of communication link is
(100-80)/100*100%=20%.
In one embodiment, the network quality parameters of communication link can be the bit error rate, and the first equipment calculates the bit error rate
Method may is that the first equipment sends test bit sequence to the second equipment, includes in test bit sequence bit
The position of value, length and bit be it is known, the second equipment receive test bit sequence, count received test bit sequence
The middle bit that mistake occurs determines error code according to the quantity of bit and the total length of test bit sequence that mistake occurs
Rate.
In one embodiment, the first equipment can measure the network quality parameters of communication link several times, then will survey
The multiple network quality parameters measured are averagely obtained final network quality parameters.
S304, judge whether RTT is greater than duration threshold value.
Wherein, the first equipment is pre-stored or is pre-configured with duration threshold value, and duration threshold value can be set according to actual needs
It sets, the application is with no restriction.First equipment judges whether RTT is greater than duration threshold value, then the network state of communication link is abnormal；
If RTT is less than or equal to duration threshold value, the network state of communication link is normal.
S305, the first equipment obtain video data packet to be sent.
Wherein, video data packet includes one or more image groups (group of pictures, GOP), each image group
It always include 1 key frame and at least two non-key frames, key frame can be I frame, and non-key frame is B frame or P frame.Below to pass
Key frame and non-key frame are briefly described:
I frame is without the concern for motion vector；The information content of data shared by I frame is bigger.P frame is forward-predictive-coded frames, P
What frame indicated is difference with a key frame (or P frame) before, and when decoding needs the picture cached before using to be superimposed with originally
The difference of frame definition generates final picture；The prediction and reconstruct of P frame: P frame is that P frame is found out in I frame using I frame as reference frame
The predicted value and motion vector of point, take prediction difference and motion vector to transmit together.Receiving end according to motion vector from I frame
Find out the predicted value of P frame point and and difference value to obtain P frame point sample value, so that complete P frame can be obtained.B frame is double
To prediction interpolation coding frame；B frame is two-way difference frame, that is, B frame recording be this frame and before and after frames difference, to decode B
Frame, the caching picture before not only obtaining, picture after also decoding pass through being superimposed for front and back picture and this frame data
Obtain final picture.B frame compression ratio is high, but cpu load can be bigger when decoding.B frame is with I the or P frame of front and back
P frame be reference frame, find out the predicted value and two motion vectors of B frame point, and take prediction difference and motion vector transmission.It connects
Receiving end calculates predicted value in two reference frames according to motion vector and sums with difference, obtains B frame point sample value, so as to
To complete B frame.
In one embodiment, video data packet includes at least one GOP, includes an I frame in each GOP.Such as: view
Include 10 frames in frequency data packet, is I frame 1, P frame 2, P frame 3, P frame 4, I frame 5, P frame 6, P frame 7, I frame 8, P frame 9 and P frame respectively
10, it include 3 I frames in video data packet.
S306, the first equipment send video data packet to the second equipment.
Wherein, the first equipment can handle video data packet according to checking algorithm to obtain check information, then will
Check information is added to the packet header of video data packet, such as: checking algorithm can be cyclic check algorithm.
S307, determine that the network state of communication link is abnormal.
Wherein, when RTT is greater than duration threshold value, determine that the network state of communication link is abnormal.
S308, at least one GOP is obtained from the video data after coding.
Wherein, the mode of Video coding includes but is not limited to AVI, RMVB, MPEG-2, VC-1, H.264 etc., and the application is not
It is restricted, with GOP for basic processing unit, the first equipment obtains the video data after coding from the video data after coding
At least one GOP
S309, at least one GOP progress data are encapsulated to obtain video data packet.
Wherein, using at least one GOP as the backpack body of video data packet, the attribute information of at least one GOP is then obtained,
Attribute information includes one of length, the quantity of GOP and check bit or a variety of, generates the packet header for carrying attribute information, will wrap
Body and packet header, which merge, generates the video data packet.
S310, key frame all in video data packet is extracted.
Such as: video data packet includes: I frame 1, P frame 2, P frame 3, P frame 4, I frame 5, P frame 6, P frame 7, I frame 8, P frame 9 and P frame
10, it include 3 I frames (key frame) in video data packet, the first equipment is by I frame 1, I frame 5 and the I frame 8 in video data packet.
S311, mask is obtained to key frame progress XOR operation all in video data packet according to the mask table of pre-configuration
Data information.
Wherein, the first equipment is pre-stored or is pre-configured with mask table, and binary ratio of preset length is stored in mask table
Special position, when XOR operation indicates that the value of two bits of input is identical, the result of output is 0；Two bits of input
When being worth not identical, the result of output is 1.First equipment is respectively to I frame each in video data packet according to pre-stored or pre-configuration
Mask table carry out XOR operation respectively obtain mask data information.It is identical with the first equipment to should be understood that the second equipment is used
Mask table recovers I frame.
Such as: according to the example of S310, the first equipment is using mask table that is pre-stored or being pre-configured to I frame 1, I frame 5 and I
Frame 8 carries out XOR operation and obtains mask data information 1, mask data information 5 and mask data information 8.
S312, mask data information progress data are encapsulated to obtain the second data packet.
Wherein, the first equipment is using mask data information as backpack body, then obtain the quantity of mask data information, length and
The attribute informations such as location information merge packet header and backpack body to obtain the second data packet using the attribute information as packet header.
Such as: according to the example of S311, the quantity of mask data information is 3；The location information of mask data information indicates
The corresponding frame 1 of the serial number mask data information 1 of corresponding frame, the corresponding frame 5 of mask data information 5, mask data information correspond to frame 8；
Length indicates the length of each mask data information.
S313, the second data packet is handled to obtain check information according to checking algorithm.
In general, checking algorithm can according to actual needs depending on, the application with no restriction, such as: checking algorithm can be with
It is cyclic check algorithm or signature algorithm etc..Such as: the second data packet is handled according to cyclic check algorithm and is verified
Position, check bit is added in the packet header of the second data packet；Another example is: handle to the second data packet using signature algorithm
To signature, which is added in the packet header of the second data packet.
S314, check information is added in the packet header of the second data packet.
S315, it encapsulates the second data packet for adding check information and video data packet progress data to obtain coded data
Packet.
S316, the first equipment send coded data packet to the second equipment.
In general, the first equipment can send the second data packet and video data packet simultaneously to the second equipment, or by the
Two data packets and video data packet obtain coded data packet after carrying out data encapsulation, after then sending the coding to the second equipment
Data packet, the embodiment of the present application is with no restriction.
Implement the embodiment of the present application, when the network quality of communication link is deteriorated, sending device is after sending coded treatment
Video data packet before, extract the key message in video data packet, data carried out to key message and encapsulate to obtain the second number
According to packet, video data packet and the second data packet are then sent to receiving device together, general receiving device is to video data packet
In the case where decoding failure, the key message that can use in the second data packet recovers original video data, can improve video
The reliability of data transmission, the anti-packet loss ability that enhancing network quality deteriorates.
Referring to fig. 4, a kind of another flow diagram of the method for transmitting video data method mentioned for the embodiment of the present application,
In the embodiment of the present application, which is applied to the second equipment, which comprises
S401, the second equipment receive video data packet and the second data packet from the first equipment.
In general, to can be the first equipment same to the second equipment for video data and the second data packet that the second equipment receives
When send the second data packet and video data packet or the first equipment the second data packet and video data packet be subjected to data encapsulation
After obtain coded data packet, then send the coded data packet to the second equipment, the embodiment of the present application is with no restriction.Its
In, what is stored in the second data packet is the backup of the I frame in video data packet, and the second data packet is to the I in video data packet
Frame carries out the data packet obtained after redundancy processing, the reliability of the second data packet transmission can be improved in this way, in video data packet
I frame occur to lose or when change, progress video decoding can be extracted in the I in the second data packet, to improve video data transmission
Reliability.
Wherein, the generating process of video data packet and the second data packet can refer to the description of the first equipment in Fig. 2 and Fig. 3,
Details are not described herein again.
In the case that the crucial frame decoding of S402, the second equipment in video data packet fails, the mark of key frame is obtained.
In general, I frame decoding fail the reason of may be I frame (key frame) occurs in transmission process loss or I frame exist
Mistake occurs in transmission process.Include at least one GOP in video data packet, includes an I frame, the second equipment in each GOP
It detects with the presence or absence of I frame in each GOP, I frame, determines that the I frame in the GOP is lost if it does not exist, obtains I frame in GOP
Index；I frame if it exists judges whether I frame changes in transmission process according to the check bit of I frame, if changing, obtains
The index of I frame in the GOP.
In one embodiment, the frame in video data packet can carry out Unified number, can also be compiled in GOP
Number, the application is with no restriction.Such as: it include 10 frames in video data packet, it is I frame 1, P respectively that 10 frames, which are uniformly numbered,
Frame 2, P frame 3, P frame 4, I frame 5, P frame 6, P frame 7, I frame 8, P frame 9 and P frame 10.Another example is: video data packet includes 3 GOP, point
It is not GOP1, GOP2 and GOP3, GOP1 includes I frame 1, P frame 2, P frame 3 and P frame 4, and GOP2 includes I frame 1, P frame 2, P frame 3 and P frame
4, GOP3 include I frame 1, P frame 2 and P frame 3.
Wherein, when the frame in video data packet uses Unified number, index is the number of frame；Frame in video data packet
When being numbered with unit in GOP, index includes the number of frame and the number of GOP.
S403, the second equipment extract the key frame of mark instruction in the second data packet.
Wherein, the second equipment extracts corresponding key frame according to the index of extraction in the second data packet.
In one embodiment, the mask data information of at least one key frame, the second equipment are carried in the second data packet
Exclusive or fortune, which is carried out, using mask data information that is pre-stored or being pre-configured recovers key frame.
S404, the second equipment carry out video decoding according to the I frame of extraction.
Wherein, the second equipment decodes to obtain original video according to the key frame progress video extracted in the second data packet
Data, the decoded process of video can refer to the decoded process of existing video, and details are not described herein again.
In a possible embodiment, the second equipment extracts the key frame of mark instruction, packet in the second data packet
Include: whether the key frame that instruction is identified in the second data packet of verification is complete；When verifying successfully, mark is extracted in the second data packet
Know the key frame of instruction.
Wherein, the check bit that the method for verification can be in the packet header for being verified the second data packet using cyclic check algorithm is come
Judge whether the second data packet is complete；Or it is whether correct using the digital signature carried in signature algorithm the second data packet of verification.
Implement the embodiment of the present application, when the network quality of communication link is deteriorated, sending device is after sending coded treatment
Video data packet before, extract video data packet in I frame, to I frame carry out data encapsulate to obtain the second data packet, then will
Video data packet and the second data packet are sent to receiving device, feelings of the general receiving device to video data packet decoding failure together
Under condition, the key message that can use in the second data packet recovers original video data, and can improve video data transmission can
By property, enhance the anti-packet loss ability that network quality deteriorates.
Network architecture diagram based on Fig. 1 is a kind of method of transmitting video data provided by the embodiments of the present application referring to Fig. 5
Interaction schematic diagram, in the embodiment of the present application, which comprises
The network quality parameters of communication link between S501, first the first equipment of equipment monitoring and the second equipment.
S502, when the network state for determining communication link according to network quality parameters is abnormal, the first equipment obtain to
The video data packet of transmission.
S503, the first equipment extract the key message in video data packet, and key message progress data are encapsulated
To the second data packet.Wherein, key message includes at least one key frame for including in video data packet；
S504, the first equipment send the second data packet and video data packet to the second equipment, and the second equipment is received from the
The video data packet of one equipment and the second data packet.
S505, the second equipment obtain key frame in the case where being decoded failure to the key frame in video data packet
Mark.
S506, the second equipment extract the key frame of mark instruction in the second data packet.
S507, the second equipment carry out video decoding according to the key frame of extraction.
Implement the embodiment of the present application, when the network quality of communication link is deteriorated, sending device is after sending coded treatment
Video data packet before, extract video data packet in key frame, to key frame carry out data encapsulate to obtain the second data packet,
Then video data packet and the second data packet are sent to receiving device together, general receiving device decodes video data packet and loses
In the case where losing, the key message that can use in the second data packet recovers original video data, can improve video data biography
Defeated reliability, the anti-packet loss ability that enhancing network quality deteriorates.
Above-mentioned Fig. 2 to Fig. 5 illustrates method of transmitting video data.A kind of video counts of corresponding the embodiment of the present application
According to the structural schematic diagram of transmitting device (abbreviation device).
Fig. 6 is referred to, Fig. 6 is a kind of structural schematic diagram of device 6 provided by the embodiments of the present application, which can wrap
Include monitoring unit 601, acquiring unit 602, encapsulation unit 603 and transmission unit 604.
Monitoring unit 601, the network quality for monitoring the communication link between first equipment and the second equipment are joined
Number.
Acquiring unit 602, for being different in the network state for determining the communication link according to the network quality parameters
Chang Shi obtains video data packet to be sent.
Encapsulation unit 603 is carried out for extracting the key message in the video data packet, and by the key message
Data encapsulate to obtain the second data packet；Wherein, the key message includes at least one pass for including in the video data packet
Key frame.
Transmission unit 604, for sending second data packet and the video data packet to second equipment.
In one or more embodiments, monitoring unit 601 monitors the communication between first equipment and the second equipment
The network quality parameters of link, comprising:
The first data packet is sent to second equipment；Wherein, first data packet carries test mark；
Receive the response bag that second equipment is sent in response to first data packet；Wherein, the response bag carries
The test mark；
The communication link is calculated according at the time of sending first data packet and at the time of receiving the response bag
Round-trip delay RTT.
In one or more embodiments, acquiring unit 602 is determining the communication chain according to the network quality parameters
When the network state on road is abnormal, first equipment obtains video data packet to be sent, comprising:
When the RTT is greater than duration threshold value, determine that the network state of the communication link is abnormal；
Multiple images group GOP is obtained from the video data after coding；
At least one described GOP progress data are encapsulated to obtain the video data packet.
In one or more embodiments, encapsulation unit 602 encapsulates key message progress data to obtain the second number
According to packet, comprising:
Extract key frame all in the video data packet；
XOR operation is carried out to key frame all in the video data packet according to the mask table of pre-configuration to be covered
Code data information；
Data encapsulation process, which is carried out, according to the mask data information obtains second data packet.
In one or more embodiments, transmission unit 604 sends described the to second equipment for the first equipment
Two data packets and the video data packet, comprising:
Second data packet is handled to obtain check information according to checking algorithm；
The check information is added in the packet header of second data packet；
The second data packet for adding the check information and the video data packet are carried out data to encapsulate after obtaining coding
Data packet.
In one or more embodiments, the key message further include: sequence parameter set SPS and/or picture parameter set
PPS。
Device 6 can be terminal device or server, described device 6 or the field-programmable for realizing correlation function
Gate array (field-programmable gate array, FPGA), special integrated chip, System on Chip/SoC (system on
Chip, SoC), central processing unit (central processor unit, CPU), network processing unit (network
Processor, NP), digital signal processing circuit, microcontroller (micro controller unit, MCU) can also use
Programmable controller (programmable logic device, PLD) or other integrated chips.
Fig. 7 is referred to, Fig. 7 is a kind of structural schematic diagram of device 7 provided by the embodiments of the present application, which can wrap
Include receiving unit 701, acquiring unit 702, extraction unit 703 and decoding unit 704.
Receiving unit 701, for receiving video data packet and the second data packet from the first equipment.
Acquiring unit 702, for obtaining in the case where being decoded failure to the key frame in the video data packet
The index of the I frame.
Extraction unit 703, for extracting the key frame of mark instruction in second data packet.
Decoding unit 704, for carrying out video decoding according to the key frame of extraction.
In one or more embodiments, extraction unit 703 in second data packet for extracting mark instruction
Key frame, comprising:
Verify identified described in second data packet instruction key frame it is whether complete；
When verifying successfully, the key frame of mark instruction is extracted in second data packet.
The embodiment of the present application and the embodiment of the method for Fig. 4 and Fig. 5 are based on same design, bring technical effect also phase
Together, detailed process can refer to the description of the embodiment of the method for Fig. 4 and Fig. 5, and details are not described herein again.
Device 7 can be terminal device or server, described device 7 or the field-programmable for realizing correlation function
Gate array (field-programmable gate array, FPGA), special integrated chip, System on Chip/SoC (system on
Chip, SoC), central processing unit (central processor unit, CPU), network processing unit (network
Processor, NP), digital signal processing circuit, microcontroller (micro controller unit, MCU) can also use
Programmable controller (programmable logic device, PLD) or other integrated chips.
Fig. 8 is a kind of video data transmission apparatus structure schematic diagram provided by the embodiments of the present application, hereinafter referred to as device 8,
Device 8 can integrate in the first equipment above-mentioned or the second equipment, as shown in figure 8, the device 8 includes: memory 802, place
Manage device 801, input unit 803, output device 804 and communication interface.
Memory 802 can be independent physical unit, can with processor 801, input unit 803 and output device 804
To be connected by bus.Memory 802, processor 801, transceiver 803 also can integrate together, pass through hardware realization etc..
Memory 802 is used to store the program for realizing above method embodiment or Installation practice modules, processing
Device 801 calls the program, executes the operation of above method embodiment.
Input unit 802 includes but is not limited to keyboard, mouse, touch panel, camera and microphone；Output device includes
But it is limited to display screen.
For receiving and dispatching various types of message, communication interface includes but is not limited to wireless interface or wired connects communication interface
Mouthful.
Optionally, when passing through software realization some or all of in the method for transmitting video data of above-described embodiment, dress
Processor can also be only included by setting.Memory for storing program is located at except device, and processor passes through circuit/electric wire and deposits
Reservoir connection, for reading and executing the program stored in memory.
Processor can be central processing unit (central processing unit, CPU), network processing unit
The combination of (network processor, NP) or CPU and NP.
Processor can further include hardware chip.Above-mentioned hardware chip can be specific integrated circuit
(application-specific integrated circuit, ASIC), programmable logic device (programmable
Logic device, PLD) or combinations thereof.Above-mentioned PLD can be Complex Programmable Logic Devices (complex
Programmable logic device, CPLD), field programmable gate array (field-programmable gate
Array, FPGA), Universal Array Logic (generic array logic, GAL) or any combination thereof.
Memory may include volatile memory (volatile memory), such as access memory (random-
Access memory, RAM)；Memory also may include nonvolatile memory (non-volatile memory), such as fastly
Flash memory (flash memory), hard disk (hard disk drive, HDD) or solid state hard disk (solid-state drive,
SSD)；Memory can also include the combination of the memory of mentioned kind.
The embodiment of the present application also provides a kind of computer storage mediums, are stored with computer program, the computer program
For executing method of transmitting video data provided by the above embodiment.
The embodiment of the present application also provides a kind of computer program products comprising instruction, when it runs on computers
When, so that computer executes method of transmitting video data provided by the above embodiment.
It should be understood by those skilled in the art that, embodiments herein can provide as method, system or computer program
Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the application
Apply the form of example.Moreover, it wherein includes the computer of computer usable program code that the application, which can be used in one or more,
The computer program implemented in usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) produces
The form of product.
The application is referring to method, the process of equipment (system) and computer program product according to the embodiment of the present application
Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions
The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs
Instruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce
A raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for real
The device for the function of being specified in present one or more flows of the flowchart and/or one or more blocks of the block diagram.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates,
Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram or
The function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that counting
Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or
The instruction executed on other programmable devices is provided for realizing in one or more flows of the flowchart and/or block diagram one
The step of function of being specified in a box or multiple boxes.
Claims (12)
1. a kind of method of transmitting video data characterized by comprising
The network quality parameters of communication link between first equipment and the second equipment described in first equipment monitoring；
When the network state for determining the communication link according to the network quality parameters is abnormal, first equipment is obtained
Video data packet to be sent；
First equipment extracts the key message in the video data packet, and carries out data envelope based on the key message
Dress obtains the second data packet；Wherein, the key message includes at least one key frame for including in the video data packet；
First equipment sends second data packet and the video data packet to second equipment.
2. the method according to claim 1, wherein the first equipment described in first equipment monitoring and second is set
The network quality parameters of communication link between standby, comprising:
First equipment sends the first data packet to second equipment；Wherein, first data packet carries the first data
Packet mark；
First equipment receives the response bag that second equipment is sent in response to first data packet；Wherein, the sound
It should wrap and carry first package identification；
First equipment is described logical according to calculating at the time of sending first data packet and at the time of receiving the response bag
Believe the round-trip delay RTT of link.
3. according to the method described in claim 2, it is characterized in that, described determining described lead to according to the network quality parameters
When believing that the network state of link is abnormal, first equipment obtains video data packet to be sent, comprising:
When the RTT is greater than duration threshold value, determine that the network state of the communication link is abnormal；
Multiple images group GOP is obtained from the video data after coding；
At least one described GOP progress data are encapsulated to obtain the video data packet.
4. according to claim 1 to method described in 3 any one, which is characterized in that described to count the key message
The second data packet is obtained according to encapsulation, comprising:
Extract key frame all in the video data packet；
XOR operation is carried out to key frame all in the video data packet according to the mask table of pre-configuration and obtains mask data
Information；
Data encapsulation process, which is carried out, according to the mask data information obtains second data packet.
5. the method according to claim 1, which is characterized in that first equipment is set to described second
Preparation send second data packet and the video data packet, comprising:
Second data packet is handled to obtain check information according to checking algorithm；
The check information is added in the packet header of second data packet；
The second data packet for adding the check information and the video data packet are carried out data to encapsulate to obtain coded data
Packet.
6. according to the method described in claim 5, it is characterized in that, the key message include: sequence parameter set SPS and/or
Picture parameter set PPS.
7. a kind of video data handling procedure characterized by comprising
Second equipment receives video data packet and the second data packet from the first equipment；
Second equipment obtains the key in the case where being decoded failure to the key frame in the video data packet
The mark of frame；
Second equipment extracts the key frame of mark instruction in second data packet；
Second equipment carries out video decoding according to the key frame of extraction.
8. the method according to the description of claim 7 is characterized in that second equipment extracts mark in second data packet
Know the key frame of instruction, comprising:
Verify identified described in second data packet instruction key frame it is whether complete；
When verifying successfully, the key frame of mark instruction is extracted in second data packet.
9. a kind of video data transmission device characterized by comprising
Monitoring unit, for monitoring the network quality parameters of the communication link between first equipment and the second equipment；
Acquiring unit, for obtaining when the network state for determining the communication link according to the network quality parameters is abnormal
Take video data packet to be sent；
Encapsulation unit carries out data envelope for extracting the key message in the video data packet, and by the key message
Dress obtains the second data packet；Wherein, the key message includes at least one key frame for including in the video data packet；
Transmission unit, for sending second data packet and the video data packet to second equipment.
10. a kind of video data processing apparatus characterized by comprising
Receiving unit, for receiving video data packet and the second data packet from the first equipment；
Acquiring unit, for obtaining the pass in the case where being decoded failure to the key frame in the video data packet
The mark of key frame；
Extraction unit, for extracting the key frame of mark instruction in second data packet；
Decoding unit, for carrying out video decoding according to the key frame of extraction.
11. a kind of electronic equipment, which is characterized in that including processor and memory, wherein the memory is calculated for storing
Machine program, the computer program include program instruction, and the processor is executed for calling described program to instruct as right is wanted
Seek the described in any item methods of 1-8.
12. a kind of computer readable storage medium, which is characterized in that the computer storage medium is stored with computer program,
The computer program includes program instruction, and described program instruction makes the processor execute such as right when being executed by a processor
It is required that the described in any item methods of 1-8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910548319.0A CN110225347A (en) | 2019-06-24 | 2019-06-24 | Method of transmitting video data, device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910548319.0A CN110225347A (en) | 2019-06-24 | 2019-06-24 | Method of transmitting video data, device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110225347A true CN110225347A (en) | 2019-09-10 |
Family
ID=67814391
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910548319.0A Pending CN110225347A (en) | 2019-06-24 | 2019-06-24 | Method of transmitting video data, device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110225347A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112533059A (en) * | 2020-11-20 | 2021-03-19 | 腾讯科技（深圳）有限公司 | Image rendering method and device, electronic equipment and storage medium |
| CN112769524A (en) * | 2021-04-06 | 2021-05-07 | 腾讯科技（深圳）有限公司 | Voice transmission method, device, computer equipment and storage medium |
| CN113452947A (en) * | 2021-05-19 | 2021-09-28 | 深圳市捷视飞通科技股份有限公司 | Key frame acquisition method and device, computer equipment and storage medium |
| CN113453026A (en) * | 2020-03-26 | 2021-09-28 | 阿里巴巴集团控股有限公司 | Video data processing method and device, electronic equipment and computer storage medium |
| CN113572854A (en) * | 2021-08-10 | 2021-10-29 | 北京无线电测量研究所 | Kafka component-based data transmission method and system |
| CN114640711A (en) * | 2020-12-15 | 2022-06-17 | 深圳Tcl新技术有限公司 | TLV data packet pushing method, intelligent terminal and storage medium |
| CN115550683A (en) * | 2021-06-29 | 2022-12-30 | 华为技术有限公司 | Video data transmission method and device |
| WO2023050921A1 (en) * | 2021-09-30 | 2023-04-06 | 中兴通讯股份有限公司 | Video and audio data sending method, display method, sending end and receiving end |
| CN116546191A (en) * | 2023-07-05 | 2023-08-04 | 杭州海康威视数字技术股份有限公司 | Video link quality detection method, device and equipment |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101588504A (en) * | 2009-05-21 | 2009-11-25 | 中兴通讯股份有限公司 | Sending and receiving devices of video communication system, and sending and receiving method thereof |
| CN103702348A (en) * | 2013-12-20 | 2014-04-02 | 京信通信系统（中国）有限公司 | Detection method and device for network quality under family base station |
| CN105357592A (en) * | 2015-10-26 | 2016-02-24 | 山东大学苏州研究院 | Selective frame dropping method for streaming media adaptive transmission |
| CN107231328A (en) * | 2016-03-23 | 2017-10-03 | 福建星网锐捷通讯股份有限公司 | Method for real-time video transmission, device, equipment and system |
| CN107342951A (en) * | 2017-06-21 | 2017-11-10 | 苏睿 | Data transmission method and device |
| CN108174239A (en) * | 2017-12-04 | 2018-06-15 | 中国联合网络通信集团有限公司 | A kind of video transmission method and equipment |
| CN109150791A (en) * | 2017-06-15 | 2019-01-04 | 中兴通讯股份有限公司 | A kind of data compression method and apparatus |
| CN109151612A (en) * | 2017-06-27 | 2019-01-04 | 华为技术有限公司 | A kind of video transmission method, equipment and system |
-
2019
- 2019-06-24 CN CN201910548319.0A patent/CN110225347A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101588504A (en) * | 2009-05-21 | 2009-11-25 | 中兴通讯股份有限公司 | Sending and receiving devices of video communication system, and sending and receiving method thereof |
| CN103702348A (en) * | 2013-12-20 | 2014-04-02 | 京信通信系统（中国）有限公司 | Detection method and device for network quality under family base station |
| CN105357592A (en) * | 2015-10-26 | 2016-02-24 | 山东大学苏州研究院 | Selective frame dropping method for streaming media adaptive transmission |
| CN107231328A (en) * | 2016-03-23 | 2017-10-03 | 福建星网锐捷通讯股份有限公司 | Method for real-time video transmission, device, equipment and system |
| CN109150791A (en) * | 2017-06-15 | 2019-01-04 | 中兴通讯股份有限公司 | A kind of data compression method and apparatus |
| CN107342951A (en) * | 2017-06-21 | 2017-11-10 | 苏睿 | Data transmission method and device |
| CN109151612A (en) * | 2017-06-27 | 2019-01-04 | 华为技术有限公司 | A kind of video transmission method, equipment and system |
| CN108174239A (en) * | 2017-12-04 | 2018-06-15 | 中国联合网络通信集团有限公司 | A kind of video transmission method and equipment |
Cited By (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113453026A (en) * | 2020-03-26 | 2021-09-28 | 阿里巴巴集团控股有限公司 | Video data processing method and device, electronic equipment and computer storage medium |
| CN112533059A (en) * | 2020-11-20 | 2021-03-19 | 腾讯科技（深圳）有限公司 | Image rendering method and device, electronic equipment and storage medium |
| CN114640711B (en) * | 2020-12-15 | 2023-08-01 | 深圳Tcl新技术有限公司 | TLV data packet pushing method, intelligent terminal and storage medium |
| CN114640711A (en) * | 2020-12-15 | 2022-06-17 | 深圳Tcl新技术有限公司 | TLV data packet pushing method, intelligent terminal and storage medium |
| CN112769524A (en) * | 2021-04-06 | 2021-05-07 | 腾讯科技（深圳）有限公司 | Voice transmission method, device, computer equipment and storage medium |
| CN113452947A (en) * | 2021-05-19 | 2021-09-28 | 深圳市捷视飞通科技股份有限公司 | Key frame acquisition method and device, computer equipment and storage medium |
| CN113452947B (en) * | 2021-05-19 | 2023-01-24 | 深圳市捷视飞通科技股份有限公司 | Key frame acquisition method and device, computer equipment and storage medium |
| CN115550683A (en) * | 2021-06-29 | 2022-12-30 | 华为技术有限公司 | Video data transmission method and device |
| CN113572854A (en) * | 2021-08-10 | 2021-10-29 | 北京无线电测量研究所 | Kafka component-based data transmission method and system |
| CN113572854B (en) * | 2021-08-10 | 2023-11-14 | 北京无线电测量研究所 | Data transmission method and system based on Kafka component |
| WO2023050921A1 (en) * | 2021-09-30 | 2023-04-06 | 中兴通讯股份有限公司 | Video and audio data sending method, display method, sending end and receiving end |
| CN116546191A (en) * | 2023-07-05 | 2023-08-04 | 杭州海康威视数字技术股份有限公司 | Video link quality detection method, device and equipment |
| CN116546191B (en) * | 2023-07-05 | 2023-09-29 | 杭州海康威视数字技术股份有限公司 | Video link quality detection method, device and equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110225347A (en) | Method of transmitting video data, device, electronic equipment and storage medium | |
| CN110366003A (en) | Anti-jitter processing method, device, electronic equipment and the storage medium of video data | |
| CN110225348A (en) | Restorative procedure, device, electronic equipment and the storage medium of video data | |
| CN101505316B (en) | Method and device for reordering and multiplexing multimedia packets from multimedia streams pertaining to interrelated sessions | |
| TWI388170B (en) | Streaming data content in a network | |
| JP2019165456A (en) | Media packet transmission method in multimedia system | |
| CN104918133B (en) | A kind of playing method and device for regarding video flowing in networking | |
| CN101516017B (en) | Method, device and system for measuring video transmission delay of session service | |
| KR101959260B1 (en) | Media data transmission apparatus and method, and media data reception apparatus and method in mmt system | |
| US11546088B2 (en) | Check code processing method, electronic device and storage medium | |
| CN104253996B (en) | The sending, receiving method and its device and Transmission system of video data | |
| CN107404646B (en) | The method, apparatus and headend of video quality assessment | |
| MX2015004596A (en) | Method and apparatus for media data delivery control. | |
| JP5587779B2 (en) | Apparatus and method for storing and reading a file having a media data container and a metadata container | |
| KR20130009670A (en) | Packet transmission apparatus and method, and packet reception apparatus and method in mmt system | |
| CN108737380A (en) | The multimedia content of delay with reduction transmits | |
| CN108712299A (en) | A kind of method, apparatus, equipment and the computer storage media of monitoring live streaming delay | |
| US20200351213A1 (en) | Method and apparatus for transmitting and receiving packet in communication system | |
| CN110191342A (en) | Method for video coding and equipment, video encoding/decoding method and equipment | |
| CN105357229A (en) | Video processing method and device | |
| CN105635802A (en) | Transmission method of digital media data and device | |
| CN103813175A (en) | Transmission apparatus, transmission method, reception apparatus, reception method, and computer program | |
| CA2909801C (en) | Apparatus and method for transmitting and receiving forward error correction packet | |
| CN106162375A (en) | Image player and image playing method | |
| JPWO2008123125A1 (en) | Image quality evaluation system, method and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190910 |