WO2021012180A1 - Procédé de commande de transmission et dispositif pour flux de code, et support d'informations lisible par ordinateur - Google Patents

Procédé de commande de transmission et dispositif pour flux de code, et support d'informations lisible par ordinateur Download PDF

Info

Publication number
WO2021012180A1
WO2021012180A1 PCT/CN2019/097265 CN2019097265W WO2021012180A1 WO 2021012180 A1 WO2021012180 A1 WO 2021012180A1 CN 2019097265 W CN2019097265 W CN 2019097265W WO 2021012180 A1 WO2021012180 A1 WO 2021012180A1
Authority
WO
WIPO (PCT)
Prior art keywords
code stream
stream
code
frame rate
main
Prior art date
Application number
PCT/CN2019/097265
Other languages
English (en)
Chinese (zh)
Inventor
马宁
陈颖
苏文艺
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to PCT/CN2019/097265 priority Critical patent/WO2021012180A1/fr
Priority to CN201980008497.2A priority patent/CN111602389B/zh
Publication of WO2021012180A1 publication Critical patent/WO2021012180A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146—Data rate or code amount at the encoder output
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/587—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/21805—Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234381—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/658—Transmission by the client directed to the server
    • H04N21/6587—Control parameters, e.g. trick play commands, viewpoint selection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/268—Signal distribution or switching

Definitions

  • the present disclosure relates to the field of data transmission technology, and in particular to a transmission control method, device and computer-readable storage medium of a code stream.
  • a key frame is an image frame that does not refer to any frame for encoding, and its data size is larger than other reference frames. Transmission needs to take up more bandwidth or longer time. Therefore, in the prior art, when switching between multiple streams, to achieve a better display effect, it is necessary to buffer the key frames and buffer them for a period of time before displaying, which leads to a longer switching time; Switching speed, the size of the key frame will be limited, which will cause the switching screen to freeze or blur.
  • the present disclosure provides a stream transmission control method, device and computer-readable storage medium.
  • a transmission control method of a code stream includes:
  • At least two code streams are received, the at least two code streams include a first code stream and a second code stream, wherein the first code stream is used as the original main code stream, and the first code stream is excluded from the at least two code streams Other code streams outside the stream are used as the original background code stream, and the transmission frame rate of the original main code stream is higher than the transmission frame rate of any one of the original background code streams;
  • main code stream switching signal indicates to switch the main code stream to the second code stream
  • the transmission frame rate of the new main code stream is higher than the transmission frame rate of any one of the new background code streams.
  • a transmission control method of a code stream includes:
  • the at least two code streams include a first code stream and a second code stream, wherein the first code stream is used as the original main code stream, and the first code stream is excluded from the at least two code streams Other code streams outside the stream are used as the original background code stream, and the transmission frame rate of the original main code stream is higher than the transmission frame rate of any one of the original background code streams;
  • the transmission frame rate of the new main code stream is higher than the transmission frame rate of any one of the new background code streams.
  • a code stream receiving device includes a processor, a communication component, a memory, and a communication bus.
  • the memory stores executable instructions, and the processor is configured to perform the following steps:
  • At least two code streams are received, the at least two code streams include a first code stream and a second code stream, wherein the first code stream is used as the original main code stream, and the first code stream is excluded from the at least two code streams Other code streams outside the stream are used as the original background code stream, and the transmission frame rate of the original main code stream is higher than the transmission frame rate of any one of the original background code streams;
  • main code stream switching signal indicates to switch the main code stream to the second code stream
  • the transmission frame rate of the new main code stream is higher than the transmission frame rate of any one of the new background code streams.
  • a code stream sending device includes a processor, a communication component, a memory, and a communication bus.
  • the memory stores executable instructions, and the processor is configured to perform the following steps:
  • the at least two code streams include a first code stream and a second code stream, wherein the first code stream is used as the original main code stream, and the first code stream is excluded from the at least two code streams Other code streams outside the stream are used as the original background code stream, and the transmission frame rate of the original main code stream is higher than the transmission frame rate of any one of the original background code streams;
  • the transmission frame rate of the new main code stream is higher than the transmission frame rate of any one of the new background code streams.
  • a computer-readable storage medium has a computer program stored thereon, and when the computer program is executed by a processor, it implements the above-mentioned code stream transmission control method.
  • the transmission frame rate of the original main stream is higher than the frame rate of the original background stream.
  • the transmission frame rate of the new main stream is higher than the transmission frame rate of the new background stream to continue the transmission of the at least two streams; that is, according to the main stream (original The transmission frame rate of the main code stream or the new main code stream) is greater than the transmission frame rate of the background code stream (the original background code stream or the new background code stream), which fully guarantees the transmission bandwidth of the main code stream and can avoid the background code stream ( The original background code stream or the new background code stream) occupies too much bandwidth and affects the transmission of the main code stream; and realizes the dynamic adjustment of the transmission frame rate of each stream according to the switching of the main code stream.
  • main stream and background stream are transmitted at different transmission frame rates at the same time, when the main stream is used as the stream to be played, it can be ensured that when the playback is switched, seamless switching to the playback location can be ensured.
  • Fig. 1 is a schematic diagram showing an implementation environment involved in the present disclosure according to an exemplary embodiment
  • Fig. 2 is a flow chart showing a method for transmission control of a code stream according to an exemplary embodiment
  • Fig. 3 is a schematic diagram of code stream transmission implemented according to the method of the present disclosure in a specific embodiment
  • Fig. 4 is a flowchart showing a method for transmission control of a code stream according to another exemplary embodiment
  • Fig. 5 is a flowchart showing a transmission control method of a code stream according to another exemplary embodiment
  • Fig. 6 is a flow chart showing a transmission control method of a code stream according to another exemplary embodiment
  • Fig. 7 is a hardware block diagram of a UAV according to an exemplary embodiment.
  • Fig. 1 is a schematic diagram showing an implementation environment involved in the present disclosure according to an exemplary embodiment.
  • the implementation environment includes: a sending end 100 and a receiving end 300.
  • the sending end 100 and the receiving end 300 establish a network connection in a wired or wireless manner. Therefore, based on the network connection between the two, the sending end 100 and the receiving end 300 interact, for example, the sending end 100 communicates to the receiving end. 300 transmits at least two code streams, and the sending end 100 adjusts the transmission frame rate of the image frames in the code stream according to the playback switching operation triggered by the receiving end 300.
  • the sending end 100 may be any device that can perform multi-channel code stream transmission, such as a drone, a notebook computer, a desktop computer, etc., that performs real-time image collection and transmission, which is not specifically limited here.
  • the receiving end can be any communication device that can receive the code stream, such as remote control with or without screen, VR/AR display device, TV, tablet computer, smart phone, notebook computer and other electronic devices.
  • Fig. 2 is a flow chart showing a method for controlling code stream transmission according to an exemplary embodiment.
  • the transmission control method of the code stream can be executed by the receiving end 300 in the implementation environment shown in FIG. 1.
  • the transmission control method of the code stream may include the following steps:
  • Step 310 At least two code streams are received.
  • the at least two code streams include a first code stream and a second code stream.
  • the first code stream is used as the original main code stream.
  • Other code streams are used as original background code streams, and the transmission frame rate of the original main code stream is higher than the transmission frame rate of any original background code stream.
  • the code stream is a video stream formed by sequentially arranging several image frames.
  • the code stream can also be an audio code stream.
  • the transmission frame rate is the number of image frames transmitted per second.
  • the transmission frame rate characterizes the data transmission speed in the code stream. It is worth mentioning that in step 310, the term “receiving at least two streams” refers to sequentially receiving the image frames in the at least two streams, and step 310 does not represent the completion of receiving each of the at least two streams. All image frames of the code stream, and the representative receiving end is in the process of receiving the image frames in each code stream.
  • the transmission frame rate of the main code stream is configured to be higher than the transmission frame rate of any background code stream.
  • the code stream to be played is used as the main code stream.
  • the other code streams except the played code stream in the received at least two code streams correspond to the background code stream, according to the main code stream.
  • the transmission frame rate is higher than the transmission frame rate of any background code stream for transmission, which can meet the playback requirements of the receiving end for the main code stream and avoid jams.
  • the background code stream is relative to the main code stream.
  • the corresponding background code stream changes accordingly.
  • at least two bit streams include A bit stream, B bit stream and C bit stream, where the main bit stream is A bit stream initially, then when A bit stream is used as the main bit stream, B bit stream The stream and C stream are the background stream; if the B stream is re-selected as the main stream, the A stream and the C stream will be used as the background stream while the B stream is used as the main stream.
  • the main stream can be selected based on user needs, or the main stream is set by default on the receiving end, or based on the processing set in the receiving end, for example, it is currently necessary to play the A stream .
  • the A stream is selected as the main stream (original main stream), so that the operation of the image frame in the A stream (such as encoding, transmission, decoding, buffering, etc.) by the sender or receiver All need to meet the playback of the A stream.
  • the main code stream before the main code stream switch is called the original main code stream, and the background code stream before the switch is called the original background code stream; the main code stream is switched The main stream after that is called the new main stream, and the background stream after switching is called the new background stream.
  • first code stream and the second code stream of the at least two code streams do not specifically refer to the specific code stream.
  • the first code stream generally refers to the original master before the main stream is selected.
  • the code stream of the code stream, and the second code stream generally refers to the code stream that is switched as the new main code stream when the main code stream is switched.
  • Step 330 Obtain the main code stream switching signal.
  • the main code stream switching signal indicates to switch the main code stream to the second code stream.
  • the data volume requirements of each stream at the receiving end may change, and the main stream needs to be switched; for example, the A Switch the code stream to play B code stream, then correspondingly, switch the main code stream to B code stream.
  • the main code stream switching signal is used to indicate the code stream to be switched to the main code stream.
  • the second code stream generally refers to the code stream which needs to be switched to the main code stream indicated by the main code stream switching signal. Therefore, the second code stream indicated by the main code stream switching signal is regarded as the new main code stream of the present disclosure.
  • the main stream switching signal may be generated according to a switching operation triggered in the receiving end, and the user triggers the switching operation in the receiving end to instruct the receiving end to switch the main stream to the second code. flow.
  • the receiving end is VR glasses and the user wants to switch the displayed code stream, he can trigger the switching operation by operating the corresponding control component of the VR glasses, thereby generating the main code stream switching signal.
  • the main stream switching signal may also be sent by an external device to the receiving end, or generated according to the main stream switching file configured in the receiving end, and the main stream switching file indicates During the transmission of at least two streams, each time segment is selected as the stream of the main stream.
  • the receiving end is a monitor screen
  • the monitor screen can receive a signal sent by an external device, or generate a main stream switching signal according to a configured main stream switching file.
  • the configured main stream switching file can generate the main stream switching signal according to the working status of the receiving end, such as working location, working time and other information.
  • the main stream switching signal can be automatically generated according to the pre-configured main stream switching file to automatically switch to the picture of camera B.
  • Step 330 Continue to receive at least two streams after the switch, where the second code stream is used as the new main code stream, and the other code streams in the at least two code streams except the second code stream are used as the new background code stream, after switching ,
  • the transmission frame rate of the new main stream is higher than the transmission frame rate of any new background stream.
  • the main code stream switching signal indicates the main code stream after switching. Since the transmission frame rate of the main code stream is configured to be higher than the transmission frame rate of any background code stream, after switching the main code stream, according to The selected stream as the new main stream, correspondingly adjust the transmission frame rate of each of the at least two streams, so that after switching, the transmission frame rate of the new main stream is higher than any new background code The transmission frame rate of the stream.
  • the receiving end after the receiving end obtains the main stream switching signal, the receiving end sends The end sends a frame rate adjustment signal, and the frame rate adjustment signal indicates that the main stream is switched to the second stream.
  • the frame rate adjustment signal is generated according to the main stream switching signal. Therefore, after receiving the frame rate adjustment signal, the transmitting end adjusts the transmission frame rate of each of the at least two streams according to the frame rate adjustment signal, and performs each code according to the adjusted transmission frame rate Stream transmission, where the sender adjusts the frame rate according to the transmission frame rate of the new main stream higher than the transmission frame rate of any new background stream.
  • the second stream is used as one stream in the original background stream, and the first stream is used as the original main stream.
  • the transmission frame rate of the original main stream is higher than that of the original background stream. Rate; after the main code stream is switched, the second code stream is used as the new main code stream, and the first code stream corresponds to the one code stream in the new background code stream; thus, it can be known that after the switch, in order to ensure the new main code stream
  • the transmission frame rate is higher than the transmission frame rate of the new main stream and guarantees the demand of the receiving end for the second code stream.
  • the transmission frame rate of the second code stream is increased, based on the transmission of the second code stream after the switch Frame rate, correspondingly adjust the frame rate of each stream as the new background stream.
  • the transmission frame rate of the background code stream (original background code stream or new background code stream) is preset.
  • a code stream is used as the background code stream (original background code stream or new background code stream)
  • the transmission of the stream is carried out according to the transmission frame rate set for the main stream.
  • the background code stream original background code stream or new background code stream
  • the transmission frame rate of each code stream is the same, so the transmission frame rate of the new background code stream after switching is the transmission frame rate of the second code stream before switching Frame rate.
  • the transmission frame rate of the main code stream (original main code stream or new main code stream) can also be preset.
  • a code stream is selected as the main code stream (original main code stream or new main code stream)
  • the transmission of the code stream as the main code stream is performed according to the set transmission frame rate.
  • the main stream original background code stream or new background code stream
  • the transmission frame rate of the main code stream is the same. Therefore, the transmission frame rate of the new main code stream after switching is the transmission frame rate of the original main code stream before switching. Frame rate.
  • the transmission frame rate as the main stream (original main stream or new main stream) and as the background code for each of the at least two streams at the same time.
  • the transmission frame rate of the stream original background code stream or new background code stream
  • the transmission frame rate of each code stream is adjusted according to the settings made.
  • the transmission frame rate of the new background code stream is a dynamic low frame rate adapted to the remaining bandwidth.
  • the remaining bandwidth is determined according to the transmission frame rate of the new main stream after switching. Specifically, the difference between the current bandwidth of the receiving end and the sending end and the occupied bandwidth of the new main stream when the transmission is performed according to the transmission frame rate of the new main stream after switching is the remaining bandwidth. Then dynamically determine the transmission frame rate for the new background stream according to the remaining bandwidth.
  • the at least two streams are performed according to the transmission frame rate of the original main stream higher than the frame rate of the original background stream
  • the transmission frame rate of the new main stream is higher than the transmission frame rate of the new background stream to continue the transmission of the at least two streams; on the one hand, according to the main stream
  • the transmission frame rate of (original main stream or new main stream) is greater than the transmission frame rate of background code stream (original background code stream or new background code stream), which fully guarantees the transmission bandwidth of the main stream to meet the requirements of the receiving end.
  • the data requirement of the main stream is to avoid the situation where the available bandwidth of the main stream is insufficient due to the excessive occupation of bandwidth by the background stream (original background stream or new background stream); on the other hand, according to the switch of the main stream
  • the transmission frame rate of each of the at least two streams is dynamically adjusted, so that the adjustment of the frame rate is adapted to the switching of the main stream.
  • the method further includes:
  • the receiving end buffers and plays the original main code stream according to the data of the received original main code stream, and only buffers the original background code stream, so that when the first code stream is used as the original main code stream, the receiving end Only the first stream is played at the end.
  • the receiving end since the code stream is transmitted after encoding, correspondingly, the receiving end performs corresponding decoding after receiving the data in the original main code stream and the original background code stream.
  • the original main stream is decoded and played, and the original background stream is decoded and buffered.
  • step 330 the method further includes:
  • the receiving end switches the playback according to the main stream switching signal, that is, stops playing the original first stream and switches to playing the second stream as the new main stream.
  • the second code stream as the new main code stream is decoded and played, and the new background code stream is decoded and buffered.
  • the step of playing the second code stream as the new main code stream includes:
  • the receiving end receives the playback switching instruction (equivalent to the main stream switching signal in this embodiment), it requests the sending end correspondingly to the playback switching instruction indicated by the playback switching instruction.
  • the data of the code stream that is, the buffering of the data in the code stream switched to is performed after the playback switching, which makes the playback switching time long and the playback switching response speed slow.
  • the receiving end After the playback switching operation is performed, the receiving end requests the image in the video stream from the sending end. Therefore, the sending end performs encoding and transmission of the image in the requested video stream according to the request of the receiving end. Since the first video frame in the video code stream is an I frame, and the I frame does not refer to any frame, it is obtained by the intra-frame coding method. The compression rate is low, the data volume is high, and the compression is difficult.
  • the streaming playback switching method in order to ensure that the receiving end responds to the playback switching, the size of the first video frame needs to be limited, that is, the first video frame is obtained by encoding after compression, and when the receiving end obtains the I frame according to the compressed encoding for playback and display, the displayed first video frame
  • the frame image freezes or is blurred.
  • the size of the first video frame is not limited, it will take a long time to transmit the I frame, resulting in a long transmission delay. Regardless of whether the first video frame is stuck or blurred or the transmission delay of the first video frame is large, the user experience is greatly reduced.
  • the image frames in each stream are transmitted according to the transmission frame rate that satisfies the receiving end to play each stream. .
  • the second cut is achieved during the playback switching, the transmission of the currently selected stream before the switching occupies too much bandwidth in the transmission channel, so that the available bandwidth for transmitting the currently selected stream is lost , It affects the playback of the currently selected stream, resulting in poor playback quality.
  • the transmission frame rate of the original main stream is higher than the transmission of any original background stream
  • the frame rate is transmitted to ensure the playback quality of the original main stream; and after the playback is switched according to the main stream switching signal, the frame rate is adjusted, and the transmission frame rate of the new background stream after adjustment is higher than any new background code
  • the transmission frame rate of the stream, and the transmission of each stream according to the adjusted transmission frame rate so as to realize the targeted transmission of each stream in combination with the stream that needs to be played in the receiving end.
  • the response speed of switching ensures the playback quality of the code stream.
  • Fig. 3 is a schematic diagram of code stream transmission according to the method of the present disclosure in an application scenario.
  • the receiving end receives two streams in parallel, namely, A stream and B stream.
  • the receiving end plays the A code stream, and correspondingly, during the playing of the A code stream, the A code stream is used as the original main code stream, and the B code stream is used as the original background code stream, and The transmission frame rate of code stream A is higher than that of code stream B.
  • the A bit stream is used as the new background bit stream
  • the B bit stream is used as the new main bit stream.
  • the A bit stream The transmission frame rate is lower than that of the B-channel stream.
  • the adjustment is to adjust the transmission frame rate of the A stream to the transmission frame rate of the B stream before the playback switch, and adjust the transmission frame rate of the B stream to the A code before the playback switch The transmission frame rate of the stream.
  • the first image frame transmitted in each bit stream is an I frame
  • the image frame transmitted thereafter is a P frame, thus greatly reducing the The bandwidth occupied during the transmission process.
  • encoding is performed again according to the intra-frame encoding method to obtain the I frame of the current image to be encoded And transmit; if there is no transmission error in the code stream, continue encoding according to the inter-frame encoding method to obtain the P frame of the current image to be encoded and transmit it.
  • the method further includes:
  • anomaly detection is performed on the received image frames.
  • the receiving end is concerned with whether the received image frame is accurate, that is, whether a data error occurs, and whether the receiving end misses the image frame, that is, whether the image frame is lost.
  • the abnormality detection performed is to detect whether the image frame received in the receiving end has data errors and whether the image frame loss occurs in the receiving end. Therefore, an abnormal image frame in the code stream is correspondingly determined according to the performed abnormality detection, and the abnormal image frame includes the image frame in which the data error occurs and the lost image frame.
  • the abnormality detection performed at the receiving end includes:
  • the check code carried by the received image frame it is checked whether the image frame is an image frame with data errors.
  • the image frame transmitted by the sending end to the receiving end includes the check code configured for the image frame, such as a CRC check code, so that after the image frame is received, the corresponding check algorithm is used, such as the CRC check
  • the CRC check algorithm of the code is checked to determine whether the check code obtained by the check algorithm is consistent with the check code carried in the received image frame to determine whether the received image frame has a data error. If they are consistent, there is no data error in the received image frame. On the contrary, if they are not consistent, the received image frame has a data error.
  • the abnormality detection performed on the receiving end further includes:
  • the frame sequence number carried by the received image frame determine whether the frame sequence numbers of the two adjacent received image frames in the same code stream are continuous, and the image frame corresponding to the frame sequence number between the frame sequence numbers that are judged to be discontinuous is confirmed as lost Image frame.
  • the sending end configures the frame sequence number for the sent image frame. Therefore, after receiving the image frame, the receiving end passes through the same code stream twice.
  • the continuity of the frame numbers of the received image frames is judged accordingly, that is, if the frame numbers of the image frames received two consecutive times are consecutive, there is no missing image frame in the image frames received twice. ; On the contrary, there are missing image frames, and the missing image frames are the image frames corresponding to the frame numbers between the discontinuous frame numbers.
  • the method further includes:
  • feedback information is sent to the sending end for the accurately received image frame, and the feedback information carries the frame number of the image frame.
  • the sending end can know in time which image frames sent are received and accurately received.
  • the code stream is transmitted to the receiving end after being encoded.
  • the original image in the code stream is encoded by the sending end according to the inter-frame encoding method or the intra-frame encoding method.
  • the inter-frame encoding method refers to the method of encoding image data using other frames as reference frames using the temporal correlation of image frames.
  • the intra-frame coding method refers to a method of encoding image data without referring to time-related lines for spatial prediction.
  • the first frame of each stream is an intra-encoded frame obtained by intra-encoding, such as H.263, H.264, H.265, MPEG4, etc.
  • the coding standard is an I frame obtained by intra-coding.
  • intra-frame coded frames since other frames are not referenced for coding, the receiving end can decode the intra-frame coded frames as long as they correctly receive it.
  • the image frame transmitted after the first frame in each stream can be an intra-frame coded frame, or an inter-frame coded frame obtained by inter-frame coding, such as H.263, H.264, H.265, P-frames and B-frames obtained by intra-frame coding in video coding standards such as MPEG4.
  • inter-frame coded frames since the predictive coding is performed with reference to the time correlation, that is, the coding depends on the reference frame, so even if the receiving end receives the inter-coded frame correctly, if the reference frame of the inter-coded frame is wrong, then The inter-coded frame cannot be decoded correctly.
  • the received image frame has a data error through anomaly detection. If the image frame with the data error is used as the reference frame of the subsequent image frame, the received image frame will not be correctly translated. Code, which causes the error caused by the image frame to be passed backward.
  • the code stream transmitted by the sending end to the receiving end includes the following image frames arranged in order: P0, P1, P2, P3, P4, P5, P6, ... Pn, where, in the sending end, the image The frame P5 is obtained by encoding the image frame P4 as the reference frame, and correspondingly, the image frames P6, P6, P6, ... Pn are obtained by encoding the previous image frame as the reference frame.
  • the receiving end finds that the image frame P4 is an abnormal image frame (that is, data error occurs or the image frame is lost) through anomaly detection, then, correspondingly, the image frame P4 cannot be correctly decoded at the receiving end.
  • the receiving end After confirming that the image frame P4 is an abnormal image frame, if it is not processed in time, it will directly affect the decoding of subsequent image frames. That is, if it is not processed, the receiving end cannot decode correctly after receiving the image frames P5, P6 and subsequent image frames, resulting in the error caused by the image frame P4 being transferred to the subsequent image frames , Resulting in wrong delivery.
  • the code stream is played in real time at the receiving end, if no countermeasures are taken for abnormal image frames to avoid the current abnormal image frame from affecting subsequent image frames, it will greatly affect the playback effect of the code stream.
  • the method further includes:
  • feedback information is sent to the sending end for the accurately received image frame, and the feedback information carries the frame number of the corresponding image frame.
  • the sending end detects the discontinuity of the frame sequence numbers in the two adjacent feedback information received, it is the initial data to be transmitted Determine the reference frame, and the determined reference frame is different from the abnormal image frame.
  • the transmitted image frame is obtained by encoding the initial data.
  • the sending end dynamically determines the reference frame corresponding to the initial data to be transmitted in the sending end according to the feedback information sent by the receiving end when it detects that the received image frame is a data error. Ensure that the determined reference frame is the image frame accurately received at the receiving end. So as to avoid wrong backward transmission.
  • the method includes:
  • a reference frame management queue is correspondingly configured at the receiving end for each bit stream received, and the reference frame management queue is used to store the accurately received image frame and the corresponding frame sequence number in the receiving end.
  • the method further includes:
  • the error-tolerant data sent again by the sending end for the abnormal image frame is the intra-frame coded frame corresponding to the abnormal image frame or the frame group including the intra-frame coded frame.
  • an abnormal image frame of an intra-coded frame or an intra-coded frame as a reference frame of the abnormal image frame can be decoded according to the re-received intra-coded frame correspondingly to avoid the error backward transfer.
  • the sending end periodically sends fault-tolerant data to the receiving end, so that no matter when an abnormal image frame appears in the receiving end, as long as the intra-frame coded frame corresponding to the abnormal image frame is received, it can be Decoding is performed according to the intra-coded frame received again for the abnormal image frame to obtain an accurate image frame.
  • Fig. 4 is a flow chart showing a method for transmission control of a code stream according to another exemplary embodiment.
  • the transmission control method of the code stream can be executed by the transmitting end 100 of the code stream, as shown in FIG. 4, including the following steps:
  • Step 410 Send at least two code streams, at least two code streams including a first code stream and a second code stream, where the first code stream is used as the original main code stream, and the at least two code streams except the first code stream Other code streams are used as original background code streams, and the transmission frame rate of the original main code stream is higher than the transmission frame rate of any original background code stream.
  • the original main stream is the stream selected for playback in the receiving end, so that after the receiving end receives the image frame of each of the at least two streams, the original main stream is The image frames of the code stream are played, and the image frames in the original background code stream are buffered.
  • the transmission is performed according to the image frame. Therefore, the sending of at least two code streams referred to in step 410 does not mean that the image frames in the at least two code streams have been sent, but it is known that the sending end is in the process of sending image frames.
  • Step 430 Obtain a frame rate adjustment signal, where the frame rate adjustment signal carries the code stream identifier of the second code stream.
  • the transmitting end can learn that the second code stream is switched to the main code stream according to the code stream identifier of the second code stream carried in the frame rate adjustment signal.
  • the frame rate adjustment signal sent by the receiving end according to the acquired main stream switching signal is received to obtain the frame rate adjustment signal.
  • the main stream switching signal is used to instruct to switch the main stream to the second code. flow.
  • the frame rate adjustment signal is correspondingly sent to the transmitting end, thereby correspondingly adjusting the transmission frame rate of each of the at least two code streams.
  • the frame rate adjustment signal may also be generated by an operation triggered on the transmitting end, that is, switching the main stream at the transmitting end.
  • Step 450 After adjusting the frame rate according to the frame rate adjustment signal, continue to send at least two streams according to the adjusted transmission frame rate, where the second stream is used as the new main stream, and the second stream is divided by the at least two streams. Other code streams outside the code stream are used as the new background code stream. After the frame rate is adjusted, the transmission frame rate of the new main code stream is higher than the transmission frame rate of any new background code stream.
  • the transmission frame rate of the new background code stream is the transmission frame rate of the second code stream before switching, or is a dynamic low frame rate adapted to the remaining bandwidth.
  • the remaining bandwidth is based on the The transmission frame rate of the new main stream is determined.
  • the transmission frame rate of the new main stream is the transmission frame rate of the original main stream before switching.
  • the method further includes:
  • Step 510 Before sending the image frames of each code stream in the at least two code streams, obtain a reference frame determined for the original image to be encoded in the corresponding code stream.
  • Step 530 Encode the original image according to the reference frame to obtain an image frame of the original image.
  • the inter-frame coding method is used to code the original images in each bit stream.
  • step 510 includes:
  • the transmitting end configures a reference frame management queue corresponding to each code stream.
  • the reference frame management queue is used to store the image frames accurately received by the receiving end in the corresponding code stream, so as to ensure the reference frame used For the image frame accurately received in the receiving end, the steps of selecting the image frame from the image frame obtained by encoding in the corresponding code stream as the reference frame of the original image include:
  • the method further includes:
  • the feedback information sent by the receiving end is received.
  • the receiving end determines that the received image frame is accurate through anomaly detection, it sends feedback information for the accurately received image frame.
  • the feedback information is used to determine a reference frame for the original image to be encoded.
  • the sending end can determine which image frames are accurately received by the receiving end according to the received feedback information.
  • the feedback information carries the frame number of the corresponding image frame. Therefore, when the sending end receives the feedback information, the corresponding image frame corresponding to the frame sequence number is saved in the reference frame management queue of the corresponding code stream according to the carried frame sequence number.
  • the receiving end configures a reference frame management queue for each bit stream.
  • the image frame and the corresponding frame sequence number are saved to the corresponding code The flow's reference frame management queue.
  • the method further includes:
  • the image frame corresponding to the adjacent data of the original image is determined as the reference frame of the original image.
  • the encoding efficiency of using the image frame corresponding to the adjacent data of the original image to be encoded is higher.
  • the image frame corresponding to the adjacent data is not accurately received by the receiving end, it may cause the The image frame corresponding to the adjacent data can not be decoded correctly in the receiving end.
  • the reference frame for the original image to be encoded is determined according to the feedback information. Specifically, when the frame numbers carried in the detection feedback information are continuous, it means that there is no image frame with data errors or lost in the current receiving end, so that the adjacent data of the original image to be encoded corresponds to the image
  • the frame is determined as the reference frame of the original image, thereby improving the coding efficiency; and when the frame number carried in the feedback information is detected as discontinuous, it means that the image frames between the discontinuous frame numbers are abnormal image frames.
  • the image frame is selected from the reference frame management queue of the corresponding code stream as the reference frame of the original image to ensure that the reference frame used is the image frame accurately received at the receiving end.
  • the method further includes:
  • the original image of the first frame in each stream is encoded and transmitted according to the intra-frame encoding method.
  • the method further includes:
  • Step 610 Receive feedback information sent by the receiving end for the received image frame.
  • Step 630 Determine whether abnormal transmission occurs in the corresponding code stream through the feedback information.
  • the sender determines whether there is abnormal transmission in the corresponding code stream by detecting whether the frame sequence number carried in the feedback information received twice in the same code stream is adjacent, that is, if it is continuous, it means that there is no abnormal transmission; if it is not continuous, then Indicates abnormal transmission occurred.
  • the receiving end may also send feedback information for the abnormal image frame to the transmitting end after the abnormal image frame is determined by the abnormality detection.
  • the feedback information carries the frame number of the corresponding abnormal image frame
  • the abnormal image frame includes the image frame with data error and the image frame with loss. Therefore, after receiving the feedback information, the receiving end can determine that abnormal transmission has occurred in the corresponding code stream, and correspondingly determine the abnormal image frame according to the frame sequence number in the feedback information.
  • Step 650 If it is determined that abnormal transmission occurs in the corresponding code stream, the original image currently to be transmitted in the code stream is encoded and transmitted according to the intra-frame coding mode.
  • Step 670 If it is determined that no abnormal transmission occurs in the corresponding code stream, the original image currently to be transmitted is coded and transmitted according to the inter-frame coding mode.
  • the first frame of the original image in each stream is encoded and transmitted according to the intra-frame encoding method, such as an encoded I frame, and the subsequent original images in the stream are determined according to whether abnormal transmission occurs during transmission.
  • Coding mode that is, when abnormal transmission occurs, the intra-frame coding method is used for coding and transmission, such as encoding to obtain I frame and transmitting; when there is no abnormal transmission, the inter-frame coding method is used for encoding and transmitting, for example, encoding to obtain P frame And transfer.
  • a code stream receiving device includes a processor, a communication component, a memory, and a communication bus.
  • the memory stores executable instructions, and the processor is configured to perform the following steps:
  • the main code stream switching signal indicates to switch the main code stream to the second code stream.
  • the second stream is used as the new main stream, and at least two streams other than the second stream are used as the new background stream.
  • the new main stream The transmission frame rate of the code stream is higher than the transmission frame rate of any new background code stream.
  • the processor further executes the following steps:
  • the processor after the step of acquiring the main stream switching signal, the processor further executes the following steps:
  • the processor in the step of playing the second code stream as the new main code stream, is configured to perform the following steps:
  • the processor in the step of acquiring the main stream switching signal, is configured to perform the following steps:
  • the processor after the step of acquiring the main stream switching signal, the processor further executes the following steps:
  • the processor is configured to perform the following steps:
  • the transmission frame rate of the new background code stream after the switch is the transmission frame rate of the second code stream before the switch, or to adapt to the dynamic low frame rate of the remaining bandwidth, the remaining bandwidth is based on the new main stream after the switch.
  • the transmission frame rate of the stream is determined.
  • the transmission frame rate of the new main stream after switching is the transmission frame rate of the original main stream before switching.
  • the processor is further configured to perform the following steps:
  • anomaly detection is performed on the received image frames.
  • the processor after the step of performing abnormality detection on the received image frame, the processor further performs the following steps:
  • feedback information is sent to the sending end for the accurately received image frame, and the feedback information carries the frame number of the image frame.
  • the present disclosure provides a code stream sending device, which includes a processor, a communication component, a memory, and a communication bus.
  • the memory stores executable instructions, and the processor is configured to perform the following steps:
  • the frame rate adjustment signal is obtained, and the frame rate adjustment signal carries the code stream identifier of the second code stream.
  • the transmission frame rate of the new main code stream is higher than the transmission frame rate of any new background code stream after the frame rate is adjusted.
  • the processor in the step of obtaining the frame rate adjustment signal, is configured to perform the following steps:
  • the frame rate adjustment signal sent by the receiving end according to the acquired main code stream switching signal is received, and the main code stream switching signal is used to instruct to switch the main code stream to the second code stream.
  • the transmission frame rate of the new background code stream is the transmission frame rate of the second code stream before switching, or is a dynamic low frame rate adapted to the remaining bandwidth.
  • the remaining bandwidth is based on the The transmission frame rate of the new main stream is determined.
  • the transmission frame rate of the new main stream is the transmission frame rate of the original main stream before switching.
  • the processor is further configured to perform the following steps:
  • the original image is encoded according to the reference frame to obtain the image frame of the original image.
  • the processor in the step of obtaining the reference frame determined for the original image to be encoded in the corresponding bitstream, is configured to perform the following steps:
  • the processor is further configured to perform the following steps:
  • the feedback information sent by the receiving end is received.
  • the receiving end determines that the received image frame is accurate through anomaly detection, it sends feedback information for the accurately received image frame.
  • the feedback information is used to determine a reference frame for the original image to be encoded.
  • the processor is further configured to perform the following steps:
  • the original image of the first frame in each stream is encoded and transmitted according to the intra-frame encoding method.
  • the processor is further configured to perform the following steps:
  • the original image currently to be transmitted in the code stream is encoded and transmitted according to the intra-frame coding method
  • the original image currently to be transmitted is coded and transmitted according to the inter-frame coding mode.
  • a code stream transmission control device that should be configured as a receiving end, the device includes:
  • the first receiving module is configured to receive at least two code streams.
  • the at least two code streams include a first code stream and a second code stream.
  • the first code stream is used as the original main code stream.
  • Other code streams outside the code stream are used as the original background code stream, and the transmission frame rate of the original main code stream is higher than the transmission frame rate of any original background code stream.
  • the main code stream signal acquisition module is configured to obtain the main code stream switching signal, and the main code stream switching signal indicates to switch the main code stream to the second code stream.
  • the second receiving module is configured to continue to receive at least two code streams after switching, where the second code stream is used as the new main code stream, and the other code streams except the second code stream among the at least two code streams are used as the new background code stream , After switching, the transmission frame rate of the new main stream is higher than the transmission frame rate of any new background stream.
  • the device further includes:
  • the play and storage module is configured to play the original main stream and buffer the original background stream.
  • the device further includes:
  • Switch the playback module configured to play the second code stream as the new main code stream, and buffer the new background code stream.
  • switching the playing module includes:
  • the buffer data acquisition unit is configured to acquire the buffer data buffered for the second code stream before switching.
  • the switching playing unit is configured to switch to playing the second code stream according to the buffered data.
  • the main stream signal acquisition module includes:
  • the main stream signal generating unit is configured to generate the main stream switching signal according to the triggered switching operation.
  • the device further includes:
  • the frame rate adjustment signal sending module is configured to send a frame rate adjustment signal to the sending end, and the frame rate adjustment signal indicates that the main stream is switched to the second stream.
  • the second receiving module includes:
  • the receiving unit is configured to receive at least two streams that the transmitter continues to transmit after adjusting the frame rate according to the frame rate adjustment signal, and the transmitter according to the transmission frame rate of the new main stream is higher than any transmission frame of the new background stream Adjust the frame rate.
  • the transmission frame rate of the new background code stream after the switch is the transmission frame rate of the second code stream before the switch, or to adapt to the dynamic low frame rate of the remaining bandwidth, the remaining bandwidth is based on the new main stream after the switch.
  • the transmission frame rate of the stream is determined.
  • the transmission frame rate of the new main stream after switching is the transmission frame rate of the original main stream before switching.
  • the device further includes:
  • the anomaly detection module is configured to perform anomaly detection on the received image frames for the image frames of each of the received at least two code streams.
  • the device further includes:
  • the feedback information sending module is configured to send feedback information for the accurately received image frame to the sending end when it is confirmed that the received image frame is accurate through anomaly detection, and the feedback information carries the frame number of the image frame.
  • modules can be implemented by hardware, software, or a combination of both.
  • these modules may be implemented as one or more hardware modules, such as one or more application specific integrated circuits.
  • these modules can be implemented as one or more computer programs executed on one or more processors.
  • a code stream transmission control device should be configured as a code stream transmitter, and the device includes:
  • the first sending module is configured to send at least two code streams.
  • the at least two code streams include a first code stream and a second code stream.
  • the first code stream is used as the original main code stream.
  • Other code streams outside the code stream are used as the original background code stream, and the transmission frame rate of the original main code stream is higher than the transmission frame rate of any original background code stream.
  • the frame rate adjustment signal obtaining module is configured to obtain the frame rate adjustment signal, and the frame rate adjustment signal carries the code stream identifier of the second code stream.
  • the second sending module is configured to, after adjusting the frame rate according to the frame rate adjustment signal, continue to send at least two streams according to the adjusted transmission frame rate, where the second stream is used as the new main stream, and at least two streams The other code streams except the second code stream are used as the new background code stream. After the frame rate is adjusted, the transmission frame rate of the new main code stream is higher than the transmission frame rate of any new background code stream.
  • the frame rate adjustment signal acquisition module includes:
  • the frame rate adjustment signal receiving unit is configured to receive the frame rate adjustment signal sent by the receiving end according to the acquired main stream switching signal, and the main stream switching signal is configured to instruct to switch the main stream to the second stream.
  • the transmission frame rate of the new background code stream is the transmission frame rate of the second code stream before switching, or is a dynamic low frame rate adapted to the remaining bandwidth.
  • the remaining bandwidth is based on the The transmission frame rate of the new main stream is determined.
  • the transmission frame rate of the new main stream is the transmission frame rate of the original main stream before switching.
  • the device further includes:
  • the reference frame obtaining module is configured to obtain the reference frame determined for the original image to be encoded in the corresponding code stream before sending the image frame of each code stream in the at least two code streams.
  • the encoding module is configured to encode the original image according to the reference frame to obtain the image frame of the original image.
  • the reference frame acquisition module includes:
  • the first reference frame acquisition unit is configured to select an image frame from the image frames obtained by encoding in the corresponding code stream as the reference frame of the original image.
  • the device further includes:
  • the feedback information receiving module is configured to receive the feedback information sent by the receiving end.
  • the receiving end determines that the received image frame is accurate through abnormal detection, it sends feedback information for the accurately received image frame.
  • the feedback information is configured as the original to be encoded
  • the image determines the reference frame.
  • the device further includes:
  • the first encoding transmission module is configured to encode and transmit the original image of the first frame in each code stream according to the intra-frame encoding method for at least two code streams.
  • the device further includes:
  • the information receiving module is configured to receive the feedback information sent by the receiving end for the received image frame
  • the abnormal transmission determination module is configured to determine whether abnormal transmission occurs in the corresponding code stream through feedback information
  • the second encoding transmission module is configured to, if the abnormal transmission determining module determines that abnormal transmission occurs in the corresponding code stream, the original image currently to be transmitted in the code stream is encoded and transmitted according to the intra-frame encoding method;
  • the third encoding transmission module is configured to encode and transmit the original image currently to be transmitted according to the inter-frame encoding method if the abnormal transmission determining module determines that no abnormal transmission occurs in the corresponding code stream.
  • modules can be implemented by hardware, software, or a combination of both.
  • these modules may be implemented as one or more hardware modules, such as one or more application specific integrated circuits.
  • these modules can be implemented as one or more computer programs executed on one or more processors.
  • Fig. 7 is a hardware block diagram of a UAV according to an exemplary embodiment, wherein the UAV 700 can be used as a code stream transmitter to correspondingly execute the code stream transmission control method of the present disclosure.
  • the drone 700 is only an example adapted to the present disclosure, and cannot be considered as providing any limitation of the scope of use of the present disclosure.
  • the unmanned aerial vehicle 700 cannot be considered to be dependent on or must have one or more components of the exemplary unmanned aerial vehicle 700 shown in FIG. 7.
  • the drone 700 may include one or more of the following components: a processing component 702, a memory 704, a power component 706, an image acquisition component 708, a positioning component 710, a sensor component 714, and a communication component 716.
  • the processing component 702 generally controls the overall operations of the UAV 700, such as operations associated with code stream transmission, communication, data storage, and original image encoding.
  • the processing component 702 may include one or more processors 718 to execute instructions to complete all or part of the steps of the following method.
  • the processing component 702 may include one or more modules to facilitate the interaction between the processing component 702 and other components.
  • the memory 704 is configured to store various types of data to support the operation of the drone 700. Examples of such data include instructions for any application or method configured to operate on drone 700.
  • the memory 704 can be implemented by any type of volatile or non-volatile storage devices or their combination, such as static random access memory (Static Random Access Memory, SRAM for short), electrically erasable programmable read-only memory (Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read-Only Memory (EPROM), Programmable Red-Only Memory (PROM), Read-only memory ( Read-Only Memory, ROM for short), magnetic memory, flash memory, disk, etc.
  • the memory 704 also stores one or more modules, and the one or more modules are configured to be executed by the one or more processors 718 to complete all or part of any of the foregoing method embodiments executed by the sending end step.
  • the power supply component 712 provides power for various components of the drone 700.
  • the power supply component 712 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the drone 700.
  • the power assembly 706 is configured to provide power for the flight of the drone 700.
  • the power assembly 706 may include a power motor that drives the rotor to rotate.
  • the image acquisition component 708 is configured for the UAV 700 to perform image or video acquisition, so as to encode a video stream.
  • the image acquisition component 708 may be at least one camera mounted on the drone 700.
  • the positioning component 710 is configured to obtain the position of the UAV 700 in real time.
  • the positioning component 710 may be a GPS positioning module, a low-orbit satellite module, or the like.
  • the sensor component 714 includes one or more sensors configured to provide the drone 700 with various aspects of status assessment.
  • the sensor component 714 can detect the take-off and stop status of the drone 700, the relative positioning of the components, and the sensor component 714 can also detect the position change of the drone 700 or a component of the drone 700 and the temperature of the drone 700 Variety.
  • the sensor component 714 may also include a magnetic sensor, a pressure sensor or a temperature sensor, an acceleration sensor, an angular velocity sensor, a distance sensor, etc.
  • the communication component 716 is configured to facilitate wired or wireless communication between the drone 700 and other devices.
  • the UAV 700 can be connected to a wireless network based on a communication standard, such as WiFi (WIreless-Fidelity, wireless fidelity).
  • the communication component 716 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel.
  • the communication component 716 further includes a near field communication (Near Field Communication, NFC for short) module to facilitate short-range communication.
  • the NFC module can be implemented based on Radio Frequency Identification (RFID) technology, Infrared Data Association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth technology and other technologies. .
  • RFID Radio Frequency Identification
  • IrDA Infrared Data Association
  • UWB Ultra Wideband
  • a computer-readable storage medium may be a temporary and non-transitory computer-readable storage medium including instructions.
  • the computer-readable storage medium stores a computer The program, when the computer program is executed by the processor, realizes the transmission control method of the code stream in any method embodiment executed by the receiving end.
  • a computer-readable storage medium may be a temporary and non-transitory computer-readable storage medium including instructions.
  • the computer-readable storage medium stores a computer The program, when the computer program is executed by the processor, realizes the transmission control method of the code stream in any method embodiment executed by the sending end.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

L'invention concerne un procédé de commande de transmission et un dispositif pour flux de code. Le procédé consiste : à recevoir au moins deux flux de code, lesdits deux flux de code comprenant un premier flux de code et un second flux de code, le premier flux de code servant de flux de code principal d'origine, les flux de code autres que le premier flux de code dans lesdits deux flux de code servent de flux de code d'arrière-plan d'origine, et la fréquence de trame de transmission du flux de code principal d'origine est supérieure à celle de l'un quelconque des flux de code d'arrière-plan d'origine ; à obtenir un signal de commutation de flux de code principal, le signal de commutation de flux de code principal indique la commutation du flux de code principal vers le second flux de code ; et à poursuivre la réception desdits deux flux de code après la commutation, le second flux de code servant de nouveau flux de code principal, les flux de code autres que le second flux de code dans lesdits deux flux de code servant de nouveaux flux de code d'arrière-plan, et après la commutation, la fréquence de trame de transmission du nouveau flux de code principal est supérieure à celle de l'un quelconque des nouveaux flux de code d'arrière-plan. Le problème dans l'état de la technique de longue durée de réponse de commutation de lecture peut être efficacement résolu.
PCT/CN2019/097265 2019-07-23 2019-07-23 Procédé de commande de transmission et dispositif pour flux de code, et support d'informations lisible par ordinateur WO2021012180A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2019/097265 WO2021012180A1 (fr) 2019-07-23 2019-07-23 Procédé de commande de transmission et dispositif pour flux de code, et support d'informations lisible par ordinateur
CN201980008497.2A CN111602389B (zh) 2019-07-23 2019-07-23 码流的传输控制方法、设备及计算机可读存储介质

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/097265 WO2021012180A1 (fr) 2019-07-23 2019-07-23 Procédé de commande de transmission et dispositif pour flux de code, et support d'informations lisible par ordinateur

Publications (1)

Publication Number Publication Date
WO2021012180A1 true WO2021012180A1 (fr) 2021-01-28

Family

ID=72190286

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/097265 WO2021012180A1 (fr) 2019-07-23 2019-07-23 Procédé de commande de transmission et dispositif pour flux de code, et support d'informations lisible par ordinateur

Country Status (2)

Country Link
CN (1) CN111602389B (fr)
WO (1) WO2021012180A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115174965A (zh) * 2022-06-30 2022-10-11 杭州海康威视数字技术股份有限公司 视频预览方法、装置、电子设备及计算机可读存储介质

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101917568A (zh) * 2009-12-17 2010-12-15 新奥特（北京）视频技术有限公司 一种基于流媒体技术的网络视频播放器及播放系统
CN202799004U (zh) * 2012-06-04 2013-03-13 深圳市景阳科技股份有限公司 一种视频播放终端及系统
CN103997680A (zh) * 2014-06-06 2014-08-20 北京奇艺世纪科技有限公司 一种视频码流的切换方法及装置
CN104079869A (zh) * 2013-03-29 2014-10-01 杭州海康威视数字技术股份有限公司 对多通道码流进行预览的方法及客户端
US20150227294A1 (en) * 2014-02-11 2015-08-13 Wowza Media Systems, LLC Server configuration interface including stream preview
CN106231225A (zh) * 2016-09-14 2016-12-14 深圳市泛海三江科技发展有限公司 一种网络硬盘录像机数据处理方法和系统
CN106937141A (zh) * 2017-03-24 2017-07-07 北京奇艺世纪科技有限公司 一种码流切换方法及装置

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9570106B2 (en) * 2014-12-02 2017-02-14 Sony Corporation Sensor configuration switching for adaptation of video capturing frame rate
CN106572355A (zh) * 2016-11-02 2017-04-19 乐视控股（北京）有限公司 多路视频直播方法及系统
CN107666593B (zh) * 2017-08-28 2020-04-21 中国电子科技集团公司第二十八研究所 一种波动网络环境下的视频实时传输方法
CN109195010B (zh) * 2018-08-15 2021-08-06 咪咕视讯科技有限公司 一种码率调节方法及装置

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101917568A (zh) * 2009-12-17 2010-12-15 新奥特（北京）视频技术有限公司 一种基于流媒体技术的网络视频播放器及播放系统
CN202799004U (zh) * 2012-06-04 2013-03-13 深圳市景阳科技股份有限公司 一种视频播放终端及系统
CN104079869A (zh) * 2013-03-29 2014-10-01 杭州海康威视数字技术股份有限公司 对多通道码流进行预览的方法及客户端
US20150227294A1 (en) * 2014-02-11 2015-08-13 Wowza Media Systems, LLC Server configuration interface including stream preview
CN103997680A (zh) * 2014-06-06 2014-08-20 北京奇艺世纪科技有限公司 一种视频码流的切换方法及装置
CN106231225A (zh) * 2016-09-14 2016-12-14 深圳市泛海三江科技发展有限公司 一种网络硬盘录像机数据处理方法和系统
CN106937141A (zh) * 2017-03-24 2017-07-07 北京奇艺世纪科技有限公司 一种码流切换方法及装置

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115174965A (zh) * 2022-06-30 2022-10-11 杭州海康威视数字技术股份有限公司 视频预览方法、装置、电子设备及计算机可读存储介质
CN115174965B (zh) * 2022-06-30 2024-01-02 杭州海康威视数字技术股份有限公司 视频预览方法、装置、电子设备及计算机可读存储介质

Also Published As

Publication number Publication date
CN111602389A (zh) 2020-08-28
CN111602389B (zh) 2022-06-03

Similar Documents

Publication Publication Date Title
US10009630B2 (en) System and method for encoding video content using virtual intra-frames
CN111052754B (zh) 将空间元素的帧流传输到客户端装置
US9585062B2 (en) System and method for implementation of dynamic encoding rates for mobile devices
US10659815B2 (en) Method of dynamic adaptive streaming for 360-degree videos
US8934728B2 (en) Image display system, image composing and re-encoding apparatus, image display apparatus, method of displaying image, and computer-readable storage medium having stored therein image composing and re-encoding program
US20200259880A1 (en) Data processing method and apparatus
WO2017198223A1 (fr) Procédé d'évaluation de la qualité vidéo, dispositif et tête radio distante
WO2020237466A1 (fr) Procédé et appareil de vidéotransmission, et aéronef, dispositif de lecture et support de stockage
WO2013030166A2 (fr) Procédé permettant de transmettre à un dispositif client des signaux vidéo à partir d'une application s'exécutant sur un serveur par l'intermédiaire d'un réseau ip
WO2021012180A1 (fr) Procédé de commande de transmission et dispositif pour flux de code, et support d'informations lisible par ordinateur
JP2010213119A (ja) 映像伝送システム、撮像装置及びモニタ装置
KR20090037741A (ko) 네트워크 카메라를 채용한 원격 감시 시스템
JP2010057084A (ja) 映像送信装置、その制御方法、および制御方法を実行するプログラム
US9118803B2 (en) Video conferencing system
CN107734278B (zh) 一种视频回放方法及相关装置
US9363574B1 (en) Video throttling based on individual client delay
US9553906B2 (en) Method and system for synchronization of data streams
CN112470481B (zh) 用于对基于图块的沉浸式视频进行编码的编码器和方法
US9451288B2 (en) Inferred key frames for fast initiation of video coding sessions
KR100899666B1 (ko) 분산 다중 스트리밍 전송 장치
CN113508601A (zh) 客户端和用于在客户端处管理多媒体内容的流传输会话的方法
US11973634B1 (en) Detecting hardware issue
US20240137606A1 (en) Electronic apparatus, server apparatus and control method thereof
JP2004140691A (ja) 動画データ通信システムおよび動画データ通信方法
JP2022015118A (ja) 無線画像伝送システム、画像表示システムおよび無線画像伝送方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19938260

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19938260

Country of ref document: EP

Kind code of ref document: A1