CN105847971A - Method for processing screen transmission video - Google Patents
Method for processing screen transmission video Download PDFInfo
- Publication number
- CN105847971A CN105847971A CN201610368583.2A CN201610368583A CN105847971A CN 105847971 A CN105847971 A CN 105847971A CN 201610368583 A CN201610368583 A CN 201610368583A CN 105847971 A CN105847971 A CN 105847971A
- Authority
- CN
- China
- Prior art keywords
- packet
- data
- data packets
- decoding
- screen video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 18
- 230000005540 biological transmission Effects 0.000 title abstract description 6
- 238000000605 extraction Methods 0.000 claims description 16
- 238000003672 processing method Methods 0.000 claims description 9
- 239000000284 extract Substances 0.000 claims description 4
- 238000009825 accumulation Methods 0.000 abstract 1
- 230000002452 interceptive effect Effects 0.000 description 5
- 238000006243 chemical reaction Methods 0.000 description 3
- 230000007547 defect Effects 0.000 description 3
- 230000005059 dormancy Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440218—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention discloses a method for processing screen transmission video. The method comprises the steps of receiving screen transmission video data, acquiring data packets corresponding to the screen transmission data, storing the data packets into a decoding waiting queue, extracting the data packets from the decoding waiting queue, judging whether the number of the data packets is greater than a preset threshold or not, extracting reference data of the next data packet corresponding to the current video sequence in the data packets if the number of the data packets is judged to be greater than the preset threshold, returning back to the steps of extracting the data packets and judging whether the number of the data packets is greater than the preset threshold or not, and carrying out decoding on the data packets if the number of the data packets is judged to be not greater than the preset threshold. According to the invention, data in the decoding waiting queue can be consumed as soon as possible, and an increase of time delay caused by data accumulation is prevented.
Description
Technical field
The present invention relates to multimedia technology field, especially relate to a kind of processing method for passing screen video.
Background technology
Development along with information technology, it is possible to achieve different resource shares displaying on different platform equipment simultaneously, it is achieved multi-screen interactive, enriches the multimedia life of user.
Client in the multi-screen interactive of prior art the processing method passing screen video is had a following two scheme:
The first scheme is: first network receives and passes screen video data with demultiplexing (demux), to obtain passing the packet that screen video data is corresponding, then decodes and shows.
Wherein, the process of decoding is specially the packet that video is passed screen data corresponding and is decoded, and further from yuv format, decoded data is converted to rgb format, finally by queues to be shown such as the frame data after conversion are stored in.
The process of display is specially takes out frame data from display queue, the timestamp of the timestamp according to present frame and previous frame calculates the display time of present frame, if present frame can show at once, showing present frame, otherwise dormancy display thread is until present frame can show.
First scheme is: first receiving source screen equipment and encode the Frame including frame of video and audio frame obtained, frame of video includes: I frame；If the frame of video detected in currently received Frame does not arrives second I frame, then delete currently received Frame；If the frame of video detected in currently received Frame is second I frame, then decode currently and Frame received after second I frame, and the reflection that will obtain after decoding is shown on screen.Thus can effectively reduce delay during transmission screen image, allow multi-screen interactive time can more effectively reach the effect that shows in real time.
But there is following defect in the first scheme:
Decode thread process one frame data is time-consumingly higher than network reception, time-consuming (particularly the biggest when passing screen video data and being HD video) of de-multiplex operation, i.e. waits that the data depletion rate of decoding queue is less than its data generation speed.In the prior art, if there is the frame per second processing speed higher than client decoding thread of fluctuation or the output of server side code device in wireless network during using multi-screen interactive, client then will certainly be caused to wait, and the video data in decoding queue is piled up, video data is piled up and is meaned that up-to-date video more can not get display the most at most, i.e. time delay is the biggest, and it is the poorest to experience.Further, the display thread of client from etc. frame data decode are taken out in queue to be shown after, in addition it is also necessary to calculate the display time of present frame again, and dormancy show thread as required, so only result in time delay more greatly, experience worse.
There is following defect in first scheme:
The core of first scheme is to abandon some frame of video in the client biography screen broadcasting incipient stage, just starts by normal flow decoding broadcasting until receiving second I frame.Owing to it has abandoned first sequence of frames of video, (the sequence of frames of video time is different in size, general between 0.5-4s), inevitably result in client from commencing play out biography screen video to demonstrating the time lengthening (extending the length of a sequence of frames of video) passing screen picture, the blank screen time before i.e. commencing play out is elongated, is unfavorable for Consumer's Experience.
Meanwhile, first scheme pertain only to pass screen video commence play out the stage, it cannot solve the problem in the playing process of the first scheme above-mentioned, so it has the defect of the first scheme equally.
Summary of the invention
The technical problem that present invention mainly solves is to provide a kind of display terminal and for passing the processing method of screen video, both can ensure that the biography screen video data decoded in the queues to be shown such as client can show as early as possible, will not produce in waiting decoding queue again and pass overstocking of screen video data, video time delay is little, improves the experience of user.
For solving above-mentioned technical problem, a technical scheme of present invention employing is: providing a kind of processing method for passing screen video, the method comprises the following steps: receives and passes screen video data, and obtains the packet that biography screen video data is corresponding；Packet is stored in wait decoding queue；From waiting, decoding queue extracts packet, and judge that whether the quantity of packet is more than the threshold value preset；If the result judged is yes, then the reference data of the next packet of the corresponding current video sequence in extraction packet, and return extraction packet, and judge whether the quantity of packet is more than the step of the threshold value preset；If the result judged is no, then packet is decoded.
Wherein, method also includes: by the queues to be shown such as decoded data are directly stored in.
Wherein, method also includes: takes out decoded data from display queue and directly shows.
Wherein, the step obtaining packet corresponding to biography screen video data includes: demultiplex passing screen video data, the packet corresponding to obtain biography screen video data.
Wherein, packet is stored in the step waited in decoding queue to include: the packet after demultiplexing is stored in wait decoding queue.
For solving above-mentioned technical problem, the technical scheme that the present invention uses is: providing a kind of display terminal, this display terminal includes: receiver module, is used for receiving biography screen video data；Packet acquisition module, passes, for obtaining, the packet that screen video data is corresponding；First memory module, for being stored in packet in wait decoding queue；Packet extraction module, for from waiting extraction packet decoding queue；Judge module, for judging that whether the quantity of packet is more than the threshold value preset；Processing module, for the result that judges at judge module as being time, the reference data of the next packet of the corresponding current video sequence in extraction packet, and control packet extraction module continuation extraction packet, and judge module continues to judge that whether the quantity of packet is more than default threshold value；When the result that judge module judges is no, packet is decoded.
Wherein, display terminal farther includes the second memory module, for by the queues to be shown such as decoded data are directly stored in.
Wherein, display terminal farther includes display module, and display module is for taking out decoded data and directly showing from display queue.
Wherein, packet acquisition module is demultiplexing module, for demultiplexing biography screen video data, passes, to obtain, the packet that screen video data is corresponding.
Wherein, the packet after the first memory module is further used for demultiplexing is stored in wait decoding queue.
The invention has the beneficial effects as follows: be different from the situation of prior art, the display terminal of the present invention is when determining the quantity passing packet corresponding to screen video data more than the threshold value preset, the only reference data of the next packet of the corresponding current video sequence in extraction packet, the only quantity of packet is less than or equal to during the threshold value preset just be decoded, when thus can avoid next packets need normal decoder because causing flower screen without reference to data in the case of, the data waited in decoding queue can be consumed again as soon as possible, the time delay preventing data stacking from causing increases.
Accompanying drawing explanation
Fig. 1 is the structural representation of a kind of display terminal that the embodiment of the present invention provides；
Fig. 2 is the flow chart of a kind of processing method for passing screen video that the embodiment of the present invention provides.
Detailed description of the invention
Refer to the structural representation that Fig. 1, Fig. 1 are a kind of display terminals that the embodiment of the present invention provides.As it is shown in figure 1, the display terminal 10 that the embodiment of the present invention provides is specially the client terminal in multi-screen interactive.It mainly receives biography screen video data of service end transmission, and be decoded this biography screen video data waiting operate after be shown to user.
Specifically, display terminal 10 includes receiver module 11, packet acquisition module 12, packet extraction module 13, judge module 14, processing module 15 and the first memory module 16.
Wherein, receiver module 11 is for receiving the biography screen video data of service end.Receiver module 11 concretely bluetooth module or Anneta module etc..Packet acquisition module 12 passes, for obtaining, the packet that screen video data is corresponding.First memory module 16 is for being stored in packet in wait decoding queue.Packet extraction module 13 is for from waiting extraction packet decoding queue.Judge module 14 is for judging that whether the quantity of packet is more than the threshold value preset.Processing module 15 is used for when the result that judge module 14 judges is as being, the reference data of the next packet of the corresponding current video sequence in extraction packet, it is to avoid because causing flower to shield without reference to data during next packets need normal decoder.Processing module 15 controls packet extraction module 12 further and continues to extract packet, and judge module 14 continues to judge that whether the quantity of packet is more than the threshold value preset.When the result that judge module 14 judges is no, packet is decoded.
Wherein, the reference data of packet is specially the reference picture of next video sequence and the predictive value of present frame and forecast error.
It should be noted that, when the result that judge module 14 judges is as being, after the reference data of the next packet of the corresponding current video sequence that processing module 15 is extracted in current packet, will give up by current packet, the most current packet is no longer decoded.Thus can save the time of decoding.
Therefore, in the present embodiment, when can avoid next packets need normal decoder because causing flower screen without reference to data in the case of, the data waited in decoding queue can be consumed again as soon as possible, the time delay preventing data stacking from causing increases.
Further, display terminal 10 farther includes the second memory module 18, for by the queues to be shown such as decoded data are directly stored in.It follows that the present embodiment eliminates the step of form of the prior art conversion, the most further save the time of decoding.
Further, display terminal 10 farther includes display module 17, and display module 17 is for taking out decoded data and directly showing from display queue.Thus, the display terminal 10 of the present embodiment withouts waiting for display, in time video is shown to user, improves Consumer's Experience.
In the present embodiment, packet acquisition module 12 concretely demultiplexing module, for biography screen video data is carried out demultiplexing process, pass, to obtain, the packet that screen video data is corresponding.Wherein, the packet after demultiplexing is stored in wait decoding queue by the first memory module 16 further.
Described in brought forward, the present embodiment both can consume the data waited in decoding queue as soon as possible, and the time delay preventing data stacking from causing increases.Timely the data decoded can be shown to user again, improve the experience of user.
The application is additionally based upon previously described display terminal and provides a kind of processing method for passing screen video.Specifically refer to Fig. 2.
As in figure 2 it is shown, the processing method being used for passing screen video of the present embodiment comprises the following steps:
Step S1: receive and pass screen video data, and obtain the packet that biography screen video data is corresponding.
Particularly as follows: demultiplex passing screen video data, pass, to obtain, the packet that screen video data is corresponding.
Step S2: packet is stored in wait decoding queue；
It is specially the packet after step S1 being demultiplexed to be stored in wait decoding queue.
Step S3: extract packet decoding queue from waiting, and judge that whether the quantity of packet is more than the threshold value preset.
In this step, if the result judged is yes, then jump to step S4, if the result judged is no, then jump to step S5.
Step S4: the reference data of the next packet of the corresponding current video sequence in extraction packet, and return step S2.
Wherein, the reference data of packet is specially the reference picture of next video sequence and the predictive value of present frame and forecast error.
This step can be avoided shielding because causing spending without reference to data during next packets need normal decoder.
It should be noted that in this step, after the reference data of the next packet of the corresponding current video sequence being extracted in current packet, will give up by current packet, the most current packet is no longer decoded.Thus can save the time of decoding.
Step S5: packet is decoded.
Method also includes: will take out decoded data in the queues to be shown such as decoded data are directly stored in and from display queue and shows.Thus in time video can be shown to user, improve the experience of user.
In sum, when the present invention is by being more than, in the quantity passing packet corresponding to screen video data, the threshold value preset, the only reference data of the next packet of the corresponding current video sequence in extraction packet, when thus can avoid next packets need normal decoder because causing flower screen without reference to data in the case of, can consume again the data waited in decoding queue as soon as possible, the time delay preventing data stacking from causing increases.
Further, the present invention also will take out decoded data in the queues to be shown such as decoded data are directly stored in and from display queue and shows.Thus in time video can be shown to user, improve the experience of user.
The foregoing is only embodiments of the invention; not thereby the scope of the claims of the present invention is limited; every equivalent structure utilizing description of the invention and accompanying drawing content to be made or equivalence flow process conversion; or directly or indirectly it is used in other relevant technical fields, the most in like manner it is included in the scope of patent protection of the present invention.
Claims (3)
1. the processing method being used for passing screen video, it is characterised in that said method comprising the steps of:
Receive and pass screen video data, and obtain the packet that described biography screen video data is corresponding；
Described packet is stored in wait decoding queue；
From described wait decoding queue, extract described packet, and judge that whether the quantity of described packet is more than the threshold value preset；
If the result judged is yes, then extracts the reference data of the next packet of corresponding current video sequence in described packet, and return the described packet of extraction, and judge that the quantity of described packet is whether more than the step of the threshold value preset；
If the result judged is no, then described packet is decoded.
Method the most according to claim 1, it is characterised in that described method also includes:
By in the queues to be shown such as decoded data are directly stored in.
Method the most according to claim 2, it is characterised in that described method also includes:
From described display queue, take out described decoded data and directly show.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610368583.2A CN105847971A (en) | 2016-05-28 | 2016-05-28 | Method for processing screen transmission video |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610368583.2A CN105847971A (en) | 2016-05-28 | 2016-05-28 | Method for processing screen transmission video |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105847971A true CN105847971A (en) | 2016-08-10 |
Family
ID=56595854
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610368583.2A Pending CN105847971A (en) | 2016-05-28 | 2016-05-28 | Method for processing screen transmission video |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105847971A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107438199A (en) * | 2016-05-29 | 2017-12-05 | 刘健文 | One kind passes screen video display terminal |
| CN107438197A (en) * | 2016-05-29 | 2017-12-05 | 刘健文 | A kind of display terminal |
| CN107438198A (en) * | 2016-05-29 | 2017-12-05 | 刘健文 | A kind of display terminal for being used to pass screen video |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013007395A1 (en) * | 2011-07-13 | 2013-01-17 | Pierre-Alain Cotte | Methods and devices for switching on or switching to a digital video signal with little delay |
| CN103297772A (en) * | 2013-05-02 | 2013-09-11 | 深圳市比维视创科技有限公司 | Method and system for processing transmission screen image and display equipment |
| CN103546802A (en) * | 2013-10-15 | 2014-01-29 | 深圳Tcl新技术有限公司 | Method for dynamically adjusting cache and display terminal |
| CN104113777A (en) * | 2014-08-01 | 2014-10-22 | 广州金山网络科技有限公司 | Audio stream decoding method and device |
| US20160134931A1 (en) * | 2014-11-12 | 2016-05-12 | Bing Song | Method and apparatus for reducing latency in multi-media system |
-
2016
- 2016-05-28 CN CN201610368583.2A patent/CN105847971A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013007395A1 (en) * | 2011-07-13 | 2013-01-17 | Pierre-Alain Cotte | Methods and devices for switching on or switching to a digital video signal with little delay |
| CN103297772A (en) * | 2013-05-02 | 2013-09-11 | 深圳市比维视创科技有限公司 | Method and system for processing transmission screen image and display equipment |
| CN103546802A (en) * | 2013-10-15 | 2014-01-29 | 深圳Tcl新技术有限公司 | Method for dynamically adjusting cache and display terminal |
| CN104113777A (en) * | 2014-08-01 | 2014-10-22 | 广州金山网络科技有限公司 | Audio stream decoding method and device |
| US20160134931A1 (en) * | 2014-11-12 | 2016-05-12 | Bing Song | Method and apparatus for reducing latency in multi-media system |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107438199A (en) * | 2016-05-29 | 2017-12-05 | 刘健文 | One kind passes screen video display terminal |
| CN107438197A (en) * | 2016-05-29 | 2017-12-05 | 刘健文 | A kind of display terminal |
| CN107438198A (en) * | 2016-05-29 | 2017-12-05 | 刘健文 | A kind of display terminal for being used to pass screen video |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102002835B1 (en) | Method, computer program, reception apparatus, and information providing apparatus for trigger compaction | |
| CN105847946A (en) | Screen transmission video processing method | |
| CN105872728A (en) | Screen transfer video processing method for multi-screen interaction | |
| JP5990650B2 (en) | Broadcast signal processing method and apparatus including interactive broadcast service | |
| KR102267861B1 (en) | Extensions to trigger parameters table for interactive television | |
| US8707151B2 (en) | Apparatus and method for composing scenes using Rich Media contents | |
| CN104219459A (en) | Video language translation method and system and intelligent display device | |
| CN103428538A (en) | Method, device and system for interaction of interactive broadcast televisions | |
| CN105142000A (en) | Information pushing method and system based on television playing content | |
| CN108494792A (en) | A kind of flash player plays the converting system and its working method of hls video flowings | |
| CN105847971A (en) | Method for processing screen transmission video | |
| JP6728246B2 (en) | Method and apparatus for transmitting and receiving signals in multimedia system | |
| KR101525248B1 (en) | Method and apparatus for providing rich-media service | |
| EP2344951B1 (en) | Conditional processing method and apparatus | |
| CN115623264A (en) | Live stream subtitle processing method and device and live stream playing method and device | |
| CN109525852B (en) | Live video stream processing method, device and system and computer readable storage medium | |
| CN109618186A (en) | A kind of H264/AVC video Supplemental Enhancement Information encapsulated circuit realized using FPGA | |
| US8401516B2 (en) | Method and device for receiving emergency broadcasting messages | |
| CN107438199A (en) | One kind passes screen video display terminal | |
| CN107438198A (en) | A kind of display terminal for being used to pass screen video | |
| US8863193B2 (en) | Information processing apparatus, broadcast receiving apparatus and information processing method | |
| CN103327399B (en) | The method quickly representing EPG data | |
| CN101483757B (en) | Skipping method, system and server for network interactive play-on-demand | |
| CN108600826B (en) | Method and device for playing TS (transport stream) | |
| CN107438197A (en) | A kind of display terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160810 |