CN107438197A - A kind of display terminal - Google Patents

A kind of display terminal Download PDF

Info

Publication number
CN107438197A
CN107438197A CN201610370608.2A CN201610370608A CN107438197A CN 107438197 A CN107438197 A CN 107438197A CN 201610370608 A CN201610370608 A CN 201610370608A CN 107438197 A CN107438197 A CN 107438197A
Authority
CN
China
Prior art keywords
packet
module
data
display terminal
queue
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610370608.2A
Other languages
Chinese (zh)
Inventor
刘健文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201610370608.2A priority Critical patent/CN107438197A/en
Publication of CN107438197A publication Critical patent/CN107438197A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4341Demultiplexing of audio and video streams
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/438Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
    • H04N21/4385Multiplex stream processing, e.g. multiplex stream decrypting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440218Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

The invention discloses a kind of display terminal, the display terminal includes:Receiving module, screen video data is passed for receiving;Packet acquisition module, shield packet corresponding to video data for obtaining described pass;First memory module, waited for the packet to be stored in decoding queue;Packet extraction module, for extracting the packet from the wait decoding queue.Thus, the present invention can consume the data waited in decoding queue as soon as possible, prevent the increase that is delayed caused by data stacking.

Description

A kind of display terminal
Technical field
The present invention relates to multimedia technology field, more particularly, to a kind of display terminal.
Background technology
With the continuous development of information technology, it is possible to achieve different resource is carried out in different platform equipment while shared displaying, realizes multi-screen interactive, enriches the multimedia life of user.
The processing method for shielding video to biography of client in the multi-screen interactive of prior art has following two schemes:
The first scheme is:Network is received with demultiplexing (demux) biography screen video data first, to obtain passing packet corresponding to screen video data, then decoding and display.
Wherein, the process of decoding is specially that packet corresponding to video biography screen data is decoded, and decoded data further are converted into rgb format from yuv format, finally by queues to be shown such as the frame data deposits after conversion.
The process of display is specially to take out frame data from display queue, the display time of present frame is calculated according to the timestamp of the timestamp of present frame and previous frame, present frame is shown if present frame can be shown at once, otherwise dormancy shows thread untill present frame can be shown.
Second scheme is:The data frame for including frame of video and audio frame that source screen equipment encodes to obtain is received first, and frame of video includes:I frames;If detecting, the frame of video in currently received data frame does not reach second I frame, deletes currently received data frame;If it is second I frame to detect the frame of video in currently received data frame, decoding data frame received currently and after second I frame, and the image obtained after decoding is shown on screen.It is possible thereby to delay when effectively reducing transmission screen image, allows the effect that can more effectively reach real-time display during multi-screen interactive.
But there is following defect in the first scheme:
The decoding frame data of thread process one it is time-consuming be higher than network receive, de-multiplex operation it is time-consuming(It is particularly time-consuming bigger when passing screen video data and being HD video), that is, wait the data depletion rate of decoding queue to be less than its data and produce speed.In the prior art, if fluctuating occurs in wireless network during multi-screen interactive is used or the frame per second of server side code device output decodes the processing speed of thread higher than client, client will certainly be then caused to wait the video data accumulation in decoding queue, video data accumulation more at most means that newest video cannot more be shown, it is delayed bigger, experience is poorer.Further, the display thread of client from etc. frame data decode are taken out in queue to be shown after, it is also necessary to calculate the display time of present frame again, and dormancy shows thread as needed, so only result in and be delayed bigger, experience worse.
Following defect be present in second scheme:
The core of second scheme is to abandon some frame of video in the client biography screen broadcasting incipient stage, just starts to decode broadcasting by normal flow until receiving second I frame.Because it has abandoned first sequence of frames of video(The sequence of frames of video time is different in size, typically between 0.5-4s), client is inevitably resulted in from biography screen video is commenced play out to the time lengthening for showing biography screen picture(Extend the length of a sequence of frames of video), that is, the blank screen time before commencing play out is elongated, is unfavorable for Consumer's Experience.
Meanwhile second scheme pertains only to pass screen video and commences play out the stage, it can not be solved the problems, such as in the playing process of the first above-mentioned scheme, so it equally has the defects of the first scheme.
The content of the invention
The present invention solves the technical problem of provide a kind of display terminal and biography screen method for processing video frequency, both it can ensure that the biography screen video data decoded in the queue to be shown such as client can be shown as early as possible, it will not be produced again in decoding queue is waited and pass overstocking for screen video data, video delay is small, improves the experience of user.
In order to solve the above technical problems, one aspect of the present invention is:A kind of pass is provided and shields method for processing video frequency, this method comprises the following steps:Receive and pass screen video data, and obtain packet corresponding to biography screen video data;Packet is stored in and waited in decoding queue;Packet is extracted from waiting in decoding queue, and judges whether the quantity of packet is more than default threshold value;If the result judged is yes, the reference data of the next packet of corresponding current video sequence in packet is extracted, and returns to extraction packet, and the step of whether quantity of packet is more than default threshold value judged;If the result judged is no, packet is decoded.
Wherein, method also includes:Decoded data are directly stored in etc. in queue to be shown.
Wherein, method also includes:Decoded data are taken out from display queue and are directly shown.
Wherein, obtaining the step of passing packet corresponding to screen video data includes:Demultiplexed to passing screen video data, packet corresponding to screen video data is passed to obtain.
Wherein, packet is stored in waits the step in decoding queue to include:Packet deposit after demultiplexing is waited into decoding queue.
In order to solve the above technical problems, one aspect of the present invention is:A kind of display terminal is provided, the display terminal includes:Receiving module, screen video data is passed for receiving;Packet acquisition module, packet corresponding to screen video data is passed for obtaining;First memory module, waited for packet to be stored in decoding queue;Packet extraction module, for extracting packet from wait decoding queue;Judge module, for judging whether the quantity of packet is more than default threshold value;Processing module, during for the result that judges in judge module to be, the reference data of the next packet of the corresponding current video sequence in packet is extracted, and control data bag extraction module continues to extract packet, and judge module continues to judge whether the quantity of packet is more than default threshold value;The result that judge module judges as it is no when, packet is decoded.
Wherein, display terminal further comprises the second memory module, for being directly stored in decoded data etc. in queue to be shown.
Wherein, display terminal further comprises display module, and display module is used to take out decoded data from display queue and directly shown.
Wherein, packet acquisition module is demultiplexing module, and for being demultiplexed to passing screen video data, packet corresponding to screen video data is passed to obtain.
Wherein, the first memory module is further used for the packet deposit after demultiplexing waiting decoding queue.
The beneficial effects of the invention are as follows:It is different from the situation of prior art, the display terminal of the present invention is when the quantity for determining packet corresponding to biography screen video data is more than default threshold value, the only reference data of the next packet of the corresponding current video sequence in extraction packet, just decoded when only the quantity of packet is less than or equal to default threshold value, it is possible thereby to avoid when next packet needs are normal to be decoded because causing without reference to data in the case of spending screen, the data waited in decoding queue can be consumed as soon as possible again, prevent the increase that is delayed caused by data stacking.
Brief description of the drawings
Fig. 1 is a kind of structural representation of display terminal provided in an embodiment of the present invention;
Fig. 2 is a kind of flow chart for passing screen method for processing video frequency provided in an embodiment of the present invention.
Embodiment
Referring to Fig. 1, Fig. 1 is a kind of structural representation of display terminal provided in an embodiment of the present invention.As shown in figure 1, display terminal 10 provided in an embodiment of the present invention is specially the client terminal in multi-screen interactive.It mainly receives the biography screen video data of service end transmission, and the biography screen video data is carried out to be shown to user after the operation such as decoding.
Specifically, display terminal 10 includes receiving module 11, packet acquisition module 12, packet extraction module 13, judge module 14, the memory module 16 of processing module 15 and first.
Wherein, receiving module 11 is used for the biography screen video data for receiving service end.Receiving module 11 concretely bluetooth module or Anneta module etc..Packet acquisition module 12, which is used to obtain, passes packet corresponding to screen video data.First memory module 16, which is used to packet being stored in, to be waited in decoding queue.Packet extraction module 13 is used to extract packet from wait decoding queue.Judge module 14 is used to judge whether the quantity of packet is more than default threshold value.Processing module 15 is used for when the result that judge module 14 judges is is, the reference data of the next packet of the corresponding current video sequence in extraction packet, avoids next packet from needing during normal decoding because causing to spend screen without reference to data.The further control data bag extraction module 12 of processing module 15 continues to extract packet, and judge module 14 continues to judge whether the quantity of packet is more than default threshold value.The result that judge module 14 judges as it is no when, packet is decoded.
Wherein, the reference data of packet is specially the reference picture of next video sequence and the predicted value of present frame and prediction error.
It is worth noting that, when the result that judge module 14 judges is is, processing module 15 is extracted after the reference data of the next packet of the corresponding current video sequence in current packet, will current packet give up, i.e., current packet is no longer decoded.It is possible thereby to save the time of decoding.
Therefore, in the present embodiment, can avoid that the data waited in decoding queue can be consumed as soon as possible again because without reference to data causing in the case of spending screen when next packet needs are normal to be decoded, delay increase caused by preventing data stacking.
Further, display terminal 10 further comprises the second memory module 18, for being directly stored in decoded data etc. in queue to be shown.It follows that the present embodiment eliminates the step of form conversion of the prior art, therefore further save the time of decoding.
Further, display terminal 10 further comprises display module 17, and display module 17 is used to take out decoded data from display queue and directly shown.Thus, the display terminal 10 of the present embodiment is withouted waiting for showing, video is shown into user in time, improves Consumer's Experience.
In the present embodiment, the concretely demultiplexing module of packet acquisition module 12, for carrying out demultiplexing process to passing screen video data, packet corresponding to screen video data is passed to obtain.Wherein, the first memory module 16 further waits the packet deposit after demultiplexing in decoding queue.
Described in brought forward, the present embodiment can both consume the data waited in decoding queue as soon as possible, prevent the increase that is delayed caused by data stacking.The data decoded timely can be shown to user again, improve the experience of user.
The application also provides a kind of pass based on previously described display terminal and shields method for processing video frequency.Referring specifically to Fig. 2.
As shown in Fig. 2 the biography screen method for processing video frequency of the present embodiment comprises the following steps:
Step S1:Receive and pass screen video data, and obtain packet corresponding to biography screen video data.
Specially:Demultiplexed to passing screen video data, packet corresponding to screen video data is passed to obtain.
Step S2:Packet is stored in and waited in decoding queue;
Packet deposit after specially step S1 is demultiplexed is waited in decoding queue.
Step S3:Packet is extracted from waiting in decoding queue, and judges whether the quantity of packet is more than default threshold value.
In this step, if the result judged is yes, step S4 is jumped to, if the result judged is no, jumps to step S5.
Step S4:Extract the reference data of the next packet of the corresponding current video sequence in packet, and return to step S2.
Wherein, the reference data of packet is specially the reference picture of next video sequence and the predicted value of present frame and prediction error.
This step can avoid next packet from needing during normal decoding because causing to spend screen without reference to data.
It is worth noting that, in this step, after the reference data of the next packet for the corresponding current video sequence being extracted in current packet, will current packet give up, i.e., current packet is no longer decoded.It is possible thereby to save the time of decoding.
Step S5:Packet is decoded.
Method also includes:Decoded data are directly stored in etc. in queue to be shown and takes out decoded data from display queue and is shown.It is possible thereby to which video is shown into user in time, the experience of user is improved.
In summary, when the present invention in the quantity for passing packet corresponding to screen video data by being more than default threshold value, the only reference data of the next packet of the corresponding current video sequence in extraction packet, it is possible thereby to avoid when next packet needs are normal to be decoded because causing without reference to data in the case of spending screen, the data waited in decoding queue can be consumed as soon as possible again, prevent the increase that is delayed caused by data stacking.
Further, decoded data are also directly stored in etc. in queue to be shown and take out decoded data from display queue and shown by the present invention.It is possible thereby to which video is shown into user in time, the experience of user is improved.
It the foregoing is only embodiments of the invention; it is not intended to limit the scope of the invention; every equivalent structure made using description of the invention and accompanying drawing content or equivalent flow conversion; or other related technical areas are directly or indirectly used in, it is included within the scope of the present invention.

Claims (3)

1. a kind of display terminal, it is characterised in that the display terminal includes:
Receiving module, screen video data is passed for receiving;
Packet acquisition module, shield packet corresponding to video data for obtaining described pass;
First memory module, waited for the packet to be stored in decoding queue;
Packet extraction module, for extracting the packet from the wait decoding queue;
Judge module, for judging whether the quantity of the packet is more than default threshold value;
Processing module, during for the result that judges in the judge module to be, extract the reference data of the next packet of the corresponding current video sequence in the packet, and control the packet extraction module to continue to extract the packet, and the judge module continues to judge whether the quantity of the packet is more than default threshold value;
The result that the judge module judges as it is no when, the packet is decoded.
2. display terminal according to claim 1, it is characterised in that the display terminal further comprises the second memory module, for being directly stored in decoded data etc. in queue to be shown.
3. display terminal according to claim 2, it is characterised in that the display terminal further comprises display module, and the display module is used to take out the decoded data from the display queue and directly shown.
CN201610370608.2A 2016-05-29 2016-05-29 A kind of display terminal Pending CN107438197A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610370608.2A CN107438197A (en) 2016-05-29 2016-05-29 A kind of display terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610370608.2A CN107438197A (en) 2016-05-29 2016-05-29 A kind of display terminal

Publications (1)

Publication Number Publication Date
CN107438197A true CN107438197A (en) 2017-12-05

Family

ID=60458219

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610370608.2A Pending CN107438197A (en) 2016-05-29 2016-05-29 A kind of display terminal

Country Status (1)

Country Link
CN (1) CN107438197A (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013007395A1 (en) * 2011-07-13 2013-01-17 Pierre-Alain Cotte Methods and devices for switching on or switching to a digital video signal with little delay
CN103297772A (en) * 2013-05-02 2013-09-11 深圳市比维视创科技有限公司 Method and system for processing transmission screen image and display equipment
CN103546802A (en) * 2013-10-15 2014-01-29 深圳Tcl新技术有限公司 Method for dynamically adjusting cache and display terminal
CN104113777A (en) * 2014-08-01 2014-10-22 广州金山网络科技有限公司 Audio stream decoding method and device
US20160134931A1 (en) * 2014-11-12 2016-05-12 Bing Song Method and apparatus for reducing latency in multi-media system
CN105847946A (en) * 2016-05-28 2016-08-10 刘健文 Screen transmission video processing method
CN105847971A (en) * 2016-05-28 2016-08-10 刘健文 Method for processing screen transmission video
CN105872728A (en) * 2016-05-28 2016-08-17 刘健文 Screen transfer video processing method for multi-screen interaction

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013007395A1 (en) * 2011-07-13 2013-01-17 Pierre-Alain Cotte Methods and devices for switching on or switching to a digital video signal with little delay
CN103297772A (en) * 2013-05-02 2013-09-11 深圳市比维视创科技有限公司 Method and system for processing transmission screen image and display equipment
CN103546802A (en) * 2013-10-15 2014-01-29 深圳Tcl新技术有限公司 Method for dynamically adjusting cache and display terminal
CN104113777A (en) * 2014-08-01 2014-10-22 广州金山网络科技有限公司 Audio stream decoding method and device
US20160134931A1 (en) * 2014-11-12 2016-05-12 Bing Song Method and apparatus for reducing latency in multi-media system
CN105847946A (en) * 2016-05-28 2016-08-10 刘健文 Screen transmission video processing method
CN105847971A (en) * 2016-05-28 2016-08-10 刘健文 Method for processing screen transmission video
CN105872728A (en) * 2016-05-28 2016-08-17 刘健文 Screen transfer video processing method for multi-screen interaction

Similar Documents

Publication Publication Date Title
KR102002835B1 (en) Method, computer program, reception apparatus, and information providing apparatus for trigger compaction
US9961398B2 (en) Method and device for switching video streams
WO2017063399A1 (en) Video playback method and device
CN110557670B (en) Method, device, terminal and storage medium for playing video in webpage
CN105847946A (en) Screen transmission video processing method
CN105872728A (en) Screen transfer video processing method for multi-screen interaction
US8707151B2 (en) Apparatus and method for composing scenes using Rich Media contents
KR20150020520A (en) Extensions to trigger parameters table for interactive television
CN112930687B (en) Media stream processing method and device, storage medium and program product
CN103475927B (en) Online-video real-time speed change play method and system thereof
US9298601B2 (en) Conditional processing method and apparatus
CN108769816A (en) A kind of video broadcasting method, device and storage medium
KR101525248B1 (en) Method and apparatus for providing rich-media service
CN102223539A (en) Processing method for splash screen caused by picture coding frame loss
CN107438199A (en) One kind passes screen video display terminal
CN104581340B (en) Client, stream medium data method of reseptance and stream medium data transmission system
CN105847971A (en) Method for processing screen transmission video
CN103581741B (en) Special effect play equipment and method
EP2453651A1 (en) Method, terminal and server for processing graphics
CN107438198A (en) A kind of display terminal for being used to pass screen video
KR20100131365A (en) Server and terminal for reducing zapping delay and method thereof
CN107438197A (en) A kind of display terminal
US9350796B2 (en) Method and device for receiving multimedia data
CN106817619A (en) One kind identification video pause state, the method for improving OTT video quality monitoring accuracies
US11870831B2 (en) Method and apparatus for playing multimedia streaming data

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20171205