CN106817614A - Audio frequency and video frame losing device and method - Google Patents
Audio frequency and video frame losing device and method Download PDFInfo
- Publication number
- CN106817614A CN106817614A CN201710045496.8A CN201710045496A CN106817614A CN 106817614 A CN106817614 A CN 106817614A CN 201710045496 A CN201710045496 A CN 201710045496A CN 106817614 A CN106817614 A CN 106817614A
- Authority
- CN
- China
- Prior art keywords
- frame per
- video
- frame
- time
- frames
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
- H04N21/4342—Demultiplexing isochronously with video sync, e.g. according to bit-parallel or bit-serial interface formats, as SDI
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4305—Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
Abstract
The invention discloses a kind of audio frequency and video frame losing device, described device includes：Acquisition module, for the time difference between the audio frame time and video frame time at real-time or timing acquisition currently playing moment；Judge module, if being more than or equal to preset duration for the absolute value of the time difference, judges that whether the preset duration is the preset multiple of the display duration of unit frame of video comprising B frames in the video；Determining module, if for including B frames in the video, the first frame per second and current the second frame per second for carrying out video playback according to currently playing video source file determine to abandon the time interval of the B frames in video；First discard module, for abandoning B frames according to the time interval, so that the frame per second of video source file reaches the current frame per second for carrying out video playback.The invention also discloses a kind of audio frequency and video frame losing method.The present invention can realize the output synchronization of adjustment audio frequency and video by abandoning on B frames of the video playback without influence.
Description
Technical field
The present invention relates to video playback field, more particularly to a kind of audio frequency and video frame losing device and method.
Background technology
In the mobile Internet epoch, with popularizing for intelligent terminal, the sound that user constantly pursues high-quality regards body
Test, high compression ratio, code check high, high-resolution, multichannel, lossless source of sound turn into video standard configuration gradually, user regards to multimedia
The image quality requirement more and more higher of frequency.
Integration testing difference file type, the video of type of coding are generally needed when the video player of intelligent terminal is developed
Source, and identical type of coding different stage, different configuration of video source, to meet the diversity of user's audio-video source.Due to
Constrained by hardware performance, be difficult to reach in video playback required by source file FPS (Frames Per Second, depending on
Frequency play frame rate), frame-skipping phenomenon just then occurs when playing so that audio frequency and video are asynchronous.
The content of the invention
It is a primary object of the present invention to propose a kind of audio frequency and video frame losing device and method, it is intended to which solution exists in the prior art
Frame-skipping phenomenon just occurs during broadcasting so that the nonsynchronous technical problem of audio frequency and video.
To achieve the above object, the present invention provides a kind of audio frequency and video frame losing device, and described device includes：
Acquisition module, between the audio frame time and video frame time at real-time or timing acquisition currently playing moment
Time difference；
Judge module, if for the time difference absolute value be more than or equal to preset duration, judge be in the video
It is no comprising B frames, the preset duration is the preset multiple of the display duration of unit frame of video；
Determining module, if for including B frames in the video, the first frame per second according to currently playing video source file with
And current the second frame per second for carrying out video playback determines to abandon the time interval of the B frames in video；
First discard module, for abandoning B frames according to the time interval, so that the frame per second of video source file reaches currently
Carry out the frame per second of video playback.
Alternatively, the determining module includes：
Determining unit, for determining the 3rd frame per second that terminal is supported according to the performance of terminal chip；
Judging unit, for judging second frame per second whether less than the 3rd frame per second；
Adjustment unit, for when second frame per second is more than or equal to three frame per second, increasing to the 3rd frame per second
Plus preset increments, to update the 3rd frame per second；
The judging unit, is additionally operable to, when second frame per second is less than three frame per second, judge second frame per second
With preset value and whether be more than the 3rd frame per second；
First computing unit, for second frame per second and preset value and during less than or equal to three frame per second,
The average value of second frame per second and the 3rd frame per second is calculated, and is calculated according to the average value and first frame per second
The time interval；
The adjustment unit, be additionally operable to second frame per second and preset value and during more than three frame per second, to institute
State the 3rd frame per second and subtract the preset increments, to update the 3rd frame per second.
Alternatively, described device also includes：
Playing module, if for not having B frames in video, playing next I frames.
Alternatively, described device also includes：
Contrast module, for real time contrast's current system reproduction time and actual play time；
Second discard module, when the time difference for current system reproduction time and actual play time is default more than first
Between when, then abandon video source file in B frames；
The playing module, is additionally operable to current system reproduction time and is preset more than second with the time difference of actual play time
During the time, then next I frames are played, wherein, first Preset Time is less than second Preset Time.
Alternatively, second discard module includes：
Second computing unit, for the second frame per second by currently playing video and the first of currently playing video source file
Frame per second calculates the B number of frames for needing to abandon；
Discarding unit, for abandoning corresponding B in video source file according to the B number of frames abandoned the need for being calculated
Frame.
Additionally, to achieve the above object, the present invention also provides a kind of audio frequency and video frame losing method, methods described includes following step
Suddenly：
The real-time or time difference between the audio frame time and video frame time at timing acquisition currently playing moment；
If the absolute value of the time difference is more than or equal to preset duration, whether judge in the video comprising B frames, it is described
Preset duration is the preset multiple of the display duration of unit frame of video；
If so, the first frame per second and current the second frame per second for carrying out video playback then according to currently playing video source file
It is determined that abandoning the time interval of the B frames in video；
B frames are abandoned according to the time interval, so that the frame per second of video source file reaches the current frame for carrying out video playback
Rate.
Alternatively, first frame per second according to currently playing video source file and currently the second of video playback is carried out
Frame per second determines that the step of abandoning the time interval of the B frames in video includes：
Performance according to terminal chip determines the 3rd frame per second that terminal is supported；
Judge second frame per second whether less than the 3rd frame per second；
When second frame per second is more than or equal to three frame per second, increase the 3rd frame per second preset increments with more
New 3rd frame per second, and continue executing with described the step of whether second frame per second is less than three frame per second judged；
Whether when second frame per second is less than three frame per second, judge second frame per second and preset value and it is more than
3rd frame per second；
Second frame per second and preset value and during less than or equal to three frame per second, calculate second frame per second with
And the average value of the 3rd frame per second, and the time interval is calculated according to the average value and first frame per second；
Second frame per second and preset value and during more than three frame per second, the 3rd frame per second is subtracted described pre-
If increment, to update the 3rd frame per second, and continue executing with and described judge second frame per second whether less than the 3rd frame per second
The step of.
Alternatively, it is described to judge also to include after the step of whether having B frames in video：
If there is no B frames in video, next I frames are played.
Alternatively, methods described also includes：
Real time contrast's current system reproduction time and actual play time；
When current system reproduction time is more than the first Preset Time with the time difference of actual play time, then video source is abandoned
B frames in file；
When current system reproduction time is more than the second Preset Time with the time difference of actual play time, then play next
I frames, wherein, first Preset Time is less than second Preset Time.
Alternatively, it is described abandon video source file in B frames the step of include：
Being calculated with the first frame per second of currently playing video source file by the second frame per second of currently playing video needs to abandon
B number of frames；
B number of frames according to being abandoned the need for being calculated abandons corresponding B frames in video source file.
Audio frequency and video frame losing device and method proposed by the present invention, by the audio at real-time or timing acquisition currently playing moment
Time difference between frame time and video frame time；When the absolute value of the time difference is more than or equal to preset duration, institute is judged
Whether state in video comprising B frames, wherein, the preset duration is the preset multiple of the display duration of unit frame of video；When described
When including B frames in video, the first frame per second and current the second frame for carrying out video playback according to currently playing video source file
Rate determines to abandon the time interval of the B frames in video, and abandons B frames according to the time interval, is lost by according to time interval
The mode of B frames is abandoned, the frame per second of video source file is reached the current frame per second for carrying out video playback, so as to realize the output of audio frequency and video
It is synchronous.
Brief description of the drawings
Fig. 1 is a kind of optional hardware architecture diagram of the mobile terminal for realizing each embodiment of the invention；
Fig. 2 is the radio communication device schematic diagram of mobile terminal as shown in Figure 1；
Fig. 3 is the high-level schematic functional block diagram of audio frequency and video frame losing device first embodiment of the present invention；
Fig. 4 is the refinement high-level schematic functional block diagram of determining module in audio frequency and video frame losing device 3rd embodiment of the present invention；
Fig. 5 is the high-level schematic functional block diagram of audio frequency and video frame losing device fourth embodiment of the present invention；
Fig. 6 is that the refinement functional module of the second discard module in the embodiment of audio frequency and video frame losing device the 5th of the present invention is illustrated
Figure；
Fig. 7 is the schematic flow sheet of audio frequency and video frame losing method first embodiment of the present invention；
Fig. 8 is the first frame per second according to currently playing video source file in audio frequency and video frame losing method 3rd embodiment of the present invention
And current the second frame per second for carrying out video playback determines that the refinement flow of the step of abandoning the time interval of the B frames in video is shown
It is intended to；
Fig. 9 is the schematic flow sheet of audio frequency and video frame losing method fourth embodiment of the present invention；
Figure 10 is the thin of the step of B frames in video source file are abandoned in the embodiment of audio frequency and video frame losing method the 5th of the present invention
Change schematic flow sheet.
The realization of the object of the invention, functional characteristics and advantage will be described further referring to the drawings in conjunction with the embodiments.
Specific embodiment
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
The mobile terminal of each embodiment of the invention is realized referring now to Description of Drawings.In follow-up description, use
For represent element such as " module ", " part " or " unit " suffix only for being conducive to explanation of the invention, itself
Not specific meaning.Therefore, " module " can be used mixedly with " part ".
Mobile terminal can be implemented in a variety of manners.For example, the terminal described in the present invention can include such as moving
Phone, smart phone, notebook computer, digit broadcasting receiver, PDA (personal digital assistant), PAD (panel computer), PMP
The mobile terminal of (portable media player), guider etc. and such as numeral TV, desktop computer etc. are consolidated
Determine terminal.Hereinafter it is assumed that terminal is mobile terminal.However, it will be understood by those skilled in the art that, except being used in particular for movement
Outside the element of purpose, construction according to the embodiment of the present invention can also apply to the terminal of fixed type.
Fig. 1 is that the hardware configuration of the mobile terminal for realizing each embodiment of the invention is illustrated.
Mobile terminal 1 00 can include wireless communication unit 110, A/V (audio/video) input block 120, user input
Unit 130, sensing unit 140, output unit 150, memory 160, interface unit 170, controller 180 and power subsystem 190
Etc..Fig. 1 shows the mobile terminal with various assemblies, it should be understood that being not required for implementing all groups for showing
Part.More or less component can alternatively be implemented.The element of mobile terminal will be discussed in more detail below.
Wireless communication unit 110 generally includes one or more assemblies, and it allows mobile terminal 1 00 and radio communication device
Or the radio communication between network.For example, wireless communication unit can include mobile communication module 112, wireless Internet mould
At least one of block 113.
Mobile communication module 112 sends radio signals to base station (for example, access point, node B etc.), exterior terminal
And at least one of server and/or receive from it radio signal.Such radio signal can be logical including voice
Words signal, video calling signal or the various types of data for sending and/or receiving according to text and/or Multimedia Message.
Wireless Internet module 113 supports the Wi-Fi (Wireless Internet Access) of mobile terminal.The module can be internally or externally
It is couple to terminal.Wi-Fi (Wireless Internet Access) technology involved by the module can include WLAN (WLAN) (Wi-Fi), Wibro
(WiMAX), Wimax (worldwide interoperability for microwave accesses), HSDPA (high-speed downlink packet access) etc..
User input unit 130 can generate key input data to control each of mobile terminal according to the order of user input
Plant operation.User input unit 130 allows the various types of information of user input, and can include keyboard, metal dome, touch
Plate (for example, detection due to being touched caused by resistance, pressure, electric capacity etc. change sensitive component), roller, rocking bar etc.
Deng.Especially, when touch pad is superimposed upon on display unit 151 in the form of layer, touch-screen can be formed.
Interface unit 170 is connected the interface that can pass through with mobile terminal 1 00 as at least one external device (ED).For example,
External device (ED) can include wired or wireless head-band earphone port, external power source (or battery charger) port, wired or nothing
Line FPDP, memory card port, the port for connecting the device with identification module, audio input/output (I/O) end
Mouth, video i/o port, ear port etc..Identification module can be that storage uses each of mobile terminal 1 00 for verifying user
Kind of information and subscriber identification module (UIM), client identification module (SIM), Universal Subscriber identification module (USIM) can be included
Etc..In addition, the device (hereinafter referred to as " identifying device ") with identification module can take the form of smart card, therefore, know
Other device can be connected via port or other attachment means with mobile terminal 1 00.Interface unit 170 can be used for reception and come from
The input (for example, data message, electric power etc.) of the external device (ED) and input that will be received is transferred in mobile terminal 1 00
One or more elements can be used for transmitting data between mobile terminal and external device (ED).
In addition, when mobile terminal 1 00 is connected with external base, interface unit 170 can serve as allowing by it by electricity
Power provides to the path of mobile terminal 1 00 from base or can serve as allowing the various command signals being input into from base to pass through it
It is transferred to the path of mobile terminal.Be can serve as recognizing that mobile terminal is from the various command signals or electric power of base input
The no signal being accurately fitted within base.Output unit 150 is configured to provide defeated with vision, audio and/or tactile manner
Go out signal (for example, audio signal, vision signal, alarm signal, vibration signal etc.).Output unit 150 can include display
Unit 151, dio Output Modules 152 etc..
Display unit 151 may be displayed on the information processed in mobile terminal 1 00.For example, when mobile terminal 1 00 is in electricity
During words call mode, display unit 151 can show and converse or other communicate (for example, text messaging, multimedia file
Download etc.) related user interface (UI) or graphic user interface (GUI).When mobile terminal 1 00 is in video calling pattern
Or during image capture mode, display unit 151 can show the image of capture and/or the image of reception, show video or figure
UI or GUI of picture and correlation function etc..
Meanwhile, when display unit 151 and touch pad in the form of layer it is superposed on one another to form touch-screen when, display unit
151 can serve as input unit and output device.Display unit 151 can include liquid crystal display (LCD), thin film transistor (TFT)
In LCD (TFT-LCD), Organic Light Emitting Diode (OLED) display, flexible display, three-dimensional (3D) display etc. at least
It is a kind of.Some in these displays may be constructed such that transparence to allow user to be watched from outside, and this is properly termed as transparent
Display, typical transparent display can be, for example, TOLED (transparent organic light emitting diode) display etc..According to specific
Desired implementation method, mobile terminal 1 00 can include two or more display units (or other display devices), for example, moving
Dynamic terminal can include outernal display unit (not shown) and inner display unit (not shown).Touch-screen can be used to detect touch
Input pressure and touch input position and touch input area.
Dio Output Modules 152 can mobile terminal be in call signal reception pattern, call mode, logging mode,
It is that wireless communication unit 110 is received or in memory 160 when under the isotypes such as speech recognition mode, broadcast reception mode
The voice data transducing audio signal of middle storage and it is output as sound.And, dio Output Modules 152 can be provided and movement
The audio output (for example, call signal receives sound, message sink sound etc.) of the specific function correlation that terminal 100 is performed.
Dio Output Modules 152 can include sound pick-up, buzzer etc..
Memory 160 can store software program for the treatment and control operation performed by controller 180 etc., Huo Zheke
Temporarily to store oneself data (for example, telephone directory, message, still image, video etc.) through exporting or will export.And
And, memory 160 can store the vibration of various modes on being exported when touching and being applied to touch-screen and audio signal
Data.
Memory 160 can include the storage medium of at least one type, and the storage medium includes flash memory, hard disk, many
Media card, card-type memory (for example, SD or DX memories etc.), random access storage device (RAM), static random-access storage
Device (SRAM), read-only storage (ROM), Electrically Erasable Read Only Memory (EEPROM), programmable read only memory
(PROM), magnetic storage, disk, CD etc..And, mobile terminal 1 00 can perform memory with by network connection
The network storage device cooperation of 160 store function.
The overall operation of the generally control mobile terminal of controller 180.For example, controller 180 is performed and voice call, data
Communication, video calling etc. related control and treatment.In addition, controller 180 can be included for reproducing (or playback) many matchmakers
The multi-media module 181 of volume data, multi-media module 181 can be constructed in controller 180, or can be structured as and control
Device 180 is separated.Controller 180 can be with execution pattern identifying processing, the handwriting input that will be performed on the touchscreen or picture
Draw input and be identified as character or image.
Power subsystem 190 receives external power or internal power under the control of controller 180 and provides operation each unit
Appropriate electric power needed for part and component.
Various implementation methods described herein can be with use such as computer software, hardware or its any combination of calculating
Machine computer-readable recording medium is implemented.Implement for hardware, implementation method described herein can be by using application-specific IC
(ASIC), digital signal processor (DSP), digital signal processing device (DSPD), programmable logic device (PLD), scene can
Programming gate array (FPGA), processor, controller, microcontroller, microprocessor, it is designed to perform function described herein
At least one in electronic unit is implemented, and in some cases, such implementation method can be implemented in controller 180.
For software implementation, the implementation method of such as process or function can with allow to perform the single of at least one function or operation
Software module is implemented.Software code can be come by the software application (or program) write with any appropriate programming language
Implement, software code can be stored in memory 160 and performed by controller 180.
So far, oneself according to its function through describing mobile terminal.Below, for the sake of brevity, will description such as folded form,
Slide type mobile terminal in various types of mobile terminals of board-type, oscillating-type, slide type mobile terminal etc. is used as showing
Example.Therefore, the present invention can be applied to any kind of mobile terminal, and be not limited to slide type mobile terminal.
Mobile terminal 1 00 as shown in Figure 1 may be constructed such that using via frame or packet transmission data it is all if any
Line and radio communication device and satellite-based communicator are operated.
The communicator that mobile terminal wherein of the invention can be operated is described referring now to Fig. 2.
Such communicator can use different air interface and/or physical layer.For example, used by communicator
Air interface includes such as frequency division multiple access (FDMA), time division multiple acess (TDMA), CDMA (CDMA) and universal mobile communications dress
Put (UMTS) (especially, Long Term Evolution (LTE)), global mobile communication device (GSM) etc..As non-limiting example, under
The description in face is related to cdma communication device, but such teaching is equally applicable to other types of device.
With reference to Fig. 2, cdma wireless communication device can include multiple mobile terminal 1s 00, multiple base station (BS) 270, base station
Controller (BSC) 275 and mobile switching centre (MSC) 280.MSC280 is configured to and Public Switched Telephony Network (PSTN)
290 form interface.MSC280 is also structured to form interface with the BSC275 that can be couple to BS270 via back haul link.Return
If any one in the interface that journey circuit can be known according to Ganji is constructed, the interface includes such as E1/T1, ATM, IP,
PPP, frame relay, HDSL, ADSL or xDSL.It will be appreciated that device can include multiple BSC275 as shown in Figure 2.
Each BS270 can service one or more subregions (or region), by multidirectional antenna or the day of sensing specific direction
Each subregion of line covering is radially away from BS270.Or, each subregion can be by two or more for diversity reception
Antenna is covered.Each BS270 may be constructed such that the multiple frequency distribution of support, and the distribution of each frequency has specific frequency spectrum
(for example, 1.25MHz, 5MHz etc.).
What subregion and frequency were distributed intersects can be referred to as CDMA Channel.BS270 can also be referred to as base station transceiver
Device (BTS) or other equivalent terms.In this case, term " base station " can be used for broadly representing single
BSC275 and at least one BS270.Base station can also be referred to as " cellular station ".Or, each subregion of specific BS270 can be claimed
It is multiple cellular stations.
As shown in Figure 2, broadcast singal is sent to broadcsting transmitter (BT) 295 mobile terminal operated in device
100.Broadcasting reception module 111 as shown in Figure 1 is arranged at mobile terminal 1 00 to receive the broadcast sent by BT295
Signal.In fig. 2 it is shown that several global pick device (GPS) satellites 300.Satellite 300 helps position multiple mobile terminals
At least one of 100.
In fig. 2, multiple satellites 300 are depicted, but it is understood that, it is possible to use any number of satellite is obtained
Useful location information.Location information module 115 as shown in Figure 1 is generally configured to coordinate to be thought with satellite 300
The location information wanted.Substitute GPS tracking techniques or outside GPS tracking techniques, it is possible to use mobile terminal can be tracked
Other technologies of position.In addition, at least one gps satellite 300 can optionally or additionally process satellite dmb transmission.
Used as a typical operation of radio communication device, BS270 receives the reverse link from various mobile terminal 1s 00
Signal.Mobile terminal 1 00 generally participates in call, information receiving and transmitting and other types of communication.Each of specific BS270 receptions is reverse
Link signal is processed in specific BS270.The data of acquisition are forwarded to the BSC275 of correlation.BSC provides call money
Source distribution and the mobile management function of the coordination including the soft switching process between BS270.The data that BSC275 will also be received
MSC280 is routed to, it provides the extra route service for forming interface with PSTN290.Similarly, PSTN290 with
MSC280 forms interface, and MSC and BSC275 form interface, and BSC275 correspondingly controls BS270 with by forward link signals
It is sent to mobile terminal 1 00.
Structure based on above-mentioned mobile terminal hardware configuration, communicator, proposes apparatus of the present invention and method each implementation
Example.
The present invention provides a kind of audio frequency and video frame losing device.
Reference picture 3, Fig. 3 is the high-level schematic functional block diagram of audio frequency and video frame losing device first embodiment of the present invention.
In the present embodiment, the audio frequency and video frame losing device includes：
Acquisition module 10, between the audio frame time and video frame time at real-time or timing acquisition currently playing moment
Time difference.
In the present embodiment, when the nonsynchronous situation of audio and video playing, and video occurs in the video of mobile terminal playing
Image decoding duration more than image display duration when, it is necessary to adjust the output of audio frequency and video.Audio frequency and video frame losing is opened in triggering first
The instruction of synchronization mechanism, mobile terminal according to it is described instruction in real time or the timing acquisition currently playing moment audio frame time and regard
Frequency frame time, and calculate the time difference between the audio frame time and video frame time at the currently playing moment.Compiled in video
In code sequence, mainly there are three kinds of coded frames：I frames, P frames, B frames.Wherein：I frames are Intra-codedpicture (intraframe coding figures
As frame), without reference to other picture frames, only encoded using the information of this frame.P frames are Predictive-codedPicture
(predictive-coded picture frame), I frames or P frames before, carries out inter prediction encoding by the way of motion prediction.B frames are
Bidirectionallypredictedpicture (bidirectionally predictive coded picture frame), there is provided highest compression ratio, it both needed
Picture frame (I frames or P frames) before, it is also desirable to later picture frame (P frames), carries out interframe two-way by the way of motion prediction
Predictive coding, generally, B frames are only used for the difference of minute book frame and front and rear frame, therefore in video display process, when going out
When now audio frequency and video are asynchronous, typically corresponding B frames in video are abandoned.
Judge module 20, if being more than or equal to preset duration for the absolute value of the time difference, in judging the video
Whether B frame is included, and the preset duration is the preset multiple of the display duration of unit frame of video.
In the present embodiment, first by the absolute value of the time difference between the audio frame time and video frame time with it is default
Duration is contrasted, and the preset duration is the preset multiple of the display duration of unit frame of video.If the absolute value of the time difference
More than or equal to preset duration, i.e., when audio/video frames difference preset multiple successive video frames display duration, described default times
Number can be the multiple of 2 times or other numerical value, and now people just may feel that audio frequency and video are asynchronous, then judge that now audio frequency and video are different
Step.Now need the output of adjustment audio frequency and video, it is therefore desirable to judge to whether there is on B frame of the video playback without influence in video,
To abandon the B frames.
Determining module 30, if for including B frames in the video, according to the first frame per second of currently playing video source file
And current the second frame per second for carrying out video playback determines to abandon the time interval of the B frames in video.
Specifically, if there are B frames in video, the first frame per second according to currently playing video source file and currently regarded
The second frame per second that frequency is played determines to abandon the time interval of the B frames in video.Specifically, it is determined that abandon video in B frames when
Between be spaced the step of can include：
Step one, the performance according to terminal chip determines the 3rd frame per second that terminal is supported；
Whether step 2, judge second frame per second less than the 3rd frame per second；
Step 3, when second frame per second is more than or equal to three frame per second, increases default to the 3rd frame per second
Increment, to update the 3rd frame per second, and continues executing with step 2；
Step 4, when second frame per second is less than three frame per second, judge second frame per second and preset value and
Whether the 3rd frame per second is more than；
Step 5, second frame per second and preset value and during less than or equal to three frame per second, calculate described the
The average value of two frame per second and the 3rd frame per second, and according between the average value and first frame per second calculating time
Every；
Step 6, second frame per second and preset value and during more than three frame per second, the 3rd frame per second is subtracted
The preset increments are removed, to update the 3rd frame per second, and step one is continued executing with.
First discard module 40, for abandoning B frames according to the time interval, so as to the frame per second of video source file reaches work as
Before carry out the frame per second of video playback.
After the time interval is calculated, B frames are abandoned according to the time interval, so that the frame of video source file
Rate reaches the current frame per second for carrying out video playback.
Audio frequency and video frame losing device proposed by the present invention, by the audio frame time at real-time or timing acquisition currently playing moment
And the time difference between video frame time；When the absolute value of the time difference is more than or equal to preset duration, the video is judged
In whether include B frames, wherein, the preset duration for unit frame of video display duration preset multiple；When in the video
During comprising B frames, the first frame per second and current the second frame per second for carrying out video playback according to currently playing video source file determine
The time interval of the B frames in video is abandoned, and B frames are abandoned according to the time interval, B frames are abandoned by according to time interval
Mode, makes the frame per second of video source file reach the current frame per second for carrying out video playback, so as to realize the output synchronization of audio frequency and video.
Further, reference picture 4, propose that audio frequency and video of the present invention are lost based on audio frequency and video frame losing device first embodiment of the present invention
Frame device second embodiment.
In the present embodiment, the determining module 30 includes：
Determining unit 31, for determining the 3rd frame per second that terminal is supported according to the performance of terminal chip；
Judging unit 32, for judging second frame per second whether less than the 3rd frame per second；
Adjustment unit 33, for when second frame per second is more than or equal to three frame per second, to the 3rd frame per second
Increase preset increments, to update the 3rd frame per second；
The judging unit 32, is additionally operable to, when second frame per second is less than three frame per second, judge second frame
Rate and preset value and whether more than the 3rd frame per second；
First computing unit 34, for second frame per second and preset value and less than or equal to the 3rd frame per second
When, the average value of second frame per second and the 3rd frame per second is calculated, and according to the average value and first frame per second
Calculate the time interval；
The adjustment unit 33, be additionally operable to second frame per second and preset value and during more than three frame per second, it is right
3rd frame per second subtracts the preset increments, to update the 3rd frame per second.
In the present embodiment, calculating the time interval specific steps for abandoning the B frames in video can be：
Step one, the performance according to terminal chip determines the 3rd frame per second that terminal is supported, specifically, the 3rd frame per second is
The frame per second that performance according to terminal chip directly determines, the frame per second supported described in different terminal chips generally not phase
Together, this is no longer going to repeat them；
Whether step 2, judge second frame per second less than the 3rd frame per second；
Step 3, when second frame per second is more than or equal to three frame per second, increases default to the 3rd frame per second
Increment, to update the 3rd frame per second, and continues executing with step 2；Specifically, the preset increments can be 1, specific implementation
During can also be using numerical value in addition to 1.
Step 4, when second frame per second is less than three frame per second, judge second frame per second and preset value and
Whether the 3rd frame per second is more than；Specifically, the preset value can be 5, can also be used in addition to 5 in specific implementation process
Numerical value.
Step 5, second frame per second and preset value and during less than or equal to three frame per second, calculate described the
The average value of two frame per second and the 3rd frame per second, and according between the average value and first frame per second calculating time
Every；Specifically, the method for calculating the time interval according to the average value and first frame per second is specially：By described
One frame per second is subtracted each other with the average value, difference is obtained, then by 1000 divided by the difference, you can obtain the time interval.
Step 6, second frame per second and preset value and during more than three frame per second, the 3rd frame per second is subtracted
The preset increments are removed, to update the 3rd frame per second, and step one is continued executing with.
The audio frequency and video frame losing device that the present embodiment is proposed, is calculated by first frame per second, the second frame per second and the second frame per second
Obtain abandoning the time interval of the B frames in video, precisely, in real time to be lost according to the time interval in subsequent play process
The B frames abandoned in video, so as to realize that accurate, real-time control is abandoned on B frame of the video playback without influence, to adjust audio-visual synchronization
Output.
Further, audio frequency and video frame losing device of the present invention the is proposed based on audio frequency and video frame losing device first embodiment of the present invention
Three embodiments.
In the present embodiment, described device also includes：
Playing module 50, if for not having B frames in video, playing next I frames.
In the present embodiment, if there is no B frames in video, need to play next I frames, it is same with the output for adjusting audio frequency and video
Step.
Further, reference picture 5, propose that audio frequency and video of the present invention are lost based on audio frequency and video frame losing device first embodiment of the present invention
Frame device fourth embodiment.
In the present embodiment, described device also includes：
Contrast module 60, for real time contrast's current system reproduction time and actual play time；
Second discard module 70, the time difference for current system reproduction time and actual play time presets more than first
During the time, then the B frames in video source file are abandoned；
The playing module 50, is additionally operable to current system reproduction time pre- more than second with the time difference of actual play time
If during the time, then playing next I frames, wherein, first Preset Time is less than second Preset Time.
In the present embodiment, when the buffer time of currently playing video is long, the nonsynchronous feelings of audio frequency and video also occur
Condition, therefore be also required to abandon the B frames in video, or next I frames are played, to realize that audio-visual synchronization is exported.Specifically, it is first
First real time contrast's current system reproduction time and actual play time；When current system reproduction time and actual play time
Between difference more than the first Preset Time when, then abandon video source file in B frames；When current system reproduction time and actual play
Between time difference when being more than the second Preset Time, then play next I frames, wherein, first Preset Time is less than described the
Two Preset Times.First Preset Time can be 100ms, and second Preset Time can be 500ms, be embodied
First Preset Time and second Preset Time can also be set to other values in journey.
The audio frequency and video frame losing device that the present embodiment is proposed, during by real time contrast's current system reproduction time and actual play
Between；When current system reproduction time is more than the first Preset Time with the time difference of actual play time, then video source file is abandoned
In B frames；When current system reproduction time is more than the second Preset Time with the time difference of actual play time, then play next
I frames, wherein, first Preset Time is less than second Preset Time, so as to realize that the audio-visual synchronization in video is exported.
Further, reference picture 6, propose that audio frequency and video of the present invention are lost based on audio frequency and video frame losing device fourth embodiment of the present invention
The embodiment of frame device the 5th.
In the present embodiment, second discard module 70 can include：
Second computing unit 71, for the second frame per second by currently playing video and the of currently playing video source file
One frame per second calculates the B number of frames for needing to abandon；
Discarding unit 72, for abandoning correspondence in video source file according to the B number of frames abandoned the need for being calculated
B frames.
In the present embodiment, can be by the second frame per second of currently playing video and the first of currently playing video source file
Frame per second calculates the B number of frames for needing to abandon, and is then lost in video source file according to the B number of frames abandoned the need for being calculated
Abandon corresponding B frames.Being calculated with the first frame per second of currently playing video source file by the second frame per second of currently playing video is needed
The B number of frames of discarding is existing current techique, and this is no longer going to repeat them.
The audio frequency and video frame losing device that the present embodiment is proposed, first by the second frame per second of currently playing video with it is currently playing
First frame per second of video source file calculates the B number of frames for needing to abandon；Then according to the B number of frames abandoned the need for being calculated
Corresponding B frames are abandoned in video source file, it is to avoid abandon excessive B frames, cause discontinuous and pause the phenomenon played.
The audio frequency and video frame losing device for being provided for a better understanding of the present invention, is briefly described audio frequency and video of the present invention and loses herein
Frame device location in audio/video player system, in audio/video player system application layer, including video player application journey
Sequence and media player include media player service in local ccf layer.Specifically multimedia framework is：To regard
Frequency data source file is exported to video file parsing module and parsed, and is then called by demultplexer, then defeated
Go out to need the B frames for abandoning, exported after being decoded finally by audio/video decoder.Verification audio frequency and video provided by the present invention are same
The frame losing device of step can be parsed to video file, abandon the B frames in video, and then realize that audio-visual synchronization is exported.
The present invention further provides a kind of audio frequency and video frame losing method.
Reference picture 7, Fig. 7 is the schematic flow sheet of audio frequency and video frame losing first embodiment of the present invention.
In the present embodiment, methods described includes：
Step S10, the real-time or time between the audio frame time and video frame time at timing acquisition currently playing moment
Difference.
In the present embodiment, when the nonsynchronous situation of audio and video playing, and video occurs in the video of mobile terminal playing
Image decoding duration more than image display duration when, it is necessary to adjust the output of audio frequency and video.Audio frequency and video frame losing is opened in triggering first
The instruction of synchronization mechanism, mobile terminal according to it is described instruction in real time or the timing acquisition currently playing moment audio frame time and regard
Frequency frame time, and calculate the time difference between the audio frame time and video frame time at the currently playing moment.Compiled in video
In code sequence, mainly there are three kinds of coded frames：I frames, P frames, B frames.Wherein：I frames are Intra-codedpicture (intraframe coding figures
As frame), without reference to other picture frames, only encoded using the information of this frame.P frames are Predictive-codedPicture
(predictive-coded picture frame), I frames or P frames before, carries out inter prediction encoding by the way of motion prediction.B frames are
Bidirectionallypredictedpicture (bidirectionally predictive coded picture frame), there is provided highest compression ratio, it both needed
Picture frame (I frames or P frames) before, it is also desirable to later picture frame (P frames), carries out interframe two-way by the way of motion prediction
Predictive coding, generally, B frames are only used for the difference of minute book frame and front and rear frame, therefore in video display process, when going out
When now audio frequency and video are asynchronous, typically corresponding B frames in video are abandoned.
Whether step S20, if the absolute value of the time difference is more than or equal to preset duration, judges included in the video
B frames, the preset duration is the preset multiple of the display duration of unit frame of video.
In the present embodiment, first by the absolute value of the time difference between the audio frame time and video frame time with it is default
Duration is contrasted, and the preset duration is the preset multiple of the display duration of unit frame of video.If the absolute value of the time difference
More than or equal to preset duration, i.e., when audio/video frames difference preset multiple successive video frames display duration, described default times
Number can be the multiple of 2 times or other numerical value, and now people just may feel that audio frequency and video are asynchronous, then judge that now audio frequency and video are different
Step.Now need the output of adjustment audio frequency and video, it is therefore desirable to judge to whether there is on B frame of the video playback without influence in video,
To abandon the B frames.
Step S30, if including B frames in the video, the first frame per second according to currently playing video source file and works as
Before carry out video playback the second frame per second determine abandon video in B frames time interval.
Specifically, if there are B frames in video, the first frame per second according to currently playing video source file and currently regarded
The second frame per second that frequency is played determines to abandon the time interval of the B frames in video.Specifically, it is determined that abandon video in B frames when
Between be spaced the step of can include：
Step one, the performance according to terminal chip determines the 3rd frame per second that terminal is supported；
Whether step 2, judge second frame per second less than the 3rd frame per second；
Step 3, when second frame per second is more than or equal to three frame per second, increases default to the 3rd frame per second
Increment, to update the 3rd frame per second, and continues executing with step 2；
Step 4, when second frame per second is less than three frame per second, judge second frame per second and preset value and
Whether the 3rd frame per second is more than；
Step 5, second frame per second and preset value and during less than or equal to three frame per second, calculate described the
The average value of two frame per second and the 3rd frame per second, and according between the average value and first frame per second calculating time
Every；
Step 6, second frame per second and preset value and during more than three frame per second, the 3rd frame per second is subtracted
The preset increments are removed, to update the 3rd frame per second, and step one is continued executing with.
Step S40, abandons B frames, so that the frame per second of video source file reaches currently carries out video according to the time interval
The frame per second of broadcasting.
After the time interval is calculated, B frames are abandoned according to the time interval, so that the frame of video source file
Rate reaches the current frame per second for carrying out video playback.
Audio frequency and video frame losing method proposed by the present invention, by the audio frame time at real-time or timing acquisition currently playing moment
And the time difference between video frame time；When the absolute value of the time difference is more than or equal to preset duration, the video is judged
In whether include B frames, wherein, the preset duration for unit frame of video display duration preset multiple；When in the video
During comprising B frames, the first frame per second and current the second frame per second for carrying out video playback according to currently playing video source file determine
The time interval of the B frames in video is abandoned, and B frames are abandoned according to the time interval, B frames are abandoned by according to time interval
Mode, makes the frame per second of video source file reach the current frame per second for carrying out video playback, so as to realize the output synchronization of audio frequency and video.
Further, reference picture 8, propose that audio frequency and video of the present invention are lost based on audio frequency and video frame losing method first embodiment of the present invention
Frame method second embodiment.
In the present embodiment, the step S30 includes：
Step S31, the performance according to terminal chip determines the 3rd frame per second that terminal is supported；
Whether step S32, judge second frame per second less than the 3rd frame per second；
Step S33, when second frame per second is more than or equal to three frame per second, increases default to the 3rd frame per second
Whether increment, to update the 3rd frame per second, and continue executing with and described judge second frame per second less than the 3rd frame per second
Step；
Step S34, when second frame per second is less than three frame per second, judge second frame per second and preset value and
Whether the 3rd frame per second is more than；
Step S35, second frame per second and preset value and during less than or equal to three frame per second, calculate described the
The average value of two frame per second and the 3rd frame per second, and according between the average value and first frame per second calculating time
Every；
Step S36, second frame per second and preset value and during more than three frame per second, the 3rd frame per second is subtracted
The preset increments are removed, to update the 3rd frame per second, and is continued executing with and described is judged second frame per second whether less than described
The step of three frame per second.
In the present embodiment, calculating the time interval specific steps for abandoning the B frames in video can be：
Step one, the performance according to terminal chip determines the 3rd frame per second that terminal is supported, specifically, the 3rd frame per second is
The frame per second that performance according to terminal chip directly determines, the frame per second supported described in different terminal chips generally not phase
Together, this is no longer going to repeat them；
Whether step 2, judge second frame per second less than the 3rd frame per second；
Step 3, when second frame per second is more than or equal to three frame per second, increases default to the 3rd frame per second
Increment, to update the 3rd frame per second, and continues executing with step 2；Specifically, the preset increments can be 1, specific implementation
During can also be using numerical value in addition to 1.
Step 4, when second frame per second is less than three frame per second, judge second frame per second and preset value and
Whether the 3rd frame per second is more than；Specifically, the preset value can be 5, can also be used in addition to 5 in specific implementation process
Numerical value.
Step 5, second frame per second and preset value and during less than or equal to three frame per second, calculate described the
The average value of two frame per second and the 3rd frame per second, and according between the average value and first frame per second calculating time
Every；Specifically, the method for calculating the time interval according to the average value and first frame per second is specially：By described
One frame per second is subtracted each other with the average value, difference is obtained, then by 1000 divided by the difference, you can obtain the time interval.
Step 6, second frame per second and preset value and during more than three frame per second, the 3rd frame per second is subtracted
The preset increments are removed, to update the 3rd frame per second, and step one is continued executing with.
The audio frequency and video frame losing method that the present embodiment is proposed, is calculated by first frame per second, the second frame per second and the second frame per second
Obtain abandoning the time interval of the B frames in video, precisely, in real time to be lost according to the time interval in subsequent play process
The B frames abandoned in video, so as to realize that accurate, real-time control is abandoned on B frame of the video playback without influence, to adjust audio-visual synchronization
Output.
Further, audio frequency and video frame losing method of the present invention the is proposed based on audio frequency and video frame losing method first embodiment of the present invention
Three embodiments.
In the present embodiment, methods described also includes：
If there is no B frames in video, next I frames are played.
In the present embodiment, if there is no B frames in video, need to play next I frames, it is same with the output for adjusting audio frequency and video
Step.
Further, reference picture 9, propose that audio frequency and video of the present invention are lost based on audio frequency and video frame losing method 3rd embodiment of the present invention
Frame method fourth embodiment.
In the present embodiment, methods described also includes：
S50, real time contrast's current system reproduction time and actual play time；
S60, when current system reproduction time is more than the first Preset Time with the time difference of actual play time, then abandons and regards
B frames in frequency source file；
S70, when current system reproduction time is more than the second Preset Time with the time difference of actual play time, then under playing
One I frame, wherein, first Preset Time is less than second Preset Time.
In the present embodiment, when the buffer time of currently playing video is long, the nonsynchronous feelings of audio frequency and video also occur
Condition, therefore be also required to abandon the B frames in video, or next I frames are played, to realize that audio-visual synchronization is exported.Specifically, it is first
First real time contrast's current system reproduction time and actual play time；When current system reproduction time and actual play time
Between difference more than the first Preset Time when, then abandon video source file in B frames；When current system reproduction time and actual play
Between time difference when being more than the second Preset Time, then play next I frames, wherein, first Preset Time is less than described the
Two Preset Times.First Preset Time can be 100ms, and second Preset Time can be 500ms, be embodied
First Preset Time and second Preset Time can also be set to other values in journey.
The audio frequency and video frame losing method that the present embodiment is proposed, during by real time contrast's current system reproduction time and actual play
Between；When current system reproduction time is more than the first Preset Time with the time difference of actual play time, then video source file is abandoned
In B frames；When current system reproduction time is more than the second Preset Time with the time difference of actual play time, then play next
I frames, wherein, first Preset Time is less than second Preset Time, so as to realize that the audio-visual synchronization in video is exported.
Further, reference picture 10, this is proposed based on any embodiment of audio frequency and video frame losing method first to fourth of the present invention
The embodiment of invention audio frequency and video frame losing method the 5th.
In the present embodiment, the step S60 includes：
Step S61, is calculated by the second frame per second of currently playing video with the first frame per second of currently playing video source file
Need the B number of frames for abandoning；
Step S62, corresponding B frames are abandoned according to the B number of frames abandoned the need for being calculated in video source file.
In the present embodiment, can be by the second frame per second of currently playing video and the first of currently playing video source file
Frame per second calculates the B number of frames for needing to abandon, and is then lost in video source file according to the B number of frames abandoned the need for being calculated
Abandon corresponding B frames.Being calculated with the first frame per second of currently playing video source file by the second frame per second of currently playing video is needed
The B number of frames of discarding is existing current techique, and this is no longer going to repeat them.
The audio frequency and video frame losing method that the present embodiment is proposed, first by the second frame per second of currently playing video with it is currently playing
First frame per second of video source file calculates the B number of frames for needing to abandon；Then according to the B number of frames abandoned the need for being calculated
Corresponding B frames are abandoned in video source file, it is to avoid abandon excessive B frames, cause discontinuous and pause the phenomenon played.
It should be noted that herein, term " including ", "comprising" or its any other variant be intended to non-row
His property is included, so that process, method, article or device including a series of key elements not only include those key elements, and
And also include other key elements being not expressly set out, or also include for this process, method, article or device institute are intrinsic
Key element.In the absence of more restrictions, the key element limited by sentence "including a ...", it is not excluded that including this
Also there is other identical element in the process of key element, method, article or device.
The embodiments of the present invention are for illustration only, and the quality of embodiment is not represented.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can add the mode of required general hardware platform to realize by software, naturally it is also possible to by hardware, but in many cases
The former is more preferably implementation method.Based on such understanding, technical scheme is substantially done to prior art in other words
The part for going out contribution can be embodied in the form of software product, and the computer software product is stored in a storage medium
In (such as ROM/RAM, magnetic disc, CD), including some instructions are used to so that a station terminal equipment (can be mobile phone, computer, clothes
Business device, or the network equipment etc.) perform method described in each embodiment of the invention.
The preferred embodiments of the present invention are these are only, the scope of the claims of the invention is not thereby limited, it is every to utilize this hair
Equivalent structure or equivalent flow conversion that bright specification and accompanying drawing content are made, or directly or indirectly it is used in other related skills
Art field, is included within the scope of the present invention.
Claims (10)
1. a kind of audio frequency and video frame losing device, it is characterised in that described device includes：
Acquisition module, for the time between the audio frame time and video frame time at real-time or timing acquisition currently playing moment
Difference；
Whether judge module, if being more than or equal to preset duration for the absolute value of the time difference, judges wrapped in the video
Frame containing B, the preset duration is the preset multiple of the display duration of unit frame of video；
Determining module, if for including B frames in the video, the first frame per second according to currently playing video source file and working as
Before carry out video playback the second frame per second determine abandon video in B frames time interval；
First discard module, for abandoning B frames according to the time interval, so as to the frame per second of video source file reaches currently carry out
The frame per second of video playback.
2. audio frequency and video frame losing device as claimed in claim 1, it is characterised in that the determining module includes：
Determining unit, for determining the 3rd frame per second that terminal is supported according to the performance of terminal chip；
Judging unit, for judging second frame per second whether less than the 3rd frame per second；
Adjustment unit, for when second frame per second is more than or equal to three frame per second, increasing pre- to the 3rd frame per second
If increment, to update the 3rd frame per second；
The judging unit, be additionally operable to second frame per second be less than three frame per second when, judge second frame per second with it is pre-
If value and whether be more than the 3rd frame per second；
First computing unit, for second frame per second and preset value and during less than or equal to three frame per second, calculate
The average value of second frame per second and the 3rd frame per second, and according to the average value and first frame per second are calculated
Time interval；
The adjustment unit, be additionally operable to second frame per second and preset value and during more than three frame per second, to described the
Three frame per second subtract the preset increments, to update the 3rd frame per second.
3. audio frequency and video frame losing device as claimed in claim 1, it is characterised in that described device also includes：
Playing module, if for not having B frames in video, playing next I frames.
4. audio frequency and video frame losing device as claimed in claim 1, it is characterised in that described device also includes：
Contrast module, for real time contrast's current system reproduction time and actual play time；
Second discard module, the time difference for current system reproduction time and actual play time is more than the first Preset Time
When, then abandon the B frames in video source file；
The playing module, is additionally operable to current system reproduction time and is more than the second Preset Time with the time difference of actual play time
When, then next I frames are played, wherein, first Preset Time is less than second Preset Time.
5. audio frequency and video frame losing device as claimed in claim 4, it is characterised in that second discard module includes：
Second computing unit, for the first frame per second of the second frame per second by currently playing video and currently playing video source file
Calculate the B number of frames for needing to abandon；
Discarding unit, for abandoning corresponding B frames in video source file according to the B number of frames abandoned the need for being calculated.
6. a kind of audio frequency and video frame losing method, it is characterised in that the described method comprises the following steps：
The real-time or time difference between the audio frame time and video frame time at timing acquisition currently playing moment；
If the absolute value of the time difference is more than or equal to preset duration, judge whether comprising B frames in the video, it is described default
Duration is the preset multiple of the display duration of unit frame of video；
If so, the first frame per second and current the second frame per second for carrying out video playback then according to currently playing video source file determines
Abandon the time interval of the B frames in video；
B frames are abandoned according to the time interval, so that the frame per second of video source file reaches the current frame per second for carrying out video playback.
7. audio frequency and video frame losing method as claimed in claim 6, it is characterised in that described according to currently playing video source file
First frame per second and current the second frame per second for carrying out video playback determine that the step of abandoning the time interval of the B frames in video is wrapped
Include：
Performance according to terminal chip determines the 3rd frame per second that terminal is supported；
Judge second frame per second whether less than the 3rd frame per second；
When second frame per second is more than or equal to three frame per second, increase the 3rd frame per second preset increments to update
State the 3rd frame per second, and continue executing with described the step of whether judge second frame per second less than three frame per second；
When second frame per second is less than three frame per second, judge second frame per second and preset value and described in whether being more than
3rd frame per second；
Second frame per second and preset value and during less than or equal to three frame per second, calculate second frame per second and institute
The average value of the 3rd frame per second is stated, and the time interval is calculated according to the average value and first frame per second；
Second frame per second and preset value and during more than three frame per second, the default increasing is subtracted to the 3rd frame per second
Amount, to update the 3rd frame per second, and continues executing with and described judges the step whether second frame per second is less than the 3rd frame per second
Suddenly.
8. audio frequency and video frame losing method as claimed in claim 7, it is characterised in that the step for judging whether to have B frames in video
Also include after rapid：
If there is no B frames in video, next I frames are played.
9. the audio frequency and video frame losing method as described in claim any one of 6-8, it is characterised in that methods described also includes：
Real time contrast's current system reproduction time and actual play time；
When current system reproduction time is more than the first Preset Time with the time difference of actual play time, then the video source is abandoned
B frames in file；
When current system reproduction time is more than the second Preset Time with the time difference of actual play time, then next I frames are played,
Wherein, first Preset Time is less than second Preset Time.
10. audio frequency and video frame losing method as claimed in claim 9, it is characterised in that the B in the discarding video source file
The step of frame, includes：
The B frames for needing to abandon are calculated with the first frame per second of currently playing video source file by the second frame per second of currently playing video
Quantity；
B number of frames according to being abandoned the need for being calculated abandons corresponding B frames in video source file.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710045496.8A CN106817614B (en) | 2017-01-20 | 2017-01-20 | Audio and video frame loss device and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710045496.8A CN106817614B (en) | 2017-01-20 | 2017-01-20 | Audio and video frame loss device and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106817614A true CN106817614A (en) | 2017-06-09 |
| CN106817614B CN106817614B (en) | 2020-08-04 |
Family
ID=59111194
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710045496.8A Active CN106817614B (en) | 2017-01-20 | 2017-01-20 | Audio and video frame loss device and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106817614B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112073823A (en) * | 2020-09-02 | 2020-12-11 | 深圳创维数字技术有限公司 | Frame loss processing method, video playing terminal and computer readable storage medium |
| CN113473229A (en) * | 2021-06-25 | 2021-10-01 | 荣耀终端有限公司 | Method for dynamically adjusting frame loss threshold and related equipment |
| CN114257857A (en) * | 2022-01-04 | 2022-03-29 | 海信视像科技股份有限公司 | Display device and video double-speed playing method |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050276282A1 (en) * | 2004-06-09 | 2005-12-15 | Lsi Logic Corporation | Method of audio-video synchronization |
| CN103310820A (en) * | 2012-03-14 | 2013-09-18 | 三星电子（中国）研发中心 | Method for optimizing multimedia player |
| CN103856812A (en) * | 2014-03-25 | 2014-06-11 | 北京奇艺世纪科技有限公司 | Video playing method and device |
| CN104822008A (en) * | 2014-04-25 | 2015-08-05 | 腾讯科技（北京）有限公司 | Video synchronizing method and device |
| CN105933800A (en) * | 2016-04-29 | 2016-09-07 | 联发科技（新加坡）私人有限公司 | Video play method and control terminal |
-
2017
- 2017-01-20 CN CN201710045496.8A patent/CN106817614B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050276282A1 (en) * | 2004-06-09 | 2005-12-15 | Lsi Logic Corporation | Method of audio-video synchronization |
| CN103310820A (en) * | 2012-03-14 | 2013-09-18 | 三星电子（中国）研发中心 | Method for optimizing multimedia player |
| CN103856812A (en) * | 2014-03-25 | 2014-06-11 | 北京奇艺世纪科技有限公司 | Video playing method and device |
| CN104822008A (en) * | 2014-04-25 | 2015-08-05 | 腾讯科技（北京）有限公司 | Video synchronizing method and device |
| CN105933800A (en) * | 2016-04-29 | 2016-09-07 | 联发科技（新加坡）私人有限公司 | Video play method and control terminal |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112073823A (en) * | 2020-09-02 | 2020-12-11 | 深圳创维数字技术有限公司 | Frame loss processing method, video playing terminal and computer readable storage medium |
| CN112073823B (en) * | 2020-09-02 | 2022-07-12 | 深圳创维数字技术有限公司 | Frame loss processing method, video playing terminal and computer readable storage medium |
| CN113473229A (en) * | 2021-06-25 | 2021-10-01 | 荣耀终端有限公司 | Method for dynamically adjusting frame loss threshold and related equipment |
| CN114257857A (en) * | 2022-01-04 | 2022-03-29 | 海信视像科技股份有限公司 | Display device and video double-speed playing method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106817614B (en) | 2020-08-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106603543B (en) | Correct the synchronous method and device of stream medium audio and video | |
| CN105677231B (en) | Associated application split screen display available device, method and terminal | |
| CN105718027B (en) | The management method and mobile terminal of background application | |
| CN104866265B (en) | Multi-media file display method and device | |
| CN106990828A (en) | A kind of apparatus and method for controlling screen display | |
| CN105357593B (en) | A kind of methods, devices and systems of uploaded videos | |
| CN106658174A (en) | Video decoding terminal and method | |
| CN105100434B (en) | The multi-functional implementation method and mobile terminal of key | |
| CN106507173A (en) | Mobile terminal and split screen display available control method | |
| CN104915127B (en) | A kind of membrane keyboard method to set up and device and mobile terminal | |
| CN105357367B (en) | Recognition by pressing keys device and method based on pressure sensor | |
| CN105827866A (en) | Mobile terminal and control method | |
| CN106210277A (en) | Mobile terminal call device and method, system | |
| CN106713640B (en) | A kind of brightness adjusting method and equipment | |
| CN106598457A (en) | Sound playing control method and device and terminal | |
| CN106406737A (en) | A screen operating method and device and a mobile terminal | |
| CN106448665A (en) | Voice processing device and method | |
| CN106817614A (en) | Audio frequency and video frame losing device and method | |
| CN104731508B (en) | Audio frequency playing method and device | |
| CN106341687A (en) | Method and device for locating video decoding abnormality | |
| CN107426282A (en) | A kind of picture loading method, terminal and server | |
| CN106534915A (en) | Mobile terminal, and television broadcasting method by mobile terminal | |
| CN105635837B (en) | A kind of video broadcasting method and device | |
| CN105117751B (en) | Two-dimentional decoding transmission method and device | |
| CN107018559A (en) | Component processor is set to enter the terminal and method of resting state |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20200706 Address after: Yuyao City, Zhejiang province 315400 Ningbo Zhongyi Ningbo ecological park Hing Rd No. 28 Applicant after: ZHEJIANG RUIHUA KANGYUAN TECHNOLOGY Co.,Ltd. Address before: 518057 Guangdong Province, Shenzhen high tech Zone of Nanshan District City, No. 9018 North Central Avenue's innovation building A, 6-8 layer, 10-11 layer, B layer, C District 6-10 District 6 floor Applicant before: NUBIA TECHNOLOGY Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |