CN108833975A - The processing method and processing device of video playing - Google Patents
The processing method and processing device of video playing Download PDFInfo
- Publication number
- CN108833975A CN108833975A CN201810668619.8A CN201810668619A CN108833975A CN 108833975 A CN108833975 A CN 108833975A CN 201810668619 A CN201810668619 A CN 201810668619A CN 108833975 A CN108833975 A CN 108833975A
- Authority
- CN
- China
- Prior art keywords
- video image
- resolution format
- frame
- resolution
- format
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012545 processing Methods 0.000 title description 87
- 238000003672 processing method Methods 0.000 title description 13
- 238000006243 chemical reaction Methods 0.000 claims abstract description 93
- 238000000034 method Methods 0.000 claims abstract description 72
- 230000008569 process Effects 0.000 claims abstract description 54
- 238000012544 monitoring process Methods 0.000 claims abstract description 12
- 239000013589 supplement Substances 0.000 claims description 3
- 238000005516 engineering process Methods 0.000 abstract description 5
- 230000008859 change Effects 0.000 description 17
- 238000010586 diagram Methods 0.000 description 14
- 230000000694 effects Effects 0.000 description 7
- 230000006870 function Effects 0.000 description 6
- 230000001360 synchronised effect Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 230000009467 reduction Effects 0.000 description 4
- 230000007704 transition Effects 0.000 description 4
- 230000009466 transformation Effects 0.000 description 3
- HUTDUHSNJYTCAR-UHFFFAOYSA-N ancymidol Chemical compound C1=CC(OC)=CC=C1C(O)(C=1C=NC=NC=1)C1CC1 HUTDUHSNJYTCAR-UHFFFAOYSA-N 0.000 description 2
- 230000003139 buffering effect Effects 0.000 description 2
- 238000003780 insertion Methods 0.000 description 2
- 230000037431 insertion Effects 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
- H04N21/234363—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/426—Internal components of the client ; Characteristics thereof
- H04N21/42653—Internal components of the client ; Characteristics thereof for processing graphics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440218—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Graphics (AREA)
- Television Systems (AREA)
- Controls And Circuits For Display Device (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The present invention provides a kind of TV, belong to field of display technology, its system on chip SOC, it notifies the third resolution format of decoded 1st frame video image to give frame-rate conversion module FRC, the variation of the third resolution format of video image described in every frame after monitoring, if the third resolution format for monitoring M frame video image is different from the third resolution format of previous frame video image, the third resolution format of the M frame video image is notified to give frame-rate conversion module FRC；The frame-rate conversion module FRC is notified according to the system on chip SOC, calls resolution format conversion process algorithm corresponding to third resolution format after changing, and carries out resolution format conversion to the M frame video image.There is no blank screen problems by the present invention.
Description
The application is on 03 18th, 2016 entitled " processing method and processing devices of video playing " proposed
The divisional application of state's application for a patent for invention 201610158743.0.
Technical field
The present invention relates to field of communication technology more particularly to a kind of processing method and processing devices of video playing.
Background technique
With the development of TV tech, more and more users use TV as the terminal device of viewing video.User
When carrying out video on demand using television set, it is frequently encountered the change due to network speed, is caused in video display process
The problems such as Caton, blank screen or delay.
Fig. 1 is existing video playing processing flow schematic diagram.Because there is real-time change in network bandwidth,
In order to cope with the variation of network bandwidth, in same video program, the background server of some video playback websites can exist
The signal source of the various resolution ratio such as 480P/720P/1080I/1080P/2160P, in video display process, background server meeting
Corresponding video format is pushed according to the actual network bandwidth of user, satisfaction does not have data buffering in user's watching process,
The problem of Caton, delay；As shown in Figure 1, the signal that server end is sent is by the decoder module in SOC chip（Decoder）Solution
Become a frame frame image after code and is sent to image procossing（VDP/DDP）Module carries out image quality（Picture Quality, abbreviation PQ）Place
Reason is then passed to display processing（Scaler）Module does scaling processing（Upscaler or Downscaler processing）Such as it counts
The difference operation calculated between pixel and pixel goes out new pixel, is finally fed to display screen processing, processes in entire
Cheng Zhong, signal are to handle one by one（F1 as shown in figure 1）, when encountering has change resolution, Display processing module just needs to do
Corresponding algorithm process, and the scaling algorithm in Display processing module according to resolution adjustment this during be to need when
Between handle（Usually replaced with the spacing wave of the blank screen signal of 2 to 3 frames of insertion or present frame）, since display handles mould
Block directly drives timer/counter control register (Timer Control Register, the abbreviation of rear class display screen
TCON), replaced in the time that this section is exported without signal using blank screen signal.
In actual resolution ratio conversion process, frame per second can only be for example handled in order to avoid SOC chip processing bandwidth is limited
Or code rate is in 30Hz input signal below, and encounters that algorithm changeover is carried out when input signal change resolution is more time-consuming
So that blank screen signal etc. must not be not inserted into, the frame per second conversion FRC chip of higher height reason ability may be added（Frame Rate
Converter abbreviation FRC）Corresponding algorithm process is carried out, if but the reasons such as network bandwidth make the video into SOC
The resolution ratio of signal changes, if decoded video image is directly output to FRC by the SOC of front end, due to needing
It can finally be provided to the Pixel Clock of the video image of display screen（Pixel clock）It can be in point of the SOC video image exported
It changes when resolution difference, such as clock cycle of 1920 × 1080 60Hz is 148.5MHz, 3840 × 2160 60Hz
Clock cycle be 597MHz, then FRC also needs again while the resolution ratio for handling vision signal and display screen is unified
Synchronised clock, this process similarly need the long period, also can inevitably there is the phenomenon that blank screen.
Therefore, problem of the prior art is either to handle separately through SOC chip, or increase at the assistance of FRC chip
Reason, in the change resolution for encountering input signal, all can inevitably have blank screen.
Summary of the invention
The present invention provides a kind of processing method and processing device of video playing, to overcome point when vision signal in the prior art
Resolution can have blank screen when changing.
In a first aspect, a kind of TV of the present invention, including：System on chip SOC, by the of decoded 1st frame video image
Three resolution formats notify to give frame-rate conversion module FRC, the third resolution format of video image described in every frame after monitoring
Variation, if monitor M frame video image third resolution format and previous frame video image third resolution format not
Together, then the third resolution format of the M frame video image is notified to give frame-rate conversion module FRC；The frame-rate conversion mould
Block FRC is notified according to the system on chip SOC, calls the conversion of resolution format corresponding to third resolution format after changing
Processing Algorithm carries out resolution format conversion to the M frame video image；
For compared with prior art, unified resolution format is carried out to the video image exported after decoding and is converted, is converted into
The video image of the 4th unified resolution format, i.e., since the video image for being converted into the 4th resolution ratio is by non-effective picture
The filling of vegetarian refreshments is all unified for the 4th resolution ratio, that is, for FRC, the output of the vision signal of SOC be it is stable, i.e.,
Needing to export will not change to the Pixel Clock pixel clock of display screen, and also there is no need to FRC to carry out clock accordingly
Synchronous processing, while the view is known in advance before carrying out corresponding resolution format conversion to video image in FRC
The third resolution format of frequency image, therefore the treatment process time is shorter, further to cause because of video to be played
Resolution ratio change caused by blank screen the technical issues of improved.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is this hair
Bright some embodiments for those of ordinary skill in the art without any creative labor, can be with
It obtains other drawings based on these drawings.
Fig. 1 is existing video playing processing flow schematic diagram；
Fig. 2 is the flow chart of one embodiment of processing method of video playing of the present invention；
Fig. 3 is the processing flow schematic diagram of one embodiment of processing method of video playing of the present invention；
Fig. 4 is the video image resolution format transition diagram in one embodiment of the method for the present invention；
Fig. 5 is the video image resolution format transition diagram in another embodiment of the method for the present invention；
Fig. 6 is the structural schematic diagram of one embodiment of processing unit of video playing of the present invention；
Fig. 7 is the structural schematic diagram of one embodiment of TV of the present invention.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is
A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art
Every other embodiment obtained without creative efforts, shall fall within the protection scope of the present invention.
The processing method of the video playing of the embodiment of the present invention can be applied to TV, mobile phone, PC（PC）, plate
In apparatus such as computer, to solve the above problems, mainly illustrate how in the following embodiments of the present invention by signal processing mode
Change, come when guaranteeing that vision signal resolution ratio changes without blank screen, without Caton, no-delay buffering show.
Fig. 2 is the flow chart of one embodiment of processing method of video playing of the present invention.Fig. 3 is the place of video playing of the present invention
The processing flow schematic diagram of one embodiment of reason method.Fig. 4 is the video image resolution format in one embodiment of the method for the present invention
Transition diagram.As shown in Fig. 2, the present embodiment is applied to come in TV for example, side with the processing method of the video playing
Method includes：
Step 201 obtains the corresponding decoded video image of video to be played；
If step 202, the code rate of video to be played or frame per second are less than or equal to preset value, by every frame video image
Resolution format be converted to before the matched second resolution format of display screen, when every frame video image resolution format with
When first resolution format mismatching, the resolution format of every frame video image is converted into first resolution format；
Wherein, be converted to includes effective pixel points and being copied by effective pixel points in the video image of first resolution format
Pixel；Effective pixel points are the pixel in the video image before conversion；
If step 203, the code rate of video to be played or frame per second are greater than preset value, in the third resolution ratio lattice of video image
When formula and the 4th resolution format mismatch, the third resolution format of video image is converted into the 4th resolution format；
The third resolution format for the video image that step 204, basis obtain in advance, is converted into the view of the 4th resolution format
The resolution format of frequency image is converted to and the matched second resolution format of display screen；
Wherein, be converted to includes effective pixel points and non-effective pixel in the video image of the 4th resolution format；Effective picture
Vegetarian refreshments is the pixel in the video image before conversion.
In the present embodiment, can also include step 201 before step 202 and 203 ', that is, determine the code of video to be played
The relationship of rate or frame per second, the not no tandem of the step and step 201 first carries out step 201 for those skilled in the art ',
Executing step 201 afterwards equally can solve technical problem of the invention, reach corresponding technical effect.
Specifically, the same video content in server may preserve different resolution format（Its frame per second will not be sent out
Changing, the only difference of resolution ratio）, including but not limited to following several, every kind of resolution ratio corresponds to one mode：
3840 × 2160 --- -- modes 1
2880 × 1440 --- -- modes 2
2560 × 1440 --- -- modes 3
1920 × 1080 --- -- modes 4
1280 × 720 --- -- modes 5
720 × 576 --- -- modes 6
640 × 480 --- -- mode 7s
320 × 240 --- -- modes 8
When playing out processing, the corresponding decoded video image of video to be played of user's request is first obtained；It can be with
It is that decoder module is decoded acquisition video image in Fig. 3；
The video to be played obtained can be server according to the network bandwidth active push of active user with active user's
The vision signal of the matched resolution format of network bandwidth, be also possible to SOC according to the network bandwidth of the active user of monitoring to
The vision signal with the matched resolution format of network bandwidth of active user of server request.
Determine the code rate or frame per second of the video, it is assumed that the bandwidth of format converting module can only support 300MHz in Fig. 3, then
If video to be played is 3840 × 2160 resolution ratio, frame per second 30Hz, or, frame per second is the view of all resolution formats of 60Hz
Frequently, code rate or frame per second are less than or equal to a preset value at this time, then are handled using the method for step 202, treatment process is such as
Under（Using the treatment process in path 1）：
It is matched with display screen being converted to the resolution format of every frame video image for decoded video image
Before second resolution format, when the resolution format of every frame video image and first resolution format mismatching, to every frame
Video image successively carries out resolution format conversion, is unified for first resolution format, Fig. 3 illustrate only 3 frame video image F1,
F2, F3, video image after conversion F1 ' as shown in Figure 3, F2 ', F3 ', the video image of remaining frame is similar, will be decoded
All video images successively carry out resolution format conversion.
Wherein, transformation rule can simply be replicated the effective pixel points in original video image.
Since video source can pass through the decoded view of decoder according to the network bandwidth real-time transform resolution ratio of user
The resolution ratio of frequency image is skimble-scamble in different moments, it is therefore desirable to be processed into unified first point by format converting module
Resolution format.
For example, first resolution format is assumed to be 3840 × 2160, the resolution format of decoded video image is mould
Formula 4 then needs the video image by 1920 × 1080 resolution ratio to be converted to the video image of 3840 × 2160 resolution ratio, specifically may be used
To be to generate 2160 row pixels, and by treated by the way that the pixel of every a line in original video image is replicated 1 row respectively
The pixel of each column in video image replicates 3 rows, generates 3840 column pixels, is ultimately converted to 3840 × 2160 video figure
Picture；In other embodiments of the present invention, resolution format conversion can also be carried out by other means, the present invention to this not
It limits.
As shown in figure 4, two frame video images resolution format above is 1920 × 1080, first resolution format is also
1920 × 1080, the 3rd frame video image resolution format is 1280 × 720, and first resolution format is 1920 × 1080, then will
3rd frame video image carries out resolution format conversion and then exports progress image quality processing again.
Alternatively, first resolution format is assumed to be 3840 × 2160, the resolution format of decoded video image is different,
Assuming that the resolution format of preceding 3 frame video image, which starts resolution format for the 1, the 4th frame of mode, becomes mode 4, then first divided
The resolution format of the resolution format and several frame video images in front is carried out unification, although at this time by the conversion of resolution format
Certain processing time is needed, but since transformation rule is relatively simple, processing speed is very fast, then passes through image procossing VDP/
The resolution ratio of vision signal after DDP module, Display processing module, display screen be it is stable, not will cause in playing process because
Resolution ratio blank screen problem caused after changing.
Since the bandwidth of the Display processing module in the SOC of front end is limited to 300MHz（SOC processing capacity is limited）, Zhi Nengzhi
4K × 2K@30Hz is held, therefore is unable to satisfy the requirement of the resolution ratio and display screen adaptation of the signal of higher frame per second 60Hz, for
The vision signal of such high frame per second or code rate can increase before exporting to display screen on the basis of above-mentioned SOC scheme
The stronger block diagram of frame rate converter of processing capacity（Frame Rate Converter abbreviation FRC）Carry out corresponding algorithm process, but
If being that the reasons such as network bandwidth make the resolution ratio into the vision signal of SOC change, if after the SOC of front end will be decoded
Video image be directly output to FRC if, the Pixel Clock of the video image due to needing can finally be provided to display screen
（Pixel clock）It can change when the resolution ratio difference of the SOC video image exported, such as 1920 × 1080 60Hz
Clock cycle is 148.5MHz, and the clock cycle of 3840 × 2160 60Hz is 597MHz, then FRC in processing vision signal and
Re-synchronization clock is also needed while the resolution ratio of display screen is unified, this process similarly needs the long period, also can not
Evitable the phenomenon that there are blank screens.
Therefore, in the embodiment of the present invention, when video to be played be 3840 × 2160 resolution ratio, frame per second 60Hz, at this time
Code rate or frame per second are greater than corresponding default code rate or preset frame rate, then using step 203, the method for step 204 at
Reason, treatment process are as follows（Using the treatment process in path 2）：
For decoded video image, decoder module can monitor the variation of the third resolution format of video image, solution
The third resolution format of 1st frame video image is notified FRC by code module, if subsequent decoding module monitors that resolution ratio becomes
When change, the third resolution format of the video image can be notified the algorithm for carrying out resolution format conversion to FRC prepare；Specifically
The mark of third resolution format can be sent to FRC；Third resolution format and fourth resolution ratio of the SOC in video image
When format mismatching, the third resolution format of video image is converted into the 4th resolution format.I.e. by every frame video figure
As being sent to before FRC, resolution format conversion is successively carried out to every frame video image, is unified for the 4th resolution format, Fig. 3
3 frame video image F1, F2, F3 are illustrated only, the F1 ' as shown in Figure 3 of the video image after conversion, F2 ', F3 ', the view of remaining frame
Frequency image is similar, and decoded all video images are successively carried out resolution format conversion.
Wherein, transformation rule can be by with the pixel of the 4th resolution format difference supplement for black pixel point or other
Non-effective pixel is converted into the video image of the 4th resolution format.
4th resolution ratio can be the resolution ratio of a certain format preset, such as the 4th resolution ratio can be preset as 1920
× 1080, the third resolution format of the video image obtained after subsequent decoding requires to match with the 4th resolution format, if
It mismatches, then needs the third resolution format of video image being converted to the 4th resolution format；It can certainly be basis
Get what the corresponding resolution format of decoded video image determined, for example, video source is corresponding when initially playing out
The resolution format of video image can be 1920 × 1080, can set the resolution ratio to the 4th resolution ratio, occur in bandwidth
When variation, the resolution format of possible video source will do it adjustment, be likely to become 720 × 576 formats, and video image is corresponding at this time
720 × 576 format of third resolution ratio it is different from 1920 × 1080 format of the 4th resolution ratio, it is therefore desirable to by current third point
720 × 576 format of resolution is converted to 1920 × 1080 format of the 4th resolution ratio.
Since video source can pass through the decoded view of decoder according to the network bandwidth real-time transform resolution ratio of user
The resolution ratio of frequency image in different moments be it is skimble-scamble, in order to guarantee to export to the Pixel Clock's of the video image of FRC
It is unified, to avoid blank screen phenomenon, it is therefore desirable to be processed into the 4th unified resolution format by SOC.
Then, for the every frame video image being sequentially output in SOC, according to the third of the video image obtained in advance point
Resolution format carries out conversion process to the 4th resolution format of the video image, is differentiated with obtaining with display screen matched second
Rate format.Here it can be and prenotice when getting decoded video image to FRC's.
Specifically, as shown in figure 3, Display processing module successively can carry out resolution ratio lattice to decoded video image
Formula conversion process obtains the video image of the 4th resolution format；Then the video image after conversion process is exported to FRC
Resolution format conversion process is carried out again；By FRC according to the mark for the resolution format known in advance（Such as Mode Index）
It calls corresponding algorithm to be handled, is processed into and the matched second resolution format of display screen；Wherein, the 4th resolution format
It can be the resolution ratio of display screen；Rear end FRC uniformly does respective handling again；FRC can be carried out according to image scaling interpolation algorithm
Resolution format conversion.
For example, it is assumed to be 3840 × 2160 with the matched second resolution format of display screen, decoded video image
Third resolution format is mode 4, then as shown in figure 4, the video image of 1920 × 1080 resolution ratio can be converted to 3840
The video image of × 2160 resolution ratio specifically can be using 1920 × 1080 original image as effective pixel points, then will
3840 × 2160 resolution ratio other parts are supplemented completely using black pixel point；In other embodiments of the present invention, also
Resolution format conversion process can be carried out by other means, and the present invention does not limit this.
When carrying out resolution format conversion process in FRC, specifically it can be between original video image neighbor pixel
The mode conversion resolution format of one new pixel of filling is calculated by interpolation algorithm；In other embodiments of the present invention
In, resolution format conversion can also be carried out by other algorithms, the present invention does not limit this.
Image scaling interpolation algorithm, including such as linear interpolation algorithm, arest neighbors interpolation algorithm, bilinear interpolation value-based algorithm
Deng.
Alternatively, it is assumed to be 3840 × 2160 with the matched second resolution format of display screen, decoded video image
Third resolution format is 320 × 240 or 1280 × 720, then can be first by third resolution ratio lattice in Display processing module
Formula is converted to the 4th resolution format 1920 × 1080, is then output to FRC, carries out final resolution format by FRC and converts
Processing, to obtain the video image with the matched second resolution format of display screen.
It is exemplified below：
Video to be played just start play when, by decoding after, the third resolution format of video image can be notified to
FRC has known the third resolution format of the video image before FRC receives the video image, in order to FRC calling
Corresponding Processing Algorithm carries out the conversion of resolution format；The video image of cache module output can pass through image procossing VDP/
The Color control of DDP module（Color Manager）, noise reduction, clarity, supersolution picture, the image quality effect process such as gamma Gamma,
Display processing module can be using the video image after process image quality effect process as valid pixel, while will differentiate with the 4th
The pixel supplement of rate format differences is black pixel point or other non-effective pixels, is converted into the video of the 4th resolution format
Image；Later, in block diagram of frame rate converter（FRC）It is middle that corresponding effective pixel points are obtained according to the third resolution format of present frame,
And according to the matched second resolution format of display screen, successively the video image that exports in the Display processing module is carried out
Corresponding resolution format conversion process, is processed into and the matched second resolution format of display screen；We assume that the of the 4th frame
Three resolution formats change to be mismatched with the 4th resolution format, and decoder module can for example pass through universal serial bus
（Inter-Integrated Circuit, abbreviation I2C）Or Serial Peripheral Interface (SPI)（Serial Peripheral
Interface, abbreviation SPI）FRC, FRC is notified to obtain the third resolution format of the 4th frame through high speed serialization V-By-One interface
After getting third resolution format, when receiving the video image of the 4th frame of Display processing module output, corresponding point is called
The corresponding algorithm of resolution format carries out resolution format conversion process；In the whole process, FRC is got from Display processing module
Video image and FRC to display screen signal resolution be always it is stable, pixel clock is unified, and FRC is right
Before video image carries out resolution format conversion, the third resolution format of the video image is known in advance, because herein
It is shorter to manage process time, not will cause the blank screen problem because caused by changing the resolution ratio of video to be played.
In the present embodiment, if in the case that the FRC of rear end can only realize 2 times of Upscaler processing, with display screen
The resolution format matched is assumed to be 3840 × 2160, and the resolution format of decoded video image is mode 5,6,7,8, then needs
Resolution format conversion is carried out before issuing cache module, and the unified conversion of resolution format is adjusted to 1920 × 1080
Resolution format can realize resolution format conversion by the way that effective pixel points are carried out duplication at this time, then in cache module
Display processing module pre-processes after output, other are consistent with above scheme；If 12 times of Upscaler may be implemented in FRC
Processing, can directly be realized with above scheme.
The processing method of video playing provided in this embodiment, by obtaining decoded video image, if then described
Code rate or frame per second are less than or equal to preset value, then are converted to and display screen by the resolution format of video image described in every frame
Before matched second resolution format, the resolution format and first resolution format mismatching of the video image described in every frame
When, the resolution format of video image described in every frame is converted into first resolution format, due to being converted to and display screen
The resolution format of video image have been unified before the second resolution format matched, conversion process is relatively easy,
Only effective pixel points are replicated, and when being converted to second resolution format matched with display screen due to being not necessarily to
Switch format conversion algorithms, the processing time is shorter, therefore does not have to insertion blank screen signal and not will cause and broadcast compared with prior art
Blank screen problem caused by after changing during putting because of resolution ratio；If the code rate or frame per second are greater than preset value,
When the third resolution format of video image and the 4th resolution format mismatch, the third resolution format of video image is turned
It is changed to the 4th resolution format；According to the third resolution format of the video image obtained in advance, it is converted into the 4th resolution ratio
The resolution format of the video image of format is converted to and the matched second resolution format of display screen；Compared with prior art and
Speech carries out unified resolution format to the video image exported after decoding and converts when code rate or frame per second are greater than preset value,
It is converted into the video image of the 4th unified resolution format, i.e., since the video image for being converted into the 4th resolution ratio is by non-
The filling of effective pixel points, so that it is all unified for the 4th resolution ratio being converted into before the matched second resolution of display screen,
Namely for FRC, the output of the vision signal of SOC be it is stable, that is, need to export to the Pixel Clock picture of display screen
Plain clock will not change, and also there is no need to FRC to carry out the synchronous processing of clock accordingly, while in FRC to video figure
As the third resolution format of the video image being known in advance, because herein before carrying out corresponding resolution format conversion
It is shorter to manage process time, further makes the skill of blank screen caused by causing the resolution ratio because of video to be played to change
Art problem is improved.
On the basis of the above embodiments, the resolution format of every frame video image is converted to and display screen matched
Two resolution formats can specifically be realized in the following way：
According to image scaling interpolation algorithm, the first resolution format of every frame video image after conversion is converted to and display screen
Matched second resolution format.
For example, it is assumed to be 3840 × 2160 with the matched second resolution format of display screen, unified first resolution lattice
Formula is mode 4, then the video image by 1920 × 1080 resolution ratio is needed to be converted to the video image of 3840 × 2160 resolution ratio,
It specifically can be the mode for calculating one new pixel of filling by interpolation algorithm between original video image neighbor pixel
Conversion resolution format；In other embodiments of the present invention, resolution format conversion can also be carried out by other algorithms, this
Invention does not limit this.
Image scaling interpolation algorithm, including such as linear interpolation algorithm, arest neighbors interpolation algorithm, bilinear interpolation value-based algorithm
Deng.
Alternatively, being assumed to be 1920 × 1080 with the matched second resolution format of display screen, first resolution format is mould
The video image of first resolution format is then carried out image resolution ratio conversion Downscaler processing, by resolution format by formula 1
Be converted to mode 4.
In the embodiment of the present invention, due to being converted to before the matched second resolution format of display screen, will it divide
Resolution format is unified, therefore the video letter after image procossing VDP/DDP module, Display processing module, display screen
Number resolution ratio be stable, the blank screen problem caused by not will cause after changing in playing process because of resolution ratio.
On the basis of the above embodiments, after the resolution format of every frame video image being converted to first resolution format,
Further include：
For every frame video image after conversion, it is converted into the P of first resolution format1Frame video image is successively stored in
In one cache module；Wherein, P1For positive integer；
By the resolution format of every frame video image be converted to the matched second resolution format of display screen, including：
The every frame video image at the uniform velocity exported from the first cache module is obtained, and the first resolution format of video image is turned
Turn to second resolution format；
The resolution format of every frame video image is converted to after the matched second resolution format of display screen, further includes：
Every frame video image after being converted into second resolution format is output to display screen.
Specifically, for the video image after conversion, first by the 1st frame to P1Frame video image successively saves
In the first cache module；The function of first cache module can be by wherein, P1It is P for positive integer, such as Fig. 3 value1=3。
Then, to the N+ P for being subsequently converted to first resolution format1Frame video image, when will be saved in cache module
Conversion after the output of nth frame video image after, i.e., the frame number of the video image saved in cache module is less than P1When, by N+
P1Frame video image is stored in cache module；For example, N is initially 1, P1=3,3 frame video images are saved in the first cache module,
Then after the 1st frame video image output saved in the first cache module, the 4th frame video image is stored in the first caching mould
In block；N adds 1, repeats above-mentioned steps, until all video images are all exported.
Wherein, P1The comprehensive decision of capacity that can start the buffer time played and cache module according to real image, due to
The conversion time of different resolution format is different, image≤P of the first cache module1Frame.
The purpose being stored in the first cache module is to guarantee have several frame video images to deposit always inside the first cache module
, although this is because first resolution format convert when it is smaller for time difference required for different resolution formats,
But the picture frame after handling certain amount, still there is regular hour difference on different resolution；Therefore from N+ P1Frame
Start to be handled frame by frame, and the output situation of the video image according to the storage of subsequent first cache module, storage to first
In cache module, as long as being less than P in i.e. the first cache module1Frame video image, the N+ P that just will newly handle1Frame is put into first
In cache module, guarantee there is 1 to P in the first cache module eventually always1Frame video image.
The main function of first cache module is delayed to the video image after unified resolution format conversion
It deposits, P can be stored simultaneously1Frame video image, and by video image, with certain rate, at the uniform velocity output is given one by one in real time
Subsequent each functional processing module.
In the present embodiment, due to saving the video image after a certain number of conversions in the first cache module, even if after
It is continuous format processing time it is longer when, first the video image in the first cache module can also be exported, and not have to
It is inserted into blank screen signal, compared with prior art, the blank screen caused by not will cause after changing in playing process because of resolution ratio
Problem.
Further, before being second resolution format by the first resolution format conversion of video image, further include：
Image quality processing is carried out to the every frame video image at the uniform velocity exported from the first cache module.
Specifically, the every frame video image at the uniform velocity exported in the first cache module is successively subjected to Color control（Color
Manager）, noise reduction, clarity, supersolution picture, the image quality effect process such as gamma Gamma；As shown in figure 3, VDP/DDP is at image
Module is managed, the video image for exporting to cache module carries out Color Manager, noise reduction, clarity, supersolution picture, Gamma
Etc. image quality effect process；
Display processing module, the video image for exporting to image processing module carry out optional frame-rate conversion, motion compensation
And electric light conversion processing, so that video image is finally shown at screen end；
Display screen（Panel）It can be liquid crystal screen module, control register comprising timer/counter（TCON）, panel etc..
The method and step 201-203 of above-described embodiment can realize that step 204 can be realized in FRC in SOC.
On the basis of the above embodiments, further, it can also be proceeded as follows before step 203 after step 201：
For decoded every frame video image, by decoded P2Frame video image is successively stored in the second cache module；
Wherein, P2For positive integer；
Corresponding, step 203 can specifically be realized in the following way：
Every frame video image at the uniform velocity exporting from the second cache module is obtained, in the third resolution format of video image and the
When four resolution formats mismatch, the third resolution format of video image is converted to the 4th resolution ratio lattice by system on chip SOC
Formula.
Specifically, for decoded video image, first by the 1st frame to P2Frame video image successively saves
In the second cache module；The function of second cache module can be realized by the function of the cache module in Fig. 3；Wherein, P2For
Positive integer, such as Fig. 3 value are P2=3。
Then, to the every frame video image at the uniform velocity exported in the second cache module, in the third resolution ratio lattice of video image
When formula and the 4th resolution format mismatch, the Display processing module of system on chip SOC is by the third resolution ratio lattice of video image
Formula is converted to the 4th resolution format.
After the nth frame video image output that will be saved in the second cache module, i.e. the view that saves in the second cache module
The frame number of frequency image is less than P2When, by N+ P2Frame video image is stored in the second cache module；For example, N is initially 1, P2=
3,3 frame video images are saved in the second cache module, the 1st frame video image output then saved in the second cache module
Afterwards, the 4th frame video image is stored in the second cache module；N adds 1, repeats above-mentioned steps, until by all video figures
As all exporting.
Wherein, P2It can start the comprehensive decision of capacity of the buffer time played and the second cache module according to real image,
Since the conversion time of different resolution format is different, image≤P of the second cache module2Frame.
The purpose being stored in the second cache module is to guarantee have several frame video images to deposit always inside the second cache module
, although this is because resolution format convert when it is smaller for time difference required for different resolution formats,
Picture frame after handling certain amount, still there is regular hour difference on different resolution；Therefore from N+ P2Frame starts
It is handled frame by frame, and the output situation of the video image according to the storage of subsequent second cache module, storage to the second caching
In module, as long as being less than P in i.e. the second cache module2Frame video image, the N+ P that just will newly handle2Frame is put into the second caching
In module, guarantee there is 1 to P in the second cache module eventually always2Frame video image.
The main function of second cache module is cached to by the decoded video image of decoder module, can be simultaneously
Store P2Frame video image（Such as F1, F2, F3）, and in real time at the uniform velocity export video image one by one with certain rate
To subsequent each functional processing module；
Specifically, as shown in figure 3, Display processing module can successively carry out the video image exported in the second cache module
Resolution format conversion process obtains the video image of the 4th resolution format；Then by the video image after conversion process
It exports to FRC and carries out resolution format conversion process again；By FRC according at least P2The mark for the resolution format brought before frame
Know（Such as Mode Index）It calls corresponding algorithm to be handled, is processed into and the matched second resolution format of display.
Fig. 5 is the video image resolution format transition diagram in another embodiment of the method for the present invention.In above-described embodiment
On the basis of, further, step 204 can specifically be realized in the following way：
FRC is according to the third resolution format of the video image obtained in advance from the video image for being converted to the 4th resolution format
Middle extraction effective pixel points, and the 4th resolution format of video image is converted to and the matched second resolution lattice of display screen
Formula.
Specifically, the Display processing module of SOC successively carries out conversion pretreatment to decoded every frame video image,
When the corresponding third resolution format of nth frame video image and the 4th resolution format mismatch, Display processing module is to nth frame
Video image carries out conversion of resolution processing, to obtain the N ' frame video image after conversion process, and exports to FRC processing；
Specifically can be the 4th resolution format such as is 3840 × 2160,1920 × 1080 video image that will be exported after decoding
As effective pixel points, then 3840 × 2160 resolution ratio other parts are supplemented completely using black pixel point.
FRC calls corresponding algorithm to carry out resolution format conversion process according to the resolution format of prior notice, specifically
Way is：According to the corresponding third resolution format of the N ' frame video image of acquisition, to the N ' frame video after conversion process
Image carries out reduction treatment, obtains the effective pixel points in the N ' frame video image, and according to effective pixel points and and display screen
Matched second resolution format carries out resolution format conversion process to effective pixel points, is processed into consistent with display screen
Second resolution format.
In the present embodiment, nth frame and the N ' frame are the same frame in time series, and only image itself changes.
For example, as shown in figure 3, there is the Processing Algorithm of different resolution format in FRC, for example aforementioned reality of resolution format
Apply the mode 1-8 of example.As shown in fig. 5, it is assumed that the video image third resolution format and the 4th resolution ratio of cache module output
Format mismatching after can then first passing through Display processing module pretreatment, then issues FRC processing, and FRC is according to third resolution ratio lattice
Formula handles the pretreated video image of Display processing module, is processed into and the matched second resolution lattice of display screen
Formula, it is Display processing module treated video image that the image on the left side is corresponding in Fig. 5, and the right is FRC treated video
Image.
As shown in figure 5, the first resolution format of a frame video image above is 2560 × 1440, second resolution format
Be the 3840 × 2160, the 2nd frame video image first resolution format be 3840 × 2160, second resolution format be 3840 ×
2160。
Further, in the present embodiment, it can also be proceeded as follows before step 205：
System on chip SOC notifies the first resolution format of decoded 1st frame video image to give frame-rate conversion module FRC；
For subsequent every frame video image, SOC monitors the situation of change of the third resolution format of video image, if monitoring
The third resolution format of M frame video image is different from the third resolution format of M-1 frame video image, then by M frame
The third resolution format of video image notifies to give frame-rate conversion module FRC, so that the FRC is receiving M frame video figure
As when got the third resolution format of M frame video image in advance；
Wherein, M is the positive integer greater than 1.
Specifically, after the decoder module of SOC monitors that the third resolution format of the video image of source changes,
Third resolution format of the I2C or SPI after V-By-One interface notification FRC variation, i.e. notice FRC video figure can be passed through
The third resolution format of picture, in order to which FRC can call phase after the video image for receiving Display processing module output
The processing method answered converts the resolution format of video image.The main function of FRC is exactly the video figure that will be received
As restoring original effective resolution ratio, and the video image is converted into the consistent view of second resolution format with display screen
Frequency image.
It in the present embodiment, before issuing FRC, is pre-processed in Display processing module, the main purpose done so
Be guarantee into FRC video image resolution ratio be it is fixed, any variation will not occur, pixel clock is unified；It is false
If the 4th resolution format is 3840 × 2160, and the resolution format of decoded nth frame video image is 1920 × 1080,
The 4th resolution format 3840 × 2160 then is uniformly processed into the nth frame video image, this process is not to video figure
As itself doing resolution format conversion Upscaler processing, but using original video image as effective pixel points, as 3840 ×
2160 a part, when the resolution ratio of original video image be lower than 3840 × 2160 when, remaining part black pixel point or its
His non-effective pixel substitutes, such as the left-half in Fig. 5.
Or, it is assumed that the 4th resolution format is 3840 × 2160, and the resolution format of decoded video image is
3840 × 2160, and be assumed to be 1920 × 1080 with the matched second resolution format of display screen, then in Display processing module
It can be not processed and be directly output to FRC, resolution format conversion process is carried out by FRC（Downscaler processing）, to obtain
With the video image of the matched second resolution format of display screen.
It is mismatched assuming that the third resolution format of the 4th frame changes with the 4th resolution format, then at this time actually
System is handling F1, and decoder module can for example be differentiated the third of the 4th frame through V-By-One interface by I2C or SPI
Rate format notifies FRC, after FRC gets third resolution format, in the video for the 4th frame for receiving Display processing module output
When image, call corresponding Processing Algorithm to resolution format conversion process；In the whole process from Display processing module to
The signal resolution of FRC, FRC to display screen be always it is stable, pixel clock is unified, and FRC is to video image
Before carrying out resolution format conversion, 3 frames know the third resolution format of the video image, therefore treatment process in advance
Time is shorter, not will cause the blank screen problem because caused by changing the resolution ratio of video to be played.
The processing method of video playing provided in this embodiment, by by the first resolution format of the 1st frame video image
And it is subsequent when monitoring that third resolution format changes, it is synchronous by the third resolution format of video image notify to
FRC carries out algorithm preparation；Decoded video image is successively stored in the second cache module, so as to protect in the second cache module
The picture frame number deposited is P2；Then Display processing module successively differentiates the video image exported in the second cache module
Rate format conversion processing obtains the video image of the 4th resolution format, and the video image after conversion process is exported to FRC
It is handled, by FRC according at least P2The third resolution format brought before frame calls corresponding algorithm to be handled；With it is existing
There is technology in comparison, unified resolution format is carried out to the video image exported after decoding and is converted, is converted into unified the
The video image of four resolution formats, i.e., since the video image for being converted into the 4th resolution ratio is filling out by non-effective pixel
It fills, so that being all unified for the 4th resolution ratio, that is, for FRC being converted into before the matched second resolution of display screen
For, the output of the vision signal of SOC be it is stable, that is, needing to export will not send out to the Pixel Clock pixel clock of display screen
Changing, also there is no need to FRC to carry out the synchronous processing of clock accordingly, while carry out accordingly in FRC to video image
Before resolution format conversion, know the third resolution format of the video image in advance, thus the treatment process time compared with
Short, the technical issues of further making blank screen caused by causing the resolution ratio because of video to be played to change, is changed
It is kind.
In above-described embodiment, the module before FRC is all the module in SOC.
On the basis of the above embodiments, further, in the present embodiment before step 101, can also carry out as follows
Operation：
Monitor the network bandwidth of active user；
The corresponding decoded video image of video to be played is then obtained, can specifically be realized in the following way：
Obtain the video to be played of resolution format corresponding with the network bandwidth of active user；
Processing is decoded to video to be played, obtains decoded video image.
Specifically, in this example, it is assumed that the resolution format of current video image such as mode 1, and at this time
User network bandwidth is not enough to play the video of the resolution format, then SOC can be according to the Netowrk tape of the active user monitored
Width requests the video to be played of resolution format corresponding with the network bandwidth of active user to server, so as to avoid view
There is Caton phenomenon in frequency playing process.
Optionally, in the present embodiment, step 101 can also be realized in the following way：
Receive the video to be played of the resolution format corresponding with the network bandwidth of active user of server push；
Processing is decoded to video to be played, obtains decoded video image.
Specifically, server end can push the video of corresponding resolution format according to the network bandwidth of user, thus
It avoids and occurs Caton phenomenon in video display process.
The resolution format of current video image such as mode 1, and user network bandwidth at this time is not enough to play this point
The video of resolution format, then server end can push the video of corresponding resolution format according to the network bandwidth of user.
Fig. 6 is the structural schematic diagram of one embodiment of processing unit of video playing of the present invention.As shown in fig. 6, the view of the present embodiment
Frequency play processing unit, may include：Decoder module, format converting module, the first Display processing module and frame-rate conversion mould
Block；
Decoder module, for obtaining the corresponding decoded video image of video to be played；
Format converting module is being incited somebody to action if the code rate or frame per second for the video to be played are less than or equal to preset value
The resolution format of video image described in every frame be converted to before the matched second resolution format of display screen, described in every frame
When the resolution format and first resolution format mismatching of video image, the resolution format of video image described in every frame is turned
It is changed to the first resolution format；
Wherein, be converted to includes effective pixel points and being copied by effective pixel points in the video image of first resolution format
Pixel；The effective pixel points are the pixel in the video image before conversion；
First Display processing module, if the code rate or frame per second for the video to be played are greater than preset value, described
When the third resolution format of video image and the 4th resolution format mismatch, by the third resolution ratio lattice of the video image
Formula is converted to the 4th resolution format；Frame-rate conversion module, for the third according to the video image obtained in advance
Resolution format, the resolution format for being converted into the video image of the 4th resolution format are converted to and display screen matched
Two resolution formats；
Wherein, be converted to includes effective pixel points and non-effective pixel in the video image of the 4th resolution format；It is described to have
Effect pixel is the pixel in the video image before conversion.
Optionally, as a kind of enforceable mode, further include：
First cache module, for successively saving the P for being converted to the first resolution format1Frame video image；Wherein, P1For
Positive integer；
Second Display processing module, is used for：
Video image described in the every frame at the uniform velocity exported from first cache module is obtained, and will be described in the video image
First resolution format conversion is the second resolution format；
Every frame video image after being converted into the second resolution format is output to the display screen.
Optionally, as a kind of enforceable mode, the device of the present embodiment, the second Display processing module is specifically used for
According to image scaling interpolation algorithm, the first resolution format of every frame video image after conversion is converted to and is shown with described
The matched second resolution format of display screen.
Optionally, as a kind of enforceable mode, second Display processing module is also used to slow from described first
Video image described in the every frame at the uniform velocity exported in storing module carries out image quality processing.
Optionally, as a kind of enforceable mode, further include：
Second cache module, for successively saving decoded P2Frame video image；Wherein, P2For positive integer；
First Display processing module, is specifically used for：
Video image described in the every frame at the uniform velocity exported from second cache module is obtained, in the third point of the video image
When resolution format and the 4th resolution format mismatch, the third resolution format of the video image is converted to described
4th resolution format.
Optionally, as a kind of enforceable mode, the frame-rate conversion module is specifically used for：
According to the third resolution format of the video image obtained in advance from the video figure for being converted to the 4th resolution format
Effective pixel points are extracted as in, and the 4th resolution format of the video image is converted to display screen matched second point
Resolution format.
Optionally, as a kind of enforceable mode, the decoder module is specifically used for：
It notifies the third resolution format of decoded 1st frame video image to give frame-rate conversion module；
For subsequent every frame video image, the situation of change of the third resolution format of video image is monitored, if monitoring institute
The third resolution format for stating M frame video image is different from the third resolution format of M-1 frame video image, then will be described
The third resolution format of M frame video image notifies to give frame-rate conversion module, so that the frame-rate conversion module is receiving
Get the third resolution format of the M frame video image when M frame video image in advance；
Wherein, M is the positive integer greater than 1.
Optionally, as a kind of enforceable mode, the device of the present embodiment further includes：
Monitoring modular, for monitoring the current network bandwidth of user；
The decoder module, is specifically used for：
Obtain the video to be played of resolution format corresponding with the network bandwidth of the active user；
Processing is decoded to the video to be played, obtains the decoded video image.
Optionally, as a kind of enforceable mode, the device of the present embodiment further includes：
Receiving module, for receive described in the resolution format corresponding with the network bandwidth of active user of server push to
The video of broadcasting；
The decoder module, is specifically used for：
Processing is decoded to the video to be played, obtains the decoded video image.
It should be noted that for device embodiment, since it essentially corresponds to embodiment of the method, so correlation
Place illustrates referring to the part of embodiment of the method.
Fig. 7 is the structural schematic diagram of one embodiment of TV of the present invention.As shown in fig. 7, the TV of the present embodiment, may include：Place
Manage device 701, memory 702 and communication interface 703；
Wherein, memory 702, for storing program；Specifically, program may include program code, and said program code includes
Computer operation instruction.Memory 702 may include random access memory（Random access memory, abbreviation RAM）,
It may also further include nonvolatile memory（non-volatile memory）, a for example, at least magnetic disk storage.
Communication interface 703, for receiving signal or data；
Processor 701, for executing the program of memory storage, for executing technical side provided by embodiment of the present invention method
Case, it is similar that the realization principle and technical effect are similar, can refer to the explanation of embodiment of the method part, details are not described herein again.
In embodiments of the present invention, processor can specifically include SOC, FRC.
It is decoder module, monitoring modular, format converting module, the first Display processing module in above-described embodiment, second aobvious
Show that module and frame-rate conversion module can be realized by processor；
First cache module and the second cache module can be realized by memory；Receiving module can be realized by communication interface.
It should be noted that for television embodiment, since it essentially corresponds to embodiment of the method, so correlation
Place illustrates referring to the part of embodiment of the method.
Those of ordinary skill in the art will appreciate that：Realize that all or part of the steps of above method embodiment can pass through
The relevant hardware of program instruction is completed, and program above-mentioned can be stored in a computer readable storage medium, the program
When being executed, step including the steps of the foregoing method embodiments is executed；And storage medium above-mentioned includes：ROM, RAM, magnetic disk or light
The various media that can store program code such as disk.
Finally it should be noted that：The above embodiments are only used to illustrate the technical solution of the present invention., rather than its limitations；To the greatest extent
Present invention has been described in detail with reference to the aforementioned embodiments for pipe, those skilled in the art should understand that：Its according to
So be possible to modify the technical solutions described in the foregoing embodiments, or to some or all of the technical features into
Row equivalent replacement；And these are modified or replaceed, various embodiments of the present invention technology that it does not separate the essence of the corresponding technical solution
The range of scheme.
Claims (5)
1. a kind of TV, which is characterized in that including：
System on chip SOC notifies the third resolution format of decoded 1st frame video image to give frame-rate conversion module FRC,
The variation of the third resolution format of video image described in every frame after monitoring, if monitoring the third point of M frame video image
Resolution format is different from the third resolution format of previous frame video image, then differentiates the third of the M frame video image
Rate format notifies to give frame-rate conversion module FRC；
The frame-rate conversion module FRC is notified according to the system on chip SOC, calls third resolution format institute after variation right
The resolution format conversion process algorithm answered carries out resolution format conversion to the M frame video image.
2. TV according to claim 1, which is characterized in that the system on chip SOC is also used to, by third resolution ratio
The video image of format is converted to the 4th fixed resolution format.
3. TV according to claim 2, which is characterized in that the system on chip SOC, further includes cache module；
The system on chip SOC, by P after decoding2Frame video image is successively stored in second cache module, and described second
Every frame video image that cache module at the uniform velocity exports, in the third resolution format of the video image and described 4th point
When resolution format mismatching, the third resolution format of video image is converted into the 4th resolution format.
4. TV according to claim 2, which is characterized in that P2It is 3.
5. TV according to claim 2, which is characterized in that when the third resolution format is differentiated lower than the described 4th
When rate format, using original video image as effective pixel points, remaining part black pixel point or other non-effective pixels
To supplement, wherein the effective pixel points are the pixel in the video image before conversion.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810668619.8A CN108833975B (en) | 2016-03-18 | 2016-03-18 | Video playing processing method and device |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610158743.0A CN105744358B (en) | 2016-03-18 | 2016-03-18 | The processing method and processing device of video playing |
| CN201810668619.8A CN108833975B (en) | 2016-03-18 | 2016-03-18 | Video playing processing method and device |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610158743.0A Division CN105744358B (en) | 2016-03-18 | 2016-03-18 | The processing method and processing device of video playing |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108833975A true CN108833975A (en) | 2018-11-16 |
| CN108833975B CN108833975B (en) | 2021-05-18 |
Family
ID=56250922
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610158743.0A Active CN105744358B (en) | 2016-03-18 | 2016-03-18 | The processing method and processing device of video playing |
| CN201810668619.8A Active CN108833975B (en) | 2016-03-18 | 2016-03-18 | Video playing processing method and device |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610158743.0A Active CN105744358B (en) | 2016-03-18 | 2016-03-18 | The processing method and processing device of video playing |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN105744358B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112449229A (en) * | 2019-09-04 | 2021-03-05 | 海信视像科技股份有限公司 | Sound and picture synchronous processing method and display equipment |
Families Citing this family (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106534840B (en) * | 2016-10-31 | 2018-10-26 | 青岛海信电器股份有限公司 | The detection method and device of vision signal |
| CN106909533A (en) * | 2016-11-14 | 2017-06-30 | 上海仪电鑫森科技发展有限公司 | Suitable for multi-platform examination editing system |
| CN106970770B (en) * | 2017-03-31 | 2020-08-25 | 联想(北京)有限公司 | Display adjustment method, electronic equipment and device |
| TWI629661B (en) * | 2017-10-17 | 2018-07-11 | 冠捷投資有限公司 | Overclocking display method and display |
| CN108573477A (en) * | 2018-03-14 | 2018-09-25 | 深圳怡化电脑股份有限公司 | Eliminate method, system and the terminal device of image moire fringes |
| CN108874945B (en) * | 2018-06-04 | 2023-03-21 | 联想(北京)有限公司 | Data processing method and electronic equipment |
| CN109068172A (en) * | 2018-08-01 | 2018-12-21 | 威创集团股份有限公司 | Processor windowing method, device, equipment and readable storage medium storing program for executing |
| KR102521834B1 (en) * | 2018-08-21 | 2023-04-17 | 삼성전자주식회사 | Method of providing image to vehicle, and electronic device therefor |
| CN110636372B (en) * | 2019-10-08 | 2022-02-25 | 未来电视有限公司 | Video decoding method, video playing device, electronic equipment and storage medium |
| CN111479154B (en) * | 2020-04-03 | 2022-03-22 | 海信视像科技股份有限公司 | Equipment and method for realizing sound and picture synchronization and computer readable storage medium |
| CN112637656B (en) * | 2020-12-15 | 2023-02-17 | 海宁奕斯伟集成电路设计有限公司 | Channel configuration method and device, electronic equipment and readable storage medium |
| CN112752152B (en) * | 2020-12-28 | 2022-11-25 | 海信视像科技股份有限公司 | Delivery video playing method and display equipment |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1925544A (en) * | 2005-08-31 | 2007-03-07 | 松下电器产业株式会社 | Image data processing device |
| CN1924931A (en) * | 2005-08-31 | 2007-03-07 | 株式会社东芝 | Video rendering apparatus and method |
| CN101277365A (en) * | 2007-03-27 | 2008-10-01 | 佳能株式会社 | Image processing device and image processing method |
| CN101662606A (en) * | 2008-08-29 | 2010-03-03 | 株式会社东芝 | Video display apparatus and video display method |
| CN103489173A (en) * | 2013-09-23 | 2014-01-01 | 百年金海科技有限公司 | Video image super-resolution reconstruction method |
| CN103596015A (en) * | 2013-11-05 | 2014-02-19 | 广东威创视讯科技股份有限公司 | Method and system for processing image |
| US8681866B1 (en) * | 2011-04-28 | 2014-03-25 | Google Inc. | Method and apparatus for encoding video by downsampling frame resolution |
| CN104135637A (en) * | 2014-07-01 | 2014-11-05 | 宁波摩米创新工场电子科技有限公司 | Image processing method and image processing device of converting low resolution to high resolution |
| CN104981766A (en) * | 2014-04-28 | 2015-10-14 | 华为终端有限公司 | Method for displaying data on screen and display control device |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7199837B2 (en) * | 2001-11-13 | 2007-04-03 | Ati Technologies, Inc. | System for improved ratiometric expansion and method thereof |
| US7420618B2 (en) * | 2003-12-23 | 2008-09-02 | Genesis Microchip Inc. | Single chip multi-function display controller and method of use thereof |
| CN101883277A (en) * | 2009-05-08 | 2010-11-10 | 尚福兵 | Low resolution video file playing method and device |
| CN104410904A (en) * | 2014-12-25 | 2015-03-11 | 安科智慧城市技术（中国）有限公司 | Video playing method and video playing device |
-
2016
- 2016-03-18 CN CN201610158743.0A patent/CN105744358B/en active Active
- 2016-03-18 CN CN201810668619.8A patent/CN108833975B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1925544A (en) * | 2005-08-31 | 2007-03-07 | 松下电器产业株式会社 | Image data processing device |
| CN1924931A (en) * | 2005-08-31 | 2007-03-07 | 株式会社东芝 | Video rendering apparatus and method |
| CN101277365A (en) * | 2007-03-27 | 2008-10-01 | 佳能株式会社 | Image processing device and image processing method |
| CN101662606A (en) * | 2008-08-29 | 2010-03-03 | 株式会社东芝 | Video display apparatus and video display method |
| US8681866B1 (en) * | 2011-04-28 | 2014-03-25 | Google Inc. | Method and apparatus for encoding video by downsampling frame resolution |
| CN103489173A (en) * | 2013-09-23 | 2014-01-01 | 百年金海科技有限公司 | Video image super-resolution reconstruction method |
| CN103596015A (en) * | 2013-11-05 | 2014-02-19 | 广东威创视讯科技股份有限公司 | Method and system for processing image |
| CN104981766A (en) * | 2014-04-28 | 2015-10-14 | 华为终端有限公司 | Method for displaying data on screen and display control device |
| CN104135637A (en) * | 2014-07-01 | 2014-11-05 | 宁波摩米创新工场电子科技有限公司 | Image processing method and image processing device of converting low resolution to high resolution |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112449229A (en) * | 2019-09-04 | 2021-03-05 | 海信视像科技股份有限公司 | Sound and picture synchronous processing method and display equipment |
| CN112449229B (en) * | 2019-09-04 | 2022-01-28 | 海信视像科技股份有限公司 | Sound and picture synchronous processing method and display equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108833975B (en) | 2021-05-18 |
| CN105744358A (en) | 2016-07-06 |
| CN105744358B (en) | 2018-09-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105744358B (en) | The processing method and processing device of video playing | |
| CN105681720B (en) | The processing method and processing device of video playing | |
| TWI529656B (en) | Image display system and image processing method | |
| CN105872419B (en) | A kind of display methods, device and LCD TV | |
| CN110868625A (en) | Video playing method and device, electronic equipment and storage medium | |
| JP2008500752A (en) | Adaptive decoding of video data | |
| JP2011176821A (en) | Shutter glasses, display apparatus and control method thereof | |
| EP2779152A1 (en) | Display apparatus and control method thereof for applying motion compensation to remove artifacts from images | |
| US6392712B1 (en) | Synchronizing interlaced and progressive video signals | |
| US20120256962A1 (en) | Video Processing Apparatus and Method for Extending the Vertical Blanking Interval | |
| JP2012182673A (en) | Image display apparatus and image processing method | |
| CN105812923B (en) | Play handling method and device based on video on demand | |
| EP3152910A1 (en) | Minimizing input lag in a remote gui tv application | |
| CN108769600B (en) | Desktop sharing system based on video stream frame rate adjustment and desktop sharing method thereof | |
| CN112637660A (en) | Image stabilization method for starting up android television video application | |
| TWI386058B (en) | Video processing method and device | |
| CN113596450B (en) | Video image compression method, decompression method, processing method, device and equipment | |
| CN114938461A (en) | Video processing method, device and equipment and readable storage medium | |
| CN109545122B (en) | Compensation method and compensation device for VR display and display system | |
| US20080002065A1 (en) | Image processing circuit, image processing system and method therefor | |
| JP4332312B2 (en) | Video signal processing apparatus, video display apparatus, and video signal processing method | |
| US8107525B1 (en) | Variable bit rate video CODEC using adaptive tracking for video conferencing | |
| JP5259867B2 (en) | Video display device and video processing method | |
| CN112468756B (en) | Video signal non-lost frame display method and display equipment | |
| CN101026681A (en) | Interlaced image signal frequency multiplication method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 266100 Zhuzhou Road, Laoshan District, Shandong, No. 151, No. Applicant after: Hisense Video Technology Co., Ltd Address before: 266100 Zhuzhou Road, Laoshan District, Shandong, No. 151, No. Applicant before: HISENSE ELECTRIC Co.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |