CN113225619A - Frame rate self-adaption method, device, equipment and readable storage medium - Google Patents
Frame rate self-adaption method, device, equipment and readable storage medium Download PDFInfo
- Publication number
- CN113225619A CN113225619A CN202110445810.8A CN202110445810A CN113225619A CN 113225619 A CN113225619 A CN 113225619A CN 202110445810 A CN202110445810 A CN 202110445810A CN 113225619 A CN113225619 A CN 113225619A
- Authority
- CN
- China
- Prior art keywords
- frame rate
- adjustment scheme
- frame
- display adjustment
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 56
- 230000006978 adaptation Effects 0.000 claims description 30
- 230000003044 adaptive effect Effects 0.000 claims description 20
- 238000012545 processing Methods 0.000 claims description 19
- 230000000903 blocking effect Effects 0.000 abstract description 3
- 238000004891 communication Methods 0.000 description 6
- 230000003139 buffering effect Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- PCTMTFRHKVHKIS-BMFZQQSSSA-N (1s,3r,4e,6e,8e,10e,12e,14e,16e,18s,19r,20r,21s,25r,27r,30r,31r,33s,35r,37s,38r)-3-[(2r,3s,4s,5s,6r)-4-amino-3,5-dihydroxy-6-methyloxan-2-yl]oxy-19,25,27,30,31,33,35,37-octahydroxy-18,20,21-trimethyl-23-oxo-22,39-dioxabicyclo[33.3.1]nonatriaconta-4,6,8,10 Chemical compound C1C=C2C[C@@H](OS(O)(=O)=O)CC[C@]2(C)[C@@H]2[C@@H]1[C@@H]1CC[C@H]([C@H](C)CCCC(C)C)[C@@]1(C)CC2.O[C@H]1[C@@H](N)[C@H](O)[C@@H](C)O[C@H]1O[C@H]1/C=C/C=C/C=C/C=C/C=C/C=C/C=C/[C@H](C)[C@@H](O)[C@@H](C)[C@H](C)OC(=O)C[C@H](O)C[C@H](O)CC[C@@H](O)[C@H](O)C[C@H](O)C[C@](O)(C[C@H](O)[C@H]2C(O)=O)O[C@H]2C1 PCTMTFRHKVHKIS-BMFZQQSSSA-N 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000012216 screening Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- FGUUSXIOTUKUDN-IBGZPJMESA-N C1(=CC=CC=C1)N1C2=C(NC([C@H](C1)NC=1OC(=NN=1)C1=CC=CC=C1)=O)C=CC=C2 Chemical compound C1(=CC=CC=C1)N1C2=C(NC([C@H](C1)NC=1OC(=NN=1)C1=CC=CC=C1)=O)C=CC=C2 FGUUSXIOTUKUDN-IBGZPJMESA-N 0.000 description 1
- YTAHJIFKAKIKAV-XNMGPUDCSA-N [(1R)-3-morpholin-4-yl-1-phenylpropyl] N-[(3S)-2-oxo-5-phenyl-1,3-dihydro-1,4-benzodiazepin-3-yl]carbamate Chemical compound O=C1[C@H](N=C(C2=C(N1)C=CC=C2)C1=CC=CC=C1)NC(O[C@H](CCN1CCOCC1)C1=CC=CC=C1)=O YTAHJIFKAKIKAV-XNMGPUDCSA-N 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002688 persistence Effects 0.000 description 1
- 230000010076 replication Effects 0.000 description 1
- 230000003362 replicative effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Television Systems (AREA)
Abstract
The invention discloses a frame rate self-adaptive method, a device, equipment and a readable storage medium, wherein the method comprises the following steps: acquiring a frame rate of video source data and presetting a refreshing frequency of a display; if the frame rate is not matched with the refreshing frequency, selecting a target display adjustment scheme corresponding to the frame rate and the refreshing frequency together based on a preset display adjustment scheme set; and adjusting the frame rate based on the target display adjustment scheme to obtain an adjusted frame rate, so that the adjusted frame rate is matched with the refreshing frequency. According to the invention, the frame rate of the video source data and the refresh frequency of the preset display are obtained, and when the frame rate is not matched with the refresh frequency, the frame rate is adjusted through the target display adjustment scheme to obtain the adjusted frame rate, so that the adjusted frame rate is matched with the refresh frequency, and the problem of blocking caused by the fact that the frame rate is not matched with the refresh frequency is avoided.
Description
Technical Field
The present invention relates to the field of video display technologies, and in particular, to a frame rate adaptive method, apparatus, device, and readable storage medium.
Background
With the rapid development of the broadcast television industry and the continuous acceleration of the digitization process, users have made higher requirements on the fluency of television playing videos during watching sports events.
There are many frame rates of videos played by televisions on the market at present, for example, 60fps, 59.94fps, 50fps, 30fps, 29.97fps, 25fps, 24fps, 15fps, etc., the refresh frequency of the display of the television is usually two of 50Hz and 60Hz, when the frame rate of the video is the same as the refresh frequency of the display, the video can be normally played on the display, and when the frame rate of the video is different from the refresh frequency of the display, the display can generate a stuck phenomenon when playing the video.
That is, there is a problem that the display is stuck due to the mismatch between the frame rate and the refresh rate when playing video.
Disclosure of Invention
The invention mainly aims to provide a frame rate self-adaption method, a frame rate self-adaption device, frame rate self-adaption equipment and a readable storage medium, and aims to solve the technical problem that the existing display is stuck due to the fact that the frame rate is not matched with the refreshing frequency when the video is played.
Acquiring a frame rate of video source data and presetting a refreshing frequency of a display;
if the frame rate is not matched with the refreshing frequency, selecting a target display adjustment scheme corresponding to the frame rate and the refreshing frequency together based on a preset display adjustment scheme set;
and adjusting the frame rate based on the target display adjustment scheme to obtain an adjusted frame rate, so that the adjusted frame rate is matched with the refreshing frequency.
Optionally, the adjusting the frame rate based on the target display adjustment scheme to obtain an adjusted frame rate includes:
extracting video frame data of the video source data;
and performing frame interpolation processing on the video frame data based on the target display adjustment scheme to obtain video source data after frame interpolation, so as to improve the frame rate of the video source data and obtain an adjusted frame rate.
Optionally, the performing, based on the target display adjustment scheme, frame interpolation processing on the video frame data to obtain video source data after frame interpolation includes:
acquiring a video frame interpolation relation in the target display adjustment scheme;
and performing frame interpolation processing on the video frame data based on the video frame interpolation relation to obtain the video data after frame interpolation.
Optionally, the selecting, based on a preset display adjustment scheme set, a target display adjustment scheme corresponding to both the frame rate and the refresh frequency includes:
selecting an initial display adjustment scheme set matched with the frame rate from the preset display adjustment scheme set;
selecting a target display adjustment scheme matched with the refreshing frequency from the initial display adjustment scheme set; or the like, or, alternatively,
selecting an initial display adjustment scheme set matched with the refreshing frequency from the preset display adjustment scheme set;
and selecting a target display adjustment scheme matched with the frame rate from the initial display adjustment scheme set.
Optionally, the obtaining a refresh frequency of a preset display includes:
and acquiring the refreshing frequency stored before the preset display is turned off.
Optionally, the acquiring a frame rate of video source data includes:
decoding the video source data to obtain decoded video source data;
and acquiring the frame rate from the decoded video source data.
Optionally, the adjusting the frame rate based on the target display adjustment scheme, after obtaining the adjusted frame rate, includes:
when the change of the refresh frequency of the preset display is detected, obtaining the changed refresh frequency;
and based on the changed refreshing frequency, reselecting a target frequency adjusting scheme from the preset display adjusting scheme set.
In addition, to achieve the above object, the present invention provides a frame rate adaptive apparatus, including:
the first acquisition module is used for acquiring the frame rate of video source data and presetting the refresh frequency of a display;
a selecting module, configured to select, based on a preset display adjustment scheme set, a target display adjustment scheme corresponding to the frame rate and the refresh frequency together if the frame rate is not matched with the refresh frequency;
and the adjusting module is used for adjusting the frame rate based on the target display adjusting scheme to obtain the adjusted frame rate.
Furthermore, to achieve the above object, the present invention further provides a frame rate adaptation device, which includes a memory, a processor and a frame rate adaptation program stored in the memory and operable on the processor, wherein the frame rate adaptation program, when executed by the processor, implements the steps of the frame rate adaptation method as described above.
Furthermore, to achieve the above object, the present invention further provides a computer readable storage medium having stored thereon a frame rate adaptation program, which when executed by a processor, implements the steps of the frame rate adaptation method as described above.
The method comprises the steps of acquiring a frame rate of video source data and presetting a refreshing frequency of a display; if the frame rate is not matched with the refreshing frequency, selecting a target display adjustment scheme corresponding to the frame rate and the refreshing frequency together based on a preset display adjustment scheme set; and adjusting the frame rate based on the target display adjustment scheme to obtain an adjusted frame rate, so that the adjusted frame rate is matched with the refreshing frequency. According to the invention, the frame rate of the video source data and the refresh frequency of the preset display are obtained, and when the frame rate is not matched with the refresh frequency, the frame rate is adjusted through the target display adjustment scheme to obtain the adjusted frame rate, so that the adjusted frame rate is matched with the refresh frequency, and the problem of blocking caused by the fact that the frame rate is not matched with the refresh frequency is avoided.
Drawings
FIG. 1 is a flowchart illustrating a frame rate adaptation method according to a first embodiment of the present invention;
FIG. 2 is a flowchart illustrating a frame rate adaptation method according to a second embodiment of the present invention;
FIG. 3 is a block diagram of a frame rate adaptive device according to a preferred embodiment of the present invention;
fig. 4 is a schematic structural diagram of a hardware operating environment according to an embodiment of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Referring to fig. 1, fig. 1 is a flowchart illustrating a frame rate adaptive method according to a first embodiment of the present invention.
While a logical order is shown in the flow chart, in some cases, the steps shown or described may be performed in an order different from that shown or described herein. The frame rate adaptive method can be applied to a television. The frame rate self-adaptive method comprises the following steps:
in step S10, the frame rate of the video source data and the refresh rate of the display are obtained.
In particular, video source data, i.e., video, broadly refers to various techniques for capturing, recording, processing, storing, transmitting, and reproducing a series of still pictures as electrical signals. Specifically, for continuous picture changes, when the rate of change exceeds 24 frames per second, the human eye cannot distinguish a single static picture according to the principle of persistence of vision, so that the visual effect of the continuously changing picture, called video, appears to be smooth and continuous, and the rate of change is the frame rate. It should be noted that, when displaying a video through a preset display (e.g., a display of a television), the preset display has its own refresh frequency, which is similar to the frame rate, and is the capability of the preset display to display the video, and the refresh frequency is the number of times per second that the preset display can refresh.
It should be noted that, when the preset display is used to display video source data, the display principle of the preset display is to refresh the display frame according to the refresh frequency, for example, the refresh frequency of the preset display is 50Hz, and when the preset display is used to refresh the display frame, the preset display is refreshed 50 times per second to complete 50 times of conversion of the display frame. It can be understood that, if the frame rate of the video source data at this time is 50fps, the number of picture changes per second of the video source data is exactly the same as the number of picture changes per second of the preset display, so that no picture can be displayed when the preset display is refreshed; if the refresh frequency of the display is preset to be 50Hz, the display is preset to be refreshed 50 times per second when the display refreshes the display frame, so as to complete the conversion of the display frame 50 times. It can be understood that, if the frame rate of the video source data at this time is 25fps, the number of picture changes per second of the video source data is different from the number of picture changes per second of the preset display, that is, the video source data cannot continue to provide new pictures after the preset display finishes refreshing for 25 times, so that the preset display only displays the picture refreshed to the 25 th time when the preset display refreshes the remaining 25 times of pictures, and the picture does not generate a fixed frame in half a second, that is, a visual pause phenomenon is caused.
Therefore, in order to solve the stuck phenomenon, the frame rate of the video source data and the refresh rate of the preset display need to be obtained, so as to perform corresponding processing according to the frame rate of the video source data and the refresh rate of the preset display.
Wherein, the obtaining of the refresh frequency of the preset display includes:
step a, obtaining the refreshing frequency stored before the preset display is shut down.
Specifically, there are multiple refresh frequencies in the existing display, for example, the refresh frequency of the display is 50Hz and 60Hz, and for the convenience of the user to watch the video through the preset display, it is necessary to avoid the need of the user to set the refresh frequency after the display is turned on each time, that is, the refresh frequency of the preset display when the display needs to be saved before the shutdown, so as to automatically obtain the saved refresh frequency when the display is turned on next time, thereby completing the automatic setting of the refresh frequency. Therefore, when the refresh frequency of the preset display is obtained, the refresh frequency stored before the preset display is shut down is obtained.
Wherein, the acquiring the frame rate of the video source data comprises:
b, decoding the video source data to obtain decoded video source data;
and c, acquiring the frame rate from the decoded video source data.
Specifically, the frame rate of the video source data cannot be directly obtained, the frame rate can be obtained only after the video source data is decoded, and on a System On Chip (SOC), the SOC is provided with a video decoder hardware module for decoding the video source data, that is, the video source data can be obtained after passing through the SOC, and the frame rate can be obtained from the decoded video source data.
Step S20, if the frame rate does not match the refresh frequency, selecting a target display adjustment scheme corresponding to the frame rate and the refresh frequency together based on a preset display adjustment scheme set.
Specifically, if the frame rate is not matched with the refresh frequency, selecting a target display adjustment scheme corresponding to the frame rate and the refresh frequency together based on a preset display adjustment scheme set; if the frame rate is matched with the refresh rate, the video source data is directly displayed through the preset display, and a target display adjustment scheme does not need to be selected from a preset display adjustment scheme set.
Because the frame rate and the refresh frequency are not unique, the same frame rate can be combined with different refresh frequencies, and the same refresh frequency can also be combined with different frame rates. For example, a frame rate of 25fps, which can be combined with a refresh rate of 50Hz, or 60 Hz; also, for example, a refresh rate of 50Hz may be combined with a frame rate of 24fps, or 30 fps.
And when the frame rate is not matched with the refresh frequency, matching a target display adjustment scheme from the preset display adjustment scheme set through the frame rate and the refresh frequency together so as to match the frame rate with the refresh frequency through the target display adjustment scheme.
It should be noted that, in the actual use process of the display, the requirements of the display adjustment scheme on the performance (i.e. hardware) of the display and the display latency are also considered.
Therefore, it is desirable to facilitate as much as possible the matching of the frame rate to the refresh rate, for example a frame rate of 25fps, combined with a refresh rate of 50Hz, but not combined with 60 Hz. Specifically, assuming that the matching relationship between the frame rate of 25fps and the refresh rate of 50Hz is matching relationship 1, and the matching relationship between the frame rate of 30fps and the refresh rate of 50Hz is matching relationship 2, the matching relationship 2 is obviously more complicated than the matching relationship 1, and the more complicated the matching relationship, the higher the cost when the frame rate and the refresh rate are matched.
For the matching relation 1, as the least common multiple of 25 and 50 is 50 and the refresh frequency of the display is just 50Hz, the display can be started without buffering the video frame; for the matching relation 2, since the least common multiple of 30 and 50 is 150, the display needs to buffer 150 video frames before the display can start displaying.
It should be noted that, the number of buffered video frames has a requirement on the buffer space of the display on the one hand, for example, the video frame is a 4K picture with the format YUV444, the size of one frame of the video frame is 24M, that is, the video frame of the buffer 150 needs to occupy a memory of 150 × 24M (i.e., 3.6G), and the buffer does not occupy the memory because of the buffer; on the other hand, the process of buffering video frames needs to wait, for example, if the refresh frequency is 50Hz, 3 seconds are needed for buffering 150 frames of video frames, and no waiting is needed for buffering.
Therefore, in the actual use process of the display, the practicability of the display adjustment scheme needs to be comprehensively considered.
Specifically, the selecting a target display adjustment scheme corresponding to the frame rate and the refresh frequency together based on a preset display adjustment scheme set includes:
step d, selecting an initial display adjustment scheme set matched with the frame rate from the preset display adjustment scheme set;
step e, selecting a target display adjustment scheme corresponding to the refresh frequency from the initial display adjustment scheme set; or the like, or, alternatively,
step f, selecting an initial display adjustment scheme set matched with the refreshing frequency from the preset display adjustment scheme set;
and g, selecting a target display adjustment scheme matched with the frame rate from the initial display adjustment scheme set.
In this embodiment, the manner of determining the corresponding target display adjustment scheme through the frame rate and the refresh frequency is as follows: firstly, selecting an initial display adjustment scheme set matched with the frame rate from a preset display adjustment scheme set, namely, performing initial screening from the preset display adjustment scheme set according to the frame rate, wherein the initial display adjustment scheme set obtained through the frame rate screening comprises a plurality of display adjustment schemes, and the number of the display adjustment schemes is determined by the number of refresh frequencies of a display, for example, the refresh frequencies of the display comprise 50Hz and 60Hz, and the display adjustment schemes are display adjustment schemes corresponding to the two refresh frequencies of 50Hz and 60Hz respectively; then, a target display adjustment scheme corresponding to the refresh frequency is selected from the initial display adjustment scheme set, that is, the target display adjustment scheme is selected from the plurality of display adjustment schemes through the specific refresh frequency, for example, the refresh frequency is 50Hz, and the initial display adjustment scheme set includes display adjustment schemes corresponding to the two refresh frequencies of 50Hz and 60Hz, so that the target display adjustment scheme is the display adjustment scheme corresponding to 50 Hz.
It can be understood that the selection process is a process of selecting twice through two parameters, that is, after the selected range is narrowed through one parameter, the target display adjustment scheme is selected from the narrowed range through another parameter, therefore, the initial display adjustment scheme can perform selection matching through the frame rate and further select the matched target display adjustment scheme through the refresh frequency, and besides the initial display adjustment scheme performs selection matching through the refresh frequency and further selects the matched target display adjustment scheme through the frame rate. The specific embodiment of the method is basically the same as that of the initial display adjustment scheme set which selects the matching frame rate from the preset display adjustment scheme set first, and then the target display adjustment scheme which selects the matching refresh frequency from the initial display adjustment scheme set, which is not described herein again.
Further, the adjusting the frame rate based on the target display adjustment scheme, after obtaining the adjusted frame rate, includes:
and h, when the change of the refresh frequency of the preset display is detected, acquiring the changed refresh frequency.
Specifically, different refresh frequencies of the preset display correspond to different application scenarios, for example, when no user watches a video before detecting the preset display, the preset display can automatically reduce the refresh frequency to achieve an energy-saving effect, and when the user watches the video before returning to the preset display, the preset display can automatically increase the refresh frequency to improve the display performance of the preset display.
Therefore, in the using process, the refresh frequency of the preset display can be changed, and certainly, besides self-changing, a user can also set the refresh frequency of the preset display, and when the change of the refresh frequency of the preset display is detected, the changed refresh frequency is obtained.
And i, based on the changed refreshing frequency, reselecting a target frequency adjusting scheme from the preset display adjusting scheme set.
Specifically, in order to ensure that the frame rate can be matched with the changed refresh frequency, the target frequency adjustment scheme needs to be reselected from the preset display adjustment scheme set based on the changed refresh frequency. The process of reselecting the target frequency adjustment scheme is substantially the same as the process of selecting the target frequency adjustment scheme, and is not described herein again.
The embodiment is implemented by acquiring the frame rate of video source data and presetting the refresh frequency of a display; if the frame rate is not matched with the refreshing frequency, selecting a target display adjustment scheme corresponding to the frame rate and the refreshing frequency together based on a preset display adjustment scheme set; and adjusting the frame rate based on the target display adjustment scheme to obtain an adjusted frame rate, so that the adjusted frame rate is matched with the refreshing frequency. According to the embodiment, the frame rate of the video source data and the refresh frequency of the preset display are obtained, and when the frame rate is not matched with the refresh frequency, the frame rate is adjusted through the target display adjustment scheme to obtain the adjusted frame rate, so that the adjusted frame rate is matched with the refresh frequency, and the problem of blocking caused by the fact that the frame rate is not matched with the refresh frequency is avoided.
Further, referring to fig. 2, a second embodiment is proposed based on the above first embodiment of the frame rate adaptive method of the present invention, where the adjusting the frame rate based on the target display adjustment scheme to obtain the adjusted frame rate includes:
step a10, extracting video frame data of the video source data.
Specifically, according to the definition of the video, the video is a continuously changing picture, where the picture is a video frame, that is, the video source data includes a plurality of video frame data, that is, the plurality of continuously changing video frames constitute the video, and in order to adjust the frame rate of the video source data, the video frame data needs to be processed.
Step A20, performing frame interpolation processing on the video frame data based on the target display adjustment scheme to obtain video source data after frame interpolation, so as to improve the frame rate of the video source data to obtain an adjusted frame rate.
Specifically, the video frame data is processed by performing frame interpolation on the video frame data, and how to perform frame interpolation is determined by the target display adjustment scheme, that is, the video frame data is subjected to frame interpolation based on the target display adjustment scheme to obtain video source data after frame interpolation, where the frame interpolation is a processing process of increasing video frames in the video frame data to increase the frame rate of the video frame data to obtain an adjusted frame rate. For example, when the frame rate is 25fps and the refresh rate is 50Hz, the number of video frames needs to be doubled by the frame interpolation processing.
It should be noted that the process of matching the frame rate and the refresh frequency may not be completed by adjusting the frame rate, and the refresh frequency may need to be adjusted after adjusting the frame rate, for example, the frame rate is 25fps, and the refresh frequency is 60Hz, and the refresh frequency needs to be adjusted to 50Hz after doubling the number of video frames by adjusting the frame rate, and the specific adjustment process is to adjust display parameters of the display, where the related display parameters include Dclock (clock frequency of the display), Htotal (display length of the display), Vtotal (display width of the display), and Vsync _ frame (refresh frequency of the display). The above display parameters need to satisfy the formula: dclock (Htotal Vtotal Vsync _ frame). It will be appreciated that the equations may be satisfied by adjusting at least one of the above parameters Dlock, Htotal, Vtotal, and Vsync _ frame. The purpose of adjusting the above parameters is to match the Vsync _ frame rate with the frame rate, for example, if the frame rate is 59.94fps and the refresh frequency is 50Hz, the Vsync _ frame rate needs to be 59.94Hz, and Dclock can be adjusted to make the Vsync _ frame rate 59.94 Hz.
Further, the performing frame interpolation processing on the video frame data based on the target display adjustment scheme to obtain video source data after frame interpolation includes:
step j, acquiring a video frame interpolation relation in the target display adjustment scheme;
and k, performing frame interpolation processing on the video frame data based on the video frame interpolation relation to obtain video data after frame interpolation.
Specifically, how to perform frame interpolation processing needs to be implemented by obtaining the video frame interpolation relationship in the target display adjustment scheme. It should be noted that, the video frame interpolation relationship, i.e., the video frame data replication relationship, the frame interpolation process is a process for replicating the video frame data, different frame rates and refresh frequencies may correspond to different video frame interpolation relationships, i.e., different target display adjustment schemes correspond to different video frame interpolation relationships, and the video frame data is interpolated based on the video frame interpolation relationship to obtain the video data after interpolation, i.e., the video frame data is replicated in a targeted manner according to the video frame interpolation relationship, so as to obtain the video data after interpolation. For example, the frame rate is 30fps, the refresh frequency is 60Hz, and the corresponding video frame interpolation relationship is that each video frame is repeated once, that is, the video frame data includes video frame a, video frame B, video frame C and video frame D, that is, the video frame data is ABCD, then the video data after the interpolation is AABBCCDD; if the frame rate is 24fps and the refresh rate is 60Hz, the corresponding video frame interpolation relationship cannot be simply obtained by repeating a certain multiple of each video frame, the corresponding video frame interpolation relationship is that an odd video frame repeats two frames and an even video frame repeats three frames, that is, if the video frame data includes a video frame a, a video frame B, a video frame C and a video frame D, that is, the video frame data is ABCD, the video data after the frame interpolation is AABBBCCDDD. It is understood that when the unit of the frame rate is fps and the unit of the refresh frequency is Hz, the purpose of the frame interpolation processing is to make the frame rate value and the refresh frequency value the same.
In this embodiment, the video frame data is subjected to frame interpolation processing through a video frame interpolation relationship in the target display adjustment scheme to obtain the video source data after frame interpolation, so that the adjusted frame rate and the refresh frequency of the video source data after frame interpolation can be matched, and the display cannot be blocked when playing the video in the process of frame interpolation processing.
In addition, the present invention also provides a frame rate adaptive apparatus, as shown in fig. 3, the frame rate adaptive apparatus includes:
a first obtaining module 10, configured to obtain a frame rate of video source data and a refresh rate of a preset display;
a selecting module 20, configured to select, based on a preset display adjustment scheme set, a target display adjustment scheme corresponding to the frame rate and the refresh frequency together if the frame rate is not matched with the refresh frequency;
an adjusting module 30, configured to adjust the frame rate based on the target display adjustment scheme, so as to obtain an adjusted frame rate.
Further, the adjusting module 30 includes:
an extraction unit configured to extract video frame data of the video source data;
and the frame interpolation unit is used for performing frame interpolation processing on the video frame data based on the target display adjustment scheme to obtain video source data after frame interpolation, so as to improve the frame rate of the video source data and obtain the adjusted frame rate.
Further, the frame interpolation unit includes:
the acquisition subunit is used for acquiring the video frame interpolation relation in the target display adjustment scheme;
and the frame interpolation subunit is used for performing frame interpolation processing on the video frame data based on the video frame interpolation relation to obtain video data after frame interpolation.
Further, the selecting module 20 includes:
a first selecting unit, configured to select an initial display adjustment scheme set matching the frame rate from the preset display adjustment scheme set;
a second selecting unit, configured to select a target display adjustment scheme matching the refresh frequency from the initial display adjustment scheme set; or the like, or, alternatively,
a third selecting unit, configured to select an initial display adjustment scheme set matching the refresh frequency from the preset display adjustment scheme set;
and the fourth selecting unit is used for selecting a target display adjustment scheme matched with the frame rate from the initial display adjustment scheme set.
Further, the first obtaining module 10 includes:
and the first acquisition unit is used for acquiring the refreshing frequency stored before the preset display is shut down.
Further, the first obtaining module 10 further includes:
the decoding unit is used for decoding the video source data to obtain decoded video source data;
and the second acquisition unit is used for acquiring the frame rate from the decoded video source data.
Further, the frame rate adaptive apparatus further includes:
the second obtaining module is used for obtaining the refresh frequency after change when the refresh frequency of the preset display is detected to change;
and the reselection module is used for reselecting the target frequency adjustment scheme from the preset display adjustment scheme set based on the changed refresh frequency.
The specific implementation of the frame rate adaptive apparatus of the present invention is substantially the same as the embodiments of the frame rate adaptive method described above, and will not be described herein again.
In addition, the invention also provides frame rate self-adaptive equipment. As shown in fig. 4, fig. 4 is a schematic structural diagram of a hardware operating environment according to an embodiment of the present invention.
It should be noted that fig. 4 is a schematic structural diagram of a hardware operating environment of the frame rate adaptive device.
As shown in fig. 4, the frame rate adaptation apparatus may include: a processor 1001, such as a CPU, a memory 1005, a user interface 1003, a network interface 1004, a communication bus 1002. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display screen (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a non-volatile memory (e.g., a magnetic disk memory). The memory 1005 may alternatively be a storage device separate from the processor 1001.
Those skilled in the art will appreciate that the frame rate adaptation device structure shown in fig. 4 does not constitute a limitation of the frame rate adaptation device, and may include more or less components than those shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 4, a memory 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and a frame rate adaptation program. The operating system is a program for managing and controlling hardware and software resources of the frame rate adaptive device, and supports the operation of the frame rate adaptive program and other software or programs.
In the frame rate adaptive device shown in fig. 4, the user interface 1003 is mainly used for connecting a terminal, and performing data communication with the terminal, such as receiving video source data sent by the terminal; the network interface 1004 is mainly used for the background server and performs data communication with the background server; the processor 1001 may be configured to call a frame rate adaptation program stored in the memory 1005 and perform the steps of the frame rate adaptation method as described above.
The specific implementation of the frame rate adaptive device of the present invention is substantially the same as the embodiments of the frame rate adaptive method described above, and will not be described herein again.
Furthermore, an embodiment of the present invention further provides a computer-readable storage medium, on which a frame rate adaptation program is stored, where the frame rate adaptation program, when executed by a processor, implements the steps of the frame rate adaptation method as described above.
The specific implementation of the computer-readable storage medium of the present invention is substantially the same as the embodiments of the frame rate adaptive method described above, and will not be described herein again.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, a device, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. A frame rate adaptation method, characterized in that the frame rate adaptation method comprises the steps of:
acquiring a frame rate of video source data and presetting a refreshing frequency of a display;
if the frame rate is not matched with the refreshing frequency, selecting a target display adjustment scheme corresponding to the frame rate and the refreshing frequency together based on a preset display adjustment scheme set;
and adjusting the frame rate based on the target display adjustment scheme to obtain an adjusted frame rate, so that the adjusted frame rate is matched with the refreshing frequency.
2. The frame rate adaptation method of claim 1, wherein the adjusting the frame rate based on the target display adjustment scheme to obtain an adjusted frame rate comprises:
extracting video frame data of the video source data;
and performing frame interpolation processing on the video frame data based on the target display adjustment scheme to obtain video source data after frame interpolation, so as to improve the frame rate of the video source data and obtain an adjusted frame rate.
3. The frame rate adaptive method according to claim 2, wherein the performing frame interpolation processing on the video frame data based on the target display adjustment scheme to obtain the video source data after frame interpolation comprises:
acquiring a video frame interpolation relation in the target display adjustment scheme;
and performing frame interpolation processing on the video frame data based on the video frame interpolation relation to obtain the video data after frame interpolation.
4. The frame rate adaptive method according to claim 1, wherein the selecting a target display adjustment scheme corresponding to the frame rate and the refresh frequency together based on a preset display adjustment scheme set comprises:
selecting an initial display adjustment scheme set matched with the frame rate from the preset display adjustment scheme set;
selecting a target display adjustment scheme matched with the refreshing frequency from the initial display adjustment scheme set; or the like, or, alternatively,
selecting an initial display adjustment scheme set matched with the refreshing frequency from the preset display adjustment scheme set;
and selecting a target display adjustment scheme matched with the frame rate from the initial display adjustment scheme set.
5. The frame rate adaptation method of claim 1, wherein the obtaining of the refresh frequency of the preset display comprises:
and acquiring the refreshing frequency stored before the preset display is turned off.
6. The frame rate adaptation method of claim 1, wherein the obtaining the frame rate of the video source data comprises:
decoding the video source data to obtain decoded video source data;
and acquiring the frame rate from the decoded video source data.
7. The frame rate adaptation method of any of claims 1-6, wherein the adjusting the frame rate based on the target display adjustment scheme, after obtaining the adjusted frame rate, comprises:
when the change of the refresh frequency of the preset display is detected, obtaining the changed refresh frequency;
and based on the changed refreshing frequency, reselecting a target frequency adjusting scheme from the preset display adjusting scheme set.
8. A frame rate adaptation apparatus, comprising:
the first acquisition module is used for acquiring the frame rate of video source data and presetting the refresh frequency of a display;
a selecting module, configured to select, based on a preset display adjustment scheme set, a target display adjustment scheme corresponding to the frame rate and the refresh frequency together if the frame rate is not matched with the refresh frequency;
and the adjusting module is used for adjusting the frame rate based on the target display adjusting scheme to obtain the adjusted frame rate.
9. Frame rate adaptation device, characterized in that it comprises a memory, a processor and a frame rate adaptation program stored on said memory and executable on said processor, said frame rate adaptation program, when executed by said processor, implementing the steps of the frame rate adaptation method according to any of claims 1 to 7.
10. A computer readable storage medium, having stored thereon a frame rate adaptation program which, when executed by a processor, implements the steps of the frame rate adaptation method of any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110445810.8A CN113225619A (en) | 2021-04-23 | 2021-04-23 | Frame rate self-adaption method, device, equipment and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110445810.8A CN113225619A (en) | 2021-04-23 | 2021-04-23 | Frame rate self-adaption method, device, equipment and readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113225619A true CN113225619A (en) | 2021-08-06 |
Family
ID=77088606
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110445810.8A Pending CN113225619A (en) | 2021-04-23 | 2021-04-23 | Frame rate self-adaption method, device, equipment and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113225619A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114422734A (en) * | 2022-01-28 | 2022-04-29 | 杭州海康威视数字技术股份有限公司 | Video recorder, video data processing method and device and electronic equipment |
| CN114422735A (en) * | 2022-01-28 | 2022-04-29 | 杭州海康威视数字技术股份有限公司 | Video recorder, video data processing method and device and electronic equipment |
| CN114584835A (en) * | 2022-02-10 | 2022-06-03 | 百果园技术(新加坡)有限公司 | Video processing method, device, equipment and storage medium |
| CN115297291A (en) * | 2022-08-04 | 2022-11-04 | 阿波罗智联(北京)科技有限公司 | Data processing method, data processing device, electronic equipment and medium |
| WO2023240699A1 (en) * | 2022-06-15 | 2023-12-21 | 武汉华星光电半导体显示技术有限公司 | Display apparatus and electronic device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101072339A (en) * | 2007-06-12 | 2007-11-14 | 北京中星微电子有限公司 | Method and system for controlling play frame rate synchronization |
| CN101770764A (en) * | 2008-12-29 | 2010-07-07 | 纬创资通股份有限公司 | Video processing method and device thereof |
| CN104267801A (en) * | 2014-10-20 | 2015-01-07 | 福州瑞芯微电子有限公司 | Power consumption and bandwidth reducing method and system |
| CN104347049A (en) * | 2014-09-24 | 2015-02-11 | 广东欧珀移动通信有限公司 | Method and device for adjusting screen refresh rate |
| CN105007443A (en) * | 2015-07-08 | 2015-10-28 | 福州瑞芯微电子股份有限公司 | Video frequency conversion playing method and device |
| CN106506856A (en) * | 2016-11-30 | 2017-03-15 | 努比亚技术有限公司 | A kind of screen-refresh control method and terminal |
| CN109640168A (en) * | 2018-11-27 | 2019-04-16 | Oppo广东移动通信有限公司 | Method for processing video frequency, device, electronic equipment and computer-readable medium |
-
2021
- 2021-04-23 CN CN202110445810.8A patent/CN113225619A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101072339A (en) * | 2007-06-12 | 2007-11-14 | 北京中星微电子有限公司 | Method and system for controlling play frame rate synchronization |
| CN101770764A (en) * | 2008-12-29 | 2010-07-07 | 纬创资通股份有限公司 | Video processing method and device thereof |
| CN104347049A (en) * | 2014-09-24 | 2015-02-11 | 广东欧珀移动通信有限公司 | Method and device for adjusting screen refresh rate |
| CN104267801A (en) * | 2014-10-20 | 2015-01-07 | 福州瑞芯微电子有限公司 | Power consumption and bandwidth reducing method and system |
| CN105007443A (en) * | 2015-07-08 | 2015-10-28 | 福州瑞芯微电子股份有限公司 | Video frequency conversion playing method and device |
| CN106506856A (en) * | 2016-11-30 | 2017-03-15 | 努比亚技术有限公司 | A kind of screen-refresh control method and terminal |
| CN109640168A (en) * | 2018-11-27 | 2019-04-16 | Oppo广东移动通信有限公司 | Method for processing video frequency, device, electronic equipment and computer-readable medium |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114422734A (en) * | 2022-01-28 | 2022-04-29 | 杭州海康威视数字技术股份有限公司 | Video recorder, video data processing method and device and electronic equipment |
| CN114422735A (en) * | 2022-01-28 | 2022-04-29 | 杭州海康威视数字技术股份有限公司 | Video recorder, video data processing method and device and electronic equipment |
| CN114422735B (en) * | 2022-01-28 | 2023-12-01 | 杭州海康威视数字技术股份有限公司 | Video recorder, video data processing method and device and electronic equipment |
| CN114422734B (en) * | 2022-01-28 | 2023-12-01 | 杭州海康威视数字技术股份有限公司 | Video recorder, video data processing method and device and electronic equipment |
| CN114584835A (en) * | 2022-02-10 | 2022-06-03 | 百果园技术(新加坡)有限公司 | Video processing method, device, equipment and storage medium |
| CN114584835B (en) * | 2022-02-10 | 2024-04-02 | 百果园技术(新加坡)有限公司 | Video processing method, device, equipment and storage medium |
| WO2023240699A1 (en) * | 2022-06-15 | 2023-12-21 | 武汉华星光电半导体显示技术有限公司 | Display apparatus and electronic device |
| CN115297291A (en) * | 2022-08-04 | 2022-11-04 | 阿波罗智联(北京)科技有限公司 | Data processing method, data processing device, electronic equipment and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113225619A (en) | Frame rate self-adaption method, device, equipment and readable storage medium | |
| US7474359B2 (en) | System and method of displaying a video stream | |
| CN108833975B (en) | Video playing processing method and device | |
| US20160316274A1 (en) | Method and system for switching video playback resolution | |
| US20180007311A1 (en) | Image data output device, image data output method, integrated circuit, and image display device | |
| WO2019153723A1 (en) | Video frame display method and device, television and storage medium | |
| CN109379619B (en) | Sound and picture synchronization method and device | |
| JP4691193B1 (en) | Video display device and video processing method | |
| US8593575B2 (en) | Video display apparatus for shortened-delay processing of a video signal and video processing method | |
| US8488058B2 (en) | Method for setting frame rate conversion (FRC) and display apparatus using the same | |
| KR20050073016A (en) | Automatic zoom apparatus and method for dynamic playing of image | |
| US10110887B2 (en) | Display diagnostics for enhancing performance of display devices | |
| KR100757735B1 (en) | Method of determining horizontal line active time for minimizing a memory, method of performing pip by using the same, and display devices using the same | |
| US20130229575A1 (en) | Digital TV Data Processing Method and System Thereof | |
| CN113099237B (en) | Video processing method and device | |
| EP1848203B1 (en) | Method and system for video image aspect ratio conversion | |
| CN108156515B (en) | Video playing method, smart television and computer readable storage medium | |
| JP5259867B2 (en) | Video display device and video processing method | |
| US20150016719A1 (en) | Methods of sifting out significant visual patterns from visual data | |
| CN109547832A (en) | Adaptive information source frequency playback method, equipment, storage medium and device | |
| US8730398B2 (en) | Video output apparatus and control method therefor, and non-transitory recording (storing) medium that records program | |
| JP2017181941A (en) | Display device, television receiver and transmission method | |
| JP5534948B2 (en) | Image processing apparatus and control method thereof | |
| US9082199B1 (en) | Video processing architecture | |
| JP5596473B2 (en) | Video content playback apparatus, control method therefor, program, and recording medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210806 |