CN113194306B - Frame rate fluctuation evaluation method and device, mobile terminal, system and storage medium - Google Patents
Frame rate fluctuation evaluation method and device, mobile terminal, system and storage medium Download PDFInfo
- Publication number
- CN113194306B CN113194306B CN202110460667.XA CN202110460667A CN113194306B CN 113194306 B CN113194306 B CN 113194306B CN 202110460667 A CN202110460667 A CN 202110460667A CN 113194306 B CN113194306 B CN 113194306B
- Authority
- CN
- China
- Prior art keywords
- frame rate
- target
- queue
- fluctuation
- queues
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000011156 evaluation Methods 0.000 title abstract description 20
- 238000001514 detection method Methods 0.000 claims abstract description 59
- 230000008859 change Effects 0.000 claims abstract description 55
- 238000013139 quantization Methods 0.000 claims abstract description 52
- 238000000034 method Methods 0.000 claims description 37
- 238000004590 computer program Methods 0.000 claims description 10
- 230000000694 effects Effects 0.000 abstract description 5
- 238000010586 diagram Methods 0.000 description 12
- 238000004891 communication Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 6
- 238000004364 calculation method Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
- H04N17/004—Diagnosis, testing or measuring for television systems or their details for digital television systems
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention relates to the field of Internet and provides a frame rate fluctuation evaluation method, a frame rate fluctuation evaluation device, a mobile terminal, a frame rate fluctuation evaluation system and a storage medium. In the current detection period, N frame rate queues corresponding to the video data are obtained, and each frame rate queue comprises the same number of M continuous frame rates, wherein the M continuous frame rates comprise 1 target frame rate queue and N-1 non-target frame rate queues; then obtaining a plurality of frame rate change amplitude parameters, namely the fluctuation condition of the target frame rate queue relative to N-1 non-target frame rate queues; then obtaining frame rate fluctuation quantization parameters corresponding to the target frame rate queue, namely frame rate fluctuation quantization parameters corresponding to the current detection period; and finally, sending the frame rate fluctuation quantization parameter to a server. Therefore, the frame rate fluctuation condition is evaluated, the reporting frequency is reduced, the occupation of application resources is reduced, and the effect of saving resources is achieved.
Description
Technical Field
The invention relates to the field of internet, in particular to a frame rate fluctuation evaluation method, a frame rate fluctuation evaluation device, a frame rate fluctuation evaluation system and a frame rate fluctuation evaluation storage medium.
Background
In the process of watching live broadcast by a user, due to factors such as a network environment or a mobile phone model, the frame rate of audio or video often fluctuates, and the fluctuation of the frame rate affects the watching experience of the user. Thus, it is necessary to evaluate the frame rate fluctuation.
Disclosure of Invention
In view of the above, the present invention is directed to a frame rate fluctuation estimation method, apparatus, mobile terminal, system and storage medium.
In order to achieve the above object, the embodiments of the present invention adopt the following technical solutions:
in a first aspect, the present invention provides a frame rate fluctuation assessment method applied to a mobile terminal, where the method includes:
in the current detection period, N frame rate queues corresponding to the video data are obtained; each frame rate queue comprises M continuous frame rates; the N frame rate queues comprise 1 target frame rate queue and N-1 non-target frame rate queues; the target frame rate queue comprises all frame rates of the current detection period;
obtaining a plurality of frame rate change amplitude parameters; the frame rate change amplitude parameters represent the fluctuation condition of the target frame rate queue relative to the N-1 non-target frame rate queues;
obtaining frame rate fluctuation quantization parameters corresponding to the target frame rate queue according to the frame rate change amplitude parameters;
and sending the frame rate fluctuation quantization parameter corresponding to the current detection period to a server.
In an optional embodiment, the target frame rate queues include Q target subframe rate queues; each non-target frame rate queue comprises Q non-target sub-frame rate queues; the step of obtaining a plurality of frame rate variation amplitude parameters includes:
obtaining a target average frame rate of each target sub-frame rate queue and a non-target average frame rate of each non-target sub-frame rate queue;
respectively obtaining N-1 frame rate difference values corresponding to a q-th target sub-frame rate queue based on a q-th target average frame rate of the target frame rate queue and a q-th non-target average frame rate of each non-target frame rate queue; the Q is a natural number which is more than or equal to 1 and less than or equal to Q;
and taking the maximum value of the N-1 frame rate difference values corresponding to each target sub-frame rate queue as a frame rate change amplitude parameter to obtain Q frame rate change amplitude parameters.
In an optional implementation manner, the step of obtaining, according to the frame rate variation amplitude parameters, a frame rate fluctuation quantization parameter corresponding to the target frame rate queue includes:
according to a preset range, scoring each frame rate change amplitude parameter;
and taking the total score value of the frame rate change amplitude parameters as the frame rate quantization parameter.
In an alternative embodiment, the queue length of each frame rate queue is the same; the target frame rate queue and each non-target frame rate queue have a preset time difference; the preset time difference is a preset value which is n-1 times; the preset value is a common divisor of the queue length; and N is a natural number which is more than 1 and less than or equal to N.
In an alternative embodiment, the method further comprises:
obtaining a timer accumulated value;
when the accumulated value of the timer is zero, sending a frame rate fluctuation quantization parameter corresponding to the current detection period to a server;
and when the timer accumulated value is a preset time threshold value, clearing the timer accumulated value to zero to obtain a frame rate fluctuation quantization parameter corresponding to the next detection period.
In a second aspect, the present invention provides a frame rate fluctuation evaluation apparatus applied to a mobile terminal, the apparatus comprising:
the acquisition module is used for acquiring N frame rate queues corresponding to the video data in the current detection period; each frame rate queue comprises M continuous frame rates; the N frame rate queues comprise 1 target frame rate queue and N-1 non-target frame rate queues; the target frame rate queue comprises all frame rates of the current detection period;
the operation module is used for obtaining a plurality of frame rate change amplitude parameters; the frame rate change amplitude parameters represent the fluctuation condition of the target frame rate queue relative to the N-1 non-target frame rate queues;
obtaining frame rate fluctuation quantization parameters corresponding to the target frame rate queue according to the frame rate change amplitude parameters;
and sending the frame rate fluctuation quantization parameter corresponding to the current detection period to a server.
In an optional embodiment, the target frame rate queues include Q target subframe rate queues; each non-target frame rate queue comprises Q non-target sub-frame rate queues; the operation module is further configured to:
obtaining a target average frame rate of each target sub-frame rate queue and a non-target average frame rate of each non-target sub-frame rate queue;
respectively based on the q-th target average frame rate of the target frame rate queue and the q-th non-target average frame rate of each non-target frame rate queue; obtaining N-1 frame rate difference values corresponding to the q-th target subframe rate queue; the Q is a natural number which is more than or equal to 1 and less than or equal to Q;
and taking the maximum value of the N-1 frame rate difference values corresponding to each target sub-frame rate queue as a frame rate change amplitude parameter to obtain Q frame rate change amplitude parameters.
In a third aspect, the present invention provides a mobile terminal, comprising a processor and a memory, wherein the memory stores a computer program, and the processor implements the method according to any one of the foregoing embodiments when executing the computer program.
In a fourth aspect, the present invention provides a system, including a mobile terminal and a server, where the mobile terminal is in communication connection with the server;
the mobile terminal is configured to execute the frame rate fluctuation assessment method according to any of the foregoing embodiments;
and the server is used for evaluating the frame rate fluctuation condition according to the received frame rate fluctuation quantization parameter.
In a fifth aspect, the present invention provides a storage medium having stored thereon a computer program which, when executed by a processor, implements the method of any one of the preceding embodiments.
The embodiment of the invention provides a frame rate fluctuation evaluation method, a frame rate fluctuation evaluation device, a mobile terminal, a frame rate fluctuation evaluation system and a storage medium. Acquiring N frame rate queues corresponding to the video data through a current detection period, wherein each frame rate queue comprises the same number of M continuous frame rates, namely 1 target frame rate queue and N-1 non-target frame rate queues; then obtaining a plurality of frame rate change amplitude parameters, namely the fluctuation condition of the target frame rate queue relative to N-1 non-target frame rate queues; then obtaining frame rate fluctuation quantization parameters corresponding to the target frame rate queue, namely frame rate fluctuation quantization parameters corresponding to the current detection period; and finally, sending the frame rate fluctuation quantization parameter to a server. Therefore, the evaluation on the frame rate fluctuation condition can be realized, and the reporting frequency can be effectively reduced, the occupation of application resources is reduced and the effect of saving resources is achieved by periodically reporting the frame rate fluctuation quantitative parameters to the server.
In order to make the aforementioned and other objects, features and advantages of the present invention comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present invention and therefore should not be considered as limiting the scope, and those skilled in the art can also obtain other related drawings based on the drawings without inventive efforts.
FIG. 1 is a schematic diagram of a system provided by an embodiment of the invention;
fig. 2 is a block diagram of a mobile terminal according to an embodiment of the present invention;
fig. 3 is a schematic flow chart of a frame rate fluctuation evaluation method according to an embodiment of the present invention;
fig. 4 is a schematic flowchart illustrating a frame rate fluctuation evaluation method according to an embodiment of the present invention;
FIG. 5 is a diagram illustrating an example of a frame rate fluctuation estimation method provided by an embodiment of the present invention;
fig. 6 is a schematic flowchart illustrating a frame rate fluctuation evaluation method according to an embodiment of the present invention;
FIG. 7 is a diagram illustrating a frame rate fluctuation estimation method according to an embodiment of the present invention;
fig. 8 is a functional block diagram of a frame rate fluctuation evaluating apparatus according to an embodiment of the present invention.
Icon: 10-system; 100-a mobile terminal; 110-a bus; 120-a processor; 130-a memory; 150-I/O module; 170 — a communication interface; 300-frame rate fluctuation evaluating means; 310-an acquisition module; 330-operation module.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. The components of embodiments of the present invention generally described and illustrated in the figures herein may be arranged and designed in a wide variety of different configurations.
Thus, the following detailed description of the embodiments of the present invention, presented in the figures, is not intended to limit the scope of the invention, as claimed, but is merely representative of selected embodiments of the invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present invention without making any creative effort, shall fall within the protection scope of the present invention.
It is noted that relational terms such as "first" and "second," and the like, may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.
Referring to fig. 1, a system 10 according to an embodiment of the invention is shown. In this embodiment, the system includes a mobile terminal and a server, where the mobile terminal and the server are located in a wireless network or a wired network, and the mobile terminal and the server perform data interaction through the wireless network or the wired network.
The mobile terminal provided by the embodiment of the invention can be a smart phone, a personal computer, a tablet computer, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, a Personal Digital Assistant (PDA) and the like. The embodiments of the present invention do not limit this.
The frame rate fluctuation assessment method provided by the embodiment of the invention is applied to the mobile terminal shown in fig. 1, wherein an application program is installed in the mobile terminal, corresponds to a server and is used for providing services for a user, and the frame rate fluctuation assessment method can be realized by the application program installed in the mobile terminal. For example, an APP (Application, mobile software) for watching live video may be installed in the mobile terminal, and the mobile terminal may execute frame rate fluctuation evaluation provided in the embodiment of the present Application by operating the APP, so that the frame rate of audio or video in the live video watching process can be evaluated.
For example, please refer to fig. 2, which is a block diagram of the mobile terminal 100 according to an embodiment of the present invention. Mobile terminal 100 includes bus 110, processor 120, memory 130, I/O module 150, and communication interface 170.
The processor 120 may receive commands from the above-described other elements (e.g., the memory 130, the I/O module 150, the communication interface 170, etc.) through the bus 110, may interpret the received commands, and may perform calculations or data processing according to the interpreted commands.
The processor 120 may be an integrated circuit chip having signal processing capabilities. The Processor 120 may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components.
The memory 130 may store commands or data received from the processor 120 or other elements (e.g., the I/O module 150, the communication interface 170, etc.) or commands or data generated by the processor 120 or other elements.
The Memory 130 may be, but is not limited to, a Random Access Memory (RAM), a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Read Only Memory (EPROM), an electrically Erasable Read Only Memory (EEPROM), and the like.
The I/O module 150 may receive commands or data input from a user via input-output means (e.g., a sensor, a keyboard, a touch screen, etc.) and may transmit the received commands or data to the processor 120 or the memory 130 through the bus 110. And also for displaying various information (e.g., multimedia data, text data) received, stored, processed from the above elements, and may display video, images, data, etc. to a user.
The communication interface 170 may be used for communicating signaling or data with other node devices.
It will be understood by those of ordinary skill in the art that the structure shown in fig. 2 is only an illustration and is not intended to limit the structure of the mobile terminal 100. For example, mobile terminal 100 may also include more or fewer components than shown in FIG. 2, or have a different configuration than shown in FIG. 2.
In the following, the mobile terminal 100 shown in fig. 2 is taken as an execution subject to execute each step in each method provided by the embodiment of the present invention, and achieve the corresponding technical effect.
The frame rate fluctuation evaluation method provided by the embodiment of the present invention will be explained in detail below. Referring to fig. 3, fig. 3 is a flowchart illustrating a frame rate fluctuation estimation method according to an embodiment of the present invention.
Step S202, in the current detection period, N frame rate queues corresponding to the video and audio data are obtained;
the detection period indicates that the frame rate fluctuation is detected once according to a preset duration, for example, the detection period is set to 20 seconds. The current detection period refers to a detection period corresponding to the current time, and if the current time is t, the current detection period is from the current time t to the past 20 seconds, and the current detection period may be represented as t-19 to t.
In the process of watching live broadcast, the data generating audio or video is video data. In order to analyze the fluctuation of the frame rate, a plurality of linked lists can be used for storing the frame rate of each second.
The N frame rate queues represent a plurality of linked lists for storing frame rates. Each frame rate queue comprises M continuous frame rates, namely each frame rate queue comprises the same number of continuous frame rates; the plurality of continuous frame rates are all frame rates generated in a time period and are arranged in sequence according to the time sequence, namely, the plurality of continuous frame rates stored in each frame rate queue correspond to one time period.
The N frame rate queues comprise 1 target frame rate queue and N-1 non-target frame rate queues; the target frame rate queue indicates that a plurality of continuous frame rates stored in the frame rate queue are all frame rates of the current detection period.
It will be appreciated that since a new frame rate is generated every second, the frame rate stored in each frame rate queue may be updated over time, such as once every second.
According to a preset detection period, the N frame rate queues can be acquired according to the current detection period.
Step S204, obtaining a plurality of frame rate change amplitude parameters;
it will be appreciated that the target frame rate queue stores the full frame rate of the current detection period, including the frame rate at the current time, and the non-target frame rate queue stores the frame rate prior to the current time.
The frame rate change amplitude parameter represents the fluctuation condition of the target frame rate queue relative to the non-target frame rate queue, that is, the frame rate of the current detection period changes relative to the frame rate before the current time. Alternatively, the difference between the frame rates in the target frame rate queue and the non-target frame rate queue may be calculated to obtain the frame rate variation amplitude parameter.
Step S206, according to the frame rate change amplitude parameters, obtaining a frame rate fluctuation quantization parameter corresponding to the target frame rate queue;
alternatively, each frame rate variation amplitude parameter may be quantized, for example, compared with a reference value, and then subjected to a scoring or scoring to obtain a frame rate fluctuation quantization parameter corresponding to the target frame rate queue.
Step S208, sending the frame rate fluctuation quantization parameter corresponding to the current detection period to a server;
optionally, the mobile terminal sends the obtained frame rate fluctuation quantization parameter to the server, that is, reports to the server, and it can be understood that the frame rate fluctuation quantization parameter has a corresponding relationship with the detection period. That is, in a detection period, the mobile terminal reports a frame rate fluctuation quantization parameter to the server. Compared with the prior art that the report is carried out every second, the report frequency is reduced based on the periodic report.
Through the steps, N frame rate queues corresponding to the video data are obtained in the current detection period, and each frame rate queue comprises the same number of continuous frame rates, namely M continuous frame rates, wherein the continuous frame rates comprise 1 target frame rate queue and N-1 non-target frame rate queues; then obtaining a plurality of frame rate change amplitude parameters, namely the fluctuation condition of the target frame rate queue relative to N-1 non-target frame rate queues; then obtaining frame rate fluctuation quantization parameters corresponding to the target frame rate queue, namely frame rate fluctuation quantization parameters corresponding to the current detection period; and finally, sending the frame rate fluctuation quantization parameter to a server. Therefore, the evaluation on the frame rate fluctuation condition can be realized, the reporting frequency is reduced, the occupation of application resources is reduced and the effect of saving resources is achieved by periodically reporting the frame rate fluctuation quantitative parameters to the server.
The frame rate variation amplitude parameter is an important parameter in frame rate estimation, and is related to accuracy of frame rate estimation, and an embodiment of the present invention provides a possible implementation manner for obtaining the frame rate variation amplitude parameter, and as shown in fig. 4, the frame rate variation amplitude parameter is a flowchart of a frame rate fluctuation estimation method provided in the embodiment of the present invention.
For better understanding, the following description will be made in detail with reference to the example of fig. 5. Referring to fig. 5, where the current time is t, the current detection period is t-19 to t, N is 3, and 3 frame rate queues are the 1 st frame rate queue, the 2 nd frame rate queue, and the 3 rd frame rate queue; each frame rate queue includes 20 frame rates, i.e. M is 20.
The 1 st frame rate queue is a target frame rate queue, and the 2 nd frame rate queue and the 3 rd frame rate queue are non-target frame rate queues; the 1 st frame rate queue stores all the frame rates of the current detection period t-19 to t.
Q is 4, the destination frame rate queue, i.e. the 1 st frame rate queue, includes 4 destination sub-frame rate queues, the non-destination frame rate queue, i.e. the 2 nd frame rate queue, includes 4 non-destination sub-frame rate queues, and the 3 rd frame rate queue also includes 4 non-destination sub-frame rate queues.
Step S204-1, obtaining the target average frame rate of each target sub-frame rate queue and the non-target average frame rate of each non-target sub-frame rate queue;
each target subframe rate queue comprises a plurality of frame rates, each target subframe rate queue has a corresponding time length, and the target average frame rate of each target subframe rate queue can be calculated according to the ratio of the sum of the frame rates in each target subframe rate queue to the corresponding time length. It will be appreciated that the non-target average frame rate of each non-target sub-frame rate queue is calculated in a similar manner.
As shown in (a1) of fig. 5, a1 to a4 respectively represent the target average frame rate of each target sub-frame rate queue in the 1 st frame rate queue; B1-B4 respectively represent the non-target average frame rate of each non-target sub-frame rate queue in the 2 nd frame rate queue; C1-C4 respectively indicate the average frame rate of each non-target sub-frame rate queue in the 3 rd frame rate queue.
It will be appreciated that the frame rate queues, whether target or non-target, are the same as the sub-frame rate queues. That is, each frame rate queue contains M frame rates, each frame rate queue includes Q subframe rate queues, Q is smaller than M, and the average frame rate of each subframe rate queue is calculated, so that M frame rates can be represented by Q average frame rates, and the calculation amount of data can be reduced.
As shown in fig. 5 (a1), each frame rate queue has 20 frame rates, each frame rate queue includes 4 sub-frame rate queues, and each frame rate queue obtains 4 average frame rates. For a frame rate queue, 20 frame rates can be represented by 4 average frame rates, and the operation amount in the subsequent steps can be reduced by reducing 16 data.
Step S204-3, obtaining N-1 frame rate difference values corresponding to a q-th target sub-frame rate queue respectively based on a q-th target average frame rate of the target frame rate queue and a q-th non-target average frame rate of each non-target frame rate queue;
it will be appreciated that there are Q target sub-frame rate queues for the target frame rate queue, and thus Q target average frame rates for each non-target frame rate queue.
Optionally, each target average frame rate of the target frame rate queue and the corresponding non-target average frame rate in each non-target frame rate queue may be subtracted to obtain an absolute value, so as to obtain N-1 frame rate difference values corresponding to each target subframe rate queue.
As shown in (a2) of fig. 5, the frame rate difference item represents 2 frame rate differences corresponding to each target sub-frame rate queue in the target frame rate queue, that is, the 1 st frame rate queue, and specifically, the following is:
when q is equal to 1, based on the 1 st target average frame rate a1 of the 1 st frame rate queue and the 1 st non-target average frame rate B1 of the 2 nd frame rate queue, obtaining a frame rate difference d 1;
based on the 1 st target average frame rate A1 of the 1 st frame rate queue and the 1 st non-target average frame rate C1 of the 3 rd frame rate queue, obtaining a frame rate difference e 1;
the 1 st target sub-frame rate queue of the 1 st frame rate queue is obtained, and the corresponding 2 frame rate difference values are d1 and e 1.
When q is 2, based on the 2 nd target average frame rate a2 of the 1 st frame rate queue and the 2 nd non-target average frame rate B2 of the 2 nd frame rate queue, obtaining a frame rate difference d 2;
based on the 2 nd target average frame rate A2 of the 1 st frame rate queue and the 2 nd non-target average frame rate C2 of the 3 rd frame rate queue, obtaining a frame rate difference e 2;
the 2 nd target sub-frame rate queue of the 1 st frame rate queue is obtained, and the corresponding 2 frame rate difference values are d2 and e 2.
When q is 3, based on the 3 rd target average frame rate A3 of the 1 st frame rate queue and the 3 rd non-target average frame rate B3 of the 2 nd frame rate queue, obtaining a frame rate difference d 3;
based on the 3 rd target average frame rate A3 of the 1 st frame rate queue and the 3 rd non-target average frame rate C3 of the 3 rd frame rate queue, obtaining a frame rate difference e 3;
the 3 rd target sub-frame rate queue of the 1 st frame rate queue is obtained, and the corresponding 2 frame rate difference values are d3 and e 3.
When q is 4, based on the 4 th target average frame rate A4 of the 1 st frame rate queue and the 4 th non-target average frame rate B4 of the 2 nd frame rate queue, obtaining a frame rate difference d 4;
obtaining a frame rate difference e4 based on the 4 th target average frame rate A4 of the 1 st frame rate queue and the 4 th non-target average frame rate C4 of the 3 rd frame rate queue;
the 4 th target sub-frame rate queue of the 1 st frame rate queue is obtained, and the corresponding 2 frame rate difference values are d4 and e 4.
Step S204-5, taking the maximum value of the N-1 frame rate difference values corresponding to each target sub-frame rate queue as a frame rate change amplitude parameter to obtain Q frame rate change amplitude parameters;
optionally, for each target sub-frame rate queue, taking a maximum value of the frame rate difference values corresponding to the target sub-frame rate queues as a frame rate variation amplitude parameter, and obtaining Q frame rate variation amplitude parameters if there are Q target sub-frame rate queues.
As shown in fig. 5 (a2), the frame rate variation parameter item represents each destination sub-frame rate queue in the 1 st frame rate queue, and the frame rate variation parameter corresponds to the following details:
the frame rate difference e1 is greater than the frame rate difference d1, and the frame rate difference e1 is the 1 st target sub-frame rate queue of the 1 st frame rate queue, and the corresponding frame rate change amplitude parameter;
the frame rate difference d2 is greater than the frame rate difference e2, and the frame rate difference d2 is the 2 nd target sub-frame rate queue of the 1 st frame rate queue, and the corresponding frame rate change amplitude parameter;
the frame rate difference d3 is greater than the frame rate difference e3, and the frame rate difference d3 is the 3 rd target sub-frame rate queue of the 1 st frame rate queue, and the corresponding frame rate change amplitude parameter;
the frame rate difference e4 is greater than the frame rate difference d4, and the frame rate difference e4 is the 4 th target sub-frame rate queue of the 1 st frame rate queue, corresponding to the frame rate variation range parameter.
According to the 4 target sub-frame rate queues, 4 frame rate change amplitude parameters, namely e1, d2, d3 and e4, are obtained.
In the step S206, a frame rate fluctuation quantization parameter is obtained according to a plurality of frame rate variation amplitude parameters, which is provided by the embodiment of the present invention. As shown in fig. 6, step S206 further includes the steps of:
step S206-1, according to the preset range, scoring each frame rate change amplitude parameter;
and step S206-3, taking the total score value of the frame rate change amplitude parameters as the frame rate quantization parameter.
The preset range is several preset ranges, and each range represents the fluctuation or stable condition of the frame rate.
For example, the preset ranges may be set to (0, 3), (3, 5), (5, + ∞). Wherein, (0, 3) represents that the frame rate has small fluctuation and is stable; (3, 5) indicating frame rate fluctuation in general; (5, + ∞) indicates that the frame rate is fluctuating and unstable. It can be understood that the setting mode of the preset range can be set according to actual requirements, and the embodiment of the present invention is not limited.
According to the 4 frame rate variation amplitude parameters e1, d2, d3, and e4 in the above embodiment, a score is performed according to a range in which each frame rate variation amplitude parameter is located, and a scoring mode may be set according to an actual requirement, which is not limited in the embodiment of the present invention. The embodiment of the invention provides a possible implementation mode.
If the frame rate change amplitude parameter is in the range of (0, 3), the frame rate change amplitude parameter is counted as 1 point; if the frame rate variation amplitude parameter is within the range of (3, 5), the frame rate variation amplitude parameter is counted as 0.5 min; if the frame rate variation range parameter is within the range of (5, infinity), the value is 0 point; and adding the scores of the 4 frame rate change amplitude parameters to obtain a total score value, namely the frame rate quantization parameter.
Alternatively, the preset ranges may also be set to (0, 0.15), (0.15, 0.3), (0.3, + ∞). Wherein, (0, 0.15) represents that the frame rate fluctuation is small and stable; (0.15, 0.3) indicates that the frame rate fluctuates in general; (0.3, + ∞) indicates that the frame rate is fluctuating and unstable.
According to the 4 frame rate variation amplitude parameters e1, d2, d3 and e4 in the above embodiment, the ratio of the 4 frame rate variation amplitude parameters to the corresponding 4 target average frame rates in the 1 st frame rate queue is calculated to obtain the 4 frame rate relative differences, i.e. e1/a1, d2/a2, d3/A3 and e4/a 4.
And grading according to the range of the relative difference value of each frame rate. If the relative difference value of the frame rates is within the range of (0, 0.15), the frame rate is counted as 1 point; if the relative difference value of the frame rates is within the range of (0.15, 0.3), the frame rate is counted as 0.5 min; if the frame rate relative difference is within the range of (0.3, + ∞), it is 0 min; and adding the scores of the 4 frame rate relative difference values to obtain a total score value which is the frame rate quantization parameter.
It can be understood that the obtained total score value and the total number of the frame rate change amplitude parameters may also be jointly used as a frame rate quantization parameter to be sent to the server, and the server may evaluate the fluctuation condition of the frame rate according to the ratio of the total score value to the total number of the frame rate change amplitude parameters.
It can be understood that the frame rate fluctuation is evaluated by the ratio, and the scoring of the frame rate fluctuation parameters is to obtain the level of each frame rate fluctuation parameter, i.e. good, medium, and bad, if there are three levels. The fluctuation condition of the frame rate can be evaluated according to the frame rate change amplitude parameter with good grade and the proportion of the frame rate change amplitude parameter in all the frame rate change amplitude parameters. If the levels of all frame rate variation amplitude parameters are good, the percentage is 100%, which indicates that the frame rate fluctuation condition is very stable.
The frame rate change amplitude parameter is converted into a frame rate relative difference value, namely, the frame rate change amplitude parameter is subjected to normalization processing, so that the method can be suitable for various service scenes for evaluating the frame rate, and the applicability and the robustness are improved.
Optionally, in order to reduce the amount of computation, the queue length of each frame rate queue may be set to be the same length, and the target frame rate queue and each non-target frame rate queue have a preset time difference, the preset time difference is a preset value N-1 times, the preset value is a common divisor of the queue lengths, and N is a natural number greater than 1 and less than or equal to N.
Fig. 7 is an exemplary diagram provided by an embodiment of the present invention. The current detection period is t-19-t, and the current detection period comprises 3 frame rate queues, namely N is 3, the 1 st frame rate queue is a target frame rate queue, and the 2 nd frame rate queue and the 3 rd frame rate queue are non-target frame rate queues. The queue length of the 3 frame rate queues is 20, the preset value is 5 seconds, and n can be natural numbers 1 and 2.
The 1 st frame rate queue stores the frame rate of the current detection period t-19 to t. When the preset time difference between the 2 nd frame rate queue and the 1 st frame rate queue is n equal to 1, namely 5 seconds. The 2 nd frame rate queue stores the frame rates in the time period from t-24 to t-5.
When the preset time difference between the 3 rd frame rate queue and the 1 st frame rate queue is n equal to 2, namely 10 seconds. The 3 rd frame rate queue stores the frame rates in the time period from t-29 to t-10.
The preset value is a common divisor of the queue length, each frame rate queue is divided into a plurality of subframe rate queues according to the preset value, the number of frame rates of each target subframe rate queue and each non-target subframe rate can be the same, and the fluctuation condition of the frame rate can be better reflected and the operation amount can be further reduced based on the calculated target average frame rate and the non-target average frame rate.
As shown in fig. 7, the preset value is 5 seconds, the queue length is 20, and the 1 st frame rate queue includes 4 target sub-frame rate queues. The 2 nd frame rate queue includes 4 non-target sub-frame rate queues, and the 3 rd frame rate queue also includes 4 non-target sub-frame rate queues.
The 1 st target sub-frame rate queue of the 1 st frame rate queue stores frame rates from t-19 to t-15; the 1 st non-target sub-frame rate queue of the 2 nd frame rate queue stores the frame rates from t-24 to t-20; the 1 st non-target sub-frame rate queue of the 3 rd frame rate queue stores frame rates from t-29 to t-25; the 3 time periods of t-19 to t-15, t-24 to t-20 and t-29 to t-25 are continuous.
Based on the 3 continuous time periods, the calculated target average frame rate and the calculated non-target average frame rate can effectively reflect the frame rate of the time period from t-19 to t-15, and compared with the frame rate change of the previous time periods, namely from t-24 to t-20 and from t-29 to t-25, the repeated calculation of certain frame rates can be avoided, so that the calculation amount is reduced.
It can be understood that the frame rate in each frame rate queue is updated with time, and in each detection period, the frame rate fluctuation quantization parameter corresponding to the current detection period is obtained, and a timer may be used to record the time when the frame rate fluctuation quantization parameter is sent.
And when the accumulated value of the timer is zero, obtaining a frame rate fluctuation quantization parameter corresponding to the current detection period, and sending the frame rate fluctuation quantization parameter to the server.
When the accumulated value of the timer is a preset time threshold, calculating a frame rate fluctuation quantization parameter corresponding to the next detection period, where the preset time threshold may be equal to the time length of the detection period.
If 20 seconds is taken as a detection period, the preset time threshold is set to be 20 seconds, and the timer accumulates 1 every 1 second. When a detection period starts, the timer is zero, the frame rate fluctuation quantization parameter of the current detection period is calculated and sent to the server.
And when the timer accumulated value is 20, which indicates that one detection period is ended, clearing the timer accumulated value, and acquiring N frame rate queues corresponding to the next detection period to obtain a frame rate fluctuation quantization parameter corresponding to the next detection period. And according to the circulation, obtaining the frame rate fluctuation quantization parameter corresponding to each detection period and sending the frame rate fluctuation quantization parameter to the server.
In order to execute the corresponding steps in the above embodiments and various possible manners, an implementation manner of the frame rate fluctuation estimation apparatus is given below, please refer to fig. 8, and fig. 8 is a functional block diagram of the frame rate fluctuation estimation apparatus 300 provided in this application. It should be noted that the basic principle and the generated technical effect of the frame rate fluctuation estimation apparatus 300 provided in the present application are the same as those of the foregoing embodiments, and for the sake of brief description, no part of this embodiment is mentioned, and no further description is provided herein, and reference may be made to the corresponding contents in the foregoing embodiments. The frame rate fluctuation evaluating apparatus 300 includes: an obtaining module 310 and an operation module 330.
An obtaining module 310, configured to obtain N frame rate queues corresponding to the video data in a current detection period; each frame rate queue comprises M continuous frame rates; the N frame rate queues comprise 1 target frame rate queue and N-1 non-target frame rate queues; the target frame rate queue comprises all frame rates of the current detection period;
an operation module 330, configured to obtain a plurality of frame rate variation amplitude parameters; the frame rate change amplitude parameters represent the fluctuation condition of the target frame rate queue relative to N-1 non-target frame rate queues;
obtaining frame rate fluctuation quantization parameters corresponding to the target frame rate queue according to the frame rate change amplitude parameters;
and sending the frame rate fluctuation quantization parameter corresponding to the current detection period to a server.
Optionally, the operation module 330 is further configured to: obtaining a target average frame rate of each target sub-frame rate queue and a non-target average frame rate of each non-target sub-frame rate queue;
respectively obtaining N-1 frame rate difference values corresponding to a q-th target sub-frame rate queue based on a q-th target average frame rate of the target frame rate queue and a q-th non-target average frame rate of each non-target frame rate queue; q is a natural number of 1 or more and Q or less;
and taking the maximum value of the N-1 frame rate difference values corresponding to each target sub-frame rate queue as a frame rate change amplitude parameter to obtain Q frame rate change amplitude parameters.
Optionally, the operation module 330 is further configured to: according to a preset range, scoring each frame rate change amplitude parameter;
and taking the total score value of the frame rate change amplitude parameters as a frame rate quantization parameter.
Optionally, the operation module 330 is further configured to: obtaining a timer accumulated value;
when the accumulated value of the timer is zero, sending a frame rate fluctuation quantization parameter corresponding to the current detection period to a server;
and when the timer accumulated value is the preset time threshold, clearing the timer accumulated value to obtain the frame rate fluctuation quantization parameter corresponding to the next detection period.
Optionally, the queue length of each frame rate queue in the obtaining module 310 is the same; the target frame rate queue and each non-target frame rate queue have a preset time difference; presetting a preset value with the time difference of n-1 times; the preset value is a common divisor of the queue length; n is a natural number greater than 1 and not greater than N.
The invention further provides a mobile terminal, which includes a processor 120 and a memory 130, where the memory 130 stores a computer program, and when the processor executes the computer program, the method for frame rate fluctuation estimation disclosed in the above embodiments is implemented.
Embodiments of the present invention further provide a storage medium, on which a computer program is stored, where the computer program is executed by the processor 120 to implement the frame rate fluctuation estimation method disclosed in the embodiments of the present invention.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method can be implemented in other ways. The apparatus embodiments described above are merely illustrative, and for example, the flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In addition, the functional modules in the embodiments of the present invention may be integrated together to form an independent part, or each module may exist alone, or two or more modules may be integrated to form an independent part.
The functions, if implemented in the form of software functional modules and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. A frame rate fluctuation assessment method is applied to a mobile terminal, and comprises the following steps:
in the current detection period, N frame rate queues corresponding to the video data are obtained; each frame rate queue comprises M frame rates; the N frame rate queues comprise 1 target frame rate queue and N-1 non-target frame rate queues; the target frame rate queue comprises all frame rates of the current detection period; the M frame rates are sequentially arranged according to a time sequence;
obtaining a plurality of frame rate change amplitude parameters; the frame rate change amplitude parameters represent the fluctuation condition of the target frame rate queue relative to the N-1 non-target frame rate queues;
obtaining frame rate fluctuation quantization parameters corresponding to the target frame rate queue according to the frame rate change amplitude parameters;
and sending the frame rate fluctuation quantization parameter corresponding to the current detection period to a server.
2. The method of claim 1, wherein the target frame rate queue comprises Q target subframe rate queues; each non-target frame rate queue comprises Q non-target sub-frame rate queues; the step of obtaining a plurality of frame rate variation amplitude parameters includes:
obtaining a target average frame rate of each target sub-frame rate queue and a non-target average frame rate of each non-target sub-frame rate queue;
respectively obtaining N-1 frame rate difference values corresponding to a q-th target sub-frame rate queue based on a q-th target average frame rate of the target frame rate queue and a q-th non-target average frame rate of each non-target frame rate queue; the Q is a natural number which is more than or equal to 1 and less than or equal to Q;
and taking the maximum value of the N-1 frame rate difference values corresponding to each target sub-frame rate queue as a frame rate change amplitude parameter to obtain Q frame rate change amplitude parameters.
3. The method according to claim 2, wherein the step of obtaining the frame rate fluctuation quantization parameter corresponding to the target frame rate queue according to the frame rate variation amplitude parameters comprises:
according to a preset range, scoring each frame rate change amplitude parameter;
and taking the total score value of the frame rate change amplitude parameters as the frame rate fluctuation quantization parameter.
4. The method according to claim 2 or 3, wherein the queue length of each frame rate queue is the same; the target frame rate queue and each non-target frame rate queue have a preset time difference; the preset time difference is a preset value which is n-1 times; the preset value is a common divisor of the queue length; and N is a natural number which is more than 1 and less than or equal to N.
5. The method of claim 3, further comprising:
obtaining a timer accumulated value;
when the accumulated value of the timer is zero, sending a frame rate fluctuation quantization parameter corresponding to the current detection period to a server;
and when the timer accumulated value is a preset time threshold value, clearing the timer accumulated value to zero to obtain a frame rate fluctuation quantization parameter corresponding to the next detection period.
6. A frame rate fluctuation assessment apparatus applied to a mobile terminal, the apparatus comprising:
the acquisition module is used for acquiring N frame rate queues corresponding to the video data in the current detection period; each frame rate queue comprises M frame rates; the N frame rate queues comprise 1 target frame rate queue and N-1 non-target frame rate queues; the target frame rate queue comprises all frame rates of the current detection period; the M frame rates are sequentially arranged according to a time sequence;
the operation module is used for obtaining a plurality of frame rate change amplitude parameters; the frame rate change amplitude parameters represent the fluctuation condition of the target frame rate queue relative to the N-1 non-target frame rate queues;
obtaining frame rate fluctuation quantization parameters corresponding to the target frame rate queue according to the frame rate change amplitude parameters;
and sending the frame rate fluctuation quantization parameter corresponding to the current detection period to a server.
7. The apparatus of claim 6, wherein the target frame rate queue comprises Q target subframe rate queues; each non-target frame rate queue comprises Q non-target sub-frame rate queues; the operation module is further configured to:
obtaining a target average frame rate of each target sub-frame rate queue and a non-target average frame rate of each non-target sub-frame rate queue;
respectively based on the q-th target average frame rate of the target frame rate queue and the q-th non-target average frame rate of each non-target frame rate queue; obtaining N-1 frame rate difference values corresponding to the q-th target sub-frame rate queue; the Q is a natural number which is more than or equal to 1 and less than or equal to Q;
and taking the maximum value of the N-1 frame rate difference values corresponding to each target sub-frame rate queue as a frame rate change amplitude parameter to obtain Q frame rate change amplitude parameters.
8. A mobile terminal, characterized in that it comprises a processor and a memory, said memory storing a computer program which, when executed by said processor, implements the method of any of claims 1 to 5.
9. A system comprising a mobile terminal and a server, wherein said mobile terminal is communicatively coupled to said server;
the mobile terminal is used for executing the frame rate fluctuation assessment method of any one of claims 1 to 5;
and the server is used for evaluating the frame rate fluctuation condition according to the received frame rate fluctuation quantization parameter.
10. A storage medium, characterized in that the storage medium has stored thereon a computer program which, when executed by a processor, implements the method of any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110460667.XA CN113194306B (en) | 2021-04-27 | 2021-04-27 | Frame rate fluctuation evaluation method and device, mobile terminal, system and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110460667.XA CN113194306B (en) | 2021-04-27 | 2021-04-27 | Frame rate fluctuation evaluation method and device, mobile terminal, system and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113194306A CN113194306A (en) | 2021-07-30 |
| CN113194306B true CN113194306B (en) | 2022-07-08 |
Family
ID=76979642
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110460667.XA Active CN113194306B (en) | 2021-04-27 | 2021-04-27 | Frame rate fluctuation evaluation method and device, mobile terminal, system and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113194306B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114115773B (en) * | 2021-10-20 | 2024-06-07 | 杭州逗酷软件科技有限公司 | Frame rate adjusting method, device, storage medium and terminal equipment |
| CN114900720B (en) * | 2022-04-02 | 2023-11-21 | 杭州星犀科技有限公司 | Method, system, electronic device and storage medium for evaluating fluency of media stream |
| CN117255179B (en) * | 2023-11-14 | 2024-02-02 | 北京灵赋生物科技有限公司 | Track monitoring system based on image tag identification guide |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101448157A (en) * | 2008-12-30 | 2009-06-03 | 杭州华三通信技术有限公司 | Video encoding method and video encoder |
| US9940904B2 (en) * | 2013-10-23 | 2018-04-10 | Intel Corporation | Techniques for determining an adjustment for a visual output |
| CN106303515B (en) * | 2016-09-26 | 2018-08-07 | 广州华多网络科技有限公司 | A kind of online live video quality detecting method and device |
| CN107864378A (en) * | 2017-11-10 | 2018-03-30 | 维沃移动通信有限公司 | A kind of frame rate detection method, device, mobile terminal and server |
| CN110209539B (en) * | 2018-02-28 | 2021-10-01 | 华为技术有限公司 | Test method, terminal equipment and tester |
| CN108427630B (en) * | 2018-03-15 | 2021-06-11 | 腾讯科技（深圳）有限公司 | Performance information acquisition method, device, terminal and computer readable storage medium |
-
2021
- 2021-04-27 CN CN202110460667.XA patent/CN113194306B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN113194306A (en) | 2021-07-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113194306B (en) | Frame rate fluctuation evaluation method and device, mobile terminal, system and storage medium | |
| CN106951925B (en) | Data processing method, device, server and system | |
| CN110009429B (en) | Method and device for predicting flow data and computer equipment | |
| CN111478963B (en) | Message pushing method and device, electronic equipment and computer readable storage medium | |
| CN111626780B (en) | Information pushing method, device, server side and storage medium | |
| CN112650921B (en) | Object recommendation method, device, equipment and storage medium | |
| US20180011864A1 (en) | Media information presentation system | |
| CN111459783A (en) | Application program optimization method and device, electronic equipment and storage medium | |
| CN113569965A (en) | User behavior analysis method and system based on Internet of things | |
| CN109684546B (en) | Recommendation method, recommendation device, storage medium and terminal | |
| CN110825787A (en) | Data reminding method and device, electronic equipment and storage medium | |
| CN113590017B (en) | Method, electronic device and computer program product for processing data | |
| CN110888811B (en) | Code coverage rate information processing method and device, electronic equipment and medium | |
| CN113626705B (en) | User retention analysis method, device, electronic equipment and storage medium | |
| CN116795628A (en) | Power consumption processing method of terminal equipment, terminal equipment and readable storage medium | |
| CN114143571B (en) | User processing method, device, equipment and storage medium | |
| CN114330929B (en) | Content contribution evaluation method, device, electronic equipment and readable storage medium | |
| CN113127333B (en) | Data processing method and device, electronic equipment and storage medium | |
| CN113656275B (en) | User activity prediction method, device, electronic equipment and storage medium | |
| CN109285035B (en) | Method, device, equipment and storage medium for predicting application retention data | |
| CN114867046B (en) | Wireless network equipment firmware updating method and wireless network equipment | |
| CN114448808A (en) | Peak clipping method and device and electronic equipment | |
| CN113726903B (en) | Data uploading method and device | |
| CN109063206B (en) | Article monitoring method and device | |
| CN111135583B (en) | Data processing method, device, server and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |