CN112057842B - Frame rate control method and device and electronic equipment - Google Patents
Frame rate control method and device and electronic equipment Download PDFInfo
- Publication number
- CN112057842B CN112057842B CN202010953712.0A CN202010953712A CN112057842B CN 112057842 B CN112057842 B CN 112057842B CN 202010953712 A CN202010953712 A CN 202010953712A CN 112057842 B CN112057842 B CN 112057842B
- Authority
- CN
- China
- Prior art keywords
- frame rate
- frame
- image content
- rate control
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
- A63F13/214—Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads
- A63F13/2145—Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads the surface being also a display device, e.g. touch screens
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/25—Output arrangements for video game devices
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/50—Controlling the output signals based on the game progress
- A63F13/52—Controlling the output signals based on the game progress involving aspects of the displayed game scene
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/70—Game security or game management aspects
- A63F13/77—Game security or game management aspects involving data related to game devices or game servers, e.g. configuration data, software version or amount of memory
Abstract
The embodiment of the application discloses a frame rate control method, a frame rate control device and electronic equipment. The method comprises the following steps: in the display process of the image content, acquiring target pressing data corresponding to pressing operation acting on the touch display screen; acquiring frame rate control parameters corresponding to the target compression data, wherein the frame rate control parameters comprise a target frame rate; generating a corresponding insertion frame based on the frame rate control parameter, and inserting the insertion frame into the image content so that the frame rate of the image content into which the insertion frame is inserted satisfies the target frame rate. Therefore, a new insertion frame is generated and inserted into the image content through the target pressing data corresponding to the pressing operation acted on the touch display screen, so that the frame rate of the image content is adjusted, the frame rate of the image content can be flexibly switched along with the pressing operation of a user in the display process of the image content, and the flexibility of frame rate control in the frame rate control process is improved.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to a frame rate control method, a frame rate control device, and an electronic device.
Background
In a game scene, video playing fluency can be improved by inserting frames into a game picture. However, in the related technical scheme, the frame inserting mode is preset in advance at the system end, so that the frame inserting can be performed only according to the fixed frame inserting mode no matter what scene, and the frame inserting process is lack of flexibility.
Disclosure of Invention
In view of the above, the present application provides a frame rate control method, apparatus and electronic device, so as to improve the above problem.
In a first aspect, the present application provides a frame rate control method applied to an electronic device configured with a touch display screen, where the method includes: in the display process of the image content, acquiring target pressing data corresponding to pressing operation acting on the touch display screen; acquiring frame rate control parameters corresponding to the target compression data, wherein the frame rate control parameters comprise a target frame rate; generating a corresponding insertion frame based on the frame rate control parameter, and inserting the insertion frame into the image content so that the frame rate of the image content into which the insertion frame is inserted satisfies the target frame rate.
In a second aspect, the present application provides a frame rate control apparatus, which operates on an electronic device configured with a touch display screen, the apparatus comprising: the target pressing data acquisition unit is used for acquiring target pressing data corresponding to pressing operation acting on the touch display screen in the display process of the image content; a frame rate parameter obtaining unit, configured to obtain a frame rate control parameter corresponding to the target compression data, where the frame rate control parameter includes a target frame rate; and the frame rate control unit is used for generating a corresponding inserted frame based on the frame rate control parameter and inserting the inserted frame into the image content so that the frame rate of the image content inserted with the inserted frame meets the target frame rate.
In a third aspect, the present application provides an electronic device, including a frame insertion chip, a processor, and a memory; one or more programs are stored in the memory and configured to be executed by the framing chip and/or the processor to implement the methods described above.
In a fourth aspect, the present application provides a computer readable storage medium having program code stored therein, wherein the above method is performed when the program code is executed by a framing chip and/or the processor.
According to the frame rate control method, the frame rate control device and the electronic equipment, in the display process of image content, target pressing data corresponding to pressing operation acting on the touch display screen are obtained, then frame rate control parameters corresponding to the target pressing data are obtained, the frame rate control parameters comprise target frame rates, corresponding inserting frames are generated based on the frame rate control parameters, and the inserting frames are inserted into the image content, so that the frame rate of the image content inserted into the inserting frames meets the target frame rate. Therefore, a new insertion frame is generated and inserted into the image content through the target pressing data corresponding to the pressing operation acted on the touch display screen, so that the frame rate of the image content is adjusted, the frame rate of the image content can be flexibly switched along with the pressing operation of a user in the display process of the image content, and the flexibility of frame rate control in the frame rate control process is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the description of the embodiments will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Fig. 1 shows a flowchart of a frame rate control method according to an embodiment of the present application;
FIG. 2 is a schematic diagram of determining a corresponding frame rate control interval according to an embodiment of the present application;
FIG. 3 is a schematic diagram showing the addition of an insertion frame to image content in an embodiment of the present application;
FIG. 4 is a schematic diagram showing the addition of image content of an inserted frame in an embodiment of the present application;
fig. 5 is a flowchart illustrating a frame rate control method according to another embodiment of the present application;
FIG. 6 is a schematic diagram of a multiple press operation in a current cycle in an embodiment of the application;
FIG. 7 is a schematic diagram showing the addition of an insertion frame to image content in an embodiment of the present application;
FIG. 8 is a schematic diagram showing the addition of image content of an inserted frame in an embodiment of the present application;
Fig. 9 is a flowchart of a frame rate control method according to still another embodiment of the present application;
fig. 10 is a flowchart illustrating a frame rate control method according to still another embodiment of the present application;
fig. 11 is a block diagram showing a frame rate control apparatus according to another embodiment of the present application;
fig. 12 shows a block diagram of an electronic device for performing a frame rate control method according to an embodiment of the present application;
fig. 13 is a memory unit for storing or carrying program codes for implementing a frame rate control method according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
The popularity of electronic devices has become a major trend in the cell phone market due to the advent of the mobile internet age. The appearance of electronic devices changes the life style of many people and the demands of traditional communication tools, and as the demands of users increase, people are no longer satisfied with the appearance and the basic functions of the electronic devices, and pursue of the electronic devices is started to bring more, stronger and more personalized functional services to people. Such as video play, games, etc. Wherein, the display process of the image content is involved in both video playing scenes and game scenes. The image content displayed in the video playing scene is a video picture, and the image content displayed in the game scene can comprise a game picture.
However, after studying the display process of the related image content, the inventor finds that in order to facilitate the improvement of the display effect of the image content in the display process, the smoothness of the image content can be improved by inserting frames into the image content. However, after further research on the frame insertion, the inventor finds that the frame insertion is performed based on the fixed frame insertion, so that the flexibility of the video frame insertion process is poor, and the power consumption is wasted because the frame insertion is performed by adopting the fixed frame insertion. For example, if the electronic device determines that the frame inserting target is 60fps (the number of frames displayed per second) during the frame inserting process of the image content, the electronic device uses this fixed manner to insert frames into the image content, so that the frame rate of the image content after frame inserting is always kept at 60fps, and further, flexibility is not provided. Moreover, the inventor finds that in some scenes, the frame rate is improved by inserting frames, so that a user has no obvious visual experience, and the frame inserting process actually causes waste of power consumption.
Furthermore, it can be understood that the frame to be generated in the frame inserting process is drawn by the GPU in the relevant frame inserting process, and if the frame rate is kept high, the GPU is always in a high workload state.
Accordingly, the inventors have proposed a frame rate control method, apparatus, and electronic device in which the above-described problems can be improved by acquiring target pressing data corresponding to a pressing operation acting on the touch display screen during display of image content, and then acquiring frame rate control parameters corresponding to the target pressing data, the frame rate control parameters including a target frame rate, and generating a corresponding insertion frame based on the frame rate control parameters, and inserting the insertion frame into the image content such that the frame rate of the image content into which the insertion frame is inserted satisfies the target frame rate. Therefore, the frame rate of the image content is adjusted by the target pressing data corresponding to the pressing operation acting on the touch display screen, so that the frame rate of the image content can be flexibly switched along with the pressing operation of a user in the display process of the image content, and the flexibility of frame rate control in the frame rate control process is improved.
Embodiments of the present application will be described in detail below with reference to the accompanying drawings.
Referring to fig. 1, a frame rate control method provided by an embodiment of the present application is applied to an electronic device configured with a touch display screen, and the method includes:
S110: and in the display process of the image content, acquiring target pressing data corresponding to the pressing operation acted on the touch display screen.
The frame rate control method provided by the embodiment of the application can be operated under various image content display scenes, and the image content displayed under different scenes (namely, the image content display scenes) can be different. Optionally, in the video playing scene, the image content may be understood as a video picture, and correspondingly, in the display process of the video picture, target pressing data corresponding to the pressing operation acting on the touch display screen may be obtained. Optionally, in the game scene, the image content may be a game picture in the game running process, and then, correspondingly, in the display process of the game picture, target pressing data corresponding to the pressing operation acting on the touch display screen is obtained.
In the embodiment of the present application, the target pressing data corresponding to the pressing operation is acquired to perform the subsequent frame rate control. In addition, in this embodiment, the target pressing data may be data related to pressing forces of pressing operations, for example, an average value of pressing forces of multiple pressing operations acting on the touch display screen in a specified period of time, or a maximum pressing force of pressing forces of multiple pressing operations acting on the touch display screen in a specified period of time. The target pressing data may be data related to the pressing frequency of the pressing operation, for example, the number of times of pressing the plurality of pressing operations applied to the touch display screen in a predetermined period of time.
S120: and acquiring a frame rate control parameter corresponding to the target compression data, wherein the frame rate control parameter comprises a target frame rate.
In this embodiment, a correspondence between the target compression data and the frame rate control parameter may be established in advance, and then the frame rate control parameter corresponding to the target compression data may be acquired through the correspondence after the target compression data is acquired. In this embodiment, there may be a plurality of ways to establish the correspondence.
As one way, a one-to-one correspondence between the target compression data and the frame rate control parameter may be established. In this way, a correspondence table including a plurality of target compression data and respective corresponding frame rate control parameters may be established in advance, and then after the target compression data is acquired through S110, the corresponding frame rate control parameters may be acquired by querying the correspondence table. Illustratively, the correspondence table stores a frame rate control parameter z1 for the target compression data a, a frame rate control parameter z2 for the target compression data B, and a frame rate control parameter z3 for the target compression data C. Then, in the case where the target compression data a is acquired through S110, the acquired frame rate control parameter is the frame rate control parameter z1.
Alternatively, a plurality of frame rate control sections may be configured, each frame rate control section corresponding to one frame rate control parameter, and the frame rate control parameters corresponding to different frame rate control sections being different. Further, in this manner, one frame rate control section may be selected from the plurality of frame rate control sections as the frame rate control section corresponding to the acquired target compression data, and the frame rate control parameter corresponding to the frame rate control section corresponding to the target compression data may be acquired as the basis for the subsequent image content display control.
Alternatively, the plurality of configured frame rate control sections may include a frame rate control section a, a frame rate control section b, a frame rate control section c, and a frame rate control section d. Wherein frame rate control section a corresponds to frame rate control parameter z1, frame rate control section b corresponds to frame rate control parameter z2, frame rate control section c corresponds to frame rate control parameter z3, and frame rate control section d corresponds to frame rate control parameter z4. Further, if it is determined that the frame rate control section corresponding to the target pressing data is the frame rate control section b, the frame rate control parameter z2 corresponding to the frame rate control section b is acquired as the frame rate control parameter based on which the display process of the image content is controlled in the subsequent S130. For another example, if the frame rate control section corresponding to the target compression data is the frame rate control section c, the frame rate control parameter z3 corresponding to the frame rate control section c is acquired as the frame rate control parameter based on which the display process of the image content is controlled in the subsequent S130.
Illustratively, taking the target pressing data as the maximum pressing force among the pressing forces of the plurality of pressing operations within the specified period of time as an example, as shown in fig. 2, it is characterized that a new insertion frame is not inserted into the displayed image content in the case where the maximum pressing force is X. The frame rate control parameter corresponding to the frame rate control section having the maximum compression force of x+2 to x+5 includes a target frame rate of x+15. For another example, the frame rate control parameter corresponding to the frame rate control section having the maximum pressing force of x+5 to x+10 includes a target frame rate of x+30.
S130: generating a corresponding insertion frame based on the frame rate control parameter, and inserting the insertion frame into the image content so that the frame rate of the image content into which the insertion frame is inserted satisfies the target frame rate.
In this embodiment, the frame rate control parameter is a parameter for controlling the frame rate of the image content in the display process, and after the frame rate control parameter corresponding to the target pressing data is determined, the frame rate of the image content in the display process can be controlled by the frame rate control parameter. Alternatively, in the present embodiment, the change of the frame rate may be performed by inserting a new frame (insertion frame) into the image content, and the frame rate control parameter therein may be used to determine the number of insertion frames.
Illustratively, as shown in fig. 3, the image content 40 is the image content before the frame insertion, and in the case where the target frame rate is higher than the original frame rate of the image content 40, in order to make the frame rate of the image content 40 reach the target frame rate, more frame images need to be inserted into the image content 40, and illustratively, if it is determined that the frame insertion includes the insert image 51, the insert image 52, the insert image 53, the insert image 54, and the insert image 55 shown in fig. 3 according to the target frame rate corresponding to the frame rate control section, and the respective insert image positions corresponding to the insert images are the positions pointed by the corresponding arrows, the image content 41 shown in fig. 4 can be obtained after the frame insertion operation is performed, wherein the image content 41 is the image content into which the insert frame has been inserted, and the frame rate of the corresponding image content 41 is the target frame rate.
Alternatively, if the frame rate control parameter characterizes that the frame rate of the image content is 50fps, in the process of controlling based on the frame rate control parameter, if the original frame rate of the image content is lower than 50fps, a new frame is generated as an insertion frame based on 50fps to be inserted into the original image content, so that the frame rate of the display process of the image content reaches 50fps. Alternatively, if the frame rate control parameter characterizes that the frame rate of the image content is 60fps, in the process of controlling based on the frame rate control parameter, if the original frame rate of the image content is lower than 60fps, a new frame is generated as an insertion frame based on 60fps to be inserted into the original image content, so that the frame rate of the display process of the image content reaches 60fps.
According to the frame rate control method provided by the application, in the display process of the image content, target pressing data corresponding to pressing operation acting on the touch display screen is obtained, then frame rate control parameters corresponding to the target pressing data are obtained, the frame rate control parameters comprise target frame rate, corresponding insertion frames are generated based on the frame rate control parameters, and the insertion frames are inserted into the image content, so that the frame rate of the image content inserted into the insertion frames meets the target frame rate. Therefore, the frame rate of the image content is adjusted by the target pressing data corresponding to the pressing operation acting on the touch display screen, so that the frame rate of the image content can be flexibly switched along with the pressing operation of a user in the display process of the image content, and the flexibility of frame rate control in the frame rate control process is improved.
Referring to fig. 5, a frame rate control method provided by an embodiment of the present application is applied to an electronic device configured with a touch display screen, and the method includes:
s210: and in the display process of the image content, acquiring multiple pressing operations acting on the touch display screen in the current period time.
It should be noted that the frequency and the intensity of the pressing operation that the user may perform at different stages may be different, and thus, the frame rate may be updated in real time by periodically performing the pressing operation. Then the frame rate of the image content may be updated once per cycle by acquiring multiple pressing operations on the touch screen during the current cycle time. Illustratively, as shown in FIG. 6, t1 to t2 are one cycle, t2 to t3 are one cycle, and t3 to t4 are one cycle. If the current time is t4, the current cycle time is t3 to t4, and the obtained multiple pressing operations are pressing operation c, pressing operation d and pressing operation e.
As one way, the frame rate control method provided in this embodiment may be operated under the condition that the frame inserting function is turned on. In this way, it is possible to detect whether the frame inserting function of the electronic device is started or not in the display process of the image content, and if the frame inserting function is started, the target pressing data of the reference target is acquired.
In this embodiment, whether the frame inserting function is started may be determined according to various manners.
As one way, whether the plug-in function is enabled may be determined based on the remaining resources of the electronic device. The resource may be a processing resource or an electrical quantity. It should be noted that, if the electronic device inserts frames into the image content during the display process of the image content, the processing resources of the CPU or the GPU are consumed, and if the frame inserting function is still started to execute the frame rate control method provided in this embodiment under the condition that the processing resources remaining in the electronic device are relatively tight, the burden of the electronic device may be increased, and thus the electronic device may be blocked. Similarly, the electronic device needs to consume the electric quantity of the electronic device during the frame inserting process of the image content, and if the remaining electric quantity is low, the frame inserting function is still started, so that the electric quantity of the electronic device may be consumed too quickly. In order to avoid the foregoing problem, the electronic device may detect whether the remaining processing resources are greater than the resource threshold, and if so, may configure the frame insertion function to be in an on state, and correspondingly, if it is detected that the remaining processing resources are not greater than the resource threshold, may configure the frame insertion function to be in an off state.
Wherein the resource threshold may comprise a first threshold value for processing resources and/or a second threshold value for power. If the resource threshold value only comprises a first threshold value related to the processing resource, the electronic equipment triggers the frame inserting function to be started under the condition that the current residual processing resource is detected to be larger than the first threshold value, otherwise, the frame inserting function is closed. If the resource threshold value only comprises a second threshold value related to the electric quantity, the electronic device can trigger to start the frame inserting function under the condition that the current residual electric quantity is detected to be larger than the second threshold value, otherwise, the frame inserting function is closed. The resource threshold includes both a first threshold for processing resources and a second threshold for power, and the electronic device detects that the currently remaining processing resources are greater than the first threshold, and triggers the frame insertion function to be turned on if the currently remaining power is greater than the second threshold, and otherwise the frame insertion function is turned off.
Alternatively, the frame inserting function management control may be configured on a setting interface of the electronic device, so that a user may control to open or close the frame inserting function by touching the frame inserting function management control.
As one way, the method further comprises: acquiring the type of the currently running application program; the length of the cycle time is updated based on the type of the application.
Wherein the length of the period time determines the frequency of subsequent frame rate updates. For example, if the period time is 2 seconds long, then the characterization is updated with a frame rate every 2 seconds.
It should be noted that, for different image contents corresponding to different applications, in the case of a currently running video-type application (video playing scene), the displayed image content is a video picture, and in the case of a currently running game-type application (game scene), the displayed image content is a game picture. Under the condition that running application programs are different, the frequency of pressing operation performed by a user is different, and further, for some application programs which are not frequently pressed by the user in the running process, still obtaining the pressing operation based on more frequent periods can cause larger power consumption waste, and the frequency of frame rate updating which is most suitable for the current application program is selected by configuring corresponding different period time lengths corresponding to different types of application programs. For example, the length of the corresponding cycle time for a game-like application may be shorter than the length of the cycle time for a video-like application.
S220: and obtaining the target pressing data based on the pressing force corresponding to each pressing operation.
As one mode, the obtaining the target compression data based on the compression forces corresponding to the multiple compression operations includes: and acquiring the maximum pressing force among the pressing forces corresponding to the multiple pressing operations as target pressing data.
S230: and acquiring a frame rate control parameter corresponding to the target compression data, wherein the frame rate control parameter comprises a target frame rate.
As one way, the frame rate control parameter further includes a repeated frame proportion in an inserted frame, where the inserted frame is a frame determined based on the frame rate and required to be newly added; the generating a corresponding insertion frame based on the frame rate control parameter, and inserting the insertion frame into the image content so that the frame rate of the image content into which the insertion frame is inserted satisfies the target frame rate includes: generating a corresponding number of inserted frames and contents based on the target frame rate and the proportion of repeated frames in the inserted frames, and inserting the inserted frames into the image contents so that the frame rate of the image contents inserted into the inserted frames meets the target frame rate.
It should be noted that the repeated frame ratio is understood to be the ratio of the frames with repeated contents in the inserted frames to all the inserted frames. The frame of repeated content can be understood as a frame with the same image content, and the frame of repeated content can be obtained by a content copying mode. In this way, a partial insertion frame is generated by means of motion vector estimation for the generated insertion frame, while a partial insertion frame is generated by means of content copying of the insertion frame generated by means of motion vector estimation.
Alternatively, if the determined insertion frame is 10 frames, and the repeated frame proportion in the insertion frame is 50%, 5 frames of the 10 frames may be obtained by copying the content of other insertion frames. For example, the 10-frame insertion frame may include an insertion image 61, an insertion image 62, an insertion image 63, an insertion image 64, an insertion image 65, an insertion image 66, an insertion image 67, an insertion image 68, an insertion image 69, and an insertion image 70 in the display order. Then, in the case where the repetition frame ratio is 50%, the insertion image 61, the insertion image 63, the insertion image 65, the insertion image 67, and the insertion image 69 may be generated based on the motion vector estimation, the insertion image 62 may be obtained by copying the content of the insertion image 61, the insertion image 64 may be obtained by copying the content of the insertion image 63, the insertion image 66 may be obtained by copying the content of the insertion image 65, the insertion image 68 may be obtained by copying the content of the insertion image 67, and the insertion image 70 may be obtained by copying the content of the insertion image 69.
It should be noted that, if the target pixel is a pixel in the image,
the motion vector characterizes the displacement between the content block and the best matching block, or the displacement of any pixel. Where the pixel 10 in fig. 7 is located at the position (a, b) in the image of the previous frame and at the position (c, d) in the image of the next frame, then the motion vector corresponding to the pixel 10 in the image of the next frame is (dx, dy), where dx represents the displacement of the pixel 10 in the X-axis direction and dy represents the displacement of the pixel 10 in the Y-axis direction, so dx=a-c, dy=d-b in the case shown in fig. 7.
As shown in fig. 8, the best matching block refers to the content block 31 in the subsequent frame image 30 that has the highest degree of matching with the content block 21 of the previous frame image 20. It should be noted that, the content block may include a plurality of pixels, and in an embodiment of the present application, a displacement of a pixel at a center point of the content block may be used as a displacement of the content block. Wherein the center point may be a geometric center. In the content shown in fig. 8, the motion vector between the content block and the best matching block is (a-c, d-b). Where a content block is understood to characterize an area in an image that has a physical meaning. For example, if a person is in an image, the person's head is an area with a physical meaning, and the physical meaning is that the image content of the area characterizes the person's head, and thus the head area can be used as a content block. For another example, the person's hand is also an area with a physical meaning, and the hand area may then be used as a piece of content.
Alternatively, as shown in the foregoing, a plurality of frame rate control sections may be configured in the electronic device. Optionally, the plurality of frame rate control intervals includes a first frame rate control interval, a second frame rate control interval, and the third frame rate control interval.
Correspondingly, if the frame rate control section corresponding to the target compression data is a first frame rate control section, a first target frame rate corresponding to the first frame rate control section and a first repeated frame proportion in the inserted frame are obtained. And if the frame rate control interval corresponding to the target pressing data is a second frame rate control interval, acquiring a second target frame rate corresponding to the second frame rate control interval and a second repeated frame proportion in the inserted frame. And if the frame rate control interval corresponding to the target pressing data is a third frame rate control interval, acquiring a third target frame rate corresponding to the third frame rate control interval and a third repeated frame proportion in the inserted frame.
The motion parameters corresponding to the first frame rate control section, the second frame rate control section and the third frame rate control section are sequentially increased, the first target frame rate, the second target frame rate and the third target frame rate are sequentially increased, and the first repeated frame proportion, the second repeated frame proportion and the third repeated frame proportion are sequentially decreased. Illustratively, the first target frame rate may be 40fps, the second target frame rate may be 50fps, and the third target frame rate may be 60fps. The first repetition frame rate may be 50%, the second repetition frame rate may be 70%, and the third repetition frame rate may be 100%.
S240: generating a corresponding insertion frame based on the frame rate control parameter, and inserting the insertion frame into the image content so that the frame rate of the image content into which the insertion frame is inserted satisfies the target frame rate.
It can be appreciated that if the corresponding frame rate control interval is the first frame rate control interval, the corresponding insertion frame is generated based on the first target frame rate and the first repetition frame ratio in the insertion frame. If the corresponding frame rate control section is the second frame rate control section, a corresponding insertion frame is generated based on the second target frame rate and a second repetition frame ratio in the insertion frame. If the corresponding frame rate control section is the third frame rate control section, a corresponding insertion frame is generated based on the third target frame rate and a third repetition frame ratio in the insertion frame.
According to the frame rate control method provided by the application, the frame rate of the image content is adjusted by the target pressing data corresponding to the pressing operation acting on the touch display screen, so that the frame rate of the image content can be flexibly switched along with the pressing operation of a user in the display process of the image content, and the flexibility of frame rate control in the frame rate control process is improved. In addition, in this embodiment, the target pressing data may be determined according to the multiple pressing operations performed on the touch display screen in the current period time, so that the obtained target pressing data may more accurately represent the pressing operation intention of the user, and further more accurately perform frame rate control. Furthermore, in this embodiment, the length of the specified time period may be determined by the type of the currently running application, which further improves the flexibility and adaptability of the frame rate control.
Referring to fig. 9, a frame rate control method provided by an embodiment of the present application is applied to an electronic device configured with a touch display screen, and the method includes:
s310: and in the display process of the image content, acquiring the motion degree of a reference object in the image content.
The reference object may be a specific object, such as a human face or an animal. Furthermore, the reference object may also be a pixel in the image content.
S320: detecting whether the degree of motion is greater than a degree threshold.
S330: and if the motion degree is greater than a degree threshold, acquiring target pressing data corresponding to pressing operation acted on the touch display screen.
S340: and if the motion degree is not greater than the degree threshold value, ending the flow.
S350: and acquiring a frame rate control parameter corresponding to the target compression data, wherein the frame rate control parameter comprises a target frame rate.
S360: generating a corresponding insertion frame based on the frame rate control parameter, and inserting the insertion frame into the image content so that the frame rate of the image content into which the insertion frame is inserted satisfies the target frame rate.
According to the frame rate control method provided by the application, the frame rate of the image content is adjusted by the target pressing data corresponding to the pressing operation acting on the touch display screen, so that the frame rate of the image content can be flexibly switched along with the pressing operation of a user in the display process of the image content, and the flexibility of frame rate control in the frame rate control process is improved. In addition, in this embodiment, whether to trigger a subsequent step can be determined according to the motion degree of the reference target in the image content, so that accuracy of frame rate control of triggering is improved, meaningless behavior of acquiring target pressing data corresponding to pressing operation acting on the touch display screen is avoided, and resource waste is avoided.
Referring to fig. 10, a frame rate control method provided by an embodiment of the present application is applied to an electronic device configured with a touch display screen, and the method includes:
s410: and in the display process of the image content, acquiring the interface type of the currently displayed interface.
S420: it is detected whether the interface type of the currently displayed interface is a dynamic type interface.
It should be noted that, even in the same image content display scene, there may be different types of interfaces. In addition, different types of interfaces have different demands for frame insertion, and some interfaces may not need to be subjected to frame insertion because after frame insertion, the visual experience is not obviously improved. The interface types can be classified into dynamic types and static types, wherein the interface of the dynamic type can be used for frame inserting operation, and the interface of the static type can be used for frame inserting operation. The game combat interface in the game scene can be a dynamic type interface, and the prop bar interface, the chat interface, the configuration interface and the like in the game scene can be static type interfaces.
Taking a game scene as an example, after the current image content display scene is obtained as the game scene, the interface type of the current displayed interface can be obtained first, then the subsequent obtaining of the motion degree of the reference target in the image content is executed under the condition that the interface type of the current displayed interface is a dynamic type, and otherwise, the subsequent steps are not executed.
In addition, in other image content display scenes, whether to trigger the subsequent acquisition of the motion parameters of the reference target or not can be determined by detecting the interface type of the currently displayed interface, the frame rate control interval corresponding to the motion parameters is acquired, and the frame rate control parameters corresponding to the frame rate control interval are acquired. For example, in a video playing scene, a video playing interface may be included, and a content selecting interface may also be included. It can be understood that when the video playing interface is displayed, the video playing interface is in a state of actually playing the video, and when the content selecting interface is actually a browsing interface for displaying a plurality of videos for the user to select, in the video playing scene, when the currently displayed interface is the video playing interface, the subsequent acquisition of the motion degree of the reference target in the image content is triggered, so that the effectiveness of controlling the display process of the image content is improved.
S430: and if the interface type is a dynamic type interface, acquiring the motion degree of the reference target in the image content.
S440: and if the interface type is not the dynamic type interface, ending the flow.
S450: detecting whether the degree of motion is greater than a degree threshold.
S460: and if the motion degree is greater than a degree threshold, acquiring target pressing data corresponding to pressing operation acted on the touch display screen.
S470: and if the motion degree is not greater than the degree threshold value, ending the flow.
S480: and acquiring a frame rate control parameter corresponding to the target compression data, wherein the frame rate control parameter comprises a target frame rate.
S490: generating a corresponding insertion frame based on the frame rate control parameter, and inserting the insertion frame into the image content so that the frame rate of the image content into which the insertion frame is inserted satisfies the target frame rate.
According to the frame rate control method provided by the application, the frame rate of the image content is adjusted by the target pressing data corresponding to the pressing operation acting on the touch display screen, so that the frame rate of the image content can be flexibly switched along with the pressing operation of a user in the display process of the image content, and the flexibility of frame rate control in the frame rate control process is improved. In addition, in this embodiment, whether to trigger a subsequent step may be determined according to the motion degree of the reference target in the image content and the interface type of the currently displayed interface, so as to facilitate to improve the accuracy of triggering to perform frame rate control, avoid meaningless behavior of acquiring target pressing data corresponding to the pressing operation acting on the touch display screen, and further avoid resource waste.
Referring to fig. 11, a frame rate control apparatus 500 according to an embodiment of the present application is operated in an electronic device configured with a touch display screen, where the apparatus 500 includes:
the target pressing data obtaining unit 510 is configured to obtain, during the display process of the image content, target pressing data corresponding to a pressing operation acting on the touch display screen.
As one way, the target pressing data obtaining unit 510 is specifically configured to obtain multiple pressing operations acting on the touch display screen in the current cycle time; and obtaining the target pressing data based on the pressing force corresponding to each pressing operation. Optionally, the target pressing data obtaining unit 510 is specifically configured to obtain, as the target pressing data, a maximum pressing force among the pressing forces corresponding to the multiple pressing operations. The target pressing data obtaining unit 510 is further specifically configured to obtain a type of an application program currently running; the length of the cycle time is updated based on the type of the application.
As one way, the target pressing data obtaining unit 510 is specifically configured to obtain, during a display process of an image content, a motion degree of a reference target in the image content; and if the motion degree is greater than a degree threshold, acquiring target pressing data corresponding to pressing operation acted on the touch display screen. Optionally, the target pressing data acquiring unit 510 is specifically configured to detect an interface type of the currently displayed interface; and if the interface type is a dynamic type interface, acquiring the motion degree of the reference target in the image content.
As one way, the frame rate control parameter further includes a repeated frame proportion in an inserted frame, where the inserted frame is a frame determined based on the frame rate and required to be newly added; the target pressing data obtaining unit 510 is specifically configured to generate an insertion frame corresponding to the number and content based on the target frame rate and the proportion of repeated frames in the insertion frame, and insert the insertion frame into the image content, so that the frame rate of the image content into which the insertion frame is inserted satisfies the target frame rate.
And a frame rate parameter acquiring unit 520, configured to acquire a frame rate control parameter corresponding to the target compression data, where the frame rate control parameter includes a target frame rate.
A frame rate control unit 530, configured to generate a corresponding insertion frame based on the frame rate control parameter, and insert the insertion frame into the image content, so that the frame rate of the image content into which the insertion frame is inserted satisfies the target frame rate.
According to the frame rate control device provided by the application, in the display process of image content, target pressing data corresponding to pressing operation acting on the touch display screen is obtained, then frame rate control parameters corresponding to the target pressing data are obtained, the frame rate control parameters comprise target frame rate, corresponding insertion frames are generated based on the frame rate control parameters, and the insertion frames are inserted into the image content, so that the frame rate of the image content inserted into the insertion frames meets the target frame rate. Therefore, the frame rate of the image content is adjusted by the target pressing data corresponding to the pressing operation acting on the touch display screen, so that the frame rate of the image content can be flexibly switched along with the pressing operation of a user in the display process of the image content, and the flexibility of frame rate control in the frame rate control process is improved.
It should be noted that, in the present application, the device embodiment and the foregoing method embodiment correspond to each other, and specific principles in the device embodiment may refer to the content in the foregoing method embodiment, which is not described herein again.
An electronic device according to the present application will be described with reference to fig. 12.
Referring to fig. 12, based on the above-mentioned frame rate control method and apparatus, another electronic device 200 capable of executing the above-mentioned frame rate control method is provided in the embodiment of the present application. The electronic device 200 includes one or more (only one shown) processors 102, memory 104, network modules 106, and a frame insertion chip 108 coupled to each other. The memory 104 stores therein a program capable of executing the contents of the foregoing embodiments, and the frame inserting chip 108 can execute the program stored in the memory 104. The program stored in the memory 104 is executed by the frame inserting chip 108, and it can be understood that the frame rate control method provided in this embodiment can be executed by the frame inserting chip 108, which is further beneficial to reduce the load of the processor 102. Alternatively, the framing chip 108 may receive the image content via MIPI (Mobile Industry Processor Interface) reception. Furthermore, the frame rate control method in the embodiment of the present application may also be performed by the frame inserting chip and the processor together. Alternatively, S110 and S120 in the foregoing embodiments may be executed by a processor, and S130 may be configured to be executed by a frame inserting chip.
Wherein the processor 102 may include one or more cores for processing data. The processor 102 utilizes various interfaces and lines to connect various portions of the overall electronic device 200, perform various functions of the electronic device 200, and process data by executing or executing instructions, programs, code sets, or instruction sets stored in the memory 104, and invoking data stored in the memory 104. Alternatively, the processor 102 may be implemented in hardware in at least one of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), programmable logic array (Programmable Logic Array, PLA). The processor 102 may integrate one or a combination of several of a central processing unit (Central Processing Unit, CPU), an image processor (Graphics Processing Unit, GPU), and a modem, etc. The CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for being responsible for rendering and drawing of display content; the modem is used to handle wireless communications. It will be appreciated that the modem may not be integrated into the processor 102 and may be implemented solely by a single communication chip.
The Memory 104 may include random access Memory (Random Access Memory, RAM) or Read-Only Memory (RAM). Memory 104 may be used to store instructions, programs, code sets, or instruction sets. The memory 104 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (e.g., a touch function, a sound playing function, an image playing function, etc.), instructions for implementing the various method embodiments described below, etc. The storage data area may also store data created by the terminal 100 in use (such as phonebook, audio-video data, chat-record data), etc.
The network module 106 is configured to receive and transmit electromagnetic waves, and to implement mutual conversion between the electromagnetic waves and the electrical signals, so as to communicate with a communication network or other devices, such as an audio playing device. The network module 106 may include various existing circuit elements for performing these functions, such as an antenna, a radio frequency transceiver, a digital signal processor, an encryption/decryption chip, a Subscriber Identity Module (SIM) card, memory, and the like. The network module 106 may communicate with various networks such as the Internet, intranets, wireless networks, or other devices via wireless networks. The wireless network may include a cellular telephone network, a wireless local area network, or a metropolitan area network. For example, the network module 106 may interact with base stations.
Referring to fig. 13, a block diagram of a computer readable storage medium according to an embodiment of the present application is shown. The computer readable medium 1100 has stored therein program code that can be invoked by a processor to perform the methods described in the method embodiments above.
The computer readable storage medium 1100 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM. Optionally, computer readable storage medium 1100 includes non-volatile computer readable medium (non-transitory computer-readable storage medium). The computer readable storage medium 1100 has storage space for program code 1110 that performs any of the method steps described above. The program code can be read from or written to one or more computer program products. Program code 1110 may be compressed, for example, in a suitable form.
In summary, in the method, the device and the electronic equipment for controlling the frame rate provided by the application, in the process of displaying the image content, the target pressing data corresponding to the pressing operation acting on the touch display screen is obtained, then the frame rate control parameter corresponding to the target pressing data is obtained, the frame rate control parameter comprises the target frame rate, the corresponding insertion frame is generated based on the frame rate control parameter, and the insertion frame is inserted into the image content, so that the frame rate of the image content inserted into the insertion frame meets the target frame rate. Therefore, the frame rate of the image content is adjusted by the target pressing data corresponding to the pressing operation acting on the touch display screen, so that the frame rate of the image content can be flexibly switched along with the pressing operation of a user in the display process of the image content, and the flexibility of frame rate control in the frame rate control process is improved.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and are not limiting; although the application has been described in detail with reference to the foregoing embodiments, it will be appreciated by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not drive the essence of the corresponding technical solutions to depart from the spirit and scope of the technical solutions of the embodiments of the present application.
Claims (8)
1. A frame rate control method, applied to an electronic device configured with a touch display screen, comprising:
in the display process of image content, multiple pressing operations acting on the touch display screen in the current period time are acquired, wherein the period length is updated based on the type of the currently running application program, the image content is corresponding to the currently running application program, and the image content corresponding to different application programs is different;
obtaining target pressing data based on the pressing forces corresponding to the pressing operations;
acquiring frame rate control parameters corresponding to the target compression data, wherein the frame rate control parameters comprise a target frame rate;
Generating a corresponding insertion frame based on the frame rate control parameter, and inserting the insertion frame into the image content so that the frame rate of the image content into which the insertion frame is inserted satisfies the target frame rate.
2. The method of claim 1, wherein the obtaining target compression data based on the compression forces corresponding to the plurality of compression operations comprises:
and acquiring the maximum pressing force among the pressing forces corresponding to the multiple pressing operations as target pressing data.
3. The method according to claim 1, wherein the step of acquiring target pressing data corresponding to a pressing operation applied to the touch display screen during the display of the image content includes:
acquiring the motion degree of a reference target in image content in the display process of the image content;
and if the motion degree is greater than a degree threshold, acquiring target pressing data corresponding to pressing operation acted on the touch display screen.
4. A method according to claim 3, wherein the step of obtaining the motion level of the reference object in the image content during the display of the image content comprises:
Detecting the interface type of the currently displayed interface;
and if the interface type is a dynamic type interface, acquiring the motion degree of the reference target in the image content.
5. The method of claim 1, wherein the frame rate control parameter further comprises a proportion of repeated frames in an interpolated frame, the interpolated frame being a frame determined to be in need of a new increase based on the frame rate; the generating a corresponding insertion frame based on the frame rate control parameter, and inserting the insertion frame into the image content so that the frame rate of the image content into which the insertion frame is inserted satisfies the target frame rate includes:
generating a corresponding number of inserted frames and contents based on the target frame rate and the proportion of repeated frames in the inserted frames, and inserting the inserted frames into the image contents so that the frame rate of the image contents inserted into the inserted frames meets the target frame rate.
6. A frame rate control apparatus for operation with an electronic device configured with a touch display screen, the apparatus comprising:
the target pressing data acquisition unit is used for acquiring multiple pressing operations acting on the touch display screen in the current period time in the display process of the image content, wherein the period length is updated based on the type of the currently running application program, the image content is corresponding to the currently running application program, and the image content corresponding to different application programs is different; obtaining the target pressing data based on the pressing forces corresponding to the pressing operations;
A frame rate parameter obtaining unit, configured to obtain a frame rate control parameter corresponding to the target compression data, where the frame rate control parameter includes a target frame rate;
and the frame rate control unit is used for generating a corresponding inserted frame based on the frame rate control parameter and inserting the inserted frame into the image content so that the frame rate of the image content inserted with the inserted frame meets the target frame rate.
7. An electronic device is characterized by comprising a frame inserting chip, a processor and a memory;
one or more programs are stored in the memory and configured to be executed by the framing chip and/or the processor to implement the method of any of claims 1-5.
8. A computer readable storage medium, characterized in that the computer readable storage medium has stored therein a program code, wherein the method of any of claims 1-5 is performed when the program code is run by a plug-in chip and/or a processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010953712.0A CN112057842B (en) | 2020-09-11 | 2020-09-11 | Frame rate control method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010953712.0A CN112057842B (en) | 2020-09-11 | 2020-09-11 | Frame rate control method and device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112057842A CN112057842A (en) | 2020-12-11 |
| CN112057842B true CN112057842B (en) | 2023-10-03 |
Family
ID=73695406
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010953712.0A Active CN112057842B (en) | 2020-09-11 | 2020-09-11 | Frame rate control method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112057842B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114339410A (en) * | 2021-12-28 | 2022-04-12 | 维沃移动通信有限公司 | Frame insertion method and device and electronic equipment |
| CN114490671B (en) * | 2022-03-31 | 2022-07-29 | 北京华建云鼎科技股份公司 | Client-side same-screen data synchronization system |
| CN114827477B (en) * | 2022-05-26 | 2024-03-29 | 维沃移动通信有限公司 | Method, device, electronic equipment and medium for time-lapse photography |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001045493A (en) * | 1999-08-04 | 2001-02-16 | Casio Comput Co Ltd | Moving image encoding device, moving image output device and storage medium |
| CN101998029A (en) * | 2009-08-05 | 2011-03-30 | 株式会社日立制作所 | Image processing device and image processing method |
| US9247243B1 (en) * | 2012-01-02 | 2016-01-26 | Marvell International Ltd. | Interpolated video error concealment |
| CN105874783A (en) * | 2014-02-04 | 2016-08-17 | 英特尔公司 | Techniques for frame repetition control in frame rate up-conversion |
| CN111083417A (en) * | 2019-12-10 | 2020-04-28 | Oppo广东移动通信有限公司 | Image processing method and related product |
-
2020
- 2020-09-11 CN CN202010953712.0A patent/CN112057842B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001045493A (en) * | 1999-08-04 | 2001-02-16 | Casio Comput Co Ltd | Moving image encoding device, moving image output device and storage medium |
| CN101998029A (en) * | 2009-08-05 | 2011-03-30 | 株式会社日立制作所 | Image processing device and image processing method |
| US9247243B1 (en) * | 2012-01-02 | 2016-01-26 | Marvell International Ltd. | Interpolated video error concealment |
| CN105874783A (en) * | 2014-02-04 | 2016-08-17 | 英特尔公司 | Techniques for frame repetition control in frame rate up-conversion |
| CN111083417A (en) * | 2019-12-10 | 2020-04-28 | Oppo广东移动通信有限公司 | Image processing method and related product |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112057842A (en) | 2020-12-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112057842B (en) | Frame rate control method and device and electronic equipment | |
| CN112203034B (en) | Frame rate control method and device and electronic equipment | |
| CN110913442B (en) | Network switching method and device, electronic equipment and storage medium | |
| CN112135081B (en) | Mode control method and device, frame insertion chip and electronic equipment | |
| WO2015001437A1 (en) | Image processing method and apparatus, and electronic device | |
| CN109309842B (en) | Live broadcast data processing method and device, computer equipment and storage medium | |
| CN109600654B (en) | Bullet screen processing method and device and electronic equipment | |
| CN109107158B (en) | Sound effect processing method and device, electronic equipment and computer readable storage medium | |
| CN113055742B (en) | Video display method, device, terminal and storage medium | |
| CN109327716A (en) | Delay control method, delay control device and computer readable storage medium | |
| CN109640179A (en) | Video frequency decoding control method, device and electronic equipment | |
| CN108289185B (en) | Video communication method, device and terminal equipment | |
| CN109218528B (en) | Sound effect processing method and device and electronic equipment | |
| CN108648259A (en) | image drawing method, device, storage medium and intelligent terminal | |
| CN111273769B (en) | Equipment control method and device, electronic equipment and storage medium | |
| CN110569008B (en) | Screen data processing method and device and electronic equipment | |
| CN110418209B (en) | Information processing method applied to video transmission and terminal equipment | |
| CN110389696B (en) | Method and device for controlling screen color gamut, electronic equipment and storage medium | |
| CN109474833B (en) | Network live broadcast method, related device and system | |
| CN113559498A (en) | Three-dimensional model display method and device, storage medium and electronic equipment | |
| CN110503042A (en) | Image processing method, device and electronic equipment | |
| CN109640094B (en) | Video decoding method and device and electronic equipment | |
| CN110572867A (en) | method and device for reducing power consumption of electronic equipment | |
| CN111954041A (en) | Video loading method, computer equipment and readable storage medium | |
| CN108924411B (en) | Photographing control method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |