CN112057842A - Frame rate control method and device and electronic equipment - Google Patents
Frame rate control method and device and electronic equipment Download PDFInfo
- Publication number
- CN112057842A CN112057842A CN202010953712.0A CN202010953712A CN112057842A CN 112057842 A CN112057842 A CN 112057842A CN 202010953712 A CN202010953712 A CN 202010953712A CN 112057842 A CN112057842 A CN 112057842A
- Authority
- CN
- China
- Prior art keywords
- frame rate
- frame
- image content
- rate control
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
- A63F13/214—Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads
- A63F13/2145—Input arrangements for video game devices characterised by their sensors, purposes or types for locating contacts on a surface, e.g. floor mats or touch pads the surface being also a display device, e.g. touch screens
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/25—Output arrangements for video game devices
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/50—Controlling the output signals based on the game progress
- A63F13/52—Controlling the output signals based on the game progress involving aspects of the displayed game scene
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/70—Game security or game management aspects
- A63F13/77—Game security or game management aspects involving data related to game devices or game servers, e.g. configuration data, software version or amount of memory
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Business, Economics & Management (AREA)
- Computer Security & Cryptography (AREA)
- General Business, Economics & Management (AREA)
- Controls And Circuits For Display Device (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the application discloses a frame rate control method and device and electronic equipment. The method comprises the following steps: in the display process of the image content, acquiring target pressing data corresponding to the pressing operation acting on the touch display screen; acquiring frame rate control parameters corresponding to the target pressing data, wherein the frame rate control parameters comprise a target frame rate; and generating a corresponding insertion frame based on the frame rate control parameter, and inserting the insertion frame into the image content so that the frame rate of the image content inserted into the insertion frame meets the target frame rate. Therefore, new insertion frames are generated through target pressing data corresponding to the pressing operation acting on the touch display screen and inserted into the image content, so that the frame rate of the image content can be adjusted, the frame rate of the image content can be flexibly switched along with the pressing operation of a user in the display process of the image content, and the flexibility of frame rate control in the frame rate control process is improved.
Description
Technical Field
The present application relates to the field of computer technologies, and in particular, to a frame rate control method and apparatus, and an electronic device.
Background
In a game scene, the video playing fluency can be improved by performing frame insertion on a game picture. However, in the related technical solutions, the frame interpolation mode is preset in advance at the system side, and then the frame interpolation is performed only according to the fixed frame interpolation mode in any scene, which may cause the frame interpolation process to lack flexibility.
Disclosure of Invention
In view of the above problems, the present application provides a frame rate control method, an apparatus and an electronic device to improve the above problems.
In a first aspect, the present application provides a frame rate control method applied to an electronic device configured with a touch display screen, where the method includes: in the display process of the image content, acquiring target pressing data corresponding to the pressing operation acting on the touch display screen; acquiring frame rate control parameters corresponding to the target pressing data, wherein the frame rate control parameters comprise a target frame rate; and generating a corresponding insertion frame based on the frame rate control parameter, and inserting the insertion frame into the image content so that the frame rate of the image content inserted into the insertion frame meets the target frame rate.
In a second aspect, the present application provides a frame rate control apparatus, which is used in an electronic device configured with a touch display screen, and includes: the target pressing data acquisition unit is used for acquiring target pressing data corresponding to pressing operation acting on the touch display screen in the display process of image content; a frame rate parameter obtaining unit, configured to obtain a frame rate control parameter corresponding to the target pressing data, where the frame rate control parameter includes a target frame rate; and the frame rate control unit is used for generating a corresponding insertion frame based on the frame rate control parameter and inserting the insertion frame into the image content so that the frame rate of the image content inserted with the insertion frame meets the target frame rate.
In a third aspect, the present application provides an electronic device, comprising a frame insertion chip, a processor, and a memory; one or more programs are stored in the memory and configured to be executed by the framing chip and/or the processor to implement the methods described above.
In a fourth aspect, the present application provides a computer-readable storage medium having program code stored therein, wherein the method described above is performed when the program code is executed by a framing chip and/or the processor.
According to the frame rate control method, the device and the electronic equipment, in the display process of image content, target pressing data corresponding to pressing operation acting on the touch display screen are obtained, then frame rate control parameters corresponding to the target pressing data are obtained, the frame rate control parameters comprise a target frame rate, corresponding insertion frames are generated based on the frame rate control parameters, and the insertion frames are inserted into the image content, so that the frame rate of the image content inserted with the insertion frames meets the target frame rate. Therefore, new insertion frames are generated through target pressing data corresponding to the pressing operation acting on the touch display screen and inserted into the image content, so that the frame rate of the image content can be adjusted, the frame rate of the image content can be flexibly switched along with the pressing operation of a user in the display process of the image content, and the flexibility of frame rate control in the frame rate control process is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a flowchart illustrating a frame rate control method according to an embodiment of the present application;
fig. 2 is a schematic diagram illustrating a method for determining a corresponding frame rate control interval in an embodiment of the present application;
FIG. 3 is a schematic diagram illustrating the addition of an insertion frame to image content in an embodiment of the present application;
FIG. 4 is a diagram illustrating an embodiment of the present application for adding image content of an inserted frame;
fig. 5 is a flowchart illustrating a frame rate control method according to another embodiment of the present application;
FIG. 6 shows a schematic diagram for acquiring multiple pressing operations in the current cycle in the embodiment of the present application;
FIG. 7 is a schematic diagram illustrating the addition of an insertion frame to image content in an embodiment of the present application;
FIG. 8 is a diagram illustrating an embodiment of the present application for adding image content of an inserted frame;
fig. 9 is a flowchart illustrating a frame rate control method according to still another embodiment of the present application;
fig. 10 is a flowchart illustrating a frame rate control method according to another embodiment of the present application;
fig. 11 is a block diagram illustrating a frame rate control apparatus according to another embodiment of the present application;
fig. 12 is a block diagram illustrating an electronic device for executing a frame rate control method according to an embodiment of the present application;
fig. 13 is a storage unit for storing or carrying program codes for implementing a frame rate control method according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
With the advent of the mobile internet age, the popularity of electronic devices has become a major trend in the mobile phone market. The emergence of electronic devices has changed the lifestyle of many people and the demand for traditional communication tools, and with the increase of user demand, people no longer satisfy the use of the appearance and basic functions of electronic devices, but have pursued electronic devices to bring more, stronger, more personalized functional services to people. Such as video playback and games, etc. The display process of the image content is involved in both the video playing scene and the game scene. The image content displayed in the video playing scene is a video picture, and the image content displayed in the game scene may include a game picture.
However, after studying the display process of the related image content, the inventors found that, in order to facilitate improving the display effect of the image content in the display process, the fluency of the image content can be improved by performing frame interpolation on the image content. However, after further research on frame interpolation, the inventors found that the related frame interpolation methods are based on the fixed frame interpolation method, which causes a lack of flexibility in the video frame interpolation process, and that power consumption is wasted because the fixed frame interpolation method is always used for frame interpolation. For example, if the electronic device determines that the target of frame interpolation is 60fps (number of frames displayed per second) during the process of frame interpolation of the image content, the electronic device performs frame interpolation on the image content in any case by adopting the fixed manner, so that the frame rate of the image content after frame interpolation is always kept at 60fps, and further the electronic device is lack of flexibility. Moreover, the inventor finds that frame rate is improved through frame interpolation in some scenes, and the frame interpolation process actually causes waste of power consumption because no obvious visual experience exists for users.
Moreover, it can be understood that the interpolated frames that need to be generated in the frame interpolation process are all drawn by the GPU in the relevant frame interpolation process, and if a higher frame rate is always maintained, the GPU is always in a higher workload state.
Therefore, the inventor proposes a frame rate control method, a device and an electronic device in the present application, which can improve the above problem, by acquiring target press data corresponding to a press operation applied to the touch display screen during the display of image content, and then acquiring frame rate control parameters corresponding to the target press data, where the frame rate control parameters include a target frame rate, and generating corresponding insertion frames based on the frame rate control parameters, and inserting the insertion frames into the image content, so that the frame rate of the image content into which the insertion frames are inserted satisfies the target frame rate. Therefore, the frame rate of the image content is adjusted through the target pressing data corresponding to the pressing operation acting on the touch display screen, so that the frame rate of the image content can be flexibly switched along with the pressing operation of a user in the display process of the image content, and the flexibility of frame rate control in the frame rate control process is improved.
Embodiments of the present application will be described in detail below with reference to the accompanying drawings.
Referring to fig. 1, a frame rate control method provided in an embodiment of the present application is applied to an electronic device configured with a touch display screen, and the method includes:
s110: and acquiring target pressing data corresponding to the pressing operation acting on the touch display screen in the display process of the image content.
The frame rate control method provided by the embodiment of the present application can be operated in a plurality of image content display scenes, and the image content displayed in different scenes (i.e., image content display scenes) can be different. Optionally, in a video playing scene, the image content may be understood as a video frame, and correspondingly, target pressing data corresponding to a pressing operation applied to the touch display screen may be acquired in a display process of the video frame. Optionally, in a game scene, the image content may be a game picture in a game running process, and then, in a display process of the game picture, target pressing data corresponding to a pressing operation applied to the touch display screen is acquired correspondingly.
It should be noted that, in the embodiment of the present application, target press data corresponding to a press operation is acquired to perform subsequent frame rate control. Also, in the present embodiment, the target pressing data may be data related to pressing force degrees of pressing operations, for example, an average of pressing force degrees of a plurality of pressing operations applied to the touch display screen within a specified time period, or a maximum pressing force degree of the pressing force degrees of the plurality of pressing operations applied to the touch display screen within the specified time period. Furthermore, the target pressing data may also be data related to a pressing frequency of a pressing operation, for example, the number of presses of a plurality of pressing operations applied to the touch display screen within a specified time period.
S120: and acquiring frame rate control parameters corresponding to the target pressing data, wherein the frame rate control parameters comprise a target frame rate.
In this embodiment, a corresponding relationship between the target pressing data and the frame rate control parameter may be pre-established, and then the frame rate control parameter corresponding to the target pressing data may be acquired through the corresponding relationship after the target pressing data is acquired. In this embodiment, there may be a plurality of ways to establish the corresponding relationship.
As one way, a one-to-one correspondence between target compression data and frame rate control parameters may be established. In this manner, a correspondence table including a plurality of target pressing data and frame rate control parameters corresponding to the target pressing data may be pre-established, and after the target pressing data is acquired through S110, the corresponding frame rate control parameters may be acquired by querying the correspondence table. Illustratively, the target compression data a corresponds to the frame rate control parameter z1, the target compression data B corresponds to the frame rate control parameter z2, and the target compression data C corresponds to the frame rate control parameter z3 are stored in the correspondence table. Then, in the case where the target compression data a is acquired through S110, the frame rate control parameter acquired is the frame rate control parameter z 1.
Alternatively, a plurality of frame rate control sections may be arranged, each frame rate control section corresponding to one type of frame rate control parameter, and different frame rate control sections may correspond to different frame rate control parameters. In this case, the frame rate control section corresponding to the acquired target pressing data may be selected from the plurality of frame rate control sections, and the frame rate control parameter corresponding to the frame rate control section corresponding to the target pressing data may be acquired as a basis for the subsequent image content display control.
Optionally, the configured frame rate control intervals may include a frame rate control interval a, a frame rate control interval b, a frame rate control interval c, and a frame rate control interval d. The frame rate control section a corresponds to a frame rate control parameter z1, the frame rate control section b corresponds to a frame rate control parameter z2, the frame rate control section c corresponds to a frame rate control parameter z3, and the frame rate control section d corresponds to a frame rate control parameter z 4. Further, when it is determined that the frame rate control section corresponding to the target push data is the frame rate control section b, the frame rate control parameter z2 corresponding to the frame rate control section b is acquired as the frame rate control parameter for controlling the display process of the image content in the subsequent S130. For another example, if the frame rate control section corresponding to the target push data is the frame rate control section c, the frame rate control parameter z3 corresponding to the frame rate control section c is acquired as the frame rate control parameter for controlling the display process of the image content in the subsequent S130.
Illustratively, taking the target compression data as the maximum compression degree among the compression degrees of the plurality of pressing operations within the specified time period as an example, as shown in fig. 2, the characterization is made not to insert a new insertion frame into the displayed image content in the case where the maximum compression degree is X. The frame rate control parameter corresponding to the frame rate control interval with the maximum pressing degree of X +2 to X +5 includes a target frame rate of X + 15. For another example, the frame rate control parameter corresponding to the frame rate control interval with the maximum pressing force degree of X +5 to X +10 includes a target frame rate of X + 30.
S130: and generating a corresponding insertion frame based on the frame rate control parameter, and inserting the insertion frame into the image content so that the frame rate of the image content inserted into the insertion frame meets the target frame rate.
It should be noted that, in this embodiment, the frame rate control parameter is a parameter for controlling a frame rate of the image content in the display process, and after the frame rate control parameter corresponding to the target press data is determined, the frame rate of the image content in the display process can be controlled through the frame rate control parameter. Optionally, in this embodiment, the frame rate may be changed by inserting a new frame (an insertion frame) into the image content, and the frame rate control parameter may be used to determine the number of insertion frames.
Illustratively, as shown in fig. 3, the image content 40 is the image content before the frame insertion, and in the case that the target frame rate is higher than the original frame rate of the image content 40, more frame images need to be inserted into the image content 40 in order to make the frame rate of the image content 40 reach the target frame rate, for example, if the frame insertion is determined according to the target frame rate corresponding to the frame rate control section, the frame insertion includes the image insertion 51, the image insertion 52, the image insertion 53, the image insertion 54, and the image insertion 55 shown in fig. 3, and the image insertion position corresponding to each image insertion is the position pointed by the corresponding arrow, after the frame insertion operation is performed, the image content 41 shown in fig. 4 can be obtained, wherein the image content 41 is the image content into which the frame insertion has been inserted, and the frame rate of the corresponding image content 41 is the target frame rate.
Optionally, if the frame rate control parameter indicates that the frame rate of the image content is 50fps, in the process of controlling based on the frame rate control parameter, if the original frame rate of the image content is lower than 50fps, a new frame is generated based on 50fps as an insertion frame to be inserted into the original image content, so that the frame rate in the process of displaying the image content reaches 50 fps. Optionally, if the frame rate control parameter indicates that the frame rate of the image content is 60fps, in the process of controlling based on the frame rate control parameter, if the original frame rate of the image content is lower than 60fps, a new frame is generated based on 60fps as an insertion frame to be inserted into the original image content, so that the frame rate in the process of displaying the image content reaches 60 fps.
According to the frame rate control method, in the display process of image content, target pressing data corresponding to pressing operation acting on the touch display screen are acquired, then frame rate control parameters corresponding to the target pressing data are acquired, the frame rate control parameters comprise a target frame rate, corresponding insertion frames are generated based on the frame rate control parameters, and the insertion frames are inserted into the image content, so that the frame rate of the image content with the inserted frames meets the target frame rate. Therefore, the frame rate of the image content is adjusted through the target pressing data corresponding to the pressing operation acting on the touch display screen, so that the frame rate of the image content can be flexibly switched along with the pressing operation of a user in the display process of the image content, and the flexibility of frame rate control in the frame rate control process is improved.
Referring to fig. 5, a frame rate control method provided in an embodiment of the present application is applied to an electronic device configured with a touch display screen, and the method includes:
s210: and in the display process of the image content, acquiring multiple pressing operations acting on the touch display screen in the current period time.
It should be noted that, the frequency and the strength of the pressing operation that may be performed by the user at different stages are different, and further, by periodically performing the acquisition of the pressing operation, the frame rate update may be performed in real time. The frame rate of the image content can be updated once per cycle by acquiring a plurality of pressing operations applied to the touch display screen within the current cycle time. Illustratively, as shown in fig. 6, t1 to t2 are one period, t2 to t3 are one period, and t3 to t4 are one period. If the current time is t4, the current cycle time is a cycle from t3 to t4, and the multiple press operations acquired are press operation c, press operation d, and press operation e.
As one way, the frame rate control method provided in this embodiment may be executed when the frame insertion function is turned on. In this way, during the display of the image content, it may be detected whether the frame insertion function of the electronic device is activated, and if the frame insertion function is activated, the target pressing data of the reference target may be acquired.
In this embodiment, whether the frame insertion function is enabled or not may be determined according to various ways.
Whether the frame insertion function is activated may be determined according to the remaining resources of the electronic device, as one way. The resource may be a processing resource or an electrical quantity. It should be noted that, if the electronic device performs frame insertion on the image content during the display process of the image content, processing resources of the CPU or the GPU are consumed, and if the frame insertion function is still turned on to execute the frame rate control method provided in this embodiment under the condition that the current remaining processing resources of the electronic device are relatively tight, the load of the electronic device may be increased, and the electronic device may be stuck. Similarly, the electronic device also needs to consume the power of the electronic device during the process of frame insertion of the image content, and if the remaining amount of power is low, the frame insertion function is still turned on, which may cause the power consumption of the electronic device to be too fast. In order to avoid the foregoing problem, the electronic device may detect whether the remaining processing resource is greater than a resource threshold, and if so, may configure the frame insertion function to be in an on state, and correspondingly, when it is detected that the remaining processing resource is not greater than the resource threshold, may configure the frame insertion function to be in an off state.
Wherein the resource threshold may comprise a first threshold for processing resources and/or a second threshold for power. If the resource threshold only comprises a first threshold related to the processing resource, the electronic device triggers to start the frame insertion function when detecting that the current remaining processing resource is larger than the first threshold, otherwise, the frame insertion function is closed. If the resource threshold only includes a second threshold related to the power amount, the electronic device may trigger to turn on the frame insertion function when detecting that the current remaining power amount is greater than the second threshold, otherwise turn off the frame insertion function. The resource threshold includes both a first threshold related to the processing resource and a second threshold related to the power amount, and the electronic device detects that the current remaining processing resource is greater than the first threshold, and triggers the frame insertion function to be turned on if the current remaining power amount is greater than the second threshold, otherwise, turns off the frame insertion function.
As another way, an insertion frame function management control may be configured on a setting interface of the electronic device, and a user may control to turn on or off the insertion frame function by touching the insertion frame function management control.
As one way, the method further comprises: acquiring the type of the currently running application program; updating a length of the cycle time based on a type of the application.
Wherein the length of the period time determines the frequency of subsequent frame rate updates. For example, if the period time length is 2 seconds, the frame rate update is performed every 2 seconds.
It should be noted that, for different image contents corresponding to different applications, the image content displayed is a video screen in the case of a currently running video application (video playback scene), and is a game screen in the case of a currently running game application (game scene). Under the condition that the running application programs are different, the frequency of the pressing operation performed by the user is different, so that for some application programs which are not frequently pressed by the user in the running process, the pressing operation is still obtained based on a more frequent period, and therefore greater power consumption waste is caused, and the frequency which is most suitable for the current application program and used for updating the frame rate is favorably selected by configuring different corresponding period time lengths for the application programs of different types. For example, the length of the corresponding cycle time for the game-type application may be shorter than that of the video-type application.
S220: and obtaining the target pressing data based on the pressing force degrees corresponding to the multiple pressing operations.
As one mode, the obtaining the target compression data based on the compression force degrees corresponding to the plurality of times of compression operations includes: and acquiring the maximum pressing degree in the pressing degrees corresponding to the multiple pressing operations as target pressing data.
S230: and acquiring frame rate control parameters corresponding to the target pressing data, wherein the frame rate control parameters comprise a target frame rate.
As a mode, the frame rate control parameter further includes a proportion of repeated frames in an inserted frame, where the inserted frame is a frame that needs to be newly added and is determined based on the frame rate; the generating a corresponding insertion frame based on the frame rate control parameter and inserting the insertion frame into the image content so that the frame rate of the image content into which the insertion frame is inserted satisfies the target frame rate includes: and generating a corresponding number of insertion frames of the content based on the target frame rate and the proportion of the repeated frames in the insertion frames, and inserting the insertion frames into the image content so that the frame rate of the image content inserted into the insertion frames meets the target frame rate.
It should be noted that the repeated frame ratio is understood as the ratio of the frames with repeated content in the inserted frames to all the inserted frames. The frame with repeated content can be understood as a frame with the same image content, and optionally, the frame with repeated content can be obtained by means of content copying. In this way, part of the interpolated frames are generated by means of motion vector estimation, while some interpolated frames are generated by means of content copying of the interpolated frames generated based on motion vector estimation.
Optionally, if the determined insertion frame is a 10-frame image, and the proportion of the repeated frames in the insertion frame is 50%, 5 frames in the 10-frame image may be obtained by copying the content of other insertion frames. For example, the 10-frame insertion frame may include an insertion image 61, an insertion image 62, an insertion image 63, an insertion image 64, an insertion image 65, an insertion image 66, an insertion image 67, an insertion image 68, an insertion image 69, and an insertion image 70 in the display order. Then in the case of a 50% repetition frame rate, where the interpolated image 61, the interpolated image 63, the interpolated image 65, the interpolated image 67 and the interpolated image 69 may be generated based on motion vector estimation, the interpolated image 62 may be content copied from the interpolated image 61, the interpolated image 64 may be content copied from the interpolated image 63, the interpolated image 66 may be content copied from the interpolated image 65, the interpolated image 68 may be content copied from the interpolated image 67 and the interpolated image 70 may be content copied from the interpolated image 69.
It should be noted that, if the target pixel is a pixel in the image,
the motion vector characterizes the displacement between the content block and the best matching block, or the displacement of any pixel. Where the pixel 10 in fig. 7 is located at (a, b) in the image of the previous frame and the pixel 10 in the image of the subsequent frame is located at (c, d), the motion vector corresponding to the pixel 10 in the image of the subsequent frame is (dx, dy), where dx represents the displacement of the pixel 10 in the X-axis direction and dy represents the displacement of the pixel 10 in the Y-axis direction, so that in the case shown in fig. 7, dx is a-c and dy is d-b.
As shown in fig. 8, the best matching block refers to the content block 31 of the next frame image 30 that matches the content block 21 of the previous frame image 20 to the highest degree. It should be noted that a plurality of pixels may be included in a content block, and in this embodiment, the displacement of the pixel at the center point of the content block may be used as the displacement of the content block. Wherein the center point may be a geometric center. In the content shown in fig. 8, the motion vectors between the content block and the best matching block are (a-c, d-b). Wherein a content block can be understood as characterizing a region in an image with a solid meaning. For example, if a person is in the image, the head of the person is a region with a solid meaning, the solid meaning is that the image content of the region represents the head of the person, and the head region can be used as a content block. For another example, the hand of the person is also an area with a solid meaning, and the hand area can be used as a content block.
Alternatively, as described above, a plurality of frame rate control sections may be configured in the electronic device. Optionally, the plurality of frame rate control intervals include a first frame rate control interval, a second frame rate control interval, and the third frame rate control interval.
Correspondingly, if the frame rate control interval corresponding to the target pressing data is a first frame rate control interval, a first target frame rate corresponding to the first frame rate control interval and a first repeated frame ratio in the insertion frame are acquired. If the frame rate control section corresponding to the target pressing data is a second frame rate control section, a second target frame rate corresponding to the second frame rate control section and a second repeating frame ratio in the insertion frame are obtained. If the frame rate control section corresponding to the target pressing data is a third frame rate control section, a third target frame rate corresponding to the third frame rate control section and a third repeating frame ratio in the insertion frame are obtained.
The motion parameters corresponding to the first frame rate control interval, the second frame rate control interval and the third frame rate control interval are sequentially increased, the first target frame rate, the second target frame rate and the third target frame rate are sequentially increased, and the first repeating frame ratio, the second repeating frame ratio and the third repeating frame ratio are sequentially decreased. For example, the first target frame rate may be 40fps, the second target frame rate may be 50fps, and the third target frame rate may be 60 fps. The first repetition frame proportion may be 50%, the second repetition frame proportion may be 70%, and the third repetition frame proportion may be 100%.
S240: and generating a corresponding insertion frame based on the frame rate control parameter, and inserting the insertion frame into the image content so that the frame rate of the image content inserted into the insertion frame meets the target frame rate.
It is understood that, if the corresponding frame rate control interval is the first frame rate control interval, the corresponding inserted frame is generated based on the first target frame rate and the first repeating frame ratio in the inserted frame. If the corresponding frame rate control interval is the second frame rate control interval, the corresponding insertion frame is generated based on the second target frame rate and the second repeating frame ratio in the insertion frame. If the corresponding frame rate control section is the third frame rate control section, the corresponding insertion frame is generated based on the third target frame rate and the third repetition frame ratio in the insertion frame.
According to the frame rate control method, the frame rate of the image content is adjusted through the target pressing data corresponding to the pressing operation acting on the touch display screen, so that the frame rate of the image content can be flexibly switched along with the pressing operation of a user in the display process of the image content, and the flexibility of frame rate control in the frame rate control process is improved. In addition, in this embodiment, the target pressing data may be determined according to a plurality of pressing operations that are acquired and act on the touch display screen within the current period of time, so that the acquired target pressing data can more accurately represent the pressing operation intention of the user, and further more accurate frame rate control is achieved. Moreover, in the embodiment, the length of the specified time period can be determined according to the type of the currently running application program, so that the flexibility and the adaptability of the frame rate control are further improved.
Referring to fig. 9, a frame rate control method provided in an embodiment of the present application is applied to an electronic device configured with a touch display screen, and the method includes:
s310: and in the display process of the image content, acquiring the motion degree of a reference target in the image content.
The reference object may be a specific object, such as a human face or an animal. Furthermore, the reference target may also be a pixel in the image content.
S320: detecting whether the degree of motion is greater than a degree threshold.
S330: and if the motion degree is greater than a degree threshold value, acquiring target pressing data corresponding to the pressing operation acting on the touch display screen.
S340: if the motion degree is not larger than the degree threshold value, the process is ended.
S350: and acquiring frame rate control parameters corresponding to the target pressing data, wherein the frame rate control parameters comprise a target frame rate.
S360: and generating a corresponding insertion frame based on the frame rate control parameter, and inserting the insertion frame into the image content so that the frame rate of the image content inserted into the insertion frame meets the target frame rate.
According to the frame rate control method, the frame rate of the image content is adjusted through the target pressing data corresponding to the pressing operation acting on the touch display screen, so that the frame rate of the image content can be flexibly switched along with the pressing operation of a user in the display process of the image content, and the flexibility of frame rate control in the frame rate control process is improved. In addition, in this embodiment, whether to trigger the subsequent step can be determined according to the motion degree of the reference target in the image content, which is favorable for improving the accuracy of frame rate control in triggering, and avoids the behavior of meaningless acquiring target pressing data corresponding to the pressing operation applied to the touch display screen, thereby avoiding resource waste.
Referring to fig. 10, a frame rate control method provided in an embodiment of the present application is applied to an electronic device configured with a touch display screen, and the method includes:
s410: and in the display process of the image content, acquiring the interface type of the currently displayed interface.
S420: and detecting whether the interface type of the currently displayed interface is a dynamic interface.
It should be noted that there may be different types of interfaces even corresponding to the same image content display scene. Moreover, the interfaces of different types have different requirements for frame interpolation, and some interfaces do not need frame interpolation because of no obvious improvement of visual experience after frame interpolation. The interface types may be further classified, and optionally, the interface types may be classified into a dynamic type and a static type, where the dynamic type interface corresponds to the interface capable of performing the frame interpolation operation, and the static type interface corresponds to the interface not capable of performing the frame interpolation operation. The game battle interface in the game scene can be a dynamic interface, and the property bar interface, the chat interface, the configuration interface and the like in the game scene can be static interfaces.
Taking a game scene as an example, after the current image content display scene is acquired as the game scene, the interface type of the current displayed interface may be acquired first, and then, under the condition that the interface type of the current displayed interface is a dynamic type, the subsequent acquisition of the motion degree of the reference target in the image content is performed, otherwise, the subsequent steps are not performed.
In addition, in other image content display scenes, whether to trigger subsequent acquisition of the motion parameters of the reference target can be determined by detecting the interface type of the currently displayed interface, and a frame rate control interval corresponding to the motion parameters is acquired, and frame rate control parameters corresponding to the frame rate control interval are acquired. For example, in a video playing scene, a video playing interface may be included, and a content selection interface may also be included. It can be understood that, when the video playing interface is displayed, the video playing state is actually performed, and when the content selection interface actually displays a plurality of video browsing interfaces for the user to select, in the video playing scene, when the currently displayed interface is the video playing interface, the subsequent acquisition of the motion degree of the reference target in the image content is triggered, so that the effectiveness of controlling the display process of the image content is improved.
S430: and if the interface type is a dynamic interface, acquiring the motion degree of the reference target in the image content.
S440: and if the interface type is not the interface of the dynamic type, ending the process.
S450: detecting whether the degree of motion is greater than a degree threshold.
S460: and if the motion degree is greater than a degree threshold value, acquiring target pressing data corresponding to the pressing operation acting on the touch display screen.
S470: if the motion degree is not larger than the degree threshold value, the process is ended.
S480: and acquiring frame rate control parameters corresponding to the target pressing data, wherein the frame rate control parameters comprise a target frame rate.
S490: and generating a corresponding insertion frame based on the frame rate control parameter, and inserting the insertion frame into the image content so that the frame rate of the image content inserted into the insertion frame meets the target frame rate.
According to the frame rate control method, the frame rate of the image content is adjusted through the target pressing data corresponding to the pressing operation acting on the touch display screen, so that the frame rate of the image content can be flexibly switched along with the pressing operation of a user in the display process of the image content, and the flexibility of frame rate control in the frame rate control process is improved. In addition, in this embodiment, whether to trigger the subsequent step may be determined according to the degree of motion of the reference target in the image content and the interface type of the currently displayed interface, which is favorable to improve the accuracy of frame rate control for triggering, and avoids a behavior of meaninglessly acquiring target pressing data corresponding to the pressing operation applied to the touch display screen, thereby avoiding resource waste.
Referring to fig. 11, in an electronic device equipped with a touch display screen, a frame rate control apparatus 500 according to an embodiment of the present disclosure includes:
a target pressing data obtaining unit 510, configured to obtain target pressing data corresponding to a pressing operation applied to the touch display screen in a display process of image content.
As one mode, the target pressing data obtaining unit 510 is specifically configured to obtain multiple pressing operations acting on the touch display screen within a current cycle time; and obtaining the target pressing data based on the pressing force degrees corresponding to the multiple pressing operations. Optionally, the target pressing data obtaining unit 510 is specifically configured to obtain, as the target pressing data, a maximum pressing degree in the pressing degrees corresponding to the multiple pressing operations. The target pressing data obtaining unit 510 is further specifically configured to obtain a type of the currently running application; updating a length of the cycle time based on a type of the application.
As one way, the object pressing data obtaining unit 510 is specifically configured to obtain a motion degree of a reference object in image content during a display process of the image content; and if the motion degree is greater than a degree threshold value, acquiring target pressing data corresponding to the pressing operation acting on the touch display screen. Optionally, the target pressing data obtaining unit 510 is specifically configured to detect an interface type of a currently displayed interface; and if the interface type is a dynamic interface, acquiring the motion degree of the reference target in the image content.
As a mode, the frame rate control parameter further includes a proportion of repeated frames in an inserted frame, where the inserted frame is a frame that needs to be newly added and is determined based on the frame rate; the target press data obtaining unit 510 is specifically configured to generate a corresponding number of insertion frames and content based on the target frame rate and a ratio of repeated frames in the insertion frames, and insert the insertion frames into the image content, so that a frame rate of the image content into which the insertion frames are inserted satisfies the target frame rate.
A frame rate parameter obtaining unit 520, configured to obtain a frame rate control parameter corresponding to the target pressing data, where the frame rate control parameter includes a target frame rate.
A frame rate control unit 530, configured to generate a corresponding insertion frame based on the frame rate control parameter, and insert the insertion frame into the image content, so that the frame rate of the image content into which the insertion frame is inserted satisfies the target frame rate.
According to the frame rate control device, in the display process of image content, target pressing data corresponding to pressing operation acting on the touch display screen are acquired, then frame rate control parameters corresponding to the target pressing data are acquired, the frame rate control parameters comprise a target frame rate, corresponding insertion frames are generated based on the frame rate control parameters, and the insertion frames are inserted into the image content, so that the frame rate of the image content with the inserted frames meets the target frame rate. Therefore, the frame rate of the image content is adjusted through the target pressing data corresponding to the pressing operation acting on the touch display screen, so that the frame rate of the image content can be flexibly switched along with the pressing operation of a user in the display process of the image content, and the flexibility of frame rate control in the frame rate control process is improved.
It should be noted that the device embodiment and the method embodiment in the present application correspond to each other, and specific principles in the device embodiment may refer to the contents in the method embodiment, which is not described herein again.
An electronic device provided by the present application will be described below with reference to fig. 12.
Referring to fig. 12, based on the frame rate control method and apparatus, another electronic device 200 capable of performing the frame rate control method is further provided in the embodiment of the present application. The electronic device 200 includes one or more processors 102 (only one shown), a memory 104, a network module 106, and a framing chip 108 coupled to each other. The memory 104 stores therein a program that can execute the content in the foregoing embodiments, and the framing chip 108 can execute the program stored in the memory 104. When the frame interpolation chip 108 executes the program stored in the memory 104, it can be understood that the frame interpolation chip 108 can execute the frame rate control method provided in this embodiment, which is further beneficial to reducing the load of the processor 102. Optionally, the framing chip 108 may receive the image content through mipi (mobile Industry Processor interface) reception. Moreover, the frame rate control method in the embodiment of the present application may also be executed by a frame interpolation chip and a processor together. Alternatively, S110 and S120 in the foregoing embodiments may be executed by a processor, and S130 may be executed by a framing chip.
The Memory 104 may include a Random Access Memory (RAM) or a Read-Only Memory (Read-Only Memory). The memory 104 may be used to store instructions, programs, code sets, or instruction sets. The memory 104 may include a stored program area and a stored data area, wherein the stored program area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like. The storage data area may also store data created by the terminal 100 in use, such as a phonebook, audio-video data, chat log data, and the like.
The network module 106 is configured to receive and transmit electromagnetic waves, and implement interconversion between the electromagnetic waves and electrical signals, so as to communicate with a communication network or other devices, for example, an audio playing device. The network module 106 may include various existing circuit elements for performing these functions, such as an antenna, a radio frequency transceiver, a digital signal processor, an encryption/decryption chip, a Subscriber Identity Module (SIM) card, memory, and so forth. The network module 106 may communicate with various networks, such as the internet, an intranet, a wireless network, or with other devices via a wireless network. The wireless network may comprise a cellular telephone network, a wireless local area network, or a metropolitan area network. For example, the network module 106 may interact with a base station.
Referring to fig. 13, a block diagram of a computer-readable storage medium according to an embodiment of the present application is shown. The computer-readable medium 1100 has stored therein program code that can be called by a processor to perform the method described in the above-described method embodiments.
The computer-readable storage medium 1100 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read only memory), an EPROM, a hard disk, or a ROM. Alternatively, the computer-readable storage medium 1100 includes a non-volatile computer-readable storage medium. The computer readable storage medium 1100 has storage space for program code 1110 for performing any of the method steps of the method described above. The program code can be read from or written to one or more computer program products. The program code 1110 may be compressed, for example, in a suitable form.
In summary, according to the frame rate control method, the device and the electronic apparatus provided by the present application, in the display process of image content, target press data corresponding to a press operation applied to the touch display screen is obtained, and then frame rate control parameters corresponding to the target press data are obtained, where the frame rate control parameters include a target frame rate, and a corresponding insertion frame is generated based on the frame rate control parameters, and the insertion frame is inserted into the image content, so that the frame rate of the image content into which the insertion frame is inserted meets the target frame rate. Therefore, the frame rate of the image content is adjusted through the target pressing data corresponding to the pressing operation acting on the touch display screen, so that the frame rate of the image content can be flexibly switched along with the pressing operation of a user in the display process of the image content, and the flexibility of frame rate control in the frame rate control process is improved.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same; although the present application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not necessarily depart from the spirit and scope of the corresponding technical solutions in the embodiments of the present application.
Claims (10)
1. The frame rate control method is applied to an electronic device configured with a touch display screen, and comprises the following steps:
in the display process of the image content, acquiring target pressing data corresponding to the pressing operation acting on the touch display screen;
acquiring frame rate control parameters corresponding to the target pressing data, wherein the frame rate control parameters comprise a target frame rate;
and generating a corresponding insertion frame based on the frame rate control parameter, and inserting the insertion frame into the image content so that the frame rate of the image content inserted into the insertion frame meets the target frame rate.
2. The method according to claim 1, wherein the acquiring target pressing data corresponding to the pressing operation applied to the touch display screen comprises:
acquiring multiple pressing operations acting on the touch display screen within the current period time;
and obtaining the target pressing data based on the pressing force degrees corresponding to the multiple pressing operations.
3. The method according to claim 2, wherein the deriving the target compression data based on the compression force degrees corresponding to each of the plurality of compression operations comprises:
and acquiring the maximum pressing degree in the pressing degrees corresponding to the multiple pressing operations as target pressing data.
4. A method according to claim 2 or 3, characterized in that the method further comprises:
acquiring the type of the currently running application program;
updating a length of the cycle time based on a type of the application.
5. The method according to claim 1, wherein the acquiring, during the displaying of the image content, target pressing data corresponding to a pressing operation applied to the touch display screen comprises:
in the display process of image content, acquiring the motion degree of a reference target in the image content;
and if the motion degree is greater than a degree threshold value, acquiring target pressing data corresponding to the pressing operation acting on the touch display screen.
6. The method according to claim 5, wherein the obtaining the degree of motion of the reference object in the image content during the displaying of the image content comprises:
detecting the interface type of the currently displayed interface;
and if the interface type is a dynamic interface, acquiring the motion degree of the reference target in the image content.
7. The method of claim 1, wherein the frame rate control parameters further comprise a ratio of repeated frames in an inserted frame, the inserted frame being a frame determined based on the frame rate that needs to be newly added; the generating a corresponding insertion frame based on the frame rate control parameter and inserting the insertion frame into the image content so that the frame rate of the image content into which the insertion frame is inserted satisfies the target frame rate includes:
and generating a corresponding number of insertion frames of the content based on the target frame rate and the proportion of the repeated frames in the insertion frames, and inserting the insertion frames into the image content so that the frame rate of the image content inserted into the insertion frames meets the target frame rate.
8. A frame rate control device, which is operated in an electronic device equipped with a touch display screen, the device comprising:
the target pressing data acquisition unit is used for acquiring target pressing data corresponding to pressing operation acting on the touch display screen in the display process of image content;
a frame rate parameter obtaining unit, configured to obtain a frame rate control parameter corresponding to the target pressing data, where the frame rate control parameter includes a target frame rate;
and the frame rate control unit is used for generating a corresponding insertion frame based on the frame rate control parameter and inserting the insertion frame into the image content so that the frame rate of the image content inserted with the insertion frame meets the target frame rate.
9. An electronic device, comprising a frame insertion chip, a processor and a memory;
one or more programs are stored in the memory and configured to be executed by the framing chip and/or the processor to implement the method of any of claims 1-7.
10. A computer-readable storage medium, in which a program code is stored, wherein the method of any of claims 1-7 is performed when the program code is executed by a framing chip and/or a processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010953712.0A CN112057842B (en) | 2020-09-11 | 2020-09-11 | Frame rate control method and device and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010953712.0A CN112057842B (en) | 2020-09-11 | 2020-09-11 | Frame rate control method and device and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112057842A true CN112057842A (en) | 2020-12-11 |
| CN112057842B CN112057842B (en) | 2023-10-03 |
Family
ID=73695406
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010953712.0A Active CN112057842B (en) | 2020-09-11 | 2020-09-11 | Frame rate control method and device and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112057842B (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114339410A (en) * | 2021-12-28 | 2022-04-12 | 维沃移动通信有限公司 | Frame insertion method and device and electronic equipment |
| CN114490671A (en) * | 2022-03-31 | 2022-05-13 | 北京华建云鼎科技股份公司 | Client-side same-screen data synchronization system |
| CN114827477A (en) * | 2022-05-26 | 2022-07-29 | 维沃移动通信有限公司 | Time-lapse shooting method and device, electronic equipment and medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001045493A (en) * | 1999-08-04 | 2001-02-16 | Casio Comput Co Ltd | Moving image encoding device, moving image output device and storage medium |
| CN101998029A (en) * | 2009-08-05 | 2011-03-30 | 株式会社日立制作所 | Image processing device and image processing method |
| US9247243B1 (en) * | 2012-01-02 | 2016-01-26 | Marvell International Ltd. | Interpolated video error concealment |
| CN105874783A (en) * | 2014-02-04 | 2016-08-17 | 英特尔公司 | Techniques for frame repetition control in frame rate up-conversion |
| CN111083417A (en) * | 2019-12-10 | 2020-04-28 | Oppo广东移动通信有限公司 | Image processing method and related product |
-
2020
- 2020-09-11 CN CN202010953712.0A patent/CN112057842B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001045493A (en) * | 1999-08-04 | 2001-02-16 | Casio Comput Co Ltd | Moving image encoding device, moving image output device and storage medium |
| CN101998029A (en) * | 2009-08-05 | 2011-03-30 | 株式会社日立制作所 | Image processing device and image processing method |
| US9247243B1 (en) * | 2012-01-02 | 2016-01-26 | Marvell International Ltd. | Interpolated video error concealment |
| CN105874783A (en) * | 2014-02-04 | 2016-08-17 | 英特尔公司 | Techniques for frame repetition control in frame rate up-conversion |
| CN111083417A (en) * | 2019-12-10 | 2020-04-28 | Oppo广东移动通信有限公司 | Image processing method and related product |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114339410A (en) * | 2021-12-28 | 2022-04-12 | 维沃移动通信有限公司 | Frame insertion method and device and electronic equipment |
| CN114490671A (en) * | 2022-03-31 | 2022-05-13 | 北京华建云鼎科技股份公司 | Client-side same-screen data synchronization system |
| CN114490671B (en) * | 2022-03-31 | 2022-07-29 | 北京华建云鼎科技股份公司 | Client-side same-screen data synchronization system |
| CN114827477A (en) * | 2022-05-26 | 2022-07-29 | 维沃移动通信有限公司 | Time-lapse shooting method and device, electronic equipment and medium |
| CN114827477B (en) * | 2022-05-26 | 2024-03-29 | 维沃移动通信有限公司 | Method, device, electronic equipment and medium for time-lapse photography |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112057842B (en) | 2023-10-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112057842B (en) | Frame rate control method and device and electronic equipment | |
| CN112203034B (en) | Frame rate control method and device and electronic equipment | |
| CN110913442B (en) | Network switching method and device, electronic equipment and storage medium | |
| CN112135081B (en) | Mode control method and device, frame insertion chip and electronic equipment | |
| CN109600654B (en) | Bullet screen processing method and device and electronic equipment | |
| CN109107158B (en) | Sound effect processing method and device, electronic equipment and computer readable storage medium | |
| CN110389696B (en) | Method and device for controlling screen color gamut, electronic equipment and storage medium | |
| CN109688465B (en) | Video enhancement control method and device and electronic equipment | |
| CN109640179B (en) | Video decoding control method and device and electronic equipment | |
| CN110569008B (en) | Screen data processing method and device and electronic equipment | |
| CN109218528B (en) | Sound effect processing method and device and electronic equipment | |
| CN109410900B (en) | Sound effect processing method and device and electronic equipment | |
| CN112399123A (en) | Video definition adjusting method and device, electronic equipment and storage medium | |
| CN111260760B (en) | Image processing method, device, electronic equipment and storage medium | |
| CN110418209B (en) | Information processing method applied to video transmission and terminal equipment | |
| CN111273769A (en) | Equipment control method and device, electronic equipment and storage medium | |
| CN109474833B (en) | Network live broadcast method, related device and system | |
| CN113559498A (en) | Three-dimensional model display method and device, storage medium and electronic equipment | |
| KR101342210B1 (en) | Device and method for controlling screen brightness in wireless terminal | |
| CN113630621B (en) | Video processing method, related device and storage medium | |
| CN112487223A (en) | Image processing method and device and electronic equipment | |
| CN111190634B (en) | Layout information processing method and device and electronic equipment | |
| CN109640094B (en) | Video decoding method and device and electronic equipment | |
| CN110572867A (en) | method and device for reducing power consumption of electronic equipment | |
| CN108712556B (en) | Frame rate adjusting method and device, terminal equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |