CN115580746A - Image refreshing method, device, equipment and medium - Google Patents

Image refreshing method, device, equipment and medium Download PDF

Info

Publication number
CN115580746A
CN115580746A CN202211175341.3A CN202211175341A CN115580746A CN 115580746 A CN115580746 A CN 115580746A CN 202211175341 A CN202211175341 A CN 202211175341A CN 115580746 A CN115580746 A CN 115580746A
Authority
CN
China
Prior art keywords
image
area
refreshed
determining
effective
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211175341.3A
Other languages
Chinese (zh)
Inventor
张猛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Goertek Techology Co Ltd
Original Assignee
Goertek Techology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Goertek Techology Co Ltd filed Critical Goertek Techology Co Ltd
Priority to CN202211175341.3A priority Critical patent/CN115580746A/en
Publication of CN115580746A publication Critical patent/CN115580746A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8146—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Graphics (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)

Abstract

The invention discloses an image refreshing method, an image refreshing device, image refreshing equipment and a computer storage medium, which relate to the technical field of image display and comprise the following steps: determining an image area to be refreshed in a display interface and effective coordinates of the image area to be refreshed in the display interface; obtaining effective image data corresponding to the determined area of the effective coordinate in the display interface; and refreshing the current frame image in the display interface based on the effective image data to obtain the next frame image. According to the invention, only the effective image data corresponding to the area to be refreshed of the image is transmitted in a mode of optimizing the data volume pushed to the panel screen by the MCU, and the whole frame of image data is not required to be transmitted completely, so that the data transmission volume is reduced, the data transmission time is shortened, the display frame rate is improved, and the power consumption is reduced.

Description

Image refreshing method, device, equipment and medium
Technical Field
The present invention relates to the field of image display technologies, and in particular, to an image refreshing method, an image refreshing apparatus, an image refreshing device, and a computer storage medium.
Background
At present, with the rise of AR (Augmented Reality) and watch devices and the low power consumption requirement of such devices in recent years, more and more of such devices adopt a display mode of MCU (microcontrollerunit) + SPI (Serial Peripheral Interface) panel. However, in this way, because the MCU platform generally has only a single core and has low performance, the time for rendering an image by a GUI (Graphical User Interface) is long, and further the time for transmitting an SPI is long, so that there are technical problems that the amount of image data to be transmitted by such a device is large and the screen display frame rate is low.
Disclosure of Invention
The invention mainly aims to provide an image refreshing method, an image refreshing device and a computer storage medium, and aims to solve the technical problems of large image data transmission quantity and low screen display frame rate in the prior art.
In order to achieve the above object, the present invention provides an image refreshing method, comprising the steps of:
determining an image area to be refreshed in a display interface and effective coordinates of the image area to be refreshed in the display interface;
obtaining effective image data corresponding to the determined area of the effective coordinate in the display interface;
and refreshing the current frame image in the display interface based on the effective image data to obtain the next frame image.
Further, the step of determining the area to be refreshed of the image in the display interface includes:
determining an area to be refreshed of the image before rendering the next frame of image;
or before the next frame image is rendered, the current frame image and the next frame image to be rendered are obtained, and the area to be refreshed of the image is determined by comparing the current frame image and the next frame image.
Further, the step of determining effective coordinates of the area to be refreshed in the image in the display interface includes:
determining the coordinate of the line boundary of the area to be refreshed of the image as the effective coordinate;
or determining the coordinate of the column boundary of the area to be refreshed of the image as the effective coordinate;
or determining the coordinates of the line boundary and the column boundary of the area to be refreshed of the image as the effective coordinates.
Further, the step of determining effective coordinates of the area to be refreshed in the image comprises:
determining the area ratio between the area to be refreshed of the image and the area where the line boundary of the area to be refreshed of the image is located, and the number ratio of pixels in the line direction;
and determining the effective coordinates of the area to be refreshed of the image according to the area ratio and the pixel number ratio.
Further, the step of determining the effective coordinates of the area to be refreshed of the image according to the area ratio and the pixel number ratio includes:
when the area ratio is larger than a preset area ratio, determining the effective coordinate as a coordinate where a line boundary of the area to be refreshed of the image is located;
when the area ratio is not larger than a preset area ratio and the pixel number ratio is larger than a preset number ratio, determining the effective coordinates as coordinates where the column boundaries of the area to be refreshed of the image are located;
and when the area ratio is not greater than a preset area ratio and the pixel number ratio is not greater than a preset number ratio, determining the effective coordinates as coordinates where a row boundary and a column boundary of the image area to be refreshed are located.
Further, the image refreshing method further includes:
determining the current residual computing power and the current refreshing frame rate of the display interface;
and when the current residual computing power is less than a preset lower-limit computing power and the current refreshing frame rate is greater than a preset lower-limit frame rate, reducing the current refreshing frame rate to refresh the image.
Further, the step of reducing the current refresh frame rate to perform image refresh includes:
determining a frame rate difference value between the current refreshing frame rate and the preset lower limit frame rate;
extracting image frames corresponding to the frame rate difference values at uniform intervals;
or determining a calculation force difference value between the current residual calculation force and the preset lower calculation force, and extracting image frames corresponding to the calculation force difference value at uniform intervals.
In addition, to achieve the above object, the present invention also provides an image refresh apparatus comprising:
the device comprises a determining module, a judging module and a judging module, wherein the determining module is used for determining an image area to be refreshed in a display interface and effective coordinates of the image area to be refreshed in the display interface;
the acquisition module is used for acquiring effective image data corresponding to the determined area of the effective coordinate in the display interface;
and the refreshing module is used for refreshing the current frame image in the display interface based on the effective image data to obtain the next frame image.
Further, to achieve the above object, the present invention also provides an image refresh apparatus comprising: a memory, a processor and a computer program stored on the memory and executable on the processor, the computer program being configured to implement the steps of the image refresh method as claimed in any one of the above.
Furthermore, to achieve the above object, the present invention also provides a computer storage medium having a computer program stored thereon, the computer program implementing the steps of the image refreshing method according to any one of the above when executed by a processor.
The invention provides an image refreshing method, an image refreshing device and a computer storage medium, which are used for determining an image region to be refreshed in a display interface and effective coordinates of the image region to be refreshed in the display interface; obtaining effective image data corresponding to the area determined by the effective coordinates in the display interface; and refreshing the current frame image in the display interface based on the effective image data to obtain the next frame image.
In the application, when the GUI library carries out image rendering, the coordinates of the region to be refreshed of the rendered image are stored; acquiring effective coordinates of a region to be refreshed of an image rendered by the frame when the MCU transmits data to the panel; and selecting effective image data to be transmitted in one frame of image according to the effective coordinates for transmission, thereby refreshing the current frame of image to obtain the next frame of image.
In the application, an image refreshing method for refreshing a screen in a block manner is provided, effective image data corresponding to an area to be refreshed of an image is only transmitted by optimizing the data volume pushed to a panel screen by an MCU, and the whole frame of image data does not need to be transmitted completely, so that the data transmission amount (data volume transmitted by an SPI) is reduced, the data transmission time is shortened, the display frame rate is improved, and the power consumption is reduced.
Drawings
Fig. 1 is a schematic structural diagram of the hardware operation of a terminal device according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating an image refreshing method according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of image refresh;
FIG. 4 is a diagram of a conventional image region to be refreshed;
FIG. 5 is a schematic diagram of an area to be refreshed according to an embodiment of an image refreshing method of the present invention;
FIG. 6 is a schematic diagram of an image refreshing apparatus according to the present invention.
The objects, features and advantages of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
As shown in fig. 1, fig. 1 is a schematic structural diagram of a hardware operating environment related to a terminal device according to an embodiment of the present invention.
It should be noted that fig. 1 is a schematic structural diagram of a hardware operating environment of the terminal device. The terminal device in the embodiment of the present invention may be a device for executing the image refreshing method provided by the present invention for a storage device based on nand flash as a storage medium, and the terminal device may specifically be a mobile terminal, a data storage control terminal, a PC, a portable computer, or other terminals.
As shown in fig. 1, the terminal device may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a storage device 1005, a communication bus 1002. Wherein a communication bus 1002 is used to enable connective communication between these components. The user interface 1003 may include a Display (Display), an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., a WI-FI interface). The storage device 1005 may be a non-volatile storage device (e.g., a Flash storage device), a high-speed RAM storage device, or a non-volatile storage device (e.g., a magnetic disk storage device). The storage device 1005 may alternatively be a storage means separate from the aforementioned processor 1001.
Those skilled in the art will appreciate that the terminal device configuration shown in fig. 1 is not intended to be limiting of the terminal device and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
As shown in fig. 1, a storage device 1005, which is a kind of computer storage medium, may include therein an operating system, a network communication module, a user interface module, and a computer program. The operating system is a program that manages and controls the hardware and software resources of the sample terminal device, and supports the execution of computer programs and other software or programs.
In the terminal apparatus shown in fig. 1, the user interface 1003 is mainly used for data communication with each terminal; the network interface 1004 is mainly used for connecting a background server and performing data communication with the background server; and the processor 1001 may be configured to call a computer program stored in the storage device 1005 and perform the following operations:
determining an image area to be refreshed in a display interface and effective coordinates of the image area to be refreshed in the display interface;
obtaining effective image data corresponding to the area determined by the effective coordinates in the display interface;
and refreshing the current frame image in the display interface based on the effective image data to obtain the next frame image.
Further, the processor 1001 may call a computer program stored in the storage device 1005, and also perform the following operations:
the step of determining the area to be refreshed of the image in the display interface comprises the following steps:
before rendering the next frame of image, determining an area of the image to be refreshed;
or before the next frame image is rendered, the current frame image and the next frame image to be rendered are obtained, and the area to be refreshed of the image is determined by comparing the current frame image and the next frame image.
Further, the step of determining effective coordinates of the area to be refreshed in the image in the display interface includes:
determining the coordinate of the line boundary of the area to be refreshed of the image as the effective coordinate;
or determining the coordinate of the column boundary of the area to be refreshed of the image as the effective coordinate;
or determining the coordinates of the line boundary and the column boundary of the area to be refreshed of the image as the effective coordinates.
Further, the processor 1001 may call a computer program stored in the storage device 1005, and further perform the following operations:
the step of determining the effective coordinates of the area to be refreshed of the image comprises the following steps:
determining the area ratio between the area to be refreshed and the area where the line boundary of the area to be refreshed and the image area to be refreshed is located, and the pixel number ratio in the line direction;
and determining the effective coordinates of the area to be refreshed of the image according to the area ratio and the pixel number ratio.
Further, the processor 1001 may call a computer program stored in the storage device 1005, and also perform the following operations:
the step of determining the effective coordinates of the region to be refreshed of the image according to the area ratio and the pixel number ratio comprises:
when the area ratio is larger than a preset area ratio, determining the effective coordinate as a coordinate where a line boundary of the area to be refreshed of the image is located;
when the area ratio is not larger than a preset area ratio and the pixel number ratio is larger than a preset number ratio, determining the effective coordinates as coordinates where the column boundaries of the area to be refreshed of the image are located;
and when the area ratio is not greater than a preset area ratio and the pixel number ratio is not greater than a preset number ratio, determining the effective coordinates as coordinates where a row boundary and a column boundary of the image area to be refreshed are located.
Further, the processor 1001 may call a computer program stored in the storage device 1005, and also perform the following operations:
the image refreshing method further comprises the following steps:
determining the current residual computing power and the current refresh frame rate of the display interface;
and when the current residual computing power is less than a preset lower-limit computing power and the current refreshing frame rate is greater than a preset lower-limit frame rate, reducing the current refreshing frame rate to refresh the image.
Further, the processor 1001 may call a computer program stored in the storage device 1005, and further perform the following operations:
the step of reducing the current refresh frame rate to refresh the image comprises:
determining a frame rate difference value between the current refreshing frame rate and the preset lower limit frame rate;
extracting image frames corresponding to the frame rate difference values at uniform intervals;
or determining a calculation force difference value between the current residual calculation force and the preset lower calculation force, and extracting image frames corresponding to the calculation force difference value at uniform intervals.
Referring to fig. 2, fig. 2 is a flowchart illustrating an image refreshing method according to an embodiment of the present invention.
In this embodiment, the image refreshing method of the present invention includes:
step S10, determining an image area to be refreshed in a display interface and effective coordinates of the image area to be refreshed in the display interface.
And step S20, obtaining effective image data corresponding to the area determined by the effective coordinates in the display interface.
And step S30, refreshing the current frame image in the display interface based on the effective image data to obtain the next frame image.
Referring to fig. 3, fig. 3 is a schematic view of image refresh. The conventional frame transmission method needs to transmit the whole frame buffer to the panel, as shown in fig. 4, which is a great burden to the MCU with only one core. In the conventional image refreshing mode, because the MCU platform generally has only a single core and has low performance, the time for rendering an image by a GUI (Graphical User Interface) is long, and further the time for transmitting an SPI is long, which results in the technical problems of large image data amount and low screen display frame rate required by such devices.
Referring to fig. 5, fig. 5 is a schematic diagram of an image region to be refreshed according to an embodiment of an image refreshing method of the present invention. In this embodiment, when the GUI library performs image rendering, coordinates of a region to be refreshed of a rendered image are saved; acquiring effective coordinates of an image to-be-refreshed area rendered by the frame when the MCU transmits data to the panel; and selecting effective image data to be transmitted in one frame of image according to the effective coordinates for transmission, thereby refreshing the current frame of image to obtain the next frame of image.
In this embodiment, an image refreshing method for refreshing a screen in blocks is provided, in which a mode of optimizing a data size pushed by an MCU to a panel screen is used, only effective image data corresponding to an area to be refreshed is transmitted, and it is not necessary to transmit all image data of a whole frame, so as to reduce a data transmission amount (data amount of SPI transmission), shorten data transmission time, and further improve a display frame rate and reduce power consumption.
Optionally, the step of determining an area to be refreshed of the image in the display interface includes:
determining an area to be refreshed of the image before rendering the next frame of image;
or before the next frame image is rendered, the current frame image and the next frame image to be rendered are obtained, and the area to be refreshed of the image is determined by comparing the current frame image and the next frame image.
In this embodiment, the area to be refreshed of the image may be determined when the next frame image is rendered by the GUI library, or after the pixels of the current frame image and the next frame image to be rendered are aligned, the current frame image and the next frame image to be rendered are compared, and the difference area between the two frame images is determined as the area to be refreshed of the image.
Optionally, the step of determining effective coordinates of the area to be refreshed of the image in the display interface includes:
determining the coordinate of the line boundary of the area to be refreshed of the image as the effective coordinate;
or, determining the coordinate of the column boundary of the region to be refreshed of the image as the effective coordinate;
or determining the coordinates of the line boundary and the column boundary of the area to be refreshed of the image as the effective coordinates.
Referring to fig. 5, the image update area is an area where the "smiling face" in fig. 5 is located, the effective coordinate of the area to be refreshed of the image is determined to be a column coordinate of the area where the "smiling face" is located, or an area coordinate defined according to each boundary coordinate of the area where the "smiling face" is located, and the two ways of determining the effective coordinate are complex and ideal.
In another embodiment of the image refresh method of the present invention, the step of determining the effective coordinates of the area to be refreshed of the image includes:
determining the area ratio between the area to be refreshed and the area where the line boundary of the area to be refreshed and the image area to be refreshed is located, and the pixel number ratio in the line direction;
and determining the effective coordinates of the area to be refreshed of the image according to the area ratio and the pixel number ratio.
In this embodiment, when determining the effective coordinates of the region to be refreshed in the image, the effective coordinates are determined according to the area and the width of the region to be refreshed in the image. After the area to be refreshed of the image is determined to be the area of the smiling face as shown in fig. 5, the coordinates of the line boundary and the coordinates of the column boundary of the area to be refreshed of the image are determined, and then the area ratio of the area to the area of the line boundary and the pixel number ratio in the line direction of the area to be refreshed of the image are determined. Specifically, in this embodiment, the area ratio is the area ratio between the area of the region of the "smiling face" shown in fig. 5 and the region of the line boundary thereof, and the pixel number ratio is the number ratio between the pixels of the column boundary of the region of the "smiling face" shown in fig. 5 and the pixels of the region of the entire line boundary.
Optionally, the step of determining the effective coordinates of the region to be refreshed of the image according to the area ratio and the pixel number ratio includes:
when the area ratio is larger than a preset area ratio, determining the effective coordinate as a coordinate where a line boundary of the area to be refreshed of the image is located;
when the area ratio is not larger than a preset area ratio and the pixel number ratio is larger than a preset number ratio, determining the effective coordinates as coordinates where the column boundaries of the area to be refreshed of the image are located;
and when the area ratio is not greater than a preset area ratio and the pixel number ratio is not greater than a preset number ratio, determining the effective coordinates as coordinates where a row boundary and a column boundary of the image area to be refreshed are located.
When the area ratio is larger than the preset area ratio, the area of the area to be refreshed of the image is close to the area of the area where the line boundary is located, and at the moment, the effective coordinate is determined to be the coordinate where the line boundary of the area to be refreshed of the image is located by transmitting the image data of the area where the whole line boundary is located.
When the area ratio is not greater than the preset area ratio and the pixel number ratio is greater than the preset number ratio, it is indicated that the area of the area to be refreshed of the image is smaller at this moment, and the image data of the area where the column boundary of the area to be refreshed of the image is located can be transmitted only without transmitting the image data of the area where the whole row boundary is located, so that the effective coordinate is determined as the coordinate where the column boundary of the area to be refreshed of the image is located.
When the area ratio is not greater than the preset area ratio and the pixel number ratio is not greater than the preset number ratio, it is indicated that the area of the area to be refreshed of the image at the moment can be ignored, and the external area defined by the line boundary and the column boundary of the area to be refreshed of the image together can be directly transmitted, so that the effective coordinates are determined as the coordinates where the line boundary and the column boundary of the area to be refreshed of the image are located.
In this embodiment, when the area of the area to be refreshed is large and wide in the row direction, the image refreshing is performed in the simplest manner by transmitting the image data of the whole row boundary area; when the area of the region to be refreshed of the image is small and narrow in the row direction, the image data of the intersection region of the row boundary and the column boundary is directly transmitted, and the frame refreshing is carried out in a mode of minimum data transmission quantity. And in the area to be refreshed of the image between the two areas, the image data of the transmission column area is adopted in compromise to refresh the picture. Therefore, the relationship between the data volume of image data transmission and the size and the width of the area to be refreshed of the image is better matched and balanced, and larger data volume is transmitted with smaller power consumption.
In another embodiment of the image refreshing method of the present invention, before the step of determining effective coordinates of the area to be refreshed of the image in the display interface, the method further includes:
classifying operation instructions triggering image refreshing, and determining a refreshing frame rate corresponding to each operation instruction;
the step of determining the effective coordinates of the area to be refreshed in the image comprises the following steps:
determining a current operation instruction for triggering image refreshing and a current refreshing frame rate corresponding to the current operation instruction;
and determining the effective coordinates of the area to be refreshed of the image according to the current refreshing frame rate.
Based on the difficulty level of image refresh of different effective coordinates in the above embodiments, in this embodiment, the effective coordinates of the area to be refreshed of the image can be determined according to the types of different operation instructions that trigger image refresh.
Before determining the effective coordinates of the area to be refreshed of the image, classifying the operation instructions triggering the image refreshing, such as sliding operation, clicking operation and the like, or classifying according to the refreshing picture and the refreshing action corresponding to the operation instructions, such as page turning operation, playing/pausing operation and the like. Then, the refresh frame rate corresponding to each operation instruction is determined based on the type of the operation instruction, for example, the refresh frame rate of the sliding operation is 45fps (Frames Per Second), the refresh frame rate of the clicking operation is 30fps, the refresh frame rate of the playing operation is 60fps, and different operation instructions correspond to different refresh frame rates.
When the effective coordinates of the area to be refreshed of the image are determined, firstly, the operation instruction for triggering image refreshing is determined, then, the corresponding refreshing frame rate is determined according to the type of the operation instruction, finally, the effective coordinates of the area to be refreshed of the image are determined based on the corresponding refreshing frame rate, and different refreshing frame rates correspond to different effective coordinates of the same area to be refreshed of the image.
Optionally, the step of determining effective coordinates of the area to be refreshed of the image according to the current refresh frame rate includes:
when the current refresh frame rate is in a preset first frame rate interval, determining the effective coordinates of the area to be refreshed of the image as the coordinates of the line boundary of the area to be refreshed of the image;
when the current refresh frame rate is in a preset second frame rate interval, determining the effective coordinates of the image area to be refreshed as the coordinates of the column boundary of the image area to be refreshed;
when the current refresh frame rate is in a preset third frame rate interval, determining the effective coordinates of the area to be refreshed of the image as the coordinates of the line boundary and the column boundary of the area to be refreshed of the image;
the minimum value of the preset first frame rate interval is greater than the maximum value of the preset second frame rate interval, and the minimum value of the preset second frame rate interval is greater than the maximum value of the preset third frame rate interval.
When different effective coordinates of the same image area to be refreshed are determined according to the refreshing frame rate corresponding to the operation instruction, if the refreshing frame rate is in a maximum preset first frame rate interval, image refreshing is required to be carried out at the maximum refreshing frame rate, the effective coordinates of the image area to be refreshed are determined as the coordinates of the row of the image area to be refreshed, and image refreshing is carried out at the simplest and easiest-to-realize effective coordinates; if the refresh frame rate is in the second largest preset frame rate interval, image refreshing is required to be carried out at the second largest refresh frame rate, and at the moment, the effective coordinates of the image area to be refreshed are determined as the row coordinates of the image area to be refreshed; and if the refresh frame rate is in a minimum preset third frame rate interval, image refreshing is only required to be carried out at the minimum refresh frame rate, and at the moment, the effective coordinates of the area to be refreshed of the image are determined as the area coordinates defined by each boundary coordinate of the area to be refreshed of the image.
In another embodiment of the image refreshing method of the present invention, the image refreshing method further includes:
determining the current residual computing power and the current refreshing frame rate of the display interface;
and when the current residual computing power is less than a preset lower-limit computing power and the current refreshing frame rate is greater than a preset lower-limit frame rate, reducing the current refreshing frame rate to refresh the image.
When image refreshing is carried out, based on the embodiment, the data volume pushed to a panel screen by the MCU can be reduced by determining the effective coordinates of the image region to be refreshed, and only the effective image data corresponding to the image region to be refreshed is transmitted, so that the whole frame of image data is not required to be transmitted completely, the display frame rate is improved, and the power consumption is reduced.
In the embodiment, a manner of appropriately reducing the current refresh frame rate under the operation condition of high load and high power consumption is provided to ensure that the power consumption is reduced while the refresh frame rate corresponding to the operation instruction is reduced and the user experience is not affected. And when the current residual computing power is smaller than the preset lower-limit computing power, the operation condition of high load and high power consumption at present is indicated, and if the current refresh frame rate is larger than the preset lower-limit frame rate at this moment, the current refresh frame rate is reduced. The preset lower limit frame rate may be a frame rate that does not affect the viewing experience of the user, such as 24FPS corresponding to the persistence principle, or other preset lower limit frame rates corresponding to the operation instruction that do not affect the viewing experience of the user.
Optionally, the step of performing image refresh by reducing the current refresh frame rate includes:
determining a frame rate difference value between the current refreshing frame rate and the preset lower limit frame rate;
extracting image frames corresponding to the frame rate difference values at uniform intervals;
or determining a calculation force difference value between the current residual calculation force and the preset lower calculation force, and extracting image frames corresponding to the calculation force difference value at uniform intervals.
In this embodiment, the current refresh frame rate may be reduced by extracting the frame rate difference or the image frames corresponding to the computation force difference at uniform intervals based on the frame rate difference between the current refresh frame rate and the preset lower frame rate, or based on the computation force difference between the current residual computation force and the preset lower computation force.
In an embodiment, the current refresh frame rate is 30FPS, the preset lower limit frame rate is 24FPS, and if it is determined that the current remaining computation power is less than the preset lower limit computation power, the current refresh frame rate is reduced to 24FPS for image refresh by extracting a frame rate difference value of 6FPS at uniform intervals. In the most extreme and most ideal case, in the above case, 30 frames are refreshed every second at present, and the current refresh frame rate is reduced to 24 frames per second by extracting 6 frames of pictures at even intervals.
Further, referring to fig. 6, an embodiment of the present invention further provides an image refreshing apparatus, including:
the determining module C1 is used for determining an image area to be refreshed in a display interface and effective coordinates of the image area to be refreshed in the display interface;
an obtaining module C2, configured to obtain effective image data corresponding to the determined area of the effective coordinate in the display interface;
and the refreshing module C3 is used for refreshing the current frame image in the display interface based on the effective image data to obtain the next frame image.
Optionally, the determining module is further configured to:
determining an area to be refreshed of the image before rendering the next frame of image;
or before the next frame image is rendered, the current frame image and the next frame image to be rendered are obtained, and the area to be refreshed of the image is determined by comparing the current frame image with the next frame image.
Optionally, the determining module is further configured to:
determining the coordinate of the line boundary of the area to be refreshed of the image as the effective coordinate;
or, determining the coordinate of the column boundary of the region to be refreshed of the image as the effective coordinate;
or determining the coordinates of the line boundary and the column boundary of the area to be refreshed of the image as the effective coordinates.
Optionally, the image refreshing apparatus further includes:
a classification module used for determining the effective coordinates of the image to-be-refreshed area in the display interface,
classifying operation instructions triggering image refreshing, and determining a refreshing frame rate corresponding to each operation instruction;
optionally, the determining module is further configured to:
determining the area ratio between the area to be refreshed of the image and the area where the line boundary of the area to be refreshed of the image is located, and the number ratio of pixels in the line direction;
and determining the effective coordinates of the area to be refreshed of the image according to the area ratio and the pixel number ratio.
Optionally, the determining module is further configured to:
when the area ratio is larger than a preset area ratio, determining the effective coordinate as a coordinate where a line boundary of the area to be refreshed of the image is located;
when the area ratio is not larger than a preset area ratio and the pixel number ratio is larger than a preset number ratio, determining the effective coordinates as coordinates where the column boundaries of the area to be refreshed of the image are located;
and when the area ratio is not greater than a preset area ratio and the pixel number ratio is not greater than a preset number ratio, determining the effective coordinates as coordinates where a row boundary and a column boundary of the image area to be refreshed are located.
Optionally, the image refreshing apparatus further includes:
the reducing module is used for determining the current residual computing power and the current refreshing frame rate of the display interface;
and when the current residual computing power is less than a preset lower-limit computing power and the current refreshing frame rate is greater than a preset lower-limit frame rate, reducing the current refreshing frame rate to refresh the image.
Optionally, the reducing module is further configured to:
determining a frame rate difference value between the current refreshing frame rate and the preset lower limit frame rate;
extracting image frames corresponding to the frame rate difference values at uniform intervals;
or determining a calculation force difference value between the current residual calculation force and the preset lower calculation force, and extracting image frames corresponding to the calculation force difference value at uniform intervals.
The image refreshing device provided by the invention adopts the image refreshing method in the embodiment, and solves the technical problems of large image data transmission quantity and low screen display frame rate in the prior art. Compared with the prior art, the image refreshing apparatus provided by the embodiment of the present invention has the same advantages as the image refreshing method provided by the above embodiment, and other technical features of the image refreshing apparatus are the same as those disclosed in the above embodiment method, which are not repeated herein.
In addition, an embodiment of the present invention further provides an image refreshing apparatus, where the image refreshing apparatus includes: a memory, a processor and a computer program stored on the memory and executable on the processor, the computer program being configured to implement the steps of the image refresh method as claimed in any one of the above.
Furthermore, an embodiment of the present invention further provides a computer storage medium, where a computer program is stored on the computer storage medium, and when the computer program is executed by a processor, the computer program implements the steps of the image refreshing method according to any one of the above descriptions.
The steps implemented when the computer program running on the processor is executed may refer to the embodiments of the image refreshing method of the present invention, and are not described herein again.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrases "comprising one of 8230; \8230;" 8230; "does not exclude the presence of additional like elements in a process, method, article, or system that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are only for description, and do not represent the advantages and disadvantages of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solution of the present invention or portions thereof that contribute to the prior art may be embodied in the form of a software product, where the computer software product is stored in a computer storage medium (e.g., F l ash storage device, ROM/RAM, magnetic disk, optical disk), and includes several instructions for enabling a controller, which is used for controlling the storage medium to perform data reading and writing operations, in a terminal device (e.g., a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims (10)

1. An image refresh method, characterized in that it comprises the steps of:
determining an image area to be refreshed in a display interface and effective coordinates of the image area to be refreshed in the display interface;
obtaining effective image data corresponding to the determined area of the effective coordinate in the display interface;
and refreshing the current frame image in the display interface based on the effective image data to obtain the next frame image.
2. The image refreshing method according to claim 1, wherein the step of determining the area of the display interface where the image is to be refreshed comprises:
determining an area to be refreshed of the image before rendering the next frame of image;
or before the next frame image is rendered, the current frame image and the next frame image to be rendered are obtained, and the area to be refreshed of the image is determined by comparing the current frame image with the next frame image.
3. The image refreshing method according to claim 1, wherein the step of determining effective coordinates of the image area to be refreshed in the display interface comprises:
determining the coordinate of the line boundary of the area to be refreshed of the image as the effective coordinate;
or, determining the coordinate of the column boundary of the region to be refreshed of the image as the effective coordinate;
or determining the coordinates of the line boundary and the column boundary of the area to be refreshed of the image as the effective coordinates.
4. The image refresh method of claim 1, wherein the step of determining the active coordinates of the area of the image to be refreshed comprises:
determining the area ratio between the area to be refreshed and the area where the line boundary of the area to be refreshed and the image area to be refreshed is located, and the pixel number ratio in the line direction;
and determining the effective coordinates of the area to be refreshed of the image according to the area ratio and the pixel number ratio.
5. The image refresh method of claim 4, wherein the step of determining the effective coordinates of the area to be refreshed of the image according to the area ratio and the pixel number ratio comprises:
when the area ratio is larger than a preset area ratio, determining the effective coordinate as a coordinate where a line boundary of the area to be refreshed of the image is located;
when the area ratio is not larger than a preset area ratio and the pixel number ratio is larger than a preset number ratio, determining the effective coordinate as a coordinate where the column boundary of the area to be refreshed of the image is located;
and when the area ratio is not greater than a preset area ratio and the pixel number ratio is not greater than a preset number ratio, determining the effective coordinates as coordinates where a row boundary and a column boundary of the image area to be refreshed are located.
6. The image refresh method according to claim 1, further comprising:
determining the current residual computing power and the current refreshing frame rate of the display interface;
and when the current residual computing power is less than a preset lower-limit computing power and the current refreshing frame rate is greater than a preset lower-limit frame rate, reducing the current refreshing frame rate to refresh the image.
7. The image refresh method of claim 6, wherein said step of reducing said current refresh frame rate for image refresh comprises:
determining a frame rate difference value between the current refreshing frame rate and the preset lower limit frame rate;
extracting image frames corresponding to the frame rate difference values at uniform intervals;
or determining a calculation force difference value between the current residual calculation force and the preset lower calculation force, and extracting image frames corresponding to the calculation force difference value at uniform intervals.
8. An image refresh apparatus, characterized in that the apparatus comprises:
the device comprises a determining module, a judging module and a judging module, wherein the determining module is used for determining an image area to be refreshed in a display interface and effective coordinates of the image area to be refreshed in the display interface;
the acquisition module is used for acquiring effective image data corresponding to the determined area of the effective coordinate in the display interface;
and the refreshing module is used for refreshing the current frame image in the display interface based on the effective image data to obtain the next frame image.
9. An image refresh apparatus characterized in that the image refresh apparatus comprises: memory, processor and computer program stored on said memory and executable on said processor, said computer program being configured to implement the steps of the image refresh method according to any of claims 1 to 7.
10. A computer storage medium, characterized in that the computer storage medium has stored thereon a computer program which, when being executed by a processor, carries out the steps of the image refresh method as claimed in any one of claims 1 to 7.
CN202211175341.3A 2022-09-26 2022-09-26 Image refreshing method, device, equipment and medium Pending CN115580746A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211175341.3A CN115580746A (en) 2022-09-26 2022-09-26 Image refreshing method, device, equipment and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211175341.3A CN115580746A (en) 2022-09-26 2022-09-26 Image refreshing method, device, equipment and medium

Publications (1)

Publication Number Publication Date
CN115580746A true CN115580746A (en) 2023-01-06

Family

ID=84583912

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211175341.3A Pending CN115580746A (en) 2022-09-26 2022-09-26 Image refreshing method, device, equipment and medium

Country Status (1)

Country Link
CN (1) CN115580746A (en)

Similar Documents

Publication Publication Date Title
CN110377263B (en) Image synthesis method, image synthesis device, electronic equipment and storage medium
CN110750664B (en) Picture display method and device
CN112596843B (en) Image processing method, device, electronic equipment and computer readable storage medium
EP3917131A1 (en) Image deformation control method and device and hardware device
US20160112757A1 (en) Server, client and video processing method
WO2018000372A1 (en) Picture display method and terminal
CN113126862B (en) Screen capture method and device, electronic equipment and readable storage medium
CN109361947A (en) Internet resources batch loading method, smart television, storage medium and device
CN111273880B (en) Remote display method and device based on cloud intelligent equipment
CN111897619A (en) Browser page display method and device, electronic equipment and storage medium
CN113126937A (en) Display terminal adjusting method and display terminal
CN113015007B (en) Video frame inserting method and device and electronic equipment
CN110874172B (en) Method, device, medium and electronic equipment for amplifying APP interface
CN113590066A (en) Full-automatic multi-screen splicing method, device, equipment and storage medium
CN111258693B (en) Remote display method and device
US11481927B2 (en) Method and apparatus for determining text color
CN113655975B (en) Image display method, image display device, electronic apparatus, and medium
CN113721876A (en) Screen projection processing method and related equipment
CN110858388B (en) Method and device for enhancing video image quality
CN113835657A (en) Display method and electronic equipment
CN112199149A (en) Interface rendering method and device and electronic equipment
CN113625923A (en) Mouse processing method and device based on remote cloud desktop, storage medium and equipment
CN115580746A (en) Image refreshing method, device, equipment and medium
US8693042B2 (en) Image copying method and device
CN114339410A (en) Frame insertion method and device and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination