WO2024050678A1 - Low-power-consumption processing apparatus and method for providing image data to display, and device - Google Patents

Low-power-consumption processing apparatus and method for providing image data to display, and device Download PDF

Info

Publication number
WO2024050678A1
WO2024050678A1 PCT/CN2022/117140 CN2022117140W WO2024050678A1 WO 2024050678 A1 WO2024050678 A1 WO 2024050678A1 CN 2022117140 W CN2022117140 W CN 2022117140W WO 2024050678 A1 WO2024050678 A1 WO 2024050678A1
Authority
WO
WIPO (PCT)
Prior art keywords
displayed
picture
data
image
image data
Prior art date
Application number
PCT/CN2022/117140
Other languages
French (fr)
Chinese (zh)
Inventor
卓永红
Original Assignee
卓永红
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 卓永红 filed Critical 卓永红
Priority to PCT/CN2022/117140 priority Critical patent/WO2024050678A1/en
Priority to CN202280003454.7A priority patent/CN115668099A/en
Publication of WO2024050678A1 publication Critical patent/WO2024050678A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26Power supply means, e.g. regulation thereof
    • G06F1/32Means for saving power
    • G06F1/3203Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3234Power saving characterised by the action undertaken
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units

Definitions

  • the present invention relates to the technical field of computer graphics processing, and in particular to a low-power processing device, method and equipment for providing image data to a display.
  • the GPU graphics processor
  • the source data of the frame image is processed to generate image data, which is then copied to the line buffer.
  • the display controller reads the image data from the line buffer, and is finally imaged by the display.
  • the GPU also needs to process the same amount of data, resulting in a lot of wasted power.
  • DRAM Dynamic Random Access Memory
  • the frame buffer is set in DRAM.
  • DRAM requires continuous periodic refresh current to maintain data from being lost, and it also consumes a lot of power. Consumption.
  • the technical problem to be solved by the present invention is to provide a low-power processing device, method and equipment for providing image data to a display, so that the display requires less power consumption and storage space to display images.
  • the image data of the display screen is provided to the display, and the encoder generates the compressed data of the screen to be displayed according to the compression scheme; when it is determined that the screen to be displayed changes or the screen to be displayed is a dynamic image, the GPU generates The image data of the picture to be displayed is used to provide the image data to the display, or the GPU generates the image data of the picture to be displayed, so as to provide the image data to the display.
  • the encoder generates the picture to be displayed according to the compression scheme.
  • the compressed data of the picture to be displayed wherein, the GPU generates the image data of the picture to be displayed in real time based on reading the source data of the picture to be displayed; the encoder generates the compressed data of the picture to be displayed based on reading the picture to be displayed.
  • the image data of the screen to be displayed is generated in real time.
  • a low-power processing method for providing image data to a display includes: determining that the picture to be displayed has no change or that the picture to be displayed is a still image, and then determining whether the compressed data of the picture to be displayed is prepared. If so, , then start decompression to provide the image data of the picture to be displayed to the display; if not, generate the image data of the picture to be displayed to provide to the display, and start compression to generate the image data of the picture to be displayed according to the compression scheme Compressed data; the decompression is to decompress the compressed data of the picture to be displayed into image data according to the compression scheme; it is determined that the picture to be displayed has changed or the picture to be displayed is a dynamic image, then the image data of the picture to be displayed is generated, so as to Provide the image data to the display, or generate the image data of the picture to be displayed, to provide the image data to the display, and start compression, and generate the compressed data of the picture to be displayed according to the compression scheme; wherein, generating the picture to
  • an image display device includes the above-mentioned low-power processing device, and a display connected to the above-mentioned low-power processing device.
  • the low-power processing device of the present invention can compress and store the image data of the still image in advance.
  • the GPU does not need to execute the graphics rendering program. It only needs the decoder to decompress the compressed data and provide it to the display for display imaging. , which can reduce the power consumption of the device when displaying still images.
  • Figure 1 is a structural block diagram of a low-power processing device of an image display device according to some embodiments.
  • FIG. 2 is a flow chart of a low-power processing method for providing image data to a display according to one embodiment.
  • FIG. 3 is a flowchart of a low-power processing method for providing image data to a display according to another embodiment.
  • the image display device includes a low-power processing device and a display.
  • Image display devices may include personal computers, computer workstations, mobile phones, portable game devices, music video players, portable smart wearable devices (e.g., smart bracelets, smart watches, smart glasses), portable smart translation devices, automotive electronic dashboards Display devices, automotive electronic control system display devices, or other types of devices that process and display graphic data.
  • portable smart wearable devices e.g., smart bracelets, smart watches, smart glasses
  • portable smart translation devices e.g., automotive electronic dashboards Display devices, automotive electronic control system display devices, or other types of devices that process and display graphic data.
  • the image display device can display still images and dynamic images.
  • a still image refers to when the device refreshes the display screen, within a sustained period of time (for example, 3-5 seconds) or after a certain number of continuous refreshes (for example, 5-10 times). There is no change in the display screen.
  • Dynamic images mean that when the device refreshes the display screen, the display screen changes from the previous frame within a sustained period of time (for example, 3-5 seconds) or after a certain number of continuous refreshes (for example, 5-10 times). If the refresh frame rate of the monitor is 60Hz, it will refresh 60 times in one second. If the refresh continues for 5 seconds, that is, it refreshes 300 times, and the display screen does not change, then the display screen is a still image. Within 5 seconds of displaying this still image, the GPU needs to read data from the frame buffer 300 times and execute the graphics rendering program 300 times, which wastes a lot of power and also takes up a lot of memory bandwidth.
  • the low-power processing device of this embodiment can, when displaying dynamic images, the GPU executes a graphics rendering program to generate image data in real time.
  • the encoder can also start working under the control of the GPU to convert the image data. Compressedly encoded and stored for use by the decoder.
  • the GPU does not need to execute the graphics rendering program. It only needs the decoder to decompress the compressed data and provide it to the monitor for display imaging. Because when displaying still images, the GPU does not execute the graphics rendering program, only the decoder works, and the decoder has a small amount of calculations and requires low power consumption, thus reducing a lot of power consumption.
  • the GPU controls the encoder to start working and provides the image data of the picture to the encoder, so that when the still picture is refreshed and displayed again later, it only needs to be decoded
  • the processor works and the GPU does not need to work.
  • the encoder and decoder do not need to work, which can further reduce power consumption.
  • the encoder may include an RLE encoder
  • the decoder may include an RLE decoder. In this way, compression and encoding can be performed while displaying dynamic images without consuming more power.
  • Displays may include liquid crystal displays (LCD displays), plasma display panels, light emitting diode (LED) array displays, cathode ray tube (CRT) displays, nanocrystal displays, electronic paper, and projection equipment.
  • LCD displays liquid crystal displays
  • LED light emitting diode
  • CRT cathode ray tube
  • nanocrystal displays electronic paper, and projection equipment.
  • the display can be integrated into the image display device or can be an independent device connected to the image display device through a cable or wireless communication interface.
  • the low-power processing device includes a CPU, GPU, memory, line buffer, display controller, encoder, decoder, pixel buffer and data interface. Components communicate with each other via buses and communication interfaces. It should be noted that the specific configurations of buses and communication interfaces between different components of the low-power processing device in the figure are only exemplary, and other configurations and/or other graphics processing systems with the same or different components may also be used. technology for implementing the present disclosure.
  • the CPU can be a general-purpose or special-purpose processor that controls an image display device and can execute a variety of software programs, such as computer operating system programs, embedded operating system programs, and various application software programs (e.g., browsers, emails, media players , GUI application (Graphical User Interface, graphical user interface)).
  • the CPU can use human-computer interaction input devices (such as keyboards, buttons, touch screens, microphones), or various sensors (such as vehicle speed sensors, fuel sensors, wiper sensors), or communication modules (such as Bluetooth communication modules, WIFI communication module, GPRS communication module), or other input devices coupled to the image display device via a data interface to obtain the source data of the picture to be displayed.
  • Various software programs running on the CPU can call the graphics API (Application Program Interface), execute the GPU driver, issue graphics rendering commands to the GPU, and start the GPU to generate image data for the display to form images.
  • graphics API Application Program Interface
  • the source data of the screen to be displayed may include messages from system programs and various application software programs received through the communication network, text data and multimedia streaming data, and messages and data generated by various application software programs (for example, generated by voice translation APPs).
  • translated text, game data generated by electronic game APP car status data sent by various car sensors (for example, current speed, current remaining fuel level, current remaining power, current car light status), various health status sensors sent health status data (e.g., heart rate, body temperature), real-time location data sent by the positioning navigator.
  • the CPU determines that the picture to be displayed has no change or that the picture to be displayed is a static image; by judging that the source data of the picture to be displayed is the same as the source data of the previous frame. If they are not the same, it is determined that the picture to be displayed has changed or the picture to be displayed is a dynamic image.
  • Various software programs running in the CPU can use built-in program data and operation steps to define application logic that determines whether the source data of the picture to be displayed is the same as the source data of the previous frame.
  • the CPU sets the source data update flag to a valid state; the CPU determines that the source data of the picture to be displayed is different from the source data of the previous frame. After the data is the same, the source data update flag is set to an invalid state.
  • the source data update flag is used to indicate whether there is any change in the picture to be displayed or whether the picture to be displayed is a static or dynamic image.
  • the CPU compares the source data of the picture to be displayed with the source data of the previous frame. If the two are not the same, the CPU writes the source data of the picture to be displayed into memory, and set the source data update flag to a valid state. If the two are the same, the source data of the screen to be displayed will not be written to the memory, and the source data update flag will be set to an invalid state.
  • the CPU determines whether it has received updated source data of the frame to be displayed. If so, it writes the source data of the frame to be displayed into the memory and sets the source data update flag to Valid status, if not, set the source data update flag to invalid status.
  • the updated source data of the picture to be displayed includes source data received closest to the time when the picture to be displayed is refreshed and is different from the source data of the previous frame of picture.
  • the software program running in the CPU can write the source data update flag into the GPU driver, and the GPU can check whether the source data update flag is in a valid state through the GPU driver.
  • the GPU driver can receive instructions from the CPU via the graphics API and control the GPU to execute these instructions, which can be stored in memory.
  • the memory can also store program data and instructions executable by the CPU, as well as graphics data associated with the application program, as well as source data of the screen to be displayed obtained through the data interface and/or bus, and data generated by other components. Such as the compressed data generated by the encoder.
  • the memory is SRAM (Static Random Access Memory), which does not require continuous periodic refresh current to maintain data without loss, which can further reduce power consumption.
  • SRAM Static Random Access Memory
  • the GPU can receive the frame start signal sent by the display controller or other external display control module. After completing the initialization work, it reads the source data of the screen to be displayed and executes the graphics rendering program. If there is no change in the picture to be displayed or the picture to be displayed is a still image and the compressed data is prepared, the GPU does not read the source data of the picture to be displayed; if the compressed data is not prepared, the GPU reads the source data from the memory and generates image data in real time. , providing image data to the display and encoder. If the picture to be displayed changes or the picture to be displayed is a dynamic image, the GPU reads the source data from the memory and generates image data in real time to provide image data to the display, or to provide image data to the display and encoder.
  • the GPU after the GPU receives the frame start signal, it first checks whether the source data update flag is in a valid state. If so, it means that the picture to be displayed has changed or the picture to be displayed is a dynamic image, and the GPU reads the source data from the memory. , and generate image data in real time.
  • the GPU checks whether the source data update flag is in a valid state through the GPU driver. If not, the GPU then checks whether the compressed frame flag is valid. If so, the GPU sends a start signal to the decoder to start the decoder. The GPU can read the compressed data from the memory and send it to the decoder; or after the decoder starts working, it can read the compressed data directly from the memory.
  • the GPU detects through the GPU driver that the source data of the same frame has been continuously processed two or three times, and the compressed frame flag is valid, and then sends a start signal to the decoder to control the decoder to start working.
  • the GPU can send a start signal to the encoder to control the encoder to start working.
  • the GPU checks whether the source data update flag is in a valid state through the GPU driver, and if so, sends a start signal to the encoder to control the encoder to start working.
  • the GPU checks whether the source data update flag is in a valid state through the GPU driver. If not, it checks whether the compressed frame flag is in a valid state. If not, it sends a start signal to the encoder to control the encoder to start working. .
  • the GPU writes the generated image data to a pixel buffer to provide the image data to the encoder.
  • the pixel buffer is used to store image data generated by the GPU and provide this image data to the encoder.
  • the GPU writes the generated image data to the line buffer to provide the image data to the display.
  • the line cache is used to store image data generated by the GPU and decompressed by the decoder, and provide the image data to the display.
  • the display controller can be a display interface connected to the display, can read image data from the line buffer, and output it to the display for the display to form an image, and can send a frame start signal to the GPU (for example, field synchronization signal VSYNC, field elimination Hidden signal VBLANK).
  • a frame start signal for example, field synchronization signal VSYNC, field elimination Hidden signal VBLANK.
  • the display controller can be replaced by an external display control module, which sends a frame start signal to the GPU, reads image data from the line buffer, and outputs it to the display for the display to form an image.
  • an external display control module which sends a frame start signal to the GPU, reads image data from the line buffer, and outputs it to the display for the display to form an image.
  • the encoder can execute various encoding algorithms, read the image data generated by the GPU in the pixel buffer, compress it, generate the compressed data and write it to the memory.
  • the encoder starts working after receiving the start signal sent by the GPU.
  • the encoder sets the compressed frame flag to a valid state after completing the compressed data of a frame of picture, and sets the compressed frame flag to an invalid state at the beginning of compression encoding.
  • the compressed frame flag is used to indicate whether or not compressed data is prepared.
  • the GPU checks whether the source data update flag is in a valid state. If not, it then checks whether the compressed frame flag is in a valid state. If not, it sends a start signal to the encoder and reads the source data from the memory in real time. Image data is generated and written to the line buffer and pixel buffer to provide image data to the display and encoder.
  • the GPU detects through the GPU driver that the source data of the same frame has been continuously processed two or three times, and the compressed frame flag is in an invalid state, and a start signal can be sent to the encoder to control the encoder to start working.
  • the GPU checks whether the source data update flag is in a valid state through the GPU driver. If so, it sends a start signal to the encoder, reads the source data from the memory, generates image data in real time, and writes it to the line cache. and pixel buffers to provide image data to displays and encoders.
  • the decoder executes a decoding algorithm that matches the encoder, decompresses the compressed data, and then writes the decompressed image data to the line buffer to provide image data to the display.
  • the decoder only starts decompression when the picture to be displayed does not change or the picture to be displayed is a still image.
  • the GPU checks whether the source data update flag is in a valid state. If not, it then checks whether the compressed frame flag is in a valid state. If so, it sends a start signal to the decoder, and the decoder starts working after receiving the start signal.
  • the GPU detects through the GPU driver that the source data of the same frame has been continuously processed two or three times, and the compressed frame flag is in a valid state, and then sends a start signal to the decoder to control the decoder to start working.
  • the compressed data can be read directly from the memory. In another embodiment, after the decoder starts working, it receives the compressed data sent by the GPU after reading it from the memory.
  • the pixel cache stores image data generated by the GPU in real time and provides that image data to the encoder.
  • the pixel cache can be a FIFO (First Input First Output, first in first out) data cache.
  • the pixel buffer can only store image data for less than one row of pixels.
  • the line buffer can receive the image data generated by the GPU in real time and the image data decompressed by the decoder in real time, and provide it to the display controller or external display control module to enable the display to generate images.
  • the row cache can be a FIFO data cache.
  • the row buffer can only store image data of one row of pixels.
  • the line buffer can store image data of multiple lines of pixels to meet the real-time timing processing of high-resolution displays.
  • the low-power processing method of providing image data to a display in this embodiment includes blocks 10-11.
  • block 10 it is determined that the picture to be displayed has no change or the picture to be displayed is a still image, and then it is determined whether the compressed data of the picture to be displayed is prepared. If so, decompression is started to provide the image data of the picture to be displayed to the display. ; If not, the image data of the picture to be displayed is generated to provide it to the display, and compression is started, and the compressed data of the picture to be displayed is generated according to the compression scheme. The decompression is to decompress the compressed data of the picture to be displayed into image data according to the compression scheme.
  • the image data for generating the picture to be displayed is generated in real time based on reading the source data of the picture to be displayed.
  • the GPU can check through the GPU driver that the source data of the same frame has been continuously processed two or three times, and the compressed frame valid flag is in an invalid state, and then the encoder is controlled to start working.
  • the GPU can check through the GPU driver that the source data of the same frame has been continuously processed two or three times, and the compressed frame valid flag is in a valid state, which can control the decoder to start working.
  • the compressed frame flag is used to indicate whether or not the compressed data is prepared. After the compressed data of a frame is completed, the compressed frame flag is set to a valid state. At the beginning of compression encoding, the compressed frame flag is set to an invalid state.
  • the compressed data can be read directly from the memory. In another embodiment, after the decoder starts working, it receives the compressed data sent by the GPU after reading it from the memory.
  • the image data of the picture to be displayed is generated to provide the image data to the display, or the image data of the picture to be displayed is generated to provide the display with the image data.
  • the image data is provided, compression is started, and compressed data of the picture to be displayed is generated according to the compression scheme.
  • generating the compressed data of the picture to be displayed is generated in real time based on reading the image data of the picture to be displayed.
  • the GPU if the picture to be displayed changes or the picture to be displayed is a dynamic image, the GPU generates image data in real time and writes it into the line buffer to provide the image data to the display.
  • the GPU if the picture to be displayed changes or the picture to be displayed is a dynamic image, the GPU generates image data in real time and writes it into the line buffer and pixel buffer to provide the image data to the display and encoder.
  • the low-power processing method of providing image data to a display in this embodiment includes blocks 20-27.
  • block 20 by determining that the source data of the picture to be displayed is the same as the source data of the previous frame, it is determined that the picture to be displayed has no change or that the picture to be displayed is a static image.
  • the CPU can determine that the source data of the image to be displayed is the same as the source data of the previous frame, thereby determining that there is no change in the image to be displayed or that the image to be displayed is a static image.
  • the source data update flag is set to an invalid state to indicate that there is no change in the picture to be displayed or that the picture to be displayed is a static image.
  • the source data update flag may be set to an invalid state by the CPU.
  • the CPU can determine that the picture to be displayed has changed or that the picture to be displayed is a dynamic image by determining that the source data of the picture to be displayed is different from the source data of the previous frame.
  • the source data update flag is set to a valid state to indicate that the picture to be displayed has changed or that the picture to be displayed is a dynamic image.
  • the source data update flag may be set to a valid state through the CPU.
  • the CPU can compare whether the source data of the picture to be displayed is the same as the source data of the previous frame. If not, write the source data of the picture to be displayed into memory, and set the source data update flag to a valid state. If so, the source data of the screen to be displayed is not written to the memory, and the source data update flag is set to an invalid state.
  • the CPU when starting to refresh the frame to be displayed, can determine whether the updated source data of the frame to be displayed is received. If so, the source data of the frame to be displayed is written into the memory and the source data update is set. Mark as valid, if not, set the source data update mark as invalid.
  • the updated source data of the picture to be displayed includes source data received closest to the time when the picture to be displayed is refreshed and is different from the source data of the previous frame of picture.
  • the source data update flag may be written into the GPU driver through a software program running in the CPU.
  • the GPU can be used to check whether the source data update flag is in a valid state through the GPU driver.
  • block 24 it is determined whether the compressed data of the picture to be displayed is prepared by checking whether the compressed frame flag is in a valid state.
  • the compressed frame flag after completing the compressed data of one frame of picture, the compressed frame flag is set to a valid state, and at the beginning of compression encoding, the compressed frame flag is set to an inactive state.
  • the state of the compressed frame flag may be set by the encoder.
  • the GPU can be used to determine whether the compressed data of the picture to be displayed is prepared by checking whether the compressed frame flag is in a valid state.
  • image data of the screen to be displayed is generated to provide the image data to the display.
  • the GPU after receiving the frame start signal through the GPU, it first checks whether the source data update flag is in a valid state. If so, it means that the picture to be displayed has changed or the picture to be displayed is a dynamic image, and the GPU reads the source data from the memory. data, generating image data in real time.
  • the generated image data may be written to a pixel buffer by the GPU to provide the image data to the encoder.
  • the generated image data may be written to the line buffer by the GPU to provide the image data to the display.
  • decompression is to decompress the compressed data of the picture to be displayed into image data according to the compression scheme.
  • the GPU can be used to check whether the source data update flag is in a valid state. If not, then check whether the compressed frame flag is in a valid state. If so, a start signal is sent to the decoder, and the decoder starts after receiving the start signal. Work.
  • the compressed data can be read directly from the memory. In another embodiment, after the decoder starts working, it receives the compressed data sent by the GPU after reading it from the memory.
  • the compression scheme includes the RLE algorithm.
  • the GPU can be used to check whether the source data update flag is in a valid state. If not, then check whether the compressed frame flag is in a valid state. If so, a start signal is sent to the encoder, and the encoder starts after receiving the start signal. Work to generate the compressed data of the picture to be displayed according to the compression scheme.
  • the encoder After the encoder generates compressed data, it is written into the memory through the bus.
  • the above blocks 20-28 can be executed in different orders and combinations according to the actual situation.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

Disclosed in the present invention are a low-power-consumption processing apparatus and method for providing image data to a display, and a device. The method comprises: if there is no change in a picture to be displayed or said picture is a still image, and compressed data has been prepared, starting decompression to provide image data of said picture to a display; and if there is a change in said picture or said picture is a dynamic image, generating image data of said picture in real time and providing the image data to the display, or starting compression again to generate compressed data of said picture. The low-power-consumption processing apparatus in the present invention can compress and store image data of a still image in advance, and when the still image is displayed, instead of a GPU executing a graphics rendering program, a decoder decompresses the compressed data and provides the decompressed data to a display for imaging, thereby reducing the power consumption required by the device to display the still image.

Description

向显示器提供图像数据的低功耗处理装置,方法和设备Low-power processing device, method and apparatus for providing image data to display 技术领域Technical field
本发明涉及计算机图形处理技术领域,尤其涉及向显示器提供图像数据的低功耗处理装置,方法和设备。The present invention relates to the technical field of computer graphics processing, and in particular to a low-power processing device, method and equipment for providing image data to a display.
背景技术Background technique
多种图像显示设备(例如:手机,个人电脑,平板电脑,智能手环,智能眼镜等)的显示器在每次刷新画面时,GPU(图形处理器)都需要从帧缓冲(FrameBuffer)中获取一帧图像的源数据,处理后生成图像数据,再拷贝到行缓存,显示控制器从行缓存读取图像数据,最后经显示器成像。对于一个分辨率为800×480,24bit颜色深度,刷新帧率为60Hz的LCD显示装置来说,GPU每秒需要从帧缓冲拷贝的数据量为800×480×3×60=65MB。当显示静止画面时,GPU也同样需要处理相同的数据量,导致大量功耗被浪费。Every time the monitors of various image display devices (such as mobile phones, personal computers, tablets, smart bracelets, smart glasses, etc.) refresh the screen, the GPU (graphics processor) needs to obtain a frame buffer (FrameBuffer). The source data of the frame image is processed to generate image data, which is then copied to the line buffer. The display controller reads the image data from the line buffer, and is finally imaged by the display. For an LCD display device with a resolution of 800×480, a 24-bit color depth, and a refresh frame rate of 60Hz, the amount of data that the GPU needs to copy from the frame buffer per second is 800×480×3×60=65MB. When displaying still images, the GPU also needs to process the same amount of data, resulting in a lot of wasted power.
另一方面,由于DRAM(动态随机存储器)的芯片面积小存储量大,所以帧缓冲都设置在DRAM中,但是DRAM要求持续的周期性刷新电流来维持数据不被丢失,也同样会消耗大量功耗。On the other hand, due to the small chip area of DRAM (Dynamic Random Access Memory) and the large storage capacity, the frame buffer is set in DRAM. However, DRAM requires continuous periodic refresh current to maintain data from being lost, and it also consumes a lot of power. Consumption.
技术问题technical problem
本发明所要解决的技术问题是提供向显示器提供图像数据的低功耗处理装置,方法和设备,使显示器显示画面所需的功耗和存储空间更小。The technical problem to be solved by the present invention is to provide a low-power processing device, method and equipment for providing image data to a display, so that the display requires less power consumption and storage space to display images.
技术解决方案Technical solutions
根据一实施例,一种向显示器提供图像数据的低功耗处理装置,包括CPU,GPU,存储器,编码器和解码器;确定待显示画面无变化或待显示画面为静止图像,则再确定所述待显示画面的压缩数据是否预备,若是,则该解码器根据压缩方案将该待显示画面的压缩数据解压缩为图像数据,以向显示器提供该图像数据;若否,则该GPU生成该待显示画面的图像数据,以向该显示器提供该图像数据,以及该编码器根据该压缩方案生成该待显示画面的压缩数据;确定待显示画面有变化或待显示画面为动态图像,则该GPU生成该待显示画面的图像数据,以向该显示器提供该图像数据,或者该GPU生成该待显示画面的图像数据,以向该显示器提供该图像数据,该编码器根据该压缩方案生成该待显示画面的压缩数据;其中,该GPU生成该待显示画面的图像数据,是基于读取该待显示画面的源数据而实时生成的;该编码器生成该待显示画面的压缩数据,是基于读取该待显示画面的图像数据而实时生成的。According to an embodiment, a low-power processing device that provides image data to a display includes a CPU, a GPU, a memory, an encoder and a decoder; if it is determined that the picture to be displayed has no change or that the picture to be displayed is a still image, then it is determined that the picture to be displayed is a still image. Whether the compressed data of the picture to be displayed is prepared. If so, the decoder decompresses the compressed data of the picture to be displayed into image data according to the compression scheme to provide the image data to the display; if not, the GPU generates the image data to be displayed. The image data of the display screen is provided to the display, and the encoder generates the compressed data of the screen to be displayed according to the compression scheme; when it is determined that the screen to be displayed changes or the screen to be displayed is a dynamic image, the GPU generates The image data of the picture to be displayed is used to provide the image data to the display, or the GPU generates the image data of the picture to be displayed, so as to provide the image data to the display. The encoder generates the picture to be displayed according to the compression scheme. The compressed data of the picture to be displayed; wherein, the GPU generates the image data of the picture to be displayed in real time based on reading the source data of the picture to be displayed; the encoder generates the compressed data of the picture to be displayed based on reading the picture to be displayed. The image data of the screen to be displayed is generated in real time.
根据另一实施例,一种向显示器提供图像数据的低功耗处理方法,包括:确定待显示画面无变化或待显示画面为静止图像,则再确定该待显示画面的压缩数据是否预备,若是,则启动解压缩,以向显示器提供该待显示画面的图像数据;若否,则生成该待显示画面的图像数据,以提供给该显示器,以及启动压缩,根据压缩方案生成该待显示画面的压缩数据;该解压缩是根据该压缩方案将该待显示画面的压缩数据解压缩为图像数据;确定待显示画面有变化或待显示画面为动态图像,则生成该待显示画面的图像数据,以向该显示器提供该图像数据,或者生成该待显示画面的图像数据,以向该显示器提供该图像数据,以及启动压缩,根据该压缩方案生成该待显示画面的压缩数据;其中,该生成该待显示画面的图像数据,是基于读取该待显示画面的源数据而实时生成的;该生成该待显示画面的压缩数据,是基于读取该待显示画面的图像数据而实时生成的。According to another embodiment, a low-power processing method for providing image data to a display includes: determining that the picture to be displayed has no change or that the picture to be displayed is a still image, and then determining whether the compressed data of the picture to be displayed is prepared. If so, , then start decompression to provide the image data of the picture to be displayed to the display; if not, generate the image data of the picture to be displayed to provide to the display, and start compression to generate the image data of the picture to be displayed according to the compression scheme Compressed data; the decompression is to decompress the compressed data of the picture to be displayed into image data according to the compression scheme; it is determined that the picture to be displayed has changed or the picture to be displayed is a dynamic image, then the image data of the picture to be displayed is generated, so as to Provide the image data to the display, or generate the image data of the picture to be displayed, to provide the image data to the display, and start compression, and generate the compressed data of the picture to be displayed according to the compression scheme; wherein, generating the picture to be displayed The image data of the display screen is generated in real time based on reading the source data of the screen to be displayed; the compressed data for generating the screen to be displayed is generated in real time based on reading the image data of the screen to be displayed.
根据另一实施例,一种图像显示设备,包括上述的低功耗处理装置,和连接上述低功耗处理装置的显示器。According to another embodiment, an image display device includes the above-mentioned low-power processing device, and a display connected to the above-mentioned low-power processing device.
有益效果beneficial effects
本发明的低功耗处理装置可预先将静止图像的图像数据进行压缩存储,在显示该静止图像时,GPU无需执行图形渲染程序,只需解码器将压缩数据解压缩后,提供给显示器显示成像,可降低设备显示静止图像的功耗。The low-power processing device of the present invention can compress and store the image data of the still image in advance. When displaying the still image, the GPU does not need to execute the graphics rendering program. It only needs the decoder to decompress the compressed data and provide it to the display for display imaging. , which can reduce the power consumption of the device when displaying still images.
附图说明Description of the drawings
图1是根据一些实施例的图像显示设备的低功耗处理装置结构框图。Figure 1 is a structural block diagram of a low-power processing device of an image display device according to some embodiments.
图2是其中一种实施例的向显示器提供图像数据的低功耗处理方法的流程图。FIG. 2 is a flow chart of a low-power processing method for providing image data to a display according to one embodiment.
图3是另一种实施例的向显示器提供图像数据的低功耗处理方法的流程图。FIG. 3 is a flowchart of a low-power processing method for providing image data to a display according to another embodiment.
本发明的最佳实施方式Best Mode of Carrying Out the Invention
下面结合附图和实施例,对本发明作进一步详细说明。应当理解的是,此处所记录的具体实施方式仅用于说明和解释本发明,并不用于限制本发明。The present invention will be further described in detail below in conjunction with the accompanying drawings and examples. It should be understood that the specific embodiments recorded here are only used to illustrate and explain the present invention, and are not intended to limit the present invention.
如图1的示例,图像显示设备包括低功耗处理装置和显示器。图像显示设备可包括个人计算机,计算机工作站,移动电话,便携式游戏设备,音乐视频播放器,便携式智能穿戴设备(例如,智能手环,智能手表,智能眼镜),便携式智能翻译设备,汽车电子仪表盘显示设备,汽车电子控制系统显示设备,或者其他类型的处理和显示图形数据的设备。As shown in the example of FIG. 1, the image display device includes a low-power processing device and a display. Image display devices may include personal computers, computer workstations, mobile phones, portable game devices, music video players, portable smart wearable devices (e.g., smart bracelets, smart watches, smart glasses), portable smart translation devices, automotive electronic dashboards Display devices, automotive electronic control system display devices, or other types of devices that process and display graphic data.
图像显示设备可显示静止图像和动态图像,静止图像是指设备刷新显示画面时,在持续的一段时间范围内(例如,3-5秒)或持续刷新一定次数(例如5-10次)后,显示画面都没有变化。动态图像是指设备刷新显示画面时,在持续的一段时间范围内(例如,3-5秒)或持续刷新一定次数(例如5-10次)后,显示画面较上一帧画面发生了变化。若显示器的刷新帧率为60Hz,则,一秒钟内会刷新60次,若持续刷新5秒,即刷新300次,显示画面都没有变化,则该显示画面为静止图像。在显示该静止图像的5秒钟内,GPU需要从帧缓冲读取数据300次,及执行图形渲染程序300次,浪费大量功耗,也占用了存储器大量带宽。The image display device can display still images and dynamic images. A still image refers to when the device refreshes the display screen, within a sustained period of time (for example, 3-5 seconds) or after a certain number of continuous refreshes (for example, 5-10 times). There is no change in the display screen. Dynamic images mean that when the device refreshes the display screen, the display screen changes from the previous frame within a sustained period of time (for example, 3-5 seconds) or after a certain number of continuous refreshes (for example, 5-10 times). If the refresh frame rate of the monitor is 60Hz, it will refresh 60 times in one second. If the refresh continues for 5 seconds, that is, it refreshes 300 times, and the display screen does not change, then the display screen is a still image. Within 5 seconds of displaying this still image, the GPU needs to read data from the frame buffer 300 times and execute the graphics rendering program 300 times, which wastes a lot of power and also takes up a lot of memory bandwidth.
为了降低功耗,本实施例的低功耗处理装置,可在显示动态图像时,GPU执行图形渲染程序,实时生成图像数据的同时,编码器也可在GPU的控制下启动工作,将图像数据进行压缩编码并存储,以供解码器使用。当该动态图像静止时,由于该图像数据已经预先压缩存储,因此,GPU无需执行图形渲染程序,只需解码器将压缩数据解压缩后提供给显示器显示成像。由于显示静止图像时,GPU不执行图形渲染程序,仅解码器工作,而解码器的运算量较小,所需功耗较低,因此降低了大量功耗。In order to reduce power consumption, the low-power processing device of this embodiment can, when displaying dynamic images, the GPU executes a graphics rendering program to generate image data in real time. At the same time, the encoder can also start working under the control of the GPU to convert the image data. Compressedly encoded and stored for use by the decoder. When the dynamic image is still, since the image data has been pre-compressed and stored, the GPU does not need to execute the graphics rendering program. It only needs the decoder to decompress the compressed data and provide it to the monitor for display imaging. Because when displaying still images, the GPU does not execute the graphics rendering program, only the decoder works, and the decoder has a small amount of calculations and requires low power consumption, thus reducing a lot of power consumption.
另一方面,在重复刷新显示相同画面2次或3次后,GPU再控制编码器开始工作,将该画面的图像数据提供给编码器,以使后续再次刷新显示该静止画面时,只需解码器工作,GPU无需工作。在显示动态画面时,也只需GPU工作,编码器和解码器都无需工作,可进一步降低功耗。On the other hand, after repeatedly refreshing and displaying the same picture 2 or 3 times, the GPU then controls the encoder to start working and provides the image data of the picture to the encoder, so that when the still picture is refreshed and displayed again later, it only needs to be decoded The processor works and the GPU does not need to work. When displaying dynamic images, only the GPU needs to work, and the encoder and decoder do not need to work, which can further reduce power consumption.
另外,鉴于RLE图像压缩算法较为简单,运算量较低,可采用RLE算法作为压缩方案。编码器可包括RLE编码器,解码器可包括RLE解码器,这样,在显示动态图像的同时进行压缩编码,也不会消耗较多功耗。In addition, since the RLE image compression algorithm is relatively simple and has low computational complexity, the RLE algorithm can be used as the compression solution. The encoder may include an RLE encoder, and the decoder may include an RLE decoder. In this way, compression and encoding can be performed while displaying dynamic images without consuming more power.
显示器可包括液晶显示屏(LCD显示屏),等离子显示面板,发光二极管(LED)阵列显示器,阴极射线管(CRT)显示器,纳米晶体显示器 ,电子纸,投影设备。显示器可集成在图像显示设备中,也可是独立的设备,通过线缆或无线通信接口连接图像显示设备。Displays may include liquid crystal displays (LCD displays), plasma display panels, light emitting diode (LED) array displays, cathode ray tube (CRT) displays, nanocrystal displays, electronic paper, and projection equipment. The display can be integrated into the image display device or can be an independent device connected to the image display device through a cable or wireless communication interface.
如图1的示例,低功耗处理装置包括CPU,GPU,存储器,行缓存,显示控制器,编码器,解码器,像素缓存和数据接口。各组件彼此之间可通过总线和通信接口来通信。需要说明的是,图中低功耗处理装置的不同组件之间的总线和通信接口的具体配置仅是示例性的,其他配置和/或具有相同或不同组件的其他图形处理系统也可被用于实现本公开的技术。As shown in the example of Figure 1, the low-power processing device includes a CPU, GPU, memory, line buffer, display controller, encoder, decoder, pixel buffer and data interface. Components communicate with each other via buses and communication interfaces. It should be noted that the specific configurations of buses and communication interfaces between different components of the low-power processing device in the figure are only exemplary, and other configurations and/or other graphics processing systems with the same or different components may also be used. technology for implementing the present disclosure.
CPU可以是控制图像显示设备的通用或专用处理器,可执行多种软件程序,例如计算机操作系统程序,嵌入式操作系统程序,各类应用软件程序(例如,浏览器,电子邮件,媒体播放器,GUI应用(Graphical User Interface,图形用户界面))。CPU可通过人机交互输入设备(例如,键盘,按键,触摸屏,话筒),或各类传感器(例如,车速传感器,油量传感器,雨刷传感器),或通信模块(例如,蓝牙通信模块,WIFI通信模块,GPRS通信模块),或经由数据接口耦合至图像显示设备的其他输入设备,来获取待显示画面的源数据。在CPU上运行的各类软件程序可调用图形API(Application Program Interface,应用程序编程接口),执行GPU驱动程序,向GPU发出图形渲染命令,启动GPU生成图像数据,以供显示器形成图像。The CPU can be a general-purpose or special-purpose processor that controls an image display device and can execute a variety of software programs, such as computer operating system programs, embedded operating system programs, and various application software programs (e.g., browsers, emails, media players , GUI application (Graphical User Interface, graphical user interface)). The CPU can use human-computer interaction input devices (such as keyboards, buttons, touch screens, microphones), or various sensors (such as vehicle speed sensors, fuel sensors, wiper sensors), or communication modules (such as Bluetooth communication modules, WIFI communication module, GPRS communication module), or other input devices coupled to the image display device via a data interface to obtain the source data of the picture to be displayed. Various software programs running on the CPU can call the graphics API (Application Program Interface), execute the GPU driver, issue graphics rendering commands to the GPU, and start the GPU to generate image data for the display to form images.
待显示画面的源数据可包括通过通信网络接收到的系统程序和各类应用软件程序的消息,文本数据和多媒体流数据,各类应用软件程序生成的消息和数据(例如,语音翻译类APP生成的翻译文字,电子游戏类APP生成的游戏数据),各类汽车传感器发送的汽车状态数据(例如,当前车速,当前剩余油量,当前剩余电量,当前车灯状态),各类健康状态传感器发送的健康状态数据(例如,心率,体温),定位导航器发送的实时位置数据。The source data of the screen to be displayed may include messages from system programs and various application software programs received through the communication network, text data and multimedia streaming data, and messages and data generated by various application software programs (for example, generated by voice translation APPs). translated text, game data generated by electronic game APP), car status data sent by various car sensors (for example, current speed, current remaining fuel level, current remaining power, current car light status), various health status sensors sent health status data (e.g., heart rate, body temperature), real-time location data sent by the positioning navigator.
CPU通过判断待显示画面的源数据与上一帧画面的源数据相同,来确定待显示画面无变化或待显示画面为静态图像;通过判断待显示画面的源数据与上一帧画面的源数据不相同,来确定待显示画面有变化或待显示画面为动态图像。在CPU中运行的各类软件程序可通过内置的程序数据和运算步骤,来定义判断待显示画面的源数据与上一帧画面的源数据是否相同的应用逻辑。By judging that the source data of the picture to be displayed is the same as the source data of the previous frame, the CPU determines that the picture to be displayed has no change or that the picture to be displayed is a static image; by judging that the source data of the picture to be displayed is the same as the source data of the previous frame. If they are not the same, it is determined that the picture to be displayed has changed or the picture to be displayed is a dynamic image. Various software programs running in the CPU can use built-in program data and operation steps to define application logic that determines whether the source data of the picture to be displayed is the same as the source data of the previous frame.
在一实施例中,CPU判断待显示画面的源数据与上一帧画面的源数据不相同后,设置源数据更新标记为有效状态;CPU判断待显示画面的源数据与上一帧画面的源数据相同后,设置源数据更新标记为无效状态,该源数据更新标记用以指示待显示画面有/无变化或待显示画面为静态/动态图像。In one embodiment, after the CPU determines that the source data of the picture to be displayed is different from the source data of the previous frame, the CPU sets the source data update flag to a valid state; the CPU determines that the source data of the picture to be displayed is different from the source data of the previous frame. After the data is the same, the source data update flag is set to an invalid state. The source data update flag is used to indicate whether there is any change in the picture to be displayed or whether the picture to be displayed is a static or dynamic image.
在一实施例中,CPU在获取待显示画面的源数据后,比较待显示画面的源数据与上一帧画面的源数据,若两者不相同,则CPU将待显示画面的源数据写入存储器,并设置源数据更新标记为有效状态,若两者相同,则不将待显示画面的源数据写入存储器,并设置源数据更新标记为无效状态。In one embodiment, after acquiring the source data of the picture to be displayed, the CPU compares the source data of the picture to be displayed with the source data of the previous frame. If the two are not the same, the CPU writes the source data of the picture to be displayed into memory, and set the source data update flag to a valid state. If the two are the same, the source data of the screen to be displayed will not be written to the memory, and the source data update flag will be set to an invalid state.
在一实施例中,在开始刷新待显示帧画面时,CPU判断是否接收到更新的待显示画面的源数据,若是,则将待显示画面的源数据写入存储器,并设置源数据更新标记为有效状态,若否,则设置源数据更新标记为无效状态。其中,更新的待显示画面的源数据包括最接近刷新待显示画面时刻接收到的与上一帧画面的源数据不同的源数据。In one embodiment, when starting to refresh the frame to be displayed, the CPU determines whether it has received updated source data of the frame to be displayed. If so, it writes the source data of the frame to be displayed into the memory and sets the source data update flag to Valid status, if not, set the source data update flag to invalid status. The updated source data of the picture to be displayed includes source data received closest to the time when the picture to be displayed is refreshed and is different from the source data of the previous frame of picture.
在一实施例中,在CPU中运行的软件程序可将源数据更新标记写入GPU驱动程序中,GPU可通过GPU驱动程序检查该源数据更新标记是否为有效状态。GPU驱动程序可经由图形API从CPU接收指令,并控制GPU执行这些指令,这些指令可存储在存储器中。In one embodiment, the software program running in the CPU can write the source data update flag into the GPU driver, and the GPU can check whether the source data update flag is in a valid state through the GPU driver. The GPU driver can receive instructions from the CPU via the graphics API and control the GPU to execute these instructions, which can be stored in memory.
存储器还可存储CPU可执行的程序数据和指令,以及与应用程序相关联的图形数据,以及通过数据接口和/或总线获取的待显示画面的源数据,以及其他组件生成的数据。如编码器生成的压缩数据。The memory can also store program data and instructions executable by the CPU, as well as graphics data associated with the application program, as well as source data of the screen to be displayed obtained through the data interface and/or bus, and data generated by other components. Such as the compressed data generated by the encoder.
在一实施例中,存储器是SRAM(静态随机存储器),无需持续的周期性刷新电流来维持数据不丢失,可进一步降低功耗。In one embodiment, the memory is SRAM (Static Random Access Memory), which does not require continuous periodic refresh current to maintain data without loss, which can further reduce power consumption.
GPU可接收显示控制器或其他外部显示控制模块发送的帧开始信号,完成初始化工作后,读取待显示画面的源数据,执行图形渲染程序。若待显示画面无变化或待显示画面为静止图像,且压缩数据预备,则GPU不读取待显示画面的源数据;若压缩数据未预备,则GPU从存储器读取源数据,实时生成图像数据,并向显示器和编码器提供图像数据。若待显示画面有变化或待显示画面为动态图像,则GPU从存储器读取源数据,实时生成图像数据,以向显示器提供图像数据,或者向显示器和编码器提供图像数据。The GPU can receive the frame start signal sent by the display controller or other external display control module. After completing the initialization work, it reads the source data of the screen to be displayed and executes the graphics rendering program. If there is no change in the picture to be displayed or the picture to be displayed is a still image and the compressed data is prepared, the GPU does not read the source data of the picture to be displayed; if the compressed data is not prepared, the GPU reads the source data from the memory and generates image data in real time. , providing image data to the display and encoder. If the picture to be displayed changes or the picture to be displayed is a dynamic image, the GPU reads the source data from the memory and generates image data in real time to provide image data to the display, or to provide image data to the display and encoder.
在一实施例中,GPU收到帧开始信号后,先检查源数据更新标记是否为有效状态,若是,则表示待显示画面有变化或待显示画面为动态图像,则GPU从存储器读取源数据,并实时生成图像数据。In one embodiment, after the GPU receives the frame start signal, it first checks whether the source data update flag is in a valid state. If so, it means that the picture to be displayed has changed or the picture to be displayed is a dynamic image, and the GPU reads the source data from the memory. , and generate image data in real time.
在一实施例中,GPU通过GPU驱动程序检查源数据更新标记是否为有效状态,若否,则GPU再检查压缩帧标志是否有效,若是,则向解码器发送启动信号,启动解码器工作。GPU可读取存储器的压缩数据,发送给解码器;或者解码器启动工作后,直接从存储器读取压缩数据。In one embodiment, the GPU checks whether the source data update flag is in a valid state through the GPU driver. If not, the GPU then checks whether the compressed frame flag is valid. If so, the GPU sends a start signal to the decoder to start the decoder. The GPU can read the compressed data from the memory and send it to the decoder; or after the decoder starts working, it can read the compressed data directly from the memory.
在一实施例中,GPU通过GPU驱动程序检查到持续处理2次或3次相同画面的源数据,且压缩帧标志有效,则向解码器发送启动信号,控制解码器开始工作。In one embodiment, the GPU detects through the GPU driver that the source data of the same frame has been continuously processed two or three times, and the compressed frame flag is valid, and then sends a start signal to the decoder to control the decoder to start working.
在一实施例中,GPU通过GPU驱动程序检查到持续处理2次或3次相同画面的源数据,且压缩帧标志无效,可向编码器发送启动信号,控制编码器开始工作。In one embodiment, if the GPU detects through the GPU driver that the source data of the same frame has been continuously processed two or three times and the compressed frame flag is invalid, the GPU can send a start signal to the encoder to control the encoder to start working.
在一实施例中,GPU通过GPU驱动程序检查源数据更新标记是否为有效状态,若是,则向编码器发送启动信号,控制编码器开始工作。In one embodiment, the GPU checks whether the source data update flag is in a valid state through the GPU driver, and if so, sends a start signal to the encoder to control the encoder to start working.
在一实施例中,GPU通过GPU驱动程序检查源数据更新标记是否为有效状态,若否,则检查压缩帧标志是否为有效状态,若否,则向编码器发送启动信号,控制编码器开始工作。In one embodiment, the GPU checks whether the source data update flag is in a valid state through the GPU driver. If not, it checks whether the compressed frame flag is in a valid state. If not, it sends a start signal to the encoder to control the encoder to start working. .
在一实施例中,GPU将生成的图像数据写入像素缓存,以向编码器提供该图像数据。像素缓存用以存储GPU生成的图像数据,并向编码器提供该图像数据。In one embodiment, the GPU writes the generated image data to a pixel buffer to provide the image data to the encoder. The pixel buffer is used to store image data generated by the GPU and provide this image data to the encoder.
在一实施例中,GPU将生成的图像数据写入行缓存,以向显示器提供该图像数据。行缓存用以存储GPU生成的图像数据和解码器解压缩的图像数据,并向显示器提供该图像数据。In one embodiment, the GPU writes the generated image data to the line buffer to provide the image data to the display. The line cache is used to store image data generated by the GPU and decompressed by the decoder, and provide the image data to the display.
显示控制器可以是连接显示器的显示接口,可从行缓存中读取图像数据,并输出到显示器,以供显示器形成图像,以及可向GPU发出帧开始信号(例如,场同步信号VSYNC,场消隐信号VBLANK)。The display controller can be a display interface connected to the display, can read image data from the line buffer, and output it to the display for the display to form an image, and can send a frame start signal to the GPU (for example, field synchronization signal VSYNC, field elimination Hidden signal VBLANK).
在一实施例中,可由外部显示控制模块替代显示控制器,向GPU发出帧开始信号,以及从行缓存中读取图像数据,并输出到显示器,以供显示器形成图像。In one embodiment, the display controller can be replaced by an external display control module, which sends a frame start signal to the GPU, reads image data from the line buffer, and outputs it to the display for the display to form an image.
编码器可执行各种编码算法,读取像素缓存中GPU生成的图像数据,进行压缩,生成压缩数据后写入存储器。The encoder can execute various encoding algorithms, read the image data generated by the GPU in the pixel buffer, compress it, generate the compressed data and write it to the memory.
在一实施例中,编码器接收到GPU发送的启动信号后,启动工作。In one embodiment, the encoder starts working after receiving the start signal sent by the GPU.
在一实施例中,编码器在完成一帧画面的压缩数据后,设置压缩帧标志为有效状态,在压缩编码之初设置压缩帧标志为无效状态。该压缩帧标志用以指示压缩数据是/否预备。In one embodiment, the encoder sets the compressed frame flag to a valid state after completing the compressed data of a frame of picture, and sets the compressed frame flag to an invalid state at the beginning of compression encoding. The compressed frame flag is used to indicate whether or not compressed data is prepared.
在一实施例中,GPU检查源数据更新标记是否为有效状态,若否,再检查压缩帧标志是否为有效状态,若否,则向编码器发送启动信号,并从存储器读取源数据,实时生成图像数据,并写入到行缓存和像素缓存,以向显示器和编码器提供图像数据。In one embodiment, the GPU checks whether the source data update flag is in a valid state. If not, it then checks whether the compressed frame flag is in a valid state. If not, it sends a start signal to the encoder and reads the source data from the memory in real time. Image data is generated and written to the line buffer and pixel buffer to provide image data to the display and encoder.
在一实施例中,GPU通过GPU驱动程序检查到持续处理2次或3次相同画面的源数据,且压缩帧标志为无效状态,可向编码器发送启动信号,控制编码器开始工作。In one embodiment, the GPU detects through the GPU driver that the source data of the same frame has been continuously processed two or three times, and the compressed frame flag is in an invalid state, and a start signal can be sent to the encoder to control the encoder to start working.
在一实施例中,GPU通过GPU驱动程序检查源数据更新标记是否为有效状态,若是,则向编码器发送启动信号,并从存储器读取源数据,实时生成图像数据,并写入到行缓存和像素缓存,以向显示器和编码器提供图像数据。In one embodiment, the GPU checks whether the source data update flag is in a valid state through the GPU driver. If so, it sends a start signal to the encoder, reads the source data from the memory, generates image data in real time, and writes it to the line cache. and pixel buffers to provide image data to displays and encoders.
解码器可执行与编码器匹配的解码算法,将压缩数据进行解压缩,然后将解压缩的图像数据写入行缓存,以向显示器提供图像数据。解码器仅在待显示画面无变化或待显示画面为静止图像时,启动解压缩。The decoder executes a decoding algorithm that matches the encoder, decompresses the compressed data, and then writes the decompressed image data to the line buffer to provide image data to the display. The decoder only starts decompression when the picture to be displayed does not change or the picture to be displayed is a still image.
在一实施例中,GPU检查源数据更新标记是否为有效状态,若否,再检查压缩帧标志是否为有效状态,若是,则向解码器发送启动信号,解码器接收该启动信号后启动工作。In one embodiment, the GPU checks whether the source data update flag is in a valid state. If not, it then checks whether the compressed frame flag is in a valid state. If so, it sends a start signal to the decoder, and the decoder starts working after receiving the start signal.
在一实施例中,GPU通过GPU驱动程序检查到持续处理2次或3次相同画面的源数据,且压缩帧标志为有效状态,则向解码器发送启动信号,控制解码器开始工作。In one embodiment, the GPU detects through the GPU driver that the source data of the same frame has been continuously processed two or three times, and the compressed frame flag is in a valid state, and then sends a start signal to the decoder to control the decoder to start working.
在一实施例中,解码器启动工作后,可直接从存储器中读取压缩数据。在另一实施例中,解码器启动工作后,接收GPU从存储器中读取后发送的压缩数据。In one embodiment, after the decoder starts working, the compressed data can be read directly from the memory. In another embodiment, after the decoder starts working, it receives the compressed data sent by the GPU after reading it from the memory.
像素缓存可存储GPU实时生成的图像数据,并向编码器提供该图像数据。像素缓存可以是FIFO(First Input First Output,先进先出)数据缓存。The pixel cache stores image data generated by the GPU in real time and provides that image data to the encoder. The pixel cache can be a FIFO (First Input First Output, first in first out) data cache.
在一实施例中,像素缓存仅可存储少于一行像素的图像数据。In one embodiment, the pixel buffer can only store image data for less than one row of pixels.
行缓存可接收GPU实时生成的图像数据和解码器实时解压缩的图像数据,并提供给显示控制器或外部显示控制模块,以使显示器生成图像。行缓存可以是FIFO数据缓存。The line buffer can receive the image data generated by the GPU in real time and the image data decompressed by the decoder in real time, and provide it to the display controller or external display control module to enable the display to generate images. The row cache can be a FIFO data cache.
在一实施例中,行缓存仅可存储一行像素的图像数据。In one embodiment, the row buffer can only store image data of one row of pixels.
在一实施例中,行缓存可存储多行像素的图像数据,以满足高分辨率显示器的实时时序处理。In one embodiment, the line buffer can store image data of multiple lines of pixels to meet the real-time timing processing of high-resolution displays.
如图2的示例,本实施例的向显示器提供图像数据的低功耗处理方法,包括框10-11。As shown in the example of Figure 2, the low-power processing method of providing image data to a display in this embodiment includes blocks 10-11.
在框10中,确定待显示画面无变化或待显示画面为静止图像,则再确定该待显示画面的压缩数据是否预备,若是,则启动解压缩,以向显示器提供该待显示画面的图像数据;若否,则生成该待显示画面的图像数据,以提供给显示器,以及启动压缩,根据压缩方案生成该待显示画面的压缩数据。其中,解压缩是根据压缩方案将该待显示画面的压缩数据解压缩为图像数据。In block 10, it is determined that the picture to be displayed has no change or the picture to be displayed is a still image, and then it is determined whether the compressed data of the picture to be displayed is prepared. If so, decompression is started to provide the image data of the picture to be displayed to the display. ; If not, the image data of the picture to be displayed is generated to provide it to the display, and compression is started, and the compressed data of the picture to be displayed is generated according to the compression scheme. The decompression is to decompress the compressed data of the picture to be displayed into image data according to the compression scheme.
其中,生成该待显示画面的图像数据,是基于读取该待显示画面的源数据而实时生成的。The image data for generating the picture to be displayed is generated in real time based on reading the source data of the picture to be displayed.
在一实施例中,可通过GPU通过GPU驱动程序检查到持续处理2次或3次相同画面的源数据,且压缩帧有效标志为无效状态,则控制编码器开始工作。In one embodiment, the GPU can check through the GPU driver that the source data of the same frame has been continuously processed two or three times, and the compressed frame valid flag is in an invalid state, and then the encoder is controlled to start working.
在一实施例中,可通过GPU通过GPU驱动程序检查到持续处理2次或3次相同画面的源数据,且压缩帧有效标志为有效状态,可控制解码器开始工作。In one embodiment, the GPU can check through the GPU driver that the source data of the same frame has been continuously processed two or three times, and the compressed frame valid flag is in a valid state, which can control the decoder to start working.
该压缩帧标志用以指示压缩数据是/否预备,在完成一帧画面的压缩数据后,该压缩帧标志被设置为有效状态,在压缩编码之初,该压缩帧标志被设置为无效状态。The compressed frame flag is used to indicate whether or not the compressed data is prepared. After the compressed data of a frame is completed, the compressed frame flag is set to a valid state. At the beginning of compression encoding, the compressed frame flag is set to an invalid state.
在一实施例中,解码器启动工作后,可直接从存储器中读取压缩数据。在另一实施例中,解码器启动工作后,接收GPU从存储器中读取后发送的压缩数据。In one embodiment, after the decoder starts working, the compressed data can be read directly from the memory. In another embodiment, after the decoder starts working, it receives the compressed data sent by the GPU after reading it from the memory.
在框11中,确定待显示画面有变化或待显示画面为动态图像,则生成该待显示画面的图像数据,以向显示器提供该图像数据,或者生成该待显示画面的图像数据,以向显示器提供该图像数据,以及启动压缩,根据压缩方案生成该待显示画面的压缩数据。In block 11, if it is determined that the picture to be displayed changes or the picture to be displayed is a dynamic image, the image data of the picture to be displayed is generated to provide the image data to the display, or the image data of the picture to be displayed is generated to provide the display with the image data. The image data is provided, compression is started, and compressed data of the picture to be displayed is generated according to the compression scheme.
其中,生成该待显示画面的压缩数据,是基于读取该待显示画面的图像数据而实时生成的。Wherein, generating the compressed data of the picture to be displayed is generated in real time based on reading the image data of the picture to be displayed.
在一实施例中,若待显示画面有变化或待显示画面为动态图像,GPU实时生成图像数据,写入行缓存,以向显示器提供该图像数据。In one embodiment, if the picture to be displayed changes or the picture to be displayed is a dynamic image, the GPU generates image data in real time and writes it into the line buffer to provide the image data to the display.
在一实施例中,若待显示画面有变化或待显示画面为动态图像,GPU实时生成图像数据,写入行缓存和像素缓存,以向显示器和编码器提供该图像数据。In one embodiment, if the picture to be displayed changes or the picture to be displayed is a dynamic image, the GPU generates image data in real time and writes it into the line buffer and pixel buffer to provide the image data to the display and encoder.
上述框10-11可以根据实际情况以不同的次序、组合执行。The above blocks 10-11 can be executed in different orders and combinations according to the actual situation.
如图3的示例,本实施例的向显示器提供图像数据的低功耗处理方法,包括框20-27。在框20中,通过判断待显示画面的源数据与上一帧画面的源数据相同,来确定待显示画面无变化或待显示画面为静态图像。As shown in the example of Figure 3, the low-power processing method of providing image data to a display in this embodiment includes blocks 20-27. In block 20, by determining that the source data of the picture to be displayed is the same as the source data of the previous frame, it is determined that the picture to be displayed has no change or that the picture to be displayed is a static image.
在一实施例中,可通过CPU通过判断待显示画面的源数据与上一帧画面的源数据相同,来确定待显示画面无变化或待显示画面为静态图像。In one embodiment, the CPU can determine that the source data of the image to be displayed is the same as the source data of the previous frame, thereby determining that there is no change in the image to be displayed or that the image to be displayed is a static image.
在框21中,设置源数据更新标记为无效状态,用以指示待显示画面无变化或待显示画面为静态图像。In block 21, the source data update flag is set to an invalid state to indicate that there is no change in the picture to be displayed or that the picture to be displayed is a static image.
在一实施例中,可通过CPU设置源数据更新标记为无效状态。In one embodiment, the source data update flag may be set to an invalid state by the CPU.
在框22中,通过判断待显示画面的源数据与上一帧画面的源数据不相同,来确定待显示画面有变化或待显示画面为动态图像。In block 22, by determining that the source data of the picture to be displayed is different from the source data of the previous frame, it is determined that the picture to be displayed has changed or that the picture to be displayed is a dynamic image.
在一实施例中,可通过CPU通过判断待显示画面的源数据与上一帧画面的源数据不相同,来确定待显示画面有变化或待显示画面为动态图像。In one embodiment, the CPU can determine that the picture to be displayed has changed or that the picture to be displayed is a dynamic image by determining that the source data of the picture to be displayed is different from the source data of the previous frame.
在框23中,设置源数据更新标记为有效状态,用以指示待显示画面有变化或待显示画面为动态图像。In block 23, the source data update flag is set to a valid state to indicate that the picture to be displayed has changed or that the picture to be displayed is a dynamic image.
在一实施例中,可通过CPU设置源数据更新标记为有效状态。In one embodiment, the source data update flag may be set to a valid state through the CPU.
在一实施例中,可通过CPU在获取待显示画面的源数据后,比较待显示画面的源数据与上一帧画面的源数据是否相同,若否,则将待显示画面的源数据写入存储器,并设置源数据更新标记为有效状态,若是,则不将待显示画面的源数据写入存储器,并设置源数据更新标记为无效状态。In one embodiment, after acquiring the source data of the picture to be displayed, the CPU can compare whether the source data of the picture to be displayed is the same as the source data of the previous frame. If not, write the source data of the picture to be displayed into memory, and set the source data update flag to a valid state. If so, the source data of the screen to be displayed is not written to the memory, and the source data update flag is set to an invalid state.
在一实施例中,在开始刷新待显示帧画面时,可通过CPU判断是否接收到更新的待显示画面的源数据,若是,则将待显示画面的源数据写入存储器,并设置源数据更新标记为有效状态,若否,则设置源数据更新标记为无效状态。其中,更新的待显示画面的源数据包括最接近刷新待显示画面时刻接收到的与上一帧画面的源数据不同的源数据。In one embodiment, when starting to refresh the frame to be displayed, the CPU can determine whether the updated source data of the frame to be displayed is received. If so, the source data of the frame to be displayed is written into the memory and the source data update is set. Mark as valid, if not, set the source data update mark as invalid. The updated source data of the picture to be displayed includes source data received closest to the time when the picture to be displayed is refreshed and is different from the source data of the previous frame of picture.
在一实施例中,可通过在CPU中运行的软件程序将源数据更新标记写入GPU驱动程序中。In one embodiment, the source data update flag may be written into the GPU driver through a software program running in the CPU.
在一实施例中,可通过GPU通过GPU驱动程序检查该源数据更新标记是否为有效状态。In one embodiment, the GPU can be used to check whether the source data update flag is in a valid state through the GPU driver.
在框24中,通过检查压缩帧标志是否为有效状态,来确定待显示画面的压缩数据是否预备。In block 24, it is determined whether the compressed data of the picture to be displayed is prepared by checking whether the compressed frame flag is in a valid state.
在一实施例中,在完成一帧画面的压缩数据后,该压缩帧标志被设置为有效状态,在压缩编码之初,该压缩帧标志被设置为无效状态。In one embodiment, after completing the compressed data of one frame of picture, the compressed frame flag is set to a valid state, and at the beginning of compression encoding, the compressed frame flag is set to an inactive state.
在一实施例中,可通过编码器设置压缩帧标志的状态。In one embodiment, the state of the compressed frame flag may be set by the encoder.
在一实施例中,可通过GPU检查压缩帧标志是否为有效状态,来确定待显示画面的压缩数据是否预备。In one embodiment, the GPU can be used to determine whether the compressed data of the picture to be displayed is prepared by checking whether the compressed frame flag is in a valid state.
在框25中,若检查该源数据更新标记为有效状态,则生成该待显示画面的图像数据,以向显示器提供该图像数据。In block 25, if it is checked that the source data update flag is in a valid state, image data of the screen to be displayed is generated to provide the image data to the display.
在一实施例中,可通过GPU收到帧开始信号后,先检查源数据更新标记是否为有效状态,若是,则表示待显示画面有变化或待显示画面为动态图像,GPU从存储器读取源数据,实时生成图像数据。In one embodiment, after receiving the frame start signal through the GPU, it first checks whether the source data update flag is in a valid state. If so, it means that the picture to be displayed has changed or the picture to be displayed is a dynamic image, and the GPU reads the source data from the memory. data, generating image data in real time.
在一实施例中,可通过GPU将生成的图像数据写入像素缓存,以向编码器提供该图像数据。In one embodiment, the generated image data may be written to a pixel buffer by the GPU to provide the image data to the encoder.
在一实施例中,可通过GPU将生成的图像数据写入行缓存,以向显示器提供该图像数据。In one embodiment, the generated image data may be written to the line buffer by the GPU to provide the image data to the display.
在框26中,若检查该源数据更新标记为无效状态,且该压缩帧标志为有效状态,则启动解压缩,以向显示器提供该待显示画面的图像数据。In block 26, if it is checked that the source data update flag is in an invalid state and the compressed frame flag is in a valid state, decompression is started to provide the display with image data of the picture to be displayed.
其中,解压缩是根据压缩方案将待显示画面的压缩数据解压缩为图像数据。Among them, decompression is to decompress the compressed data of the picture to be displayed into image data according to the compression scheme.
在一实施例中,可通过GPU检查源数据更新标记是否为有效状态,若否,再检查压缩帧标志是否为有效状态,若是,则向解码器发送启动信号,解码器接收该启动信号后启动工作。In one embodiment, the GPU can be used to check whether the source data update flag is in a valid state. If not, then check whether the compressed frame flag is in a valid state. If so, a start signal is sent to the decoder, and the decoder starts after receiving the start signal. Work.
在一实施例中,解码器启动工作后,可直接从存储器中读取压缩数据。在另一实施例中,解码器启动工作后,接收GPU从存储器中读取后发送的压缩数据。In one embodiment, after the decoder starts working, the compressed data can be read directly from the memory. In another embodiment, after the decoder starts working, it receives the compressed data sent by the GPU after reading it from the memory.
在一实施例中,压缩方案包括RLE算法。In one embodiment, the compression scheme includes the RLE algorithm.
在框27中,若检查该源数据更新标记为无效状态且该压缩帧标志为无效状态,则启动压缩,根据压缩方案生成该待显示画面的压缩数据。In block 27, if it is checked that the source data update flag is in an invalid state and the compressed frame flag is in an invalid state, compression is started, and the compressed data of the picture to be displayed is generated according to the compression scheme.
在一实施例中,可通过GPU检查源数据更新标记是否为有效状态,若否,再检查压缩帧标志是否为有效状态,若是,则向编码器发送启动信号,编码器接收该启动信号后启动工作,根据压缩方案生成该待显示画面的压缩数据。In one embodiment, the GPU can be used to check whether the source data update flag is in a valid state. If not, then check whether the compressed frame flag is in a valid state. If so, a start signal is sent to the encoder, and the encoder starts after receiving the start signal. Work to generate the compressed data of the picture to be displayed according to the compression scheme.
在框28中,将该压缩数据写入存储器。In block 28, the compressed data is written to memory.
在一实施例中,编码器生成压缩数据后,通过总线写入存储器。In one embodiment, after the encoder generates compressed data, it is written into the memory through the bus.
上述框20-28可以根据实际情况以不同的次序、组合执行。The above blocks 20-28 can be executed in different orders and combinations according to the actual situation.
以上举较佳实施例,对本发明的目的,技术方案和优点进行了进一步详细说明,所应理解的是,以上该实施例仅为了使本领域技术人员能够制作或实现而公开的实施例,并不用以限制本发明的保护范围。凡在本发明所定义的原理基础上所作的任何显而易见的修改,等同的替换与改进,均应包含在本发明的保护范围之内。本发明所主张的权利范围不应仅限于上述实施例,而是应与本发明权利要求所定义的原理和技术特征相一致的最广的可能范围。The preferred embodiments are cited above to further describe the purpose, technical solutions and advantages of the present invention in detail. It should be understood that the above embodiments are only disclosed to enable those skilled in the art to make or implement them, and It is not intended to limit the scope of the present invention. Any obvious modifications, equivalent substitutions and improvements made on the basis of the principles defined in the present invention shall be included in the protection scope of the present invention. The scope of the rights claimed by the present invention should not be limited to the above-mentioned embodiments, but should be the broadest possible scope consistent with the principles and technical features defined in the claims of the present invention.

Claims (10)

  1. 一种向显示器提供图像数据的低功耗处理装置,其特征在于,包括CPU,GPU,存储器,编码器和解码器;A low-power processing device that provides image data to a display, characterized in that it includes a CPU, a GPU, a memory, an encoder and a decoder;
    确定待显示画面无变化或待显示画面为静止图像,则再确定所述待显示画面的压缩数据是否预备,若是,则所述解码器根据压缩方案将所述待显示画面的压缩数据解压缩为图像数据,以向显示器提供所述图像数据;若否,则所述GPU生成所述待显示画面的图像数据,以向所述显示器提供所述图像数据,以及所述编码器根据所述压缩方案生成所述待显示画面的压缩数据;After determining that the picture to be displayed has no change or that the picture to be displayed is a still image, it is then determined whether the compressed data of the picture to be displayed is prepared. If so, the decoder decompresses the compressed data of the picture to be displayed according to the compression scheme into Image data to provide the image data to the display; if not, the GPU generates image data of the picture to be displayed to provide the image data to the display, and the encoder generates image data according to the compression scheme Generate compressed data of the picture to be displayed;
    确定待显示画面有变化或待显示画面为动态图像,则所述GPU生成所述待显示画面的图像数据,以向所述显示器提供所述图像数据,或者所述GPU生成所述待显示画面的图像数据,以向所述显示器提供所述图像数据,以及所述编码器根据所述压缩方案生成所述待显示画面的压缩数据;If it is determined that the picture to be displayed changes or the picture to be displayed is a dynamic image, the GPU generates the image data of the picture to be displayed to provide the image data to the display, or the GPU generates the image data of the picture to be displayed. image data to provide the image data to the display, and the encoder to generate compressed data of the picture to be displayed according to the compression scheme;
    其中,所述GPU生成所述待显示画面的图像数据,是基于读取所述待显示画面的源数据而实时生成的;所述编码器生成所述待显示画面的压缩数据,是基于读取所述待显示画面的图像数据而实时生成的。Wherein, the GPU generates the image data of the picture to be displayed in real time based on reading the source data of the picture to be displayed; the encoder generates the compressed data of the picture to be displayed based on reading The image data of the picture to be displayed is generated in real time.
  2. 如权利要求1所述的向显示器提供图像数据的低功耗处理装置,其特征在于,所述确定待显示画面无变化或待显示画面为静态图像,进一步包括:The low-power processing device for providing image data to a display according to claim 1, wherein determining that the picture to be displayed has no change or that the picture to be displayed is a static image further includes:
    所述CPU通过判断所述待显示画面的源数据与上一帧画面的源数据相同,来确定待显示画面无变化或待显示画面为静态图像;The CPU determines that the source data of the picture to be displayed is the same as the source data of the previous frame to determine that there is no change in the picture to be displayed or that the picture to be displayed is a static image;
    所述确定待显示画面有变化或待显示画面为动态图像,进一步包括:Determining that the picture to be displayed changes or that the picture to be displayed is a dynamic image further includes:
    所述CPU通过判断所述待显示画面的源数据与上一帧画面的源数据不相同,来确定待显示画面有变化或待显示画面为动态图像。The CPU determines that the picture to be displayed has changed or that the picture to be displayed is a dynamic image by judging that the source data of the picture to be displayed is different from the source data of the previous frame.
  3. 如权利要求2所述的向显示器提供图像数据的低功耗处理装置,其特征在于,所述确定待显示画面无变化或待显示画面为静态图像,进一步包括:The low-power processing device for providing image data to a display according to claim 2, wherein determining that the picture to be displayed has no change or that the picture to be displayed is a static image further includes:
    所述CPU设置源数据更新标记为无效状态,用以指示待显示画面无变化或待显示画面为静态图像;The CPU sets the source data update flag to an invalid state to indicate that there is no change in the picture to be displayed or that the picture to be displayed is a static image;
    所述确定待显示画面有变化或待显示画面为动态图像,进一步包括:Determining that the picture to be displayed changes or that the picture to be displayed is a dynamic image further includes:
    所述CPU设置源数据更新标记为有效状态,用以指示待显示画面有变化或待显示画面为动态图像。The CPU sets the source data update flag to a valid state to indicate that the picture to be displayed has changed or that the picture to be displayed is a dynamic image.
  4. 如权利要求3所述的向显示器提供图像数据的低功耗处理装置,其特征在于,所述确定待显示画面无变化或待显示画面为静态图像,进一步包括:The low-power processing device for providing image data to a display according to claim 3, wherein determining that the picture to be displayed has no change or that the picture to be displayed is a static image further includes:
    所述GPU检查所述源数据更新标记为无效状态;The GPU checks that the source data update mark is in an invalid state;
    所述确定待显示画面有变化或待显示画面为动态图像,进一步包括:Determining that the picture to be displayed changes or that the picture to be displayed is a dynamic image further includes:
    所述GPU检查所述源数据更新标记为有效状态。The GPU checks that the source data update flag is valid.
  5. 如权利要求3所述的向显示器提供图像数据的低功耗处理装置,其特征在于,所述确定所述待显示画面的压缩数据是否预备,进一步包括:The low-power processing device for providing image data to a display according to claim 3, wherein the determining whether the compressed data of the picture to be displayed is prepared further includes:
    所述GPU通过检查压缩帧标志是否为有效状态,来确定待显示画面的压缩数据是否预备;所述压缩帧标志用以指示所述压缩数据是否预备,所述编码器在完成一帧画面的压缩数据后设置所述压缩帧标志为有效状态,在压缩编码之初设置所述压缩帧标志为无效状态。The GPU determines whether the compressed data of the picture to be displayed is prepared by checking whether the compressed frame flag is in a valid state; the compressed frame flag is used to indicate whether the compressed data is prepared. The encoder completes the compression of a frame of picture. The compressed frame flag is set to a valid state after the data is transmitted, and is set to an invalid state at the beginning of compression encoding.
  6. 如权利要求5所述的向显示器提供图像数据的低功耗处理装置,其特征在于,所述GPU检查所述源数据更新标记为无效状态,再检查所述压缩帧标志为有效状态,则所述GPU控制所述解码器启动工作。The low-power processing device for providing image data to a display according to claim 5, wherein the GPU checks that the source data update flag is in an invalid state, and then checks that the compressed frame flag is in a valid state, then the The GPU controls the decoder to start working.
  7. 如权利要求5所述的向显示器提供图像数据的低功耗处理装置,其特征在于,所述GPU检查所述源数据更新标记为有效状态,或者所述源数据更新标记为无效状态且所述压缩帧标志为无效状态,则所述GPU控制所述编码器启动工作。The low-power processing device for providing image data to a display according to claim 5, wherein the GPU checks that the source data update flag is in a valid state, or that the source data update flag is in an invalid state and the If the compressed frame flag is in an invalid state, the GPU controls the encoder to start working.
  8. 如权利要求3所述的向显示器提供图像数据的低功耗处理装置,其特征在于,所述确定待显示画面无变化或待显示画面为静止图像和确定待显示画面有变化或待显示画面为动态图像,进一步包括:The low-power processing device for providing image data to a display according to claim 3, wherein the step of determining that the picture to be displayed has no change or that the picture to be displayed is a still image and that the picture to be displayed has changed or that the picture to be displayed is Moving images, further including:
    所述CPU在获取所述待显示画面的源数据后,比较所述待显示画面的源数据与上一帧画面的源数据是否相同,若否,则所述CPU将所述待显示画面的源数据写入所述存储器,并设置所述源数据更新标记为有效状态,若是,则不将所述待显示画面的源数据写入存储器,并设置所述源数据更新标记为无效状态。After acquiring the source data of the picture to be displayed, the CPU compares whether the source data of the picture to be displayed is the same as the source data of the previous frame. If not, the CPU compares the source data of the picture to be displayed to the source data of the picture to be displayed. The data is written into the memory, and the source data update flag is set to a valid state. If so, the source data of the picture to be displayed is not written into the memory, and the source data update flag is set to an invalid state.
  9. 如权利要求3所述的向显示器提供图像数据的低功耗处理装置,其特征在于,所述确定待显示画面无变化或待显示画面为静止图像和确定待显示画面有变化或待显示画面为动态图像,进一步包括:The low-power processing device for providing image data to a display according to claim 3, wherein the step of determining that the picture to be displayed has no change or that the picture to be displayed is a still image and that the picture to be displayed has changed or that the picture to be displayed is Moving images, further including:
    所述CPU在开始刷新待显示帧画面时,判断是否接收到更新的待显示画面的源数据,若是,则将所述待显示画面的源数据写入所述存储器,并设置所述源数据更新标记为有效状态,若否,则设置所述源数据更新标记为无效状态;所述更新的待显示画面的源数据包括最接近刷新待显示画面时刻接收到的与上一帧画面的源数据不同的源数据。When the CPU starts to refresh the frame to be displayed, it determines whether it has received the updated source data of the frame to be displayed. If so, it writes the source data of the frame to be displayed into the memory and sets the source data update Mark as a valid state, if not, set the source data update mark as an invalid state; the source data of the updated picture to be displayed includes the source data received closest to the moment when the picture to be displayed is refreshed and is different from the source data of the previous frame. source data.
  10. 如权利要求1所述的向显示器提供图像数据的低功耗处理装置,其特征在于,所述压缩方案包括RLE算法;所述编码器包括RLE编码器;所述解码器包括RLE解码器。The low-power processing device for providing image data to a display according to claim 1, wherein the compression scheme includes an RLE algorithm; the encoder includes an RLE encoder; and the decoder includes an RLE decoder.
    11.如权利要求1所述的向显示器提供图像数据的低功耗处理装置,其特征在于,所述编码器将所述待显示画面的压缩数据写入所述存储器;所述解码器从所述存储器读取所述待显示画面的压缩数据,或所述GPU从所述存储器读取所述待显示画面的压缩数据后发送给所述解码器。11. The low-power processing device for providing image data to a display according to claim 1, wherein the encoder writes the compressed data of the picture to be displayed into the memory; the decoder reads the compressed data from the image data to be displayed. The memory reads the compressed data of the picture to be displayed, or the GPU reads the compressed data of the picture to be displayed from the memory and sends it to the decoder.
    12.如权利要求1所述的向显示器提供图像数据的低功耗处理装置,其特征在于,进一步包括:12. The low-power processing device for providing image data to a display as claimed in claim 1, further comprising:
    像素缓存,用以存储所述GPU生成的图像数据,并向所述编码器提供所述图像数据。A pixel cache is used to store image data generated by the GPU and provide the image data to the encoder.
    13.如权利要求1所述的向显示器提供图像数据的低功耗处理装置,其特征在于,进一步包括:13. The low-power processing device for providing image data to a display as claimed in claim 1, further comprising:
    行缓存,用以存储所述GPU生成的图像数据和所述解码器解压缩的图像数据,并向所述显示器提供所述图像数据。A line cache is used to store the image data generated by the GPU and the image data decompressed by the decoder, and provide the image data to the display.
    14.一种向显示器提供图像数据的低功耗处理方法,其特征在于,包括:14. A low-power processing method for providing image data to a display, characterized by comprising:
    确定待显示画面无变化或待显示画面为静止图像,则再确定所述待显示画面的压缩数据是否预备,若是,则启动解压缩,以向显示器提供所述待显示画面的图像数据;若否,则生成所述待显示画面的图像数据,以提供给所述显示器,以及启动压缩,根据压缩方案生成所述待显示画面的压缩数据;所述解压缩是根据所述压缩方案将所述待显示画面的压缩数据解压缩为图像数据;If it is determined that the picture to be displayed has no change or the picture to be displayed is a still image, then it is determined whether the compressed data of the picture to be displayed is prepared. If so, decompression is started to provide the image data of the picture to be displayed to the display; if not , then the image data of the picture to be displayed is generated to provide it to the display, and compression is started, and the compressed data of the picture to be displayed is generated according to the compression scheme; the decompression is to convert the picture to be displayed according to the compression scheme. The compressed data of the display screen is decompressed into image data;
    确定待显示画面有变化或待显示画面为动态图像,则生成所述待显示画面的图像数据,以向所述显示器提供所述图像数据;或者生成所述待显示画面的图像数据,以向所述显示器提供所述图像数据,以及启动压缩,根据所述压缩方案生成所述待显示画面的压缩数据;If it is determined that the picture to be displayed changes or the picture to be displayed is a dynamic image, the image data of the picture to be displayed is generated to provide the image data to the display; or the image data of the picture to be displayed is generated to provide the image data to the display. The display provides the image data, starts compression, and generates compressed data of the picture to be displayed according to the compression scheme;
    其中,所述生成所述待显示画面的图像数据,是基于读取所述待显示画面的源数据而实时生成的;所述生成所述待显示画面的压缩数据,是基于读取所述待显示画面的图像数据而实时生成的。Wherein, the generating the image data of the picture to be displayed is generated in real time based on reading the source data of the picture to be displayed; the generating the compressed data of the picture to be displayed is based on reading the source data of the picture to be displayed. The image data of the display screen is generated in real time.
    15.如权利要求14所述的向显示器提供图像数据的低功耗处理方法,其特征在于,所述确定待显示画面无变化或待显示画面为静止图像,进一步包括:15. The low-power processing method for providing image data to a display as claimed in claim 14, wherein determining that the picture to be displayed has no change or that the picture to be displayed is a still image further includes:
    通过判断所述待显示画面的源数据与上一帧画面的源数据相同,来确定待显示画面无变化或待显示画面为静态图像;By judging that the source data of the picture to be displayed is the same as the source data of the previous frame, it is determined that the picture to be displayed has no change or that the picture to be displayed is a static image;
    所述确定待显示画面有变化或待显示画面为动态图像,进一步包括:Determining that the picture to be displayed changes or that the picture to be displayed is a dynamic image further includes:
    通过判断所述待显示画面的源数据与上一帧画面的源数据不相同,来确定待显示画面有变化或待显示画面为动态图像。By judging that the source data of the picture to be displayed is different from the source data of the previous frame, it is determined that the picture to be displayed has changed or that the picture to be displayed is a dynamic image.
    16.如权利要求15所述的向显示器提供图像数据的低功耗处理方法,其特征在于,所述确定待显示画面无变化或待显示画面为静态图像,进一步包括:16. The low-power processing method for providing image data to a display as claimed in claim 15, wherein determining that the picture to be displayed has no change or that the picture to be displayed is a static image further includes:
    设置源数据更新标记为无效状态,用以指示待显示画面无变化或待显示画面为静态图像;Set the source data update flag to an invalid state to indicate that there is no change in the image to be displayed or that the image to be displayed is a static image;
    所述确定待显示画面有变化或待显示画面为动态图像,进一步包括:Determining that the picture to be displayed changes or that the picture to be displayed is a dynamic image further includes:
    设置源数据更新标记为有效状态,用以指示待显示画面有变化或待显示画面为动态图像。Set the source data update flag to a valid state to indicate that the picture to be displayed has changed or that the picture to be displayed is a dynamic image.
    17.如权利要求16所述的向显示器提供图像数据的低功耗处理方法,其特征在于,所述确定待显示画面无变化或待显示画面为静态图像,进一步包括:17. The low-power processing method for providing image data to a display as claimed in claim 16, wherein determining that the picture to be displayed has no change or that the picture to be displayed is a static image further includes:
    检查所述源数据更新标记为无效状态;Check that the source data update mark is invalid;
    所述确定待显示画面有变化或待显示画面为动态图像,进一步包括:Determining that the picture to be displayed changes or that the picture to be displayed is a dynamic image further includes:
    检查所述源数据更新标记为有效状态。Check that the source data updates are marked as valid.
    18.如权利要求17所述的向显示器提供图像数据的低功耗处理方法,其特征在于,所述确定所述待显示画面的压缩数据是否预备,进一步包括:18. The low-power processing method for providing image data to a display according to claim 17, wherein the determining whether the compressed data of the picture to be displayed is prepared further includes:
    通过检查压缩帧标志是否为有效状态,来确定待显示画面的压缩数据是否预备;所述压缩帧标志用以指示所述压缩数据是否预备,在完成一帧画面的压缩数据后所述压缩帧标志被设置为有效状态,在压缩编码之初所述压缩帧标志被设置为无效状态。By checking whether the compressed frame flag is in a valid state, it is determined whether the compressed data of the picture to be displayed is prepared; the compressed frame flag is used to indicate whether the compressed data is prepared. After the compressed data of a frame of picture is completed, the compressed frame flag is is set to the valid state, and the compressed frame flag is set to the invalid state at the beginning of compression encoding.
    19.如权利要求18所述的向显示器提供图像数据的低功耗处理方法,其特征在于,所述启动解压缩,进一步包括:19. The low-power processing method for providing image data to a display as claimed in claim 18, wherein said initiating decompression further includes:
    若检查所述源数据更新标记为无效状态,且所述压缩帧标志为有效状态,则启动解压缩。If it is checked that the source data update flag is in an invalid state and the compressed frame flag is in a valid state, decompression is started.
    20.如权利要求18所述的向显示器提供图像数据的低功耗处理方法,其特征在于,所述启动压缩,进一步包括:20. The low-power processing method for providing image data to a display as claimed in claim 18, wherein said initiating compression further includes:
    若检查所述源数据更新标记为有效状态,或者所述源数据更新标记为无效状态且所述压缩帧标志为无效状态,则启动压缩。If it is checked that the source data update mark is in a valid state, or the source data update mark is in an invalid state and the compressed frame flag is in an invalid state, compression is started.
    21.如权利要求14所述的向显示器提供图像数据的低功耗处理方法,其特征在于,所述生成所述待显示画面的压缩数据,进一步包括:21. The low-power processing method for providing image data to a display according to claim 14, wherein generating the compressed data of the picture to be displayed further includes:
    将所述压缩数据写入存储器。Write the compressed data to memory.
    22.如权利要求16所述的向显示器提供图像数据的低功耗处理方法,其特征在于,所述确定待显示画面无变化或待显示画面为静止图像和确定待显示画面有变化或待显示画面为动态图像,进一步包括:22. The low-power processing method for providing image data to a display as claimed in claim 16, wherein the step of determining that the image to be displayed has no change or that the image to be displayed is a still image and determining that the image to be displayed has changed or is to be displayed. The screen is a dynamic image, further including:
    在获取所述待显示画面的源数据后,比较所述待显示画面的源数据与上一帧画面的源数据是否相同,若否,则将所述待显示画面的源数据写入存储器,并设置所述源数据更新标记为有效状态,若是,则不将所述待显示画面的源数据写入存储器,并设置所述源数据更新标记为无效状态。After obtaining the source data of the picture to be displayed, compare whether the source data of the picture to be displayed is the same as the source data of the previous frame. If not, write the source data of the picture to be displayed into the memory, and The source data update flag is set to a valid state. If so, the source data of the picture to be displayed is not written into the memory, and the source data update flag is set to an invalid state.
    23.如权利要求16所述的向显示器提供图像数据的低功耗处理方法,其特征在于,所述确定待显示画面无变化或待显示画面为静止图像和确定待显示画面有变化或待显示画面为动态图像,进一步包括:23. The low-power processing method for providing image data to a display as claimed in claim 16, wherein the step of determining that the image to be displayed has no change or that the image to be displayed is a still image and determining that the image to be displayed has changed or is to be displayed. The screen is a dynamic image, further including:
    在开始刷新待显示帧画面时,判断是否接收到更新的待显示画面的源数据,若是,则将所述待显示画面的源数据写入存储器,并设置所述源数据更新标记为有效状态,若否,则设置所述源数据更新标记为无效状态;When starting to refresh the frame to be displayed, it is determined whether the source data of the updated frame to be displayed is received, and if so, the source data of the frame to be displayed is written into the memory, and the source data update flag is set to a valid state, If not, set the source data update mark to an invalid state;
    所述更新的待显示画面的源数据包括最接近刷新待显示画面时刻接收到的与上一帧画面的源数据不同的源数据。The updated source data of the picture to be displayed includes source data received closest to the moment when the picture to be displayed is refreshed and is different from the source data of the previous frame of picture.
    24.如权利要求14所述的向显示器提供图像数据的低功耗处理方法,其特征在于,所述压缩方案包括RLE算法。24. The low-power processing method for providing image data to a display according to claim 14, wherein the compression scheme includes an RLE algorithm.
    25.一种图像显示设备,其特征在于,包括如权利要求1至13任意一项所述的低功耗处理装置,和连接所述低功耗处理装置的显示器。25. An image display device, characterized by comprising the low-power processing device according to any one of claims 1 to 13, and a display connected to the low-power processing device.
PCT/CN2022/117140 2022-09-06 2022-09-06 Low-power-consumption processing apparatus and method for providing image data to display, and device WO2024050678A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2022/117140 WO2024050678A1 (en) 2022-09-06 2022-09-06 Low-power-consumption processing apparatus and method for providing image data to display, and device
CN202280003454.7A CN115668099A (en) 2022-09-06 2022-09-06 Low power processing apparatus, method and apparatus for providing image data to a display

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2022/117140 WO2024050678A1 (en) 2022-09-06 2022-09-06 Low-power-consumption processing apparatus and method for providing image data to display, and device

Publications (1)

Publication Number Publication Date
WO2024050678A1 true WO2024050678A1 (en) 2024-03-14

Family

ID=85023265

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/117140 WO2024050678A1 (en) 2022-09-06 2022-09-06 Low-power-consumption processing apparatus and method for providing image data to display, and device

Country Status (2)

Country Link
CN (1) CN115668099A (en)
WO (1) WO2024050678A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103310723A (en) * 2012-03-09 2013-09-18 乐金显示有限公司 Display device and method for controlling panel self refresh operation thereof
CN105096873A (en) * 2015-08-12 2015-11-25 京东方科技集团股份有限公司 Image display method and liquid crystal display
US20170034484A1 (en) * 2014-05-22 2017-02-02 Olympus Corporation Wireless endoscope system, endoscope, display device, image transmission method, image display method, and program
CN112750399A (en) * 2020-12-31 2021-05-04 上海天马有机发光显示技术有限公司 Display panel driving method and device, display device, equipment and storage medium

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103310723A (en) * 2012-03-09 2013-09-18 乐金显示有限公司 Display device and method for controlling panel self refresh operation thereof
US20170034484A1 (en) * 2014-05-22 2017-02-02 Olympus Corporation Wireless endoscope system, endoscope, display device, image transmission method, image display method, and program
CN105096873A (en) * 2015-08-12 2015-11-25 京东方科技集团股份有限公司 Image display method and liquid crystal display
CN112750399A (en) * 2020-12-31 2021-05-04 上海天马有机发光显示技术有限公司 Display panel driving method and device, display device, equipment and storage medium

Also Published As

Publication number Publication date
CN115668099A (en) 2023-01-31

Similar Documents

Publication Publication Date Title
US9293119B2 (en) Method and apparatus for optimizing display updates on an interactive display device
KR101217352B1 (en) Hybrid graphics display power management
TW201810220A (en) Low power consumption display device
KR20150057404A (en) Display driver ic, and operation method of system including the display driver ic
CN114741044B (en) Cross-operation environment display output sharing method based on heterogeneous rendering
US20100164964A1 (en) Display system with improved graphics abilities while switching graphics processing units
US20230073736A1 (en) Reduced display processing unit transfer time to compensate for delayed graphics processing unit render time
US12027087B2 (en) Smart compositor module
US6791538B2 (en) Method and system for operating a combination unified memory and graphics controller
KR100941029B1 (en) Graphic accelerator and graphic accelerating method
US10789913B2 (en) Arbitrary block rendering and display frame reconstruction
US20190310818A1 (en) Selective execution of warping for graphics processing
US20230074876A1 (en) Delaying dsi clock change based on frame update to provide smoother user interface experience
WO2022073182A1 (en) Methods and apparatus for display panel fps switching
WO2021056364A1 (en) Methods and apparatus to facilitate frame per second rate switching via touch event signals
WO2024050678A1 (en) Low-power-consumption processing apparatus and method for providing image data to display, and device
US20190303322A1 (en) Direct interrupt routing for display processing
WO2024145866A1 (en) Graphics processing method and system for quickly reading source data of primitive, and electronic device
US20200225728A1 (en) System and apparatus for improved display processing blinking operation
WO2023065100A1 (en) Power optimizations for sequential frame animation
WO2023230744A1 (en) Display driver thread run-time scheduling
WO2021168771A1 (en) Optimized method of page zeroing in memory pool
US20240169953A1 (en) Display processing unit (dpu) pixel rate based on display region of interest (roi) geometry
WO2023141917A1 (en) Sequential flexible display shape resolution
WO2024168655A1 (en) Ambient light adaptive pixel anti-aging frame-layer conditional compensation

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22957652

Country of ref document: EP

Kind code of ref document: A1