CN113329257A - Image display method and device, electronic equipment and readable storage medium - Google Patents

Image display method and device, electronic equipment and readable storage medium Download PDF

Info

Publication number
CN113329257A
CN113329257A CN202110546469.5A CN202110546469A CN113329257A CN 113329257 A CN113329257 A CN 113329257A CN 202110546469 A CN202110546469 A CN 202110546469A CN 113329257 A CN113329257 A CN 113329257A
Authority
CN
China
Prior art keywords
display
path
slices
different
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110546469.5A
Other languages
Chinese (zh)
Inventor
郑超
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN202110546469.5A priority Critical patent/CN113329257A/en
Publication of CN113329257A publication Critical patent/CN113329257A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/426Internal components of the client ; Characteristics thereof

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The application provides an image display method, an image display device, electronic equipment and a readable storage medium, wherein the method is applied to the electronic equipment comprising an SOC and a DDIC, a target image is divided into a plurality of slices on a first path corresponding to the SOC, and different slices are compressed by different compression modules to obtain at least two compressed images. And decompressing different compressed images by using different decompressing modules to obtain at least two decompressed images. And finally, combining the decompressed images and displaying the combined images through a display screen. By adopting the scheme, the display path comprises the plurality of compression modules and the plurality of decompression modules, so that the transmission of the whole target image is adjusted to the transmission of each slice, the bandwidth consumed by the transmission of the slices is smaller, the bandwidth consumption of the display path can be reduced, the power supply voltage of the display path is reduced, the power consumption of the display path can be reduced, the power consumption of the electronic equipment is further reduced, the phenomena of dead halt and the like caused by the heating of the electronic equipment are avoided, and the cruising ability and the quality of the electronic equipment are improved.

Description

Image display method and device, electronic equipment and readable storage medium
Technical Field
The present application relates to the field of image compression technologies, and in particular, to an image display method and apparatus, an electronic device, and a readable storage medium.
Background
At present, electronic devices are called objects that are unavailable in people's lives, people use the electronic devices to do shopping, entertainment, social contact, travel and the like, and functions such as image display, video playing and the like are called basic functions of the electronic devices.
When the electronic device displays an image, the image from a Graphics Processing Unit (GPU) is compressed and transmitted to a display screen, decompressed at the display screen end and displayed by the display screen. The path between the GPU and the display screen is referred to as the display path. The display path includes some modules, such as a display driver (display driver) module, a decompression module, etc.
In the image display process, the bandwidth of the display path is relatively large, which results in relatively high power consumption of the display path and further results in large power consumption of the electronic device.
Disclosure of Invention
The embodiment of the application discloses an image display method and device, electronic equipment and a readable storage medium, which are used for reducing the bandwidth and power consumption of a display channel and further reducing the power consumption of the electronic equipment in the image display process.
In a first aspect, an embodiment of the present application provides an image display method applied to an electronic device including a system on chip SOC and a display driver chip DDIC, where the method includes:
dividing a target image into at least two strip slices on a first path corresponding to the SOC;
compressing different slices of the at least two slices by using different compression modules on the first path to obtain at least two compressed images;
decompressing, by a different decompression module on the second path, a different compressed image of the at least two compressed images to obtain at least two decompressed images;
and combining the at least two decompressed images to obtain the target image and displaying the target image through the display screen.
In a second aspect, an embodiment of the present application provides an image display apparatus applied to an electronic device including a system on chip SOC and a display driver chip DDIC, the display apparatus including:
the processing unit is used for dividing the target image into at least two strip slices on a first path corresponding to the SOC;
the compression unit is used for compressing different slices in the at least two slices by using different compression modules on the first path to obtain at least two compressed images;
a decompression unit configured to decompress different compressed images of the at least two compressed images using different decompression modules on the second path to obtain at least two decompressed images;
a merging unit, configured to merge the at least two decompressed images to obtain the target image;
and the display unit is used for displaying the target image through the display screen.
In a third aspect, an embodiment of the present application provides an electronic device, including: a processor, a memory and a computer program stored on the memory and executable on the processor, the processor when executing the computer program causing the electronic device to carry out the method according to the first aspect or the various possible implementations of the first aspect.
In a fourth aspect, embodiments of the present application provide a computer-readable storage medium, in which computer instructions are stored, and when executed by a processor, the computer instructions cause the electronic device to implement the method according to the first aspect or various possible implementation manners of the first aspect.
In a fifth aspect, embodiments of the present application provide a computer program product comprising a computer program, which when executed by a processor, implements the method according to the first aspect or the various possible implementations of the first aspect.
The embodiment of the application provides an image display method, an image display device, electronic equipment and a readable storage medium, wherein the method is applied to the electronic equipment comprising an SOC and a DDIC, and comprises the following steps: and dividing the target image into a plurality of slices on a first path corresponding to the SOC, and compressing different slices by using different compression modules on the first path to obtain at least two compressed images. And decompressing different compressed images by using different decompressing modules on the second path to obtain at least two decompressed images. And finally combining at least two decompressed images to obtain the target image and displaying the target image through a display screen. By adopting the scheme, the display path comprises the plurality of compression modules and the plurality of decompression modules, so that the transmission of the whole target image is adjusted to the transmission of each slice, the bandwidth consumed by the transmission of the slices is relatively small, the bandwidth consumption of the display path can be reduced, the power supply voltage of the display path is reduced, the power consumption of the display path can be reduced, the power consumption of the electronic equipment is further reduced, the phenomena of dead halt and the like caused by the heating of the electronic equipment are avoided, and the cruising ability and the quality of the electronic equipment are improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
Fig. 1 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;
FIG. 2 is a schematic diagram of an implementation environment for an image display method provided by an embodiment of the present application;
FIG. 3 is a flowchart of an image display method provided by an embodiment of the present application;
FIG. 4 is a schematic diagram illustrating a process of compressing a stripe in an image display method according to an embodiment of the present application;
fig. 5A is a schematic diagram of a first path in an image display method according to an embodiment of the present application;
FIG. 5B is a diagram illustrating a second path in the image display method according to the embodiment of the disclosure;
fig. 6 is a schematic structural diagram of an image display device according to an embodiment of the present disclosure.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
It is to be noted that the terms "comprises" and "comprising" and any variations thereof in the examples and figures of the present application are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
Generally, a Graphics Processing Unit (GPU) of an electronic device is connected to a display screen through a display path, a display driver (display driver) module, a compression module, a decompression module, and the like are disposed on the display path, an image provided by an AP reaches the compression module through the display driver module, the compression module compresses the entire image and transmits the compressed image to the decompression module, and the decompression module decompresses the compressed image and displays the decompressed image on the display screen.
In the image display process, the bandwidth consumption of the display path is relatively high, and the frequency of some hardware modules, such as the compression module, on the compression path is relatively high, so that the power supply voltage required by the display path is relatively high, for example, the power supply voltage is about 0.65 volt (V). Meanwhile, the current ratio of the display path is high, and correspondingly, the power consumption of the display path is high, so that the electronic equipment is high in power consumption, poor in endurance and easy to generate heat.
Accordingly, embodiments of the present application provide an image display method, an image display apparatus, an electronic device, and a readable storage medium, which are used to reduce bandwidth and power consumption of a display path, further reduce power consumption of the electronic device during an image display process, and avoid heat generation of the electronic device while improving cruising ability of the electronic device.
The image display method provided by the embodiment of the application is applied to electronic equipment with a display screen, including but not limited to a mobile phone, a tablet computer, a sports camera, a smart watch, a smart bracelet, smart glasses, vehicle-mounted terminal equipment and the like. The electronic device may be a portable device, such as an electronic device with an IOS, Android, Microsoft, or other operating system. It should be understood that in other embodiments of the present application, the electronic device may not be a portable electronic device, but may be a desktop computer having a touch-sensitive surface (e.g., a touch panel).
Fig. 1 is a schematic structural diagram of an electronic device provided in an embodiment of the present application. Referring to fig. 1, an electronic device 100 includes: a Radio Frequency (RF) circuit 101, a memory 102, a display screen 103, a sensor 104, a wireless fidelity (WiFi) module 105, an audio circuit 106, a processor 107, a power supply 108, a Display Driver IC (DDIC) 109, and the like. Those skilled in the art will appreciate that the electronic device configuration shown in fig. 1 does not constitute a limitation of the electronic device and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
The following describes each component of the electronic device in detail with reference to fig. 1:
the RF circuit 101 may be used for receiving and transmitting information or signals during a call, and in particular, receives downlink information from a base station and gives it to the processor 107 for processing; in addition, the RF circuit 101 transmits uplink data to the base station. In general, the RF circuit 101 includes, but is not limited to, an antenna, at least one Amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, the RF circuitry 101 may also communicate with networks and other devices via wireless communications. The wireless communication may use any communication standard or protocol, including but not limited to Global System for Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), 5th generation (5G) Mobile communication System or New Radio (NR) communication System, and future Mobile communication System, e-mail, Short Message Service (SMS), and the like.
The memory 102 may be used to store software programs and modules, and the processor 107 executes various functional applications and data processing of the electronic device by operating the software programs and modules stored in the memory 102. The memory 102 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the electronic device, and the like. Further, the memory 102 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
The display screen 103, also referred to as a touch panel, the display screen 103 may comprise a touch sensitive surface or the like. Where a touch-sensitive surface (e.g., a touch panel) may capture touch events on or near the touch-sensitive surface of a user of the electronic device (e.g., user manipulation of a finger, stylus, etc. on or near the touch-sensitive surface using any suitable object) and transmit the captured touch information to another device, such as processor 107. Among them, a touch event of a user near a touch-sensitive surface may be referred to as a hover touch; hover touch may refer to a user not having to directly contact the touchpad in order to select, move, or drag a target (e.g., an icon, etc.), but rather only having to be located near the electronic device in order to perform a desired function. In the context of a hover touch application, the terms "touch," "contact," and the like do not imply a contact that is intended to directly contact the display screen, but rather a contact that is near or in proximity thereto. The touch-sensitive surface capable of performing floating touch can be realized by adopting capacitance, infrared light sensation, ultrasonic waves and the like. The touch sensitive surface may comprise two parts, a touch detection means and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, and sends the touch point coordinates to the processor 107, and the touch controller can also receive and execute instructions sent by the processor 107. In addition, touch sensitive surfaces may be implemented using various types of resistive, capacitive, infrared, and surface acoustic waves. The display screen 103 may be used to display information input by or provided to the user as well as various menus of the electronic device. The display screen 103 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The display screen 103 overlies the touch sensitive surface, and when the touch sensitive surface determines a touch event thereon or nearby, it is communicated to the processor 107 to determine the type of touch event, and the processor 107 may then provide a corresponding visual output on the display screen 103 according to the type of touch event. It will be appreciated that the display screen 103 is formed by stacking multiple layers of material, and that only the touch sensitive surface (layer) and the display screen (layer) are shown in this embodiment, and that other layers are not described in this embodiment. In some embodiments, the touch-sensitive surface is disposed on the front surface of the electronic device in a full-panel manner, and the display screen 103 may also be disposed on the front surface of the electronic device in a full-panel manner, so that a frameless structure can be implemented on the front surface of the electronic device.
The electronic device may also include at least one sensor 104, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor that adjusts the brightness of the display screen 103 according to the brightness of ambient light, and a proximity sensor that turns off the display screen 103 and/or the backlight when the electronic device is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally, three axes), detect the magnitude and direction of gravity when stationary, and can be used for applications (such as horizontal and vertical screen switching, related games, magnetometer attitude calibration) for recognizing the attitude of the electronic device, vibration recognition related functions (such as pedometer, tapping) and the like; as for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which may be further configured to the electronic device, detailed descriptions thereof are omitted.
Audio circuitry 106, speaker 1062, microphone 1061 may provide an audio interface between a user and an electronic device. The audio circuit 106 may transmit the electrical signal converted from the received audio data to the speaker 1062, and convert the electrical signal into a sound signal by the speaker 1062 and output the sound signal; on the other hand, the microphone 1061 converts the collected sound signals into electrical signals, which are received by the audio circuit 106 and converted into audio data, which are then processed by the audio data output processor 107, and then passed through the RF circuit 101 to be transmitted to, for example, another electronic device, or output to the memory 102 for further processing.
WiFi belongs to short-range wireless transmission technology, and the electronic device can help the user send and receive e-mail, browse web pages, access streaming media, etc. through the WiFi module 105, which provides wireless broadband internet access for the user. Although fig. 1 shows the WiFi module 105, it is understood that it does not belong to the essential constitution of the electronic device, and may be omitted entirely as needed within the scope not changing the essence of the invention.
The processor 107 is a control center of the electronic device, connects various parts of the entire electronic device by using various interfaces and lines, and performs various functions of the electronic device and processes data by running or executing software programs and/or modules stored in the memory 102 and calling data stored in the memory 102, thereby performing overall monitoring of the electronic device. Alternatively, processor 107 may include one or more processing units; preferably, the processor 107 may integrate an application processor, a Graphics Processing Unit (GPU), and a modem processor, wherein the application processor mainly processes an operating system, a user interface, an application program, and the like, and the modem processor mainly processes wireless communication. GPUs are used for processing of images or graphics, and are also known as display cores, visual processors, display chips. It will be appreciated that the modem processor described above may not be integrated into the processor 107.
The electronic device also includes a power supply 108 (e.g., a battery) for powering the various components, which may preferably be logically coupled to the processor 107 via a power management system to manage charging, discharging, and power consumption management functions via the power management system.
The DDIC109 is used for driving the display of the display screen 103, the display screen 103 and the processor 107 are connected through a display path, the display path includes a display driving module, a compression module, a decompression module, and the like, and the decompression module is disposed in the DDIC 109.
Although not shown, the electronic device may further include a camera, a bluetooth module, and the like, which are not described in detail herein.
The following embodiments may be implemented in an electronic device (e.g., an electronic device) having the hardware described above.
Fig. 2 is a schematic diagram of an implementation environment for an image display method provided in an embodiment of the present application. Referring to fig. 2, the implementation environment mainly relates to a System On Chip (SOC), a Display Driver IC (DDIC), a display, and the like of the electronic device. Referring to fig. 1, a portion above the dotted line is referred to as a platform end, which may also be referred to as an SOC end, where the SOC at least includes a processor above the dotted line, and optionally, the SOC may further include all or part of other devices above the dotted line except the processor. Since the embodiments of the present application mainly relate to image display, the processor is referred to as GPU unless otherwise specified below. The dotted line is hereinafter referred to as the display side, including the DDIC and the display.
The path between the processor on the platform side and the display screen on the display screen side is called a display path, and the display path comprises two parts: the display device comprises a first channel and a second channel, wherein the first channel is a channel corresponding to a platform end and comprises a processor, a display driver (display driver) module, a compression module and the like. The compression module may also be referred to as a compression path module, a display hardware module driver (DISP HW module Drivers), and the like, and the display driver module and the compression module may be a software module, a hardware module, or a module combining software and hardware, and the embodiment of the present application is not limited.
The second path is a path corresponding to the display screen end and comprises a DDIC, wherein a memory, a decompression module, a cache, a data path (data path) and the like are arranged in the DDIC. The Memory is, for example, a Static Random-Access Memory (SRAM). The cache is, for example, a line buffer (line buffer). The decompression module is, for example, a Video Electronics Standards Association (VESA) Display Stream Compression (DSC) module or the like.
Referring to fig. 2, the first path has a plurality of compression modules, and the second path has a plurality of decompression modules. After the processor outputs a target image, the target image is divided into a plurality of strips (slices), each Slice corresponds to one compression module and one decompression module, the compression modules corresponding to different slices are different, and the decompression modules corresponding to different slices are different. Therefore, each slice of the target image is compressed by different compression modules and decompressed by different decompression modules, the multiple compression modules work in parallel, and the multiple decompression modules work in parallel, so that the consumption of bandwidth on the display channel is reduced, the power supply voltage of the display channel is reduced, the power consumption of the display channel can be reduced, the power consumption of the electronic equipment is reduced, the phenomena of dead halt caused by the heating of the electronic equipment and the like are avoided, and the cruising ability and the quality of the electronic equipment are improved.
It can be understood that, an Application (APP) is installed on the electronic device, and some target image related information is generated in the running process of the APP, and the information reaches the processor after being coded and decoded. Therefore, in a broad sense, the display path according to the embodiment of the present application further includes a codec module.
The following describes the technical solutions of the present application and how to solve the above technical problems with specific embodiments. The following several specific embodiments may be combined with each other, and details of the same or similar concepts or processes may not be repeated in some embodiments. Embodiments of the present application will be described below with reference to the accompanying drawings.
Fig. 3 is a flowchart of an image display method according to an embodiment of the present application. The embodiment of the application is applied to electronic equipment, the electronic equipment comprises an SOC and a DDIC, and the embodiment comprises the following steps:
301. and dividing the target image into at least two strips slice on a first path corresponding to the SOC.
The target image is, for example, a desktop image, a photo stored in the electronic device, a wallpaper, etc., and may also be an image frame during the video playing process, etc. Slices are also referred to as intra slices, etc.
Referring to fig. 2, the first channel has a display driving module. The processor provides a complete target image, and the target image is divided into at least two slices by the display driving module after reaching the display driving module.
302. And compressing different slices of the at least two slices by using different compression modules on the first path to obtain at least two compressed images.
For example, referring to fig. 2, a plurality of compression modules are disposed on the first path, and different compression modules are used for compressing different slices. And each compression module compresses each slice to obtain at least two compressed images.
303. Different ones of the at least two compressed images are decompressed using different ones of the decompression modules on the second path to obtain at least two decompressed images.
For example, referring to fig. 2, a plurality of decompression modules are disposed on the second path, and different decompression modules are used for decompressing different compressed images.
304. And combining the at least two decompressed images to obtain the target image and displaying the target image through the display screen.
For example, after the electronic device decompresses the compressed image using different decompression modules on the second path to obtain decompressed images, each decompressed image is stored in the cache. And then the images are transmitted to a display screen through a data path, so that the images are combined into a target image and displayed on the display screen.
If only one compression module and one decompression module are arranged on the display path, the frequency of the compression module is high, so that the power supply voltage required by the display path is high. That is, when only one compression module and one decompression module are present in the display path, a large amount of power is required to carry the target image. In the embodiment of the application, the display path is provided with a plurality of compression modules and a plurality of decompression modules, which is equivalent to a plurality of sub-paths, each sub-path carries a respective slice, and the bandwidth ratio of each sub-path is low, so that the display path can be driven by a relatively low supply voltage. Therefore, power consumption can be saved. Further, since the respective sub-paths operate in parallel, the time cost is not increased.
The image display method provided by the embodiment of the application is applied to electronic equipment comprising an SOC and a DDIC, and comprises the following steps: and dividing the target image into a plurality of slices on a first path corresponding to the SOC, and compressing different slices by using different compression modules on the first path to obtain at least two compressed images. And decompressing different compressed images by using different decompressing modules on the second path to obtain at least two decompressed images. And finally combining at least two decompressed images to obtain the target image and displaying the target image through a display screen. By adopting the scheme, the display path comprises the plurality of compression modules and the plurality of decompression modules, so that the transmission of the whole target image is adjusted to the transmission of each slice, the bandwidth consumed by the transmission of the slices is relatively small, the bandwidth consumption of the display path can be reduced, the power supply voltage of the display path is reduced, the power consumption of the display path can be reduced, the power consumption of the electronic equipment is further reduced, the phenomena of dead halt and the like caused by the heating of the electronic equipment are avoided, and the cruising ability and the quality of the electronic equipment are improved.
Optionally, in the above embodiment, before the electronic device decompresses different compressed images of the at least two compressed images by using different decompression modules on the second path to obtain at least two decompressed images, the electronic device further sends the at least two compressed images to the memory on the second path corresponding to the DDIC, so that the memory stores the at least two compressed images.
For example, referring to fig. 2, a memory, such as an SRAM, is disposed on the second path. After each compression module on the first path compresses the slice to obtain at least two compressed images, each compressed image reaches the second path and is stored in the SRAM on the second path. And then, the decompression module on the second path reads the compressed image from the SRAM and decompresses the compressed image.
By adopting the scheme, the compression module is stored in the memory, so that the loss of the compressed image can be avoided, and the aim of ensuring the quality of the target image is fulfilled.
Optionally, in the above embodiment, when the electronic device compresses different slices of the at least two slices by using different compression modules on the first path to obtain at least two compressed images, for each Slice of the at least two slices, the Slice is compressed into a compressed image in the display serial interface DSI format by using a corresponding compression module.
Illustratively, a Display Serial Interface (DSI) defines a high-speed Serial Interface between a Processor and a Display screen, and conforms to a Mobile Industry Processor Interface (Mobile Industry Processor Interface) standard, and the electronic device compresses each slice into a compressed image in a DSI format by using a compression module so as to conform to the MIPI standard.
By adopting the scheme, the electronic equipment compresses the slice into a compressed image meeting the MIPI standard, and the universality is improved.
Optionally, in the above embodiment, different slices of the at least two slices correspond to different regions in the target image, and areas of any two slices of the at least two slices are equal.
For example, when the target image is a rectangular image, a horizontal center line and a vertical center line of the rectangle may be made, so as to divide the target image into 4 strips.
By adopting the scheme, the slice areas are equal in size, so that the compression modules can execute compression in parallel, the decompression modules execute decompression in parallel, and the complexity of the scheme is reduced.
Optionally, in the above embodiment, for each Slice of the at least two slices, when the electronic device compresses the Slice into a compressed image in a display serial interface DSI format by using the corresponding compression module, the corresponding compression module is used to perform a compression operation on the Slice, where the compression operation includes one or more of multi-layer composition, color conversion, gaussian blurring processing, and layer access; and converting the Slice after the compression operation into a compressed image in a DSI format. For example, please refer to fig. 4.
Fig. 4 is a schematic diagram illustrating a process of compressing a stripe in an image display method according to an embodiment of the present application. Referring to fig. 4, the electronic device compresses slice by using a compression module, where the compression operation includes one or more of multi-layer composition, color conversion, gaussian blurring processing, and layer access. These compression operations will be described separately below.
Multi-layer composition, also called overlay or Overlay (OVL), is equivalent to receiving an incoming slice, dividing the slice into multiple layers and merging.
Color conversion, also referred to as color conversion, is used to perform color conversion on each image.
Gaussian blurring, also known as gaussian smoothing, dither, etc., is used to reduce image noise and to reduce detail levels, etc.
Layer access, which mainly refers to direct memory access (RDMA), receives one layer at a time.
The DSI format conversion, DIS, is a serial interface applied to display technology, transmits pixel information or commands to peripheral devices in a serial manner, reads status information or pixel information from the peripheral devices, and enjoys its own independent communication protocol during transmission, including packet format and error correction and detection mechanism.
In fig. 4, solid arrows indicate the order of precedence, and dashed arrows indicate omitted operations. That is, in the implementation of the present application, in addition to the above-mentioned compression operation, other compression operations may also exist in the process of compressing slice by the compression module.
By adopting the scheme, the purpose of improving the compression quality is realized by performing one or more operations of multi-layer synthesis, color conversion, Gaussian blur processing and layer access on the strip.
In the foregoing embodiment, in the implementation environment shown in fig. 2, the power supply voltage of the display path is the first power supply voltage, and the power supply voltage when the display path only includes one compression module and one decompression module is referred to as the second power supply voltage, where the first power supply voltage is smaller than a preset value, and the preset value is determined according to the second power supply voltage. For example, taking the working frequency of the compression module in the display path as 60Hz for example, the second power supply voltage is 0.65V, and the current is 135 milliamperes (mA) for example. That is, when the display path includes only one compression module and one decompression module, the voltage required to drive the display path is 0.65V. The predetermined voltage is less than the second supply voltage, for example, 0.57V.
By adopting the scheme, when the display channel comprises the plurality of compression modules and the plurality of decompression modules, the power supply voltage of the whole display channel is lower, so that the power consumption of the electronic equipment can be saved, the phenomena of dead halt and the like caused by the heating of the electronic equipment are avoided, and the cruising ability of the electronic equipment is improved.
Optionally, in the above embodiment, after the electronic device merges the at least two decompressed images to obtain the target image and displays the target image on the display screen, the electronic device further updates the display of the display screen in response to an operation instruction received by the display screen.
For example, when the target image is a desktop image or a photograph, after the target image is displayed on the display screen, the user performs a click operation, a slide operation, or the like on the display screen to input an operation instruction. And after the electronic equipment identifies the operation instruction, updating the content displayed on the display screen. For example, the electronic device is a mobile phone, the target image is a desktop image, and the desktop image includes a "setting" icon, an icon of a map APP, an icon of a social APP, and the like. After the user slides left or optimizes, the display screen of the electronic device displays another desktop image, and the other desktop image comprises an icon of a shopping APP, an icon of a video playing APP, an icon of a binding APP of the wearable device bound with the electronic device and the like. The other desktop icon is also provided by the processor, is divided into a plurality of slices by the display driving module on the first display path, is decompressed by the corresponding compression module and decompression module through each slice, and is finally merged and displayed.
In addition, when the target image is an image frame in the video, the electronic device can automatically update the content displayed on the display screen without being triggered by a user. And after the next frame image is divided into a plurality of slices by the display driving module on the first display path, the next frame image is compressed by the corresponding compression module and decompressed by the decompression module through each slice, and finally the next frame image is combined and displayed.
By adopting the scheme, the electronic equipment updates the display content of the display screen according to the user operation, so that the display screen can display rich information.
The following describes in detail the image display method according to the embodiment of the present application, taking the example that the display driving module on the first channel divides the target image into two slices. For example, please refer to fig. 5A and 5B.
Fig. 5A is a schematic diagram of a first path in an image display method according to an embodiment of the present application. Referring to fig. 5A, the processor provides a complete target image, such as a desktop image. When the target image is transmitted on the display path, the target image is divided into two slices by the display driving module on the first path. For example, the target image is divided into two parts in the vertical direction, the left half is sent to the compression module 1, and the right half is sent to the compression module 2. The compression module 1 performs multi-layer synthesis, color conversion, gaussian blur processing, layer access and the like on the left half partial image to obtain a left half partial compressed image. Similarly, the compression module 2 also performs compression operation on the right half image to obtain a right half compressed image. The left half compressed image and the right half compressed image are compressed images in the DSI format. And then, the two compressed images are respectively sent to a second path through the DSI of the MIPI, and are finally displayed by a display screen after being decompressed and the like in the second path.
Fig. 5B is a schematic diagram of a second path in the image display method according to the embodiment of the present application. Referring to fig. 5B, the second path includes two decompression modules, such as VESA DSC1 and VESA DSC 2. The left and right half compressed images are first stored in the SRAM after reaching the second path. Then, VESA DSC1 reads the left half compressed image from SRAM and decompresses, resulting in a left half decompressed image. The VESA DSC2 reads and decompresses the right half-compressed image from the SRAM, resulting in a right half-compressed image. The two decompressed images are cached in a line buffer (line buffer), and after being merged into a target image through a data path (data path), the target image is displayed on a display screen.
As can be seen from fig. 5A and 5B: by dividing the target image into two slices, different slices correspond to different compression modules and decompression modules, the bandwidth of the display channel can be reduced, the frequency of the compression modules on the first channel is reduced, the power supply voltage of the display channel is reduced, the power consumption of the platform end is reduced, and the power consumption of the electronic equipment is reduced.
In the above embodiment, when the display channel includes a compression module and a decompression module, the display channel is also referred to as a 1DSC display channel, which is abbreviated as 1 DSC. When the display path includes two compression modules and two decompression modules, the display path is also called a 2DSC display path, 2DSC for short. Next, the currents and the like of the two display paths will be described. For exemplary purposes, see table 1. Table 1 is a current comparison table of a 1DSC scheme and a 2DSC scheme when the refresh frequency of the display screen of the electronic device is 60Hz/90 Hz.
TABLE 1
1DSC,60Hz 2DSC,60Hz 1DSC,90Hz 2DSC,90Hz
12.4mA 11.6mA 20mA 19.7mA
Referring to table 1, the resolution (resolution) of the display screen is 1200 × 2640, and when the 1DSC scheme is adopted, if the refresh frequency of the display screen of the electronic device is 60Hz, the power consumption of the battery is about 12.4 mA. If the refresh frequency of the display screen of the electronic equipment is 90Hz, the power consumption of the battery is 20 mA.
By adopting the DSC scheme of the application 2, if the refresh frequency of the display screen of the electronic equipment is 60Hz, the power consumption of the battery is about 11.6 mA. If the refresh frequency of the display screen of the electronic equipment is 90Hz, the power consumption of the battery is 19.7 mA.
Clearly, the 2DSC scheme consumes less power than the 1DSC scheme for the same resolution. That is, with the 2DSC scheme, the platform-side power consumption (power) gain is significant.
Table 1 is a current comparison table of a 1DSC scheme and a 2DSC scheme when the refresh frequency of the display screen of the electronic device is 60Hz/120 Hz.
TABLE 2
Figure BDA0003073855690000151
Referring to table 2, assuming that a 4V battery is installed on the electronic device, when the 1DSC scheme is adopted, if the refresh frequency of the display screen is 60Hz and the power supply voltage is 0.65V, the power consumption of the display channel is 135 mA. If the refresh frequency of the display screen is 120Hz and the power supply voltage is 0.65V, the power consumption of the display channel is 170 mA.
Assuming that a 4V battery is installed on the electronic equipment, when a 2DSC scheme is adopted, if the refresh frequency of the display screen is 60Hz and the power supply voltage is 0.575V, the power consumption of the display channel is 120 mA. If the refresh frequency of the display screen is 120Hz and the power supply voltage is 0.575V, the power consumption of the display channel is 150 mA.
Clearly, at the same refresh frequency, the 2DSC scheme can save 15-20mA of power consumption compared to the 1DSC scheme. That is, the bandwidth consumption of the display path is reduced, and the frequency of the platform-side compression module is reduced, so that a lower supply voltage can be used to supply power to the display path, thereby achieving better power consumption benefits. The power supply voltage is also referred to as Vcore, etc.
The following are embodiments of the apparatus of the present application that may be used to perform embodiments of the method of the present application. For details which are not disclosed in the embodiments of the apparatus of the present application, reference is made to the embodiments of the method of the present application.
Fig. 6 is a schematic structural diagram of an image display device according to an embodiment of the present disclosure. The image display apparatus 600 is applied to an electronic device including a system on chip SOC and a display driving chip DDIC, the image display apparatus 600 including: a processing unit 61, a compression unit 62, a decompression unit 63, a merging unit 64, and a display unit 65.
The processing unit 61 is configured to divide the target image into at least two stripe slices on the first path corresponding to the SOC;
a compressing unit 62, configured to compress different slices of the at least two slices by using different compression modules on the first path to obtain at least two compressed images;
a decompression unit 63, configured to decompress different compressed images of the at least two compressed images by using different decompression modules on the second path to obtain at least two decompressed images;
a merging unit 64, configured to merge the at least two decompressed images to obtain the target image;
a display unit 65, configured to display the target image through the display screen.
In a possible implementation manner, the compressing unit 62 is configured to, for each Slice of the at least two slices, compress the Slice into a compressed image in a display serial interface DSI format by using a corresponding compression module.
In a possible implementation manner, the compressing unit 62 is configured to, for each Slice of the at least two slices, perform a compression operation on the Slice by using a corresponding compression module, where the compression operation includes one or more of multi-layer composition, color conversion, gaussian blurring processing, and layer access; and converting the Slice after the compression operation into a compressed image in a DSI format.
In a feasible implementation manner, different slices of the at least two slices correspond to different regions in the target image, and areas of any two slices of the at least two slices are equal.
In a possible implementation manner, the first supply voltage of the display path is smaller than a preset value, the preset value is determined according to a second supply voltage of the display path between the AP and the display screen, and the second supply voltage is a supply voltage when the display path includes a compression module and a decompression module.
In a possible implementation manner, the compressing unit 62 sends the at least two compressed images to the memory on the second path corresponding to the DDIC before the decompressing unit 63 decompresses different compressed images of the at least two compressed images by using different decompressing modules on the second path to obtain at least two decompressed images, so that the memory stores the at least two compressed images.
In a possible implementation manner, the processing unit 61 is further configured to update the display of the display screen in response to an operation instruction received by the display screen after the merging unit 64 merges the at least two decompressed images to obtain the target image and the display unit 65 displays the merging unit 64.
The image display device provided in the embodiment of the present application can execute the actions of the electronic device in the above embodiments, and the implementation principle and the technical effect are similar, which are not described herein again.
An embodiment of the present application further provides an electronic device, which includes a processor, a memory, and a computer program stored in the memory and executable on the processor, and when the processor executes the computer program, the electronic device is enabled to implement the image display method as described above.
Embodiments of the present application also provide a computer-readable storage medium, in which computer instructions are stored, and the computer instructions are executed by a processor to implement the method applied to the electronic device.
Embodiments of the present application also provide a computer program product, which contains a computer program, and when the computer program is executed by a processor, the method applied to an electronic device is implemented.
Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.
It will be understood that the present application is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the application is limited only by the appended claims.

Claims (10)

1. An image display method applied to an electronic device including a System On Chip (SOC) and a display driver chip (DDIC), the method comprising:
dividing a target image into at least two strip slices on a first path corresponding to the SOC;
compressing different slices of the at least two slices by using different compression modules on the first path to obtain at least two compressed images;
decompressing, by a different decompression module on the second path, a different compressed image of the at least two compressed images to obtain at least two decompressed images;
and combining the at least two decompressed images to obtain the target image and displaying the target image through the display screen.
2. The method of claim 1, wherein said compressing different slices of said at least two slices with different compression modules on said first path to obtain at least two compressed images comprises:
for each Slice of the at least two slices, compressing the Slice into a compressed image in a Display Serial Interface (DSI) format by using a corresponding compression module.
3. The method of claim 2, wherein for each Slice of the at least two slices, compressing the Slice into a compressed image in a Display Serial Interface (DSI) format using a corresponding compression module comprises:
for each Slice of the at least two slices, utilizing a corresponding compression module to perform compression operation on the Slice, wherein the compression operation comprises one or more of multi-layer composition, color conversion, Gaussian blur processing and layer access;
and converting the Slice after the compression operation into a compressed image in a DSI format.
4. The method according to any one of claims 1 to 3, wherein different slices of the at least two slices correspond to different regions in the target image, and any two slices of the at least two slices have equal areas.
5. The method according to any one of claims 1 to 3,
and the first power supply voltage of the display path is smaller than a preset value, the preset value is determined according to a second power supply voltage of the display path between the AP and the display screen, and the second power supply voltage is the power supply voltage when the display path comprises a compression module and a decompression module.
6. The method of any of claims 1-3, wherein before decompressing, with a different decompression module on the second path, a different compressed image of the at least two compressed images to obtain at least two decompressed images, further comprising:
and sending the at least two compressed images to a memory on a second path corresponding to the DDIC, so that the memory stores the at least two compressed images.
7. The method according to any one of claims 1-3, wherein said merging said at least two decompressed images to obtain said target image and displaying said target image on said display screen further comprises:
and updating the display of the display screen in response to the operation instruction received by the display screen.
8. An image display apparatus applied to an electronic device including a System On Chip (SOC) and a display driver chip (DDIC), comprising:
the processing unit is used for dividing the target image into at least two strip slices on a first path corresponding to the SOC;
the compression unit is used for compressing different slices in the at least two slices by using different compression modules on the first path to obtain at least two compressed images;
a decompression unit configured to decompress different compressed images of the at least two compressed images using different decompression modules on the second path to obtain at least two decompressed images;
a merging unit, configured to merge the at least two decompressed images to obtain the target image;
and the display unit is used for displaying the target image through the display screen.
9. An electronic device comprising a processor, a memory, and a computer program stored on the memory and executable on the processor, wherein execution of the computer program by the processor causes the electronic device to perform the method of any of claims 1-7.
10. A computer-readable storage medium having stored therein computer instructions for implementing the method of any one of claims 1-7 when executed by a processor.
CN202110546469.5A 2021-05-19 2021-05-19 Image display method and device, electronic equipment and readable storage medium Pending CN113329257A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110546469.5A CN113329257A (en) 2021-05-19 2021-05-19 Image display method and device, electronic equipment and readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110546469.5A CN113329257A (en) 2021-05-19 2021-05-19 Image display method and device, electronic equipment and readable storage medium

Publications (1)

Publication Number Publication Date
CN113329257A true CN113329257A (en) 2021-08-31

Family

ID=77416155

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110546469.5A Pending CN113329257A (en) 2021-05-19 2021-05-19 Image display method and device, electronic equipment and readable storage medium

Country Status (1)

Country Link
CN (1) CN113329257A (en)

Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060023955A1 (en) * 2004-07-30 2006-02-02 Akihiro Namera Image data processing circuit and image processing apparatus including the same
CN101039417A (en) * 2007-04-26 2007-09-19 广东威创日新电子有限公司 Multi-block parallel compression video data apparatus and compression method thereof
JP2008103923A (en) * 2006-10-18 2008-05-01 Olympus Corp Image processor, and imaging apparatus
US20120299967A1 (en) * 2011-05-23 2012-11-29 Canon Kabushiki Kaisha Image output apparatus, control method for image output apparatus, and program
CN103916668A (en) * 2013-01-04 2014-07-09 云联(北京)信息技术有限公司 Image processing method and system
CN103997648A (en) * 2014-06-11 2014-08-20 中国科学院自动化研究所 System and method for achieving decompression of JPEG2000 standard images rapidly based on DSPs
US20180137598A1 (en) * 2016-11-14 2018-05-17 Google Inc. Early sub-pixel rendering
CN110324598A (en) * 2018-03-30 2019-10-11 武汉斗鱼网络科技有限公司 A kind of image processing method, device and computer equipment
US20190384559A1 (en) * 2018-06-14 2019-12-19 Samsung Electronics Co., Ltd. Electronic apparatus and method for controlling thereof
CN110944194A (en) * 2018-09-21 2020-03-31 苹果公司 System and method for switching display links back and forth
CN111061449A (en) * 2019-12-10 2020-04-24 Oppo广东移动通信有限公司 Data processing method and related product
CN111556322A (en) * 2020-06-01 2020-08-18 哈尔滨理工大学 FPGA-based rapid image compression and transmission system
WO2020169026A1 (en) * 2019-02-23 2020-08-27 华为技术有限公司 Method for displaying image in system of multiple display driving circuits, and electronic device
WO2020191516A1 (en) * 2019-03-22 2020-10-01 华为技术有限公司 Image data processing apparatus and method

Patent Citations (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060023955A1 (en) * 2004-07-30 2006-02-02 Akihiro Namera Image data processing circuit and image processing apparatus including the same
JP2008103923A (en) * 2006-10-18 2008-05-01 Olympus Corp Image processor, and imaging apparatus
CN101039417A (en) * 2007-04-26 2007-09-19 广东威创日新电子有限公司 Multi-block parallel compression video data apparatus and compression method thereof
US20120299967A1 (en) * 2011-05-23 2012-11-29 Canon Kabushiki Kaisha Image output apparatus, control method for image output apparatus, and program
CN103916668A (en) * 2013-01-04 2014-07-09 云联(北京)信息技术有限公司 Image processing method and system
CN103997648A (en) * 2014-06-11 2014-08-20 中国科学院自动化研究所 System and method for achieving decompression of JPEG2000 standard images rapidly based on DSPs
US20180137598A1 (en) * 2016-11-14 2018-05-17 Google Inc. Early sub-pixel rendering
CN110324598A (en) * 2018-03-30 2019-10-11 武汉斗鱼网络科技有限公司 A kind of image processing method, device and computer equipment
US20190384559A1 (en) * 2018-06-14 2019-12-19 Samsung Electronics Co., Ltd. Electronic apparatus and method for controlling thereof
CN110944194A (en) * 2018-09-21 2020-03-31 苹果公司 System and method for switching display links back and forth
WO2020169026A1 (en) * 2019-02-23 2020-08-27 华为技术有限公司 Method for displaying image in system of multiple display driving circuits, and electronic device
WO2020191516A1 (en) * 2019-03-22 2020-10-01 华为技术有限公司 Image data processing apparatus and method
CN111061449A (en) * 2019-12-10 2020-04-24 Oppo广东移动通信有限公司 Data processing method and related product
CN111556322A (en) * 2020-06-01 2020-08-18 哈尔滨理工大学 FPGA-based rapid image compression and transmission system

Similar Documents

Publication Publication Date Title
US11361734B2 (en) Display driving method and electronic device including the display driver integrated circuit for supporting the same
US11847992B2 (en) Control method based on vertical synchronization signal and electronic device
CN109218731B (en) Screen projection method, device and system of mobile equipment
CN108287744B (en) Character display method, device and storage medium
WO2018161534A1 (en) Image display method, dual screen terminal and computer readable non-volatile storage medium
TWI546775B (en) Image processing method and device
CN111611031A (en) Graph drawing method and electronic equipment
US11838438B2 (en) Message viewing method and terminal
US11294533B2 (en) Method and terminal for displaying 2D application in VR device
CN111313915B (en) Electronic equipment
CN109948581B (en) Image-text rendering method, device, equipment and readable storage medium
CN109348019B (en) Display method and device
CN111092621A (en) Radio frequency circuit, control method and electronic equipment
CN108845785B (en) Display method and terminal
CN110990172A (en) Application sharing method, first electronic device and computer-readable storage medium
CN104007887A (en) Floating layer display method and terminal
CN111158815B (en) Dynamic wallpaper blurring method, terminal and computer readable storage medium
CN110795021B (en) Information display method and device and electronic equipment
CN109636715B (en) Image data transmission method, device and storage medium
CN109698711B (en) Radio frequency module and terminal equipment
CN111275607B (en) Interface display method and device, computer equipment and storage medium
US20230315148A1 (en) Interface Display Method and Electronic Device
CN109391739B (en) Mobile terminal and communication method
KR20160031286A (en) Apparatus and Method for processing display data in electronic device
CN108920086B (en) Split screen quitting method and device, storage medium and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination