CN114449231A

CN114449231A - Image conversion method and device

Info

Publication number: CN114449231A
Application number: CN202011197524.6A
Authority: CN
Inventors: 钟辉; 王利飞
Original assignee: Honor Device Co Ltd
Current assignee: Honor Device Co Ltd
Priority date: 2020-10-31
Filing date: 2020-10-31
Publication date: 2022-05-06
Anticipated expiration: 2040-10-31
Also published as: CN114449231B

Abstract

The application provides an image conversion method and equipment, in the method, according to the characteristic information of an RGB image to be displayed, a target conversion mode corresponding to the RGB image is selected from a plurality of conversion modes, and the RGB image is converted according to the target conversion mode to obtain a red, green, blue and white (RGBW) image. Wherein, the conversion parameters corresponding to different conversion modes are different, and the corresponding image conversion effects are also different. Therefore, the method can realize format conversion of different RGB images by adopting different conversion modes, and can flexibly select the conversion mode correspondingly adopted by the RGB images to improve the image display effect or reduce the display power consumption.

Description

Image conversion method and device

Technical Field

The present application relates to the field of electronic devices, and in particular, to an image conversion method and device.

Background

The electronic equipment adopts RGBW four-channel sub-pixel arrangement display screen based on Red-Green-Blue-White (RGBW) color space, namely White (White, W) channel sub-pixels are added on the basis of adopting RGB three-channel sub-pixel arrangement mode based on Red-Green-Blue (RGB) color space, the light transmittance of the display screen can be greatly improved, and the maximum brightness of the display screen can be greatly improved. Therefore, when the electronic equipment displays a picture in the display screen, the RGB three-channel image is converted into the RGBW four-channel image and then displayed, and the problem that the display content on the display screen cannot be seen clearly due to insufficient brightness of the display screen under strong light can be solved.

The human eye typically has different sensitivities to different color sub-pixels in RGB colors, for example, the human eye has a sensitivity of 20% to the R pixel, 70% to the G pixel, and 10% to the B pixel. Therefore, when the electronic equipment performs image conversion, the R pixel and the B pixel which are not sensitive to human eyes in the RGB three-channel image can be subjected to proportion reduction, or the B pixel is subjected to proportion reduction, and the reduced pixels are replaced by the W pixel, so that the RGBW four-channel image is obtained. However, replacing some B pixels or some B pixels and R pixels with W pixels may cause jaggy shapes of images in which the reduced B pixels or the reduced B pixels and R pixels are arranged, affecting definition.

At present, when an electronic device converts an RGB image into an RGBW image, the image to be displayed is converted by using the same conversion method, and reduction ratios of R pixels and B pixels in all images or reduction ratios of B pixels are the same, which easily causes the converted image to have an obvious sawtooth shape. In order to reduce the jaggies in the converted image, the jaggies in the image displayed in a part of scenes can be improved only by performing corresponding adjustment according to the design of different conversion algorithms. In addition, when some smooth frame interpolation methods are adopted, in order to reduce jaggies, a plurality of sub-pixels of the screen panel are usually lighted up to a certain brightness, and the display power consumption of the display screen is also increased.

Therefore, the existing electronic equipment can only adopt a preset method to convert the RGB image into the RGBW image, and the conversion mode is single, so that the display effect of the converted image is poor or the display power consumption is large.

Disclosure of Invention

The application provides an image conversion method and device, which are used for solving the problems of poor image display effect or high display power consumption after conversion caused by single image conversion mode.

In a first aspect, an embodiment of the present application provides an image conversion method, where the method includes:

acquiring a red, green and blue (RGB) image to be displayed, and determining characteristic information of the RGB image, wherein the characteristic information is used for representing application characteristics of an application to which the RGB image belongs and/or color distribution characteristics of the RGB image, and the RGB image is a frame picture to be displayed in the running process of the application;

selecting a target conversion mode from a plurality of conversion modes according to the characteristic information, wherein the conversion parameters corresponding to different conversion modes are different;

and converting the RGB image according to the target conversion mode to obtain a red, green, blue and white RGBW image.

According to the method, the corresponding conversion mode is selected from a plurality of conversion modes according to the characteristic information of the RGB image to be displayed, the RGB image is converted to obtain the corresponding RGBW image, format conversion can be carried out on different RGB images in different conversion modes, and the conversion mode adopted by the RGB image can be flexibly selected. The conversion parameters corresponding to different conversion modes are different, and the corresponding display effect and power consumption after conversion are also different, so that the RGB image can be converted by flexibly selecting the corresponding conversion modes, and the requirements of improving the image display effect or reducing the display power consumption are met.

In one possible design, the characteristic information includes at least one of:

identification information of the application; and the pixel number information is used for indicating the number of pixels contained in the color boundary region in the RGB image.

Through the design, the target conversion mode corresponding to the RGB image can be selected in various different modes by determining the characteristic information of various different types of the RGB image, and the flexibility of conversion mode selection is further improved.

In one possible design, the quantity information includes at least one of:

the number of pixel points included in the color boundary region; and the ratio of the number of the pixel points contained in the color boundary area to the number of the pixel points contained in the RGB image.

Through the design, different forms of data used for indicating the same characteristic of the RGB image can be acquired, and diversified representation of characteristic information is achieved.

In one possible design, before selecting a target transition mode among the plurality of transition modes based on the characteristic information, the method further includes:

determining that the identification information of the application to which the RGB image belongs is contained in a preset application identification set, wherein the application identification set contains a preset identification of at least one application needing conversion mode matching; and/or

Determining that a color boundary region exists in the RGB image; and/or

And determining that the number of the pixel points indicated by the pixel point number information exceeds a set threshold value.

In the design, before a target conversion mode is selected from a plurality of conversion modes, conversion mode matching is required to be carried out on the RGB image determined by the different methods, so that conversion mode matching can be selectively carried out on the RGB image to be displayed, and the flexibility of image conversion is improved.

and determining the plurality of conversion modes according to the characteristic information.

Through the design, a plurality of different conversion modes can be set according to the characteristic information of the RGB image for selection.

In one possible design, selecting a target transition mode among a plurality of transition modes based on the characteristic information includes:

and determining the target conversion mode corresponding to the characteristic information in the plurality of conversion modes according to the corresponding relation between the preset characteristic information and the conversion modes.

Through the design, the conversion mode adopted by the RGB image can be quickly selected according to the characteristic information of the RGB image.

In a possible design, when the feature information is the pixel number information, the correspondence between the feature information and the conversion mode includes:

the information of the number of the indicated pixels exceeding a preset threshold corresponds to a first conversion mode, and the information of the number of the indicated pixels not exceeding the preset threshold corresponds to a second conversion mode;

and the brightness of the pixel points in the RGBW image obtained by conversion according to the first conversion mode is smaller than the brightness of the pixel points in the RGBW image obtained by conversion according to the second conversion mode.

In the design, a scheme of selecting a target conversion mode from two conversion modes according to pixel point quantity information representing RGB image color distribution characteristics is provided, when a color boundary area of a sawtooth shape after conversion is easy to appear in an RGB image is large, a first conversion mode with a relatively good sawtooth shape improvement effect is selected, and conversely, a second conversion mode with relatively low power consumption is selected, so that the display effect of the converted image can be improved or the display power consumption of the image can be reduced.

In one possible design, the color interface region is a blue and white color interface region.

In one possible design, the color boundary region is a region of a predetermined size including a color boundary line at a different color boundary, or a region corresponding to at least one pixel point on one side or both sides of the color boundary line.

In one possible design, converting the RGB image according to the target conversion mode includes:

and converting pixel points of partial or all areas of the RGB image according to the target conversion mode, wherein the partial areas of the RGB image are color boundary areas in the RGB image.

Through the design, when the image is converted, the image area which is converted by adopting the conversion mode matched with the conversion modes in the multiple conversion modes can be flexibly selected, and the flexibility of image conversion is improved.

In a second aspect, an embodiment of the present application provides an electronic device, including:

the image analysis unit is used for acquiring a red, green and blue (RGB) image to be displayed and determining characteristic information of the RGB image, wherein the characteristic information is used for representing application characteristics of an application to which the RGB image belongs and/or color distribution characteristics of the RGB image, and the RGB image is a frame image which needs to be displayed in the running process of the application;

the mode matching unit is used for selecting a target conversion mode from a plurality of conversion modes according to the characteristic information, wherein the conversion parameters corresponding to different conversion modes are different;

and the image conversion unit is used for converting the RGB image according to the target conversion mode to obtain a red, green, blue and white RGBW image.

In one possible design, the quantity information includes at least one of:

In one possible design, before selecting the target conversion mode among the plurality of conversion modes according to the feature information, the mode matching unit is further configured to:

Determining that a color boundary region exists in the RGB image; and/or

In one possible design, when a target conversion mode is selected from among a plurality of conversion modes based on the feature information, the mode matching unit is configured to:

In one possible design, in the case that the feature information is the information on the number of pixels:

if the number of the pixel points indicated by the pixel point number information exceeds a set threshold, the target conversion mode corresponding to the characteristic information is a first conversion mode;

if the number of the pixel points indicated by the pixel point number information does not exceed the set threshold, the target conversion mode corresponding to the characteristic information is a second conversion mode;

In one possible design, when the RGB image is converted according to the target conversion mode, the image conversion unit is configured to:

In a third aspect, an embodiment of the present application provides an electronic device, which includes a memory and one or more processors;

wherein the memory is to store computer program code comprising computer instructions; the instructions, when executed by the one or more processors, enable the electronic device to perform the method as described above in the first aspect or any possible design of the first aspect.

In a fourth aspect, an embodiment of the present application provides a chip, where the chip is coupled with a memory in an electronic device, so that the chip invokes a computer program stored in the memory when running, so as to implement the method according to the first aspect or any one of the possible designs provided by the first aspect of the present application.

In a fifth aspect, embodiments of the present application provide a computer storage medium storing a computer program, which, when run on an electronic device, causes the electronic device to perform the method of the first aspect or any one of the possible designs of the first aspect.

In a sixth aspect, embodiments of the present application provide a computer program product, which, when run on an electronic device, causes the electronic device to perform the method of the first aspect or any one of the possible designs of the first aspect.

Drawings

Fig. 1 is a schematic diagram of color space conversion provided in an embodiment of the present application;

FIG. 2 is a schematic diagram of an HIS color space provided by an embodiment of the present application;

fig. 3 is a schematic diagram of a display screen in an RGBW format according to an embodiment of the present disclosure;

fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure;

fig. 5 is a schematic diagram of a pixel arrangement of a full white frame in an RGB color space according to an embodiment of the present disclosure;

fig. 6 is a schematic diagram of a pixel arrangement of a full white frame in an RGBW color space according to an embodiment of the present application;

fig. 7 is a schematic diagram of a pixel arrangement of a blue-white color boundary picture in an RGBW color space according to an embodiment of the present disclosure;

fig. 8 is a schematic diagram of an image conversion method according to an embodiment of the present application;

fig. 9 is a schematic diagram of a pixel arrangement of a blue-white color boundary picture in an RGB color space according to an embodiment of the present disclosure;

fig. 10 is a schematic diagram of a pixel arrangement of a blue-white color boundary picture in an RGBW color space according to an embodiment of the present disclosure;

fig. 11 is a schematic diagram of a pixel arrangement of a blue-white color boundary picture in an RGBW color space according to an embodiment of the present disclosure;

fig. 12 is a schematic flowchart of an image conversion method according to an embodiment of the present application;

FIG. 13 is a schematic diagram illustrating a method for displaying consecutive frame images according to an embodiment of the present disclosure;

fig. 14 is a schematic diagram of an electronic device according to an embodiment of the present application;

fig. 15 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the embodiments of the present application will be described in further detail with reference to the accompanying drawings. In the description of the embodiments of the present application, the terms "first" and "second" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implying any number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature.

For ease of understanding, an explanation of concepts related to the present application is given by way of example for reference, as follows:

an electronic device is a device which has a display screen and can realize a color picture display function. In some embodiments of the present application, the electronic device may be a portable terminal device, such as a mobile phone, a tablet computer, a wearable device with a color screen display function (e.g., a watch, etc.), an in-vehicle terminal device, an Augmented Reality (AR)/Virtual Reality (VR) device, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a Personal Digital Assistant (PDA), a smart home device (e.g., a smart television, etc.), and the like.

In some embodiments of the present application, the electronic device may also be a portable terminal device that also includes other functions, such as a personal digital assistant and/or a color picture display function. Exemplary embodiments of the portable terminal device include, but are not limited to, a mount

Or other operating system. The above-described portable terminal device may also be other portable terminal devices such as a Laptop computer (Laptop) with a display screen, and the like. It should also be understood that in some other embodiments of the present application, the electronic device may not be a portable terminal device, but may be a desktop computer having a display screen capable of displaying color pictures.

It should be understood that "at least one" in the embodiments of the present application means one or more, "a plurality" means two or more. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a alone, both A and B, and B alone, where A, B may be singular or plural. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship. "at least one of the following" or similar expressions refer to any combination of these items, including any combination of the singular or plural items. For example, at least one (one) of a, b, or c, may represent: a, b, c, a and b, a and c, b and c, or a, b and c, wherein a, b and c can be single or multiple.

Referring to fig. 1, a schematic diagram of color space conversion according to an embodiment of the present invention is shown. As shown in the figure, the maximum brightness of the display screen can be improved by the display screen with RGBW four-channel sub-pixel arrangement, wherein the principle is to insert some W pixels into three color pixels of the RGB color space shown in the figure, that is, the W white pixel is added to the original RGB three primary colors to become an RGBW four-color type pixel, so that the brightness of the whole display screen is increased by the W pixel.

Hue-Saturation-Intensity (HIS) color space describes a color by Hue, Saturation, and lightness. Fig. 2 is a schematic diagram of the HIS color space. In the HIS color space, H defines the frequency of the color, called hue; s represents the shade degree of the color, called saturation; i denotes intensity or brightness. In the double hexagonal pyramid representation of the HSI color model, I is the intensity axis, and the hue H has an angular range of [0,2 π ] or [0, π ], where the angle for pure red is 0, the angle for pure green is 2 π/3, and the angle for pure blue is 4 π/3.

In the RGB color space, when a W pixel is inserted into sub-pixels of three colors of a pixel point, the corresponding brightness information is determined by converting pixel data of the pixel point in the RGB color space into pixel data in the HIS color space, and then the brightness information is displayed by utilizing the W pixel. Wherein, pixel data of the RGB color space is converted into HIS color space data according to the following formula:

r, G, B represents the red sub-pixel value, the green sub-pixel value, and the blue sub-pixel value of the pixel point, θ represents the converted hue value, with the value range of [0,2 π ], H represents the hue value after the conversion of θ into the value range of [0, π ], S represents the converted saturation, and I represents the converted intensity (brightness).

In the existing method for converting an RGB image into an RGBW image, a corresponding RGBW image is obtained by reducing B color pixels (or B color pixels and R color pixels) in the RGB image, which are relatively insensitive to human eyes, in some proportion and replacing the reduced pixels with W pixels. However, the W pixels obtained by this method are replaced, and the image in which the reduced pixels are arranged is jagged. For example, as shown in fig. 3, a B pixel in an RGB image is reduced in proportion, and a W sub-pixel is replaced by a B sub-pixel, so that in an RGBW image, due to some B sub-pixels being lost, a zigzag shape appears at a picture boundary between a blue part and a white part, which causes the definition of a display picture to be affected, and the visual effect is poor. In addition, when the RGB image is converted into the RGBW image at present, a predetermined fixed conversion mode is usually adopted for the same display screen, and the requirement for the image display effect when the converted image is displayed for different images may not be met.

In view of this, the present application provides an image conversion method for converting an RGB image into an RGBW image according to RGB image characteristics, thereby improving screen display luminance when displaying the image, and improving screen display effect or reducing power consumption.

Referring to fig. 4, a structure of an electronic device to which the method provided by the embodiment of the present application is applied will be described.

As shown in fig. 4, the electronic device 400 may include a processor 410, an external memory interface 420, an internal memory 421, a USB interface 430, a charging management module 440, a power management module 441, a battery 442, an antenna 1, an antenna 2, a mobile communication module 450, a wireless communication module 460, an audio module 470, a speaker 470A, a receiver 470B, a microphone 470C, an earphone interface 470D, a sensor module 480, a camera 490, a display screen 491, a SIM card interface 492, and the like. Wherein the sensor module 480 may include a touch sensor, a pressure sensor, etc.

It is to be understood that the electronic device 400 shown in fig. 4 is merely an example and is not to be construed as limiting the electronic device, and that the electronic device may have more or fewer components than shown, may combine two or more components, or may have a different configuration of components. The various components shown in fig. 4 may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

Processor 410 may include one or more processing units, such as: the processor 410 may include an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a memory, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a Neural-Network Processing Unit (NPU), among others. Wherein, the different processing units may be independent devices or may be integrated in one or more processors. The controller may be, among other things, a neural center and a command center of the electronic device 400. The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and instruction execution.

A memory may also be provided in processor 410 for storing instructions and data. In some embodiments, the memory in the processor 410 is a cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 410. If the processor 410 needs to use the instruction or data again, it can be called directly from the memory. Avoiding repeated accesses reduces the latency of the processor 410, thereby increasing the efficiency of the system.

The execution of the image conversion method provided in the embodiment of the present application may be controlled or completed by calling other components by the processor 410, for example, calling a processing program stored in the internal memory 421 in the embodiment of the present application to control other related devices to respectively execute corresponding methods, so as to implement an image conversion function and a converted image display function, improve the intelligence and convenience of the electronic device 400, and improve the user experience. The processor 410 may include different devices, such as an integrated CPU and a GPU, and the CPU and the GPU may cooperate to execute the image conversion method provided by the embodiment of the present application, for example, a part of the algorithm for RGB image synthesis in the image conversion method is executed by the GPU, and another part of the algorithm is executed by the CPU, so as to obtain faster processing efficiency. For another example, a part of the algorithm for rendering and synthesizing the RGB image to be displayed or the frame image to be displayed in the RGB format is executed by the GPU, and the algorithm of the image conversion part provided in the embodiment of the present application is executed by the CPU.

The display screen 491 is used to display images, videos, and the like. The display screen 491 includes a display panel. The display panel may adopt a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (FLED), a miniature, a Micro-oeld, a quantum dot light-emitting diode (QLED), and the like. The display screen 491 may be used to display color screens as well as various Graphical User Interfaces (GUIs). For example, the display screen 491 may display a photograph, a video, a web page, a file, or the like.

The cameras 490 (front or rear, or one camera may act as both front and rear) are used to capture still images or video. In general, the camera 490 may include a photosensitive element such as a lens group including a plurality of lenses (convex or concave lenses) for collecting an optical signal reflected by an object to be photographed and transferring the collected optical signal to an image sensor, and an image sensor. And the image sensor generates an original image of the object to be shot according to the optical signal.

The internal memory 421 may be used to store computer-executable program code, including instructions. The processor 410 executes various functional applications of the electronic device 400 and data processing by executing instructions stored in the internal memory 421. The internal memory 421 may include a program storage area and a data storage area. The storage program area may store, among other things, the code for the operating system, application programs (e.g., image conversion, image display, etc.), and the like. The storage data area may store data created during use of the electronic device 400 (such as image data to be displayed), and the like.

The internal memory 421 may also store one or more computer programs corresponding to the image conversion algorithm provided in the embodiments of the present application. The one or more computer programs stored in the internal memory 421 and configured to be executed by the one or more processors 410 include instructions that may be used to perform the steps in the following embodiments. In addition, the internal memory 421 may include a high-speed random access memory, and may further include a nonvolatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (UFS), and the like.

Of course, the code of the screen display algorithm provided in the embodiment of the present application may also be stored in the external memory. In this case, the processor 410 may execute the code of the picture display algorithm stored in the external memory through the external memory interface 420.

The wireless communication function of the electronic device 400 may be implemented by the antenna 1, the antenna 2, the mobile communication module 450, the wireless communication module 460, the modem processor, the baseband processor, and the like.

The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in electronic device 400 may be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 450 may provide a solution including 2G/3G/4G/5G wireless communication applied on the electronic device 400. The mobile communication module 450 may include at least one filter, a switch, a power amplifier, a Low Noise Amplifier (LNA), and the like. In some embodiments, at least some of the functional blocks of the mobile communication module 450 may be disposed in the same device as at least some of the blocks of the processor 410.

The wireless communication module 460 may provide a solution for wireless communication applied to the electronic device 400, including Wireless Local Area Networks (WLANs) (e.g., wireless fidelity (Wi-Fi) networks), bluetooth (bluetooth, BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), Infrared (IR), and the like. The wireless communication module 460 may be one or more devices integrating at least one communication processing module.

In addition, the electronic device 400 may implement audio functions through the audio module 470, the speaker 470A, the receiver 470B, the microphone 470C, the headphone interface 470D, and the application processor. The SIM card interface 492 in the electronic device 400 is used to connect a SIM card. The SIM card can be brought into and out of contact with the electronic device 400 by being inserted into the SIM card interface 492 or being pulled out of the SIM card interface 492.

It should be understood that in practical applications, the electronic device 400 may include more or less components than those shown in fig. 4, and the embodiment of the present application is not limited thereto. The illustrated electronic device 400 is merely an example, and the electronic device 400 may have more or fewer components than shown in the figures, may combine two or more components, or may have a different configuration of components. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

The embodiments of the present application will be described in detail below with reference to the accompanying drawings.

Fig. 5 is a schematic diagram of a pixel arrangement of a full white frame in an RGB color space according to an embodiment of the present disclosure. As shown in fig. 5, in the full white picture in the RGB color space, all the sub-pixels are turned on, and every three R, G, B sub-pixels are sequentially arranged to form a pixel displaying white, so as to obtain 16 pixels of 4 × 4, where the pixel value of each R, G, B sub-pixel is 255. When the full white picture is converted from an RGB format to an RGBW format, a method of replacing part of blue B sub-pixels and/or part of red R sub-pixels in the picture with white W sub-pixels is adopted.

For example, when the full white picture is converted from the RGB format to the RGBW format, a method of replacing half of the blue B sub-pixels in the picture with the white W sub-pixels may be adopted to obtain the pixel arrangement diagram of the full white picture in the RGBW color space as shown in fig. 6, in the full white picture in the RGBW format, although half of the blue pixels in the picture corresponding to the RGB format are replaced with the white pixels, since the sensitivity of human eyes to the blue pixels is low and the reduced blue pixels are uniformly arranged, the influence on the color display of the picture is low, and meanwhile, the increased white pixels are uniformly arranged, and the brightness of the display picture can be uniformly improved.

The above-mentioned conversion mode of replacing part of the blue B sub-pixels and/or part of the red R sub-pixels in the image picture with the white W sub-pixels can improve the display brightness of the picture, but can only meet the display requirements of a small part of scenes, and the conversion display effect on different color boundary areas (such as a blue-white boundary picture, a red-white boundary picture, etc.) in the image is relatively poor, and the jaggies in the picture displayed after conversion are obvious.

For example, according to the above conversion method, when the pixel points in the blue-white color boundary region in the RGB image are converted into the RGBW format, a pixel arrangement diagram of the blue-white color boundary picture in the RGBW color space is obtained, as shown in fig. 7, the left region of the blue-white color boundary line in the drawing is the sub-pixel arrangement of the white picture, and the right region of the blue-white color boundary line is the sub-pixel arrangement of the blue picture. The left area is added with W sub-pixels, so that the brightness of a white picture is relatively high; the right area is a blue image, and only the blue sub-pixel is correspondingly turned on, that is, the pixel value is not zero, and the other three-color sub-pixels including R, G, W sub-pixels are not turned on (marked as "-") that is, the pixel values are all zero, so that the brightness of the blue image in the right area is relatively low, and the difference between the brightness and the color of the blue image and the color of the left area is obvious, so that the blue-white boundary area in the displayed image has a more obvious sawtooth shape.

In addition, when different RGB images are converted into RGBW images, the same conversion method is adopted, and the conversion method is relatively single, so that the conversion requirements of different scenes cannot be met.

In order to solve the above problem, an embodiment of the present application provides an image conversion method, as shown in fig. 8, the method including:

s801: in the process of displaying a picture through a display screen, the electronic equipment acquires an RGB image to be displayed and determines characteristic information of the RGB image.

The characteristic information is used for representing application characteristics of the application to which the RGB image belongs and/or color distribution characteristics of the RGB image, and the RGB image is a frame picture which needs to be displayed in the running process of the application.

When the electronic equipment displays a picture through a display screen, acquiring a frame picture to be displayed of the next frame in the foreground application running process as an RGB image to be displayed, and determining the characteristic information of the RGB image. Wherein the feature information includes at least one of the following feature information:

characteristic information 1: identification information of an application to which the RGB image belongs, where the identification information is used to characterize an application feature of the application, such as an application type or an application scene of the application.

Characteristic information 2: and the pixel point quantity information is used for indicating the quantity of the pixel points contained in the color boundary region in the RGB image, and the pixel point quantity information is used for representing the color distribution characteristics of the RGB image.

Wherein, the information of the number of the pixel points comprises at least one of the following information:

1) the number of pixel points contained in the color boundary region in the RGB image;

2) and the ratio of the number of the pixel points contained in the color boundary area to the number of the pixel points contained in the RGB image.

In some embodiments of the present application, an electronic device identifies identification information of an application by reading an application identifier or an application attribute of the application; the ratio is obtained by performing image recognition and analysis on the RGB image to determine the information of the number of the pixels, for example, by counting the proportion of the pixels included in the color boundary region in the pixels included in the RGB image through a color histogram.

S802: and the electronic equipment selects a target conversion mode matched with the characteristic information from a plurality of conversion modes according to the characteristic information.

Wherein, the conversion parameters corresponding to different conversion modes are different.

In the embodiment of the application, according to the characteristic information of the RGB image, a plurality of conversion modes for converting the RGB image into the RGBW image are preset, and a corresponding relationship between the characteristic information of the RGB image and the conversion modes is set. The conversion parameters corresponding to different conversion modes are different, and any one conversion mode is used for converting the RGB image into a red, green, blue and white RGBW image according to the conversion parameters corresponding to the conversion mode.

In an embodiment of the present application, the conversion parameter includes a scaling factor greater than 0 and not greater than 1, and the scaling factor is used to determine a pixel value corresponding to a pixel point after the RGB image conversion.

And when a target conversion mode is selected from a plurality of conversion modes according to the characteristic information, determining the target conversion mode corresponding to the characteristic information in the plurality of conversion modes according to the corresponding relation between the preset characteristic information and the conversion modes.

In some embodiments of the present application, the electronic device may set two different transition modes. Under the condition that the characteristic information is the pixel point number information: if the number of the pixel points indicated by the pixel point number information exceeds a set threshold, the target conversion mode corresponding to the characteristic information is a first conversion mode; and if the number of the pixel points indicated by the pixel point number information does not exceed the set threshold, the target conversion mode corresponding to the characteristic information is a second conversion mode. And the brightness of the pixel points in the RGBW image obtained by conversion according to the first conversion mode is smaller than the brightness of the pixel points in the RGBW image obtained by conversion according to the second conversion mode. In some embodiments of the present application, the electronic device may determine feature information of an RGB image to be displayed for each frame, select a target conversion mode from a plurality of conversion modes according to the feature information, and convert the RGB image into an RGBW image by using the selected target conversion mode and then display the RGBW image.

In the above manner, the electronic device can select the conversion mode corresponding to the characteristic information of the RGB image for conversion for each frame of RGB image to be displayed, so that the flexibility of image conversion is improved, and it is ensured that each frame of RGB image has a relatively good display effect.

As another optional implementation manner, for each frame of RGB image to be displayed, the electronic device first determines whether a target conversion mode needs to be selected from multiple conversion modes for image format conversion according to feature information of the RGB image. If so, selecting a target conversion mode from a plurality of conversion modes according to the characteristic information of the image, converting the RGB image of the frame into an RGBW image by using the selected conversion mode, and then displaying, otherwise, performing image format conversion on the RGB image according to a preset conversion mode, and then displaying, wherein the preset conversion mode is one of the conversion modes or is a conversion mode different from the conversion modes.

In the above manner, the electronic device can perform conversion pattern matching on the determined RGB image that needs conversion pattern matching according to the feature information of the RGB image, thereby reducing the data processing amount of conversion pattern matching.

In this embodiment, the electronic device determines whether the RGB image needs to be subjected to conversion pattern matching by using the method described in the first and/or second aspects, that is, whether a target conversion pattern is selected from a plurality of preset conversion patterns.

The first scheme is as follows: it is determined whether or not a target conversion mode is selected from among a plurality of conversion modes to perform image format conversion on the RGB image, based on identification information (the above-described feature information 1) to which the RGB image belongs.

In some embodiments of the present application, a correspondence between an application type indicated by different identification information and whether to perform conversion pattern matching is preset, and different application types are respectively corresponding to whether to perform conversion pattern matching or not. And the electronic equipment determines whether to perform conversion mode matching according to the preset corresponding relation and the application type indicated by the identification information corresponding to the RGB image to be displayed. And if the application type is determined to be correspondingly matched with a conversion mode, selecting a target conversion mode from a plurality of conversion modes to perform image format conversion on the RGB image, otherwise, performing image format conversion on the RGB image according to a preset conversion mode and then displaying, or directly displaying the RGB image.

Scheme II: and determining whether to select a target conversion mode from a plurality of conversion modes to perform image format conversion on the RGB image according to pixel number information (the characteristic information 2) for indicating the number of pixels included in the color boundary region in the RGB image.

According to the scheme, whether conversion mode matching is carried out or not is determined according to the information of the number of the pixel points in the color boundary area in the RGB image.

As an optional implementation manner, if it is determined that a color boundary region exists in the RGB image, that is, it is determined that the number of pixels in the color boundary region indicated by the pixel number information is not 0, it is determined that conversion mode matching is performed.

As another optional implementation manner, if it is determined that the number of pixels in the color boundary region indicated by the pixel number information exceeds a set threshold, it is determined that conversion pattern matching is performed, otherwise, it is determined that conversion pattern matching is not performed, and the RGB image is displayed after image format conversion is performed directly according to a preset conversion pattern, or the RGB image is displayed directly.

Generally, the color boundary region of the RGB image is a region in which a zigzag shape is likely to appear after conversion, and therefore, in the above manner, whether to perform conversion pattern matching is determined according to the color distribution characteristics of the RGB image, and a suitable conversion pattern can be selected by performing conversion pattern matching only on an image with a large color boundary region, thereby avoiding performing conversion pattern matching on an image with no color boundary region or a small color boundary region, and further reducing the data processing amount or resource occupation.

In some embodiments of the present invention, when the above-mentioned first and second schemes are combined, when the conversion pattern matching is determined according to the methods described in the above-mentioned first and second schemes, a target conversion pattern is selected from multiple conversion patterns to perform image format conversion on the RGB image, otherwise, the conversion pattern matching is not performed.

Optionally, first, it is determined whether the application type corresponding to the RGB image is subjected to conversion pattern matching or not according to a correspondence between the application type and whether the conversion pattern matching is performed or not, and if so, it is further determined whether the conversion pattern matching is performed or not according to whether the number of pixels indicated by the pixel number information of the RGB image exceeds a set threshold or not.

In the embodiment of the application, when determining that the target conversion mode is selected from the plurality of conversion modes to perform the image format conversion on the RGB image, at least one of the following manners is used to determine the conversion mode used for performing the image format conversion on the RGB image.

In the method 1, a conversion mode for converting an image format of an RGB image is determined based on identification information (the above-mentioned feature information 1) of an application to which the RGB image belongs.

In this manner, the identification information is the same as the identification information in the first embodiment, and is not repeated here.

In some embodiments of the present application, a corresponding relationship between application types indicated by different identification information and available conversion modes is preset, and the electronic device determines a corresponding conversion mode according to the preset corresponding relationship and an application type indicated by identification information corresponding to an RGB image to be displayed.

In the above manner, by setting the available conversion modes corresponding to different application types, some conversion modes with possibly poor image conversion effect can be excluded in advance according to the application characteristics of the application to which the RGB image belongs, so that selection of some conversion modes with inapplicable RGB images or poor conversion effect in some application scenarios is avoided. In this manner, the information of the number of pixels is the same as the identification information in the first scheme, and is not repeated here.

In some embodiments of the present application, a corresponding relationship between the number of pixels indicated by different pixel number information and the conversion mode is preset, and the electronic device determines the corresponding conversion mode according to the preset corresponding relationship and the number of pixels indicated by the pixel number information corresponding to the RGB image to be displayed.

Specifically, value ranges of different pixel numbers can be set for different conversion modes, and according to the value range to which the determined pixel number corresponding to the RGB image belongs, the corresponding conversion mode is selected to perform image format conversion on the RGB image, so as to obtain the RGBW image. In the above manner, for each frame of image, the corresponding conversion mode is selected according to the color distribution characteristics of the image, and an appropriate conversion mode can be selected according to the picture color condition of the image to perform format conversion on the RGB image to be displayed, thereby balancing the requirements of power consumption and display effect.

In some embodiments of the present invention, when the manner 1 and the manner 2 are combined, when the manner 1 is adopted to determine that a plurality of available conversion modes are obtained, the manner 2 is further adopted to select a corresponding conversion mode from the plurality of available conversion modes, if a conversion mode is finally determined, it is determined that the conversion mode is adopted, and if a plurality of available conversion modes are still finally determined, any one of the conversion modes is selected.

And if the suitable conversion mode cannot be matched according to the corresponding relation between the characteristic information of the image and the conversion mode, performing image format conversion on the RGB image according to a preset conversion mode.

Step S803: and the electronic equipment converts the RGB image according to the target conversion mode to obtain an RGBW image.

In the embodiment of the application, after the target conversion mode corresponding to the RGB image to be displayed is matched according to the above manner, the pixel points of the partial or all regions of the RGB image are converted according to the target conversion mode, wherein the partial region of the RGB image is a color boundary region in the RGB image.

In an embodiment of the present application, the color boundary region includes at least one of a blue color boundary region and a white color boundary region, a red color boundary region and a white color boundary region.

When a conversion mode of replacing a part of blue sub-pixels in an image with white sub-pixels is adopted, the color boundary area is a blue and white color boundary area (blue and white color boundary area); when a conversion mode of replacing partial red sub-pixels in the image with white sub-pixels is adopted, the color boundary area is a red and white color boundary area (red and white color boundary area); when a conversion mode of replacing a part of blue sub-pixels and a part of red sub-pixels in the image with white sub-pixels is adopted, the color boundary area is a blue-white picture boundary area and/or a red-white picture boundary area.

In the embodiment of the present application, the range of the color boundary region is a region with a set size including a boundary line with different colors, or a region including at least one pixel point on one side or two sides of the color boundary line.

For example, as shown in fig. 9, it is a schematic diagram of the pixel arrangement of a blue-white color boundary picture, in which a blue-white color boundary line l is a boundary line between a white picture and a blue picture, a left area of the boundary line l is a sub-pixel arrangement of the white picture in an RGB image, and a right area of the boundary line l is a sub-pixel arrangement of the blue picture. When the image conversion is performed, the range of the corresponding blue-white frame boundary region is a range corresponding to at least one pixel on one side or both sides of the boundary line l, or a range corresponding to a predetermined number of pixels on one side or both sides of the boundary line l. For example, when the range of the blue-white frame boundary region is a range corresponding to one pixel on one side of the boundary line l, the blue-white frame boundary region corresponds to the region 1 or the region 2 shown in the figure; when the range of the blue-white picture boundary area is the range corresponding to one pixel at each of two sides of the boundary line l, the blue-white picture boundary area corresponds to the range of the area 1 plus the area 2 shown in the figure; the range of the blue-white frame boundary region corresponds to the range of the region 3 shown in the figure when the range of the blue-white frame boundary region corresponds to two pixels on both sides of the boundary line l.

In some embodiments of the present application, when an RGB image is converted, for each pixel point in the RGB image, a product of a minimum value of an R sub-pixel value, a G sub-pixel value, and a B sub-pixel value of the pixel point and a conversion parameter, that is, a proportionality coefficient, is determined as a W sub-pixel value after the pixel point is converted, and a difference value between the R sub-pixel value, the G sub-pixel value, the B sub-pixel value, and the W sub-pixel value of the pixel point is determined as the R sub-pixel value, the G sub-pixel value, and the B sub-pixel value after the pixel point is converted.

For example, when the R, G, B sub-pixel values of the pixel are r, g, and b, respectively, and r > g > b, the minimum value b is the maximum value of the W sub-pixel value corresponding to the pixel after the format conversion. When the proportional coefficient corresponding to the pixel point corresponding to the conversion mode is 0.5, the converted R, G, B, W sub-pixel values corresponding to the pixel point are respectively R: R-0.5B, G: G-0.5B, B: B-0.5B and W:0.5B, wherein R, G and B are integers not less than 0 and not more than 255, and W is an integer not less than 0 and not more than B.

The following describes an image conversion method provided in the embodiments of the present application with reference to specific examples.

Example one

For example, in step S802, the electronic device may set two conversion modes, where the conversion parameters corresponding to the conversion modes are a scaling factor 0.5 and a scaling factor 1, respectively. When a RGB image is converted into an RGBW image, a mode is adopted in which, when a part of blue subpixels in the image is replaced by white subpixels, format conversion is performed on pixels with RGB pixel values of R:128, G:128, and B:255 in a boundary region of a blue-white picture by using the two conversion modes, corresponding subpixel values in an RGBW format are as shown in table 1 below, where a mode 1 is a conversion mode with a scaling coefficient of 0.5, and a mode 2 is a conversion mode with a scaling coefficient of 1.

When the minimum sub-pixel value among the pixel values of the pixel points is an R sub-pixel value and a G sub-pixel value of 128, the converted W sub-pixel value corresponding to the pixel point ranges from 0 to 128, the converted W sub-pixel value corresponding to the mode 1 is 128 × 0.5 ═ 64, and the converted W sub-pixel value corresponding to the mode 2 is 128 × 1 ═ 128. The converted R, G, B subpixel values for mode 1 are 64, and 191, respectively, and the converted R, G, B subpixel values for mode 2 are 0, and 127, respectively, as shown in table 1 below.

TABLE 1 comparison of the effects of different conversion modes on format conversion of pixels

Switching modes	Post-conversion R, G, B, W subpixel values	Advantages of the invention	Disadvantages of
				Mode 1	R:64G:64B:191W:64	Smooth and less jaggy	Higher power consumption
Mode 2	R:0G:0B:128W:128	Better power consumption	With pronounced saw teeth

The scale factor corresponding to the mode 1 in table 1 is smaller, and the pixel arrangement schematic diagram of the blue-white color boundary picture in the RGBW color space is obtained after the format conversion is performed on the pixel points in the blue-white color boundary region by using the mode 1, as shown in fig. 10, the left region of the blue-white color boundary line in the drawing is the sub-pixel arrangement of the white picture, and the right region is the sub-pixel arrangement of the blue picture, wherein the blue-white color boundary region is a region corresponding to a pixel point on one side of the blue-white color boundary line adjacent to the white picture, as shown in the region 1 in the drawing. In combination with the data in table 1, compared with the schematic pixel arrangement diagram of the blue-white color boundary region in the RGBW format shown in fig. 7, the R, G, B sub-pixel values of the pixels near the blue-white color boundary line after conversion in fig. 10 have smaller variations, so that the difference between the luminance of the pixels near the blue-white color boundary line and the color and luminance of the white picture or the blue picture is smaller, and the jaggy feeling of the blue-white boundary line in the displayed picture can be reduced.

The scale factor corresponding to the mode 2 in table 1 is larger, and the pixel arrangement schematic diagram of the blue-white color boundary picture in the RGBW color space is obtained after the format conversion is performed on the pixel points in the blue-white color boundary region by using the mode 2, as shown in fig. 11, the left region of the blue-white color boundary line in the drawing is the sub-pixel arrangement of the white picture, and the right region is the sub-pixel arrangement of the blue picture, wherein the blue-white color boundary region is a region corresponding to a pixel point on one side of the blue-white color boundary line adjacent to the white picture, as shown in the region 1 in the drawing. With the data in table 1, compared with the pixel arrangement diagram of the blue-white color boundary region in the RGBW format shown in fig. 7, the R, G, B sub-pixel values of the pixels near the blue-white color boundary line after conversion in fig. 11 change greatly, so that the difference between the luminance of the pixels near the blue-white color boundary line and the color and luminance of the white picture or the blue picture is large, the jaggy of the blue-white boundary line in the displayed picture is obvious, but the W sub-pixel value of the pixels in fig. 11 after conversion is large, and the amount of backlight required by the display screen when displaying the image is small, so the power consumption is small.

According to the comparison between the mode 1 and the mode 2, the display effect and the power consumption obtained by performing image conversion by adopting different scale coefficients are different. The smaller the scale factor is, the smaller the brightness and color difference between different color regions in the RGBW image obtained by conversion according to the scale factor is, so that the more the sawtooth shape is less obvious, but the power consumption is relatively larger; the larger the scale factor is, the larger the brightness of the RGBW image converted from the scale factor is, the smaller the amount of backlight required when displaying the image is, and therefore the smaller the power consumption is, but the jaggy shape in the display screen is more noticeable. Therefore, in the embodiment of the application, different conversion modes are set according to different scale coefficients, and the suitable modes of the RGB images can be flexibly selected from multiple conversion modes for image conversion according to the requirements on the display effect and the power consumption of the images in an actual scene, so that different image display requirements are met, and the balance between the display effect and the power consumption is achieved.

In the method, the electronic device can also select more than two different scale coefficients from a plurality of set scale coefficients in the value range of the scale coefficients to be respectively used as the conversion parameters corresponding to different conversion modes, so that more optional conversion modes are set, the flexibility of image conversion format control is improved, and a more appropriate image conversion mode can be selected according to actual conditions. For example, based on the mode 1 and the mode 2 shown in table 1, the mode 3 having a scale factor value between the mode 1 and the mode 2 may be added, and if the scale factor of the mode 3 is set to 0.75, the converted R, G, B, W sub-pixel values corresponding to the mode 3 are R:32, G:32, B:159, and W:96, respectively.

Example two

Illustratively, based on the first example, in step S802, when the electronic device determines whether the RGB image needs to be subjected to conversion pattern matching by using the method described in the first embodiment, the identification information is used to indicate an application type of an application to which the RGB image belongs, such as a game type, a shooting type, a video playing type, a reading type, a social communication type, and the like. For example, when the electronic device displays an image, if the application is determined to be a camera according to the identification information of the application to which the RGB image to be displayed belongs, the application type of the application can be determined to be a shooting type.

Illustratively, as shown in table 2 below, an example of a corresponding relationship between an application type and whether to perform conversion pattern matching is provided in the embodiment of the present application.

TABLE 2 correspondence between application type of image and whether conversion pattern matching is performed

As shown in table 2 above, by setting the corresponding relationship between the application type and whether to perform conversion pattern matching, when displaying an RGB image, it is determined whether to select a corresponding target conversion pattern from a plurality of conversion patterns to perform format conversion on the RGB image according to the application characteristics of the application to which the RGB image belongs. For example, the application types in the first-stage classification shown in table 2 may be respectively corresponding to performing conversion pattern matching or not performing conversion pattern matching, or the application types in the second-stage classification may be respectively corresponding to performing conversion pattern matching or not performing conversion pattern matching.

For example, as shown in table 2 above, when the picture displayed by the RGB image is an application interface of a takeout APP in a mobile phone, the application type corresponding to the image is a food takeout type; when the picture displayed by the RGB image is an application interface of a certain shopping APP in the mobile phone, the application type corresponding to the image is a shopping category. The food takeout class and the shopping class can be classified into a shopping price ratio class. Therefore, a mode of respectively corresponding the food takeout class and the shopping class to the conversion pattern matching or corresponding the shopping price class to the conversion pattern matching can be adopted.

The requirements of the display scenes corresponding to different types of applications on the power consumption and the performance of image display are different, so that the mode of determining whether to perform conversion mode matching according to the application types of the applications to which the RGB images belong can adaptively adjust the display mode of the RGB images according to the requirements of the application display scenes on the power consumption and the performance of the image display. For example, for a scene with a high performance requirement (e.g., a game, a camera shooting scene, etc.), or a scene with a low power consumption or in a power saving mode of the electronic device, the RGB image may be displayed after being subjected to image format conversion directly according to a preset conversion mode without performing conversion mode matching, so that a certain amount of data processing may be reduced, and performance may be improved. For scenes with low performance requirements (such as video playing scenes, internet reading scenes, social communication scenes and the like), conversion mode matching can be adopted to select a relatively good conversion mode to convert the RGB images when the images are displayed, so that the display effect of the displayed images is ensured.

Example three

Illustratively, based on the first example and the second example, in the step S802, when the electronic device determines the conversion mode used for converting the image format of the RGB image in the mode 1, on the basis of the correspondence between the application type of the image and whether the conversion mode is matched as shown in the above table 2, the correspondence between the application type and the conversion mode may be further increased, so as to obtain the correspondence as shown in the following table 3.

TABLE 3 correspondence between application type of image and whether conversion pattern matching is performed and available conversion patterns

As shown in table 3 above, by setting the correspondence between the application type and the conversion mode, when displaying an RGB image, a corresponding available conversion mode is determined according to a scene of the RGB image, and a target conversion mode is selected from the available conversion modes. When the application type corresponding to the RGB image corresponds to the non-conversion mode matching, the RGB image is converted by using a preset conversion mode, and the preset conversion mode may be the same as one of preset conversion modes.

Optionally, when the display requirement is mainly to save power consumption, selecting a conversion mode with relatively high pixel brightness in the converted image from available conversion modes; when the display requirement mainly aims at reducing picture saw teeth and improving the display effect, a conversion mode with relatively low pixel point brightness in the converted image is selected from available conversion modes.

The requirements of the display scenes corresponding to different types of applications on the power consumption, the display effect and the like of image display are different, the corresponding conversion mode is determined according to the application type of the RGB image, and a proper image format conversion mode can be selected according to the requirements of the application scenes on the power consumption and the performance, so that the display effect of the image is improved or the power consumption is reduced.

For example, in step S802, when the electronic device determines the conversion mode for converting the image format of the RGB image in the mode 2, the multiple conversion modes may include two conversion modes, i.e., the mode 1 and the mode 2 shown in table 1 above, and if the number of pixels in the blue-white color boundary region in the RGB image exceeds the preset threshold, the conversion is performed in the mode 1 for pixels with RGB pixel values of R:128, G:128, and B:255 in the blue-white picture boundary region; if the number of the pixel points in the blue-white color boundary region in the RGB image does not exceed the preset threshold, the mode 2 is adopted for conversion aiming at the pixel points with the RGB pixel values of R:128, G:128 and B:255 in the blue-white picture boundary region. The conversion parameter, namely the proportionality coefficient, corresponding to the mode 1 is smaller than the conversion parameter corresponding to the mode 2, and the luminance of the pixel point after the mode 1 conversion is smaller than the luminance of the pixel point after the mode 2 conversion, so that the sawtooth shape in the image after the mode 1 conversion is not obvious relative to the mode 2, but the power consumption is higher than that of the mode 2.

As an optional implementation manner, the electronic device may select one conversion mode from multiple conversion modes as a default mode for applications of different application types, and in the image conversion process, if it is determined that the application type of the image to be displayed corresponds to the mode matching that is not performed, the conversion may be performed in the default mode.

The following describes an image conversion method provided in the embodiments of the present application with reference to a specific implementation flow.

Fig. 12 is a schematic flowchart of an image conversion method according to an embodiment of the present application, and as shown in fig. 12, the flowchart includes:

s1201: the electronic device obtains an RGB image to be displayed.

The RGB image is an image to be displayed after rendering and synthesis; the RGB image can be a single frame image or any frame image in the video data stream.

Step S1202: the electronic equipment determines whether a picture with a boundary between blue and white exists in the RGB image; if so, go to step S1203, otherwise go to step S1206.

Step S1203: the electronic equipment determines whether to perform conversion mode matching according to the characteristic information of the RGB image; if so, go to step S1204, otherwise, go to step S1206.

Step S1204: and the electronic equipment selects a conversion mode for converting the RGB image into an image format from a plurality of conversion modes according to the characteristic information of the RGB image.

Step S1205: and the electronic equipment performs image format conversion on the RGB image according to the conversion mode to obtain and display a corresponding RGBW image.

Step S1206: and the electronic equipment performs image format conversion on the RGB image according to a preset conversion mode to obtain and display a corresponding RGBW image.

In the above embodiment, according to the feature information of the RGB image, the conversion mode adopted by the RGB image is selected from the multiple conversion modes, and the conversion mode meeting the different requirements on the image display effect and the power consumption can be dynamically selected according to the different requirements, so that the balance between the display effect and the power consumption is realized.

In the above embodiment, when the available conversion mode of the RGB image cannot be determined, color adjustment, such as pixel fusion blurring processing, may be performed on the pixel points in the blue-white picture boundary region in the RGB image, so as to reduce the jaggy feeling during display.

The specific implementation flows provided by the above embodiments are only examples of applicable method flows in the embodiments of the present application, and the execution sequence of each step may be adjusted accordingly according to actual requirements, and other steps may be added or some steps may be reduced. The method flows provided by the above embodiments may also be executed in combination with methods provided by other embodiments to implement the image conversion method provided by the embodiments of the present application.

In some embodiments of the present application, in a specific implementation, a Display Driver Integrated Circuit (DDIC) of a Display screen of an electronic device presets a corresponding relationship between different feature information of an image and a conversion mode, and when displaying an image, a Command Prompt (CMD) for indicating the conversion mode may be received through an MIPI (Mobile Industry Processor Interface), and an image format of the image to be displayed is converted by using the corresponding conversion mode.

In some embodiments of the present application, when an electronic device displays RGB images of consecutive frames in a video, after an image displayed in each frame is synthesized by a Surface flicker, a HWC, and the like, if it is determined that a blue-white boundary picture exists in a next frame image to be displayed, a conversion mode adopted by converting the image into an RGBW format is determined according to the method provided in the foregoing embodiment, and it is determined whether a display mode of a DDIC of a current display screen is consistent with a conversion mode required by the image. If the two images are not consistent, the conversion mode is sent to the DDIC through a Display Serial Interface (DSI) protocol in a frame blanking area (Vertical Port, Vporch), and the DDIC switches the conversion mode in the Vporch, so that when the next frame image is displayed, the RGB image is converted into the RGBW image by using the switched conversion mode, and the Display requirement of the image is ensured to be met during Display.

Exemplarily, referring to fig. 13, a schematic diagram of a method for displaying consecutive frame images according to an embodiment of the present invention is shown. As shown in the figure, when displaying video data, if an nth frame image (n is a positive integer) is currently displayed and an RGB image is displayed after image format conversion in the mode 1, after synthesizing an nth +1 frame image which is a next frame, and if it is determined that an nth +1 frame image is displayed after image format conversion in the mode 2, a conversion mode adopted by the DDIC is switched from the mode 1 to the mode 2 in a time period Vporch from the completion of the display of the nth frame image to the start of the display of the nth +1 frame image, so that when displaying the nth +1 frame image, the image is displayed after format conversion in the switched mode 2.

In some embodiments of the present application, the electronic device may determine whether a blue-white boundary picture exists in a final image synthesized by the Surface flag multilayer, the HWC, the GPU, or the like by identifying a foreground application and aiming at a part of the foreground application, and if the blue-white boundary picture is identified, a suitable conversion mode from RGB to RGBW may be selected according to feature information of the image, and the RGB image is converted and then displayed. If the proper conversion mode is not determined, color adjustment can be performed on the image content of the blue-white boundary area, for example, feathering pixel processing at the boundary is performed, and the image proportion of the blue-white boundary is reduced, so that the sharpened sawtooth line is reduced.

The method provided by the embodiment of the application can identify the blue-white mixed color RGB image, and performs image format conversion on the RGB image by using different conversion modes, so as to obtain different display effects. Therefore, the balance between the display effect and the power consumption can be achieved by dynamically adapting the conversion mode.

Based on the above embodiments, an embodiment of the present application further provides an electronic device, as shown in fig. 14, where the electronic device includes:

an image analysis unit 1401, configured to obtain a red, green, and blue RGB image to be displayed, and determine feature information of the RGB image, where the feature information is used to represent an application feature of an application to which the RGB image belongs and/or a color distribution feature of the RGB image, and the RGB image is a frame image that needs to be displayed in an operation process of the application;

a pattern matching unit 1402, configured to select a target conversion mode from multiple conversion modes according to the feature information, where conversion parameters corresponding to different conversion modes are different;

an image conversion unit 1403, configured to convert the RGB image according to the target conversion mode to obtain a red, green, blue, and white RGBW image.

In one possible design, the quantity information includes at least one of:

In one possible design, before selecting a target conversion mode from among a plurality of conversion modes according to the feature information, the mode matching unit 1402 is further configured to:

Determining that a color boundary region exists in the RGB image; and/or

In one possible design, when the target conversion mode is selected from a plurality of conversion modes according to the feature information, the mode matching unit 1402 is configured to:

In one possible design, when converting the RGB image according to the target conversion mode, the image conversion unit 1403 is configured to:

Based on the above embodiment, the embodiment of the present application further provides an electronic device, which is used for implementing the image conversion method provided by the embodiment of the present application. As shown in fig. 15, the electronic device 1500 may include: a display screen 1501, one or more processors 1502, memory 1503, and one or more computer programs (not shown). The various devices described above may be coupled by one or more communication buses 2704.

The display screen 1501 is used for displaying images, videos and other relevant user interfaces. One or more computer programs, including instructions, are stored in memory 1503; the processor 1502 calls the instructions stored in the memory 1503 to cause the electronic 1500 to execute the image conversion method provided by the embodiment of the present application.

The steps of a method or algorithm described in the embodiments herein may be embodied directly in hardware, in a software element executed by a processor, or in a combination of the two. The software cells may be stored in Random Access Memory (RAM), flash memory, read-only memory (ROM), EPROM memory, EEPROM memory, registers, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. For example, a storage medium may be coupled to the processor such that the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an ASIC.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

In one or more exemplary designs, the functions described in the embodiments of the present application may be implemented in hardware, software, firmware, or any combination of the three. If implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media that facilitate transfer of a computer program from one place to another. Storage media may be any available media that can be accessed by a general purpose or special purpose computer. For example, such computer-readable media can include, but is not limited to, RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to carry or store program code in the form of instructions or data structures and which can be read by a general-purpose or special-purpose computer, or a general-purpose or special-purpose processor. In addition, any connection is properly termed a computer-readable medium, and thus is included if the software is transmitted from a website, server, or other remote source via a coaxial cable, fiber optic computer, twisted pair, Digital Subscriber Line (DSL), or wirelessly, e.g., infrared, radio, and microwave. Such discs (disks) and disks (discs) include compact disks, laser disks, optical disks, Digital Versatile Disks (DVDs), floppy disks and blu-ray disks, where disks usually reproduce data magnetically, while disks usually reproduce data optically with lasers. Combinations of the above may also be included in the computer-readable medium.

Those skilled in the art will recognize that, in one or more of the examples described above, the functions described in the embodiments of the present application may be implemented in hardware, software, firmware, or any combination thereof. When implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage media may be any available media that can be accessed by a general purpose or special purpose computer.

The above-mentioned embodiments are intended to illustrate the objects, technical solutions and advantages of the embodiments of the present application in further detail, and it should be understood that the above-mentioned embodiments are only specific embodiments of the present application, and are not intended to limit the scope of the embodiments of the present application, and any modifications, equivalent substitutions, improvements and the like made on the basis of the technical solutions of the embodiments of the present application should be included in the scope of the embodiments of the present application. The above description of the present application is provided to enable any person skilled in the art to make or use the present application, and any modifications based on the disclosed embodiments should be considered as obvious in the art, and the basic principles described in the embodiments of the present application may be applied to other variations without departing from the inventive spirit and scope of the present application. Thus, the disclosure of the embodiments of the present application is not intended to be limited to the embodiments and designs described, but is to be accorded the widest scope consistent with the principles of the application and novel features disclosed.

Although the present application has been described in conjunction with specific features and embodiments thereof, it will be apparent that various modifications and combinations can be made thereto without departing from the spirit and scope of the embodiments of the application. Accordingly, the specification and figures are merely exemplary of the present application as defined in the appended claims and are intended to cover any and all modifications, variations, combinations, or equivalents within the scope of the present application. It will be apparent to those skilled in the art that various changes and modifications may be made in the present application without departing from the scope of the application. Thus, if such modifications and variations of the embodiments of the present application fall within the scope of the claims of the present application and their equivalents, the embodiments of the present application are intended to include such modifications and variations as well.

Claims

1. An image conversion method, comprising:

2. The method of claim 1, wherein the characteristic information comprises at least one of:

3. The method of claim 2, wherein the quantity information comprises at least one of:

4. The method according to claim 2 or 3, wherein before selecting a target transition mode among a plurality of transition modes according to the feature information, the method further comprises:

Determining that a color boundary region exists in the RGB image; and/or

5. The method according to any of claims 1-4, wherein before selecting a target transition mode among a plurality of transition modes based on the characteristic information, the method further comprises:

6. The method according to any one of claims 1-5, wherein selecting a target switching mode among a plurality of switching modes based on the characteristic information comprises:

7. The method according to claim 6, wherein in the case where the feature information is the pixel point number information:

8. The method according to any of claims 1-7, wherein converting the RGB image according to the target conversion mode comprises:

9. An electronic device, comprising:

10. The electronic device of claim 9, wherein the characteristic information comprises at least one of:

11. The electronic device of claim 10, wherein the quantity information comprises at least one of:

12. The electronic device according to claim 10 or 11, wherein before selecting a target conversion mode among a plurality of conversion modes according to the feature information, the mode matching unit is further configured to:

Determining that a color boundary region exists in the RGB image; and/or

13. The electronic device according to any of claims 9-12, wherein, prior to selecting a target transition pattern among a plurality of transition patterns based on the characteristic information, the pattern matching unit is further configured to:

14. The electronic device according to any one of claims 9 to 13, wherein, when a target conversion mode is selected among a plurality of conversion modes based on the feature information, the mode matching unit is configured to:

15. The electronic device according to claim 14, wherein in a case where the feature information is the pixel point number information:

16. The electronic device according to any of claims 9-15, wherein when converting the RGB image according to the target conversion mode, the image conversion unit is configured to:

17. An electronic device, comprising a display screen, a memory, and one or more processors; wherein the memory is to store computer program code comprising computer instructions; the computer instructions, when executed by the processor, cause the electronic device to perform the method of any of claims 1-8.

18. A computer-readable storage medium, characterized in that it comprises program instructions which, when run on a terminal device, cause the terminal device to carry out the method according to any one of claims 1 to 8.