CN113496529A - Display control method, device and electronic system - Google Patents

Display control method, device and electronic system Download PDF

Info

Publication number
CN113496529A
CN113496529A CN202110304783.2A CN202110304783A CN113496529A CN 113496529 A CN113496529 A CN 113496529A CN 202110304783 A CN202110304783 A CN 202110304783A CN 113496529 A CN113496529 A CN 113496529A
Authority
CN
China
Prior art keywords
pixel
sub
display device
emitting unit
pixels
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110304783.2A
Other languages
Chinese (zh)
Inventor
徐鲁辉
范浩强
李帅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Megvii Technology Co Ltd
Original Assignee
Beijing Megvii Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Megvii Technology Co Ltd filed Critical Beijing Megvii Technology Co Ltd
Priority to CN202110304783.2A priority Critical patent/CN113496529A/en
Publication of CN113496529A publication Critical patent/CN113496529A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/90—Determination of colour characteristics
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/2003—Display of colours
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
    • G09G3/2007—Display of intermediate tones
    • G09G3/2074—Display of intermediate tones using sub-pixels
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10004—Still image; Photographic image

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Control Of Indicators Other Than Cathode Ray Tubes (AREA)

Abstract

The invention provides a display control method, a device and an electronic system; the method comprises the following steps: acquiring an image to be displayed and a pixel mapping relation corresponding to a display device; wherein the pixel mapping relation is determined according to sub-pixels in a light emitting unit of the display device; determining pixel parameters of the display device according to the pixel mapping relation and the image to be displayed; and controlling the display device to display at least a part of the image area of the image to be displayed based on the pixel parameter. In this way, the pixel mapping relationship of the display device is determined in advance according to the arrangement information of the sub-pixels of the display device, and even if the display device has a plurality of pixel arrangements, the pixel parameters of each light-emitting unit can be adjusted on the whole based on the pixel mapping relationship, so that the displayed image area achieves the preset display effect, and the display effect of the image is improved.

Description

Display control method, device and electronic system
Technical Field
The invention relates to the technical field of display control, in particular to a display control method, a display control device and an electronic system.
Background
A pixel structure in a display screen, generally consisting of a plurality of light emitting cells arranged in a matrix; each light-emitting unit includes a predetermined number of light-emitting pixels, for example, one light-emitting unit may include R (red), G (green), and B (blue) pixels, and may also include R (red), G (green), B (blue), and W (white) pixels, R (red), Y (yellow), and B (blue) pixels, or R (red), G (green), B (blue), and C (clear) pixels, and so on. The light-emitting pixels in the light-emitting unit are arranged according to a predetermined arrangement, and taking RGB pixels as an example, the RGB pixels may be arranged in a horizontal sequence, a vertical sequence, or a triangle.
Disclosure of Invention
In view of the above, the present invention provides a display control method, device and electronic system to improve the display effect of an image.
In a first aspect, an embodiment of the present invention provides a display control method, where the method includes: acquiring an image to be displayed and a pixel mapping relation corresponding to a display device; wherein the pixel mapping relation is determined according to sub-pixels in a light emitting unit of the display device; determining pixel parameters of the display device according to the pixel mapping relation and the image to be displayed; and controlling the display device to display at least a part of the image area of the image to be displayed based on the pixel parameter.
In a second aspect, an embodiment of the present invention provides a display control apparatus, including: the data acquisition module is used for acquiring an image to be displayed and a pixel mapping relation corresponding to the display device; wherein the pixel mapping relation is determined according to sub-pixels in a light emitting unit of the display device;
the parameter determining module is used for determining pixel parameters of the display device according to the pixel mapping relation and the image to be displayed;
and the display control module is used for controlling the display device to display at least one part of the image area of the image to be displayed based on the pixel parameter.
In a third aspect, an embodiment of the present invention provides an electronic system, including: a processing device and a storage device; the storage means has stored thereon a computer program which, when executed by the processing device, performs the display control method.
In a fourth aspect, an embodiment of the present invention provides a machine-readable storage medium, on which a computer program is stored, where the computer program is executed by a processing device to perform the steps of the display control method.
The embodiment of the invention has the following beneficial effects:
in the display control method, the display control device and the electronic system, the light-emitting unit in the display device acquires an image to be displayed and a pixel mapping relation corresponding to the display device; wherein the pixel mapping relation is determined according to sub-pixels in a light emitting unit of the display device; determining pixel parameters of the display device according to the pixel mapping relation and the image to be displayed; and controlling the display device to display at least a part of the image area of the image to be displayed based on the pixel parameter.
In this mode, the pixel mapping relationship of the display device is determined in advance according to the sub-pixels of the display device, and the pixel parameters of the display device are adjusted based on the pixel influence relationship, so that even if the display device has a plurality of pixel arrangements, the pixel parameters of each light-emitting unit can be adjusted on the whole based on the pixel mapping relationship, so that the displayed image area achieves a preset display effect, and the display effect of the image is improved.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
In order to make the aforementioned and other objects, features and advantages of the present invention comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a schematic structural diagram of an electronic system according to an embodiment of the present invention;
fig. 2 is a flowchart of a display control method according to an embodiment of the present invention;
fig. 3 is a flowchart of a specific determination manner of a pixel mapping relationship in another display control method according to an embodiment of the present invention;
fig. 4 is a schematic diagram of a display device according to an embodiment of the invention;
fig. 5 is a schematic structural diagram of a display control apparatus according to an embodiment of the present invention.
Detailed Description
To make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
With the development of the full-screen technology, the scheme of the camera under the screen of the full-screen can be truly realized after the Liuhai screen, the water drop screen, the through hole screen and the blind hole screen; the camera is located the display screen below, and the display screen both can guarantee normal display effect, can guarantee the printing opacity effect of camera again. The display panel is, for example, an OLED (Organic Light-Emitting display or Organic Light-Emitting semiconductor), a QLED (Quantum Dot Light-Emitting Diode display), and the embodiment of the invention is not limited thereto.
In the related art, in the light emitting unit matrix of the display screen, the arrangement of the sub-pixels in each light emitting unit has repeatability, so that each light emitting unit only needs to be locally and respectively rendered, and each light emitting unit can be applied to the same rendering process. However, when the arrangement of the sub-pixels in each light-emitting unit is different and does not have any regularity, the display effect of the image is poor when each light-emitting unit is processed in the same rendering manner.
Based on this, the embodiments of the present invention provide a display control method, device and electronic system, which can be applied to any display device with non-repetitive arrangement of sub-pixels in light-emitting units, and can also be used for rendering and displaying images with non-uniformity of any display parameters, such as brightness. Of course, the embodiments of the present invention can also be applied to a display device in which sub-pixels in a light emitting unit are repeatedly arranged, and the embodiments of the present invention are not limited thereto.
The technology can be implemented by corresponding software, hardware or a combination of software and hardware, and embodiments of the present invention are described in detail below.
The first embodiment is as follows:
first, an example electronic system 100 for implementing a display control method, apparatus, and electronic system of embodiments of the present invention is described with reference to fig. 1.
As shown in FIG. 1, an electronic system 100 includes one or more processing devices 102, one or more memory devices 104, an input device 106, an output device 108, and one or more image capture devices 110, which are interconnected via a bus system 112 and/or other type of connection mechanism (not shown). It should be noted that the components and structure of the electronic system 100 shown in fig. 1 are exemplary only, and not limiting, and that the electronic system may have other components and structures as desired.
The processing device 102 may be a gateway or an intelligent terminal, or a device including a Central Processing Unit (CPU) or other form of processing unit having data processing capability and/or instruction execution capability, and may process data of other components in the electronic system 100 and may control other components in the electronic system 100 to perform desired functions.
The storage 104 may include one or more computer program products that may include various forms of machine-readable storage media, such as volatile memory and/or non-volatile memory. The volatile memory may include, for example, Random Access Memory (RAM), cache memory (cache), and/or the like. The non-volatile memory may include, for example, Read Only Memory (ROM), hard disk, flash memory, etc. On which one or more computer program instructions may be stored that may be executed by processing device 102 to implement client functionality (implemented by the processing device) and/or other desired functionality in embodiments of the invention described below. Various applications and various data, such as various data used and/or generated by the applications, may also be stored in the machine-readable storage medium.
The input device 106 may be a device used by a user to input instructions and may include one or more of a keyboard, a mouse, a microphone, a touch screen, and the like.
The output device 108 may output various information (e.g., images or sounds) to the outside (e.g., a user), and may include one or more of a display, a speaker, and the like.
The image capture device 110 may capture preview video frames or image data and store the captured preview video frames or image data in the storage 104 for use by other components.
For example, the devices in the exemplary electronic system for implementing the display control method, apparatus and electronic system according to the embodiments of the present invention may be integrally disposed, or may be disposed in a distributed manner, such as integrally disposing the processing device 102, the storage device 104, the input device 106 and the output device 108, and disposing the image capturing device 110 at a designated position where a target image can be captured. When the above-described devices in the electronic system are integrally provided, the electronic system may be implemented as an intelligent terminal such as a camera, a smart phone, a tablet computer, a vehicle-mounted terminal, and the like.
Example two:
the present embodiment provides a display control method, which is executed by a processing device in the electronic system described above. As shown in fig. 2, the method comprises the steps of:
step S202, acquiring an image to be displayed and a pixel mapping relation corresponding to a display device; wherein the pixel mapping relation is determined according to sub-pixels in a light emitting unit of the display device;
in some embodiments, the light emitting unit in the display device has a variety of pixel arrangements. Illustratively, arrangement information of sub-pixels of at least two light emitting units among the plurality of light emitting units of the display device is different.
The display device is used for displaying an image to be displayed or displaying a part of an image area of the image to be displayed; the display device can be a complete display screen or a part of the display area of the display screen. The display device may be a separate device or may be mounted on the terminal device as a single component. The terminal equipment can also be provided with a camera device. The image to be displayed can be collected by the camera device, can be stored in the terminal equipment in advance, and can also be transmitted to the terminal equipment by an external network so as to be displayed by the display device.
The display device generally includes a plurality of light emitting units, each of which generally includes a plurality of sub-pixels, and it should be noted that the sub-pixels in the light emitting units of the display device are different concepts from the image pixels. Taking the display device as a display screen as an example, the sub-pixels in the light-emitting units of the display screen are physical structures, and the image pixels are actually integral units or elements in an image that can be observed by human eyes. For example, the light emitting unit may be a light emitting unit of RGB, RGBW, RYYB or RGBC type, which includes R, G, B, R, 2Y, B, C, R, G, B, C, and so on, respectively. Taking the example of the light-emitting unit including RGB sub-pixels, the light-emitting unit generally includes R, G, B sub-pixels, and the parameters of R, G, B three sub-pixels are adjusted and superimposed on each other to make the light-emitting unit have corresponding display parameters, such as various colors, brightness, etc. In practical implementation, for example, the R, G, B sub-pixels in the light-emitting unit can be implemented by R, G, B three-color light-emitting diodes, the three-color light-emitting diodes jointly constitute the light-emitting unit, and parameters such as the brightness of the light-emitting diodes corresponding to the R, G, B three colors can be adjusted. When the three colors of light are superposed, the colors are mixed, so that the color and the brightness of the luminous unit are changed, and the luminous unit emits the light with the corresponding color and the corresponding brightness through R, G, B three sub-pixels.
In an embodiment, in a display area of the display device, the number and the type of the sub-pixels included in each light emitting unit are the same, for example, each light emitting unit includes 3 sub-pixels, and the 3 sub-pixels are R, G, B sub-pixels respectively, but this embodiment is not limited thereto, and each light emitting unit may further include other numbers and types of sub-pixels, which is not described herein again. In an embodiment of the invention, the arrangement of the sub-pixels in at least one light emitting unit in the display region corresponding to the display device is different from the arrangement of the sub-pixels in other light emitting units. Or, the arrangement of the sub-pixels in all the light emitting units corresponding to the display device is different. For example, the arrangement information of the sub-pixels of some or all of the light emitting units in the display region corresponding to the display device has a difference and generally does not have any regularity. For example, taking the light emitting units including RGB sub-pixels as an example, the RGB sub-pixels in one light emitting unit may be arranged in a horizontal sequence, and the RGB sub-pixels in another light emitting unit may be arranged in a vertical sequence or in a triangle. Illustratively, the arrangement information of the sub-pixels of the light emitting unit may further include a size parameter, a shape parameter, an attitude parameter, or a distance parameter of the sub-pixels. In one embodiment, the RGB sub-pixels in each light-emitting unit may have different size, shape, posture, distance parameters, etc., for example, taking the example that the R, G, B sub-pixels in the light-emitting unit are implemented by R, G, B three-color light-emitting diodes, at least one of the size, shape, rotation angle or arrangement distance between the three-color light-emitting diodes and the relative position relationship between the three-color light-emitting diodes may be different.
Considering that arrangement information of sub-pixels in different light-emitting units has difference, when the display device needs to be subjected to display control, a pixel mapping relation of the display device needs to be acquired in advance; the pixel mapping relationship is determined according to arrangement information of sub-pixels of a light emitting unit of the display device. In this embodiment, the arrangement information of the sub-pixels of the light emitting unit may specifically be position information of each sub-pixel inside the light emitting unit, and may further include shape information of the light emitting unit. For a display device, the arrangement of the sub-pixels of the light emitting unit is already fixed, and thus the pixel mapping relationship determined based on the arrangement information of the sub-pixels is also determined.
In one embodiment, the sub-pixels in at least two light emitting units of the display device are arranged in a non-repetitive manner. The non-repetitive arrangement means, for example, a non-sequential arrangement in which the distribution is disordered, a non-uniform distribution, for example, a non-sequential distribution formed by different geometric parameters of the sub-pixels themselves, a non-uniform distribution formed by different positional parameters of the sub-pixels, and a non-repetitive arrangement formed by any one or more of random distributions formed by different set postures.
In general, a display device is composed of a plurality of light emitting units, each of which includes a plurality of sub-pixels. The plurality of sub-pixels of at least two light emitting units of the display device are distributed in a non-repetitive manner, and the distribution is disordered and non-uniform, for example, the disordered distribution can be formed by different geometrical parameters of the sub-pixels, or the non-uniform distribution can be formed by different position parameters of the sub-pixels, and the random distribution can be formed by different set postures. It should be noted that the "non-repetitive distribution" herein is understood as the "non-repetitive" in the foregoing, and will not be described in detail herein. Of course, the non-repetitive distribution formed by different arrangement of the sub-pixels of only one light emitting unit and the sub-pixels of other light emitting units may be also formed by non-repetitive distribution of the sub-pixels of a plurality of light emitting units, or non-repetitive distribution formed by different arrangement of the plurality of sub-pixels of all the light emitting units of the display device, which is not limited in the embodiment of the present invention.
The non-repetitive distribution of the sub-pixels of the light-emitting unit can be realized from multiple aspects. For example, the at least two sub-pixels may be considered non-repetitive if the sub-pixels have one or more of different sizes, or different shapes, or different set-up orientations, or different distance parameters from other surrounding sub-pixels, each of which is described in detail below.
For example, at least two non-repetitive sub-pixels of a plurality of sub-pixels in a plurality of light emitting units of a display device have different size parameters. For example, the at least two non-repetitive sub-pixels are at least two different directly circular sub-pixels, or triangular sub-pixels with different side lengths, or square sub-pixels with different side lengths, or other shapes with different size parameters.
For example, in some embodiments, there may be only two sub-pixels with different size parameters in the plurality of sub-pixels, and it is more preferable that the at least two non-repetitive sub-pixels and other sub-pixels in the plurality of sub-pixels have different size parameters. Of course, it is understood that it is preferable that the plurality of sub-pixels have different size parameters.
For example, at least two non-repetitive sub-pixels of the plurality of sub-pixels have different shape parameters, that is, the at least two non-repetitive sub-pixels have different shapes, which may be, for example, circular, elliptical, triangular, rectangular, square, or other irregular shapes, respectively.
In some embodiments, only two sub-pixels with different shape parameters may exist in the plurality of sub-pixels, and preferably, the at least two non-repetitive sub-pixels and other sub-pixels in the plurality of sub-pixels have different shape parameters. Of course, it is understood that the sub-pixels with different shape parameters are preferred.
For example, at least two non-repetitive sub-pixels of the plurality of sub-pixels have different set posture parameters, that is, the at least two non-repetitive sub-pixels have different set posture parameters. Wherein the set posture parameter is for sub-pixels having the same shape. If the shapes are different, then their setting of the pose parameters must also be left alone. For example, the plurality of sub-pixels are all elliptical, but at least two non-repetitive sub-pixels in the plurality of elliptical sub-pixels have different major axis directions. Of course, if the gesture is a triangle or other polygon, the different setting of the gesture parameters means that the orientation of each corner is different. And for the sub-pixels with the same shape, adjusting the set posture parameters can be realized by rotating the sub-pixels.
In some embodiments, only two sub-pixels with different set posture parameters may exist in the plurality of sub-pixels, and preferably, the at least two non-repetitive first sub-pixels and other sub-pixels in the plurality of sub-pixels have different set posture parameters. Of course, it is understood that the plurality of sub-pixels are all sub-pixels with different set posture parameters as a preferred scheme.
For example, at least two non-repetitive sub-pixels of the plurality of sub-pixels have different third distance parameters. The third distance parameter of the sub-pixel is a distance parameter between the sub-pixel and other sub-pixels within a preset range of the sub-pixel. For example, the range may be a preset circumference centered on the sub-pixel, wherein the third distance parameter may refer to a distribution state of distance parameters between the sub-pixel and other sub-pixels within the preset range, or an average distance parameter, or a maximum distance parameter or a minimum distance parameter. Of course, to characterize more comprehensively, the third distance parameter may be a distribution of distance parameters between the sub-pixel and other sub-pixels within a predetermined range.
For example, the distances between the centers of the sub-pixel a and the 6 sub-pixels within the predetermined circumference a1 are a1, a2, A3, a4, a5 and a6, respectively, and the distances between the centers of the sub-pixel b and the 6 sub-pixels within the predetermined circumference a2 are b1, b2, b3, b4, b5 and b6, respectively, while a1, a2, A3, a4, a5 and a6 do not have corresponding equal relationships with b1, b2, b3, b4, b5 and b6, so it can be said that the sub-pixel a and the sub-pixel b have different distance parameters. Of course, if the number of sub-pixels in the preset range is different, the distribution status of the distance parameter will certainly not be the same.
In some embodiments, only two sub-pixels with different third distance parameters may exist in the plurality of sub-pixels, and preferably, the at least two non-repetitive sub-pixels and other sub-pixels in the plurality of sub-pixels have different third distance parameters. Of course, it is understood that the plurality of sub-pixels are all sub-pixels with different third distance parameters are preferred.
For example, at least two non-repetitive sub-pixels of the plurality of sub-pixels have a different fourth distance parameter. The second distance parameter of the sub-pixel is a distance parameter between the sub-pixel and the sub-pixel within a preset range of the sub-pixel. For example, the range may be a range of a preset circumference centered on the sub-pixel, wherein the fourth distance parameter may refer to a distribution state of distance parameters between the sub-pixel and the sub-pixel within the preset range, or an average distance parameter, or a maximum distance parameter or a minimum distance parameter. Of course, to characterize more comprehensively, the second distance parameter may be a distribution of the distance parameters between the sub-pixel and the sub-pixels within the predetermined range.
In some embodiments, only two sub-pixels a with different second distance parameters exist in the plurality of sub-pixels a, and preferably, the at least two non-repetitive sub-pixels a and other sub-pixels a in the plurality of sub-pixels a have different second distance parameters. Of course, it is understood that the plurality of sub-pixels a are all sub-pixels a with different second distance parameters as a preferred scheme.
For example, the display device may further be provided with a plurality of display sub-regions, each of the display sub-regions being provided with at least one light emitting unit including a plurality of sub-pixels. All or part of the plurality of display subareas are arranged in a non-repetitive manner. The display sub-regions are arranged in a non-repetitive manner, so that the disorder degree of the sub-pixels is further improved, the brightness of diffraction stripes can be further uniformly distributed, the signal passing capacity of the display device can be enhanced, and the interference degree of signals received or sent by the optical device can be reduced.
Step S204, determining pixel parameters of the display device according to the pixel mapping relation and the image to be displayed;
in some embodiments, at least two of the plurality of light emitting units of the display device correspond to different pixel parameters.
Before the display device displays the image to be processed, sub-pixel parameters in the light-emitting unit corresponding to the display device are adjusted through the pixel mapping relation, and the image to be processed or a part of image area of the image to be processed is displayed through the adjusted display device. For example, the pixel mapping relationship may be implemented in a matrix form, and the pixel mapping relationship may hold mapping values corresponding to respective pixel parameters in the light emitting unit. And for a certain light-emitting unit, after acquiring the initial pixel parameters from the image to be displayed, adjusting the initial pixel parameters according to the pixel mapping relation to obtain the final corresponding pixel parameters of the light-emitting unit.
And step S206, controlling the display device to display at least a part of the image area of the image to be displayed based on the pixel parameter.
The pixel parameter may specifically be a luminance value of each sub-pixel in the display device, or may also be a voltage value, a current value, and the like for controlling each sub-pixel, which is not limited in the embodiment of the present invention.
The display control method described above, the light emitting unit in the display device has a plurality of kinds of sub-pixel arrangements, and the pixel mapping relationship of the display device is determined according to the arrangement information of the sub-pixels of the light emitting unit of the display device; when an image to be displayed needs to be displayed, determining pixel parameters of a display device according to the pixel mapping relation and the image to be displayed; and then controlling the display device to display at least a part of the image area of the image to be displayed based on the pixel parameters. In this aspect, the pixel mapping relationship of the display device may be determined in advance based on the arrangement information of the subpixels of the display device, and the pixel parameters of the display device may be adjusted based on the pixel mapping relationship, so that even if the display device has a plurality of types of subpixel arrangements, the pixel parameters of each light-emitting unit may be adjusted as a whole based on the pixel mapping relationship, so that the displayed image region achieves a predetermined display effect, thereby improving the display effect of the image.
Example three:
the embodiment of the invention also provides another display control method which is realized on the basis of the method of the embodiment; the pixel mapping relation is determined by the following method: and determining the pixel mapping relation according to the pixel matrix corresponding to the sample set and the arrangement information of the sub-pixels of the light-emitting unit of the display device.
The method mainly describes that a pixel mapping relation is determined according to a pixel matrix corresponding to a sample set and target pixel positions corresponding to sub-pixels in each light-emitting unit in a display device, wherein the sample set generally comprises at least one image, the number of the images in the sample set is not particularly limited, and for example, the sample set can comprise several images, dozens of images, hundreds of images or even thousands of images.
As shown in fig. 3, the manner of determining the pixel mapping relationship includes the following steps:
step S302, inputting a pixel matrix corresponding to the sample set into a target neural network to obtain an output result;
step S304, determining a loss value based on the output result and the arrangement information of the sub-pixels of the light emitting unit of the display device;
step S306, carrying out iterative training on the target neural network based on the loss value to obtain a target loss value meeting a target training condition, and determining the output result corresponding to the target loss value as the pixel mapping relation;
the target neural network can be realized through an existing target neural network model; in the target neural network, operations such as convolution and pooling can be performed on the input pixel matrix.
And when the iterative training of the target neural network meets the target training condition, stopping the training, wherein the loss value corresponding to the target neural network is the target loss value. In some embodiments, the target training condition is, for example, that the number of iterative training of the target neural network reaches a certain number, the loss value is minimum, or the loss value is smaller than a training threshold, and the like, which is not limited by the embodiments of the present invention. Accordingly, the target loss value may be a minimum loss value, and the like, which is not limited in the embodiment of the present invention. In practical implementation, the sample set may include a plurality of sample sets, each sample set corresponds to one pixel mapping relationship, and a plurality of pixel mapping relationships are obtained in total; then, based on the weight parameter, the multiple pixel mapping relations are weighted and averaged to obtain the final pixel mapping relation.
Specifically, the sample set includes a plurality of samples; each sample set corresponds to a pixel matrix; the step of determining the pixel mapping relationship according to the pixel matrix corresponding to the sample set and the arrangement information of the sub-pixels of the light emitting unit of the display device includes: for each sample set, inputting the pixel matrix corresponding to the sample set into a target neural network to obtain an output result; determining a loss value based on the output result and arrangement information of sub-pixels of a light emitting unit of the display device; performing iterative training on the target neural network based on the loss value to obtain a target loss value meeting a target training condition, and determining the output result corresponding to the target loss value as an initial mapping relation corresponding to the sample set;
and obtaining the pixel mapping relation according to the initial mapping relation corresponding to each sample set. In some embodiments, for example, the initial mapping relationship corresponding to each sample set may be weighted and averaged to obtain the pixel mapping relationship.
The above-mentioned manner for determining the pixel mapping relationship may be understood as setting a loss function according to the arrangement information of the sub-pixels of the light-emitting unit of the display device, wherein the loss function further includes the pixel mapping relationship; the pixel mapping relation, namely the output result, is continuously adjusted through the target neural network until the loss value of the loss function converges to the minimum or the training times are more than or equal to the target times, and the final pixel mapping relation is obtained. By the method, the optimal pixel mapping relation can be obtained by continuously training the target neural network as long as the loss function is reasonably set. The display device renders the image based on the pixel mapping relation, so that the image to be displayed can achieve a specific display effect.
In this embodiment, the arrangement information of the sub-pixels in the light emitting unit includes: the position of the target pixel corresponding to the sub-pixel in each light-emitting unit and the position of the sub-pixel in each light-emitting unit;
specifically, the arrangement information of the sub-pixels of the light emitting unit of the display device may specifically be: the target pixel position corresponding to the sub-pixel of each light-emitting unit in the display device and the position of each sub-pixel. The shape of each light-emitting unit in the display device may be the same or different, for example, the shape of the light-emitting unit may be circular, oval, square, rectangular, rhombic, etc.; however, the light emitting units are often identical or symmetrical in shape, and the light emitting units are regularly arranged, for example, in a regular arrangement such as a rectangular shape or a delta shape.
A step of determining a loss value based on the output result and arrangement information of sub-pixels of a light emitting unit of the display device, including: determining, for each sub-pixel in a light emitting unit of the display device, a position distance between a position of the sub-pixel and a position of a target pixel corresponding to the sub-pixel; determining the loss value based on the output result and the location distance.
The display device comprises a plurality of channels; each channel corresponds to a pixel mapping relationship.
A step of determining a loss value based on the output result and arrangement information of sub-pixels of a light emitting unit of the display device, including: determining a channel position distance between the position of a sub-pixel and the position of a target pixel corresponding to the sub-pixel for the sub-pixel of a target channel in a light emitting unit of the display device; and determining a loss value corresponding to the target channel based on the output result and the channel position distance.
The iterative training of the target neural network based on the loss value to obtain a target loss value meeting a target training condition, and the determining of the output result corresponding to the target loss value as the pixel mapping relationship includes: performing iterative training on the target neural network according to the loss value corresponding to the target channel to obtain a target channel loss value meeting a target training condition; and determining the output result corresponding to the loss value of the target channel as the pixel mapping relation corresponding to the target channel.
The kind of the sub-pixel of the light emitting unit corresponds to the target channel, and each sub-pixel corresponds to one target channel. The following description will be given taking an example in which three kinds of sub-pixels of RGB are provided in a light emitting unit.
When there are three RGB sub-pixels in the light-emitting unit, the target channel is R, G, B display channels correspondingly. Accordingly, loss values corresponding to R, G, B three display channels may be determined, respectively, based on the output result and the arrangement information of R, G, B three kinds of sub-pixels in the light emitting unit of the display device. And performing iterative training on the target neural network, and determining target loss values corresponding to R, G, B three display channels respectively when the target loss values meet target training conditions. And determining the output results corresponding to the target channel loss values as the pixel mapping relations corresponding to the target channels, that is, determining the output results corresponding to the target channel loss values of R, G, B as the pixel mapping relations of R, G, B three display channels. In some embodiments, according to R, G, B pixel mapping relationships of three display channels and an image to be displayed, pixel parameters of R, G, B three sub-pixels in a light-emitting unit of a display device can be respectively determined.
The position of each sub-pixel in the arrangement information of the sub-pixels can be understood as the position of each sub-pixel in the light emitting unit. Specifically, the position of each sub-pixel in the light-emitting unit may be characterized based on the target pixel position corresponding to the sub-pixel, for example, the position of the sub-pixel may be characterized by parameters such as the distance and the direction of the sub-pixel relative to the target pixel position corresponding to the sub-pixel. A sub-pixel may be understood as a light emitting device mounted in a display apparatus; when there are three kinds of RGB sub-pixels in the light emitting unit, the display device may have R, G, B three display channels, and the number of each sub-pixel may be the same and may be different; the number of each sub-pixel may be one or more. In practical implementation, for example, the R, G, B sub-pixels in the light-emitting unit can be implemented by R, G, B three-color light-emitting diodes, the three-color light-emitting diodes jointly constitute the light-emitting unit, parameters such as the brightness of the light-emitting diodes corresponding to R, G, B three colors can be adjusted, when the three colors of light are overlapped with each other, the colors are mixed, so that the color and the brightness of the light-emitting unit are changed, and the light-emitting unit is jointly made to emit the light with the corresponding color and brightness by R, G, B three sub-pixels.
Fig. 4 is a schematic view of a whole or a part of a display device in which sub-pixels in each light emitting unit are arranged in a non-repetitive manner and the arrangement of sub-pixels in each light emitting unit is different. In this embodiment, the light emitting units are arranged in a circle as an example; the circle in FIG. 4 can be understood as the virtual shape of the light-emitting unit, the "sharp" shape inside the circle, i.e. the target pixel position corresponding to the sub-pixel in the light-emitting unit; the dummy shape of the light emitting unit is not normally present in the display device, but the sub-pixels in the light emitting unit are actual components in the display device. For a light emitting unit, each sub-pixel may be located at the same distance from the target pixel or may be located at a different distance from the target pixel. It should be noted that one sub-pixel may correspond to one target pixel, multiple sub-pixels may correspond to one target pixel, or multiple sub-pixels in one light emitting unit may correspond to one target pixel together, which is not limited in this embodiment of the present invention. For example, for a light emitting unit including RGB sub-pixels, the R sub-pixel in each light emitting unit corresponds to a first target pixel, the G sub-pixel in each light emitting unit corresponds to a second target pixel, the B sub-pixel in each light emitting unit corresponds to a third target pixel, and a virtual pixel unit is composed of the first target pixel, the second target pixel, and the third target pixel, and the plurality of virtual pixel units are arranged repeatedly. For example, for a light-emitting unit including RGB sub-pixels, the R, G, B sub-pixels in one light-emitting unit may also all correspond to the same target pixel.
Since the light emitting unit in the display device has a plurality of kinds of sub-pixel arrangements in the present embodiment; it is thus necessary to acquire arrangement information of the sub-pixels of each light emitting unit of the display device. Based on this, in the step of determining the loss value based on the output result and the arrangement information of the sub-pixels of the light emitting unit of the display device, specifically, for each sub-pixel in a specified channel in the display device, the position of the sub-pixel and the position distance of the target pixel position corresponding to the sub-pixel may be determined; target pixels corresponding to each sub-pixel are arranged according to a target rule; a loss value is then determined based on the output and the location distance. For example, the target rule may be a repetitive arrangement, for example, the shape parameters, the size parameters, and the setting posture parameters of the plurality of target pixels are the same, and/or the plurality of target pixels are uniformly distributed, where the shape parameters, the size parameters, and the setting posture parameters are described above and are not described herein again. For example, the repetitive arrangement may also be understood as that the relative positional relationship between each target pixel and other adjacent target pixels is the same.
The display device may include only one display channel, or may include a plurality of display channels; in most cases, the display device includes a plurality of display channels, such as the RGB three display channels described above, or the RGBC four display channels. The designated channel may be all display channels in the display device or may be a part of the display channels. In one implementation, if the display device includes a plurality of display channels, each display channel may be used as a designated channel one by one, and a pixel mapping relationship corresponding to the designated channel is obtained. Of course, all display channels in the display device may be used as the designated channels, and the pixel mapping relationship corresponding to the designated channels may be obtained.
In this embodiment, the sub-pixels in the display device have multiple arrangement modes, and the arrangement is not regular; and thus the light emitting cells composed of the sub-pixels, may also have an irregular arrangement. In order to make such a display device display an image to be displayed, the luminance centers of the light emitting units are regularly arranged, and it is necessary to set a target pixel position corresponding to each sub-pixel.
In one embodiment, one light-emitting unit corresponds to one target pixel position; the target pixel positions are arranged according to a target rule. In one embodiment, the target rule may be understood as: the target pixel positions of the light-emitting units in the same preset row are positioned on a horizontal line; the target pixel positions of the light emitting units in the same preset column are located on a vertical line. If the light-emitting units are regularly arranged, the target pixel position corresponding to the light-emitting units is the central position of the light-emitting units; if the light emitting cells are not regularly arranged, the target pixel positions of the light emitting cells may be deviated from the center positions of the light emitting cells.
The target pixel position corresponding to the sub-pixel can be specifically understood as a target pixel position of a light emitting unit to which the sub-pixel belongs. In this embodiment, the position of each sub-pixel or the target pixel position, etc. may be represented by coordinates, and based on the coordinates of the sub-pixel and the coordinates corresponding to the target pixel position corresponding to the sub-pixel, a position distance between the sub-pixel and the target pixel position corresponding to the sub-pixel may be calculated, where the position distance may represent a pixel arrangement of the sub-pixel in the light emitting unit. Due to the light emitting unit in the display device, there are various kinds of sub-pixel arrangements; therefore, in the display device, the position distance between the sub-pixel in at least one light-emitting unit and the target pixel position corresponding to the sub-pixel is different from that of other light-emitting units; in many cases, the sub-pixels in the display device may have a plurality of positional distances from the target pixel position corresponding to the sub-pixel.
Specifically, when the position of the sub-pixel and the position distance of the target pixel position corresponding to the sub-pixel are determinedThe position distance may be calculated by the following formula: d ═ e-((x-x’)^2+(y-y’)^2)/2；
Wherein d is the position distance; e is a natural logarithm; x is the abscissa of the sub-pixel; x' is the abscissa of the target pixel corresponding to the sub-pixel; y is the ordinate of the sub-pixel; y' is the ordinate of the target pixel corresponding to the sub-pixel.
In some embodiments, the location of a pixel may be represented by its abscissa, ordinate, etc.
In determining the loss value based on the output result and the position distance, the loss value is determined by the following formula:
Loss＝2*trace(Icov*K1*W)+trace(Icov*WT*K2*W)；
wherein Loss is a Loss value; trace represents the trace of the matrix; i iscovA pixel matrix corresponding to the sample set; k1The distance matrix is a distance matrix, and the distance matrix comprises the position distance corresponding to each sub-pixel in the display device; w is the output result; wTA transposed matrix that is W; k2Is an identity matrix.
In some embodiments, the loss value for each channel of the display device may be determined by the above formula. When the Loss value corresponding to the target channel is Loss, the output result corresponding to the target channel is W. When the light-emitting unit has three RGB sub-pixels, the target channel is R, G, B display channels correspondingly, and the content related to the target channel is please refer to the above, which is not described herein again.
In the loss function, the position distance corresponding to each sub-pixel in the display device represents the arrangement of multiple sub-pixels of each light-emitting unit in the display device; the loss function also includes an output result representing the pixel mapping relationship. In the process of continuously training and adjusting the output result, the pixel mapping relation can be more matched with the arrangement of various sub-pixels of each light-emitting unit in the display device through the loss function, when the loss value is converged or trained for a certain number of times, the pixel mapping relation is the highest in matching with the arrangement of various sub-pixels of each light-emitting unit in the display device, and the display device carries out image rendering based on the pixel mapping relation so as to obtain the preset display effect.
In addition, in the above manner of determining the pixel mapping relationship, the pixel matrix corresponding to the sample set needs to be input into the target neural network, and then the target neural network outputs the initial output result representing the pixel mapping relationship; therefore, the selection of the pixel matrix corresponding to the sample set has an important influence on the accuracy of the pixel mapping relationship. Based on this, the present embodiment further describes how to determine the pixel matrix corresponding to the sample set, and specifically includes the following steps 01-03:
step 01, obtaining a sample set; wherein the sample set comprises at least one image;
step 02, converting image pixels in each image in the sample set into a one-dimensional matrix aiming at each image in the sample set; calculating the product of the one-dimensional matrix and the transpose matrix of the one-dimensional matrix to obtain a product matrix;
and step 03, determining an expected matrix corresponding to the sample set according to the product matrix, and determining the expected matrix as a pixel matrix corresponding to the sample set. Specifically, the expectation matrix corresponding to the sample set may be obtained by solving an expectation for product matrices corresponding to all images in the sample set to obtain an expectation matrix corresponding to the sample set.
The sample set may be obtained from an existing image dataset, such as the CIFAR100 dataset. Image pixels in the image may include brightness parameters, color parameters, etc. of the image pixels; generally, image pixels in an image are arranged in a two-dimensional matrix, and for convenience of operation, the image pixels in the image are converted into a one-dimensional matrix. In one implementation, the one-dimensional matrix may be a row matrix or a column matrix. In the conversion process, the pixels of each row of pixel rows in the image can be connected end to end, or the pixels of each column of pixel columns can be connected end to end, so as to obtain the one-dimensional matrix.
After the one-dimensional matrix of the image is obtained, the image is further operated, namely, the product of the one-dimensional matrix and the transpose matrix of the one-dimensional matrix is calculated to obtain a product matrix. Limited by a matrix multiplication rule, in order to obtain a two-dimensional matrix after the matrix multiplication, a column matrix needs to be multiplied by a row matrix, and based on the multiplication, if the one-dimensional matrix is a column vector, the one-dimensional matrix is multiplied by a transpose matrix of the one-dimensional matrix to obtain a product matrix; and if the one-dimensional matrix is a row vector, multiplying the transposed matrix of the one-dimensional matrix by the one-dimensional matrix to obtain a product matrix.
In some embodiments, the expectation matrix corresponding to the sample set is obtained by calculating an expectation of a product matrix corresponding to a plurality of images in the sample set. The expected matrix of the product matrix corresponding to each image is obtained by calculating the expected matrix from the product matrix corresponding to the plurality of images, so that image pixels in the expected matrix have the commonality of the image pixels of the plurality of images and can represent the characteristics of the image pixels of most images.
After the pixel mapping relation is determined in the above manner, when an image to be displayed needs to be displayed, converting image pixel parameters of the image to be displayed into a one-dimensional matrix; the one-dimensional matrix corresponding to the image to be displayed comprises a column vector or a row vector; calculating the product of the one-dimensional matrix corresponding to the image to be displayed and the pixel mapping relation to obtain a one-dimensional pixel matrix corresponding to the display device; and converting the one-dimensional pixel matrix of the display device into pixel parameters of the display device according to the pixel scale of the display device.
Aiming at the image pixel parameter of each channel of the image to be displayed, converting the image pixel parameter of the channel into a one-dimensional matrix; the one-dimensional matrix corresponding to the channel comprises a column vector or a row vector; calculating the product of the one-dimensional matrix corresponding to the channel and the pixel mapping relation corresponding to the channel to obtain the one-dimensional pixel matrix corresponding to the channel in the display device; and converting the one-dimensional pixel matrix of the corresponding channel in the display device into the pixel parameter of the corresponding channel in the display device according to the pixel scale of the corresponding channel in the display device.
In some embodiments, the sub-pixels in at least two light emitting cells of the display device are arranged non-repetitively.
In addition, if the display device includes a plurality of display channels, one pixel mapping relationship may be determined according to each display channel; then, when the image to be displayed is displayed, for each display channel, the image pixel corresponding to the display channel is extracted from the image to be displayed, and then the image pixel is converted into a one-dimensional matrix. And calculating the product of the one-dimensional matrix and the pixel mapping relation corresponding to the display channel to obtain a one-dimensional pixel matrix, and converting the one-dimensional pixel matrix into pixel parameters of the display device under the display channel according to the pixel scale of the display channel of the display device. The following description will take an example in which three kinds of sub-pixels of RGB are provided in a light emitting unit. For R, G, B three display channels, image pixels corresponding to R, G, B three display channels are extracted from the image to be displayed respectively, and a one-dimensional matrix corresponding to R, G, B three display channels is obtained. And respectively calculating the product of the one-dimensional matrixes corresponding to R, G, B three display channels of the display device and the pixel mapping relation corresponding to R, G, B three display channels to respectively obtain the one-dimensional pixel matrixes corresponding to R, G, B three display channels. And respectively converting the one-dimensional pixel matrix corresponding to the R, G, B three display channels into pixel parameters of R, G, B three display channels in the display device according to the R, G, B one-dimensional pixel matrix corresponding to the three display channels and the pixel scales of R, G, B three display channels of the display device. And controlling the display device to display the image to be displayed based on R, G, B pixel parameters of the three channels.
As can be seen from the foregoing embodiments, for a display device, the display device has a certain pixel mapping relationship, and no matter which image the display device displays, the pixel parameters are adjusted based on the pixel mapping relationship; the pixel mapping relationship is usually a matrix, and the scale of the matrix is usually fixed. Therefore, the dimension of the one-dimensional matrix corresponding to the image to be displayed multiplied by the pixel mapping relationship is relatively fixed. If the number of the image pixels of the image to be displayed is less, the number of the image pixels of the image to be displayed can be expanded in an interpolation mode, so that the scale of the one-dimensional matrix corresponding to the image to be displayed is matched with the pixel mapping relation. If the number of the image pixels of the image to be displayed is large, the one-dimensional matrix corresponding to the image to be displayed can be obtained in a manner of extracting part of the pixels, so that the scale of the one-dimensional matrix corresponding to the image to be displayed is matched with the pixel mapping relation.
When the one-dimensional matrix corresponding to the image to be displayed is a column vector, the one-dimensional matrix corresponding to the image to be displayed uses InThe dimension of the one-dimensional matrix is n x 1, InThe scale of (d) may also be the number of logical pixels; w represents a pixel mapping relation, and the scale of W is m x n; at this time, a one-dimensional matrix I of pixel parameters of the display devicem＝W*In(ii) a Wherein, ImThe dimension of (a) is m x 1; i ismIs a row vector, ImMay also be understood as the number of sub-pixels in the display device. After obtaining a one-dimensional matrix of pixel parameters of the display device, I may be adjusted according to the number of rows of the display devicemThe pixel parameters are divided into a plurality of rows to form a two-dimensional matrix type display device. The pixel parameter may specifically be pixel brightness, ImIncluding the luminance values of the individual sub-pixels in the display device.
When the one-dimensional matrix corresponding to the image to be displayed is a row vector, the one-dimensional matrix corresponding to the image to be displayed uses InIndicating that the dimension of the one-dimensional matrix is 1 x n; w represents a pixel mapping relation, and the scale of W is n m; at this time, a one-dimensional matrix I of pixel parameters of the display devicem＝InW; wherein, ImThe dimension of (a) is 1 × m; i ismIs a column vector. After obtaining a one-dimensional matrix of pixel parameters of the display device, I can be adjusted according to the number of columns of the display devicemAnd dividing the pixel into a plurality of columns to form pixel parameters of the display device in a two-dimensional matrix form.
In addition, the step of determining the pixel parameter of the display device according to the pixel mapping relationship and the image to be displayed can be further implemented by the following method: step 12, determining at least two adjustment modes of sub-pixel parameters according to the pixel mapping relation; the at least two pixel parameter adjusting modes include a first adjusting mode and a second adjusting mode.
The above adjustment manner may be understood as an adjustment range of the pixel parameter, or an adjustment range combination, and the like. For example, when the pixel parameter is brightness, the adjustment may be a brightness increase of 10 for the light emitting unit a, a brightness decrease of 20 for the light emitting unit B, and so on. For another example, taking the light emitting unit comprising RGB sub-pixels as an example, for the light emitting unit a, the adjustment manner may be that the luminance of the R sub-pixel is increased by 10, and the luminance of the G and B sub-pixels is increased by 30, and for the light emitting unit B, the adjustment manner may be that the luminance of the R sub-pixel is increased by 30, and the luminance of the G and B sub-pixels is decreased by 10, etc. The adjustment modes of at least two pixel parameters are determined according to the arrangement information of the sub-pixels of the light-emitting units, and may be understood as the adjustment mode of at least one light-emitting unit in the display device is different from the adjustment modes of other light-emitting units, the adjustment mode corresponding to the at least one light-emitting unit may be understood as the first adjustment mode, and the adjustment mode of part or all of the other light-emitting units may be understood as the second adjustment mode. In practical implementation, according to the arrangement information of different sub-pixels of the light emitting unit, more than two adjustment manners of the pixel parameter may also be included, for example, in addition to the light emitting unit adjusted in the first adjustment manner and the second adjustment manner, the display device further includes a light emitting unit adjusted in a third adjustment manner, a fourth adjustment manner, and the like.
Step 14, adjusting the pixel parameters of at least one light-emitting unit of the display device by adopting a first adjusting mode; and adjusting the pixel parameters of part or all of the light-emitting units of the display device except for at least one light-emitting unit by adopting a second adjusting mode.
Since the arrangement of the sub-pixels in the light-emitting units in the display device is different and does not have any regularity, for example, the relative positions and distances between the initial brightness center and the target brightness center of the light-emitting units are different, in order to make the target brightness center of each light-emitting unit satisfy the target display parameters, all the pixels of the light-emitting units in the display device cannot be adjusted in the same adjustment manner, and the pixel parameters need to be adjusted in a pixel adjustment manner matched with the light-emitting units according to the relative positions, distances, and the like between the initial brightness center and the target brightness center of each light-emitting unit. For example, if two pixel parameter adjustment manners, namely a first adjustment manner and a second adjustment manner, are determined according to the arrangement information of the sub-pixels of the light emitting units, the pixel parameter of at least one light emitting unit in the display device is adjusted by the first adjustment manner, and the pixel parameter of all or part of the light emitting units except for at least one light emitting unit in the display device is adjusted by the second adjustment manner.
The step of determining the pixel parameter of the display device according to the pixel mapping relationship and the image to be displayed may be further implemented by:
and step 22, determining the initial brightness center of the image area corresponding to the light-emitting unit in at least one part of the image area displayed by the light-emitting unit according to the pixel mapping relation for each light-emitting unit.
The above initial luminance center may be understood as an initial position of the luminance center displayed before the luminance of the pixel of the light emitting unit is adjusted for each light emitting unit. In practical implementation, considering that different light-emitting units usually have different arrangement information of sub-pixels, such as different sub-pixel arrangement modes, when determining the initial brightness center of the image area corresponding to the light-emitting unit in at least a part of the image area displayed by the light-emitting unit, the initial brightness center needs to be determined for each light-emitting unit.
And 24, adjusting the brightness of the pixels of the light-emitting units of the display device according to the initial brightness center corresponding to each light-emitting unit and the target display parameters.
In this embodiment, the initial brightness center corresponding to each light-emitting unit and the target display parameter may be understood as arrangement information of sub-pixels in the light-emitting unit in the above embodiment. The target display parameter may be a luminance uniformity of at least a part of the image region displaying the image to be displayed, or a luminance or a color of at least a part of the image region displaying the image to be displayed may be changed according to a preset rule. In one embodiment, the target display parameters may include one or more of the following:
the first parameter is as follows: the target brightness center of each light emitting unit is the same distance from the target brightness center of each light emitting unit in a preset direction adjacent to the light emitting unit. In the display technology, human eyes perceive the brightness center most strongly, and the following description is given by taking an example that the light-emitting unit includes RGB sub-pixels and the RGB sub-pixels are arranged in a triangle, because human eyes have relatively higher sensitivity to the G sub-pixel, even if the brightness values of the RGB sub-pixels are the same, the brightness center may be shifted and is usually closer to the G sub-pixel. For example, the human eye sensitivity to three sub-pixels is respectively 70% for the G sub-pixel, 20% for the R sub-pixel, and 10% for the B sub-pixel, and if the luminance is different, the luminance center usually needs to be recalculated; the brightness center of the light emitting unit can be calculated by the prior art, and is not described in detail herein. The target luminance center can be understood as a position of the luminance center that can satisfy the target display parameter, for example, the light emitting unit includes RGB sub-pixels, and the RGB sub-pixels are arranged in a triangle, the target luminance center can be a center of the RGB sub-pixels arranged in a triangle, or an arbitrary position of a triangle region formed by the RGB sub-pixels; the predetermined direction may be above, below, left or right of the light emitting unit, etc.
And a second parameter: when the target display parameters for making the brightness of at least a part of the image area of the image to be displayed uniform are required, the brightness centers of the light-emitting units are generally required to be uniformly distributed, and in this case, the target brightness center of each light-emitting unit is the same as the distance between the target brightness center of each light-emitting unit in the preset direction adjacent to the light-emitting unit. Equivalent to uniformly distributing the target luminance centers of each light emitting unit in a given display area, the uniform distribution of the target luminance centers can also be understood as equal distances between the target luminance centers of adjacent light emitting units in the horizontal and vertical directions, etc.
And (3) parameters III: the target brightness center of each light-emitting unit and the target brightness center of the light-emitting unit belonging to the same row of the light-emitting unit are positioned on the same horizontal line. In order to make the brightness of at least a part of the image area of the image to be displayed more uniform, it is also possible to generally make the target brightness center of each light-emitting unit in the same row on the same horizontal line for each row of light-emitting units in the designated display area, and the horizontal line is generally required to be sufficiently straight.
And a fourth parameter: the target brightness center of each light-emitting unit and the target brightness centers of the light-emitting units in the same column to which the light-emitting unit belongs are located on the same vertical line. In order to make the brightness of at least a part of the image area to be displayed more uniform, it is also possible to generally make the target brightness center of each light-emitting unit in the same column on the same vertical line for each column of light-emitting units in the designated display area, and it is generally required that the vertical line is sufficiently straight.
In an embodiment, the target display parameters may further include display parameters of the reference image. The reference image can be pre-stored locally or acquired from a network; the reference image may be an original image or an image processed based on the original image. The display parameter of the reference image may be a parameter such as a pixel value, luminance, or color of the reference image, or may be a parameter obtained by processing based on a parameter such as a pixel value, luminance, or color. The brightness of the pixels of the light emitting unit of the display device is adjusted based on the display parameters of the reference image, so that the display effect of the image to be displayed by the display device is similar to that of the reference image. Further, in order to make the display effect of the image to be displayed by the display device have universality, the display parameters of the reference image can be obtained based on a large number of original images, for example, the expected value, the average value and the like of the parameters such as the pixel values, the brightness, the colors and the like of the large number of original images are calculated, and the calculation result is used as the display parameters of the reference image, so that the preset display effect can be obtained by displaying various images to be displayed based on the display parameters of the reference image.
In practical implementation, the brightness of the display image can be made uniform by a Rendering algorithm, which may be an SPR (Sub Pixel Rendering) algorithm or other Rendering algorithm; the rendering algorithm module can also be called as a controller, and the controller is used for realizing the one or more target display parameters, sending the image to be displayed to the controller after acquiring the image to be displayed, and rendering the image to be displayed through the controller to finally obtain a rendered image.
In practical implementation, the step 24 can be implemented by the following steps 30 to 31:
step 30, determining a target brightness center of each light-emitting unit according to the target display parameters; in practical implementation, the step 30 can be implemented by the following steps 301 to 302:
step 301, for each light emitting unit, establishing the following constraint equation according to the target display parameter, wherein the constraint equation can be understood as an equation formed by some conditions that must be satisfied in order to reach the target display parameter:
the target brightness centers of the light-emitting units are the same as the distance between the target brightness center of each light-emitting unit in the preset direction adjacent to the light-emitting unit; in practical implementation, for a current light-emitting unit, a target brightness center of the current light-emitting unit and a target brightness center of a left-side adjacent light-emitting unit, a target brightness center of a right-side adjacent light-emitting unit, or a distance between the target brightness centers of two left-side adjacent light-emitting units and the target brightness center of the right-side adjacent light-emitting unit in the same row may be calculated first; then, calculating the target brightness center of the current light-emitting unit and the target brightness center of the light-emitting unit adjacent to the upper side and the target brightness center of the light-emitting unit adjacent to the lower side in the same column, or calculating the distance between the target brightness centers of the two light-emitting units adjacent to each other up and down; the constraint condition may be understood as that, for the current light-emitting unit, the target luminance center of the light-emitting unit is the same distance from the target luminance center of each light-emitting unit adjacent to the light-emitting unit, above, below, left, right, or the like.
The sum of absolute values of differences between the ordinate of the target brightness center of each light-emitting unit of the same row to which the light-emitting unit belongs and a preset standard ordinate is zero; in practical implementation, a specified light-emitting unit can be selected from the row to which the current light-emitting unit belongs according to a preset rule, and the ordinate of the target brightness center of the specified light-emitting unit can be understood as a preset standard ordinate; for example, for each row of light-emitting units in the designated display area, the first light-emitting unit from the left in the row to which the current light-emitting unit belongs may be selected as the designated light-emitting unit; or, if the designated display area includes multiple rows of light-emitting units, selecting a first light-emitting unit from the left number from the first row of light-emitting units as a designated light-emitting unit, selecting a second light-emitting unit from the left number from the second row of light-emitting units as a designated light-emitting unit, and so on until all the multiple rows of light-emitting units select corresponding designated light-emitting units; specifically, the rule for selecting the designated light-emitting unit can be determined according to actual requirements.
The constraint condition may be understood as that, after a specified light-emitting unit is selected from a row to which a current light-emitting unit belongs, an absolute value of a difference between a vertical coordinate of a target luminance center of each light-emitting unit in the row and a preset standard vertical coordinate is calculated, so that a sum of the calculated absolute values of the differences is zero; it is also understood that a horizontal line is drawn with reference to the target luminance center of the selected specified light-emitting unit, and the lateral shift loss of each light-emitting unit in the vertical coordinate direction with respect to the horizontal line is calculated from the vertical coordinate of the target luminance center of each light-emitting unit in the row to which the light-emitting unit belongs, the lateral shift loss also corresponds to the lateral shift distance, and the sum of the calculated lateral shift distances is zero.
The absolute value sum of the difference value between the abscissa of the target brightness center of each light-emitting unit in the same column to which the light-emitting unit belongs and the preset standard abscissa is zero; in practical implementation, a specified light-emitting unit can be selected from the column to which the current light-emitting unit belongs according to a preset rule, and the abscissa of the target brightness center of the specified light-emitting unit can be understood as a preset standard abscissa; for example, for each column of light-emitting units in the designated display area, the first light-emitting unit counted from the top in the column to which the current light-emitting unit belongs may be selected as the designated light-emitting unit; or, if the designated display area includes a plurality of rows of light-emitting units, the first light-emitting unit counted from the top can be selected from the first row of light-emitting units counted from the left as the designated light-emitting unit, the second light-emitting unit counted from the top can be selected from the second row of light-emitting units counted from the left as the designated light-emitting unit, and so on until the plurality of rows of light-emitting units all select the corresponding designated light-emitting units; specifically, the rule for selecting the designated light-emitting unit can be determined according to actual requirements.
The constraint condition may be understood as that, after a specified light-emitting unit is selected from a column to which a current light-emitting unit belongs, an absolute value of a difference between an abscissa of a target luminance center of each light-emitting unit in the column and a preset standard abscissa is calculated, so that a sum of the calculated absolute values of the differences is zero; it is also understood that a vertical line is drawn with reference to the target luminance center of the selected specified light-emitting unit, and the vertical offset loss of each light-emitting unit in the abscissa direction with respect to the vertical line is calculated from the abscissa of the target luminance center of each light-emitting unit in the column to which it belongs, the vertical offset loss also corresponding to the vertical offset distance, and the sum of the calculated vertical offset distances is zero.
Step 302, adjusting the initial brightness center of each light-emitting unit based on the constraint equation to obtain the target brightness center of each light-emitting unit.
Adjusting the initial brightness center of each light-emitting unit based on the constraint equation, so that the adjusted initial brightness center of each light-emitting unit in the same row is on the same horizontal line, the adjusted initial brightness center of each light-emitting unit in the same column is on the same vertical line, and for the current light-emitting unit, the distances between the adjusted initial brightness center of the light-emitting unit and the adjusted target brightness center of each light-emitting unit above, below, left or right adjacent to the light-emitting unit are the same; for each light-emitting unit, the adjusted initial brightness center of the light-emitting unit is determined as a target brightness center.
And step 31, adjusting the brightness of the sub-pixels of each light-emitting unit in the display device according to the target brightness center of each light-emitting unit and the initial brightness center corresponding to each light-emitting unit. Specifically, the step 31 can be specifically realized through the following steps 311 to 312:
step 311, for each light emitting unit in the display device, determining a brightness adjustment coefficient of each sub-pixel in the light emitting unit according to the target brightness center and the initial brightness center of the light emitting unit.
The brightness adjustment coefficient can be understood as a proportionality coefficient for adjusting brightness; determining a brightness adjustment coefficient of each sub-pixel in each light-emitting unit according to the coordinates of a target brightness center and the coordinates of an initial brightness center of the light-emitting unit for each light-emitting unit in the display device; for example, taking an example that the light-emitting unit includes RGB sub-pixels, the luminance adjustment coefficients of the R sub-pixel, the G sub-pixel, and the B sub-pixel of the light-emitting unit determined according to the target luminance center and the initial luminance center of a certain specified light-emitting unit are 1.5, 0.8, and 1, respectively; in practical implementation, the brightness adjustment coefficients of the sub-pixels of each light-emitting unit are usually required to be calculated for each light-emitting unit, and the current light-emitting unit can be selected in a preset manner, for example, in a row unit, that is, after the brightness adjustment coefficients of the sub-pixels of each light-emitting unit in a certain row are determined, the brightness adjustment coefficients of the sub-pixels of each light-emitting unit in the next row are continuously determined; or, the current light-emitting unit is selected in units of columns, that is, after the brightness adjustment coefficients of the sub-pixels of each light-emitting unit in a certain column are determined, the brightness adjustment coefficients of the sub-pixels of each light-emitting unit in the next column are continuously determined.
Step 312, adjusting the initial brightness of each pixel in the light emitting unit according to the brightness adjustment coefficient of each pixel, so as to obtain the final brightness of each pixel in the light emitting unit.
The initial brightness may be understood as a brightness value of each sub-pixel before adjusting the brightness of each sub-pixel in each light-emitting unit; the final luminance may be understood as a luminance value of each sub-pixel after adjusting the luminance of each sub-pixel in each light-emitting unit; the brightness value of the sub-pixel is usually between 0 and 255, the brightness close to 255 is higher, the brightness close to 0 is lower, and the rest part belongs to middle tone; in practical implementation, the brightness adjustment coefficient of each sub-pixel may be multiplied by the initial brightness of each sub-pixel in the light-emitting unit correspondingly to obtain the final brightness of each sub-pixel in the light-emitting unit; for example, taking an example that the light-emitting unit includes RGB sub-pixels, initial luminance values of the R sub-pixel, the G sub-pixel, and the B sub-pixel in a certain specified light-emitting unit are 100, 150, and 200, respectively, and luminance adjustment coefficients of the R sub-pixel, the G sub-pixel, and the B sub-pixel of the light-emitting unit determined through the above steps are 1.5, 0.8, and 1, respectively, then final luminance values of the R sub-pixel, the G sub-pixel, and the B sub-pixel in the light-emitting unit are 100 × 1.5 — 150, 150 × 0.8 — 120, and 200 × 1 — 200, respectively.
When the arrangement of the sub-pixels in each light-emitting unit is different and does not have any regularity, taking the case that the light-emitting unit includes three kinds of sub-pixels of RGB as an example, which is equivalent to that the distribution of the three kinds of sub-pixels of RGB in the whole world is non-uniform, at this time, if the luminance of the three kinds of sub-pixels of RGB in each light-emitting unit is consistent, the luminance of at least a part of the image area displaying the image to be displayed is non-uniform, and the display luminance of at least a part of the image area displaying the image to be displayed can be uniform by the above rendering method.
In practical implementation, each sub-pixel of the light emitting unit of the display device generally includes a positive electrode and a negative electrode, the positive electrode and the negative electrode are connected to an external driving circuit through a connecting circuit, and the brightness of the corresponding sub-pixel can be adjusted by controlling the magnitude of the current or the magnitude of the voltage output by the driving circuit.
To further understand the above embodiments, an algorithm flow of a controller is provided below, first calculating an initial brightness center of each light emitting unit in a display device, respectively calculating, for each light emitting unit, a distance between the initial brightness center of the light emitting unit and an initial brightness center of an adjacent light emitting unit, a lateral offset loss of the initial brightness center of each light emitting unit in the same row to which the light emitting unit belongs, and a longitudinal offset loss of the initial brightness center of each light emitting unit in the same column to which the light emitting unit belongs, respectively, and adjusting the initial brightness center of each light emitting unit according to three constraint conditions in a constraint equation in the above embodiments to obtain a target brightness center of each light emitting unit; determining, for each light-emitting unit, a scaling factor of each sub-pixel in the light-emitting unit, which is equivalent to the brightness adjustment factor, according to the target brightness center and the initial brightness center of the light-emitting unit, or applying a constraint to the scaling factor by the constraint condition to obtain the scaling factor of each sub-pixel; the scaling factor can also be understood as the pixel mapping relationship in the above-described embodiment.
Then, according to the proportionality coefficient of each sub-pixel, adjusting the initial brightness of each sub-pixel to obtain the final brightness of each sub-pixel of the light-emitting unit, or adjusting the initial brightness of each sub-pixel in the light-emitting unit through a controller to obtain the final brightness of each sub-pixel in each light-emitting unit of the rendered image, thereby completing the rendering; considering that the arrangement of the sub-pixels of each light-emitting unit in the designated display area has non-repeatability, the initial brightness of the sub-pixels in each light-emitting unit needs to be calculated and adjusted respectively to complete the overall rendering of the designated display area.
Example five:
corresponding to the above method embodiment, referring to fig. 5, a schematic structural diagram of a display control apparatus is shown, the apparatus includes:
the data acquisition module 50 is configured to acquire an image to be displayed and a pixel mapping relationship corresponding to the display device; wherein the pixel mapping relation is determined according to sub-pixels in a light emitting unit of the display device;
a parameter determining module 51, configured to determine a pixel parameter of the display device according to the pixel mapping relationship and the image to be displayed;
and a display control module 52, configured to control the display device to display at least a part of the image area of the image to be displayed based on the pixel parameter.
The display control device, the light emitting unit in the display device has a plurality of pixel arrangements, and the pixel mapping relation of the display device is determined according to the arrangement information of the sub-pixels of the light emitting unit of the display device; when an image to be displayed needs to be displayed, determining pixel parameters of a display device according to the pixel mapping relation and the image to be displayed; and then controlling the display device to display at least a part of the image area of the image to be displayed based on the pixel parameters. In this method, the pixel mapping relationship of the display device is determined in advance according to the arrangement information of the sub-pixels of the display device, and the pixel parameters of the display device are adjusted based on the pixel influence relationship, so that even if the display device has a plurality of pixel arrangements, the pixel parameters of each light-emitting unit can be adjusted on the whole based on the pixel mapping relationship, so that the displayed image area achieves the preset display effect, and the display effect of the image is improved.
Further, the apparatus further includes a relationship determining module, configured to determine the pixel mapping relationship by: inputting the sample image into a target neural network to obtain an output result; determining a loss value based on the output result and arrangement information of the sub-pixels of the light emitting unit of the display device; training a target neural network based on the loss value, and continuing to perform the step of inputting the sample image into the target neural network until the loss value is converged; and determining an output result when the loss value is converged as a pixel mapping relation.
Further, the arrangement information of the sub-pixels of the light emitting unit of the display device includes: the ideal pixel center position corresponding to the physical pixel of each light-emitting unit in the display device and the position of each physical pixel; the relationship determination module is further configured to: determining the position of each physical pixel in a designated channel in the display device and the position distance of the center position of an ideal pixel corresponding to the physical pixel; the center position of an ideal pixel corresponding to each physical pixel has a preset arrangement mode; based on the output and the location distance, a loss value is determined.
Further, the relationship determination module is further configured to: by passingThe position distance is calculated by the following formula: d ═ e-((x-x’)^2+(y-y’)^2)/2(ii) a Wherein d is a position distance; e is a natural logarithm; x is the abscissa of the location of the physical pixel; x' is the abscissa of the center position of the ideal pixel corresponding to the physical pixel; y is the ordinate of the position of the physical pixel; y' is the ordinate of the ideal pixel center position corresponding to the physical pixel.
Further, the relationship determination module is further configured to: the loss value is determined by the following formula: loss 2 trace (Icov K)1*W)+trace(Icov*WT*K2W); wherein Loss is a Loss value; trace represents the trace of the matrix; icov is a sample image; k1The distance matrix comprises the position distance corresponding to each physical pixel in the display device; w is an output result; wTA transposed matrix that is W; k2Is a preset unit matrix.
Further, the relationship determination module is further configured to: obtaining a sample image by: obtaining a sample set; wherein the sample set comprises a plurality of images; for each image in the sample set, converting image pixel parameters in the image into a one-dimensional matrix; calculating the product of the one-dimensional matrix and the transpose matrix of the one-dimensional matrix to obtain a product matrix; and calculating an expected matrix of the product matrix corresponding to each image, and determining the expected matrix as a sample image.
Further, the relationship determination module is further configured to: if the one-dimensional matrix is a column vector, multiplying the one-dimensional matrix by a transposed matrix of the one-dimensional matrix to obtain a product matrix; and if the one-dimensional matrix is a row vector, multiplying the transposed matrix of the one-dimensional matrix by the one-dimensional matrix to obtain a product matrix.
Further, the parameter determination module is further configured to: converting image pixel parameters of an image to be displayed into a one-dimensional matrix; the one-dimensional matrix corresponding to the image to be displayed comprises a column vector or a row vector; calculating a product of a one-dimensional matrix corresponding to the image to be displayed and a pixel mapping relation to obtain a one-dimensional matrix of pixel parameters of the display device; and converting the one-dimensional matrix of the pixel parameters into the pixel parameters of the display device according to the pixel scale of the display device.
The present embodiment also provides an electronic system, including: a processing device and a storage device; the storage means has stored thereon a computer program which, when run by the processing apparatus, performs the display control method as described above.
The present embodiment also provides a machine-readable storage medium having stored thereon a computer program which, when executed by a processing device, performs the steps of the display control method as described above.
The display control device, the electronic system and the machine-readable storage medium provided by the embodiment of the invention have the same technical characteristics as the display control method provided by the embodiment of the invention, so that the same technical problems can be solved, and the same technical effects can be achieved.
The display control method, the display control device, and the computer program product of the system provided in the embodiments of the present invention include a machine-readable storage medium storing a program code, where instructions included in the program code may be used to execute the method described in the foregoing method embodiments, and specific implementations may refer to the method embodiments and are not described herein again.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the system and the apparatus described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In addition, in the description of the embodiments of the present invention, unless otherwise explicitly specified or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, e.g., as meaning either a fixed connection, a removable connection, or an integral connection; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meaning of the above terms in the present invention can be understood in specific cases for those skilled in the art.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
Finally, it should be noted that: although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art will understand that the following embodiments are merely illustrative of the present invention, and not restrictive, and the scope of the present invention is not limited thereto: any person skilled in the art can modify or easily conceive the technical solutions described in the foregoing embodiments or equivalent substitutes for some technical features within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the embodiments of the present invention, and they should be construed as being included therein. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (18)

1. A display control method, characterized in that the method comprises:
acquiring an image to be displayed and a pixel mapping relation corresponding to a display device; wherein the pixel mapping relation is determined according to sub-pixels in a light emitting unit of the display device;
determining pixel parameters of the display device according to the pixel mapping relation and the image to be displayed;
and controlling the display device to display at least a part of the image area of the image to be displayed based on the pixel parameter.
2. The method of claim 1, wherein the pixel mapping relationship is determined by:
and determining the pixel mapping relation according to the pixel matrix corresponding to the sample set and the arrangement information of the sub-pixels of the light-emitting unit of the display device.
3. The method according to claim 1 or 2, wherein the pixel mapping relationship is determined by:
inputting the pixel matrix corresponding to the sample set into a target neural network to obtain an output result;
determining a loss value based on the output result and arrangement information of sub-pixels of a light emitting unit of the display device;
and performing iterative training on the target neural network based on the loss value to obtain a target loss value meeting a target training condition, and determining the output result corresponding to the target loss value as the pixel mapping relation.
4. The method of claim 2 or 3, wherein the sample set comprises a plurality; each sample set corresponds to a pixel matrix;
the step of determining the pixel mapping relationship according to the pixel matrix corresponding to the sample set and the arrangement information of the sub-pixels of the light emitting unit of the display device includes:
for each sample set, inputting the pixel matrix corresponding to the sample set into a target neural network to obtain an output result; determining a loss value based on the output result and arrangement information of sub-pixels of a light emitting unit of the display device; performing iterative training on the target neural network based on the loss value to obtain a target loss value meeting a target training condition, and determining the output result corresponding to the target loss value as an initial mapping relation corresponding to the sample set;
and obtaining the pixel mapping relation according to the initial mapping relation corresponding to each sample set.
5. The method according to any one of claims 1 to 4, wherein the arrangement information of the sub-pixels in the light emitting unit includes: the position of the target pixel corresponding to the sub-pixel in each light-emitting unit, and the position of the sub-pixel in each light-emitting unit.
6. The method according to claim 5, wherein the step of determining a loss value based on the output result and arrangement information of sub-pixels of a light emitting unit of the display device comprises:
determining, for each sub-pixel in a light emitting unit of the display device, a position distance between a position of the sub-pixel and a position of a target pixel corresponding to the sub-pixel;
determining the loss value based on the output result and the location distance.
7. The method according to claim 5, wherein the step of determining a loss value based on the output result and arrangement information of sub-pixels of a light emitting unit of the display device comprises:
determining a channel position distance between the position of a sub-pixel and the position of a target pixel corresponding to the sub-pixel for the sub-pixel of a target channel in a light emitting unit of the display device;
and determining a loss value corresponding to the target channel based on the output result and the channel position distance.
8. The method of claim 7, wherein iteratively training the target neural network based on the loss values to obtain target loss values satisfying target training conditions, and wherein determining the output result corresponding to the target loss values as the pixel mapping relationship comprises:
performing iterative training on the target neural network according to the loss value corresponding to the target channel to obtain a target channel loss value meeting a target training condition;
and determining the output result corresponding to the loss value of the target channel as the pixel mapping relation corresponding to the target channel.
9. The method according to any one of claims 6-8, wherein the step of determining the position distance between the position of the sub-pixel and the position of the target pixel corresponding to the sub-pixel comprises:
calculating the position distance by the following formula: d ═ e-((x-x’)^2+(y-y’)^2)/2；
Wherein d is the position distance; e is a natural logarithm; x is the abscissa of the sub-pixel; x' is the abscissa of the target pixel corresponding to the sub-pixel; y is the ordinate of the sub-pixel; y' is the ordinate of the target pixel corresponding to the sub-pixel.
10. The method of any of claims 1-9, wherein the step of determining a loss value based on the output and the location distance comprises:
the loss value is determined by the following formula:
Loss＝2*trace(Icov*K1*W)+trace(Icov*WT*K2*W)；
wherein Loss is a Loss value; trace represents the trace of the matrix; i iscovA pixel matrix corresponding to the sample set; k1The distance matrix is a distance matrix, and the distance matrix comprises the position distance corresponding to each sub-pixel in the display device; w is the output result; wTA transposed matrix that is W; k2Is an identity matrix.
11. The method according to any one of claims 1-10, wherein the pixel matrix corresponding to the sample set is obtained by:
obtaining a sample set; wherein the sample set comprises a plurality of images;
for each image in the sample set, converting image pixels in the image into a one-dimensional matrix; calculating the product of the one-dimensional matrix and the transpose matrix of the one-dimensional matrix to obtain a product matrix;
and determining an expected matrix corresponding to the sample set according to the product matrix, and determining the expected matrix as a pixel matrix corresponding to the sample set.
12. The method of claim 11, wherein the step of calculating the product of the one-dimensional matrix and the transpose of the one-dimensional matrix to obtain a product matrix comprises:
when the one-dimensional matrix is a column vector, multiplying the one-dimensional matrix by a transpose matrix of the one-dimensional matrix to obtain a product matrix;
and when the one-dimensional matrix is a row vector, multiplying the transposed matrix of the one-dimensional matrix by the one-dimensional matrix to obtain the product matrix.
13. The method according to any one of claims 1 to 12, wherein the step of determining pixel parameters of the display device according to the pixel mapping relationship and the image to be displayed comprises:
converting the image pixel parameters of the image to be displayed into a one-dimensional matrix; the one-dimensional matrix corresponding to the image to be displayed comprises a column vector or a row vector;
calculating the product of the one-dimensional matrix corresponding to the image to be displayed and the pixel mapping relation to obtain a one-dimensional pixel matrix corresponding to the display device;
and converting the one-dimensional pixel matrix of the display device into pixel parameters of the display device according to the pixel scale of the display device.
14. The method according to any one of claims 1 to 12, wherein the step of determining pixel parameters of the display device according to the pixel mapping relationship and the image to be displayed comprises:
aiming at the image pixel parameter of each channel of the image to be displayed, converting the image pixel parameter of the channel into a one-dimensional matrix; the one-dimensional matrix corresponding to the channel comprises a column vector or a row vector;
calculating the product of the one-dimensional matrix corresponding to the channel and the pixel mapping relation corresponding to the channel to obtain the one-dimensional pixel matrix corresponding to the channel in the display device;
and converting the one-dimensional pixel matrix of the corresponding channel in the display device into the pixel parameter of the corresponding channel in the display device according to the pixel scale of the corresponding channel in the display device.
15. A method according to any of claims 1-14, wherein the sub-pixels in at least two of the light-emitting units of the display device are arranged non-repetitively.
16. A display control apparatus, characterized in that the apparatus comprises:
the data acquisition module is used for acquiring an image to be displayed and a pixel mapping relation corresponding to the display device; wherein the pixel mapping relation is determined according to sub-pixels in a light emitting unit of the display device;
the parameter determining module is used for determining pixel parameters of the display device according to the pixel mapping relation and the image to be displayed;
and the display control module is used for controlling the display device to display at least one part of the image area of the image to be displayed based on the pixel parameter.
17. An electronic system, characterized in that the electronic system comprises: a processing device and a storage device;
the storage means has stored thereon a computer program which, when executed by the processing device, performs the display control method according to any one of claims 1 to 15.
18. A machine readable storage medium having a computer program stored thereon, the computer program, when executed by a processing device, performing the steps of the display control method according to any one of claims 1-15.
CN202110304783.2A 2021-03-23 2021-03-23 Display control method, device and electronic system Pending CN113496529A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110304783.2A CN113496529A (en) 2021-03-23 2021-03-23 Display control method, device and electronic system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110304783.2A CN113496529A (en) 2021-03-23 2021-03-23 Display control method, device and electronic system

Publications (1)

Publication Number Publication Date
CN113496529A true CN113496529A (en) 2021-10-12

Family

ID=77997477

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110304783.2A Pending CN113496529A (en) 2021-03-23 2021-03-23 Display control method, device and electronic system

Country Status (1)

Country Link
CN (1) CN113496529A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113971633A (en) * 2021-10-25 2022-01-25 深圳蓝普视讯科技有限公司 Flip chip space pixel arrangement structure, pixel multiplexing method, system, device and storage medium

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113971633A (en) * 2021-10-25 2022-01-25 深圳蓝普视讯科技有限公司 Flip chip space pixel arrangement structure, pixel multiplexing method, system, device and storage medium
CN113971633B (en) * 2021-10-25 2022-12-06 深圳蓝普视讯科技有限公司 Flip chip spatial pixel multiplexing method, system, device and storage medium

Similar Documents

Publication Publication Date Title
US9620050B2 (en) Display method and display device
US9576519B2 (en) Display method and display device
US7965305B2 (en) Color display system with improved apparent resolution
CN108428436B (en) luminance compensation method, luminance compensation device, display device, and storage medium
US9786210B2 (en) Pixel array composed of pixel units, display and method for rendering image on a display
CN111326121B (en) Driving method, driving chip, display device and storage medium
US9589492B2 (en) Pixel array, display and method for presenting image on the display
US10957282B2 (en) Luminance compensation method for a display panel
CN109388448B (en) Image display method, display system, and computer-readable storage medium
WO2019100675A1 (en) Partition-based backlight control method and device
US20210376008A1 (en) Display substrate, display method thereof, display device, and fine metal mask
KR20150142570A (en) Pixel array, display and method for presenting image on the display
CN110246470B (en) Method for performing image adaptive tone mapping and display apparatus employing the same
US10115333B2 (en) Image display method and display apparatus
CN113516939A (en) Brightness correction method and device, display equipment, computing equipment and storage medium
CN113496529A (en) Display control method, device and electronic system
US9508317B2 (en) Display evaluation device, display evaluation method, and non-transitory computer readable medium
CN110322401A (en) Pixel processing method and device
CN114138224B (en) Rendering method and device for sub-pixels in image, computer equipment and storage medium
CN115512654A (en) Image display method and device, display device, electronic device and storage medium
WO2022120799A1 (en) Image processing method and apparatus, electronic device, and storage medium
KR101098641B1 (en) Sub-component based rendering of objects having spatial frequency dominance parallel to the striping direction of the display
CN113139921A (en) Image processing method, display device, electronic apparatus, and storage medium
US20210035526A1 (en) Coordinate mapping method
CN113138735A (en) Display control method, device and electronic system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination