WO2022017271A1 - 显示设备的图像显示方法、设备以及计算机可读存储介质 - Google Patents

显示设备的图像显示方法、设备以及计算机可读存储介质 Download PDF

Info

Publication number
WO2022017271A1
WO2022017271A1 PCT/CN2021/106713 CN2021106713W WO2022017271A1 WO 2022017271 A1 WO2022017271 A1 WO 2022017271A1 CN 2021106713 W CN2021106713 W CN 2021106713W WO 2022017271 A1 WO2022017271 A1 WO 2022017271A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
resolution
pixel
display device
pixels
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2021/106713
Other languages
English (en)
French (fr)
Inventor
弓殷强
赵鹏
余新
陈晨
李屹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Appotronics Corp Ltd
Original Assignee
Appotronics Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Appotronics Corp Ltd filed Critical Appotronics Corp Ltd
Publication of WO2022017271A1 publication Critical patent/WO2022017271A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4053—Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
    • G06T3/4076—Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution using the original low-resolution images to iteratively correct the high-resolution images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/90—Determination of colour characteristics
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/56—Extraction of image or video features relating to colour
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F9/00—Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements
    • G09F9/30—Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements in which the desired character or characters are formed by combining individual elements
    • G09F9/35—Indicating arrangements for variable information in which the information is built-up on a support by selection or combination of individual elements in which the desired character or characters are formed by combining individual elements being liquid crystals
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters

Definitions

  • the present invention relates to the field of display technology, and in particular, to an image display method, a device and a computer-readable storage medium of a display device.
  • Conventional systems or devices for displaying images such as displays, projectors, or other imaging systems, generate displayed images by addressing individual picture elements or arrays of pixels arranged in horizontal rows and vertical columns.
  • the resolution of a displayed image is defined as the number of horizontal rows and vertical columns used to form a single pixel of the displayed image.
  • the resolution of the displayed image is affected by the resolution of the display device itself and the resolution of the image data that is processed by the display device and used to generate the displayed image.
  • Embodiments of the present invention provide an image display method, a device, and a computer-readable storage medium of a display device, so as to solve the problems of poor display effect and blurred displayed images in the existing image display method.
  • the present invention provides an image display method of a display device, in which a pixel gap of a set size exists between pixels of the display device, the method includes: acquiring a first image with a first resolution; Pixels in the image are classified according to odd-even rows and columns; image downsampling is performed on the first image based on each type of pixel in the first image using the pixel gap of the display device to obtain a plurality of different second images with the second resolution. an image, wherein the second resolution is consistent with the resolution of the display device; the plurality of second images are displayed in time series and offset from each other to obtain an image with an enhanced visible display resolution.
  • the image downsampling is performed on the first image based on each type of pixel in the first image by using the pixel gap, so as to obtain a plurality of different second images with a second resolution, wherein the second resolution is the same as that of the display device.
  • Consistent resolution includes:
  • an equation group is established according to the grayscale contribution values of the second image pixel and other pixels in the surrounding 3*3 neighborhood to the corresponding pixel of the first image, and then the pixel grayscale information of the second image is determined.
  • N and M represent the number of rows and columns of the second image, respectively
  • L0(x, y) represents the normalized gray value of the pixel (x, y) of the second image
  • L(x, y) is the first
  • the normalized gray value of the pixel (x, y) of an image L0(-1+x,y), L0(x,y-1), L0(x,y+1), L0(x+1 ,y), L0(x-1,y-1), L0(x-1,y+1), L0(x+1,y-1), L0(x+1,y+1) represent the first Two image pixels (-1+x,y), (x,y-1), (x,y+1), (x+1,y), (x-1,y-1), (x- 1,y+1), (x+1,y-1), (x+1,y+1) normalized gray value, a represents the pixel size of the display device, and the total size of pixels and pixel gaps ratio.
  • the successive over-relaxation iteration method is used to obtain the pixel grayscale information of the second image.
  • classifying the pixels in the first image according to the odd-even row and column includes:
  • Pixels located in odd-numbered rows and odd-numbered columns of the first image are classified into one class.
  • Pixels located in odd-numbered rows and even-numbered columns of the first image are classified into one class.
  • Pixels located in even rows and odd columns of the first image are classified into one class.
  • Pixels located in even-numbered rows and even-numbered columns of the first image are classified into one class.
  • the first image is a first RGB image
  • the second image is a second RGB image
  • Image downsampling is performed on the first image based on each type of pixel in the first image by using the pixel gap to obtain a plurality of different second images with a second resolution, wherein the second resolution is the same as the resolution of the display device Consistent, including:
  • the pixel gap is used respectively, and the first grayscale image is image downsampled based on each type of pixels in the first grayscale image, to obtain A plurality of different second grayscale images corresponding to the three channels are obtained respectively.
  • the second grayscale images corresponding to the three channels are superimposed to obtain a second RGB image.
  • displaying a plurality of second images in time series and offset from each other to obtain an image with enhanced visible display resolution includes:
  • Each second image is shifted by 1/2 pixel unit in a set direction relative to the second image of the previous frame.
  • the present invention also provides a display device, the display device includes a processor, a display device memory and a display module connected to the processor.
  • the display module is used for displaying images
  • the memory stores program data
  • the processor is used for executing the program data to realize the steps of the above image display method.
  • the present invention also provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the above image display method are implemented.
  • the beneficial effects of the present invention are: in the process of image downsampling of the first image, the present application introduces an important factor of the pixel gap of the display device, so that the obtained second image can better adapt to the display device
  • the pixel gap can prevent the pixel crosstalk and other problems that exist when the display device is offset and display multiple second images, so that the presented images are clearer, thereby improving the display capability of the display device.
  • FIG. 1 is a schematic flowchart of an embodiment of an image display method for a display device provided by the present application
  • Fig. 2 is the display image effect comparison diagram that utilizes different display image methods to obtain respectively;
  • FIG. 3 is a schematic structural diagram of an embodiment of a display device provided by the present application.
  • FIG. 4 is a schematic structural diagram of an embodiment of a computer-readable storage medium provided by the present application.
  • a typical model for enhancing the resolution of a display device is to decompose a high-resolution image to be displayed into multiple lower-resolution images, which are then displayed with different offsets and higher frame rates (such as when playing video) These low-resolution images.
  • the principle of this model is: give full play to the visual persistence of the human eye, exchange time for space, and complete things that cannot be accomplished by structure and technology. That is, without increasing the physical resolution of the display device, the visual resolution of the final displayed image is improved by utilizing the feature of the human eye's persistence of vision.
  • the algorithm for processing and splitting the image to be displayed is the key to the above technology. Different splitting methods will result in completely different display effects. Previously common difference algorithms are: direct frame splitting method, weighted average method and internal sampling method. However, the above three split algorithms may cause the final image displayed by the display device to be blurred and unclear, and the display effect needs to be improved.
  • the display device mentioned in this embodiment may be a display connected to a computer host, may be various electronic products with display functions such as mobile terminals such as mobile phones and tablets, or may be a display system including a projection device, this embodiment is here No restrictions.
  • FIG. 1 is a schematic flowchart of an embodiment of an image display method for a display device provided by the present application. Include the following steps:
  • S10 Acquire a first image with a first resolution.
  • the first image may be any image that needs to be displayed with a higher resolution than the display device.
  • a first image is defined to include any drawings, graphics and/or textual characters, symbols, illustrations and/or other representations of information.
  • An image can be a still image, a series of images, or a video.
  • image will be used herein and in the claims, unless specifically stated otherwise, to refer to a still image, a series of images, a video, or any other image displayed by a display system.
  • the acquisition method may be, for example, downloading from the Internet, receiving from other devices, and so on.
  • S20 Classify the pixels in the first image according to odd-even rows and columns.
  • the classification according to odd-even rows and columns means that the pixels of odd-numbered rows and even-numbered rows of the first image are respectively classified into different categories and/or the pixels of odd-numbered columns and even-numbered columns are respectively classified into different categories.
  • the first image is divided into two categories, specifically, the pixels located in odd rows of the first image are divided into one category, and the pixels located in even rows of the first image are divided into another category.
  • the pixels located in the odd-numbered columns of the first image are divided into one type, and the pixels located in the even-numbered columns of the first image are divided into another type.
  • the first image is divided into four categories. Specifically, the pixels located in odd rows and odd columns of the first image are divided into one category, and the pixels located in odd rows and even columns of the first image are divided into one category. The pixels are classified into one class, the pixels located in the even-numbered rows and odd-numbered columns of the first image are classified into one class, and the pixels located in the even-numbered rows and even-numbered columns of the first image are classified into one class.
  • S30 Perform image downsampling on the first image based on each type of pixel in the first image by using the pixel gap, so as to obtain a plurality of different second images with a second resolution, wherein the second resolution is the same as that of the display device. Resolution is the same.
  • the second image has a lower resolution than the first image.
  • the second image is thus also referred to herein as a low-resolution image and the first image is also referred to herein as a high-resolution image. It will be understood by those of ordinary skill in the art that the terms low resolution and high resolution are used herein in a comparative manner and are not limited to any particular minimum or maximum number of pixels.
  • image downsampling is performed on the first image, so as to obtain a plurality of different second images. That is to say, the image downsampling operation of the first image in this embodiment is performed based on different pixel information of the first image, so that the obtained second image corresponds to each type of pixels of the first image one-to-one, and all The combination of the second images can reflect all the pixel information of the first image, that is, the phenomenon that the pixel details of the first image are lost in a large range is not caused.
  • the pixels of the current display device are not densely arranged, but there are gaps of a certain size.
  • the area ratio of the size of the pixel to the total size of the pixel and the gap is called the fill rate .
  • the display device of this embodiment utilizes the high-frequency information at the pixel gap to improve the high-frequency information in the final displayed high-resolution image. That is, the pixel gap is taken into account in the image downsampling operation of the first image, so that the obtained second image can adapt to the pixel gap of the display device, which can prevent the display device from offsetting and displaying multiple second images.
  • the existing pixel crosstalk and other problems make the presented image clearer.
  • a pixel gap can be used to establish a set of equations according to the grayscale contribution values of the pixels of the second image and other pixels in the surrounding 3*3 neighborhood to the corresponding pixels of the first image, and then determine the pixel grayscale of the second image. information. That is, an equation group is established according to the following formula, and then the pixel grayscale information of the second image is obtained:
  • L0(x, y) represents the pixel (x, y) of the second image
  • the normalized gray value of y), L(x, y) is the normalized gray value of the pixel (x, y) of the first image, L0(-1+x,y), L0(x,y) -1), L0(x,y+1), L0(x+1,y)
  • L0(x-1,y-1), L0(x-1,y+1), L0(x+1,y-1), L0(x+1,y+1) represent the Pixels (-1+x,y), (x,y-1), (x,y+1), (x+1,y), (x-1,y-1), (x-1,y +1), (x+1, y-1), (x+1, y+1) normalized gray value
  • a represents the pixel size of the display device, and the ratio of the total size of the pixel and the pixel gap .
  • the Gauss-Seidel iteration method is used to solve the problem, and the successive over-relaxation method is used to accelerate the acquisition of pixel grayscale information of the third image.
  • the Gauss-Seidel iteration method is one of the commonly used iterative methods for solving linear equations. Generally speaking, the Jacobi iteration method converges too slowly and is rarely used in practice. When the Jacobi iteration method converges very slowly, the Gauss-Seidel iteration method is not significantly faster. Therefore, in order to improve the convergence speed, the weighted average is used to obtain the successive over-relaxation iteration method, and the linear equations are set as:
  • the iterative formula of the successive over-relaxation iterative method is:
  • ⁇ (restricted to real numbers) that accelerates convergence, which represents the relaxation factor, representing can be seen as and weighted average of .
  • the independent variable L0(x, y) of the above equation system needs to be greater than 0 and less than 1, and this condition needs to be added to each iterative solution.
  • the relaxation parameter ⁇ affects the speed of convergence and the quality of the image. Its typical value is in the range of 0.9-1.4. A smaller value of ⁇ is a relatively conservative strategy. The convergence speed and display effect may be negatively affected, but the robustness of the system Sex and adaptability will improve. Conversely, a larger value of ⁇ can speed up the convergence speed of the system, but the robustness and adaptability of the system may decrease.
  • K the number of iterations K
  • the second image is the second RGB image.
  • the first grayscale image is subjected to image downsampling based on each type of pixel in the first grayscale image, so as to obtain the corresponding three channels respectively.
  • Multiple different second grayscale images of the channel are possible.
  • the second grayscale images corresponding to the three channels are superimposed to obtain a second RGB image.
  • S40 Display a plurality of second images in time series and offset from each other to obtain images with enhanced visible display resolution.
  • the display position of each second image is offset by a non-integer pixel unit, preferably half a pixel, in a set direction relative to the display position of the previous frame of the second image. distance.
  • the display device divides the first image to be displayed into four subframes.
  • the second subframe is shifted to the right by half a pixel unit relative to the first subframe
  • the third subframe is relative to the second subframe.
  • the final image with enhanced visible display resolution can be obtained by translating downward by half a pixel unit and shifting the fourth subframe upward by half a pixel unit relative to the third subframe.
  • FIG. 2 is a comparison diagram of display image effects obtained by using different display image methods respectively.
  • the first column of each row is the first image to be displayed, that is, the original image
  • the second column of each row is an image directly downsampled to 1/2 pixel of the first image
  • the third column of each row is provided by this application.
  • the resolution of an image with enhanced visible display resolution obtained by using the image display method provided by the present application is much higher than that of an image obtained by directly down-sampling the first image.
  • the image with the enhanced visible display resolution has a smaller difference in resolution between the first image, that is, the original image. Therefore, the image display method provided by the present application can significantly improve the visible resolution of the image.
  • FIG. 3 is a schematic structural diagram of an embodiment of a display device provided by the present application.
  • the display device 100 includes a processor 120 , a display device memory 130 and a display module 110 connected to the processor 120 .
  • the display module 110 is used for displaying images
  • the display device memory 130 stores program data
  • the processor 120 is used for executing the program data to realize the steps of the above image display method.
  • the display device 100 is specifically a projector.
  • the display module 110 receives the second image and sequentially displays the second image to obtain an image with enhanced visible display resolution. More specifically, because each second image is spatially offset from each other, the display module 110 displays the second image at different positions according to the spatial offset of the second image. In this way, when the display module 110 displays the second image corresponding to the first image, it is spaced and temporally offset from each other, thereby creating an image with enhanced visible display resolution. In one embodiment, display module 110 optically manipulates the second image to create an image with enhanced visible display resolution.
  • FIG. 4 is a schematic structural diagram of an embodiment of a computer-readable storage medium provided by the present application.
  • a computer program 201 is stored on the computer-readable storage medium 200.
  • the image display method described above is realized. step.
  • the computer storage medium 200 can be any available medium or data storage device that can be accessed by a computer, including but not limited to magnetic storage (eg, floppy disk, hard disk, magnetic tape, magneto-optical disk (MO), etc.), optical storage (eg, CD, DVD, etc.) , BD, HVD, etc.), as well as semiconductor memory (eg, ROM, EPROM, EEPROM, non-volatile memory 110 (NANDFLASH), solid state disk (SSD)), and the like.
  • magnetic storage eg, floppy disk, hard disk, magnetic tape, magneto-optical disk (MO), etc.
  • optical storage eg, CD, DVD, etc.
  • BD magneto-optical disk
  • HVD etc.
  • semiconductor memory eg, ROM, EPROM, EEPROM, non-volatile memory 110 (NANDFLASH), solid state disk (SSD)
  • the image display method provided by the present application first classifies the first image, then uses pixel gaps to downsample the first image according to the classification result, thereby obtaining a plurality of different second images, and finally displays them according to time series and offset from each other a plurality of second images to obtain images with enhanced visible display resolution.
  • an important factor of the pixel gap of the display device is introduced, so that the obtained second image can better adapt to the pixel gap of the display device, and can prevent the display device from displaying more offsets. Problems such as pixel crosstalk existing in the second image are eliminated, so that the presented image is clearer, thereby improving the display capability of the display device.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Artificial Intelligence (AREA)
  • Multimedia (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Computer Hardware Design (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Chemical & Material Sciences (AREA)
  • Crystallography & Structural Chemistry (AREA)
  • General Engineering & Computer Science (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Transforming Electric Information Into Light Information (AREA)

Abstract

一种显示设备的图像显示方法、显示设备及计算机可读存储介质，该方法包括：获取具有第一分辨率的第一图像（S10）；将第一图像中的像素按照奇偶行列进行分类（S20）；利用像素间隙，基于第一图像中的每类像素对第一图像进行图像下采样，以得到多个不同的，具有第二分辨率的第二图像，其中第二分辨率与显示设备的分辨率一致（S30）；按时序且彼此偏离地显示多个第二图像，以获得具有增强可见显示分辨率图像（S40）。利用上述方法，在对第一图像进行图像下采样的过程中，引入显示设备的像素间隙这一重要因素，使呈现出来的图像更加清晰，从而改善显示设备的显示能力。

Description

显示设备的图像显示方法、设备以及计算机可读存储介质 技术领域
本发明涉及显示技术领域，特别涉及一种显示设备的图像显示方法、设备以及计算机可读存储介质。
背景技术
用于显示图像的常规系统或设备(诸如显示器、投影仪或其它成像系统)通过寻址在水平行和垂直列中所布置的单个画面元素或像素的阵列来生成所显示地图像。所显示图像的分辨率被定义为用于形成所显示图像的单个像素的水平行和垂直列的数目。所显示图像的分辨率受显示设备本身的分辨率以及图像数据的分辨率的影响，所述图像数据是由所述显示设备所处理并用来生成所显示图像的。
典型地，为了增加所显示图像的分辨率，必须增加显示设备的分辨率以及用于生成所显示图像的图像数据的分辨率。然而，增加显示设备的分辨率增加了显示设备的成本和复杂度。另外，可能无法获得和/或可能难于产生较高分辨率的图像数据。
发明内容
本发明实施例提供了一种显示设备的图像显示方法、设备以及计算机可读存储介质，以解决现有的图像显示方法显示效果差，显示的图像模糊不清等问题。
为解决上述技术问题，本发明提供一种显示设备的图像显示方法，该显示设备像素之间存在设定尺寸的像素间隙，该方法包括：获取具有第一分辨率的第一图像；将第一图像中的像素按照奇偶行列进行分类；利用显示设备的像素间隙，基于第一图像中的每类像素对第一图像进行图像下采样，以得到多个不同的，具有第二分辨率的第二图像， 其中第二分辨率与显示设备的分辨率一致；按时序且彼此偏离地显示多个第二图像，以获得具有增强可见显示分辨率图像。
其中，利用像素间隙，基于第一图像中的每类像素对第一图像进行图像下采样，以得到多个不同的，具有第二分辨率的第二图像，其中第二分辨率与显示设备的分辨率一致包括：
利用像素间隙，根据第二图像像素及其周围3*3邻域内的其他像素对第一图像对应像素的灰度贡献值建立方程式组，进而确定第二图像的像素灰度信息。
其中，根据以下公式建立方程式组，进而得到第二图像的像素灰度信息：
Figure PCTCN2021106713-appb-000001
其中，N和M分别表示第二图像的行数和列数，L0(x,y)表示第二图像的像素(x,y)的归一化灰度值，L(x,y)为第一图像的像素(x,y)的归一化灰度值，L0(-1+x,y)、L0(x,y-1)、L0(x,y+1)、L0(x+1,y)、L0(x-1,y-1)、L0(x-1,y+1)、L0(x+1,y-1)、L0(x+1,y+1)分别表示第二图像的像素(-1+x,y)、(x,y-1)、(x,y+1)、(x+1,y)、(x-1,y-1)、(x-1,y+1)、(x+1,y-1)、(x+1,y+1)的归一化灰度值，a表示显示设备的像素尺寸，与像素和像素间隙总尺寸的比值。
其中，采用逐次超松弛迭代法得到第二图像的像素灰度信息。
其中，将第一图像中的像素按照奇偶行列进行分类包括：
将位于第一图像的奇数行以及奇数列的像素划分为一类。
将位于第一图像的奇数行以及偶数列的像素划分为一类。
将位于第一图像的偶数行以及奇数列的像素划分为一类。
将位于第一图像的偶数行以及偶数列的像素划分为一类。
其中，第一图像为第一RGB图像，第二图像为第二RGB图像。
利用像素间隙，基于第一图像中的每类像素对第一图像进行图像 下采样，以得到多个不同的，具有第二分辨率的第二图像，其中第二分辨率与显示设备的分辨率一致，包括：
对具有第一分辨率的第一RGB图像对应三通道的第一灰度图像，分别利用像素间隙，并基于第一灰度图像中的每类像素对第一灰度图像进行图像下采样，以分别得到对应三通道的多个不同的第二灰度图像。
将对应三通道的第二灰度图像叠加，以得到第二RGB图像。
其中，按时序且彼此偏离地显示多个第二图像，以获得具有增强可见显示分辨率图像包括：
每个第二图像相对于其前一帧第二图像按照设定方向平移1/2个像素单位。
为解决上述技术问题，本发明还提供一种显示设备，该显示设备包括处理器以及与处理器连接的显示设备存储器和显示模组。
其中，显示模组用于显示图像，存储器中存储有程序数据，处理器用于执行程序数据以实现上述图像显示方法的步骤。
为解决上述技术问题，本发明还提供一种计算机可读存储介质，计算机可读存储介质上存储有计算机程序，计算机程序被处理器执行时实现上述图像显示方法的步骤。
通过上述方案，本发明的有益效果是：本申请在对第一图像进行图像下采样的过程中，引入显示设备的像素间隙这一重要因素，使得到的第二图像能够更好地适应显示设备的像素间隙，能够防止显示设备在偏移显示多幅第二图像时存在的像素串扰等问题，使呈现出来的图像更加清晰，从而改善显示设备的显示能力。
附图说明
为了更清楚地说明本申请实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本申请的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些 附图获得其他的附图，其中：
图1为本申请提供的显示设备图像显示方法一实施例的流程示意图；
图2是分别利用不同的显示图像方法得到的显示图像效果对比图；
图3是本申请提供的显示设备一实施方式的结构示意图；
图4是本申请提供的计算机可读存储介质一实施方式的结构示意图。
具体实施方式
下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅是本申请的一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本申请保护的范围。
在图像显示领域，目前使用的显示设备例如投影仪的分辨率十分有限。当待显示图像的分辨率大于显示设备的分辨率时，通常需要减少待显示图像的像素个数以匹配显示设备的分辨率。如果直接将经过减少像素个数的待显示图像进行显示，则会造成最终显示图像的细节受到损失，图像模糊不清等不良效果。因此，需要增加显示设备的可见显示分辨率。一种增强显示设备分辨率的典型模型为：将待显示的高分辨率图像分解为多个较低分辨率图像，然后采用不同的偏移量和较高的帧速率(如播放视频时)显示这些低分辨率图像。该模型的原理是:充分发挥人眼的视觉暂留的特点，以时间来换取空间，完成结构及工艺无法完成的事情。即在不提高显示设备的物理分辨率的情况下，利用人眼的视觉暂留的特点，提高最终显示图像的可见分辨率。对待显示图像进行处理和拆分的算法是上述技术的关键。不同的拆分方法将会得到完全不同的显示效果。此前常见的差分算法有：直接拆帧法，加权平均法和内部取样法。但上述三种拆分算法可能会导致显 示设备最终显示的图像模糊不清，显示效果有待提高。
本实施例提到的显示设备可以是与电脑主机连接的显示器，可以是具有显示功能的各种电子产品如手机、平板等移动终端，也可以是包括投影装置的显示系统，本实施例在此不做限制。
参阅图1，图1为本申请提供的显示设备图像显示方法一实施例的流程示意图。包括以下步骤：
S10：获取具有第一分辨率的第一图像。
第一图像可以是分辨率高于显示设备的任意需要显示的图像。第一图像被定义为包括任何图画、图形和/或文字字符、符号、插图和/或其他信息表示。图像可以是静止图像、一系列图像或视频。术语“图像”将用在这里和权利要求中，除非另外有特殊的说明，是指静止图像、一系列图像、视频或者任意其他由显示系统显示的图像。获取途径例如可以从网上下载、从其他设备接收等等。
S20：将第一图像中的像素按照奇偶行列进行分类。
具体地，为了将第一图像中的不同信息提取出来，进而使后续对第一图像进行图像下采样时，能够针对第一图像的不同像素信息进行，首先对第一图像中的像素进行分类操作。而按照奇偶行列进行分类指的是，第一图像奇数行和偶数行的像素分别被分为不同类别和/或奇数列和偶数列的像素分别被分为不同的类别。
在一个具体实施方式中，将第一图像划分为两类，具体地，将位于第一图像的奇数行的像素划分为一类，将位于第一图像的偶数行的像素划分为另一类。或者将位于第一图像的奇数列的像素划分为一类，将位于第一图像的偶数列的像素划分为另一类。
在另一个具体实施方式中，将第一图像划分为四类，具体地，将位于第一图像的奇数行以及奇数列的像素划分为一类，将位于第一图像的奇数行以及偶数列的像素划分为一类，将位于第一图像的偶数行以及奇数列的像素划分为一类，将位于第一图像的偶数行以及偶数列的像素划分为一类。
S30：利用像素间隙，基于第一图像中的每类像素对第一图像进 行图像下采样，以得到多个不同的，具有第二分辨率的第二图像，其中第二分辨率与显示设备的分辨率一致。
在本申请的一种形式中，第二图像具有比第一图像更低的分辨率。从而第二图像在此还被称为低分辨率图像，第一图像在此还被称为高分辨率图像。本领域普通技术人员应当理解，这里依照比较方式来使用术语低分辨率和高分辨率，而不局限于任何特定的最小或最大的像素数目。
首先，根据步骤S20中对第一图像像素的分类结果，对第一图像进行图像下采样，从而得到多个不同的第二图像。也就是说，本实施例对第一图像的图像下采样操作是基于第一图像不同的像素信息进行的，从而使得到的第二图像与第一图像的每类像素一一对应，并且所有的第二图像合并起来能反映第一图像的所有像素信息，也即不会造成第一图像的像素细节大范围丢失的现象。
另外，由于技术所限，目前的显示设备的像素之间不是密集排列的，而是存在一定尺寸的间隙，在本申请中像素的尺寸，与像素和间隙的总尺寸的面积比值称为填充率。本实施例的显示设备为了显示出更高空间分辨率的图像(例如高频条纹等)，利用像素间隙处的高频信息以提高最终显示的高分辨率图像中的高频信息。也即，在对第一图像进行图像下采样的操作中将像素间隙考虑在内，使得到的第二图像能够适应显示设备的像素间隙，能够防止显示设备在偏移显示多幅第二图像时存在的像素串扰等问题，使呈现出来的图像更加清晰。
具体地，步骤S30可利用像素间隙，根据第二图像像素及其周围3*3邻域内的其他像素对第一图像对应像素的灰度贡献值建立方程式组，进而确定第二图像的像素灰度信息。也即，根据以下公式建立方程式组，进而得到第二图像的像素灰度信息：
Figure PCTCN2021106713-appb-000002
其中，x＝1，……，N,y＝1,……，M，N和M分别表示第二图像的行数和列数，L0(x,y)表示第二图像的像素(x,y)的归一化灰度值，L(x,y)为第一图像的像素(x,y)的归一化灰度值，L0(-1+x,y)、L0(x,y-1)、L0(x,y+1)、L0(x+1,y)
、L0(x-1,y-1)、L0(x-1,y+1)、L0(x+1,y-1)、L0(x+1,y+1)分别表示第二图像的像素(-1+x,y)、(x,y-1)、(x,y+1)、(x+1,y)、(x-1,y-1)、(x-1,y+1)、(x+1,y-1)、(x+1,y+1)的归一化灰度值，a表示显示设备的像素尺寸，与像素与和像素间隙的总尺寸的比值。
其中，当a＝1/2时，第一图像的显示效果最佳。
可选地，采用高斯-赛德尔迭代法进行求解，并应用逐次超松弛方法加速得到第三图像的像素灰度信息。
高斯-赛德尔迭代法是解线性方程组的常用迭代法之一，一般说来，Jacobi迭代法收敛太慢，在实践中很少使用。在Jacobi迭代法收敛很慢的情况下，Gauss-Seidel迭代法也并不明显快一些，因此，为提高收敛速度，采用加权平均而得到逐次超松弛迭代法，设线性方程组为：
a i1x 1+a i2x 2+…+a inx n＝b i(i＝1,2,…,n)
逐次超松弛迭代法的迭代公式为:
Figure PCTCN2021106713-appb-000003
Figure PCTCN2021106713-appb-000004
此处假定a ii≠0 i(i＝1,2,…,n)，在很多情况下，它比简单迭代法收敛快，它和简单迭代法的不同点在于计算
Figure PCTCN2021106713-appb-000005
时，利用了刚刚迭代出的
Figure PCTCN2021106713-appb-000006
的值，当系数矩阵严格对角占优或对称正定时，高斯-赛德尔迭代法必收敛。
另外，此处引入一个中间量
Figure PCTCN2021106713-appb-000007
和一个加速收敛的参数ω(限于实数)，该参数表示松弛因子，表示
Figure PCTCN2021106713-appb-000008
可以看做是
Figure PCTCN2021106713-appb-000009
和
Figure PCTCN2021106713-appb-000010
的加权平均。
此外由于显示设备无法突破自身的最大显示亮度，因此上述方程 组的自变量L0(x,y)需要大于0并且小于1，这一条件需要加入每次迭代求解之中。
显然，在该算法中存在两个可调参数：松弛参数ω和迭代次数K。
松弛参数ω影响收敛的速度和图像的质量，其典型值在0.9-1.4的范围，更小的ω取值为相对保守的策略，其收敛速度、显示效果可能受到负面影响，但是系统的鲁棒性和适应性将会提升。反之较大的ω取值可以加快系统的收敛速度，但系统的鲁棒性和适应性可能会下降。
对于迭代次数K的选择，需要综合收敛速度、最终所需的表现力、显示延迟以及系统的运算能力选择。一般来讲，K＝1就可以达到较好的显示效果。如果计算资源较为充足，可以选取较大的K值，例如K＝2到5，可以进一步提高系统的显示效果以及鲁棒性。
若第一图像为第一RGB图像，第二图像为第二RGB图像。
则对具有第一分辨率的第一RGB图像对应三通道的第一灰度图像，分别基于第一灰度图像中的每类像素对第一灰度图像进行图像下采样，以分别得到对应三通道的多个不同的第二灰度图像。
将对应三通道的第二灰度图像叠加，以得到第二RGB图像。
S40：按时序且彼此偏离地显示多个第二图像，以获得具有增强可见显示分辨率图像。
可选地，显示设备在显示第二图像时，每个第二图像的显示位置相对于上一帧第二图像的显示位置按照设定的方向偏移非整数个像素单位，优选为半个像素的距离。
例如，显示设备将待显示的第一图像拆分成四个子帧，在显示时，第二子帧相对于第一子帧向右平移半个像素单位，第三子帧相对于第二子帧向下平移半个像素单位，第四子帧相对于第三子帧向上平移半个像素单位即可得到最终的具有增强可见显示分辨率图像。
参阅图2，图2是分别利用不同的显示图像方法得到的显示图像效果对比图。其中显示设备的填充率为a＝0.9，K＝1，ω＝1.25。每一行的第一列为待显示的第一图像即原图，每一行的第二列为直接降采 样为第一图像的1/2像素的图像，每一行的第三列为本申请提供的图像显示方法得到的具有增强可见显示分辨率的图像。
从图2可以看出，利用本申请提供的图像显示方法得到的具有增强可见显示分辨率图像的分辨率相比于直接对第一图像进行降采样得到的图像的分辨率高得多。并且，该具有增强可见显示分辨率的图像与第一图像即原图的分辨率差别也较小。因此，本申请所提供的图像显示方法能显著提高图像的可见分辨率。
本实施例在对第一图像进行图像下采样的过程中，引入显示设备的像素间隙这一重要因素，使得到的第二图像能够更好地适应显示设备的像素间隙，能够防止显示设备在偏移显示多幅第二图像时存在的像素串扰等问题，使呈现出来的图像更加清晰，从而改善显示设备的显示能力。
参阅图3，图3是本申请提供的显示设备一实施方式的结构示意图，该显示设备100包括处理器120以及与处理器120连接的显示设备存储器130和显示模组110。其中，显示模组110用于显示图像，显示设备存储器130中存储有程序数据，处理器120用于执行程序数据以实现上述图像显示方法的步骤。例如，显示设备100具体为投影仪。
在一个具体实施方式中，显示模组110接收第二图像，并且顺序地显示第二图像以得到具有增强可见显示分辨率的图像。更具体地说，因为每个第二图像在空间上彼此偏离，显示模组110依据第二图像的空间偏移在不同的位置上显示该第二图像。如此，显示模组110在显示第一图像对应的第二图像时，从而在空间和时间上彼此偏离，从而创建具有增强可见显示分辨率的图像。在一个实施例中，显示模组110在光学上操纵第二图像以创建具有增强可见显示分辨率的图像。
参阅图4，图4是本申请提供的计算机可读存储介质一实施方式的结构示意图，计算机可读存储介质200上存储有计算机程序201，计算机程序201被处理器执行时实现上述图像显示方法的步骤。
所述计算机存储介质200可以是计算机能够存取的任何可用介质或数据存储设备，包括但不限于磁性存储器(例如软盘、硬盘、磁带、磁光盘(MO)等)、光学存储器(例如CD、DVD、BD、HVD等)、以及半导体存储器(例如ROM、EPROM、EEPROM、非易失性存储器110(NANDFLASH)、固态硬盘(SSD))等。
本申请提供的图像显示方法首先对第一图像进行分类，之后利用像素间隙，根据分类结果对第一图像进行图像下采样，从而得到多个不同的第二图像，最后按照时序且彼此偏离地显示多个第二图像，以得到具有增强可见显示分辨率的图像。在对第一图像进行图像下采样的过程中，引入显示设备的像素间隙这一重要因素，使得到的第二图像能够更好地适应显示设备的像素间隙，能够防止显示设备在偏移显示多幅第二图像时存在的像素串扰等问题，使呈现出来的图像更加清晰，从而改善显示设备的显示能力。
以上所述，仅为本申请中的具体实施方式，但本申请的保护范围并不局限于此，任何熟悉该技术的人在本申请所揭露的技术范围内，可理解想到的变换或替换，都应涵盖在本申请的包含范围之内，因此，本申请的保护范围应该以权利要求书的保护范围为准。

Claims (10)

  1. 一种显示设备的图像显示方法，所述显示设备像素之间存在设定尺寸的像素间隙，其特征在于，所述方法包括：
    获取具有第一分辨率的第一图像；
    将所述第一图像中的像素按照奇偶行列进行分类；
    利用所述像素间隙，基于所述第一图像中的每类像素对所述第一图像进行图像下采样，以得到多个不同的，具有第二分辨率的第二图像，其中所述第二分辨率与所述显示设备的分辨率一致；
    按时序且彼此偏离地显示所述多个第二图像，以获得具有增强可见显示分辨率图像。
  2. 根据权利要求1所述的方法，其特征在于，所述利用所述像素间隙，基于所述第一图像中的每类像素对所述第一图像进行图像下采样，以得到多个不同的，具有第二分辨率的第二图像，其中所述第二分辨率与所述显示设备的分辨率一致包括：
    利用所述像素间隙，根据所述第二图像像素及其周围3*3邻域内的其他像素对所述第一图像对应像素的灰度贡献值建立方程式组，进而确定所述第二图像的像素灰度信息。
  3. 根据权利要求2所述的方法，其特征在于，根据以下公式建立所述方程式组，进而得到所述第二图像的所述像素灰度信息：
    Figure PCTCN2021106713-appb-100001
    其中，N和M分别表示所述第二图像的行数和列数，L0(x,y)表示所述第二图像的像素(x,y)的归一化灰度值，L(x,y)为所述第一图像的像素(x,y)的归一化灰度值，L0(-1+x,y)、L0(x,y-1)、L0(x,y+1)、L0(x+1,y)、L0(x-1,y-1)、L0(x-1,y+1)、L0(x+1,y-1)、L0(x+1,y+1)分别表示所述第二图像的像素(-1+x,y)、(x,y-1)、(x,y+1)、(x+1,y)、(x-1,y-1) 、(x-1,y+1)、(x+1,y-1)、(x+1,y+1)的归一化灰度值，a表示所述显示设备的像素尺寸，与所述像素和所述像素间隙总尺寸的比值。
  4. 根据权利要求3所述的方法，其特征在于：
    采用逐次超松弛迭代法得到所述第二图像的所述像素灰度信息。
  5. 根据权利要求1所述的方法，其特征在于，所述将所述第一图像中的像素按照奇偶行列进行分类包括：
    将位于所述第一图像的奇数行以及奇数列的像素划分为一类；
    将位于所述第一图像的奇数行以及偶数列的像素划分为一类；
    将位于所述第一图像的偶数行以及奇数列的像素划分为一类；
    将位于所述第一图像的偶数行以及偶数列的像素划分为一类。
  6. 根据权利要求1所述的方法，其特征在于，
    所述第一图像为第一RGB图像，所述第二图像为第二RGB图像；
    所述利用所述像素间隙，基于所述第一图像中的每类像素对所述第一图像进行图像下采样，以得到多个不同的，具有第二分辨率的第二图像，其中所述第二分辨率与所述显示设备的分辨率一致，包括：
    对具有第一分辨率的所述第一RGB图像对应三通道的第一灰度图像，分别利用所述像素间隙，并基于所述第一灰度图像中的每类像素对所述第一灰度图像进行图像下采样，以分别得到对应三通道的多个不同的第二灰度图像；
    将所述对应三通道的第二灰度图像叠加，以得到所述第二RGB图像。
  7. 根据权利要求1所述的方法，其特征在于，所述按时序且彼此偏离地显示所述多个第二图像，以获得具有增强可见显示分辨率图像包括：
    每个所述第二图像相对于其前一帧所述第二图像按照设定方向平移1/2个像素单位。
  8. 一种显示设备，其特征在于，所述显示设备包括处理器以及与所述处理器连接的显示设备存储器和显示模组；
    其中，所述显示模组用于显示图像，所述存储器中存储有程序数据，所述处理器用于执行所述程序数据以实现如权利要求1-7任一项所述的方法。
  9. 根据权利要求8所述的显示设备，其特征在于，所述显示设备为投影仪。
  10. 一种计算机可读存储介质，其特征在于，所述计算机可读存储介质上存储有计算机程序，所述计算机程序被处理器执行时实现如权利要求1-7任意一项所述的方法的步骤。
PCT/CN2021/106713 2020-07-21 2021-07-16 显示设备的图像显示方法、设备以及计算机可读存储介质 Ceased WO2022017271A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010705907.3 2020-07-21
CN202010705907.3A CN114037604B (zh) 2020-07-21 2020-07-21 显示设备的图像显示方法、设备以及计算机可读存储介质

Publications (1)

Publication Number Publication Date
WO2022017271A1 true WO2022017271A1 (zh) 2022-01-27

Family

ID=79728951

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/106713 Ceased WO2022017271A1 (zh) 2020-07-21 2021-07-16 显示设备的图像显示方法、设备以及计算机可读存储介质

Country Status (2)

Country Link
CN (1) CN114037604B (zh)
WO (1) WO2022017271A1 (zh)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1510640A (zh) * 2002-09-11 2004-07-07 惠普开发有限公司 图像显示系统和方法
US20120062552A1 (en) * 2010-09-09 2012-03-15 Samsung Electronics Co., Ltd. Method of processing image data and display apparatus performing the method
CN104077103A (zh) * 2014-07-09 2014-10-01 上海天奕达电子科技有限公司 一种低分辨率平台支持高分辨率显示装置的方法和装置
CN104516135A (zh) * 2015-01-21 2015-04-15 京东方科技集团股份有限公司 一种显示面板的显示方法、显示器件及显示装置
CN105070220A (zh) * 2015-09-11 2015-11-18 京东方科技集团股份有限公司 一种显示面板的显示方法、显示器件及显示装置

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9736442B1 (en) * 2016-08-29 2017-08-15 Christie Digital Systems Usa, Inc. Device, system and method for content-adaptive resolution-enhancement

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1510640A (zh) * 2002-09-11 2004-07-07 惠普开发有限公司 图像显示系统和方法
US20120062552A1 (en) * 2010-09-09 2012-03-15 Samsung Electronics Co., Ltd. Method of processing image data and display apparatus performing the method
CN104077103A (zh) * 2014-07-09 2014-10-01 上海天奕达电子科技有限公司 一种低分辨率平台支持高分辨率显示装置的方法和装置
CN104516135A (zh) * 2015-01-21 2015-04-15 京东方科技集团股份有限公司 一种显示面板的显示方法、显示器件及显示装置
CN105070220A (zh) * 2015-09-11 2015-11-18 京东方科技集团股份有限公司 一种显示面板的显示方法、显示器件及显示装置

Also Published As

Publication number Publication date
CN114037604A (zh) 2022-02-11
CN114037604B (zh) 2025-06-03

Similar Documents

Publication Publication Date Title
CN111898701B (zh) 模型训练、帧图像生成、插帧方法、装置、设备及介质
CN109671023B (zh) 一种人脸图像超分辨率二次重建方法
CN104469179A (zh) 一种将动态图片结合到手机视频中的方法
US20080122860A1 (en) Video format conversion using 3D graphics pipeline of a GPU
CN110569013B (zh) 基于展示屏幕的图像展示方法以及装置
TW201349852A (zh) 影像處理裝置與影像處理方法
US20140028919A1 (en) Image processing circuit and method thereof
CN104813361A (zh) 感知内容的视频尺寸调整
WO2018113224A1 (zh) 一种图像缩小方法及装置
EP4030341A1 (en) Image recognition method, video playback method, related device, and medium
WO2021008322A1 (zh) 图像处理方法、装置及设备
CN111079864A (zh) 一种基于优化视频关键帧提取的短视频分类方法及系统
US9953399B2 (en) Display method and display device
US7495647B2 (en) LCD blur reduction through frame rate control
US8508581B2 (en) Pixel data transformation method and apparatus for three dimensional display
CN112882672B (zh) 近眼显示控制方法、装置及近眼显示设备
CN115633144A (zh) 视频处理方法、装置、电子设备及存储介质
WO2022017271A1 (zh) 显示设备的图像显示方法、设备以及计算机可读存储介质
US8279223B2 (en) Image processing apparatus, image processing method and program
US8855444B2 (en) Method for partitioning and processing a digital image
WO2024032331A9 (zh) 图像处理方法及装置、电子设备、存储介质
CN118264859A (zh) 显示输出方法、装置、设备及介质
CN117577061A (zh) 一种液晶拼接方法、装置、设备及介质
CN117240987A (zh) 一种基于ai的照片级帧插值算法
KR102340942B1 (ko) 영상 처리 방법 및 이를 이용한 표시장치

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21846467

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21846467

Country of ref document: EP

Kind code of ref document: A1