CN110211543B - Local backlight adjusting method and device and virtual reality system - Google Patents
Local backlight adjusting method and device and virtual reality system Download PDFInfo
- Publication number
- CN110211543B CN110211543B CN201910618017.6A CN201910618017A CN110211543B CN 110211543 B CN110211543 B CN 110211543B CN 201910618017 A CN201910618017 A CN 201910618017A CN 110211543 B CN110211543 B CN 110211543B
- Authority
- CN
- China
- Prior art keywords
- backlight
- image
- data
- setting
- unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
- G09G3/34—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters by control of light from an independent source
- G09G3/3406—Control of illumination source
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Liquid Crystal Display Device Control (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
Abstract
The embodiment of the invention provides a local backlight adjusting method and device and a virtual reality system. The local backlight adjusting method comprises the following steps: receiving a frame of input image; processing the input image into a grid image comprising a plurality of anti-distortion image units and a plurality of black image units according to a preset mark template; and obtaining backlight adjustment data of the multiple anti-distortion image units through backlight calculation, and setting the backlight adjustment data of the multiple black image units. According to the invention, the mark template is introduced, the anti-distortion image and the black image in the input image are separated by using the mark template, and when backlight calculation is carried out subsequently, only the backlight calculation is carried out on the anti-distortion image, and backlight adjustment data is directly set for the black image, so that the calculation complexity is effectively reduced, the calculation amount is reduced, and the processing efficiency is improved.
Description
Technical Field
The invention relates to the technical field of virtual reality, in particular to a local backlight adjusting method and device and a virtual reality system.
Background
Liquid Crystal Displays (LCD) have been widely used in electronic products such as tablet personal computers, televisions, or mobile phones, and a Local Dimming technique is introduced to the LCD for reducing power consumption and improving contrast of a Display screen. Research shows that the direct-type Light-Emitting Diode (LED) backlight, together with the Local Dimming technology, can greatly reduce power consumption, increase the contrast value and gray scale number of the display screen, and reduce the ghost. The Local Dimming technology is used for processing an input image, adjusting the brightness of each LED of the direct type backlight according to the brightness of the image, adjusting the gray-scale value of each pixel of the LCD, improving the brightness of a highlight part in the image, reducing the brightness of a dark part in the image and achieving the optimal contrast.
Currently, Local Dimming technology has begun to be applied in Virtual Reality (VR) systems, and is particularly used in VR rendering processes. VR rendering is important for the content displayed by VR systems, and requires not only the rendering of high resolution images for both left and right eyes, but also the real-time output with a frame rate of 90 Hz. Practical application shows that although Local Dimming has the characteristics of easiness in implementation and obvious effect, the Local Dimming technology needs to calculate each backlight subarea, the calculation is complex, the calculation amount is large, the calculation burden of VR rendering is greatly increased, the VR rendering process has large time delay, the display quality of VR images is reduced, and the user experience is influenced.
Therefore, how to reduce the large delay of the VR rendering process using the Local Dimming technology is an urgent technical problem to be solved in the art.
Disclosure of Invention
The technical problem to be solved by the embodiments of the present invention is to provide a Local backlight adjustment method and apparatus, and a virtual reality system, so as to solve the problem that the VR rendering process using the Local Dimming technology has a large delay.
In order to solve the above technical problem, an embodiment of the present invention provides a local backlight adjusting method, including:
receiving a frame of input image;
processing the input image into a grid image comprising a plurality of anti-distortion image units and a plurality of black image units according to a preset mark template;
and obtaining backlight adjustment data of the multiple anti-distortion image units through backlight calculation, and setting the backlight adjustment data of the multiple black image units.
Optionally, the marking template is provided with marking lines and grid lines, the size and shape of the marking lines are the same as those of the anti-distortion boundary, the grid lines divide the marking template into a plurality of grids, and an area defined by each grid is used as an image unit and corresponds to one backlight sub-area of the backlight module and one display sub-area of the display panel.
Optionally, processing the input image into a mesh image including a plurality of anti-distortion image cells and a plurality of black image cells according to a preset mark template, includes:
data are not set in grids where the mark lines in the mark template are located, a plurality of boundary image units are formed, and the boundary image units form a closed boundary ring; the grids in the marking template within the marking lines are set to input data of corresponding positions of the image to form a plurality of anti-distortion image units; the grids outside the mark lines in the mark template are set with data of corresponding positions of the input image to form a plurality of black image units.
Optionally, obtaining backlight adjustment data of the plurality of anti-distortion image units through backlight calculation, and setting the backlight adjustment data of the plurality of black image units, includes performing the following processing on all image units:
reading the ith image unit; judging whether the ith image unit is an anti-distortion image unit or not, if so, performing backlight setting calculation and display compensation calculation on the ith image unit to obtain backlight setting data and display compensation data of the ith image unit, and sending the backlight setting data and the display compensation data to a storage unit; otherwise, setting the backlight value of the backlight setting data of the ith image unit to be 0, setting the gray value of the display compensation data of the ith image unit to be 0, and sending the gray value to the storage unit.
Optionally, performing backlight setting calculation and display compensation calculation on the ith image unit includes:
performing backlight setting calculation on the ith image unit to obtain backlight setting data;
and performing display compensation calculation on the ith image unit based on the backlight setting data to obtain display compensation data.
Optionally, the method further comprises:
generating backlight setting data and display compensation data of the frame;
and simultaneously sending the backlight setting data and the display compensation data of the frame to a backlight driving circuit and a display driving circuit respectively according to the vertical synchronous signal.
In order to solve the above technical problem, an embodiment of the present invention further provides a local backlight adjustment device, including:
the receiving module is used for receiving a frame of input image;
a template module for processing the input image into a mesh image including a plurality of anti-distortion image cells and a plurality of black image cells according to a preset marker template;
and the processing module is used for obtaining backlight adjustment data of the multiple anti-distortion image units through backlight calculation and setting backlight adjustment data of the multiple black image units.
Optionally, the marking template is provided with marking lines and grid lines, the size and shape of the marking lines are the same as those of the anti-distortion boundary, the grid lines divide the marking template into a plurality of grids, and an area defined by each grid is used as an image unit and corresponds to one backlight sub-area of the backlight module and one display sub-area of the display panel.
Optionally, the template module is specifically configured to form a plurality of boundary image units by setting no data in a grid where a mark line in the mark template is located, where the plurality of boundary image units form a closed boundary ring; the grids in the marking template within the marking lines are set to input data of corresponding positions of the image to form a plurality of anti-distortion image units; the grids outside the mark lines in the mark template are set with data of corresponding positions of the input image to form a plurality of black image units.
Optionally, the processing module comprises a judging unit, a calculating unit, a setting unit and a storage unit,
the judging unit is used for reading the ith image unit, judging whether the ith image unit is an anti-distortion image unit, if so, sending a calculation instruction to the calculating unit, and otherwise, sending a setting instruction to the setting unit;
the computing unit is used for carrying out backlight setting computation and display compensation computation on the ith image unit according to the computing instruction to obtain backlight setting data and display compensation data of the ith image unit and sending the backlight setting data and the display compensation data to the storage unit;
the setting unit is used for setting the backlight value of the ith image unit backlight setting data to be 0 and setting the gray value of the ith image unit display compensation data to be 0 according to the setting instruction, and sending the gray value to the storage unit;
and the storage unit is used for storing the backlight setting data and the display compensation data of the ith image unit.
Optionally, the calculation unit comprises a backlight setting calculation subunit and a display compensation calculation subunit,
a backlight setting calculation subunit, configured to perform backlight setting calculation on the ith image unit to obtain backlight setting data;
and the display compensation calculating subunit is used for performing display compensation calculation on the ith image unit based on the backlight setting data to obtain display compensation data.
Optionally, the system also comprises a generating module and a sending module,
the generating module is used for generating the backlight setting data and the display compensation data of the frame;
and the sending module is used for simultaneously sending the backlight setting data and the display compensation data of the frame to the backlight driving circuit and the display driving circuit respectively according to the vertical synchronous signal.
The embodiment of the invention also provides a virtual reality system which comprises the local backlight adjusting device.
Embodiments of the present invention also provide a medium, on which a computer program executable on a processor is stored, where the computer program, when executed by the processor, implements the steps of the local backlight adjusting method as described above.
According to the local backlight adjusting method and device and the virtual reality system, the mark template is introduced, the input image is processed into the grid image by the mark template, the anti-distortion image and the black image in the input image are separated, during backlight calculation, only the backlight calculation is carried out on the anti-distortion image, and backlight adjusting data is directly set for the black image, so that the calculation complexity is effectively reduced, the calculation amount is reduced, and the processing efficiency is improved. Compared with the prior art, the method can reduce the calculation amount by 10-20%, save at least 10% of processing time, and effectively solve the problem of large time delay of the VR rendering process adopting the LocalDimming technology in the prior art.
Of course, not all of the advantages described above need to be achieved at the same time in the practice of any one product or method of the invention. Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the embodiments of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
Drawings
The accompanying drawings are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the example serve to explain the principles of the invention and not to limit the invention. The shapes and sizes of the various elements in the drawings are not to scale and are merely intended to illustrate the invention.
FIG. 1 is a flow chart of a local backlight adjusting method according to an embodiment of the invention;
FIG. 2 is a schematic diagram of VR system pre-processing to form an intermediate image;
FIG. 3 is a schematic diagram of processing an input image into a grid image according to an embodiment of the present invention;
FIG. 4 is a flowchart illustrating a local backlight adjustment according to an embodiment of the present invention;
fig. 5 is a flowchart illustrating an embodiment of applying local backlight adjustment to VR rendering.
Detailed Description
The following detailed description of embodiments of the invention is provided in connection with the accompanying drawings and examples. The following examples are intended to illustrate the invention but are not intended to limit the scope of the invention. It should be noted that the embodiments and features of the embodiments in the present application may be arbitrarily combined with each other without conflict.
Aiming at the problem that the existing VR rendering process adopting the Local Dimming technology has large time delay, the embodiment of the invention provides a solution for Local backlight adjustment. Fig. 1 is a flowchart of a local backlight adjusting method according to an embodiment of the present invention, and as shown in fig. 1, the local backlight adjusting method according to the embodiment of the present invention includes:
s1, receiving a frame of input image;
s2, processing the input image into a grid image comprising a plurality of anti-distortion image units and a plurality of black image units according to a preset mark template;
s3, obtaining backlight adjustment data of the multiple anti-distortion image units through backlight calculation, and setting backlight adjustment data of the multiple black image units.
With the continuous development of computer technology, virtual reality VR systems are becoming an important tool for people's life and entertainment. In an optical lens of an existing VR device, since a human eye serves as an exit pupil of the system and has a large field of view display, pincushion distortion needs to be considered in a lens imaging process. The pillow-shaped distortion means that after a normal image passes through a lens, the image is seen by human eyes like a pillow. The current processing mode is to use software to preprocess a video or an image source, and to change a normal image into a barrel-shaped image through the preprocessing, so that human eyes can see the normal image after the barrel-shaped image is subjected to pincushion distortion by a lens. Wherein the preprocessing process is called as anti-distortion processing. Because the VR system is near-eye display, human eyes concentrate on a near-focus area, and do not pay much attention to display contents far away from the focus area, the intermediate image is used as the display contents in the existing preprocessing. Fig. 2 is a schematic diagram of VR system preprocessing to form an intermediate image, and as shown in fig. 2, preprocessing only subjects the image in the area inside the boundary (indicated by a dotted line frame) of the intermediate image to anti-distortion processing, and sets the area outside the boundary of the intermediate image to black without image information, while regarding the input image as the main image content for display. In the embodiment of the present invention, an image in an area inside the boundary of the intermediate image is referred to as an inverse distortion image, black in an area outside the boundary of the intermediate image is referred to as a black image, and the boundary of the intermediate image is referred to as an inverse distortion boundary. For a VR system with a complete machine shape, the optical structure of the whole system is determined, and the anti-distortion shape is also determined, namely the anti-distortion boundary formed by preprocessing is determined. Therefore, in the embodiment of the present invention, before the local backlight adjustment process is performed, the anti-distortion boundary is obtained from the VR system and stored as the preset processing parameter.
In the embodiment of the present invention, the one frame of input image received in step S1 is an image preprocessed by the VR system, and includes an anti-distortion image located in the middle area and a black image located in the peripheral area of the anti-distortion image. Subsequently, in step S2, the input image is processed into a mesh image including anti-distortion image cells and black image cells in accordance with a flag template set in advance. Specifically, according to the pre-known anti-distortion boundary, a mark template is pre-set, and mark lines and grid lines are set in the mark template. The size of the marking template is the same as that of the input image, the size and the shape of a marking line in the marking template are the same as those of the anti-distortion boundary, the marking template is divided into M-N grids which are regularly arranged by grid lines, an area defined by each grid is used as an image unit, the area corresponds to a backlight subarea of the backlight module and corresponds to a display subarea of the display panel, and M and N are positive integers which are larger than 1. That is, the backlight module is also divided into M × N regularly arranged backlight sub-regions, the display panel is also divided into M × N regularly arranged display sub-regions, and the display sub-regions and the backlight sub-regions are in one-to-one correspondence, that is, in a direction perpendicular to the display panel, the projections of the one-to-one corresponding display sub-regions and the backlight sub-regions are overlapped. Each backlight sub-area includes a plurality of LEDs, and each display sub-area includes a plurality of pixels.
Thus, the input image is processed according to the marking template, and one frame of the input image can be processed into a grid image comprising M × N image units. The grid where the mark line in the mark template is located is not provided with data, and a plurality of boundary image units of the grid image are formed, so that the plurality of boundary image units form a closed boundary ring. The grid within the marker lines in the marker template is arranged to be data of corresponding positions of the input image, and a plurality of anti-distorted image cells are formed because the corresponding positions of the input image are anti-distorted image data. The grid except the mark lines in the mark template is also set with data of the corresponding position of the input image, and a plurality of black image cells are formed because the corresponding position of the input image is black data.
Fig. 3 is a schematic diagram of processing an input image into a grid image according to an embodiment of the present invention, as shown in fig. 3, a left graph in the diagram represents the input image, a middle graph is a mark template including mark lines and grid lines, and a right graph represents a grid image obtained by processing the input image according to the mark template. The grid image includes M x N image cells including a plurality of anti-distortion image cells, a plurality of black image cells, and a plurality of boundary image cells, the plurality of boundary image cells forming a closed annular boundary ring, the plurality of anti-distortion image cells being located within the boundary ring, the plurality of black image cells being located outside the boundary ring.
From the mesh image including the plurality of anti-distortion image units and the plurality of black image units obtained in the foregoing steps, display compensation data for input image compensation and backlight setting data for controlling backlight luminance for each image unit can be obtained. The embodiment of the invention only performs backlight calculation on the multiple anti-distortion image units, obtains backlight adjustment data of the anti-distortion image units through the backlight calculation, does not perform backlight calculation on the multiple black image units, directly sets the backlight adjustment data of the black image units through an assignment mode, and finally obtains the backlight adjustment data of all the image units.
In the embodiment of the present invention, step S3 performs the following processing on all image cells:
s31, reading the ith image unit, wherein i is 1 to M;
s32, judging whether the ith image unit is an anti-distortion image unit, if so, executing a step S33, otherwise, executing a step S34;
s33, carrying out backlight calculation on the ith image unit to obtain backlight adjustment data of the ith image unit, and executing the step S35;
s34, setting the backlight value of the ith image unit backlight setting data to 0, setting the gray-level value of the ith image unit display compensation data to 0, and executing step S35;
s35, sending the backlight adjustment data of the ith image unit to a storage unit.
The backlight calculation comprises backlight setting calculation and display compensation calculation, the backlight adjustment data comprises backlight setting data and display compensation data, the backlight setting data is used for setting the brightness of the backlight module, and the display compensation data is used for performing gray level compensation on an input image.
Wherein the backlight calculation for the ith image unit in step S33 includes:
s331, performing backlight setting calculation on the ith image unit to obtain backlight setting data;
s332, performing display compensation calculation on the ith image unit based on the backlight setting data to obtain display compensation data.
Since the grid image is formed of M × N grids, each image cell in the grid image can be uniquely determined by the grid coordinates (x, y), for example, the grid coordinates of the image cell of the 4 th row and 10 th column in the grid image can be identified as the image cell (4, 10). In this way, for any one image cell of the mesh image, whether the image cell is an anti-distortion image cell or a black image cell can be directly determined from the mesh coordinates of the boundary image cells. Therefore, after the ith image cell is read in step S31, the grid coordinates of the ith image cell are obtained, and the ith image cell can be determined to be an anti-distortion image cell or a black image cell according to the grid coordinates of the boundary image cell.
If the ith image unit is an anti-distortion image unit, the image unit is shown to be displayed to a user as image content, so that backlight setting calculation and display compensation calculation are required to be carried out, the backlight setting calculation is carried out on the ith image unit to obtain backlight setting data, then the image unit is processed based on the backlight setting data to obtain display compensation data based on the backlight setting data, and then the calculated backlight setting data and the calculated display compensation data are sent to the storage unit. If the ith image unit is not the anti-distortion image unit, the image unit is a black image unit and is positioned at the periphery of the sight line of the user, so that backlight setting calculation and display compensation calculation are not needed, the backlight setting data of the ith image unit is directly set to be 0 in backlight value, namely the LED is turned off, the display compensation data of the ith image unit is directly set to be 0 in gray value, namely black, and then the backlight value is 0 and the gray value is 0, and the display compensation data is sent to the storage unit.
By repeating the above processes, backlight adjustment data of all the image units can be obtained. And finally, after the storage unit receives the backlight setting data and the display compensation data of all the image units, generating the backlight setting data and the display compensation data of the frame, sending the backlight setting data of the frame to a backlight driving circuit according to a vertical synchronization (Vsync) signal, sending the display compensation data of the frame to the display driving circuit, adjusting the brightness of each backlight subarea in the backlight module by the backlight driving circuit according to the backlight setting data, and compensating the input image by the display driving circuit according to the display compensation data to realize local backlight adjustment. The brightness of the backlight subarea is mainly adjusted, and the compensation processing of the input image is mainly to adjust the gray value of the corresponding pixel.
In the embodiment of the invention, the backlight setting calculation and the display compensation calculation are carried out on each image unit by adopting the existing Local Dimming method. For example, the backlight setting calculation may be to obtain a brightness parameter of the image unit, and then decide a backlight setting value, i.e. backlight setting data, according to the brightness parameter. The display compensation calculation may be to calculate a gray scale value to be displayed by each pixel in the image unit, that is, display compensation data, according to the calculated backlight setting value and the backlight point diffusion rule, so as to achieve a display effect in a higher dynamic contrast range in cooperation with the backlight luminance. The calculation of backlight setting and the calculation of display compensation in the existing Local Dimming method are well known to those skilled in the art and are not described herein.
FIG. 4 is a flowchart illustrating a local backlight adjustment according to an embodiment of the invention. As shown in fig. 4, the local backlight adjustment includes:
s101, receiving a frame of input image;
s102, processing the input image into a grid image comprising M x N image units according to a preset mark template;
s103, setting i to be 1;
s104, reading the ith image unit, judging whether the ith image unit is an anti-distortion image unit, if so, executing the step S105, otherwise, executing the step S106;
s105, performing backlight setting calculation and display compensation calculation on the ith image unit to obtain backlight setting data and display compensation data of the ith image unit, and executing the step S107;
s106, setting the backlight value of the ith image unit backlight setting data to 0, setting the gray-scale value of the ith image unit display compensation data to 0, and executing step S107;
s107, storing the backlight setting data and the display compensation data of the ith image unit;
s108, judging whether i is smaller than M x N, if so, executing a step S109, otherwise, executing a step S110;
s109, setting i to i +1, and executing step S104;
s110, generating backlight setting data and display compensation data of the frame according to the backlight setting data and the display compensation data of all the image units; the backlight setting data of the present frame is transmitted to the backlight driving circuit according to a vertical synchronization (Vsync) signal, and the display compensation data of the present frame is transmitted to the display driving circuit.
As can be seen from the above description, in the embodiments of the present invention, by introducing the mark template, processing the input image into the grid image by using the mark template, separating the inverse distortion image and the black image in the input image, and during the subsequent backlight calculation, performing the backlight setting calculation and the display compensation calculation only on the inverse distortion image, and directly setting the backlight setting data and the display compensation data on the black image, the calculation complexity is effectively reduced, the calculation amount is reduced, and the processing efficiency is improved. For an input image, usually, an anti-distortion image accounts for about 80% -90% of the input image, and a black image accounts for about 10% -20% of the input image, so that compared with the existing processing method for calculating each backlight subarea, the method can reduce the calculation amount by 10% -20%, save at least 10% of processing time, and effectively overcome the delay problem existing in the VR rendering process adopting the Local Dimming technology.
Fig. 5 is a flowchart illustrating an embodiment of applying local backlight adjustment to VR rendering. As shown in fig. 5, the VR rendering process specifically includes:
s201, acquiring optical structure information of a VR system;
s202, acquiring attitude position data through a peripheral;
s203, rendering the binocular image;
s204, respectively carrying out anti-distortion and time programming (TimeWrap) processing on the binocular images;
s205, local backlight adjustment processing is carried out;
and S206, sending the backlight setting data to a backlight driving circuit according to the Vsync signal, and sending the display compensation data to a display driving circuit.
In step S205, the image after the inverse distortion processing is processed by using the local backlight adjusting method according to the embodiment of the present invention.
Based on the technical concept of the local backlight adjusting method, the embodiment of the invention also provides a local backlight adjusting device. The local backlight adjusting device of the embodiment of the invention comprises:
the receiving module is used for receiving a frame of input image;
a template module for processing the input image into a mesh image including a plurality of anti-distortion image cells and a plurality of black image cells according to a preset marker template;
and the processing module is used for obtaining backlight adjustment data of the multiple anti-distortion image units through backlight calculation and setting backlight adjustment data of the multiple black image units.
The marking template is provided with marking lines and grid lines, the size and the shape of the marking lines are the same as those of the anti-distortion boundary, the grid lines divide the marking template into a plurality of grids, and an area defined by each grid is used as an image unit and corresponds to a backlight sub-area of the backlight module and a display sub-area of the display panel.
The template module is specifically used for forming a plurality of boundary image units by not setting data in grids where the marking lines in the marking template are located, wherein the plurality of boundary image units form a closed boundary ring; the grids in the marking template within the marking lines are set to input data of corresponding positions of the image to form a plurality of anti-distortion image units; the grids outside the mark lines in the mark template are set with data of corresponding positions of the input image to form a plurality of black image units.
In the embodiment of the present invention, the processing module includes a determining unit, a calculating unit, a setting unit, and a storing unit, wherein:
the judging unit is used for reading the ith image unit, judging whether the ith image unit is an anti-distortion image unit, if so, sending a calculation instruction to the calculating unit, and otherwise, sending a setting instruction to the setting unit;
the computing unit is used for carrying out backlight setting computation and display compensation computation on the ith image unit according to the computing instruction sent by the judging unit to obtain backlight setting data and display compensation data of the ith image unit and sending the backlight setting data and the display compensation data to the storage unit;
the setting unit is used for setting the backlight value of the ith image unit backlight setting data to be 0 and setting the gray value of the ith image unit display compensation data to be 0 according to the setting instruction sent by the judging unit and sending the gray value to the storage unit;
and the storage unit is used for storing the backlight setting data and the display compensation data of the ith image unit.
In an embodiment of the present invention, the calculation unit includes a backlight setting calculation subunit and a display compensation calculation subunit, wherein,
a backlight setting calculation subunit, configured to perform backlight setting calculation on the ith image unit to obtain backlight setting data;
and the display compensation calculating subunit is used for performing display compensation calculation on the ith image unit based on the backlight setting data to obtain display compensation data.
In the embodiment of the present invention, the local backlight adjusting apparatus further includes a generating module and a transmitting module, wherein,
the generating module is used for generating the backlight setting data and the display compensation data of the frame;
and the sending module is used for sending the backlight setting data of the frame to the backlight driving circuit and sending the display compensation data of the frame to the display driving circuit according to the vertical synchronizing signal.
The specific processing procedure of the local backlight adjusting device has been described in detail in the above local backlight adjusting method, and is not described herein again.
Based on the technical idea of the foregoing embodiment, an embodiment of the present invention further provides a virtual reality system, where the virtual reality system includes the foregoing local backlight adjustment device.
Based on the technical idea of the foregoing embodiment, an embodiment of the present invention further provides a medium, on which a computer program executable on a processor is stored, and the computer program, when executed by the processor, implements the steps of the foregoing local backlight adjusting method.
In the description of the embodiments of the present invention, it should be understood that the terms "middle", "upper", "lower", "front", "rear", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc. indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience of description and simplicity of description, but do not indicate or imply that the devices or elements referred to must have a particular orientation, be constructed in a particular orientation, and be operated, and thus, should not be construed as limiting the present invention.
In the description of the embodiments of the present invention, it should be noted that, unless explicitly stated or limited otherwise, the terms "mounted," "connected," and "connected" are to be construed broadly, and may be, for example, fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program requests. These computer program requests may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable information processing apparatus to produce a machine, such that the requests, which are executed via the processor of the computer or other programmable information processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program requests may also be stored in a computer-readable memory that can direct a computer or other programmable information processing apparatus to function in a particular manner, such that the requests stored in the computer-readable memory produce an article of manufacture including request means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable information processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
Although the embodiments of the present invention have been described above, the above description is only for the convenience of understanding the present invention, and is not intended to limit the present invention. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (12)
1. A method of local backlight adjustment, comprising:
receiving a frame of input image;
processing the input image into a grid image comprising a plurality of anti-distortion image units and a plurality of black image units according to a preset mark template; the marking template is provided with marking lines and grid lines, the size and the shape of the marking lines are the same as those of the anti-distortion boundary, the grid lines divide the marking template into a plurality of grids, and an area defined by each grid is used as an image unit and corresponds to a backlight sub-area of the backlight module and a display sub-area of the display panel;
and obtaining backlight adjustment data of the multiple anti-distortion image units through backlight calculation, and setting the backlight adjustment data of the multiple black image units.
2. The local backlight adjustment method of claim 1, wherein processing the input image into a mesh image including a plurality of anti-distortion image cells and a plurality of black image cells according to a preset mark template comprises:
data are not set in grids where the mark lines in the mark template are located, a plurality of boundary image units are formed, and the boundary image units form a closed boundary ring; the grids in the marking template within the marking lines are set to input data of corresponding positions of the image to form a plurality of anti-distortion image units; the grids outside the mark lines in the mark template are set with data of corresponding positions of the input image to form a plurality of black image units.
3. The local backlight adjustment method of claim 2, wherein obtaining backlight adjustment data of the anti-distortion image units by backlight calculation, and setting backlight adjustment data of the black image units comprises performing the following processing on all image units:
reading the ith image unit; judging whether the ith image unit is an anti-distortion image unit or not, if so, performing backlight setting calculation and display compensation calculation on the ith image unit to obtain backlight setting data and display compensation data of the ith image unit, and sending the backlight setting data and the display compensation data to a storage unit; otherwise, setting the backlight value of the backlight setting data of the ith image unit to be 0, setting the gray value of the display compensation data of the ith image unit to be 0, and sending the gray value to the storage unit.
4. The local backlight adjustment method of claim 3, wherein performing backlight setting calculation and display compensation calculation on the ith image unit comprises:
performing backlight setting calculation on the ith image unit to obtain backlight setting data;
and performing display compensation calculation on the ith image unit based on the backlight setting data to obtain display compensation data.
5. The local backlight adjustment method of claim 3, further comprising:
generating backlight setting data and display compensation data of the frame;
and simultaneously sending the backlight setting data and the display compensation data of the frame to a backlight driving circuit and a display driving circuit respectively according to the vertical synchronous signal.
6. A local backlight adjustment apparatus, comprising:
the receiving module is used for receiving a frame of input image;
a template module for processing the input image into a mesh image including a plurality of anti-distortion image cells and a plurality of black image cells according to a preset marker template; the marking template is provided with marking lines and grid lines, the size and the shape of the marking lines are the same as those of the anti-distortion boundary, the grid lines divide the marking template into a plurality of grids, and an area defined by each grid is used as an image unit and corresponds to a backlight sub-area of the backlight module and a display sub-area of the display panel;
and the processing module is used for obtaining backlight adjustment data of the multiple anti-distortion image units through backlight calculation and setting backlight adjustment data of the multiple black image units.
7. The local backlight adjustment device according to claim 6, wherein the template module is specifically configured to form a plurality of boundary image units by setting no data in a grid where a mark line in the mark template is located, and the plurality of boundary image units form a closed boundary ring; the grids in the marking template within the marking lines are set to input data of corresponding positions of the image to form a plurality of anti-distortion image units; the grids outside the mark lines in the mark template are set with data of corresponding positions of the input image to form a plurality of black image units.
8. The local backlight adjustment device of claim 7, wherein the processing module comprises a judgment unit, a calculation unit, a setting unit and a storage unit,
the judging unit is used for reading the ith image unit, judging whether the ith image unit is an anti-distortion image unit, if so, sending a calculation instruction to the calculating unit, and otherwise, sending a setting instruction to the setting unit;
the computing unit is used for carrying out backlight setting computation and display compensation computation on the ith image unit according to the computing instruction to obtain backlight setting data and display compensation data of the ith image unit and sending the backlight setting data and the display compensation data to the storage unit;
the setting unit is used for setting the backlight value of the ith image unit backlight setting data to be 0 and setting the gray value of the ith image unit display compensation data to be 0 according to the setting instruction, and sending the gray value to the storage unit;
and the storage unit is used for storing the backlight setting data and the display compensation data of the ith image unit.
9. The local backlight adjustment device of claim 8, wherein the calculation unit comprises a backlight setting calculation subunit and a display compensation calculation subunit,
a backlight setting calculation subunit, configured to perform backlight setting calculation on the ith image unit to obtain backlight setting data;
and the display compensation calculating subunit is used for performing display compensation calculation on the ith image unit based on the backlight setting data to obtain display compensation data.
10. The local backlight adjustment device of claim 8, further comprising a generation module and a transmission module,
the generating module is used for generating the backlight setting data and the display compensation data of the frame;
and the sending module is used for simultaneously sending the backlight setting data and the display compensation data of the frame to the backlight driving circuit and the display driving circuit respectively according to the vertical synchronous signal.
11. A virtual reality system, comprising the local backlight adjustment device as claimed in any one of claims 7 to 10.
12. A medium having stored thereon a computer program operable on a processor, the computer program, when executed by the processor, implementing the steps of the local backlight adjustment method as claimed in any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910618017.6A CN110211543B (en) | 2019-07-10 | 2019-07-10 | Local backlight adjusting method and device and virtual reality system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910618017.6A CN110211543B (en) | 2019-07-10 | 2019-07-10 | Local backlight adjusting method and device and virtual reality system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110211543A CN110211543A (en) | 2019-09-06 |
| CN110211543B true CN110211543B (en) | 2020-10-30 |
Family
ID=67796972
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910618017.6A Active CN110211543B (en) | 2019-07-10 | 2019-07-10 | Local backlight adjusting method and device and virtual reality system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110211543B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111161685B (en) * | 2020-02-28 | 2022-02-01 | 京东方科技集团股份有限公司 | Virtual reality display equipment and control method thereof |
| WO2023115288A1 (en) * | 2021-12-21 | 2023-06-29 | 京东方科技集团股份有限公司 | Data transmission apparatus and method, electronic device, medium and intelligent interactive tablet |
Family Cites Families (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101689776B1 (en) * | 2010-04-13 | 2016-12-27 | 삼성디스플레이 주식회사 | Method of driving backlight assembly and display apparatus having the same |
| CN103792674B (en) * | 2014-01-21 | 2016-11-23 | 浙江大学 | A kind of apparatus and method measured and correct virtual reality display distortion |
| US10438331B2 (en) * | 2014-06-26 | 2019-10-08 | Intel Corporation | Distortion meshes against chromatic aberrations |
| CN104363383B (en) * | 2014-10-16 | 2018-02-27 | 青岛歌尔声学科技有限公司 | A kind of method and apparatus of image predistortion correction |
| CN106101594B (en) * | 2016-08-04 | 2019-03-12 | 深圳创维－Rgb电子有限公司 | HDR television set and local dimming method |
| WO2018093562A1 (en) * | 2016-11-16 | 2018-05-24 | Google Llc | Freeform projected display |
| US10490157B2 (en) * | 2017-01-03 | 2019-11-26 | Screenovate Technologies Ltd. | Compression of distorted images for head-mounted display |
| CN106873162B (en) * | 2017-03-14 | 2019-05-28 | 上海天马微电子有限公司 | Pixel arrangement method, display device and the near-eye display device of display device |
| CN107680047A (en) * | 2017-09-05 | 2018-02-09 | 北京小鸟看看科技有限公司 | A kind of virtual reality scenario rendering intent, image processor and wear display device |
| CN107742512B (en) * | 2017-11-07 | 2020-09-01 | 北京京东方光电科技有限公司 | Display driving circuit, driving method thereof and display device |
| CN109903231A (en) * | 2017-12-11 | 2019-06-18 | 上海聚虹光电科技有限公司 | The antidote of VR or AR equipment iris image |
| CN108287678B (en) * | 2018-03-06 | 2020-12-29 | 京东方科技集团股份有限公司 | Image processing method, device, equipment and medium based on virtual reality |
| CN109461213B (en) * | 2018-11-16 | 2023-11-28 | 京东方科技集团股份有限公司 | Image processing method, device, equipment and storage medium based on virtual reality |
| CN109407392B (en) * | 2019-01-02 | 2021-08-06 | 京东方科技集团股份有限公司 | Liquid crystal display and virtual reality head-mounted device |
| CN109753158B (en) * | 2019-01-11 | 2021-01-22 | 京东方科技集团股份有限公司 | VR device delay determination method and control terminal |
| CN109636715B (en) * | 2019-02-01 | 2023-06-13 | 京东方科技集团股份有限公司 | Image data transmission method, device and storage medium |
-
2019
- 2019-07-10 CN CN201910618017.6A patent/CN110211543B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN110211543A (en) | 2019-09-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109658876B (en) | Image display processing method and device, display device and storage medium | |
| US11521564B2 (en) | Image display processing method and device, display device and non-volatile storage medium | |
| US20110007136A1 (en) | Image signal processing apparatus and image display | |
| US9128298B2 (en) | Three-dimensional image display apparatus, display system, driving method, driving apparatus, display controlling method, display controlling apparatus, program, and computer-readable recording medium | |
| CN108198534A (en) | Display methods, display optimization device and display device | |
| CN110211543B (en) | Local backlight adjusting method and device and virtual reality system | |
| CN102968964B (en) | Backlight driving method and device, and display device | |
| CN102263969A (en) | Video signal processing apparatus, video signal processing method, and computer program | |
| CN104539935A (en) | Image brightness adjusting method, adjusting device and display device | |
| WO2021169578A1 (en) | Virtual reality display device and display method | |
| JP2013104912A (en) | Display device and display method | |
| CN105825840A (en) | Optical compensating method and device and display panel | |
| CN111916032A (en) | Gamma adjusting method and device for display panel | |
| KR20180039224A (en) | Head mounted display device | |
| US8698731B2 (en) | Backlight module driving system and driving method thereof | |
| JP5100873B1 (en) | Crosstalk correction amount evaluation apparatus and crosstalk correction amount evaluation method | |
| CN104915166B (en) | Information processing method and electronic equipment | |
| CN106782344A (en) | brightness adjusting method, device and display device | |
| JP5359191B2 (en) | Liquid crystal display | |
| CN105513566A (en) | Image adjusting method of executing optimal adjustment according to different environments and displayer | |
| CN104106109A (en) | Video display control device | |
| US20220148529A1 (en) | Backlight System, Display Apparatus, And Light Emission Control Method | |
| JP2013250570A (en) | Image quality adjusting device and image correction data generation program | |
| CN109712578B (en) | Display method and display device | |
| CN101466011B (en) | Device for improving reading disorder of low eyesight crowd |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |