CN112348751A - Anti-distortion method and device for near-eye display equipment - Google Patents
Anti-distortion method and device for near-eye display equipment Download PDFInfo
- Publication number
- CN112348751A CN112348751A CN202011165449.5A CN202011165449A CN112348751A CN 112348751 A CN112348751 A CN 112348751A CN 202011165449 A CN202011165449 A CN 202011165449A CN 112348751 A CN112348751 A CN 112348751A
- Authority
- CN
- China
- Prior art keywords
- distortion
- eye display
- initial
- display equipment
- display effect
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 68
- 230000000694 effects Effects 0.000 claims abstract description 118
- 238000012937 correction Methods 0.000 claims abstract description 19
- 238000010586 diagram Methods 0.000 claims description 21
- 239000003086 colorant Substances 0.000 claims description 19
- 230000003287 optical effect Effects 0.000 claims description 17
- 239000011159 matrix material Substances 0.000 claims description 9
- 238000009877 rendering Methods 0.000 claims description 8
- 230000001960 triggered effect Effects 0.000 claims description 5
- 238000004891 communication Methods 0.000 claims description 3
- 230000006870 function Effects 0.000 claims description 3
- 238000012545 processing Methods 0.000 abstract description 8
- 230000008901 benefit Effects 0.000 abstract description 5
- 230000008569 process Effects 0.000 description 7
- 238000004590 computer program Methods 0.000 description 6
- 239000006185 dispersion Substances 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000012890 quintic function Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- G06T5/80—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/90—Determination of colour characteristics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/327—Calibration thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
Abstract
The invention discloses an anti-distortion method and device of near-eye display equipment, which relate to the technical field of image processing, wherein an operator directly checks the near-eye display equipment to confirm an anti-distortion effect, can adjust and watch the near-eye display equipment at the same time, realizes the adjustment of any view field position in an anti-distortion image, further can correct symmetrical and asymmetrical distortion, and has the advantages of simple and direct operation, low cost and high efficiency, and the main technical scheme of the invention is as follows: drawing an initial anti-distortion grid graph corresponding to the near-eye display equipment and displaying the initial anti-distortion grid graph in the near-eye display equipment to obtain a corresponding display effect graph; viewing the display effect image by wearing a near-eye display device by an operator, and controlling to execute correction operation in the display effect image according to an operation instruction when receiving the operation instruction of triggering and adjusting the specified distorted view field position by the operator; and acquiring distortion data according to the corrected display effect picture and applying the distortion data to the near-eye display equipment. The present invention is applied to correct distortion present in a near-eye display device.
Description
Technical Field
The invention relates to the technical field of image processing, in particular to an anti-distortion method and device for near-eye display equipment.
Background
Distortion is one of the main problems affecting the viewing experience of a user in near-eye display devices such as virtual reality, augmented reality, mixed reality, and the like.
The main method for correcting distortion at present is to acquire distortion data of an optical system in a device, and display an image of inverse distortion on a screen according to the data to achieve an effect of canceling out the distortion of the optical system. In a specific implementation method, no matter theoretical distortion data is directly adopted, distortion data is obtained by processing an image after photographing through a camera, or distortion coefficients in an exhaustive or blind tuning formula are calculated according to an inaccurate fitting formula, the default distortion of the system is rotational symmetry, namely, the data of one quadrant is only calculated, and the other three quadrants are only symmetrically processed.
However, due to errors in the processing of the optical lens and the assembly of the optical system, the distortion of the system is not completely rotationally symmetric. And for optical systems with special structures such as non-square special-shaped screens and non-circular special-shaped lenses, the distortion is more likely to be completely asymmetric, the anti-distortion cannot be realized by adopting the method, and the method also has the defects of complex operation flow, high requirement on measuring equipment, time and labor waste, inconsistent full-view anti-distortion effect and the like.
Disclosure of Invention
In view of the above, the present invention provides an anti-distortion method and apparatus for a near-eye display device, and mainly aims to adjust any view field position in an anti-distortion image while adjusting and viewing by an operator directly checking the near-eye display device to confirm an anti-distortion effect, so that symmetric and asymmetric distortions can be corrected, and the method and apparatus are simple and direct to operate, low in cost, and high in efficiency.
In order to achieve the above purpose, the present invention mainly provides the following technical solutions:
a first aspect of the present application provides a method of anti-distortion for a near-eye display device, the method comprising:
drawing an initial anti-distortion grid graph corresponding to the near-eye display equipment and displaying the initial anti-distortion grid graph in the near-eye display equipment to obtain a corresponding display effect graph;
viewing the display effect image by wearing the near-eye display equipment by an operator, and controlling to execute correction operation in the display effect image according to an operation instruction when the operation instruction for adjusting the specified distorted view field position triggered by the operator is received;
and acquiring distortion data according to the corrected display effect diagram and applying the distortion data to the near-eye display equipment.
In some variations of the first aspect of the present application, the rendering an initial inverse distortion mesh map corresponding to a near-eye display device includes:
acquiring a plurality of groups of object height and image space field angle data from theoretical distortion data of an optical system corresponding to the near-eye display equipment;
fitting a functional relation between the object height and the image space field angle according to the plurality of groups of object height and image space field angle data;
and drawing an initial anti-distortion grid map corresponding to the near-eye display equipment according to the functional relation between the object height and the field angle of the image space.
In some modified embodiments of the first aspect of the present application, the drawing an initial inverse distortion mesh map corresponding to the near-eye display device according to a functional relationship between the object height and an image field angle includes:
selecting a target field angle in the near-eye display device;
calculating a target object height corresponding to the target field angle by substituting the target field angle into a functional relation between the object height and an image field angle;
converting the target height into a pixel value according to the screen size and the resolution of the near-eye display equipment;
drawing a corresponding dot matrix diagram according to the pixel values;
and respectively connecting all points in the dot matrix diagram according to the rows and the columns to obtain an initial anti-distortion grid diagram.
In some modified embodiments of the first aspect of the present application, before the drawing an initial anti-distortion mesh map corresponding to a near-eye display device and displaying in the near-eye display device, the method includes:
acquiring a first color, a second color and a third color contained in the light rays with different wavelengths in an RGB color mode by analyzing the light rays with different wavelengths received by the near-eye display device, wherein the first color, the second color and the third color are different and form three colors contained in RGB colors;
the drawing and displaying of the initial anti-distortion mesh map corresponding to the near-eye display device in the near-eye display device comprises:
and drawing a first initial inverse distortion grid graph corresponding to the near-eye display equipment according to the first color and displaying the first initial inverse distortion grid graph in the near-eye display equipment to obtain a display effect graph corresponding to the first initial inverse distortion grid graph.
In some modified embodiments of the first aspect of the present application, before the obtaining distortion data from the corrected display effect map and applying the distortion data to the near-eye display device, the method further includes:
taking the display effect image corresponding to the corrected first initial anti-distortion grid image as a background;
drawing a second initial inverse distortion grid graph corresponding to the near-eye display equipment again by the second color and displaying the second initial inverse distortion grid graph in the near-eye display equipment to obtain a display effect graph corresponding to the second initial inverse distortion grid graph;
controlling and adjusting to enable the display effect graph corresponding to the second initial anti-distortion grid graph to be overlapped with the background;
drawing a third initial inverse distortion grid graph corresponding to the near-eye display equipment in the third color again and displaying the third initial inverse distortion grid graph in the near-eye display equipment to obtain a display effect graph corresponding to the third initial inverse distortion grid graph;
and controlling and adjusting to enable the display effect graph corresponding to the third initial anti-distortion grid graph to be superposed with the background, and outputting the corrected target display effect graph.
In some modified embodiments of the first aspect of the present application, the acquiring distortion data from the corrected initial inverse distortion mesh map and applying the distortion data to the near-eye display device includes:
and acquiring distortion data according to the corrected target display effect image and applying the distortion data to the near-eye display equipment.
A second aspect of the present application provides an anti-distortion apparatus of a near-eye display device, the apparatus comprising:
the drawing unit is used for drawing an initial anti-distortion grid graph corresponding to the near-eye display equipment;
the display unit is used for displaying the initial anti-distortion grid map in the near-eye display equipment to obtain a corresponding display effect map;
the execution unit is used for checking the display effect image by wearing the near-eye display equipment by an operator, and when receiving an operation instruction for triggering and adjusting a specified distorted view field position by the operator, controlling to execute a correction operation in the display effect image according to the operation instruction;
and the acquisition unit is used for acquiring distortion data according to the display effect image corrected by the execution unit and applying the distortion data to the near-to-eye display equipment.
In some modified embodiments of the first aspect of the present application, the rendering unit includes:
the acquisition module is used for acquiring a plurality of groups of object height and image space field angle data from theoretical distortion data of the optical system corresponding to the near-eye display equipment;
the fitting module is used for fitting a functional relation between the object height and the image space field angle according to the plurality of groups of object height and image space field angle data acquired by the acquisition module;
and the drawing module is used for drawing the initial anti-distortion grid map corresponding to the near-eye display equipment according to the functional relation between the object height and the field angle of the image space obtained by the fitting module.
In some variations of the first aspect of the present application, the rendering module comprises:
the selection submodule is used for selecting a target field angle in the near-to-eye display equipment;
the calculation submodule is used for solving the target object height corresponding to the target field angle by substituting the target field angle selected by the selection submodule into the functional relation between the object height and the field angle of the image space;
the conversion submodule is used for converting the height of the target object obtained by the calculation submodule into a pixel value according to the screen size and the resolution of the near-eye display equipment;
the drawing submodule is used for drawing a corresponding dot-matrix diagram according to the pixel value obtained by the conversion submodule;
and the determining submodule is used for respectively connecting all points in the dot-matrix diagram obtained by the drawing submodule according to rows and columns to obtain an initial anti-distortion grid diagram.
In some variations of the first aspect of the present application, the apparatus further comprises:
the analysis unit is further used for obtaining a first color, a second color and a third color contained in the light rays with different wavelengths in an RGB color mode by analyzing the light rays with different wavelengths received by the near-eye display device, wherein the first color, the second color and the third color are different and form three colors contained in the RGB colors;
the drawing unit is further specifically configured to draw a first initial inverse distortion grid map corresponding to the near-eye display device according to the first color;
the display unit is further configured to display the first initial inverse distortion grid map drawn by the drawing unit in the near-to-eye display device, so as to obtain a display effect map corresponding to the first initial inverse distortion grid map.
In some variations of the first aspect of the present application, the apparatus further comprises:
the determining unit is used for taking the display effect image corresponding to the first initial anti-distortion grid image after being corrected by the executing unit as a background;
the drawing unit is further used for redrawing a second initial anti-distortion grid map corresponding to the near-eye display device in the second color;
the display unit is further configured to display the second initial inverse distortion grid map drawn by the drawing unit in the near-eye display device to obtain a display effect map corresponding to the second initial inverse distortion grid map;
the adjusting unit is used for controlling and adjusting the display effect graph corresponding to the second initial anti-distortion grid graph displayed by the display unit to be superposed with the background;
the drawing unit is further configured to draw a third initial inverse distortion grid map corresponding to the near-eye display device in the third color again;
the display unit is further configured to display the third initial inverse distortion grid map drawn by the drawing unit in the near-eye display device, so as to obtain a display effect map corresponding to the third initial inverse distortion grid map;
the adjusting unit is further configured to control and adjust to coincide the display effect graph corresponding to the third initial inverse distortion grid graph displayed by the display unit with the background, and output the corrected target display effect graph.
In some modified embodiments of the first aspect of the present application, the obtaining unit is further specifically configured to obtain distortion data according to the corrected target display effect map obtained by the adjusting unit and apply the distortion data to the near-eye display device.
A third aspect of the present application provides a storage medium including a stored program, wherein the program, when executed, controls an apparatus in which the storage medium is located to perform the anti-distortion method of the near-eye display apparatus as described above.
A fourth aspect of the present application provides an electronic device comprising at least one processor, and at least one memory, a bus, connected to the processor;
the processor and the memory complete mutual communication through the bus;
the processor is configured to invoke program instructions in the memory to perform an anti-distortion method for a near-eye display device as described above.
By the technical scheme, the technical scheme provided by the invention at least has the following advantages:
the invention provides an anti-distortion method and an anti-distortion device for near-eye display equipment. Compared with the prior art, the method and the device solve the technical problems that an existing method for using the inverse distortion is complex in operation process, high in requirement on measuring equipment, time-consuming and labor-consuming, inconsistent in full-view inverse distortion effect and the like.
The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.
Drawings
Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the invention. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:
fig. 1 is a flowchart illustrating an anti-distortion method for a near-eye display device according to an embodiment of the present invention;
FIG. 2 is an example of an initial undistorted grid map provided by an embodiment of the present invention;
FIG. 3 is a flowchart of an anti-distortion method for a near-eye display device according to another embodiment of the present invention;
fig. 4 is a block diagram illustrating an anti-distortion device of a near-eye display apparatus according to an embodiment of the present invention;
fig. 5 is a block diagram illustrating an anti-distortion apparatus of a near-eye display device according to another embodiment of the present invention;
fig. 6 is an electronic device for anti-distortion of a near-eye display device according to an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the invention are shown in the drawings, it should be understood that the invention can be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.
The embodiment of the invention provides an anti-distortion method of near-eye display equipment, as shown in fig. 1, the method is that an operator directly checks the near-eye display equipment to confirm an anti-distortion effect, and can adjust and see at the same time to realize the adjustment of any view field position in an anti-distortion image, and the embodiment of the invention provides the following specific steps:
101. and drawing an initial anti-distortion grid graph corresponding to the near-eye display equipment and displaying the initial anti-distortion grid graph in the near-eye display equipment to obtain a corresponding display effect graph.
In the embodiment of the present invention, an initial inverse distortion grid map corresponding to a near-eye display device is generated mainly according to theoretical distortion data of an optical system in the near-eye display device, and as an example of the initial inverse distortion grid map provided in fig. 2, the initial inverse distortion grid map is displayed in the near-eye display device, so as to obtain a display effect map in the near-eye display device.
It should be noted that, in the process of displaying the initial inverse distortion grid map on the near-eye display device, the distortion existing in the initial inverse distortion grid map is opposite to that of the near-eye display device, and is used for realizing the effect of canceling out the distortion of the optical system, so that the display effect map on the near-eye display device is obtained, the distortion effect as illustrated in fig. 2 does not exist any more, and the display effect map is also an inverse distortion grid map substantially.
However, for the person wearing the near-eye display device, although the distortion is corrected by displaying, it is still likely that there is a distorted position in the display effect map, so that the correction operation needs to be performed again, such as the subsequent correction operation provided in step 102 and step 103 of the embodiment of the present invention.
102. The display effect picture is checked by wearing the near-eye display equipment by an operator, and when an operation instruction for adjusting the specified distorted view field position triggered by the operator is received, the correction operation is controlled to be executed in the display effect picture according to the operation instruction.
In the embodiment of the present invention, a specific method for performing a correction operation on a display effect map in a near-eye display device is as follows: the method comprises the steps that an operator wears near-eye display equipment to check a display effect picture, so that adjustment operation can be conducted while checking, and a correction instruction is given to the situation that the operator observes that a distorted view field position exists in the display effect picture, for example, an operation instruction for triggering and adjusting the appointed distorted view field position is given, so that when the terminal side (a main body for receiving the operator instruction and specifically executing the instruction) receives the operation instruction for triggering and adjusting the appointed distorted view field position by the operator, the correction operation is executed in the display effect picture according to the operation instruction control.
It should be noted that, because the operator wears the near-eye display device to view the display effect map, which is actually an inverse distortion grid map, the embodiment of the present invention receives the adjustment operation instruction, that is, performs adjustment on the position of the point in the inverse distortion grid map, and further, since the position of the point is changed, the line connecting the point is also changed, and finally, the grid map is changed, and a new inverse distortion grid map is obtained as the correction result.
103. And acquiring distortion data according to the corrected display effect picture and applying the distortion data to the near-eye display equipment.
In the embodiment of the invention, according to the display effect diagram, corresponding object height and field angle data are stored and are used for being applied to near-eye display equipment to perform related rendering operation, and then the anti-distortion can be realized.
The embodiment of the present invention first draws an initial inverse distortion grid map corresponding to a near-eye display device and displays the initial inverse distortion grid map in the near-eye display device to obtain a corresponding display effect map, an operator wears the near-eye display device to check that a distorted field position exists in the display effect map, when an operation instruction for adjusting a specified distorted field position is received, a correction operation is controlled to be executed in the display effect map according to the operation instruction, and finally, distorted data is obtained and applied to the near-eye display device according to the corrected display effect map. Compared with the prior art, the method and the device solve the technical problems that an existing method for using the inverse distortion is complex in operation process, high in requirement on measuring equipment, time-consuming and labor-consuming, inconsistent in full-view inverse distortion effect and the like.
In order to describe the above embodiments in more detail, the embodiment of the present invention further provides another method for inverse distortion of a near-eye display device, as shown in fig. 3, the method further sets forth a specific implementation method for drawing an initial inverse distortion grid map corresponding to the near-eye display device, and a specific countermeasure for solving the problem of chromatic dispersion caused by distortion, and for this embodiment of the present invention, the following specific steps are provided:
201. the light rays with different wavelengths received by the near-eye display device are analyzed, a first color, a second color and a third color contained in the light rays with different wavelengths are obtained in an RGB color mode, and the first color, the second color and the third color are different and form three colors contained in the RGB colors.
Wherein, the RGB color mode is: the color standard in the industry is obtained by changing three color channels of red (R), green (G) and blue (B) and superimposing the three color channels on each other, wherein RGB represents the colors of the three channels of red, green and blue, and the standard almost includes all the colors that can be perceived by human vision, and is one of the most widely used color systems.
In the embodiment of the present invention, because the distortions of the light beams with different wavelengths are also different, in order to solve the problem of chromatic dispersion caused by the distortions, the implementation of the present invention provides the following measures: the method mainly uses three colors to respectively carry out the operations of drawing an initial anti-distortion grid graph and displaying the grid graph in the same near-eye display equipment, and each color correspondingly obtains a display effect graph in the near-eye display equipment, namely the three colors correspondingly obtain different three effect graphs.
In the following description, for solving the dispersion problem caused by distortion, the embodiment of the present invention provides specific implementation steps, as step 202-. It should be noted that "first", "second" and "third" given in the embodiments of the present invention are only for clearly distinguishing the initial anti-distortion grid patterns drawn in different colors, and there is no sequence for referring to events. Therefore, the one color refers to any of RGB.
202. And drawing a first initial inverse distortion grid graph corresponding to the near-eye display equipment according to the first color and displaying the first initial inverse distortion grid graph in the near-eye display equipment to obtain a display effect graph corresponding to the first initial inverse distortion grid graph.
In the embodiment of the invention, one color can be arbitrarily selected from the RGB colors to be used as the first medium color, and the initial inverse distortion grid map is drawn by the color. Specifically, the drawing method mainly comprises the following steps:
firstly, acquiring a plurality of groups of object height and image space field angle data from theoretical distortion data of an optical system corresponding to near-eye display equipment;
it should be noted that, for a near-eye display device, the theoretical distortion data of the optical system is the pre-designed known data, and the embodiment of the present invention focuses on analyzing and acquiring the relationship between the object height and the image field angle by using the known data.
The field angle data can also be calculated from the image height and the image distance, and is expressed by the following formula (1):
wherein F is the angle of view, Y is the image height, and L is the image distance. Specifically, in the embodiment of the present invention, there is no particular limitation on the acquisition of the object height and the image space field angle data.
And secondly, fitting a functional relation between the object height and the image space field angle according to the plurality of groups of object height and image space field angle data.
The research shows that the relation between the object height and the image space field angle of a certain optical system can be accurately fitted by a quintic function, such as the formula (2):
W＝p1F5+p2F4+p3F3+p4F2+p1f (formula 2)
Wherein W is the object height, each coefficient p 1-p 5, and F is the angle of view.
And finally, drawing an initial anti-distortion grid graph corresponding to the near-eye display device according to the functional relation between the object height and the field angle of the image space.
In the embodiment of the present invention, according to the functional relationship, the specific implementation step of drawing the initial inverse distortion mesh map may include the following steps:
in a first step, a target field angle is selected in a near-eye display device. For the near-eye display device, when the image of the system is viewed, it is more convenient to represent a certain position in the image by the angle of view, and specifically, the angle of view is taken in an even and regular manner and covers as many field ranges as possible according to the actual situation of the screen effective display area.
And a second step of calculating the target object height corresponding to the target field angle by substituting the target field angle into the functional relation between the object height and the image field angle. That is, the target view angle is substituted into the formula (2), and the corresponding target height is solved.
And thirdly, converting the height of the target object into a pixel value according to the screen size and the resolution of the near-eye display equipment, drawing a corresponding dot matrix according to the pixel value, and respectively connecting all points in the dot matrix according to rows and columns to obtain an initial anti-distortion grid map. An example of an initial inverse distortion grid map is provided in fig. 2.
203. And viewing the display effect image by wearing a near-eye display device by an operator, and controlling to execute correction operation in the display effect image according to an operation instruction when receiving the operation instruction of triggering and adjusting the specified distorted view field position by the operator.
The method comprises the steps of displaying an initial anti-distortion image drawn in a first color in near-eye display equipment to obtain a display effect image, checking whether a distorted position still exists or not by wearing the equipment by an operator, and if so, issuing a trigger correction instruction to a terminal.
204. And taking the display effect image corresponding to the corrected first initial anti-distortion grid image as a background.
In the embodiment of the present invention, the first color is a color arbitrarily selected from RGB colors, the first initial inverse distortion grid map is drawn in the first color, and the purpose of finally obtaining the display effect map as the background is: as a reference, the effect map shown in the near-eye display device is corrected for the other two color initial anti-distortion mesh maps.
205. And drawing a second initial inverse distortion grid graph corresponding to the near-eye display equipment again by using a second color and displaying the second initial inverse distortion grid graph in the near-eye display equipment to obtain a display effect graph corresponding to the second initial inverse distortion grid graph.
206. And controlling and adjusting to enable the display effect graph corresponding to the second initial anti-distortion grid graph to be overlapped with the background.
The above step 205-. In the embodiment of the present invention, the display effect map is corrected by adjusting it to be completely coincident with the background of step 205.
207. And drawing a third initial inverse distortion grid graph corresponding to the near-eye display equipment in a third color again and displaying the third initial inverse distortion grid graph in the near-eye display equipment to obtain a display effect graph corresponding to the third initial inverse distortion grid graph.
208. And controlling and adjusting to enable the display effect graph corresponding to the third initial anti-distortion grid graph to be superposed with the background, and outputting the corrected target display effect graph.
The above step 207-. In the embodiment of the present invention, the display effect map is corrected by adjusting it to be completely coincident with the background of step 205.
209. And acquiring distortion data according to the corrected target display effect image and applying the distortion data to the near-eye display equipment.
In the embodiment of the invention, the display effect of each color initial anti-distortion grid map on the near-eye display device is processed in an iterative mode, and a finally corrected display effect map is obtained. According to the embodiment of the invention, the display effect graph in the near-eye display equipment is corrected, and the display effects of the initial inverse distortion gridding graph drawn by different colors in the near-eye display equipment are completely overlapped, so that the inverse distortion correction operation of adjusting while looking is realized, and the dispersion problem caused by distortion is solved. Finally, the object height and the view angle data (namely, the view angle data are not changed and are still the data in the initial anti-distortion map) are acquired according to the corrected target display effect map, but it should be noted that, because the iteration processing in the embodiment of the invention takes the background as the reference (namely, the display effect maps corresponding to other colors are completely overlapped with the background), the view angle data acquired here can be acquired from the initial anti-distortion grid map corresponding to the first color.
Further, as an implementation of the method shown in fig. 1 and fig. 3, an embodiment of the present invention provides an anti-distortion device for a near-eye display device. The embodiment of the apparatus corresponds to the embodiment of the method, and for convenience of reading, details in the embodiment of the apparatus are not repeated one by one, but it should be clear that the apparatus in the embodiment can correspondingly implement all the contents in the embodiment of the method. The apparatus is applied to correct display distortion existing in a near-eye display device, and particularly as shown in fig. 4, the apparatus comprises:
a drawing unit 31, configured to draw an initial inverse distortion grid map corresponding to the near-eye display device;
the display unit 32 is configured to display the initial inverse distortion grid map drawn by the drawing unit 31 in the near-eye display device to obtain a corresponding display effect map;
the execution unit 33 is configured to view the display effect map by wearing the near-eye display device by an operator, and when an operation instruction for adjusting a specified distorted field position triggered by the operator is received, control to execute a correction operation in the display effect map according to the operation instruction;
and an acquisition unit 34 for acquiring distortion data and applying the distortion data to the near-eye display device according to the display effect map corrected by the execution unit 33.
Further, as shown in fig. 5, the drawing unit 31 includes:
the obtaining module 311 is configured to obtain multiple sets of object height and image field angle data from theoretical distortion data of an optical system corresponding to the near-eye display device;
a fitting module 312, configured to fit a functional relationship between the object height and the image field angle according to the multiple sets of object height and image field angle data acquired by the acquiring module 311;
and a drawing module 313, configured to draw an initial inverse distortion grid map corresponding to the near-eye display device according to the functional relationship between the object height and the field angle of the image space obtained by the fitting module 312.
Further, as shown in fig. 5, the drawing module 313 includes:
a selecting sub-module 3131 for selecting a target viewing angle in the near-eye display device;
a calculating sub-module 3132, configured to calculate a target object height corresponding to the target view angle by substituting the target view angle selected by the selecting sub-module 3131 into a functional relationship between the object height and the image view angle;
a conversion sub-module 3133 configured to convert the target height obtained by the calculation sub-module 3132 into a pixel value according to the screen size and resolution of the near-eye display device;
a drawing sub-module 3134, configured to draw a corresponding bitmap according to the pixel value obtained by the converting sub-module 3133;
the determining sub-module 3435 is configured to obtain an initial anti-distortion grid map by connecting each point in the dot matrix map obtained by the drawing sub-module 3434 according to rows and columns.
Further, as shown in fig. 5, the apparatus further includes:
the analyzing unit 35 is further configured to obtain, in an RGB color mode, a first color, a second color, and a third color included in the light rays with different wavelengths by analyzing the light rays with different wavelengths received by the near-eye display device, where the first color, the second color, and the third color are different from each other and constitute three colors included in the RGB colors;
the drawing unit 31 is further specifically configured to draw a first initial inverse distortion grid map corresponding to the near-eye display device according to the first color;
the display unit 32 is further configured to display the first initial inverse distortion grid map drawn by the drawing unit 31 in the near-eye display device, so as to obtain a display effect map corresponding to the first initial inverse distortion grid map.
Further, as shown in fig. 5, the apparatus further includes:
a determining unit 36, configured to use the display effect map corresponding to the first initial inverse distortion grid map after being corrected by the executing unit as a background;
the drawing unit 31 is further configured to redraw a second initial inverse distortion grid map corresponding to the near-eye display device in the second color;
the display unit 32 is further configured to display the second initial inverse distortion grid map drawn by the drawing unit 31 in the near-eye display device, so as to obtain a display effect map corresponding to the second initial inverse distortion grid map;
an adjusting unit 37, configured to control and adjust that the display effect map corresponding to the second initial anti-distortion grid map displayed by the display unit 32 coincides with the background;
the drawing unit 31 is further configured to draw a third initial inverse distortion grid map corresponding to the near-eye display device in the third color again;
the display unit 32 is further configured to display the third initial inverse distortion grid map drawn by the drawing unit 31 in the near-eye display device, so as to obtain a display effect map corresponding to the third initial inverse distortion grid map;
the adjusting unit 37 is further configured to control and adjust to overlap the display effect map corresponding to the third initial anti-distortion grid map displayed by the display unit 32 with the background, and output the corrected target display effect map.
Further, as shown in fig. 5, the obtaining unit 34 is further specifically configured to obtain distortion data according to the corrected target display effect map obtained by the adjusting unit 37 and apply the distortion data to the near-eye display device
In summary, the embodiments of the present invention provide an inverse distortion method and an inverse distortion device for a near-eye display device, where an initial inverse distortion grid map corresponding to the near-eye display device is first drawn and displayed in the near-eye display device to obtain a corresponding display effect map, an operator wears the near-eye display device to check that there is a distorted view field position in the display effect map, when an operation instruction for adjusting a specified distorted view field position is received, a correction operation is controlled to be executed in the display effect map according to the operation instruction, and finally, distortion data is obtained according to the corrected display effect map and applied to the near-eye display device. Compared with the prior art, the method and the device solve the technical problems that an existing method for using the inverse distortion is complex in operation process, high in requirement on measuring equipment, time-consuming and labor-consuming, inconsistent in full-view inverse distortion effect and the like.
The anti-distortion device of the near-eye display equipment comprises a processor and a memory, wherein the drawing unit, the display unit, the execution unit, the acquisition unit and the like are stored in the memory as program units, and the corresponding functions are realized by executing the program units stored in the memory by the processor.
The processor comprises a kernel, and the kernel calls the corresponding program unit from the memory. The kernel can set one or more than one, the operator directly checks the near-eye display equipment to confirm the anti-distortion effect by adjusting the kernel parameters, the operator can adjust the kernel parameters while watching, the arbitrary view field position in the anti-distortion image can be adjusted, and then the symmetric and asymmetric distortion can be corrected, the operation is simple and direct, the cost is low, and the efficiency is high.
An embodiment of the present invention provides a storage medium having stored thereon a program that, when executed by a processor, implements an anti-distortion method of the near-eye display device.
The embodiment of the invention provides a processor, which is used for running a program, wherein the program runs to execute an anti-distortion method of a near-eye display device.
An embodiment of the present invention provides an electronic device 40, as shown in fig. 6, the device includes at least one processor 401, and at least one memory 402 and a bus 403 connected to the processor 401; the processor 401 and the memory 402 complete communication with each other through the bus 403; the processor 401 is configured to call program instructions in the memory 402 to perform the above-described anti-distortion method for a near-eye display device.
The device herein may be a server, a PC, a PAD, a mobile phone, etc.
The present application further provides a computer program product adapted to perform a program for initializing the following method steps when executed on a data processing device:
an anti-distortion method of a near-eye display device, the method comprising: drawing an initial anti-distortion grid graph corresponding to the near-eye display equipment and displaying the initial anti-distortion grid graph in the near-eye display equipment to obtain a corresponding display effect graph; viewing the display effect image by wearing the near-eye display equipment by an operator, and controlling to execute correction operation in the display effect image according to an operation instruction when the operation instruction for adjusting the specified distorted view field position triggered by the operator is received; and acquiring distortion data according to the corrected display effect diagram and applying the distortion data to the near-eye display equipment.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a device includes one or more processors (CPUs), memory, and a bus. The device may also include input/output interfaces, network interfaces, and the like.
The memory may include volatile memory in a computer readable medium, Random Access Memory (RAM) and/or nonvolatile memory such as Read Only Memory (ROM) or flash memory (flash RAM), and the memory includes at least one memory chip. The memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The above are merely examples of the present application and are not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims (10)
1. A method of anti-distortion for a near-eye display device, the method comprising:
drawing an initial anti-distortion grid graph corresponding to the near-eye display equipment and displaying the initial anti-distortion grid graph in the near-eye display equipment to obtain a corresponding display effect graph;
viewing the display effect image by wearing the near-eye display equipment by an operator, and controlling to execute correction operation in the display effect image according to an operation instruction when the operation instruction for adjusting the specified distorted view field position triggered by the operator is received;
and acquiring distortion data according to the corrected display effect diagram and applying the distortion data to the near-eye display equipment.
2. The method of claim 1, wherein the rendering of the initial undistorted mesh map corresponding to the near-eye display device comprises:
acquiring a plurality of groups of object height and image space field angle data from theoretical distortion data of an optical system corresponding to the near-eye display equipment;
fitting a functional relation between the object height and the image space field angle according to the plurality of groups of object height and image space field angle data;
and drawing an initial anti-distortion grid map corresponding to the near-eye display equipment according to the functional relation between the object height and the field angle of the image space.
3. The method of claim 2, wherein said rendering an initial inverse distortion mesh map corresponding to the near-eye display device as a function of the object height and the image field angle comprises:
selecting a target field angle in the near-eye display device;
calculating a target object height corresponding to the target field angle by substituting the target field angle into a functional relation between the object height and an image field angle;
converting the target height into a pixel value according to the screen size and the resolution of the near-eye display equipment;
drawing a corresponding dot matrix diagram according to the pixel values;
and respectively connecting all points in the dot matrix diagram according to the rows and the columns to obtain an initial anti-distortion grid diagram.
4. The method of claim 1, wherein prior to said rendering and displaying in the near-eye display device an initial undistorted mesh map corresponding to the near-eye display device, comprising:
acquiring a first color, a second color and a third color contained in the light rays with different wavelengths in an RGB color mode by analyzing the light rays with different wavelengths received by the near-eye display device, wherein the first color, the second color and the third color are different and form three colors contained in RGB colors;
the drawing and displaying of the initial anti-distortion mesh map corresponding to the near-eye display device in the near-eye display device comprises:
and drawing a first initial inverse distortion grid graph corresponding to the near-eye display equipment according to the first color and displaying the first initial inverse distortion grid graph in the near-eye display equipment to obtain a display effect graph corresponding to the first initial inverse distortion grid graph.
5. The method of claim 4, wherein before the obtaining distortion data from the corrected display effect map and applying the distortion data to the near-eye display device, the method further comprises:
taking the display effect image corresponding to the corrected first initial anti-distortion grid image as a background;
drawing a second initial inverse distortion grid graph corresponding to the near-eye display equipment again by the second color and displaying the second initial inverse distortion grid graph in the near-eye display equipment to obtain a display effect graph corresponding to the second initial inverse distortion grid graph;
controlling and adjusting to enable the display effect graph corresponding to the second initial anti-distortion grid graph to be overlapped with the background;
drawing a third initial inverse distortion grid graph corresponding to the near-eye display equipment in the third color again and displaying the third initial inverse distortion grid graph in the near-eye display equipment to obtain a display effect graph corresponding to the third initial inverse distortion grid graph;
and controlling and adjusting to enable the display effect graph corresponding to the third initial anti-distortion grid graph to be superposed with the background, and outputting the corrected target display effect graph.
6. The method of claim 5, wherein the obtaining and applying distortion data to the near-eye display device from the corrected initial anti-distortion mesh map comprises:
and acquiring distortion data according to the corrected target display effect image and applying the distortion data to the near-eye display equipment.
7. An anti-distortion apparatus for a near-eye display device, the apparatus comprising:
the drawing unit is used for drawing an initial anti-distortion grid graph corresponding to the near-eye display equipment;
the display unit is used for displaying the initial anti-distortion grid map in the near-eye display equipment to obtain a corresponding display effect map;
the execution unit is used for checking the display effect image by wearing the near-eye display equipment by an operator, and when receiving an operation instruction for triggering and adjusting a specified distorted view field position by the operator, controlling to execute a correction operation in the display effect image according to the operation instruction;
and the acquisition unit is used for acquiring distortion data according to the display effect image corrected by the execution unit and applying the distortion data to the near-to-eye display equipment.
8. The apparatus of claim 7, wherein the rendering unit comprises:
the acquisition module is used for acquiring a plurality of groups of object height and image space field angle data from theoretical distortion data of the optical system corresponding to the near-eye display equipment;
the fitting module is used for fitting a functional relation between the object height and the image space field angle according to the plurality of groups of object height and image space field angle data acquired by the acquisition module;
and the drawing module is used for drawing the initial anti-distortion grid map corresponding to the near-eye display equipment according to the functional relation between the object height and the field angle of the image space obtained by the fitting module.
9. A storage medium comprising a stored program, wherein the program, when executed, controls an apparatus in which the storage medium is located to perform an anti-distortion method of a near-eye display apparatus according to any one of claims 1 to 6.
10. An electronic device, comprising at least one processor, and at least one memory, bus connected to the processor;
the processor and the memory complete mutual communication through the bus;
the processor is to invoke program instructions in the memory to perform an anti-distortion method for a near-eye display device of any of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011165449.5A CN112348751A (en) | 2020-10-27 | 2020-10-27 | Anti-distortion method and device for near-eye display equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011165449.5A CN112348751A (en) | 2020-10-27 | 2020-10-27 | Anti-distortion method and device for near-eye display equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112348751A true CN112348751A (en) | 2021-02-09 |
Family
ID=74359119
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011165449.5A Pending CN112348751A (en) | 2020-10-27 | 2020-10-27 | Anti-distortion method and device for near-eye display equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112348751A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114331814A (en) * | 2021-12-24 | 2022-04-12 | 合肥视涯技术有限公司 | Distorted picture correction method and display equipment |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105791789A (en) * | 2016-04-28 | 2016-07-20 | 努比亚技术有限公司 | Head-mounted equipment, display equipment and method of automatically adjusting display output |
| US20160353094A1 (en) * | 2015-05-29 | 2016-12-01 | Seeing Machines Limited | Calibration of a head mounted eye tracking system |
| CN106572342A (en) * | 2016-11-10 | 2017-04-19 | 北京奇艺世纪科技有限公司 | Image anti-distortion and anti-dispersion processing method, device and virtual reality device |
| CN107610044A (en) * | 2017-08-29 | 2018-01-19 | 歌尔科技有限公司 | Image processing method, computer-readable recording medium and virtual reality helmet |
| CN109891296A (en) * | 2016-10-26 | 2019-06-14 | 威尔乌集团 | It is distorted using pupil position correction optical lens |
-
2020
- 2020-10-27 CN CN202011165449.5A patent/CN112348751A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160353094A1 (en) * | 2015-05-29 | 2016-12-01 | Seeing Machines Limited | Calibration of a head mounted eye tracking system |
| CN105791789A (en) * | 2016-04-28 | 2016-07-20 | 努比亚技术有限公司 | Head-mounted equipment, display equipment and method of automatically adjusting display output |
| CN109891296A (en) * | 2016-10-26 | 2019-06-14 | 威尔乌集团 | It is distorted using pupil position correction optical lens |
| CN106572342A (en) * | 2016-11-10 | 2017-04-19 | 北京奇艺世纪科技有限公司 | Image anti-distortion and anti-dispersion processing method, device and virtual reality device |
| CN107610044A (en) * | 2017-08-29 | 2018-01-19 | 歌尔科技有限公司 | Image processing method, computer-readable recording medium and virtual reality helmet |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114331814A (en) * | 2021-12-24 | 2022-04-12 | 合肥视涯技术有限公司 | Distorted picture correction method and display equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102555953B1 (en) | Electronic apparatus, display apparatus and control method thereof | |
| US20210333870A1 (en) | Image rendering method, device, system, storage medium, image display method and computer device | |
| US9196022B2 (en) | Image transformation and multi-view output systems and methods | |
| KR101150665B1 (en) | System and method for image correction | |
| US20200020120A1 (en) | Reducing textured ir patterns in stereoscopic depth sensor imaging | |
| CN111107333B (en) | Brightness correction method, system, equipment and computer readable storage medium | |
| US11069322B2 (en) | Display method and display device, visible light communication transmission method and device | |
| CN109817170B (en) | Pixel compensation method and device and terminal equipment | |
| JP2015097350A (en) | Image processing apparatus and multi-projection system | |
| US20210183323A1 (en) | Driving method of display device and display device | |
| KR20190032818A (en) | An electronic device including a plurality of camera using a rolling shutter system | |
| CN111312141B (en) | Color gamut adjusting method and device | |
| CN106303477A (en) | A kind of adaptive projector image bearing calibration and system | |
| US20190228720A1 (en) | Backlight adjustment method of display panel, backlight adjustment device, and display device | |
| CN104020565B (en) | There is display system and the method for displaying image thereof of optical lens and display screen | |
| CN105791793A (en) | Image processing method and electronic device | |
| Eisenberg et al. | Measuring and qualifying optical performance of AR/VR/MR device displays and addressing the unique visual requirements of transparent AR/MR displays | |
| TWI443604B (en) | Image correction method and image correction apparatus | |
| US20120242784A1 (en) | Image processing method, camera module, and photographing method | |
| CN112348751A (en) | Anti-distortion method and device for near-eye display equipment | |
| Watson | Spatial standard observer | |
| KR20210127591A (en) | Image processing apparatus and method thereof | |
| JP7266179B2 (en) | Image processing device and imaging device | |
| US20160295183A1 (en) | Image processing device and image display apparatus | |
| US10616542B2 (en) | Multi-dimensional image projection apparatus and multi-dimensional image calibration method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |