CN113099203B - Display system calibration method and system - Google Patents
Display system calibration method and system Download PDFInfo
- Publication number
- CN113099203B CN113099203B CN202110504684.9A CN202110504684A CN113099203B CN 113099203 B CN113099203 B CN 113099203B CN 202110504684 A CN202110504684 A CN 202110504684A CN 113099203 B CN113099203 B CN 113099203B
- Authority
- CN
- China
- Prior art keywords
- display system
- calibrated
- camera
- image information
- eyeball camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/327—Calibration thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/122—Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/246—Calibration of cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Eye Examination Apparatus (AREA)
Abstract
The invention provides a display system calibration method and a system, comprising the following steps: parameter calibration is carried out on a preset eyeball camera; based on calibration parameter information of the eyeball camera, adjusting the position relationship between the eyeball camera and a display system to be calibrated, and fixing the eyeball camera on the display system to be calibrated; rendering a preset calibration pattern on a display system to be calibrated according to a preset rule virtual scene; controlling the display system to be calibrated and the eyeball camera to rotate, and shooting image information presented by the display system to be calibrated in real time through the eyeball camera according to a preset frame rate; and carrying out characteristic information analysis on the image information, and calibrating the optical performance of the display system to be calibrated based on the characteristic information analysis result. With the above described invention, a deterministic and quantifiable calibration and evaluation of the display system can be achieved by simulating the eye camera of the human eye.
Description
Technical Field
The invention relates to the technical field of virtual display systems, in particular to a display system calibration method and a display system calibration system.
Background
Modern computing and display technology has prompted the development of so-called "virtual reality" or "augmented reality" experience systems, which are primarily used to present digitally generated images, or portions thereof, to a user in a manner that appears or may be considered to be authentic in a wearable device. Virtual reality or VR scenes typically involve the presentation of digital or virtual image information without transparency to other real-world visual inputs; currently, augmented reality or AR scenes typically include presentation in digital or virtual image information as an enhancement to the visualization of the real world around the user.
Currently, indexes such as display performance, display quality and the like of a display system of virtual reality or augmented reality, such as optical display distortion, displayed color saturation, displayed dispersion performance and the like of the display system are difficult to evaluate by using a relatively objective system, and the existing main means is to evaluate the display performance of the display system of virtual reality or augmented reality through experience, test and use of multiple people. It is known that this approach is too subjective and to some extent difficult to have a good objective evaluation result; furthermore, because the human visual perception system is very complex, based on current evaluation methods, it is a challenge to produce a VR, AR or MR technology to promote a pleasant, natural feel, and to present virtual image elements in abundance among other virtual or real world image elements.
Disclosure of Invention
In view of the above problems, the present invention is to provide a display system calibration method and system, so as to solve the problem that the performance of the display system cannot be calibrated in a standard and quantifiable manner.
The display system calibration method provided by the invention comprises the steps of carrying out parameter calibration on a preset eyeball camera; based on calibration parameter information of the eyeball camera, adjusting the position relationship between the eyeball camera and a display system to be calibrated, and fixing the eyeball camera on the display system to be calibrated; rendering a preset calibration pattern on a display system to be calibrated according to a preset rule virtual scene; controlling the display system to be calibrated and the eyeball camera to rotate, and shooting image information presented by the display system to be calibrated in real time through the eyeball camera according to a preset frame rate; and carrying out characteristic information analysis on the image information, and calibrating the optical performance of the display system to be calibrated based on the characteristic information analysis result.
In addition, the optional technical scheme is that the eyeball camera comprises a left eyeball camera and a right eyeball camera which are arranged in pairs, and the display system to be calibrated comprises a left eye display screen and a right eye display screen; the process of adjusting the positional relationship between the eye camera and the display system to be calibrated includes: the optical axis position of the left eye camera is aligned with the center position of the left eye display screen, and the optical axis position of the right eye camera is aligned with the center position of the right eye display screen.
Furthermore, an alternative solution is that the calibration parameter information comprises an internal parameter, an intrinsic parameter or an external parameter; the internal parameters comprise projection transformation parameters from the eyeball camera coordinates to the two-dimensional image coordinates shot by the eyeball camera; intrinsic parameters include focal length, principal point, optical distortion parameters; the extrinsic parameters include a rotation matrix and a translation vector between the left eye camera and the right eye camera.
In addition, the optional technical scheme is that the process of controlling the display system to be calibrated and the eyeball camera to rotate and shooting the image information presented by the display system to be calibrated in real time through the eyeball camera according to the preset frame rate comprises the following steps: controlling a display system to be calibrated and an eyeball camera to rotate in a preset mode; shooting first image information presented by a left eye screen in real time by a left eye camera according to a first preset frame rate; and simultaneously, shooting second image information presented by a right eye screen in real time by a right eye camera according to a first preset frame rate.
Furthermore, an optional technical solution is that the process of performing feature information analysis on the image information and calibrating the optical performance of the display system to be calibrated based on the result of the feature information analysis includes: respectively acquiring characteristic values of the characteristics of the first image information and the second image information in the upper left, upper right, lower left, lower right and middle areas; features include hue, saturation, and contrast; comparing the characteristic value of the first image information with the characteristic value at the corresponding position of the left eye display screen to obtain a first comparison result, and comparing the characteristic value of the second image information with the characteristic value at the corresponding position of the right eye display screen to obtain a second comparison result; judging whether the left-eye display screen meets parameter requirements or not based on the first comparison result, and if the left-eye display screen does not meet the parameter requirements, adjusting the characteristics of the corresponding position of the left-eye display screen based on the characteristic value of the first image information; and circularly executing the steps; and judging whether the right-eye display screen meets the parameter requirement or not based on the second comparison result, if not, adjusting the characteristics of the corresponding position of the right-eye display screen based on the characteristic value of the second image information, and executing the steps in a circulating way.
In addition, an optional technical solution is that the process of analyzing the characteristic information of the image information and calibrating the optical performance of the display system to be calibrated based on the result of the characteristic information analysis further includes: and performing analysis of the collinearity, curvature, length, width, added marks, lost marks, numbers, shapes, sizes, spatial groupings, or spatial directions on the first image information and the second image information, and calibrating optical performance of the display system to be calibrated based on the result of the analysis.
In addition, the optional technical scheme is that the range of the first preset frame rate is 30 Hz-60 Hz.
In addition, the resolution of the eyeball camera is not less than the resolution of the display system to be calibrated; and, the properties of the eye camera include simulated cornea position, simulated cornea geometry, eye position, pupil size, pupil position, gaze distance, and gaze direction.
In addition, the optional technical scheme is that the process of parameter calibration for the preset eyeball camera comprises the following steps: displaying a sample image with a preset size through a sample screen at a preset distance and a preset angle relative to an eyeball camera; shooting a sample image through an eyeball camera to obtain a corresponding shooting image; based on the shot image and Zhang Zhengyou calibration method, the parameters of the dome camera are calibrated.
According to another aspect of the present invention, there is provided a display system calibration system comprising: the parameter calibration unit is used for carrying out parameter calibration on a preset eyeball camera; the position determining unit is used for adjusting the position relation between the eyeball camera and the display system to be calibrated based on the calibration parameter information of the eyeball camera and fixing the eyeball camera on the display system to be calibrated; the calibration pattern rendering unit is used for rendering a preset calibration pattern to the display system to be calibrated according to a preset rule virtual scene; the image information shooting unit is used for controlling the display system to be calibrated and the eyeball camera to rotate and shooting image information presented by the display system to be calibrated in real time through the eyeball camera according to a preset frame rate; and the optical performance calibration unit is used for carrying out characteristic information analysis on the image information and calibrating the optical performance of the display system to be calibrated based on the result of the characteristic information analysis.
By using the display system calibration method and system, the position relationship between the eyeball camera and the display system to be calibrated is adjusted based on the calibration parameter information of the eyeball camera, and the eyeball camera is fixed on the display system to be calibrated; rendering a preset calibration pattern on a display system to be calibrated according to a preset rule virtual scene; controlling the display system to be calibrated and the eyeball camera to rotate, and shooting image information presented by the display system to be calibrated in real time through the eyeball camera according to a preset frame rate; the image information is subjected to characteristic information analysis, and the optical performance of the display system to be calibrated is calibrated based on the result of the characteristic information analysis, so that the display performance of the virtual world and the real world can be calibrated and evaluated under deterministic and quantifiable conditions, and the virtual world and the real world can be effectively fused together in a seamless manner.
To the accomplishment of the foregoing and related ends, one or more aspects of the invention comprise the features hereinafter fully described. The following description and the annexed drawings set forth in detail certain illustrative aspects of the invention. These aspects are indicative, however, of but a few of the various ways in which the principles of the invention may be employed. Furthermore, the invention is intended to include all such aspects and their equivalents.
Drawings
Other objects and attainments together with a more complete understanding of the invention will become apparent and appreciated by referring to the following description taken in conjunction with the accompanying drawings. In the drawings:
FIG. 1 is a flow chart of a display system calibration method according to an embodiment of the invention;
fig. 2 is a logic block diagram of a display system calibration system according to an embodiment of the present invention.
The same reference numerals will be used throughout the drawings to refer to similar or corresponding features or functions.
Detailed Description
In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of one or more embodiments. It may be evident, however, that such embodiment(s) may be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form in order to facilitate describing one or more embodiments.
In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", "clockwise", "counterclockwise", "axial", "radial", "circumferential", etc. indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings are merely for convenience in describing the present invention and simplifying the description, and do not indicate or imply that the device or element being referred to must have a specific orientation, be configured and operated in a specific orientation, and therefore should not be construed as limiting the present invention.
For a detailed description of the display system calibration method and system of the present invention, specific embodiments of the present invention will be described in detail with reference to the accompanying drawings.
Fig. 1 shows a flow of a display system calibration method according to an embodiment of the invention.
As shown in fig. 1, the display system calibration method according to the embodiment of the invention includes the following steps:
s110: and carrying out parameter calibration on a preset eyeball camera.
S120: based on the calibration parameter information of the eyeball camera, the position relation between the eyeball camera and the display system to be calibrated is adjusted, and the eyeball camera is fixed on the display system to be calibrated.
S130: and rendering the preset calibration pattern to the display system to be calibrated according to the preset rule virtual scene.
S140: and controlling the display system to be calibrated and the eyeball camera to rotate, and shooting image information presented by the display system to be calibrated in real time through the eyeball camera according to a preset frame rate.
S150: and carrying out characteristic information analysis on the image information, and calibrating the optical performance of the display system to be calibrated based on the characteristic information analysis result.
The above steps are then described in detail below.
In the step S110, the preset calibration parameter information of the eye camera includes an internal parameter, an intrinsic parameter, or an external parameter; the internal parameters comprise projection transformation parameters from the eyeball camera coordinates to the two-dimensional image coordinates shot by the eyeball camera; intrinsic parameters include focal length, principal point, optical distortion parameters; the extrinsic parameters include a rotation matrix and a translation vector between the left eye camera and the right eye camera.
Wherein the extrinsic parameters represent a conversion from the world coordinate system to the eye camera coordinate system, and the extrinsic parameters include a rotation matrix and a translation vector between the left eye camera and the right eye camera, by which the eye camera center position and the heading of the eye camera in the world coordinate system can be facilitated to be determined. Thus, parametric calibration of eye photography can be used to correct lens distortion, measure object size in world three dimensions, or determine the position of an eye camera in a scene in three dimensional scene reconstruction.
Specifically, the process of parameter calibration on the preset eyeball camera comprises the following steps: displaying a sample image with a preset size through a sample screen at a preset distance and a preset angle relative to the eyeball camera; shooting the sample image through the eyeball camera to obtain a corresponding shooting image; based on the shot image and Zhang Zhengyou calibration method, the parameters of the dome camera are calibrated.
As can be seen, the preset eyeball camera comprises a left eyeball camera and a right eyeball camera which are arranged in pairs, and the display system to be calibrated comprises a left eye display screen and a right eye display screen; the process of adjusting the positional relationship between the eye camera and the display system to be calibrated includes: the optical axis position of the left eyeball camera is aligned with the center position of the left eye display screen, the optical axis position of the right eyeball camera is aligned with the center position of the right eye display screen, after the positions of the left eyeball camera and the right eyeball camera are determined, the eyeball camera and the display system to be monitored can be fixed through a certain fixing piece or a fixing mode, and the relative positions of the left eyeball camera and the right eyeball camera in the running process are ensured to be stable, and no position deviation occurs.
After the position of the eyeball camera is determined, a pre-designed calibration pattern can be rendered and displayed through the display system to be calibrated, the calibration pattern can be designed into a regular pattern with certain position distribution and color distribution, so that virtual scene rendering is performed according to a preset rule, and then the virtual scene rendering is displayed on a screen of the display system to be calibrated, wherein the preset rule can comprise: setting parameters such as resolution of rendering, frame rate of rendering and the like for rendering. Then, the pattern information displayed on the screen is photographed by an eyeball camera.
It should be noted that, in the process of shooting by the eyeball camera, the display system to be calibrated and the eyeball camera can be controlled to rotate by an external device, and image information presented by the display system to be calibrated is shot in real time by the eyeball camera according to a preset frame rate, the external device can be a mechanical arm, and the mechanical arm can enable the system to be calibrated and the eyeball camera thereon to be performed in a certain mode according to a preset movement rule. The motion rule may be set according to an application scenario or a calibration requirement of the display system to be calibrated, and is not limited specifically, and by setting different rotation angles and different rotation speeds, a change of display content of the display screen to be calibrated in a corresponding motion mode can be displayed, for example, whether a certain error exists in contrast of the display content in the motion mode or not is found, so that calibration accuracy of optical performance of the display system is ensured.
Specifically, the process of controlling the display system to be calibrated and the eyeball camera to rotate through the external device and shooting the image information presented by the display system to be calibrated in real time through the eyeball camera according to the preset frame rate comprises the following steps: controlling a display system to be calibrated and an eyeball camera to rotate in a preset mode; shooting first image information presented by a left eye screen in real time by a left eye camera according to a first preset frame rate; and simultaneously, shooting second image information presented by a right eye screen in real time by a right eye camera according to a first preset frame rate. The preset mode, that is, the set motion rule, is not particularly limited in the display system calibration method of the present invention.
Finally, the process of analyzing the characteristic information of the image information and calibrating the optical performance of the display system to be calibrated based on the result of the characteristic information analysis includes: respectively acquiring characteristic values of the characteristics of the first image information and the second image information in the upper left, upper right, lower left, lower right and middle areas; features include hue, saturation, and contrast; comparing the characteristic value of the first image information with the characteristic value at the corresponding position of the left eye display screen to obtain a first comparison result, and comparing the characteristic value of the second image information with the characteristic value at the corresponding position of the right eye display screen to obtain a second comparison result; judging whether the left-eye display screen meets parameter requirements or not based on the first comparison result, and if the left-eye display screen does not meet the parameter requirements, adjusting the characteristics of the corresponding position of the left-eye display screen based on the characteristic value of the first image information; and circularly executing the steps until the parameters of the left eye display screen meet the set parameter requirements; and similarly, judging whether the right-eye display screen meets the parameter requirement or not based on the second comparison result, if the right-eye display screen does not meet the parameter requirement, adjusting the characteristics of the corresponding position of the right-eye display screen based on the characteristic value of the second image information, and circularly executing the steps until the parameter of the right-eye display screen meets the set parameter requirement.
In one embodiment of the present invention, in order to further calibrate the display system to be calibrated, improve the optical performance thereof, perform feature information analysis on the image information, and calibrate the optical performance of the display system to be calibrated based on the result of the feature information analysis, the process may further include: the method comprises the steps of analyzing key characteristic information such as collinearity, curvature, length, width, added marks, lost marks, numbers, shapes, sizes, space grouping or space directions of first image information and second image information, calibrating optical performance of a display system to be calibrated based on analysis results, and attaching optical distortion rate, optical dispersion rate and the like, so that display performance can be adjusted and optimized accordingly, and overall optical display quality is improved.
It should be noted that, the range of the first preset frame rate may be 30Hz to 60Hz.
In another embodiment of the present invention, the resolution of the eyeball camera is set to be not less than the resolution of the display system to be calibrated; in addition, the attributes of the eyeball camera comprise simulated cornea position, simulated cornea geometry, eyeball position, pupil size, pupil position, gaze distance, gaze direction and the like, the display position and direction for human eyes are simulated through the eyeball camera, the shooting frame rates of the left eyeball camera and the right eyeball camera are strictly synchronous physically in the application process, the design of human eyes can be simulated in geometric, optical performance and/or motion, the cornea and pupil geometry which are the same as the human eyes are adopted, the iris and the pupil are provided with various textures, colors or diameter options, the resolution design of the eyeball camera is also included, and the eyeball camera is utilized to calibrate and evaluate the perceived virtual world and the real world according to the human eye conditions such as pupil position, gaze point and the like.
Corresponding to the above display system calibration method, the present invention further provides a display system calibration system, and in particular, fig. 2 shows schematic logic of the display system calibration system according to an embodiment of the present invention.
As shown in fig. 2, a display system calibration system 200 according to an embodiment of the present invention mainly includes:
a parameter calibration unit 210, configured to perform parameter calibration on a preset eyeball camera;
a position determining unit 220, configured to adjust a positional relationship between the eye camera and the display system to be calibrated based on calibration parameter information of the eye camera, and fix the eye camera on the display system to be calibrated;
the calibration pattern rendering unit 230 is configured to render a preset calibration pattern onto the display system to be calibrated according to a preset rule virtual scene;
the image information shooting unit 240 is configured to control the display system to be calibrated and the eyeball camera to rotate, and shoot image information presented by the display system to be calibrated in real time according to a preset frame rate through the eyeball camera;
an optical performance calibration unit 250 for performing feature information analysis on the image information and calibrating the optical performance of the display system to be calibrated based on the result of the feature information analysis.
It should be noted that, in the embodiments of the display system calibration system, reference may be made to descriptions in the embodiments of the display system calibration method, which are not described herein in detail.
According to the display system calibration method and system provided by the invention, quantitative parameter evaluation and calibration can be carried out on the display system by simulating the eyeball camera of the human eye, so that the uniformity and universality of the display system calibration are ensured, the display performance of the display system is further optimized, and the comfort level and naturalness of VR, AR or MR technology and the experience level of a user are ensured.
The display system calibration method and system according to the present invention are described above by way of example with reference to fig. 1 and 2. However, it will be appreciated by those skilled in the art that various modifications may be made to the display system calibration method and system set forth above without departing from the spirit of the invention. Accordingly, the scope of the invention should be determined from the following claims.
Claims (7)
1. A method for calibrating a display system, comprising:
parameter calibration is carried out on a preset eyeball camera, and the parameter calibration process comprises the following steps: displaying a sample image with a preset size through a sample screen at a preset distance and a preset angle relative to an eyeball camera; shooting the sample image through the eyeball camera to obtain a corresponding shooting image; calibrating parameters of the eyeball camera based on the photographed image and a Zhang Zhengyou calibration method, wherein the eyeball camera comprises a left eyeball camera and a right eyeball camera which are arranged in pairs;
based on the calibration parameter information of the eyeball camera, adjusting the position relation between the eyeball camera and a display system to be calibrated, and fixing the eyeball camera on the display system to be calibrated, wherein the display system to be calibrated comprises a left eye display screen and a right eye display screen;
rendering a preset calibration pattern on the display system to be calibrated according to a preset rule virtual scene;
the method for controlling the display system to be calibrated and the eyeball camera to rotate according to different rotation angles and different rotation speeds, and shooting image information presented by the display system to be calibrated in real time through the eyeball camera according to a preset frame rate comprises the following steps: controlling the display system to be calibrated and the eyeball camera to rotate in a preset mode; shooting first image information presented by the left eye display screen in real time according to a first preset frame rate through the left eye camera; simultaneously, shooting second image information presented by the right eye display screen in real time through the right eye camera according to the first preset frame rate;
performing characteristic information analysis on the image information, and calibrating optical performance of the display system to be calibrated based on a result of the characteristic information analysis, including: respectively acquiring characteristic values of the characteristics of the first image information and the second image information in the upper left, upper right, lower left, lower right and middle areas; the features include hue, saturation and contrast; comparing the characteristic value of the first image information with the characteristic value at the corresponding position of the left eye display screen to obtain a first comparison result, and comparing the characteristic value of the second image information with the characteristic value at the corresponding position of the right eye display screen to obtain a second comparison result; judging whether the left-eye display screen meets parameter requirements or not based on the first comparison result, and if the left-eye display screen does not meet the parameter requirements, adjusting the characteristics of the corresponding position of the left-eye display screen based on the characteristic value of the first image information; and circularly executing the steps; and judging whether the right-eye display screen meets parameter requirements or not based on the second comparison result, if not, adjusting the characteristics of the corresponding position of the right-eye display screen based on the characteristic value of the second image information, and executing the steps in a circulating way.
2. The method for calibrating a display system according to claim 1,
the process of adjusting the positional relationship between the eye camera and the display system to be calibrated comprises:
and aligning the optical axis position of the left eyeball camera with the central position of the left eye display screen, and aligning the optical axis position of the right eyeball camera with the central position of the right eye display screen.
3. A display system calibration method as defined in claim 2, wherein,
the calibration parameter information comprises an internal parameter, an inherent parameter or an external parameter;
the internal parameters comprise projection transformation parameters from the eyeball camera coordinates to two-dimensional image coordinates shot by the eyeball camera;
the inherent parameters comprise focal length, principal point and optical distortion parameters;
the extrinsic parameters include a rotation matrix and a translation vector between the left eye camera and the right eye camera.
4. The display system calibration method according to claim 1, wherein the process of performing feature information analysis on the image information and calibrating the optical performance of the display system to be calibrated based on the result of feature information analysis, further comprises:
and analyzing the collinearity, curvature, length, width, adding marks, lost marks, numbers, shapes, sizes, spatial grouping or spatial directions of the first image information and the second image information, and calibrating the optical performance of the display system to be calibrated based on the analysis result.
5. The method for calibrating a display system according to claim 1,
the range of the first preset frame rate is 30 Hz-60 Hz.
6. The method for calibrating a display system according to claim 1,
the resolution of the eyeball camera is not smaller than the resolution of the display system to be calibrated; and, in addition, the processing unit,
the properties of the eye camera include simulated cornea position, simulated cornea geometry, eye position, pupil size, pupil position, gaze distance, and gaze direction.
7. A display system calibration system, comprising:
the parameter calibration unit is used for carrying out parameter calibration on a preset eyeball camera, and the parameter calibration process comprises the following steps: displaying a sample image with a preset size through a sample screen at a preset distance and a preset angle relative to an eyeball camera; shooting the sample image through the eyeball camera to obtain a corresponding shooting image; calibrating parameters of the eyeball camera based on the photographed image and a Zhang Zhengyou calibration method, wherein the eyeball camera comprises a left eyeball camera and a right eyeball camera which are arranged in pairs;
the position determining unit is used for adjusting the position relation between the eyeball camera and the display system to be calibrated based on the calibration parameter information of the eyeball camera and fixing the eyeball camera on the display system to be calibrated, wherein the display system to be calibrated comprises a left eye display screen and a right eye display screen;
the calibration pattern rendering unit is used for rendering a preset calibration pattern to the display system to be calibrated according to a preset rule virtual scene;
the image information shooting unit is used for controlling the display system to be calibrated and the eyeball camera to rotate according to different rotation angles and different rotation speeds, shooting image information presented by the display system to be calibrated in real time through the eyeball camera according to a preset frame rate, and comprises the following steps: controlling the display system to be calibrated and the eyeball camera to rotate in a preset mode; shooting first image information presented by the left eye display screen in real time according to a first preset frame rate through the left eye camera; simultaneously, shooting second image information presented by the right eye display screen in real time through the right eye camera according to the first preset frame rate;
an optical performance calibration unit for performing feature information analysis on the image information and calibrating optical performance of the display system to be calibrated based on a result of the feature information analysis, including: respectively acquiring characteristic values of the characteristics of the first image information and the second image information in the upper left, upper right, lower left, lower right and middle areas; the features include hue, saturation and contrast; comparing the characteristic value of the first image information with the characteristic value at the corresponding position of the left eye display screen to obtain a first comparison result, and comparing the characteristic value of the second image information with the characteristic value at the corresponding position of the right eye display screen to obtain a second comparison result; judging whether the left-eye display screen meets parameter requirements or not based on the first comparison result, and if the left-eye display screen does not meet the parameter requirements, adjusting the characteristics of the corresponding position of the left-eye display screen based on the characteristic value of the first image information; and circularly executing the steps; and judging whether the right-eye display screen meets parameter requirements or not based on the second comparison result, if not, adjusting the characteristics of the corresponding position of the right-eye display screen based on the characteristic value of the second image information, and executing the steps in a circulating way.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110504684.9A CN113099203B (en) | 2021-05-10 | 2021-05-10 | Display system calibration method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110504684.9A CN113099203B (en) | 2021-05-10 | 2021-05-10 | Display system calibration method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113099203A CN113099203A (en) | 2021-07-09 |
| CN113099203B true CN113099203B (en) | 2023-08-22 |
Family
ID=76665318
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110504684.9A Active CN113099203B (en) | 2021-05-10 | 2021-05-10 | Display system calibration method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113099203B (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH06160727A (en) * | 1992-11-18 | 1994-06-07 | Koonan:Kk | Eyeball microscope |
| WO2012100495A1 (en) * | 2011-01-30 | 2012-08-02 | 中兴通讯股份有限公司 | Processing method and apparatus for stereoscopic capture of dual cameras |
| CN104887316A (en) * | 2015-04-24 | 2015-09-09 | 长春理工大学 | Virtual three-dimensional endoscope displaying method based on active three-dimensional displaying technology |
| CN106596051A (en) * | 2016-12-19 | 2017-04-26 | 中国航空工业集团公司洛阳电光设备研究所 | Airborne head-up display and head-mounted display delay test apparatus and method |
| CN107003109A (en) * | 2014-11-13 | 2017-08-01 | 奥林巴斯株式会社 | Calibrating installation, calibration method, Optical devices, camera, projection arrangement, measuring system and measuring method |
| CN206961066U (en) * | 2017-02-28 | 2018-02-02 | 深圳市未来感知科技有限公司 | A kind of virtual reality interactive device |
| CN108124152A (en) * | 2017-12-26 | 2018-06-05 | 华勤通讯技术有限公司 | The distortion measurement method and system of head-mounted display apparatus |
| TWM569008U (en) * | 2018-07-20 | 2018-10-21 | 威盛電子股份有限公司 | Eye position calibrating system |
| CN110557626A (en) * | 2019-07-31 | 2019-12-10 | 华为技术有限公司 | image display method and electronic equipment |
| CN111694158A (en) * | 2020-06-17 | 2020-09-22 | Oppo广东移动通信有限公司 | Calibration method, calibration equipment and calibration system for near-eye display device |
| CN112584113A (en) * | 2020-12-02 | 2021-03-30 | 深圳市当智科技有限公司 | Wide-screen projection method and system based on mapping correction and readable storage medium |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107239213A (en) * | 2014-12-31 | 2017-10-10 | 华为终端（东莞）有限公司 | Control method for screen display and mobile terminal |
-
2021
- 2021-05-10 CN CN202110504684.9A patent/CN113099203B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH06160727A (en) * | 1992-11-18 | 1994-06-07 | Koonan:Kk | Eyeball microscope |
| WO2012100495A1 (en) * | 2011-01-30 | 2012-08-02 | 中兴通讯股份有限公司 | Processing method and apparatus for stereoscopic capture of dual cameras |
| CN107003109A (en) * | 2014-11-13 | 2017-08-01 | 奥林巴斯株式会社 | Calibrating installation, calibration method, Optical devices, camera, projection arrangement, measuring system and measuring method |
| CN104887316A (en) * | 2015-04-24 | 2015-09-09 | 长春理工大学 | Virtual three-dimensional endoscope displaying method based on active three-dimensional displaying technology |
| CN106596051A (en) * | 2016-12-19 | 2017-04-26 | 中国航空工业集团公司洛阳电光设备研究所 | Airborne head-up display and head-mounted display delay test apparatus and method |
| CN206961066U (en) * | 2017-02-28 | 2018-02-02 | 深圳市未来感知科技有限公司 | A kind of virtual reality interactive device |
| CN108124152A (en) * | 2017-12-26 | 2018-06-05 | 华勤通讯技术有限公司 | The distortion measurement method and system of head-mounted display apparatus |
| TWM569008U (en) * | 2018-07-20 | 2018-10-21 | 威盛電子股份有限公司 | Eye position calibrating system |
| CN110557626A (en) * | 2019-07-31 | 2019-12-10 | 华为技术有限公司 | image display method and electronic equipment |
| CN111694158A (en) * | 2020-06-17 | 2020-09-22 | Oppo广东移动通信有限公司 | Calibration method, calibration equipment and calibration system for near-eye display device |
| CN112584113A (en) * | 2020-12-02 | 2021-03-30 | 深圳市当智科技有限公司 | Wide-screen projection method and system based on mapping correction and readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113099203A (en) | 2021-07-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109983501B (en) | Method for hiding object in image or video and related augmented reality method | |
| US11200646B2 (en) | Compensation for deformation in head mounted display systems | |
| KR102596880B1 (en) | Head-mounted display apparatus and method thereof for generating 3d image information | |
| EP4383193A1 (en) | Line-of-sight direction tracking method and apparatus | |
| CN109885169B (en) | Eyeball parameter calibration and sight direction tracking method based on three-dimensional eyeball model | |
| US11445170B2 (en) | Eyeball camera system and methods for display system calibration | |
| US10778953B2 (en) | Dynamic convergence adjustment in augmented reality headsets | |
| CN110119258B (en) | Method and system for testing and adjusting positions of display screen and optical system | |
| JP2019121394A (en) | Image generation device and method of generating image | |
| KR101454780B1 (en) | Apparatus and method for generating texture for three dimensional model | |
| JP6552266B2 (en) | Image processing apparatus, image processing method, and program | |
| CN112926523B (en) | Eyeball tracking method and system based on virtual reality | |
| CN113099203B (en) | Display system calibration method and system | |
| WO2020262261A1 (en) | Information processing device, information processing method, and program | |
| CN107888899A (en) | For image acquiring method, device and virtual reality device in virtual reality device | |
| CN114967128B (en) | Sight tracking system and method applied to VR glasses | |
| CN109963143A (en) | A kind of image acquiring method and system of AR glasses | |
| CN115278203A (en) | Calibration method and calibration device for virtual reality equipment and calibration robot | |
| US20230306676A1 (en) | Image generation device and image generation method | |
| CN108471939B (en) | Pan zone measuring method and device and wearable display equipment | |
| JP6932526B2 (en) | Image display device, image display method and program | |
| WO2019138515A1 (en) | Image forming device, eyeglass lens selection system, image forming method, and program | |
| CN108881892A (en) | Anti-dazzle method, system for Table top type virtual reality system | |
| US20240193744A1 (en) | Image processing device and image processing method | |
| JP2022083816A (en) | Image generation apparatus, image generation method, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |