CN107155104B - Display correction method and device of naked eye stereoscopic display equipment - Google Patents

Display correction method and device of naked eye stereoscopic display equipment Download PDF

Info

Publication number
CN107155104B
CN107155104B CN201710487902.6A CN201710487902A CN107155104B CN 107155104 B CN107155104 B CN 107155104B CN 201710487902 A CN201710487902 A CN 201710487902A CN 107155104 B CN107155104 B CN 107155104B
Authority
CN
China
Prior art keywords
image
preset
correction
parameter
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710487902.6A
Other languages
Chinese (zh)
Other versions
CN107155104A (en
Inventor
赖敬文
简培云
席大军
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SuperD Co Ltd
Original Assignee
SuperD Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SuperD Co Ltd filed Critical SuperD Co Ltd
Priority to CN201710487902.6A priority Critical patent/CN107155104B/en
Publication of CN107155104A publication Critical patent/CN107155104A/en
Application granted granted Critical
Publication of CN107155104B publication Critical patent/CN107155104B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/20—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
    • G02B30/34—Stereoscopes providing a stereoscopic pair of separated images corresponding to parallactically displaced views of the same object, e.g. 3D slide viewers
    • G02B30/36—Stereoscopes providing a stereoscopic pair of separated images corresponding to parallactically displaced views of the same object, e.g. 3D slide viewers using refractive optical elements, e.g. prisms, in the optical path between the images and the observer

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
  • Processing Or Creating Images (AREA)
  • Stereoscopic And Panoramic Photography (AREA)

Abstract

The invention provides a display correction method and a display correction device of naked eye stereoscopic display equipment, wherein the method comprises the following steps: acquiring a first preset image displayed by naked eye stereoscopic display equipment according to preset layout parameters; acquiring actual image attributes of the first preset image according to the first preset image; acquiring a first correction parameter according to a preset layout parameter and an actual image attribute of a first preset image; and storing the first correction parameter, so that the naked eye three-dimensional display equipment performs naked eye three-dimensional display according to the first correction parameter. According to the method, errors of the display device of the naked eye three-dimensional display equipment in the production process are detected, the correction parameters are stored, and during subsequent naked eye three-dimensional display, display is corrected according to the correction parameters, so that the display equipment displays standard images, the three-dimensional display effect is guaranteed, the correction method provided by the invention can be suitable for different display equipment, the correction process is simplified, and the design cost is saved.

Description

Display correction method and device of naked eye stereoscopic display equipment
Technical Field
The invention relates to the technical field of stereoscopic display, in particular to a display correction method and device of naked eye stereoscopic display equipment and electronic equipment.
Background
At present, a special light splitting device, such as a grating, is superimposed on a conventional display screen in mainstream 3D (stereoscopic) display equipment, and the grating can refract images in different directions, so that visible frames of a left eye and a right eye are separated, and a user can see a 3D image. Generally speaking, when naked eye 3D display equipment displays images, a left-eye image and a right-eye image need to be arranged and displayed on a conventional display screen according to a certain rule (i.e. arranging images), and a left-eye and a right-eye viewing areas are formed in a user viewing area in cooperation with a light splitting function of a grating, so that the left-eye image is sent to a left eye of a user, and the right-eye image is sent to a right eye of the user, so that the user views a 3D image.
Because the arrangement diagram must be matched with the light splitting action of the grating, grating parameters, such as grating inclination angle, grating pitch and the like, are key parameters required to be used in the arrangement diagram algorithm, are also necessary parameters for the naked eye 3D display device to perform imaging display, and directly determine the imaging effect of the 3D display device. However, due to factors such as manufacturing process and assembly error, the actual values of the grating parameters usually deviate from the ideal design values. If the designed values are directly used for drawing arrangement display, the naked eye 3D display equipment cannot accurately adjust the left and right eye visual areas, and the display effect of the naked eye 3D display equipment is further influenced. Therefore, in order to effectively ensure the display effect of the naked eye 3D display device, before the naked eye 3D display device leaves factory and is sold, the raster parameters of the naked eye 3D display device need to be corrected, that is, the actual values of the raster parameters of the naked eye 3D display device need to be very accurately obtained so as to be applied to the layout algorithm of the device, and the stereoscopic display effect of the naked eye 3D display device is ensured.
In traditional display device calibration process, according to the display device of difference, manual parameter adjustment is carried out to it, makes the final imaging effect optimum, because its calibration process is manual, greatly increased correctors' work load, is unfavorable for automatic realization and the requirement of the quick production of volume production.
With the development of the technology, some automatic detection and correction methods are developed successively, including correction for a screen, correction for a camera, and correction for the whole tracking type stereo display scheme, which simplify the manual detection process to a certain extent.
Disclosure of Invention
The embodiment of the invention provides a display correction method and a display correction device of naked eye stereoscopic display equipment, and aims to solve the problems that in the prior art, an automatic detection correction process is scattered, a complete detection correction system is lacked, and the requirements of mass production and rapid production are not met.
The embodiment of the invention provides a display correction method of naked eye stereoscopic display equipment, the naked eye stereoscopic display equipment comprises a display screen, the display screen comprises a display device and a light splitting device, the display device and the light splitting device are oppositely arranged, and the method comprises the following steps:
acquiring a first preset image displayed by the naked eye three-dimensional display equipment according to preset layout parameters;
acquiring actual image attributes of the first preset image according to the first preset image;
acquiring a first correction parameter according to the preset layout parameter and the actual image attribute of the first preset image;
and storing the first correction parameter, so that the autostereoscopic display equipment performs autostereoscopic display according to the first correction parameter.
Optionally, the obtaining of the first predetermined image displayed by the autostereoscopic display device according to the preset layout parameter includes:
shooting a virtual image formed by the first preset image on a mirror surface by using a camera or directly shooting the first preset image by using the camera to obtain a first target image so that the first target image comprises the first preset image;
and acquiring the first preset image according to the first target image.
Specifically, when the virtual image is formed on the mirror surface, the display screen is parallel to and opposite to the mirror surface.
Optionally, the obtaining the first predetermined image according to the first target image includes:
determining a region range of the first predetermined image in the first target image;
according to the determined area range, an image corresponding to the area range is scratched in the first target image, and therefore the first preset image is obtained.
Optionally, the determining the region range of the first predetermined image in the first target image includes:
determining the area range of the display screen in the first target image according to predetermined image position information corresponding to the display screen, so that the area range of the display screen in the first target image is determined as the area range of the first predetermined image in the first target image, wherein the image position information comprises coordinate information of four vertexes of the display screen in the first target image;
alternatively, the first and second electrodes may be,
performing image denoising processing on the first target image;
determining edge pixel points of the first preset image in the first target image by adopting an edge detection algorithm aiming at the denoised first target image;
and determining the boundary line of the first preset image in the first target image according to the edge pixel points, so as to determine the area range of the first preset image in the first target image.
Optionally, the obtaining a first correction parameter according to the preset mapping parameter and the actual image attribute of the first predetermined image includes:
acquiring a first incidence relation among the layout parameter, the first correction parameter and the theoretical image attribute of the first preset image;
and determining the first correction parameter according to the first incidence relation, the actual image attribute and the preset layout parameter.
Optionally, the first correlation is a functional relationship in which the ranking parameter and the first correction parameter are applied to represent the theoretical image attribute.
Optionally, the determining the first correction parameter according to the first association relationship, the actual image attribute, and the preset mapping parameter includes:
establishing a first cost function corresponding to the first incidence relation;
and according to the actual image attribute and the preset mapping parameter, minimizing the first cost function by utilizing a minimization algorithm, and determining the first correction parameter.
Optionally, the first predetermined image is a stripe image formed by alternately arranging a first color stripe and a second color stripe;
the actual image attribute and the theoretical image attribute of the fringe image comprise fringe slope, fringe intercept and fringe spacing;
the preset layout parameters comprise a layout inclination angle, a layout period and a layout displacement;
the first correction parameters comprise grating inclination angle, grating horizontal pitch and grating displacement.
Optionally, the first predetermined image is a stripe image formed by alternately arranging a first color stripe and a second color stripe;
the actual image properties of the fringe image include at least one of fringe slope, fringe intercept, and fringe spacing;
the obtaining of the actual image attribute of the first predetermined image according to the first predetermined image comprises:
acquiring a center line point of the first color stripe in the stripe image;
performing linear fitting according to the centerline point of the first color stripe to obtain a fitted stripe linear equation;
and determining the actual image attribute of the fringe image according to the fitted fringe straight-line equation.
Optionally, the performing line fitting according to the centerline point of the first color stripe to obtain a fitted stripe line equation includes:
and performing linear fitting by using a least square method according to the center line point of the first color stripe to obtain a fitted stripe linear equation.
Optionally, a camera for shooting the virtual image is configured on the autostereoscopic display apparatus.
Optionally, a front camera is further configured on the naked eye stereoscopic display device;
the method further comprises the following steps:
shooting a virtual image formed on a mirror surface by a second preset image displayed by the naked eye stereoscopic display equipment by using the front camera to obtain a second target image, wherein the second target image comprises the second preset image;
acquiring correction parameters of the front camera according to the second target image containing the second preset image, wherein the correction parameters of the front camera comprise internal parameters and external parameters of the camera;
and storing the correction parameters of the front camera so that the naked eye three-dimensional display equipment uses the correction parameters of the front camera to carry out naked eye three-dimensional display.
Optionally, the obtaining the correction parameter of the front camera according to the second target image containing the second predetermined image includes:
acquiring actual pixel coordinates of characteristic pixel points in the second preset image in the second target image;
and determining the correction parameters of the front camera according to the actual pixel coordinates of the characteristic pixel points.
Optionally, the determining, according to the actual pixel coordinate of the characteristic pixel point, a correction parameter of the front-facing camera includes:
acquiring original coordinate information of the characteristic pixel points when the naked eye stereoscopic display equipment displays a second preset image;
acquiring a second incidence relation between theoretical pixel coordinates of the characteristic pixel points in the second preset image in the second target image and correction parameters of the front camera according to the original coordinate information of the characteristic pixel points;
and determining the correction parameters of the front camera according to the actual pixel coordinates of the characteristic pixel points and the second incidence relation between the theoretical pixel coordinates and the correction parameters of the front camera.
Optionally, the obtaining, according to the original coordinate information of the feature pixel, a second association relationship between theoretical pixel coordinates of the feature pixel in the second predetermined image in the second target image and the correction parameter of the front-facing camera includes:
acquiring second coordinate information of the characteristic pixel points in the virtual image according to the original coordinate information of the characteristic pixel points and the distance between the display screen and the mirror surface;
and performing preset coordinate transformation by using the correction parameter of the front-facing camera according to the second coordinate information of the characteristic pixel point, thereby obtaining a second association relation between the theoretical pixel coordinate of the characteristic pixel point in the second preset image in the second target image and the correction parameter of the front-facing camera.
Optionally, the determining, according to the actual pixel coordinate of the characteristic pixel point and the second association relationship between the theoretical pixel coordinate and the correction parameter of the front camera, the correction parameter of the front camera includes:
establishing a second cost function corresponding to the second incidence relation;
and according to the obtained actual pixel coordinates, minimizing the second cost function by utilizing a minimization algorithm, and determining the correction parameters of the front camera.
Optionally, the second predetermined image is a checkerboard image, and the feature pixel points are intersections between adjacent checkerboards.
Optionally, the autostereoscopic display device includes a first display mode and a second display mode;
the naked eye stereoscopic display equipment displays the first preset image in the first display mode, and the first correction parameter corresponds to the first display mode;
the method further comprises the following steps:
acquiring a third preset image displayed by the naked eye stereoscopic display device according to a preset second arrangement parameter in the second display mode;
acquiring actual image attributes of the third preset image according to the third preset image;
acquiring a second correction parameter according to the preset second layout parameter and the actual image attribute of the third preset image;
saving the second correction parameter.
Optionally, after saving the second correction parameter, the method further includes:
determining a current display mode of the naked eye stereoscopic display equipment;
calling a first correction parameter corresponding to a first display mode to carry out autostereoscopic display when the autostereoscopic display equipment is determined to be in the first display mode;
and calling a second correction parameter corresponding to the second display mode to perform autostereoscopic display when the autostereoscopic display device is determined to be in the second display mode.
The embodiment of the invention also provides a display correction device of the naked eye stereoscopic display equipment, the naked eye stereoscopic display equipment comprises a display screen, the display screen comprises a display device and a light splitting device, the display device and the light splitting device are oppositely arranged, and the device comprises:
the first acquisition module is used for acquiring a first preset image displayed by the naked eye stereoscopic display equipment according to preset layout parameters;
the second acquisition module is used for acquiring the actual image attribute of the first preset image according to the first preset image;
the third acquisition module is used for acquiring a first correction parameter according to the preset layout parameter and the actual image attribute of the first preset image;
and the first storage module is used for storing the first correction parameter so that the autostereoscopic display equipment performs autostereoscopic display according to the first correction parameter.
Optionally, the first obtaining module includes:
the first obtaining sub-module is used for shooting a virtual image formed by the first preset image on the mirror surface by using a camera or directly shooting the first preset image by using the camera to obtain a first target image so that the first target image comprises the first preset image;
and the second acquisition sub-module is used for acquiring the first preset image according to the first target image.
Optionally, the second obtaining sub-module includes:
a first determination unit configured to determine a region range of the first predetermined image in the first target image;
and a second determining unit, configured to, according to the determined region range, extract an image corresponding to the region range from the first target image, so as to obtain the first predetermined image.
Optionally, the third obtaining module includes:
the third obtaining submodule is used for obtaining a first incidence relation among the arrangement parameter, the first correction parameter and the theoretical image attribute of the first preset image;
and the first determining submodule determines the first correction parameter according to the first incidence relation, the actual image attribute and the preset layout parameter.
Optionally, the first correlation is a functional relationship in which the ranking parameter and the first correction parameter are applied to represent the theoretical image attribute.
Optionally, the first determining sub-module includes:
the establishing unit is used for establishing a first cost function corresponding to the first incidence relation;
and the third determining unit is used for minimizing the first cost function by utilizing a minimization algorithm according to the actual image attribute and the preset mapping parameter, and determining the first correction parameter.
Optionally, the first predetermined image is a stripe image formed by alternately arranging a first color stripe and a second color stripe;
the actual image properties of the fringe image include at least one of fringe slope, fringe intercept, and fringe spacing;
the second acquisition module includes:
a fourth obtaining submodule, configured to obtain a centerline point of the first color stripe in the stripe image;
the fitting submodule is used for performing linear fitting according to the centerline point of the first color stripe to obtain a stripe linear equation after fitting;
and the second determining submodule is used for determining the actual image attribute of the fringe image according to the fitted fringe straight-line equation.
Optionally, a front camera is further configured on the naked eye stereoscopic display device; the device further comprises:
the fourth acquisition module is used for shooting a virtual image formed by a second preset image displayed by the naked eye stereoscopic display equipment on a mirror surface by using the front camera to acquire a second target image, wherein the second target image comprises the second preset image;
a fifth obtaining module, configured to obtain a correction parameter of the front-facing camera according to the second target image including the second predetermined image, where the correction parameter of the front-facing camera includes an internal parameter and an external parameter of the camera;
and the second storage module is used for storing the correction parameters of the front camera, so that the naked eye three-dimensional display equipment uses the correction parameters of the front camera to carry out naked eye three-dimensional display.
Optionally, the fifth obtaining module includes:
a fifth obtaining submodule, configured to obtain actual pixel coordinates of a feature pixel point in the second predetermined image in the second target image;
and the third determining submodule is used for determining the correction parameters of the front camera according to the actual pixel coordinates of the characteristic pixel points.
Optionally, the third determining sub-module includes:
the first acquisition unit is used for acquiring original coordinate information of the characteristic pixel points when the naked eye three-dimensional display equipment displays a second preset image;
the second obtaining unit is used for obtaining a second incidence relation between theoretical pixel coordinates of the characteristic pixel points in the second preset image in the second target image and correction parameters of the front camera according to original coordinate information of the characteristic pixel points;
and the fourth determining unit is used for determining the correction parameters of the front camera according to the actual pixel coordinates of the characteristic pixel points and the second incidence relation between the theoretical pixel coordinates and the correction parameters of the front camera.
Optionally, the autostereoscopic display device includes a first display mode and a second display mode;
the naked eye stereoscopic display equipment displays the first preset image in the first display mode, and the first correction parameter corresponds to the first display mode;
the device further comprises:
a sixth obtaining module, configured to obtain a third predetermined image displayed by the autostereoscopic display device according to a preset second arrangement parameter in the second display mode;
a seventh obtaining module, configured to obtain an actual image attribute of the third predetermined image according to the third predetermined image;
the eighth acquiring module is used for acquiring a second correction parameter according to the preset second layout parameter and the actual image attribute of the third preset image;
and the third storage module is used for storing the second correction parameter.
Optionally, the apparatus further comprises:
a determining module, configured to determine a current display mode of the autostereoscopic display device after the third saving module saves the second correction parameter;
the first calling module is used for calling a first correction parameter corresponding to a first display mode to carry out naked eye three-dimensional display when the naked eye three-dimensional display equipment is determined to be in the first display mode;
and the second calling module is used for calling a second correction parameter corresponding to the second display mode to perform naked eye stereoscopic display when the naked eye stereoscopic display device is determined to be in the second display mode.
Embodiments of the present invention also provide a computer-readable storage medium for storing a computer program, where the computer program can be executed by a processor to perform the above-mentioned method.
An embodiment of the present invention further provides an electronic device, where the electronic device includes one or more processors, and the processors are configured to execute the following methods:
acquiring a first preset image displayed by naked eye stereoscopic display equipment according to preset layout parameters;
acquiring actual image attributes of the first preset image according to the first preset image;
acquiring a first correction parameter according to the preset layout parameter and the actual image attribute of the first preset image;
and storing the first correction parameter, so that the autostereoscopic display equipment performs autostereoscopic display according to the first correction parameter.
An embodiment of the present invention further provides a naked eye stereoscopic display device, including:
the device comprises a shell, a display screen and a front camera which are arranged on the shell, and one or more processors which are arranged in the shell;
the display screen comprises a display device and a light splitting device, and the display device and the light splitting device are arranged oppositely;
the processor arranges pixels on the display device according to preset arrangement parameters, and displays a first preset image on the display screen under the action of the light splitting device;
the front camera is used for shooting a virtual image formed by the first preset image on the mirror surface to obtain a first target image, so that the first target image comprises the first preset image;
the processor is configured to:
acquiring the first preset image according to the first target image;
acquiring actual image attributes of the first preset image according to the first preset image;
acquiring a first correction parameter according to the preset layout parameter and the actual image attribute of the first preset image;
and storing the first correction parameter, and performing naked eye three-dimensional display according to the first correction parameter.
The technical scheme of the embodiment of the invention at least comprises the following beneficial effects:
according to the technical scheme, the method comprises the steps of obtaining a first preset image displayed by the naked eye three-dimensional display equipment, determining the actual image attribute of the first preset image, determining a first correction parameter according to the actual image attribute and the preset layout parameter, correcting the naked eye three-dimensional display equipment according to the first correction parameter, detecting and correcting errors occurring in the production process of the naked eye three-dimensional display equipment, storing the correction parameter, displaying the naked eye three-dimensional display equipment according to the pre-stored correction parameter during subsequent naked eye three-dimensional display, namely correcting the display, and accordingly presenting a good three-dimensional display effect. Compared with the existing correction method, the correction method provided by the invention uses a more uniform mathematical model, has quick and continuous correction process and obvious systematization characteristic, simultaneously enables the detection and correction process to be more economical and easier to implement, and can meet the requirement of mass production and rapid production.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive exercise.
FIG. 1 is a schematic diagram illustrating the imaging principle of a first predetermined image in an embodiment of the present invention;
FIG. 2 is a schematic diagram illustrating a display correction method of a autostereoscopic display apparatus according to an embodiment of the present invention;
fig. 3a is a schematic diagram illustrating a coordinate state corresponding to a landscape state of the autostereoscopic display apparatus according to the embodiment of the present invention;
fig. 3b is a schematic diagram showing a coordinate state corresponding to a longitudinal screen state of the autostereoscopic display apparatus according to the embodiment of the present invention;
FIG. 4 is a schematic diagram of an auxiliary calibration system according to an embodiment of the present invention;
FIGS. 5 a-5 d are schematic diagrams of a fixture of an auxiliary calibration system according to an embodiment of the present invention;
FIGS. 6 a-6 b are schematic diagrams of a host calibration system according to an embodiment of the invention;
FIGS. 7 a-7 c are schematic diagrams of a single panel calibration system according to an embodiment of the present invention;
fig. 8a to 8c are schematic diagrams illustrating a display correction device of a autostereoscopic display apparatus according to an embodiment of the present invention.
Fig. 9 is a schematic view of a first target image acquired in a virtual image of a streak image (first predetermined image) displayed on a mirror surface captured by a camera in the embodiment of the present invention;
FIG. 10 is a schematic diagram of a fringe image extracted from the first target image in FIG. 9 according to an embodiment of the present invention;
FIG. 11 is a schematic illustration of a fitted fringe straight line in an embodiment of the present invention;
FIG. 12 is a schematic diagram of a checkerboard image in an embodiment of the present invention;
fig. 13 is a schematic diagram of a second target image acquired in a virtual image of a checkerboard image displayed on a mirror surface captured by a camera in the embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The autostereoscopic Display apparatus in the embodiment of the present invention includes a Display screen, where the Display screen includes a Display device and a light splitting device, and the Display device and the light splitting device are oppositely disposed, where the Display device is used to Display an image, for example, a conventional 2D Display panel, for example, a L CD (L acquired Crystal Display, liquid Crystal Display) panel, an O L ED (Organic L light-Emitting Diode) panel, and the light splitting device is used to split the image displayed by the Display device, for example, the light splitting device may be a grating, which may be any one of gratings that can be used in the autostereoscopic Display apparatus in the prior art, such as a slit grating or a lenticular grating, and the present invention is not limited.
Generally, the pixel columns on the display device run in the vertical direction, and if the light splitting device, such as the grating pattern, also runs in the vertical direction, the two run in the same direction, an obvious moire pattern is generated, which has a great influence on the display effect of the three-dimensional picture. Therefore, in order to reduce the influence of moire, in practical application, refer to fig. 1 specifically, wherein the first straight line represents the projection of the grating on the display device, and the naked eye stereoscopic display device generally adopts the grating placed obliquely, so that a certain angle is formed between the grain direction of the grating and the pixel column direction on the display device, and moire can be reduced or even eliminated.
Obviously, the arrangement of the left and right eye pictures on the display device needs to be matched with the light splitter device for performing the stereoscopic display, which refers to the background art described above, in order to avoid the influence of errors, display correction is performed on the autostereoscopic display device, that is, it is very necessary to accurately acquire the actual values (referred to as correction parameters in this application) of the parameters related to the light splitter device, so that the autostereoscopic display device performs the arrangement according to the correction parameters to perform the autostereoscopic display.
The following describes a display correction method and device for a autostereoscopic display apparatus according to an embodiment of the present invention in detail.
As shown in fig. 2, a display correction method of a autostereoscopic display device according to an embodiment of the present invention includes:
step 201, acquiring a first preset image displayed by the naked eye stereoscopic display device according to preset layout parameters.
In the embodiment of the invention, the naked eye stereoscopic display equipment comprises a display screen, wherein the display screen comprises a display device and a light splitting device, and the display device and the light splitting device are arranged oppositely. When the naked eye stereoscopic display equipment displays a first preset image, the naked eye stereoscopic display equipment arranges pixels on a display device according to preset arrangement parameters, and the first preset image is displayed on a display screen of the naked eye stereoscopic display equipment under the action of a light splitting device.
The autostereoscopic display device can arrange pixels according to preset arrangement parameters according to an arrangement mode during autostereoscopic display, wherein the arrangement mode during autostereoscopic display is a known technology and is not described again. Specifically, the layout parameters include a layout inclination angle, a layout period, a layout displacement and the like, wherein the layout displacement is a horizontal distance between an intersection point closest to a layout center point among intersection points of the light splitting device and a horizontal coordinate axis and the layout center point. Taking the first predetermined image as a stripe image as an example, the naked eye stereoscopic display device arranges the first color pixels and the second color pixels on the display device by using preset arrangement parameters, and displays the stripe image in which the first color stripes and the second color stripes are alternately arranged under the auxiliary action of the light splitting device, wherein the stripe image is a periodic stripe image, that is, the first color stripes and the second color stripes are arranged in a staggered and periodic manner. For example, the stripe image may be a red-green stripe image, i.e., the first color stripe is a stripe of one of red and green stripes and the second color stripe is a stripe of the other of red and green stripes.
After the naked eye stereoscopic display device displays the first predetermined image, in this step, the first predetermined image needs to be acquired.
The embodiment of the present invention does not limit how to obtain the first predetermined image, and the following examples illustrate that:
optionally, when the first predetermined image is acquired, the first predetermined image may be acquired by adopting a mirror projection manner, specifically: the method comprises the steps of projecting a first preset image displayed by the naked eye stereoscopic display device onto a mirror surface, presenting a virtual image of the first preset image on the mirror surface, shooting the virtual image of the first preset image formed on the mirror surface by using a camera, obtaining an image containing the first preset image, and obtaining the first preset image according to the image.
In order to facilitate subsequent operation and effectively ensure accuracy of operation processing by obtaining a first preset image with high quality, preferably, when a virtual image of the first preset image is formed on the mirror surface, a display screen of the naked eye stereoscopic display device is parallel to and opposite to the mirror surface, and the display screen and the mirror surface are separated by a preset distance, the preset distance can be reasonably set by a person in the field, and the basic principle is that the distance between the display screen of the naked eye stereoscopic display device and the mirror surface needs to be ensured so that the image collected by the camera contains the clear first preset image.
In a specific implementation, a special calibration jig may be designed for acquiring the first predetermined image by mirror projection, the jig may include a support for supporting the autostereoscopic display apparatus and a mirror, when the autostereoscopic display apparatus is placed on the support, a display screen of the autostereoscopic display apparatus may be spaced from the mirror by a predetermined distance and is preferably parallel to the mirror, and a clear virtual image of the first predetermined image may be displayed on the mirror. It will be appreciated that the tool used may take many forms, and the invention is not limited in this regard, but is intended to encompass as common components: a bracket for supporting the naked eye stereoscopic display device and a mirror surface.
It should be noted that the camera for shooting the virtual image may be a camera outside the autostereoscopic display apparatus, or may be a front camera configured for the autostereoscopic display apparatus itself, and when performing mirror projection, the front camera is directly opposite to the mirror surface, and can easily shoot the virtual image on the mirror surface.
It should be further noted that, no matter the virtual image is shot by a camera outside the autostereoscopic display device or by a front-facing camera configured by the autostereoscopic display device, the display correction method provided by the embodiment of the present invention may be executed by the autostereoscopic display device, that is, the autostereoscopic display device performs self-correction, and after acquiring the first predetermined image from the camera, performs subsequent processing to obtain a correction parameter, and stores the correction parameter for subsequent use.
The naked eye stereoscopic display equipment utilizes the front camera of the naked eye stereoscopic display equipment to shoot the virtual image so as to carry out self-correction, the camera of the naked eye stereoscopic display equipment is utilized in the mode, the camera does not need to be additionally configured, the design and the cost of a correcting tool are simplified, and the detection and correction process is more economical and is easier to implement. Moreover, for the naked eye stereoscopic display device with a tracking display function, namely, tracking the position of the eyes of a viewer, and displaying according to the position of the eyes, the front camera is used for tracking the viewing position, and the camera needs to be calibrated before leaving a factory, namely, the internal reference and the external reference of the camera are obtained.
Of course, the display correction method provided in the embodiment of the present invention may also be executed by other devices except the autostereoscopic display device, and after obtaining the correction parameter, the correction parameter is transmitted to the autostereoscopic display device for use.
It is understood that the process of acquiring the first predetermined image is not limited to be implemented by mirror mapping, and besides the process of acquiring by mirror projection, the first predetermined image may be directly captured by a camera outside the autostereoscopic display apparatus, so as to obtain an image including the first predetermined image, and then the first predetermined image is obtained according to the image. When the first preset image is directly shot by the aid of the external camera, the distance between the external camera and the display screen needs to be ensured, and clear images can be shot.
In the embodiment of the present invention, the image including the first predetermined image is referred to as a first target image. After the first target image is acquired, a first predetermined image is acquired according to the first target image, for example, the first predetermined image is extracted from the first target image. Specifically, the manner of acquiring the first predetermined image according to the first target image may include: firstly, determining the area range of a first preset image in a first target image; then, according to the determined area range, an image corresponding to the area range is scratched in the first target image, so that a first predetermined image is obtained, namely the scratched image corresponding to the area range is determined as the first predetermined image.
For example, as shown in fig. 9, a first target image, in which the first predetermined image is a fringe image, is projected onto a mirror surface, the camera captures a virtual image obtained by the projection, thereby obtaining the first target image, and then the fringe image is extracted from the first target image, and the extracted fringe image can be referred to fig. 10.
Specifically, when determining the area range of the first predetermined image in the first target image, there may be two ways:
the first mode is as follows: and determining the area range of the display screen in the first target image according to the predetermined image position information corresponding to the display screen, and determining the area range of the display screen in the first target image as the area range of the first predetermined image in the first target image.
The image position information referred to herein refers to position information of the display screen in the first target image, and the image position information may be predetermined and set. For a conventional square screen, when an image is displayed, the image is generally displayed in a full screen manner, that is, the image is displayed on the entire screen, and therefore, an image position corresponding to the display screen represents a position of the first predetermined image in the first target image, and then, an area range of the display screen in the first target image is an area range of the first predetermined image in the first target image. At this time, when the area range of the first predetermined image is acquired, the area range of the display screen needs to be defined according to the predetermined image position information corresponding to the display screen, and the area range of the display screen in the first target image needs to be determined as the area range of the first predetermined image in the first target image. Specifically, the image position information may include coordinate information of four vertices of the display screen in the first target image, that is, the area range may be determined according to the coordinate information of the four vertices of the display screen.
It should be noted that how to determine the image position information is not limited in the embodiment of the present invention, and a person skilled in the art may arbitrarily select the image position information. For example, when the first predetermined image is obtained by mirror mapping, the relative position between the mirror and the display screen is fixed, and the position of the display screen in the first target image is fixed, which can be determined by the prior art.
The second mode is as follows: firstly, performing image denoising processing on a first target image; then, aiming at the denoised first target image, determining edge pixel points of a first preset image in the first target image by adopting an edge detection algorithm; and determining the boundary line of the first preset image in the first target image according to the edge pixel points, thereby determining the area range of the first preset image in the first target image.
The algorithms such as denoising processing and edge detection belong to conventional methods in the prior art, and are not described herein again. For example, a value of a channel corresponding to the first target image may be extracted first, image denoising is performed using the channel value, and after image denoising is completed, an edge detection algorithm is used to determine edge pixel points of the first predetermined image for the denoised first target image. And determining a boundary line of the first preset image according to the determined edge pixel point, wherein a region surrounded by the boundary line in the first target image is a region corresponding to the first preset image, and an image corresponding to the region in the first target image is the first preset image.
After the area range of the first predetermined image is determined, a matting technique can be adopted in the first target image to scrub the area image corresponding to the area range, and the area image corresponding to the area range is determined as the first predetermined image, that is, the scrubbed area image is the first predetermined image.
After the first predetermined image is acquired, step 202 may be performed.
Step 202, obtaining the actual image attribute of the first predetermined image according to the first predetermined image.
The image attribute of the first predetermined image refers to a characteristic parameter inherent to the image, and for example, for a stripe image, the image attribute may include a slope of the stripe, an intercept of a stripe straight line (abbreviated as stripe intercept), a distance between adjacent stripes (abbreviated as stripe distance), and the like.
In one embodiment of the present invention, referring to fig. 10 and 11, the first predetermined image is a stripe image in which stripes of a first color and stripes of a second color are alternately arranged, for example, a red-green stripe image, a blue-yellow stripe image or other stripe images, wherein colors of two stripes of the stripe image need to have a distinct color distinction. Fig. 10 and 11 are schematic diagrams showing only two kinds of stripes, and the specific stripe color is not limited.
For a fringe image, its image attributes may include at least one of fringe slope, fringe intercept, and fringe spacing.
In this step, the image attributes may be obtained as follows:
firstly, acquiring a center line point of a first color stripe in a stripe image;
then, a straight line fitting is performed according to the centerline point of the first color stripe to obtain a fitted stripe straight line equation, for example, a straight line fitting may be performed by a least square method to obtain a fitted stripe straight line equation. The stripe straight line can be seen in fig. 11, and fig. 11 is the stripe straight line after fitting.
And further determining the actual image attribute of the fringe image according to the fitted fringe straight-line equation.
How to obtain the centerline points of the fringes and how to perform the line fitting can be done in a manner well known in the art and will not be described in detail here. For example, in the first predetermined image, for the first color stripe, the first color stripe may be processed by using a gaussian filter, and a centerline point of the first color stripe may be obtained by using a gradient change. And after obtaining the line points in the stripes, combining all the points into a plurality of line segments, deleting the line segments with too few points, and performing linear fitting processing on the plurality of line segments by using a least square method to obtain a fitted stripe linear equation.
The method for obtaining the stripe linear equation is not limited to the above method, and a coordinate system may be established according to the stripe image, and the stripe linear equation may be solved in the coordinate system. And will not be described in detail herein. It should be noted that other ways may be used to obtain the stripe straight line equation, and the method is not limited to the method illustrated in the embodiments of the present invention, and a person skilled in the art may select the stripe equation according to needs.
The fringe straight-line equation after straight-line fitting can be in the following form:
y＝kx+b+gh。
where h is d/cos θ, θ represents an angle (acute angle) between the linear equation and the x axis, d represents a fringe spacing, the slope k of the linear equation is a fringe slope, that is, a tangent value corresponding to θ is the slope k of the linear equation, the intercept b of the linear equation is a fringe intercept, where g is an integer and represents a fringe number, and g is 0, 1, or 2 … ….
Then, after a stripe straight-line equation is obtained through straight-line fitting, at least one of a stripe slope, a stripe intercept and a stripe interval in the actual image attribute of the stripe can be obtained.
Here, the image attribute obtained in this step is an actual image attribute, and a theoretical image attribute of the first predetermined image will be described later. It is emphasized that the actual image attribute and the theoretical image attribute are both image attributes, and the difference is that the actual image attribute refers to an image attribute obtained by detecting the first predetermined image, and the theoretical image attribute is calculated according to a theory and is not actually detected. Obviously, the theoretical image attribute value and the actual image attribute should be the same without influence of factors such as errors, i.e., the theoretical image attribute and the actual image attribute are the same regardless of errors.
After determining the actual image properties of the first predetermined image, step 203 is performed.
Step 203, acquiring a first correction parameter according to a preset layout parameter and an actual image attribute of the first predetermined image.
The first correction parameter is actually an actual value of an attribute parameter of the light splitting device, taking the light splitting device as a grating as an example, specifically, the first correction parameter may include a grating inclination angle, a grating horizontal pitch, a grating displacement, and the like.
According to the foregoing, the autostereoscopic display apparatus arranges pixels on a display device according to preset arrangement parameters, and displays a first predetermined image on a display screen of the autostereoscopic display apparatus under the action of a light splitting device. Taking the first preset image as a red and green stripe image as an example, the naked eye three-dimensional display equipment arranges red and green pixels on the display device according to preset arrangement parameters, and displays the red and green stripe image on the display screen under the light splitting action of the light splitting device. That is, the red and green stripe image is a result of the interaction between the row diagram and the light splitting device, that is, the first predetermined image is a result of the interaction between the row diagram and the light splitting device, that is, the theoretical image attribute, the row diagram parameter and the first correction parameter of the first predetermined image are closely related, and theoretically, a certain functional relationship must exist among the three. Obviously, a person skilled in the art can obtain a functional relationship between the optical principle and the mathematical principle, so as to obtain the first correction parameter by using the layout parameter and the actual image property of the first predetermined image.
By way of example, in one embodiment of the invention, the first predetermined image is a fringe image, the image attributes include fringe spacing and fringe slope, the drainage parameters include drainage dip and drainage period, and the first correction parameter includes raster dip, as a function of:
Figure BDA0001330902810000181
where θ is a stripe inclination angle, θ 1 is a row diagram inclination angle, θ 0 is a grating inclination angle, T is a stripe pitch, T1 is a row diagram period, and T0 is a grating projection period (period of grating projection onto the display screen), where the obtaining manner of T0 is not limited, for example, a known quantity, the stripe pitch is a corresponding stripe period, and a tangent value of the stripe inclination angle corresponds to a stripe slope.
Therefore, the grating inclination angle can be solved by utilizing the functional relation.
It is to be understood that the above-described modes are only examples, and the present invention is not limited thereto, and may be reasonably selected by those skilled in the art.
In another embodiment of the present invention, in summary, the specific process of determining the first correction parameter in this step may be:
acquiring a first incidence relation among the layout parameters, the first correction parameters and the theoretical image attributes;
and determining a first correction parameter according to the first incidence relation, the actual image attribute and a preset layout parameter.
Wherein the first relationship can be regarded as a functional relationship. A, B, C respectively represents one of the rank parameter, the first correction parameter, and the theoretical image attribute, the first association relationship can be represented as a ═ f (B, C), i.e., one of the rank parameter, the first correction parameter, and the theoretical image attribute is a function of the other two, i.e., a can be represented by applying B, C, i.e., a changes following B, C.
Since the first association relationship is a theoretical relationship, that is, the relationship between the theoretical image attribute and the layout parameter and the first correction parameter is represented, and the detected actual image attribute may have slight difference from the theoretical image attribute, in order to more accurately obtain the first correction parameter, a first cost function corresponding to the first association relationship may be established, and the first cost function is minimized by using a minimization algorithm according to the actual image attribute and the preset layout parameter, so as to determine the first correction parameter. The minimization algorithm is, for example, a gradient descent method, and the like, which is not limited in the present invention. This is illustrated in detail below:
in this embodiment, the light splitter is a grating, the first predetermined image is a stripe image formed by two colors arranged alternately, assuming that the stripe image is a red and green stripe image, the naked eye stereoscopic display device arranges the first color pixels and the second color pixels on the display screen by using preset layout parameters, namely, a layout inclination angle, a layout period, and a layout displacement, and displays the stripe image formed by the first color stripes and the second color stripes arranged alternately with the aid of the light splitter, where the stripe image is a periodic stripe image, that is, the first color stripes and the second color stripes are arranged alternately and periodically. The image attributes of the red and green stripe image include stripe slope, stripe intercept, and stripe spacing, among others.
Fig. 1 shows a schematic diagram, in which a first straight line represents a periodic grating (i.e., a light splitting device) projected onto a display screen, and actual grating parameters, i.e., first correction parameters, include a grating tilt angle c, a grating horizontal pitch p, and a grating displacement Δ, where the grating displacement Δ is a horizontal distance between an intersection point closest to a layout center point among intersection points of the grating and a horizontal coordinate axis X and the layout center point.
The second line represents a periodic profile on the display device according to preset profile parameters c ', p ', Δ ', including: a bar graph inclination angle c ', a bar graph period p' and a bar graph displacement delta ', wherein the bar graph displacement delta' is the horizontal distance between the intersection point closest to the bar graph central point and the bar graph central point in the intersection points of the bar graph and the horizontal coordinate axis X.
It will be appreciated that the slope k of the first line1Relating to the grating inclination c, for convenience of description, the slope k of the first line1Denoted tanc, and similarly, the slope k of the second line2Relating to the inclination angle c' of the row diagram, the slope k of the second line2Denoted as tan c'.
Obviously, the equation for the first line can be expressed as:
y＝k1x + tan Δ + tan n p, where n is an integer and denotes the number of the first straight line, and n is 0, 1, or 2 … …. k is a radical of1Representing the slope of a first line whose slope is the tangent of the grating slope c, i.e. k1Tan, tan Δ represents the intercept of the grating displacement on the y-axis, tan n p representsThe intercept of the horizontal pitch of the grating on the y-axis.
And the equation for the second line can be expressed as:
y＝k2x + tan '. m '. p ', where m is an integer and represents the number of the second line, and m is 0, 1, or 2 … …. k is a radical of2The slope of the second line is represented as the tangent value corresponding to the inclination angle c ', i.e., k2 ═ tan, tan ' × Δ ' represents the intercept of the displacement Δ ' on the y-axis, and tan ' × m × p ' represents the intercept of the period p ' on the y-axis.
The image attributes of the red and green stripe image include a stripe slope slp, a stripe intercept shf, a stripe pitch gap, and the like. Since the stripe image is a periodic image, the equation of the stripe image corresponding to the red and green stripe image can be expressed as:
y is slpx + shf + g is gap/cos θ, where g is an integer and represents the number of the stripe straight line, and tan θ represents the slope slp of the stripe image, the relationship between θ and slp can be determined, and the relationship between cos θ and slp can be obtained.
Obviously, the first predetermined image, i.e. the red and green stripe image, is formed by the interaction of the raster and the line pattern, i.e. it can be considered that the stripe straight line is generated from the first straight line formed by the raster projected on the display device of the above-mentioned autostereoscopic display apparatus and the second straight line formed by the line pattern. In principle, the intersection point of the first straight line and the second straight line is certainly located on the stripe straight line, that is, the first straight line, the second straight line and the stripe straight line have a common intersection point, and based on this principle and the known equations of the three straight lines, the theoretical correlation between the rank map parameters (c ', p ', Δ '), the first correction parameters (c, p, Δ) and the theoretical image attributes (gap, shf, slp) can be derived. Further, the first correction parameters (c, p, Δ) can be calculated based on the theoretical correlation.
According to the above principle, a plurality of correlations between the three may be derived, for example, the correlation between the theoretical image attributes (slp, shf, gap) is represented by the ranking parameters (c ', p', Δ '), the correlation between the theoretical image attributes (slp, shf, gap) is represented by the first correction parameters (c', p ', Δ'), the correlation between the theoretical image attributes (gap, shf, slp) is represented by the ranking parameters (c ', p', Δ '), the correlation between the ranking parameters (c', p ', Δ') is represented by the first correction parameters (c, p, Δ) and the theoretical image attributes (gap, shf, slp), and the like.
By using the method to obtain the correction parameters, because the incidence relation among the arrangement parameters, the first correction parameters and the theoretical image attributes is used, a plurality of equations can be established, a uniform mathematical model is approached, and a plurality of first correction parameters can be solved by one-time calculation. Independent mathematical models do not need to be configured for each correction parameter, independent operation is achieved, the correction operation process is effectively simplified, the correction process is rapid and continuous, the system characteristic is obvious, the detection and correction process is more economical and easier to implement, and the requirement of mass production rapid production can be met.
For example, assume that the correlation obtained according to the above principle is a functional relationship in which the theoretical image attribute is expressed by applying the rank mapping parameters (c ', p ', Δ ') and the first correction parameter, see the following three expressions:
a first expression: gap ═ f1(c, p, Δ, c ', p ', Δ ');
a second expression: shf ═ f2(c, p, Δ, c ', p ', Δ ');
a third expression: slp ═ f3(c, p, Δ, c ', p ', Δ ').
Wherein (c ', p ', Δ ') is a preset known quantity, each set of layout parameters (c ', p ', Δ ') corresponds to a stripe image, i.e. corresponds to a set of theoretical image attributes (slp, shf, gap), in practice, a plurality of sets of layout parameters are preset, and also theoretical image attributes (slp, shf, gap) corresponding to each set of layout parameters are respectively obtained, the actual image attributes of the stripe image are obtained in the previous step, i.e. the image attributes corresponding to each set of layout are also known quantities, and the first correction parameters (c, p, Δ) are to-be-required quantities, then a plurality of equations can be established according to the three expressions, the plurality of sets of layout parameters (c ', p ', Δ ') and the plurality of sets of image attributes respectively corresponding to the plurality of sets of layout parameters detected in the previous step, so as to solve (c, p, Δ).
It can be understood that the three relations represent a theoretical correlation, that is, gap, shf, and slp may be regarded as theoretical values of image attributes of the streak image obtained by matching fixed raster parameters (i.e., first correction parameters) under preset layout parameters, that is, theoretical image attributes. In the foregoing steps, a certain error may exist by detecting that the acquired image attribute is an actual image attribute, and directly substituting the actual image attribute as a theoretical image attribute into the above relational expression for solution.
Therefore, it is further preferable that a first cost function corresponding to the above-described association relationship is established, and then the first cost function is minimized by a minimization algorithm according to the actual image attribute and the ranking parameter, and the first correction parameter is determined. The minimization algorithm used may include a gradient descent method, but other methods are also possible, and are not listed here. It should be noted that other methods that can be applied to the minimization algorithm of the embodiment of the present invention should also be within the scope of the present invention. The following is a detailed description:
the actual image attributes acquired in the above steps are represented as (gap, shf, slp), and the theoretical image attributes are represented as (gap, shf, slp), and correspond to the layout parameters (c ', p ', Δ '), respectively.
gap＝f1(c、p、Δ、c′、p′、Δ′)；
shf＝f2(c、p、Δ、c′、p′、Δ′)；
slp＝f3(c、p、Δ、c′、p′、Δ′)。
Establishing a first cost function as follows:
Figure BDA0001330902810000211
where coe ═ c, p, Δ, the theoretical image attributes gap, shf, slp may be calculated using the aforementioned expressions, gap, slp, shf being the actual image attributes detected using the image algorithm. Using the known (c ', p ', Δ ') and (gap, shf, slp), the first cost function is minimized, solving for (c, p, Δ).
For example: in the current state, when the first set of layout parameters is c1 ', p1 ', Δ 1 ', the corresponding actual image attributes are gap1, shf1, and slp1, and the theoretical image attributes are slp1, shf1, and gap 1. When the second group of row parameters are c2 ', p 2' and Δ 2 ', the actual image attributes corresponding to the second group of row parameters are gap2, shf2 and slp2, the second group of theoretical image attributes are slp2, shf2 and gap2, and when the third group of row parameters are c 3', p3 'and Δ 3', the actual image attributes corresponding to the third group of row parameters are gap3, shf3, slp3 and the third group of theoretical image attributes are slp3, shf3 and gap 3. By analogy, when the N-th group of row map parameters are cn ', pn ' and Δ N ', the actual image attributes corresponding to the N-th group of row map parameters are gapn, shfn, slpn, and the N-th group of theoretical image attributes are slpn, shfn, and gapn. Wherein the theoretical image attribute may be expressed using an expression using the first correction parameter and the layout parameter.
The actual image attribute set is determined from gap1, shf1, slp1, gap2, shf2, slp2, gap3, shf3, slp3 … gapn, shfn, slpn, and the theoretical image attribute set is determined from slp1, shf1, gap1, slp2, shf2, gap2, slp3, shf3, gap3 … slpn, shfn, gapn. And substituting the actual image attribute set and the theoretical image attribute set into the first cost function according to the corresponding relation, and fitting by using a minimum optimization algorithm according to a plurality of groups of actual image attributes and corresponding theoretical image attributes to obtain first correction parameters c, p and delta.
And 204, storing the first correction parameter, so that the autostereoscopic display device performs autostereoscopic display according to the first correction parameter.
After the first correction parameter is obtained, the first correction parameter is stored so as to be convenient for the follow-up naked eye stereoscopic display device to call the first correction parameter in the naked eye stereoscopic display process, and the naked eye stereoscopic display device can display according to the pre-stored correction parameter, namely correct the display, so that a better stereoscopic display effect is presented.
Specifically, when the autostereoscopic display device is a mobile phone or a notebook computer, such a device generally includes a motherboard on which a memory is disposed, and in this step, the first correction parameter may be stored in the autostereoscopic display device, that is, in the memory of the device itself, for calling when the autostereoscopic display device displays.
Of course, the autostereoscopic display apparatus may also be a display screen type apparatus, that is, only as a display screen, and it needs to be connected to an external host and perform display under the control of the external host, where the external host is, for example, an external monitor or an external PC (personal computer), and at this time, the first correction parameter may be stored in the external host, for example, in a certain memory of the monitor, or in the external PC, and the like.
The correction method provided by the invention can be suitable for different display devices, compared with the existing correction method, the correction method provided by the invention uses a more uniform mathematical model, has a quick and continuous correction process and obvious systematization characteristics, and simultaneously enables the detection and correction process to be more economical and easier to implement, and can meet the requirement of mass production and rapid production.
As described above, for a autostereoscopic display apparatus having a tracking display function, i.e., tracking the eye position of a viewer, and displaying according to the eye position, a front camera is used for tracking the viewing position, and calibration of the camera is required before shipment, i.e., obtaining internal parameters and external parameters of the camera. Therefore, as a further optimization of the present invention, before acquiring the first correction parameter, for the autostereoscopic display apparatus having the front camera, front camera correction may be performed, wherein the process of performing front camera correction may be applied to the process of naked eye 3D display with tracking. The specific correction process may be as follows:
firstly, the naked eye stereoscopic display device is controlled to display a second preset image, the image is projected to a mirror surface right opposite to a front camera of the naked eye stereoscopic display device, then a virtual image formed by the second preset image on the mirror surface is shot by the front camera, and a second target image is obtained. As with the foregoing embodiment, preferably, for the convenience of subsequent operations and to effectively ensure the accuracy of the operation processing for obtaining a second predetermined image with higher quality, when a virtual image is formed on the mirror surface, the display screen of the autostereoscopic display apparatus is parallel to and opposite to the mirror surface, and the display screen and the mirror surface are separated by a predetermined distance, which can be reasonably set by a person in the art, the basic principle is that it is required to ensure that the image acquired by the front camera contains a clear second predetermined image.
And then, acquiring the correction parameters of the front camera according to a second target image containing a second preset image, wherein the correction parameters of the front camera comprise internal parameters and external parameters of the camera. Specifically, the second predetermined image may be provided with characteristic pixel points, the actual pixel coordinates of the characteristic pixel points in the second predetermined image in the second target image may be first obtained by using methods such as image detection, and then, the correction parameters of the front-facing camera may be determined according to the actual pixel coordinates of the characteristic pixel points.
In principle, when the naked eye stereoscopic display device displays the characteristic pixel points, the characteristic pixel points are displayed according to preset original coordinate information, wherein the original coordinate information is pixel coordinates of the characteristic pixel points on a display screen of the naked eye stereoscopic display device, and in a second target image, actual pixel coordinates of the characteristic pixel points in the second target image can be obtained through an image detection method. However, as can be understood by those skilled in the art, since the second target image is shot by the front-facing camera, the original coordinate information of the feature pixel points can be converted into the pixel coordinates in the theoretical second target image through coordinate transformation according to the internal reference and the external reference of the camera, that is, the original coordinates are transformed by using the correction parameters (the internal reference and the external reference) of the camera as transformation parameters, and the second association relationship between the theoretical pixel coordinates of the feature pixel points in the second predetermined image in the second target image and the correction parameters of the front-facing camera can be obtained; then, on the basis of knowing the original coordinate information and the actual pixel coordinates and knowing the second association relationship, the correction parameters of the camera, i.e. the internal reference and the external reference, can be solved. And then, storing the correction parameters of the front camera, so that the naked eye three-dimensional display equipment uses the correction parameters of the front camera to carry out naked eye three-dimensional display.
According to the method for correcting the camera by using the mirror mapping mode, the distance between the camera and the mirror is known, namely the distance between the camera and the virtual image is known, only one second preset image needs to be shot under the condition that the number of the characteristic point pixel points reaches a certain number, a plurality of images do not need to be shot by using a front camera, and the distance between the camera and the images, the internal parameters of the camera and the external parameters of the camera are determined through the plurality of images, so that the correction process is simplified. The method is characterized in that the virtual image of the first preset image shot by the front camera is combined for display correction, at the moment, the front camera serves as a calibrated camera and a camera for image acquisition to display correction, and correction of the light splitting device and correction of the camera can be automatically executed by naked eye stereoscopic display equipment, so that unification of calibration processes of the camera and the light splitting device is realized, the same correction tool can be used, and calibration of the camera and correction of the light splitting device are completed at one time and sequentially.
Specifically, assume that the display screen and the mirror are arranged in parallel, and the distance d between the display screen and the mirror ismOriginal coordinate information X of characteristic pixel points0. It should be noted that, for convenience of description, the coordinates (X, y, z) are expressed by capital X, i.e., X0In fact, the coordinates (x) are represented0，y0，z0)。
Firstly, according to the distance d between the display screen and the mirror surfacemAnd original coordinate information X0Performing mirror image coordinate transformation to determine second coordinate information, wherein the second coordinate information of the virtual image of the corresponding characteristic pixel point in the second target image is X-ray coordinate informationmIs shown by Xm＝X0+2dm. Then, based on the second coordinate information XmAnd the internal reference and the external reference of the camera (namely the camera correction parameter) are subjected to coordinate transformation to obtain the theoretical pixel coordinate of the characteristic pixel point in the second preset image in the second target image and the prepositive cameraA second correlation of correction parameters of the head.
The specific transformations are as follows: firstly according to the second coordinate information XmAnd carrying out rotation translation transformation on external parameters CR and CT (wherein CT represents the relative position relationship between the origin of the display screen coordinate system and the origin of the camera coordinate system, and when the naked eye display stereo equipment is determined, namely the relative position relationship between the display screen and the camera is determined, the CT value is a known quantity) of the camera to obtain third coordinate information of a virtual image of the characteristic pixel point shot by the camera, wherein the third coordinate information adopts XcTo indicate that
Xc＝CR*(Xm-CT), wherein XcRepresents (x)c，yc，zc)，Xm＝X0+2dm。
After obtaining the third coordinate information XcThen, for XcPerforming homogeneous coordinate transformation to obtain homogeneous coordinate information, wherein the homogeneous coordinate information adopts XpTo indicate that
Figure BDA0001330902810000251
After the homogeneous coordinate information is obtained, the coordinate information X needs to be alignedpCorrecting for radial distortion to obtain Xpp，Xpp＝(1+k1r2+k2r4)XpWherein k is1、k2R is internal reference of the camera, and X is obtained after distortion correctionppAnd then, acquiring theoretical pixel coordinates of the characteristic pixel points according to the camera internal reference matrix.
Wherein the theoretical pixel coordinate uv of the characteristic pixel point is equal to XppThe product of the matrix formed by the camera internal parameters is as follows:
Figure BDA0001330902810000252
through the series of transformation, theoretical pixel coordinates uv of the characteristic pixel points and internal parameters and external parameters of the camera can be establishedSecond association of parameters, that is, uv is represented as X0、dmAnd a function of the camera internal parameter and the camera external parameter. X0、dmThe actual pixel coordinates of the characteristic pixel points in the second target image can be obtained through an image detection method, so that internal and external parameters of the camera, namely correction parameters of the camera, can be solved by utilizing the incidence relation.
Similarly, referring to the foregoing method, in order to effectively reduce the error, the detected actual pixel coordinates are expressed as uv, a second cost function corresponding to the second association relationship may be established, and then the second cost function is minimized by using a minimization algorithm according to the actual pixel coordinates uv, so as to determine the internal parameter and the external parameter of the camera. For example, the second cost function may be:
Figure BDA0001330902810000253
wherein coe ═ fx, fy, px, py, sk, k1，k2，CRa，CRb，CRc]T。
uv is the theoretical pixel coordinate and the uv,
Figure BDA0001330902810000261
uv is the actual pixel coordinate detected.
For example, the number of the feature pixel points in the second target image is 10, the theoretical pixel coordinates corresponding to the 10 feature pixel points are uv 1-uv 10, respectively, and the actual pixel coordinates corresponding to the 10 feature pixel points are uv 1-uv 10, respectively, wherein uv 1-uv 10 are known quantities. Then, using a second cost function to perform calculation, and sequentially substituting uv1 and uv1, uv2 and uv2, uv3 and uv3, uv4 and uv4, uv5 and uv5, uv6 and uv6, uv7 and uv7, uv8 and uv8, uv9 and uv9, uv10 and uv10 into the second cost function, wherein uv1, uv2, uv3, uv4, uv5, uv6, uv7, uv8, uv9 and uv10 are all expressed as the associated functions containing the external reference of the preposed camera, and the pre-positioned camera (i.e. the correction of the internal reference of the preposed camera includes: fx, fy, px, py, skew, k1、k2、CRa、CRb、CRcAnd determining the correction parameters of the front camera by using a minimum optimization algorithm. Wherein skew is the same as sk, i.e. different letter combinations are used to represent the same parameters.
In actual implementation, the actual pixel coordinates UV of the feature pixels of the first preset number need to be obtained according to the number of the unknown quantities and the requirement of the operation precision. The number of the selected characteristic pixel points needs to be larger than the number of unknown variables in the correction parameters of the front-facing camera. The more the number of the selected characteristic pixel points is, the more accurate the solved correction parameter of the front camera is. It should be noted that, when determining the correction parameter of the front-facing camera according to the second target image in the present scheme, the correction process can be completed only according to one second target image, and in the correction process, automatic and rapid correction of the front-facing camera can be achieved.
And after the correction parameters are obtained, the correction parameters of the front camera are stored, so that the naked eye three-dimensional display equipment uses the correction parameters of the front camera to carry out naked eye three-dimensional display. The embodiment of the invention aims at the autostereoscopic display equipment with the front camera, a virtual image of a second preset image displayed by the autostereoscopic display equipment acquired by the front camera is used as a second target image, after the second target image is acquired, a correction parameter of the front camera is acquired according to the second target image containing the second preset image, and after the correction parameter of the front camera is acquired, the correction parameter of the front camera is stored so as to facilitate real-time calling in a subsequent process.
For example, as shown in fig. 12, the second predetermined image may be a checkerboard image, and the intersection points between adjacent checkerboards may be used as feature pixel points.
At this time, the process of generating the checkerboard image by the initial autostereoscopic display device may be:
setting the size information of the checkerboard and acquiring the size information of the display screen; determining the number of lines and columns of the checkerboards displayed by the display screen according to the size information of the display screen and the size information of the checkerboards by taking the central point of the display screen as a symmetrical point; setting color marks according to the parity information of the column number of each checkerboard in each row; wherein adjacent rows have color indicia arranged in opposite ways. The size information corresponding to each checkerboard in the checkerboard image is the same.
Specifically, the number of the chequers that can be accommodated by the display screen is determined according to the size information of the display screen and the size information of each square in the chequer image, and after the number of the chequers is determined, the number of rows and the number of columns of the chequers that can be accommodated by the display screen are determined. After the number of rows and the number of columns of the checkerboards are determined, the color of each checkerboard is set for each row, wherein in the same row, the colors of adjacent checkerboards are opposite, and the color setting mode in adjacent rows is opposite.
That is, for each row of checkerboard, the odd information and the even information to which the column number belongs are counted, after the odd information and the even information are determined, the colors of the odd column and the even column in each row are set according to the odd information and the even information, and the color setting modes of the odd column and the even column of the adjacent row are opposite in the setting process, for example: the color of the odd columns in the first row is white, the color of the even columns in the first row is black, the color of the odd columns in the second row is black, and the color of the even columns in the second row is white. The color of the odd columns in the corresponding third row is white and the color of the even columns is black.
After the checkerboard image is displayed on the display screen, a virtual image of the checkerboard image is formed on the mirror surface which is spaced from the display screen by a preset distance, and the virtual image of the checkerboard image formed on the mirror surface is shot by the aid of the front-facing camera on the end face of the display screen to obtain a second target image. The second target image can be seen in particular in fig. 13.
After the second target image is acquired, according to the second target image containing the second predetermined image, the process of acquiring the correction parameter of the front camera is as follows: acquiring actual pixel coordinates of characteristic pixel points in a second preset image in a second target image; and determining the correction parameters of the front camera according to the actual pixel coordinates of the characteristic pixel points.
And when the actual pixel coordinates of the characteristic pixel points in the second preset image in the second target image are obtained, after the characteristic pixel points are determined in the second target image, the actual pixel coordinates uv of the corresponding characteristic pixel points in the second target image are obtained by adopting an angular point image detection algorithm according to each characteristic pixel point.
Referring to fig. 13, the number of the feature pixels in the checkerboard image is multiple, and the feature pixels obtained in the present scheme are all corners of the checkerboard image, for example, the number of the feature pixels in the checkerboard image may be 135. When the number of the feature pixel points is 135, correspondingly, the number of the original coordinate information of the feature pixel points in the checkerboard image is 135, and the number of the actual pixel coordinates of the feature pixel points obtained by using the image detection algorithm is also 135.
Further, in the embodiment of the present invention, after acquiring the correction parameter of the front camera, the method may further include:
and determining the image position information of the display screen in the second target image according to the correction parameters of the front camera.
The image position information is applicable to the acquisition process of the first correction parameter and is used for extracting a first predetermined image in the first target image. It can be understood that when the same set of mirror surface tool is used for correcting the light splitting device and the front camera, the position relationship between the naked eye stereoscopic display device and the mirror surface is fixed, and in a virtual image formed on the mirror surface, the position of the display screen is fixed, that is, the image position information of the display screen in the first target image or the second target image is the same.
The image position information of the display screen may be position information of four vertices of the display screen in the second target image. Specifically, the coordinate information of the four vertexes of the display screen in the second target image can be acquired according to the screen parameter information of the display screen and the distance information between the display screen and the mirror surface. Wherein the screen parameter information includes: the pixel point distance, the resolution of the display screen, and the coordinate origin information, such as the center position of the display screen, are the coordinate origin.
After the correction parameter of the front-facing camera is obtained, a specific process of determining the image position information of the display screen according to the correction parameter of the front-facing camera may be as follows: after the correction parameters of the front camera are obtained, determining the image position information of the display screen according to the correction parameters of the front camera and the original position information of the display screen. The original position information of the display screen can be obtained according to the coordinate information of the characteristic pixel points of the boundary position of the display screen in the second target image, and the original position information of the four vertexes of the display screen can be obtained by utilizing the information such as the coordinates, the resolution, the pixel point distance and the like of the characteristic pixel points of the boundary.
After the original position information of the display screen is obtained, the coordinate transformation is carried out on the original position information according to the obtained correction parameters of the front-facing camera, and therefore the image position information of the four vertexes of the display screen in the second target image is obtained. For example, when the dot pitch of the pixel points is dot, the resolution of the display screen is A × B, and the distance between the display screen and the mirror surface is mirrdist, the coordinates of the four vertexes of the display screen in the X direction are 0.5Adot, -0.5Adot respectively; determining the coordinates of four vertexes of the display screen in the Y direction to be 0.5Bdot, -0.5Bdot respectively; the mirror image coordinate transformation is carried out by utilizing the distance between the display screen and the mirror surface, and the coordinates of a virtual image formed by four vertexes of the display screen are determined to be (0.5Adot, 0.5Bdot, 2mirrdist), (-0.5Adot, 0.5Bdot, 2mirrdist), (0.5Adot, -0.5Bdot, 2mirrdist) and (-0.5Adot, -0.5Bdot, 2 mirrdist). And then, by utilizing the internal reference and the external reference of the camera, sequentially carrying out rotation translation transformation, homogeneous coordinate transformation, radial distortion correction and internal reference matrix transformation to obtain the position coordinates of the four vertexes of the display screen in the second target image, namely image position information.
Optionally, in an embodiment of the present invention, after the image position information of the display screen is acquired, the foregoing process of acquiring the first correction parameter may be performed: acquiring a first preset image displayed by naked eye stereoscopic display equipment according to preset layout parameters; acquiring actual image attributes of the first preset image according to the first preset image; acquiring a first correction parameter according to a preset layout parameter and an actual image attribute of a first preset image; and storing the first correction parameter, so that the naked eye three-dimensional display equipment performs naked eye three-dimensional display according to the first correction parameter.
When a first preset image displayed by the naked eye three-dimensional display equipment according to preset layout parameters is obtained, shooting the first preset image to obtain a first target image, and obtaining the first preset image according to the first target image. When a first preset image is acquired according to a first target image, determining the area range of the first preset image in the first target image; and according to the determined area range, scratching an image corresponding to the area range in the first target image, and determining the image corresponding to the area range as a first preset image.
When determining the region range of the first predetermined image in the first target image: determining the area range of the display screen in the first target image according to the predetermined image position information corresponding to the display screen, and determining the area range of the display screen in the first target image as the area range of the first predetermined image in the first target image, wherein the image position information comprises coordinate information of four vertexes of the display screen in the first target image.
In the process, the front camera can be corrected firstly, the image position information of the display screen is acquired, then the corresponding first target image is acquired when the naked eye three-dimensional display equipment displays the first preset image, the first preset image is acquired in the first target image according to the image position information of the display screen, the first correction parameter is acquired according to the first preset image, the camera calibration and the display screen correction process are unified, a comprehensive correction unified model can be established on the basis of realizing automatic and rapid camera correction, the feasibility of comprehensive correction is guaranteed, and the correction process is more convenient and rapid. The method and the theory are very suitable for equipment which needs to utilize a camera of the equipment to acquire data and change the display state of a screen in real time. And simultaneously, the method is also suitable for different display devices, and can ensure the consistency of correction.
Further, in an embodiment of the present invention, the autostereoscopic display apparatus includes two display modes, i.e., a first display mode and a second display mode, where the first display mode is one of a landscape display mode and a portrait display mode, and the second display mode is the other of the landscape display mode and the portrait display mode, so that display corrections can be performed on the two modes respectively. Specifically, the autostereoscopic display device is controlled to display a first preset image in a first display mode, and display correction is performed by the method to obtain a first correction parameter corresponding to the first display mode. And controlling the naked eye stereoscopic display equipment to display a third preset image in a second display mode, and acquiring a second correction parameter corresponding to the second display mode by using the same method as the first display mode. The calibration method is the same, please refer to the above description, and will not be described herein again. It is to be noted that the coordinate systems of different display modes may be different, so that various parameters in the correction process correspond to the respective coordinate systems.
In this embodiment, the display correction is performed for each of the two display modes, but the light-splitting devices to be corrected in the two display modes may be the same light-splitting device or different light-splitting devices. Specifically, the autostereoscopic display apparatus having two display modes may share the light splitting device when performing display of the two display modes, that is, the first display mode and the second display mode use the same light splitting device, that is, switching of the light splitting device is not required when performing switching of the display modes, in which case the same light splitting device is corrected in the two display modes.
It is of course also possible to use different light splitting devices for the first display mode and the second display mode, i.e. when switching the display modes, switching of the light splitting devices is also required, for example, one light grating is turned off and the other light grating is turned on, in which case, different light splitting devices are corrected in the two modes. The display correction method provided by the embodiment of the present invention is not particularly limited, and the display correction method provided by the embodiment of the present invention can be used for correction of the same or different light splitting devices.
In the landscape state, the coordinate axis x of the screen is the same as the direction in which the screen length is larger. Wherein the corresponding coordinate system in the landscape state is shown in fig. 3 a. Fig. 3a is only an example of a possible embodiment of the coordinate system in the landscape state, and a person skilled in the art can set up the coordinate system in the landscape state according to practical situations. The specific correction process comprises the following steps: and (3) a flow of singly correcting the display screen or a flow of comprehensively correcting the front camera and the display screen. Referring to the embodiment shown in fig. 2, in the comprehensive correction process, the correction of the front camera (i.e., internal and external reference calibration) is performed first, and the method may be as described above, and then the correction of the actual parameters of the display screen, i.e., the light splitting device, is performed, and the method is as described above.
In the portrait screen state, the x-axis of the screen is in the same direction as the shorter side, and the corresponding coordinate system in the portrait screen state is shown in fig. 3 b. Fig. 3b is only an example of an implementation of the coordinate system in the portrait screen state, and a person skilled in the art can set up the coordinate system in the portrait screen state according to the actual situation. The front camera and the naked eye stereoscopic display device are required to be considered in the variation of the longitudinal screen. In the case of the portrait screen, the general steps are also divided into camera correction and display screen correction or only display screen correction, the most important difference is that the optical characteristics of the screen are changed, and the spatial coordinates are also different, so that adaptation and improvement are required for the portrait screen.
When only the display screen is needed to be corrected, only the first target image is needed to be acquired, the first correction parameter is determined according to the first target image, and when the camera and the display screen are needed to be corrected, the second target image and the first target image are needed to be acquired, and the camera correction parameter and the first correction parameter are determined.
In the structure, because the acquisition of the image is carried out by a camera (or other cameras) of the equipment, the content of the screen has no difference in the image, and only when the acquired image is used for calculation, different conversions are needed according to different directions, and after the coordinate system is changed, the position of the camera relative to the origin of coordinates is also changed; modifications in the correction algorithm and flow are required.
When the correction flow is specifically realized, the difference between the vertical screen correction and the horizontal screen correction is as follows: 1. when the checkerboard is generated, theoretical angular point coordinate systems are different, and meanwhile, the input of parameters CTx and CTy for camera calibration is changed. 2. When the stripe display is performed according to the screen parameters, the set parameter values are also different due to the change of the screen characteristics. Wherein the screen characteristics change, i.e. the physical parameters of the light-splitting device change (C, P, Δ), the set parameter values (c ', p ', Δ ') also differ.
Further, in an embodiment of the present invention, the autostereoscopic display device performs self-correction, executes the display correction method by itself, and after saving the second correction parameter, when the autostereoscopic display device performs autostereoscopic display, first determines a current display mode of the autostereoscopic display device; and calling a first correction parameter corresponding to the first display mode for naked eye three-dimensional display when the naked eye three-dimensional display device is determined to be in the first display mode, and calling a second correction parameter corresponding to the second display mode for naked eye three-dimensional display when the naked eye three-dimensional display device is determined to be in the second display mode.
In the technical solution of the embodiment of the present invention, the mirror mapping principle is required to be adopted when the second target image is obtained, the mirror mapping principle may also be adopted when the first target image is obtained, and of course, other manners may also be adopted in the process of obtaining the first target image. When the mirror mapping principle is adopted, the adopted correction mechanisms are various, and a specific manner for realizing the correction of the autostereoscopic display device by each correction device is described in detail below.
In a first mode
If the terminal equipment and the screen are mobile phones, tablets and computers (the normal line of a camera is vertical to the screen of the terminal equipment and the screen of the terminal equipment), parallel supports can be designed, a mirror can be placed on one side, a display screen can be placed on the other side, the upper surface and the lower surface of each support are as smooth as possible, the display screen is parallel to the mirror, and in addition, the reflecting surface of the mirror is opposite to the display screen, so that the supports are in direct contact with the display screen.
In order to form the equipment of production, the system of design needs can guarantee that display screen and mirror surface are parallel, will not disturbed by external light as far as possible simultaneously, in order to satisfy the characteristics of light and polytypic adaptation simultaneously. In order to enable the camera to shoot the whole picture of the display screen, the display screen needs to be at a proper distance from the mirror surface, if the distance is too close, the complete screen cannot be shot, and if the distance is too far, the shot picture is too small. Because the terminal device cannot be moved in the calibration process, the fixture needs to ensure the fixation of the terminal device, and meanwhile, the keys on the periphery of the terminal device cannot be pressed easily, and a data line connected with the terminal device cannot be lifted.
The support tool has different shapes in different scenes, but the main characteristics are as follows: 1. the display screen is parallel to the mirror surface; 2. the distance between the display screen and the mirror surface can ensure that the camera takes a picture to obtain a complete screen pattern; 3. ensuring that the terminal equipment is not moved in the correction process as much as possible; 4. to accommodate more similar devices, the panels holding the display need to be made flexible.
Mode two
Utilize the mode of auxiliary control to rectify, utilize the C/S mode promptly, use socket to communicate, the client host computer is connected with the bore hole stereoscopic display equipment that waits to rectify through the data line, and the client host computer is responsible for sending order and flow control, and bore hole stereoscopic display equipment that waits to rectify is responsible for image display, receives the order and passes back data, and the system model is as shown in figure 4, includes: the display device comprises a client host 21 and a naked eye stereoscopic display device 22 connected with the client host 21, wherein the naked eye stereoscopic display device 22 is fixed on a jig 23, and a display screen of the naked eye stereoscopic display device 22 is opposite to a total reflection lens 232 on the jig 23 and is spaced by a preset distance.
During correction, only the autostereoscopic display device 22 needs to be placed on the jig 23, and the autostereoscopic display device 22 and the client host 21 are connected through a data line, so that correction can be performed. The above system structure is characterized in that the connection between the tool 23 and the client host 21 is flexible, and the client program needs to be installed on the client host 21 when being deployed.
As shown in fig. 5a to 5d, the jig includes: the naked eye three-dimensional display device 22 comprises a dark black box 231 and a total reflection lens 232 arranged in the dark black box 231, the naked eye three-dimensional display device 22 is detachably arranged on the dark black box 231 and is parallel to and opposite to the total reflection lens 232, the naked eye three-dimensional display device 22 and the total reflection lens 232 are spaced at a preset distance, and the total reflection lens 232 is used for reflecting an image displayed by the naked eye three-dimensional display device 22 so that the naked eye three-dimensional display device 22 can collect the image reflected by the total reflection lens 232. The dark box 231 includes a cover plate 233, a groove adapted to the shape of the autostereoscopic display apparatus 22 is formed on the cover plate 233, the autostereoscopic display apparatus 22 is detachably mounted in the groove, and an image displayed by the autostereoscopic display apparatus 22 reaches the total reflection lens 232 through the bottom of the groove. The bottom of the groove is provided with a first opening, and an image displayed by the naked eye stereoscopic display device reaches the total reflection lens 232 through the first opening. The transparent glass substrate 234 is installed in the groove, and the transparent glass substrate 234 is covered on the first opening portion and is used for bearing the naked eye stereoscopic display device 22.
As shown in fig. 4 and fig. 5a to 5d, in the calibration process, the autostereoscopic display device 22 is connected to the client host 21, after the client host 21 starts the application program, the autostereoscopic display device 22 is triggered to start the application program, after the screen brightness is set, the client host 21 generates a corresponding image, and when the display screen calibration is required, a stripe image is generated at this time; when the camera and the display screen need to be comprehensively corrected, a checkerboard image needs to be generated, and after the camera is corrected, a stripe image is generated to correct the display screen. In the embodiment of the present invention, the comprehensive correction of the camera and the display screen is taken as an example for explanation.
The client host 21 determines a corresponding coordinate system according to the current screen state, transmits the checkerboard image to the autostereoscopic display device 22 after the checkerboard image is generated, projects the checkerboard image into the total reflection lens 232 after the checkerboard image is displayed by the autostereoscopic display device 22, shoots a virtual image of the checkerboard image formed in the total reflection lens 232 by using a camera to obtain a second target image, and then analyzes the second target image by the client host 21 to obtain camera correction parameters. After the camera correction parameters are obtained, the image position information of the display screen can be determined according to the camera correction parameters.
Then, the client host 21 obtains corresponding layout parameters in the current screen state, generates a stripe image according to the layout parameters, and transmits the stripe image to the autostereoscopic display device 22, after the autostereoscopic display device 22 displays the stripe image, the stripe image is projected into the total reflection lens 232, a virtual image of the stripe image formed in the total reflection lens 232 is photographed by using a camera, a first target image is obtained, a first predetermined image is obtained according to predetermined image position information of the display screen, and then the client host 21 analyzes the first predetermined image, so as to obtain a first correction parameter.
In order to facilitate the deployment of the device, the bracket and the host may be designed together, such as the host calibration system shown in fig. 6a and 6b, which includes: the stand 41 and a host 42 of a special case, the host 42 and the stand 41 can be disassembled and assembled flexibly, and the naked eye stereoscopic display device 22 is fixed on the stand 41. When the model of the autostereoscopic display apparatus 22 is changed, it is only necessary to additionally design the support 41 capable of being assembled with the host 42. The bracket 41 can be replaced as a whole, only the supporting plate can be replaced, and in addition, because the case has a sealed environment, redundant materials are not needed to surround the four upright posts.
The auxiliary control correction is characterized in that the naked eye three-dimensional display equipment is used as auxiliary equipment, the host controls the naked eye three-dimensional display equipment to perform operations such as software installation, command sending, screen image acquisition and the like, and more complex requirements can be realized, such as uploading a correction log of each naked eye three-dimensional display equipment, allocating a number to each naked eye three-dimensional display equipment and the like. The auxiliary control correction system does not need equipment to install related software in advance, and correction can be carried out more flexibly.
Mode III
The self-correcting mode is that the picture display, the picture capture and the calculation are carried out through the self system to obtain the final parameters; the system only needs naked eye stereoscopic display equipment, a parallel mirror and a corresponding tool. The correcting device is light, simple and convenient, and as shown in fig. 5a to 5d, the correcting device comprises a dark box 231 and a total reflection lens 232 installed in the dark box 231, the naked eye stereoscopic display device 22 is detachably installed on the dark box 231, and is parallel to and opposite to the total reflection lens 232, the naked eye stereoscopic display device 22 and the total reflection lens 232 are spaced by a preset distance, and the total reflection lens 232 is used for reflecting an image displayed by the naked eye stereoscopic display device 22 so that the naked eye stereoscopic display device 22 collects the image reflected by the total reflection lens 232. The predetermined distance between the autostereoscopic display apparatus 22 and the total reflection lens 232 can ensure that the camera on the autostereoscopic display apparatus 22 can clearly shoot a virtual image formed on the total reflection lens 232.
The dark box 231 includes a cover plate 233, a groove adapted to the shape of the autostereoscopic display apparatus 22 is formed in the cover plate 233, the autostereoscopic display apparatus 22 is detachably mounted in the groove, and an image displayed by the autostereoscopic display apparatus 22 reaches the total reflection lens 232 through the bottom of the groove. The bottom of the groove is provided with a first opening, and the image displayed by the autostereoscopic display apparatus 22 reaches the total reflection lens 232 through the first opening. The transparent glass substrate 234 is installed in the groove, and the transparent glass substrate 234 is covered on the first opening portion and is used for bearing the naked eye stereoscopic display device 22.
The side wall of the groove is provided with a seam allowance structure, and the transparent glass substrate 234 is arranged in the seam allowance structure. The seam allowance structure comprises a concave seam allowance, a bearing part for bearing the transparent glass substrate 234 extends out of the concave seam allowance, and the non-overlapped area of the transparent glass substrate 234 and the bearing part is larger than the display area of the naked eye stereoscopic display device 22. When the transparent glass substrate 234 is mated with the groove, the seam allowance structure supports the transparent glass substrate 234 to ensure the mating of the transparent glass substrate 234 with the groove. Meanwhile, when the transparent glass substrate 234 is matched with the groove, the transparent glass substrate and the groove form a structure which can prevent dust from entering the dark box 231. The non-overlapping area of the transparent glass substrate 234 and the bearing part is larger than the display area of the autostereoscopic display apparatus 22. The image that can guarantee to show in the display screen passes through transparent glass substrate 234, on the projection reaches total reflection lens 232, and then realizes that the camera on the bore hole stereoscopic display equipment 22 forms the collection of virtual image on the total reflection lens 232.
The difference between the depth of the groove and the thickness of the bearing part is greater than or equal to the sum of the thicknesses of the transparent glass substrate 234 and the naked eye stereoscopic display device 22, so that the naked eye stereoscopic display device 22 can be accommodated conveniently. The cover plate 233 is further provided with two recesses, which are symmetrically arranged at two sides of the groove. By providing the recess at the edge of the cover plate 233, the user can conveniently take the autostereoscopic display apparatus 22 mounted in the recess. The cover plate 233 is further provided with a mounting portion for mounting a connecting wire connected to the autostereoscopic display apparatus 22, and the mounting portion is communicated with the groove. The blackbox 231 includes a box body provided with a second opening portion on which the cover plate 233 is covered.
The specific working principle is as follows: the autostereoscopic display device 22 is placed on the transparent glass substrate 234, the total reflection lens 232 is arranged right below the autostereoscopic display device 22, an image on the screen of the autostereoscopic display device 22 can penetrate through the transparent glass substrate 234 and the first opening part and form an image on the total reflection lens 232, a front camera of the autostereoscopic display device 22 can shoot the image on the total reflection lens 232, relevant data of the image is calculated by software, and the stereoscopic display effect is corrected.
The specific correction process comprises the following steps: and starting an application program of the naked eye stereoscopic display equipment, and prompting a user to place the naked eye stereoscopic display equipment on the transparent glass substrate. And then the naked eye three-dimensional display equipment determines a corresponding coordinate system according to the current screen state, displays the checkerboard image according to the corresponding parameters, shoots a virtual image formed by the checkerboard on the total reflection lens by using the camera, acquires a second target image, calculates the camera parameters according to the second target image, and determines the image position information of the display screen according to the camera parameters after acquiring the camera parameters. And then, after the naked eye three-dimensional display equipment determines the corresponding layout parameters according to the current screen state, displaying the fringe image, shooting a virtual image formed by the fringe image on a total reflection lens by using a camera, acquiring a first target image, determining a first preset image according to the image position information of the display screen, calculating screen correction parameters according to the first preset image, and correcting the display image according to the screen correction parameters.
The correction device of the system is provided with an own operating system, picture display (checkerboard and fringe images) is carried out by using pre-installed correction software, a projected image in a mirror surface is obtained by using a camera of the correction device, and own device parameters are obtained through calculation. The self-correcting system has the characteristics of simple structure, capability of completing image display and calculation by self, no need of connecting an additional host computer and communicating with other machines, and need of preassembling correction software in advance.
Mode IV
And correcting a single panel, wherein the single panel is a screen only with 3D characteristics and is not provided with a processor, and in order to detect whether the screen leaving a factory is qualified, whether the screen has a qualified three-dimensional display effect needs to be verified through mirror surface correction. In the system, a single panel is used as an expansion screen of a host system and is used for displaying stripe images, in order to acquire the images, the area where the stripe images are located in photographed images needs to be known in advance, and therefore the purpose is achieved by using an external industrial camera and simultaneously using checkerboard calibration. The system is mainly characterized in that: 1. the single panel does not have an operating system and cannot be operated independently; 2. an external camera is needed to shoot to obtain an image; 3. the system distinguishes whether the product is qualified or not through mirror surface correction, and parameters do not need to be set. The device structure is shown in FIGS. 7 a-7 c:
the apparatus is mainly composed of an adjustable mirror 51, a jig 52 for placing a panel, an apparatus main body 53, and the like. The jig 52 is formed with a transparent glass cover plate 521, and the single panel is placed on the transparent glass cover plate 521, wherein the transparent glass cover plate 521 is opposed to the mirror surface 51, and an image displayed on the single panel is imaged on the mirror surface 51 through the transparent glass cover plate 521. Since the distance between the mirror 51 and the transparent glass cover 521 can be adjusted, various types of single panels can be adapted. The mirror surface 51 is arranged in a box body, and a transmission device for driving the mirror surface 51 to move up and down is arranged in the box body. The general procedure is to put the single panel on the transparent glass cover 521, fix the single panel, light the single panel, and let the device host 53 start to work to perform the calibration.
The specific correction process comprises the following steps: the device host 53 starts a program to start the grating, displays a stripe image on the single panel according to the layout parameters, shoots a virtual image of the stripe image on the mirror surface 51 by using an industrial camera, acquires a first target image, calculates screen parameters according to the first target image, and detects whether the single panel belongs to a qualified product according to the screen parameters.
The mirror surface correction is realized through a camera of the equipment and a mirror surface parallel to the camera by utilizing an image mapping principle, the display and the acquisition of self images are realized, the calibration of the traditional camera is greatly improved, the screen parameter correction process of the equipment is facilitated, the screen fringe images can be acquired without the help of an external camera, and therefore the design and the cost of the correction equipment are simplified. The method and the theory are very suitable for equipment which needs to utilize a camera of the equipment to acquire data and change the display state of a screen in real time.
In addition, the method is suitable for all naked eye three-dimensional display equipment, the naked eye three-dimensional display equipment can be viewed by a transverse screen or a longitudinal screen, or the naked eye three-dimensional display equipment is an integral display product or a single display module, and the method can be adopted for correction. And for different operating systems, the same method can be used for carrying out expansion adaptation on the different operating systems so as to run on the different systems.
In the embodiment of the invention, different corrections are carried out in different screen modes, and in the horizontal screen mode, the correction flow completed once is executed by adopting the correction method to obtain and store the corresponding first correction parameter and camera correction parameter in the horizontal screen mode; in the longitudinal screen mode, the correction process completed once is executed by adopting the correction method to obtain and store the corresponding second correction parameter and the corresponding camera correction parameter in the longitudinal screen mode.
In the actual application process, when the correction is carried out in the horizontal screen mode, the correction process can be realized by calling the corresponding first correction parameter and camera correction parameter in the horizontal screen mode; when the correction is performed in the vertical screen mode, the correction process can be realized by calling the corresponding second correction parameter and the camera correction parameter in the vertical screen mode.
According to the embodiment of the invention, a first preset image displayed by the naked eye three-dimensional display equipment is obtained, the actual image attribute of the first preset image is determined, the first correction parameter is determined according to the actual image attribute and the preset layout parameter, the naked eye three-dimensional display equipment is corrected according to the first correction parameter, the error of the naked eye three-dimensional display equipment in the production process is detected and corrected, the correction parameter is stored, and during the subsequent naked eye three-dimensional display, the naked eye three-dimensional display equipment can display according to the pre-stored correction parameter, namely, the display is corrected, so that a better three-dimensional display effect is presented. Compared with the existing correction method, the correction method provided by the invention uses a more uniform mathematical model, has quick and continuous correction process and obvious systematization characteristic, simultaneously enables the detection and correction process to be more economical and easier to implement, and can meet the requirement of mass production and rapid production.
An embodiment of the present invention further provides a display correction device for a autostereoscopic display apparatus, where the autostereoscopic display apparatus includes a display screen, the display screen includes a display device and a light splitting device, and the display device and the light splitting device are arranged oppositely, as shown in fig. 8a, the device includes:
the first obtaining module 10 is configured to obtain a first predetermined image displayed by the autostereoscopic display device according to a preset layout parameter;
a second obtaining module 20, configured to obtain an actual image attribute of the first predetermined image according to the first predetermined image;
a third obtaining module 30, configured to obtain a first correction parameter according to a preset layout parameter and an actual image attribute of the first predetermined image;
the first saving module 40 is configured to save the first correction parameter, so that the autostereoscopic display device performs autostereoscopic display according to the first correction parameter.
Wherein, the first obtaining module 10 includes:
the first obtaining sub-module 11 is configured to take a virtual image formed by the first predetermined image on the mirror surface by using a camera or take the first predetermined image directly by using the camera, and obtain a first target image, so that the first target image includes the first predetermined image;
the second obtaining sub-module 12 is configured to obtain a first predetermined image according to the first target image.
When a virtual image is formed on the mirror surface, the display screen is parallel to and opposite to the mirror surface.
The second obtaining sub-module 12 includes:
a first determining unit 121 configured to determine a region range of a first predetermined image in the first target image;
and a second determining unit 122, configured to, according to the determined region range, extract an image corresponding to the region range from the first target image, thereby acquiring the first predetermined image.
Wherein the first determining unit 121 is further configured to:
determining the area range of a display screen in a first target image according to predetermined image position information corresponding to the display screen, and determining the area range of the display screen in the first target image as the area range of a first predetermined image in the first target image, wherein the image position information comprises coordinate information of four vertexes of the display screen in the first target image;
alternatively, the first and second electrodes may be,
performing image denoising processing on the first target image;
aiming at the denoised first target image, determining edge pixel points of a first preset image in the first target image by adopting an edge detection algorithm;
and determining the boundary line of the first preset image in the first target image according to the edge pixel points, thereby determining the area range of the first preset image in the first target image.
Wherein, the third obtaining module 30 includes:
the third obtaining submodule 31 is configured to obtain a first association relationship among the layout parameter, the first correction parameter, and the theoretical image attribute of the first predetermined image;
the first determining submodule 32 is used for determining a first correction parameter according to the first incidence relation, the actual image attribute and a preset layout parameter;
the first correlation is a functional relation of applying the mapping parameter and the first correction parameter to represent the theoretical image attribute.
Wherein the first determination submodule 32 includes:
an establishing unit 321, configured to establish a first cost function corresponding to the first association relationship;
a third determining unit 322, configured to determine the first correction parameter by minimizing the first cost function according to the actual image attribute and the preset ranking parameter by using a minimization algorithm.
The first preset image is a stripe image formed by alternately arranging a first color stripe and a second color stripe; the actual image attribute and the theoretical image attribute of the stripe image comprise a stripe slope, a stripe intercept and a stripe interval; the preset layout parameters comprise a layout inclination angle, a layout period and a layout displacement; the first correction parameters include grating inclination angle, grating horizontal pitch and grating displacement.
The first preset image is a stripe image formed by alternately arranging a first color stripe and a second color stripe; the actual image properties of the fringe image include at least one of fringe slope, fringe intercept, and fringe spacing; the second obtaining module 20 includes:
the fourth obtaining submodule 21 is configured to obtain a center line point of the first color stripe in the stripe image;
the fitting submodule 22 is used for performing linear fitting according to the centerline point of the first color stripe to obtain a stripe linear equation after fitting;
and the second determining submodule 23 is configured to determine an actual image attribute of the fringe image according to the fitted fringe straight-line equation.
Wherein fitting submodule 22 is further configured to:
and performing linear fitting by using a least square method according to the central line point of the first color stripe to obtain a fitted stripe linear equation.
The camera for shooting the virtual image is configured on the naked eye stereoscopic display equipment.
The naked eye stereoscopic display equipment is also provided with a front camera; as shown in fig. 8b, the apparatus further comprises:
the fourth obtaining module 50 is configured to shoot a virtual image formed on the mirror surface of a second predetermined image displayed by the autostereoscopic display device by using the front camera, and obtain a second target image, where the second target image includes the second predetermined image;
a fifth obtaining module 60, configured to obtain a correction parameter of the front camera according to a second target image including a second predetermined image, where the correction parameter of the front camera includes an internal parameter and an external parameter of the camera;
and a second storing module 70, configured to store the correction parameters of the front-facing camera, so that the autostereoscopic display apparatus performs autostereoscopic display using the correction parameters of the front-facing camera.
Wherein, the fifth obtaining module 60 includes:
a fifth obtaining submodule 61, configured to obtain actual pixel coordinates of a feature pixel point in a second predetermined image in the second target image;
and a third determining submodule 62, configured to determine a correction parameter of the front camera according to the actual pixel coordinate of the characteristic pixel point.
Wherein the third determination submodule 62 includes:
the first obtaining unit 621 is configured to obtain original coordinate information of a feature pixel when the autostereoscopic display device displays a second predetermined image;
a second obtaining unit 622, configured to obtain, according to the original coordinate information of the feature pixel, a second association relationship between a theoretical pixel coordinate of the feature pixel in a second predetermined image in the second target image and a correction parameter of the front-facing camera;
the fourth determining unit 623 is configured to determine the correction parameter of the front-facing camera according to the actual pixel coordinate and the second association relationship between the theoretical pixel coordinate and the correction parameter of the front-facing camera.
Wherein the second obtaining unit 622 is further configured to:
acquiring second coordinate information of the characteristic pixel points in the virtual image according to the original coordinate information of the characteristic pixel points and the distance between the display screen and the mirror surface;
and performing preset coordinate transformation by using the correction parameter of the front camera according to the second coordinate information of the characteristic pixel point, thereby obtaining a second association relation between the theoretical pixel coordinate of the characteristic pixel point in a second preset image in the second target image and the correction parameter of the front camera.
Wherein the fourth determining unit 623 is further configured to:
establishing a second cost function corresponding to the second incidence relation;
and according to the obtained actual pixel coordinates, minimizing the second cost function by utilizing a minimization algorithm, and determining the correction parameters of the front camera.
The second preset image is a checkerboard image, and the characteristic pixel points are intersection points between adjacent checkerboards.
The naked eye stereoscopic display equipment comprises a first display mode and a second display mode;
the naked eye three-dimensional display equipment displays a first preset image in a first display mode, and a first correction parameter corresponds to the first display mode; as shown in fig. 8c, the apparatus further comprises:
a sixth obtaining module 80, configured to obtain a third predetermined image displayed by the autostereoscopic display apparatus according to a preset second arrangement parameter in the second display mode;
a seventh obtaining module 90, configured to obtain an actual image attribute of the third predetermined image according to the third predetermined image;
an eighth obtaining module 100, configured to obtain a second correction parameter according to a preset second layout parameter and an actual image attribute of a third predetermined image;
a third saving module 110, configured to save the second correction parameter.
Wherein, the device still includes:
a determining module 120, configured to determine a current display mode of the autostereoscopic display device after the third saving module 110 saves the second correction parameter;
the first calling module 130 is configured to call a first correction parameter corresponding to a first display mode to perform autostereoscopic display when it is determined that the autostereoscopic display apparatus is in the first display mode;
the second invoking module 140 is configured to invoke a second correction parameter corresponding to the second display mode to perform autostereoscopic display when it is determined that the autostereoscopic display apparatus is in the second display mode.
Embodiments of the present invention also provide a computer-readable storage medium for storing a computer program, where the computer program can be executed by a processor to perform the above-mentioned method.
An embodiment of the present invention further provides an electronic device, where the electronic device includes one or more processors, and the processors are configured to execute the following methods:
acquiring a first preset image displayed by naked eye stereoscopic display equipment according to preset layout parameters;
acquiring actual image attributes of the first preset image according to the first preset image;
acquiring a first correction parameter according to a preset layout parameter and an actual image attribute of a first preset image;
and storing the first correction parameter, so that the naked eye three-dimensional display equipment performs naked eye three-dimensional display according to the first correction parameter.
The embodiment of the invention also provides naked eye stereoscopic display equipment with a self-correcting function, namely a self-display correcting function, which comprises:
the device comprises a shell, a display screen and a front camera which are arranged on the shell, and one or more processors arranged in the shell;
the display screen comprises a display device and a light splitting device, and the display device and the light splitting device are arranged oppositely;
the processor arranges pixels on the display device according to preset arrangement parameters, and displays a first preset image on the display screen under the action of the light splitting device;
the front camera is used for shooting a virtual image formed by the first preset image on the mirror surface to obtain a first target image, so that the first target image comprises the first preset image;
the processor is configured to:
acquiring a first preset image according to the first target image;
acquiring actual image attributes of the first preset image according to the first preset image;
acquiring a first correction parameter according to a preset layout parameter and an actual image attribute of a first preset image;
and storing the first correction parameter, and performing naked eye three-dimensional display according to the first correction parameter.
According to the embodiment of the invention, a first preset image displayed by the naked eye three-dimensional display equipment is obtained, the actual image attribute of the first preset image is determined, the first correction parameter is determined according to the actual image attribute and the preset layout parameter, the naked eye three-dimensional display equipment is corrected according to the first correction parameter, the error of the naked eye three-dimensional display equipment in the production process is detected and corrected, the correction parameter is stored, and during the subsequent naked eye three-dimensional display, the naked eye three-dimensional display equipment can display according to the pre-stored correction parameter, namely, the display is corrected, so that a better three-dimensional display effect is presented. Compared with the existing correction method, the correction method provided by the invention uses a more uniform mathematical model, has quick and continuous correction process and obvious systematization characteristic, simultaneously enables the detection and correction process to be more economical and easier to implement, and can meet the requirement of mass production and rapid production.
While the preferred embodiments of the present invention have been described, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention as defined in the following claims.

Claims (29)

1. The display correction method of the naked eye stereoscopic display equipment comprises a display screen, the display screen comprises a display device and a light splitting device, and the display device and the light splitting device are arranged oppositely, and the method is characterized by comprising the following steps of:
acquiring a first preset image displayed by the naked eye three-dimensional display equipment according to preset layout parameters;
acquiring actual image attributes of the first preset image according to the first preset image;
acquiring a first correction parameter according to the preset layout parameter and the actual image attribute of the first preset image;
storing the first correction parameter to enable the autostereoscopic display equipment to carry out autostereoscopic display according to the first correction parameter;
the acquiring of the first preset image displayed by the naked eye stereoscopic display device according to the preset arrangement parameters comprises:
shooting a virtual image formed by the first preset image on a mirror surface by using a camera to obtain a first target image so that the first target image comprises the first preset image;
acquiring the first preset image according to the first target image;
acquiring a first correction parameter according to the preset mapping parameter and the actual image attribute of the first preset image, wherein the acquiring of the first correction parameter comprises the following steps:
acquiring a first incidence relation among the layout parameter, the first correction parameter and the theoretical image attribute of the first preset image;
determining the first correction parameter according to the first incidence relation, the actual image attribute and the preset layout parameter;
the determining the first correction parameter according to the first association relationship, the actual image attribute and the preset mapping parameter includes:
establishing a first cost function corresponding to the first incidence relation;
and according to the actual image attribute and the preset mapping parameter, minimizing the first cost function by utilizing a minimization algorithm, and determining the first correction parameter.
2. A method as claimed in claim 1, wherein the display screen is parallel-opposed to a mirror surface when the virtual image is formed on the mirror surface.
3. The method of claim 1, wherein said acquiring the first predetermined image from the first target image comprises:
determining a region range of the first predetermined image in the first target image;
according to the determined area range, an image corresponding to the area range is scratched in the first target image, and therefore the first preset image is obtained.
4. The method of claim 3, wherein the determining the region range of the first predetermined image in the first target image comprises:
determining the area range of the display screen in the first target image according to predetermined image position information corresponding to the display screen, so that the area range of the display screen in the first target image is determined as the area range of the first predetermined image in the first target image, wherein the image position information comprises coordinate information of four vertexes of the display screen in the first target image;
alternatively, the first and second electrodes may be,
performing image denoising processing on the first target image;
determining edge pixel points of the first preset image in the first target image by adopting an edge detection algorithm aiming at the denoised first target image;
and determining the boundary line of the first preset image in the first target image according to the edge pixel points, so as to determine the area range of the first preset image in the first target image.
5. The method of claim 1,
the first incidence relation is a functional relation of applying the layout parameter and the first correction parameter to represent the theoretical image attribute.
6. The method of claim 1,
the first preset image is a stripe image formed by alternately arranging a first color stripe and a second color stripe;
the actual image attribute and the theoretical image attribute of the fringe image comprise fringe slope, fringe intercept and fringe spacing;
the preset layout parameters comprise a layout inclination angle, a layout period and a layout displacement;
the first correction parameters comprise grating inclination angle, grating horizontal pitch and grating displacement.
7. The method of claim 1,
the first preset image is a stripe image formed by alternately arranging a first color stripe and a second color stripe;
the actual image properties of the fringe image include at least one of fringe slope, fringe intercept, and fringe spacing;
the obtaining of the actual image attribute of the first predetermined image according to the first predetermined image comprises:
acquiring a center line point of the first color stripe in the stripe image;
performing linear fitting according to the centerline point of the first color stripe to obtain a fitted stripe linear equation;
and determining the actual image attribute of the fringe image according to the fitted fringe straight-line equation.
8. The method of claim 7, wherein fitting a line to the centerline point of the first color stripe to obtain a fitted stripe line equation comprises:
and performing linear fitting by using a least square method according to the center line point of the first color stripe to obtain a fitted stripe linear equation.
9. The method according to claim 1, wherein a camera for capturing a virtual image is arranged on the autostereoscopic display device.
10. The method of claim 1,
the naked eye stereoscopic display equipment is also provided with a front camera;
the method further comprises the following steps:
shooting a virtual image formed on a mirror surface by a second preset image displayed by the naked eye stereoscopic display equipment by using the front camera to obtain a second target image, wherein the second target image comprises the second preset image;
acquiring correction parameters of the front camera according to the second target image containing the second preset image, wherein the correction parameters of the front camera comprise internal parameters and external parameters of the camera;
and storing the correction parameters of the front camera so that the naked eye three-dimensional display equipment uses the correction parameters of the front camera to carry out naked eye three-dimensional display.
11. The method according to claim 10, wherein the obtaining of the calibration parameters of the front camera according to the second target image containing the second predetermined image comprises:
acquiring actual pixel coordinates of characteristic pixel points in the second preset image in the second target image;
and determining the correction parameters of the front camera according to the actual pixel coordinates of the characteristic pixel points.
12. The method of claim 11, wherein the determining the calibration parameters of the front camera according to the actual pixel coordinates of the characteristic pixel point comprises:
acquiring original coordinate information of the characteristic pixel points when the naked eye stereoscopic display equipment displays a second preset image;
acquiring a second incidence relation between theoretical pixel coordinates of the characteristic pixel points in the second preset image in the second target image and correction parameters of the front camera according to the original coordinate information of the characteristic pixel points;
and determining the correction parameters of the front camera according to the actual pixel coordinates of the characteristic pixel points and the second incidence relation between the theoretical pixel coordinates and the correction parameters of the front camera.
13. The method according to claim 12, wherein the obtaining a second association relationship between theoretical pixel coordinates of the feature pixel points in the second predetermined image in the second target image and correction parameters of the front-facing camera according to the original coordinate information of the feature pixel points comprises:
acquiring second coordinate information of the characteristic pixel points in the virtual image according to the original coordinate information of the characteristic pixel points and the distance between the display screen and the mirror surface;
and performing preset coordinate transformation by using the correction parameter of the front-facing camera according to the second coordinate information of the characteristic pixel point, thereby obtaining a second association relation between the theoretical pixel coordinate of the characteristic pixel point in the second preset image in the second target image and the correction parameter of the front-facing camera.
14. The method according to claim 12, wherein the determining the calibration parameters of the front camera according to the actual pixel coordinates of the characteristic pixel points and the second association relationship between the theoretical pixel coordinates and the calibration parameters of the front camera comprises:
establishing a second cost function corresponding to the second incidence relation;
and according to the obtained actual pixel coordinates, minimizing the second cost function by utilizing a minimization algorithm, and determining the correction parameters of the front camera.
15. The method according to any one of claims 11 to 14, wherein the second predetermined image is a checkerboard image, and the characteristic pixel points are intersections between adjacent checkerboards.
16. The method of claim 1,
the naked eye stereoscopic display device comprises a first display mode and a second display mode;
the naked eye stereoscopic display equipment displays the first preset image in the first display mode, and the first correction parameter corresponds to the first display mode;
the method further comprises the following steps:
acquiring a third preset image displayed by the naked eye stereoscopic display device according to a preset second arrangement parameter in the second display mode;
acquiring actual image attributes of the third preset image according to the third preset image;
acquiring a second correction parameter according to the preset second layout parameter and the actual image attribute of the third preset image;
saving the second correction parameter.
17. The method of claim 16, wherein after saving the second correction parameter, the method further comprises:
determining a current display mode of the naked eye stereoscopic display equipment;
calling a first correction parameter corresponding to a first display mode to carry out autostereoscopic display when the autostereoscopic display equipment is determined to be in the first display mode;
and calling a second correction parameter corresponding to the second display mode to perform autostereoscopic display when the autostereoscopic display device is determined to be in the second display mode.
18. The utility model provides a bore hole stereoscopic display equipment's demonstration correcting unit, bore hole stereoscopic display equipment includes the display screen, the display screen includes display device and beam splitting device, display device with beam splitting device sets up relatively, its characterized in that, the device includes:
the first acquisition module is used for acquiring a first preset image displayed by the naked eye stereoscopic display equipment according to preset layout parameters;
the second acquisition module is used for acquiring the actual image attribute of the first preset image according to the first preset image;
the third acquisition module is used for acquiring a first correction parameter according to the preset layout parameter and the actual image attribute of the first preset image;
the first storage module is used for storing the first correction parameter so that the autostereoscopic display equipment performs autostereoscopic display according to the first correction parameter;
the first obtaining module comprises:
the first acquisition sub-module is used for shooting a virtual image formed by the first preset image on the mirror surface by using a camera to acquire a first target image so that the first target image comprises the first preset image;
the second obtaining sub-module is used for obtaining the first preset image according to the first target image;
the third obtaining module includes:
the third obtaining submodule is used for obtaining a first incidence relation among the arrangement parameter, the first correction parameter and the theoretical image attribute of the first preset image;
the first determining submodule determines the first correction parameter according to the first incidence relation, the actual image attribute and the preset layout parameter;
the first determination submodule includes:
the establishing unit is used for establishing a first cost function corresponding to the first incidence relation;
and the third determining unit is used for minimizing the first cost function by utilizing a minimization algorithm according to the actual image attribute and the preset mapping parameter, and determining the first correction parameter.
19. The apparatus of claim 18, wherein the second acquisition submodule comprises:
a first determination unit configured to determine a region range of the first predetermined image in the first target image;
and a second determining unit, configured to, according to the determined region range, extract an image corresponding to the region range from the first target image, so as to obtain the first predetermined image.
20. The apparatus of claim 18,
the first incidence relation is a functional relation of applying the layout parameter and the first correction parameter to represent the theoretical image attribute.
21. The apparatus of claim 18,
the first preset image is a stripe image formed by alternately arranging a first color stripe and a second color stripe;
the actual image properties of the fringe image include at least one of fringe slope, fringe intercept, and fringe spacing;
the second acquisition module includes:
a fourth obtaining submodule, configured to obtain a centerline point of the first color stripe in the stripe image;
the fitting submodule is used for performing linear fitting according to the centerline point of the first color stripe to obtain a stripe linear equation after fitting;
and the second determining submodule is used for determining the actual image attribute of the fringe image according to the fitted fringe straight-line equation.
22. The apparatus of claim 18,
the naked eye stereoscopic display equipment is also provided with a front camera;
the device further comprises:
the fourth acquisition module is used for shooting a virtual image formed by a second preset image displayed by the naked eye stereoscopic display equipment on a mirror surface by using the front camera to acquire a second target image, wherein the second target image comprises the second preset image;
a fifth obtaining module, configured to obtain a correction parameter of the front-facing camera according to the second target image including the second predetermined image, where the correction parameter of the front-facing camera includes an internal parameter and an external parameter of the camera;
and the second storage module is used for storing the correction parameters of the front camera, so that the naked eye three-dimensional display equipment uses the correction parameters of the front camera to carry out naked eye three-dimensional display.
23. The apparatus of claim 22, wherein the fifth obtaining module comprises:
a fifth obtaining submodule, configured to obtain actual pixel coordinates of a feature pixel point in the second predetermined image in the second target image;
and the third determining submodule is used for determining the correction parameters of the front camera according to the actual pixel coordinates of the characteristic pixel points.
24. The apparatus of claim 23, wherein the third determining submodule comprises:
the first acquisition unit is used for acquiring original coordinate information of the characteristic pixel points when the naked eye three-dimensional display equipment displays a second preset image;
the second obtaining unit is used for obtaining a second incidence relation between theoretical pixel coordinates of the characteristic pixel points in the second preset image in the second target image and correction parameters of the front camera according to original coordinate information of the characteristic pixel points;
and the fourth determining unit is used for determining the correction parameters of the front camera according to the actual pixel coordinates of the characteristic pixel points and the second incidence relation between the theoretical pixel coordinates and the correction parameters of the front camera.
25. The apparatus of claim 18,
the naked eye stereoscopic display device comprises a first display mode and a second display mode;
the naked eye stereoscopic display equipment displays the first preset image in the first display mode, and the first correction parameter corresponds to the first display mode;
the device further comprises:
a sixth obtaining module, configured to obtain a third predetermined image displayed by the autostereoscopic display device according to a preset second arrangement parameter in the second display mode;
a seventh obtaining module, configured to obtain an actual image attribute of the third predetermined image according to the third predetermined image;
the eighth acquiring module is used for acquiring a second correction parameter according to the preset second layout parameter and the actual image attribute of the third preset image;
and the third storage module is used for storing the second correction parameter.
26. The apparatus of claim 25, further comprising:
a determining module, configured to determine a current display mode of the autostereoscopic display device after the third saving module saves the second correction parameter;
the first calling module is used for calling a first correction parameter corresponding to a first display mode to carry out naked eye three-dimensional display when the naked eye three-dimensional display equipment is determined to be in the first display mode;
and the second calling module is used for calling a second correction parameter corresponding to the second display mode to perform naked eye stereoscopic display when the naked eye stereoscopic display device is determined to be in the second display mode.
27. A computer-readable storage medium for storing a computer program which can be executed by a processor for performing the method according to any one of claims 1 to 17.
28. An electronic device, wherein the electronic device comprises one or more processors configured to perform the method of:
acquiring a first preset image displayed by naked eye stereoscopic display equipment according to preset layout parameters;
acquiring actual image attributes of the first preset image according to the first preset image;
acquiring a first correction parameter according to the preset layout parameter and the actual image attribute of the first preset image;
storing the first correction parameter to enable the autostereoscopic display equipment to carry out autostereoscopic display according to the first correction parameter;
the acquiring of the first preset image displayed by the naked eye stereoscopic display device according to the preset arrangement parameters comprises the following steps:
shooting a virtual image formed by the first preset image on a mirror surface by using a camera to obtain a first target image so that the first target image comprises the first preset image;
acquiring the first preset image according to the first target image;
acquiring a first correction parameter according to the preset mapping parameter and the actual image attribute of the first preset image, wherein the acquiring of the first correction parameter comprises the following steps:
acquiring a first incidence relation among the layout parameter, the first correction parameter and the theoretical image attribute of the first preset image;
determining the first correction parameter according to the first incidence relation, the actual image attribute and the preset layout parameter;
the determining the first correction parameter according to the first association relationship, the actual image attribute and the preset mapping parameter includes:
establishing a first cost function corresponding to the first incidence relation;
and according to the actual image attribute and the preset mapping parameter, minimizing the first cost function by utilizing a minimization algorithm, and determining the first correction parameter.
29. A autostereoscopic display device comprising:
the device comprises a shell, a display screen and a front camera which are arranged on the shell, and one or more processors which are arranged in the shell;
the display screen comprises a display device and a light splitting device, and the display device and the light splitting device are arranged oppositely;
the processor arranges pixels on the display device according to preset arrangement parameters, and displays a first preset image on the display screen under the action of the light splitting device;
it is characterized in that the preparation method is characterized in that,
the front camera is used for shooting a virtual image formed by the first preset image on the mirror surface to obtain a first target image, so that the first target image comprises the first preset image;
the processor is configured to:
acquiring the first preset image according to the first target image;
acquiring actual image attributes of the first preset image according to the first preset image;
acquiring a first correction parameter according to the preset layout parameter and the actual image attribute of the first preset image;
storing the first correction parameter, and performing naked eye three-dimensional display according to the first correction parameter;
acquiring a first correction parameter according to the preset mapping parameter and the actual image attribute of the first preset image, wherein the acquiring of the first correction parameter comprises the following steps:
acquiring a first incidence relation among the layout parameter, the first correction parameter and the theoretical image attribute of the first preset image;
determining the first correction parameter according to the first incidence relation, the actual image attribute and the preset layout parameter;
the determining the first correction parameter according to the first association relationship, the actual image attribute and the preset mapping parameter includes:
establishing a first cost function corresponding to the first incidence relation;
and according to the actual image attribute and the preset mapping parameter, minimizing the first cost function by utilizing a minimization algorithm, and determining the first correction parameter.
CN201710487902.6A 2017-06-23 2017-06-23 Display correction method and device of naked eye stereoscopic display equipment Active CN107155104B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710487902.6A CN107155104B (en) 2017-06-23 2017-06-23 Display correction method and device of naked eye stereoscopic display equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710487902.6A CN107155104B (en) 2017-06-23 2017-06-23 Display correction method and device of naked eye stereoscopic display equipment

Publications (2)

Publication Number Publication Date
CN107155104A CN107155104A (en) 2017-09-12
CN107155104B true CN107155104B (en) 2020-08-04

Family

ID=59796341

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710487902.6A Active CN107155104B (en) 2017-06-23 2017-06-23 Display correction method and device of naked eye stereoscopic display equipment

Country Status (1)

Country Link
CN (1) CN107155104B (en)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107613287A (en) * 2017-09-25 2018-01-19 深圳市维超智能科技有限公司 A kind of packing box and 3D self-calibration system
KR102401168B1 (en) 2017-10-27 2022-05-24 삼성전자주식회사 Method and apparatus for calibrating parameter of 3d display apparatus
CN108111838B (en) * 2017-12-25 2024-02-20 张家港康得新光电材料有限公司 Naked eye 3D display correction jig and correction method
CN108063940B (en) * 2017-12-25 2023-10-27 张家港康得新光电材料有限公司 Correction system and method for human eye tracking naked eye 3D display system
CN108366248A (en) * 2018-01-17 2018-08-03 高炜 A kind of 3D display device and 3D calibrating installations and method
CN108419072B (en) * 2018-01-17 2020-08-04 深圳市绚视科技有限公司 Correction method and correction device for naked eye 3D display screen and storage medium
CN110072100A (en) * 2018-01-24 2019-07-30 深圳市创鑫未来科技有限公司 A kind of 3D display calibrating installation and calibration method
CN108337501B (en) * 2018-04-09 2024-04-16 张家港康得新光电材料有限公司 Method and device for determining naked eye 3D optimal viewing distance
CN110385849B (en) * 2018-04-16 2022-08-05 深圳市创鑫未来科技有限公司 3D mobile phone film and packaging box
CN108829364A (en) * 2018-06-19 2018-11-16 浙江水晶光电科技股份有限公司 Adjusting method, mobile terminal and the server of head-up display
CN109246417A (en) * 2018-11-27 2019-01-18 武汉市天蝎科技有限公司 A kind of machine vision analysis system and method based on bore hole stereoscopic display
WO2020177132A1 (en) * 2019-03-07 2020-09-10 深圳市立体通科技有限公司 Automatic calibration method for image arrangement of naked 3d display screen, and electronic device
CN112767317B (en) * 2020-12-31 2022-11-25 上海易维视科技有限公司 Naked eye 3D display grating film detection method

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104661011A (en) * 2014-11-26 2015-05-27 深圳超多维光电子有限公司 Stereoscopic image display method and hand-held terminal
CN105204173A (en) * 2015-08-31 2015-12-30 重庆卓美华视光电有限公司 View synthesis correction method and device
CN105572883A (en) * 2014-10-11 2016-05-11 深圳超多维光电子有限公司 Correction system of stereoscopic display device and correction method thereof
CN106488212A (en) * 2015-08-28 2017-03-08 深圳创锐思科技有限公司 The bearing calibration of stereoscopic display device and system
CN106488217A (en) * 2015-08-28 2017-03-08 深圳创锐思科技有限公司 The correction parameter acquisition methods of stereoscopic display device and device
CN106488210A (en) * 2015-08-28 2017-03-08 深圳创锐思科技有限公司 The correction parameter acquisition methods of stereoscopic display device and device
CN106488214A (en) * 2015-08-28 2017-03-08 深圳创锐思科技有限公司 The correction system of stereoscopic display device

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102595182B (en) * 2012-03-16 2015-02-11 深圳超多维光电子有限公司 Stereo display equipment, and correction method, device and system thereof
JP2014092461A (en) * 2012-11-02 2014-05-19 Sony Corp Image processor and image processing method, image processing system, and program

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105572883A (en) * 2014-10-11 2016-05-11 深圳超多维光电子有限公司 Correction system of stereoscopic display device and correction method thereof
CN104661011A (en) * 2014-11-26 2015-05-27 深圳超多维光电子有限公司 Stereoscopic image display method and hand-held terminal
CN106488212A (en) * 2015-08-28 2017-03-08 深圳创锐思科技有限公司 The bearing calibration of stereoscopic display device and system
CN106488217A (en) * 2015-08-28 2017-03-08 深圳创锐思科技有限公司 The correction parameter acquisition methods of stereoscopic display device and device
CN106488210A (en) * 2015-08-28 2017-03-08 深圳创锐思科技有限公司 The correction parameter acquisition methods of stereoscopic display device and device
CN106488214A (en) * 2015-08-28 2017-03-08 深圳创锐思科技有限公司 The correction system of stereoscopic display device
CN105204173A (en) * 2015-08-31 2015-12-30 重庆卓美华视光电有限公司 View synthesis correction method and device

Also Published As

Publication number Publication date
CN107155104A (en) 2017-09-12

Similar Documents

Publication Publication Date Title
CN107155104B (en) Display correction method and device of naked eye stereoscopic display equipment
US20200192201A1 (en) System and method for calibrating a display system using manual and semi-manual techniques
CN107249128B (en) Camera correction method and device
US11115633B2 (en) Method and system for projector calibration
JP6681470B2 (en) Depth perception trinocular camera system
CN107179613B (en) A kind of display bearing calibration, device and the electronic equipment of bore hole stereoscopic display equipment
US7583307B2 (en) Autostereoscopic display
EP3163535B1 (en) Wide-area image acquisition method and device
WO2019080295A1 (en) Naked-eye 3d display method and control system based on eye tracking
US8189035B2 (en) Method and apparatus for rendering virtual see-through scenes on single or tiled displays
CN103562963A (en) Systems and methods for alignment, calibration and rendering for an angular slice true-3D display
CN101136192B (en) System and method for automated calibration and correction of display geometry and color
CN102572486B (en) Acquisition system and method for stereoscopic video
JP5633058B1 (en) 3D measuring apparatus and 3D measuring method
WO2012154874A1 (en) Display screen for camera calibration
WO2012154878A1 (en) Camera calibration using an easily produced 3d calibration pattern
EP2887662A2 (en) Apparatus and method to measure display quality
CN103947199A (en) Image processing device, three-dimensional image display device, image processing method and image processing program
TWI520099B (en) Calibration method of an image capture system
CN107113417B (en) Projecting an image onto an object
US10778908B2 (en) Method for correcting image of multi-camera system by using multi-sphere correction device
CN107202680B (en) Module detection equipment and detection method
WO2014119555A1 (en) Image processing device, display device and program
CN114967170B (en) Display processing method and device based on flexible naked eye three-dimensional display equipment
CN103020950A (en) Brightness function acquisition method and related device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant