CN113612978B - Geometric distortion correction method, device, system and computer readable storage medium - Google Patents
Geometric distortion correction method, device, system and computer readable storage medium Download PDFInfo
- Publication number
- CN113612978B CN113612978B CN202110754232.6A CN202110754232A CN113612978B CN 113612978 B CN113612978 B CN 113612978B CN 202110754232 A CN202110754232 A CN 202110754232A CN 113612978 B CN113612978 B CN 113612978B
- Authority
- CN
- China
- Prior art keywords
- user
- eyes
- camera
- geometric distortion
- software
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012937 correction Methods 0.000 title claims abstract description 48
- 238000000034 method Methods 0.000 title claims abstract description 47
- 239000011159 matrix material Substances 0.000 claims abstract description 70
- 210000001747 pupil Anatomy 0.000 claims abstract description 42
- 210000003128 head Anatomy 0.000 claims description 47
- 238000012544 monitoring process Methods 0.000 claims description 18
- 238000004891 communication Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 4
- 239000011521 glass Substances 0.000 description 3
- YTAHJIFKAKIKAV-XNMGPUDCSA-N [(1R)-3-morpholin-4-yl-1-phenylpropyl] N-[(3S)-2-oxo-5-phenyl-1,3-dihydro-1,4-benzodiazepin-3-yl]carbamate Chemical compound O=C1[C@H](N=C(C2=C(N1)C=CC=C2)C1=CC=CC=C1)NC(O[C@H](CCN1CCOCC1)C1=CC=CC=C1)=O YTAHJIFKAKIKAV-XNMGPUDCSA-N 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3179—Video signal processing therefor
- H04N9/3185—Geometric adjustment, e.g. keystone or convergence
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/327—Calibration thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/363—Image reproducers using image projection screens
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Geometry (AREA)
- Controls And Circuits For Display Device (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
The invention discloses a geometric distortion correction method, a device, a system and a computer readable storage medium, comprising the following steps: acquiring position information of eyes of a user, and determining a projection matrix of a software camera according to the position information, the pupil distance and a preset display screen size; and according to the projection matrix, adjusting the field angle corresponding to the software camera so as to correct the geometric distortion formed by the software camera. According to the invention, the position information of the eyes of the user is obtained, the projection matrix of the software camera is determined according to the position information, the pupil distance and the preset display screen size, and the view angle of the software camera is adjusted according to the projection matrix, so that the geometric distortion of the software camera is corrected, and the three-dimensional display equipment cannot form geometric distortion.
Description
Technical Field
The present invention relates to the field of three-dimensional display technologies, and in particular, to a geometric distortion correction method, device, system, and computer readable storage medium.
Background
With the development of three-dimensional technology, many three-dimensional projectors and three-dimensional display screens at present mainly realize three-dimensional effects by improving the rapid refresh rate of pictures, and the three-dimensional display screens belong to active three-dimensional technology and can realize good three-dimensional effects, but the current three-dimensional technology is used for playing videos, and when being applied to three-dimensional display equipment capable of realizing man-machine interaction, geometric distortion is easy to form, and good three-dimensional effects are difficult to realize.
Therefore, how to correct the geometric distortion formed when the three-dimensional technology is applied to the stereoscopic display device is an urgent problem to be solved.
Disclosure of Invention
The invention mainly aims to provide a geometric distortion correction method, a device, a system and a computer readable storage medium, which aim to solve the problem of how to correct geometric distortion of a stereoscopic display device.
In order to achieve the above object, the present invention provides a geometric distortion correction method comprising the steps of:
Acquiring position information of eyes of a user, and determining a projection matrix of a software camera according to the position information, the pupil distance and a preset display screen size;
And according to the projection matrix, adjusting the field angle corresponding to the software camera so as to correct the geometric distortion formed by the software camera.
Preferably, before the step of obtaining the position information of the eyes of the user and determining the projection matrix of the software camera according to the position information, the pupil distance and the preset display screen size, the geometric distortion correction method further comprises:
when a starting instruction is detected, a head photo of a user is shot through a dynamic camera, and the pupil distance corresponding to eyes of the user is determined according to the head photo of the user.
Preferably, the step of acquiring the position information of the eyes of the user comprises:
Monitoring the movement condition of the head of a user in real time through the dynamic capture camera, and determining a first position of eyes of the user according to the movement condition;
Determining location information of the eyes of the user according to the first location, wherein the location information comprises: and the first coordinates corresponding to the eyes of the user and the first distance between the eyes of the user and the display screen.
Preferably, the software camera includes a first lens and a second lens, and the step of determining the projection matrix corresponding to the software camera according to the position information, the pupil distance and the preset display screen size includes:
According to the position information, modifying a second coordinate corresponding to the software camera into the first coordinate, and modifying a second distance between the software camera and the display screen into the first distance;
modifying a third distance between the first lens and the second lens in the software camera into the pupil distance, and determining the view cone width of the software camera according to the preset display screen size and the first distance;
And determining a projection matrix corresponding to the software camera according to the first coordinate, the first distance, the pupil distance and the view cone width.
Preferably, the step of adjusting the view angle corresponding to the software camera according to the projection matrix to correct the geometric distortion formed by the software camera includes:
And calculating a view angle parameter according to the projection matrix, and adjusting the view angle corresponding to the software camera in real time according to the view angle parameter so as to correct geometric distortion formed by the software camera.
Preferably, after the step of adjusting the view angle corresponding to the software camera according to the projection matrix to correct the geometric distortion formed by the software camera, the geometric distortion correction method further includes:
and performing projection operation according to the projection matrix and the field angle adjusted by the software camera, and monitoring the movement condition of the head of the user in real time through the dynamic capture camera so as to acquire a second position of eyes of the user.
Preferably, after the step of performing projection operation according to the projection matrix and the view angle adjusted by the software camera and monitoring the motion condition of the head of the user in real time by the motion capture camera to obtain the second position of the eyes of the user, the geometric distortion correction method further includes:
Comparing the second position with the first position to obtain a comparison result;
if the comparison result is that the second position is the same as the first position, continuing to perform the projection operation;
If the comparison result is that the second position is different from the first position, storing the second position as the first position, and executing the steps: and determining the position information of the eyes of the user according to the first position.
In addition, in order to achieve the above object, the present invention also provides a geometric distortion correction apparatus including:
The determining module is used for acquiring the position information of eyes of a user and determining a projection matrix of the software camera according to the position information, the pupil distance and the preset display screen size;
And the correction module is used for adjusting the view angle corresponding to the software camera according to the projection matrix so as to correct the geometric distortion formed by the software camera.
Further, the determining module is further configured to:
when a starting instruction is detected, a head photo of a user is shot through a dynamic camera, and the pupil distance corresponding to eyes of the user is determined according to the head photo of the user.
Further, the determining module is further configured to:
Monitoring the movement condition of the head of a user in real time through the dynamic capture camera, and determining a first position of eyes of the user according to the movement condition;
Determining location information of the eyes of the user according to the first location, wherein the location information comprises: and the first coordinates corresponding to the eyes of the user and the first distance between the eyes of the user and the display screen.
Further, the determining module is further configured to:
According to the position information, modifying a second coordinate corresponding to the software camera into the first coordinate, and modifying a second distance between the software camera and the display screen into the first distance;
modifying a third distance between the first lens and the second lens in the software camera into the pupil distance, and determining the view cone width of the software camera according to the preset display screen size and the first distance;
And determining a projection matrix corresponding to the software camera according to the first coordinate, the first distance, the pupil distance and the view cone width.
Further, the correction module is further configured to:
And calculating a view angle parameter according to the projection matrix, and adjusting the view angle corresponding to the software camera in real time according to the view angle parameter so as to correct geometric distortion formed by the software camera.
Further, the correction module further includes a monitoring module for:
and performing projection operation according to the projection matrix and the field angle adjusted by the software camera, and monitoring the movement condition of the head of the user in real time through the dynamic capture camera so as to acquire a second position of eyes of the user.
Further, the correction module further includes a contrast module for:
Comparing the second position with the first position to obtain a comparison result;
if the comparison result is that the second position is the same as the first position, continuing to perform the projection operation;
If the comparison result is that the second position is different from the first position, storing the second position as the first position, and executing the steps: and determining the position information of the eyes of the user according to the first position.
In addition, to achieve the above object, the present invention also provides a geometric distortion correction system, including: a memory, a processor and a geometric distortion correction program stored on the memory and executable on the processor, which when executed by the processor, implements the steps of the geometric distortion correction method as described above.
In addition, in order to achieve the above object, the present invention also provides a computer-readable storage medium having stored thereon a geometric distortion correction program which, when executed by a processor, implements the steps of the geometric distortion correction method as described above.
The geometric distortion correction method provided by the invention acquires the position information of eyes of a user, and determines a projection matrix of a software camera according to the position information, the pupil distance and the preset display screen size; and according to the projection matrix, adjusting the corresponding field angle of the software camera to correct the geometric distortion of the software camera. According to the invention, the position information of the eyes of the user is obtained, the projection matrix of the software camera is determined according to the position information, the pupil distance and the preset display screen size, and the view angle of the software camera is adjusted according to the projection matrix, so that the geometric distortion of the software camera is corrected, and the three-dimensional display equipment cannot form geometric distortion.
Drawings
FIG. 1 is a schematic diagram of a device architecture of a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a flowchart of a geometric distortion correction method according to a first embodiment of the present invention;
The achievement of the objects, functional features and advantages of the present invention will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
Referring to fig. 1, fig. 1 is a schematic device structure of a hardware running environment according to an embodiment of the present invention.
The device of the embodiment of the invention can be a PC or a server device.
As shown in fig. 1, the apparatus may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, a communication bus 1002. Wherein the communication bus 1002 is used to enable connected communication between these components. The user interface 1003 may include a Display, an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may further include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a stable memory (non-volatile memory), such as a disk memory. The memory 1005 may also optionally be a storage device separate from the processor 1001 described above.
It will be appreciated by those skilled in the art that the device structure shown in fig. 1 is not limiting of the device and may include more or fewer components than shown, or may combine certain components, or a different arrangement of components.
As shown in fig. 1, an operating system, a network communication module, a user interface module, and a geometric distortion correction program may be included in a memory 1005 as one type of computer storage medium.
The operating system is a program for managing and controlling the portable three-dimensional display equipment and software resources and supports the operation of a network communication module, a user interface module, a geometric distortion correction program and other programs or software; the network communication module is used to manage and control the network interface 1002; the user interface module is used to manage and control the user interface 1003.
In the stereoscopic display apparatus shown in fig. 1, the stereoscopic display apparatus calls a geometric distortion correction program stored in a memory 1005 through a processor 1001 and performs operations in the respective embodiments of the geometric distortion correction method described below.
Based on the above hardware structure, the embodiment of the geometric distortion correction method of the invention is provided.
Referring to fig. 2, fig. 2 is a flowchart of a first embodiment of a geometric distortion correction method according to the present invention, the method includes:
Step S10, acquiring position information of eyes of a user, and determining a projection matrix of a software camera according to the position information, the pupil distance and the preset display screen size;
And step S20, according to the projection matrix, adjusting the view angle corresponding to the software camera so as to correct the geometric distortion formed by the software camera.
The geometric distortion correction method is applied to a stereoscopic display device, wherein the stereoscopic display device can be interactive or non-interactive, the stereoscopic display device can be a terminal or PC device, and for convenience of description, the stereoscopic display device is taken as an example for description; the stereoscopic display device includes, but is not limited to: the three-dimensional display equipment monitors the movement condition of the head of the user through the dynamic camera, determines the position information of eyes of the user according to the movement condition, and determines a projection matrix of the software camera according to the position information, the interpupillary distance and the preset display screen size; the stereoscopic display equipment adjusts the view angle corresponding to the software camera in real time according to the determined projection matrix of the software camera, so that the view angle corresponding to the software camera is consistent with the view angle of the user, and further, the geometric distortion formed by the software camera is corrected; it should be noted that, the software camera in the stereoscopic display device is used for projecting the content of the stereoscopic display device, which may be an image or interaction information with the user, and the software camera in the stereoscopic display device generally has two lenses, including a first lens and a second lens, for simulating two eyes of the user; the motion capture camera in the stereoscopic display device is a motion capture camera and is used for monitoring the motion condition of the head of a user in real time and acquiring the position information of eyes of the user.
The geometric distortion correction method of the embodiment obtains the position information of eyes of a user, and determines a projection matrix of a software camera according to the position information, the pupil distance and the preset display screen size; and according to the projection matrix, adjusting the corresponding field angle of the software camera to correct the geometric distortion of the software camera. According to the invention, the position information of eyes of a user is obtained, the projection matrix of the software camera is determined according to the position information, the pupil distance and the preset display screen size, and the view angle of the software camera is adjusted according to the projection matrix so as to correct the geometric distortion of the software camera, so that the corresponding stereoscopic display equipment cannot form geometric distortion.
The following will explain each step in detail:
Step S10, acquiring position information of eyes of a user, and determining a projection matrix of a software camera according to the position information, the pupil distance and the preset display screen size;
In this embodiment, the stereoscopic display device acquires the position information of the eyes of the user in real time through the dynamic capturing camera, and determines the projection matrix corresponding to the software camera in the stereoscopic display device according to the position information of the eyes of the user, the pupil distance corresponding to the user and the preset display screen size, and it is to be noted that the first lens and the second lens in the software camera in the stereoscopic display device need to work cooperatively, so that the stereoscopic display device determines the projection matrix corresponding to the software camera, and the projection matrix of the first lens and the second lens in the software camera are also determined correspondingly.
Specifically, before step S10, it includes:
And a step a, when a starting instruction is detected, shooting a head photo of a user through a dynamic camera, and determining the pupil distance corresponding to eyes of the user according to the head photo of the user.
In this step, when the stereoscopic display device detects the start instruction, the stereoscopic display device takes a photograph of the head of the user through the dynamic camera, and determines the interpupillary distance corresponding to the eyes of the user according to the photograph of the head of the user, for example: when the stereoscopic display device detects a starting instruction, the stereoscopic display device calls a dynamic camera to shoot a plurality of user head photos, analyzes the plurality of user head photos, selects a user head photo which is the clearest and shoots the face of a user, positions eyes of the user in the user head photo, and determines the corresponding pupil distance between the two eyes of the user; it should be noted that, the user can select to determine the pupil distance through the dynamic camera or select to input the corresponding pupil distance through the input interface of the stereoscopic display device.
Further, step S10 further includes:
Step b, monitoring the movement condition of the head of the user in real time through the dynamic camera, and determining the first position of eyes of the user according to the movement condition;
In this step, the stereoscopic display device monitors the movement condition of the user's head in real time through the motion capture camera, and determines the first position of the user's eyes according to the movement condition, for example: the three-dimensional display equipment monitors the movement condition of the head of the user in real time through the dynamic camera, and when the movement amplitude of the head of the user is monitored to exceed a preset movement amplitude threshold value, the three-dimensional display equipment calculates the position of the head of the user through the dynamic camera and determines the first position of eyes of the user according to the position of the head of the user; it should be noted that some stereoscopic display devices can realize the effect of naked eyes in three dimensions, that is, a user can see a three-dimensional image or image without using three-dimensional glasses, at this time, the stereoscopic display device determines the first position of eyes of the user through the motion capture camera, the common stereoscopic display device needs the user to wear the three-dimensional glasses when using, and the stereoscopic display device can determine the position of the three-dimensional glasses as the first position of eyes of the user through the motion capture camera.
Step c, determining position information of eyes of the user according to the first position, wherein the position information comprises: and the first coordinates corresponding to the eyes of the user and the first distance between the eyes of the user and the display screen.
In this step, the stereoscopic display device determines position information of the user's eyes according to the determined first position of the user's eyes, the position information including: a first coordinate of the user's eye and a first distance between the user's eye and the display screen; such as: the three-dimensional display device constructs a coordinate system for the real world, and determines a first coordinate of eyes of a user and a first distance between the eyes of the user and a display screen through a dynamic camera; the first coordinates of the eyes of the user include coordinates of the left and right eyes, respectively.
Step d, according to the position information, modifying a second coordinate corresponding to the software camera into the first coordinate, and modifying a second distance between the software camera and the display screen into the first distance;
In this step, the stereoscopic display device modifies, according to the position information of the eyes of the user, the second coordinates corresponding to the software camera to the first coordinates of the eyes of the user, where the first coordinates include coordinates corresponding to the left eye and the right eye of the user, and the first lens and the second lens in the software camera modify according to the coordinates corresponding to the left eye and the right eye of the user, and modifies the second distance between the software camera and the display screen to the first distance between the eyes of the user and the display screen, for example: the three-dimensional display device corresponds the constructed real world coordinate system with the virtual world coordinate system, modifies a second coordinate corresponding to the software camera in the virtual world coordinate system into a first coordinate of the eyes of the user, wherein the first coordinate comprises coordinates corresponding to the left eye and the right eye of the user, modifies a first lens and a second lens in the software camera according to the coordinates corresponding to the left eye and the right eye of the user, and modifies a second distance between the software camera and the display screen into a first distance between the eyes of the user and the display screen, so that the position of the software camera in the virtual world coordinate system is consistent with the position of the eyes of the user in the real world coordinate system. It should be noted that when the second distance between the software camera and the display screen is closer than the first distance between the user's eyes and the display screen, both the front surface and the rear surface of the three-dimensional image are compressed toward the screen, and when the second distance between the software camera and the display screen is farther than the first distance between the user's eyes and the display screen, the three-dimensional image appears to be spread away from the screen, both of which may cause geometric distortion of the stereoscopic display device.
Step e, modifying a third distance between the first lens and the second lens in the software camera into the pupil distance, and determining the view cone width of the software camera according to the preset display screen size and the first distance;
In this step, the stereoscopic display device modifies a third distance between the first lens and the second lens in the software camera to be a pupil distance corresponding to the eyes of the user, and determines a viewing cone width of the software camera according to a preset display screen size and the first distance, for example: the three-dimensional display device adjusts a third distance between the first lens and the second lens in the software camera to be the pupil distance corresponding to the eyes of the user, so that the first lens and the second lens in the software camera can simulate the eyes of the user; when the width of the display screen is smaller than the width of the frustum of the camera, the three-dimensional image seen by the user is smaller, and the three-dimensional image of the farther part is more compressed than the three-dimensional image of the closer part, when the width of the screen is larger than the width of the viewing cone of the camera, the three-dimensional image seen by the user is larger, and the three-dimensional image of the farther part is more expanded than the three-dimensional image of the closer part, the two conditions can cause geometric distortion of the stereoscopic display device, and therefore, the viewing cone width needs to be determined according to the preset size of the display screen and the first distance between eyes of the user and the display screen, so that the size of the image formed by the software camera is the same as the size of the display screen.
And f, determining a projection matrix corresponding to the software camera according to the first coordinate, the first distance, the pupil distance and the view cone width.
In the step, the stereoscopic display device modifies parameters of the software camera according to the first coordinate, the first distance, the pupil distance and the viewing cone width, and then determines a projection matrix corresponding to the software camera according to the parameters modified by the software camera; when the software camera projects the three-dimensional image to the display screen, each pixel point in the three-dimensional image has a unique corresponding coordinate point on the display screen, and all the pixel points of one frame of three-dimensional image form a projection matrix at the corresponding coordinate points on the display screen.
And step S20, according to the projection matrix, adjusting the view angle corresponding to the software camera so as to correct the geometric distortion formed by the software camera.
In this embodiment, the stereoscopic display device adjusts the corresponding field angle of the software camera in real time according to the projection matrix to correct the geometric distortion formed by the software camera, and it should be noted that the stereoscopic display device calculates the corresponding field angle according to the projection matrix according to the preset field angle calculation formula, and adjusts the corresponding field angle of the software camera in real time according to the calculated field angle to correct the geometric distortion formed by the software camera.
Specifically, step S20 further includes:
And g, calculating a view angle parameter according to the projection matrix, and adjusting the view angle corresponding to the software camera in real time according to the view angle parameter so as to correct the geometric distortion formed by the software camera.
In this step, the stereoscopic display device calculates a viewing angle parameter according to the projection matrix, and adjusts, in real time, a viewing angle corresponding to the software camera according to the viewing angle parameter, so as to correct geometric distortion formed by the software camera, for example: the three-dimensional display equipment adjusts the angle of view of the software camera according to the calculated angle of view parameter, which is the same as the angle of view of the eyes of the user, so that the angle of view of the software camera is the same as the angle of view of the eyes of the user, and further, the geometric distortion formed by the software camera is corrected; it should be noted that, when the angle of view of the software camera is different from the angle of view of the eyes of the user, the three-dimensional image seen by the user may form geometric distortion.
According to the geometric distortion correction method, the stereoscopic display device monitors the movement condition of the head of a user through the dynamic camera, determines the position information of eyes of the user according to the movement condition, and determines the projection matrix of the software camera according to the position information, the interpupillary distance and the preset display screen size; the stereoscopic display equipment adjusts the view angle corresponding to the software camera in real time according to the determined projection matrix of the software camera, so that the view angle corresponding to the software camera is consistent with the view angle of the user, and further, the geometric distortion formed by the software camera is corrected; the invention modifies the parameters corresponding to the software camera according to the position information of the eyes of the user, the pupil distance and the preset display screen size in real time, determines the projection matrix of the software camera according to the parameters modified by the software camera, adjusts the view angle of the software camera according to the projection matrix in real time, ensures that the view angle of the software camera is the same as the view angle of the eyes of the user, and finally corrects the geometric distortion formed by the software camera.
Further, based on the first embodiment of the geometric distortion correction method of the present invention, a second embodiment of the geometric distortion correction method of the present invention is proposed.
The second embodiment of the geometric distortion correction method differs from the first embodiment of the geometric distortion correction method in that, after step S20, the geometric distortion correction method further includes:
and h, performing projection operation according to the projection matrix and the field angle adjusted by the software camera, and monitoring the movement condition of the head of the user in real time through the dynamic capture camera so as to acquire a second position of eyes of the user.
Step i, comparing the second position with the first position to obtain a comparison result;
Step j, if the comparison result is that the second position is the same as the first position, continuing the projection operation;
And step k, if the comparison result is that the second position is different from the first position, storing the second position as the first position, and executing the steps: and determining the position information of the eyes of the user according to the first position.
In this embodiment, the stereoscopic display device performs a projection operation according to the projection matrix and the field angle adjusted by the software camera, and monitors the movement condition of the user's head in real time by using the dynamic capture camera, so as to obtain the second position of the user's eyes. Comparing the second position with the first position to obtain a comparison result; if the comparison result is that the second position is the same as the first position, continuing to perform projection operation; if the comparison result is that the second position is different from the first position, the second position is stored as the first position, and the steps are executed: based on the first position, position information of the eyes of the user is determined.
The following will explain each step in detail:
and h, performing projection operation according to the projection matrix and the field angle adjusted by the software camera, and monitoring the movement condition of the head of the user in real time through the dynamic capture camera so as to acquire a second position of eyes of the user.
In this step, after the geometric distortion is corrected by the stereoscopic display device, performing projection operation according to the projection matrix and the view angle adjusted by the software camera, and monitoring the motion condition of the user's head in real time by the motion capture camera to obtain the second position of the user's eyes, where it is noted that if the motion condition of the user's head is static or the motion amplitude does not exceed the preset motion amplitude threshold, the second position and the first position may be regarded as the same, and if the motion condition of the user's head is that the motion amplitude exceeds the preset motion amplitude threshold, the second position and the first position may be regarded as different.
Step i, comparing the second position with the first position to obtain a comparison result;
in the step, the stereoscopic display device compares the second position of the eyes of the user acquired in real time with the first position to obtain a comparison result, and executes different steps according to different comparison results.
Step j, if the comparison result is that the second position is the same as the first position, continuing the projection operation;
In this step, if the stereo display device obtains that the comparison result is that the second position is the same as the first position, the projection operation is continued, and the second position is the same as the first position, which means that the head of the user is stationary or the motion amplitude is not large, and the three-dimensional image displayed by the software camera in the display screen does not form geometric distortion in the view of the user, so that the software camera does not need to be adjusted, and the projection operation is continued.
And step k, if the comparison result is that the second position is different from the first position, storing the second position as the first position, and executing the steps: and determining the position information of the eyes of the user according to the first position.
In this step, if the stereoscopic display device obtains that the second position is different from the first position as a result of the comparison, the stereoscopic display device stores the second position as the first position, and executes the steps of: based on the first position, position information of the eyes of the user is determined. Such as: if the comparison result is that the second position is different from the first position, the stereoscopic display device replaces the first position of the eyes of the user with the second position of the eyes of the user, namely, the position information of the first position is changed into the position information of the second position, and the steps are executed: and determining the position information of the eyes of the user according to the first position, and continuing to execute the subsequent steps.
The stereoscopic display device of the embodiment performs projection operation according to the projection matrix and the field angle adjusted by the software camera, and monitors the movement condition of the head of the user in real time through the dynamic capture camera so as to obtain the second position of the eyes of the user. Comparing the second position with the first position to obtain a comparison result; if the comparison result is that the second position is the same as the first position, continuing to perform projection operation; if the comparison result is that the second position is different from the first position, the second position is stored as the first position, and the steps are executed: according to the first position, the position information of eyes of the user is determined, and the movement condition of the head of the user is monitored in real time, so that the software camera is adjusted in time to correct the geometric distortion, and the user cannot feel the geometric distortion in sense.
The invention also provides a geometric distortion correction device. The geometric distortion correction apparatus of the present invention includes:
The determining module is used for acquiring the position information of eyes of a user and determining a projection matrix of the software camera according to the position information, the pupil distance and the preset display screen size;
And the correction module is used for adjusting the view angle corresponding to the software camera according to the projection matrix so as to correct the geometric distortion formed by the software camera.
Further, the determining module is further configured to:
when a starting instruction is detected, a head photo of a user is shot through a dynamic camera, and the pupil distance corresponding to eyes of the user is determined according to the head photo of the user.
Further, the determining module is further configured to:
Monitoring the movement condition of the head of a user in real time through the dynamic capture camera, and determining a first position of eyes of the user according to the movement condition;
Determining location information of the eyes of the user according to the first location, wherein the location information comprises: and the first coordinates corresponding to the eyes of the user and the first distance between the eyes of the user and the display screen.
Further, the determining module is further configured to:
According to the position information, modifying a second coordinate corresponding to the software camera into the first coordinate, and modifying a second distance between the software camera and the display screen into the first distance;
modifying a third distance between the first lens and the second lens in the software camera into the pupil distance, and determining the view cone width of the software camera according to the preset display screen size and the first distance;
And determining a projection matrix corresponding to the software camera according to the first coordinate, the first distance, the pupil distance and the view cone width.
Further, the correction module is further configured to:
And calculating a view angle parameter according to the projection matrix, and adjusting the view angle corresponding to the software camera in real time according to the view angle parameter so as to correct geometric distortion formed by the software camera.
Further, the correction module further includes a monitoring module for:
and performing projection operation according to the projection matrix and the field angle adjusted by the software camera, and monitoring the movement condition of the head of the user in real time through the dynamic capture camera so as to acquire a second position of eyes of the user.
Further, the correction module further includes a contrast module for:
Comparing the second position with the first position to obtain a comparison result;
if the comparison result is that the second position is the same as the first position, continuing to perform the projection operation;
If the comparison result is that the second position is different from the first position, storing the second position as the first position, and executing the steps: and determining the position information of the eyes of the user according to the first position.
The invention also provides a computer readable storage medium.
A computer readable storage medium has stored thereon a geometrical distortion correction program which, when executed by a processor, implements the steps of the geometrical distortion correction method as described above.
The method implemented when the geometric distortion correction program running on the processor is executed may refer to various embodiments of the geometric distortion correction method of the present invention, which are not described herein.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) as described above, comprising instructions for causing a terminal device (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the method according to the embodiments of the present invention.
The foregoing description is only of the preferred embodiments of the present invention, and is not intended to limit the scope of the invention, but rather is intended to cover any equivalents of the structures or equivalent processes disclosed herein, or any application, directly or indirectly, in the field of other related technology.
Claims (7)
1. A geometric distortion correction method, characterized in that the geometric distortion correction method comprises the steps of:
Acquiring position information of eyes of a user, and determining a projection matrix of a software camera according to the position information, the pupil distance and a preset display screen size;
according to the projection matrix, adjusting the view angle corresponding to the software camera to correct geometric distortion formed by the software camera;
Before the step of obtaining the position information of the eyes of the user and determining the projection matrix of the software camera according to the position information, the pupil distance and the preset display screen size, the geometric distortion correction method further comprises the following steps:
when a starting instruction is detected, shooting a head photo of a user through a dynamic camera, and determining the pupil distance corresponding to eyes of the user according to the head photo of the user;
The step of obtaining the position information of the eyes of the user comprises the following steps:
Monitoring the movement condition of the head of a user in real time through the dynamic capture camera, and determining a first position of eyes of the user according to the movement condition;
Determining location information of the eyes of the user according to the first location, wherein the location information comprises: the first coordinates corresponding to the eyes of the user and the first distance between the eyes of the user and the display screen;
The software camera comprises a first lens and a second lens, and the step of determining a projection matrix corresponding to the software camera according to the position information, the pupil distance and the preset display screen size comprises the following steps:
According to the position information, modifying a second coordinate corresponding to the software camera into the first coordinate, and modifying a second distance between the software camera and the display screen into the first distance;
modifying a third distance between the first lens and the second lens in the software camera into the pupil distance, and determining the view cone width of the software camera according to the preset display screen size and the first distance;
And determining a projection matrix corresponding to the software camera according to the first coordinate, the first distance, the pupil distance and the view cone width.
2. The method for correcting geometric distortion as claimed in claim 1, wherein the step of adjusting the view angle corresponding to the software camera according to the projection matrix to correct the geometric distortion formed by the software camera comprises:
And calculating a view angle parameter according to the projection matrix, and adjusting the view angle corresponding to the software camera according to the view angle parameter so as to correct geometric distortion formed by the software camera.
3. The method for correcting geometric distortion as claimed in claim 1, wherein after the step of adjusting the view angle corresponding to the software camera according to the projection matrix to correct the geometric distortion formed by the software camera, the method for correcting geometric distortion further comprises:
and performing projection operation according to the projection matrix and the field angle adjusted by the software camera, and monitoring the movement condition of the head of the user in real time through the dynamic capture camera so as to acquire a second position of eyes of the user.
4. The method for correcting geometric distortion as claimed in claim 3, wherein after the step of performing a projection operation according to the projection matrix and the angle of view adjusted by the software camera and monitoring the movement of the user's head in real time by the motion capture camera to obtain the second position of the user's eyes, the method for correcting geometric distortion further comprises:
Comparing the second position with the first position to obtain a comparison result;
if the comparison result is that the second position is the same as the first position, continuing to perform the projection operation;
If the comparison result is that the second position is different from the first position, storing the second position as the first position, and executing the steps: and determining the position information of the eyes of the user according to the first position.
5. A geometric distortion correction apparatus, characterized in that the geometric distortion correction apparatus comprises:
The determining module is used for acquiring the position information of eyes of a user and determining a projection matrix of the software camera according to the position information, the pupil distance and the preset display screen size;
The correction module is used for adjusting the view angle corresponding to the software camera according to the projection matrix so as to correct the geometric distortion formed by the software camera;
The determining module is further used for shooting a head photo of the user through the dynamic camera when the starting instruction is detected, and determining the pupil distance corresponding to the eyes of the user according to the head photo of the user;
The determining module is further used for monitoring the movement condition of the head of the user in real time through the dynamic capture camera and determining the first position of eyes of the user according to the movement condition; determining location information of the eyes of the user according to the first location, wherein the location information comprises: the first coordinates corresponding to the eyes of the user and the first distance between the eyes of the user and the display screen;
the software camera comprises a first lens and a second lens, and the determining module is further used for modifying a third distance between the first lens and the second lens in the software camera into the interpupillary distance and determining the viewing cone width of the software camera according to the preset display screen size and the first distance; and determining a projection matrix corresponding to the software camera according to the first coordinate, the first distance, the pupil distance and the view cone width.
6. A geometric distortion correction system, the geometric distortion correction system comprising: memory, a processor and a geometrical distortion correction program stored on the memory and executable on the processor, which when executed by the processor, implements the steps of the geometrical distortion correction method according to any of claims 1 to 4.
7. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a geometrical distortion correction program, which when executed by a processor, implements the steps of the geometrical distortion correction method according to any of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110754232.6A CN113612978B (en) | 2021-07-01 | 2021-07-01 | Geometric distortion correction method, device, system and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110754232.6A CN113612978B (en) | 2021-07-01 | 2021-07-01 | Geometric distortion correction method, device, system and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113612978A CN113612978A (en) | 2021-11-05 |
| CN113612978B true CN113612978B (en) | 2024-06-25 |
Family
ID=78303972
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110754232.6A Active CN113612978B (en) | 2021-07-01 | 2021-07-01 | Geometric distortion correction method, device, system and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113612978B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114727077A (en) * | 2022-03-04 | 2022-07-08 | 乐融致新电子科技(天津)有限公司 | Projection method, apparatus, device and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109002164A (en) * | 2018-07-10 | 2018-12-14 | 歌尔科技有限公司 | It wears the display methods for showing equipment, device and wears display equipment |
| CN109640070A (en) * | 2018-12-29 | 2019-04-16 | 上海曼恒数字技术股份有限公司 | A kind of stereo display method, device, equipment and storage medium |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107580203B (en) * | 2017-07-18 | 2019-01-15 | 长春理工大学 | Immersion active stereo projective perspective transformation matrix solving method |
| AU2017251725A1 (en) * | 2017-10-24 | 2019-05-09 | Canon Kabushiki Kaisha | Calibration of projection systems |
| CN112672139A (en) * | 2021-03-16 | 2021-04-16 | 深圳市火乐科技发展有限公司 | Projection display method, device and computer readable storage medium |
-
2021
- 2021-07-01 CN CN202110754232.6A patent/CN113612978B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109002164A (en) * | 2018-07-10 | 2018-12-14 | 歌尔科技有限公司 | It wears the display methods for showing equipment, device and wears display equipment |
| CN109640070A (en) * | 2018-12-29 | 2019-04-16 | 上海曼恒数字技术股份有限公司 | A kind of stereo display method, device, equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113612978A (en) | 2021-11-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102291461B1 (en) | Technologies for adjusting a perspective of a captured image for display | |
| CN107911621B (en) | Panoramic image shooting method, terminal equipment and storage medium | |
| US10403036B2 (en) | Rendering glasses shadows | |
| US10643334B2 (en) | Image presentation control methods and image presentation control apparatuses | |
| CN109905590B (en) | Video image processing method and device | |
| WO2020140758A1 (en) | Image display method, image processing method, and related devices | |
| US9613404B2 (en) | Image processing method, image processing apparatus and electronic device | |
| WO2016197639A1 (en) | Screen picture display method and apparatus | |
| US9491263B2 (en) | Systems and methods for automatically modifying a picture or a video containing a face | |
| CN113552947B (en) | Virtual scene display method, device and computer readable storage medium | |
| US10986401B2 (en) | Image processing apparatus, image processing system, and image processing method | |
| JP7101269B2 (en) | Pose correction | |
| WO2015149611A1 (en) | Image presentation control methods and image presentation control apparatuses | |
| CN105721739B (en) | Anti-shaking system and method for screen image | |
| US20140111524A1 (en) | Method and terminal for displaying an animation | |
| CN113612978B (en) | Geometric distortion correction method, device, system and computer readable storage medium | |
| US20220374076A1 (en) | Virtual Reality-Based Eyeball Tracking Method and System | |
| CN111939567A (en) | Game virtual scene transformation method and device and electronic terminal | |
| US20120320500A1 (en) | Portable electronic device and method for using the same | |
| CN108027646B (en) | Anti-shaking method and device for terminal display | |
| US10354125B2 (en) | Photograph processing method and system | |
| CN113010057B (en) | Pose control method, electronic device and computer readable storage medium | |
| CN112561787B (en) | Image processing method, device, electronic equipment and storage medium | |
| EP3413175A1 (en) | Image generation method, terminal, and graphical user interface | |
| CN115327782B (en) | Display control method and device, head-mounted display equipment and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |