CN113259650A - Stereoscopic image display method, device, medium and system based on eye tracking - Google Patents
Stereoscopic image display method, device, medium and system based on eye tracking Download PDFInfo
- Publication number
- CN113259650A CN113259650A CN202110517607.7A CN202110517607A CN113259650A CN 113259650 A CN113259650 A CN 113259650A CN 202110517607 A CN202110517607 A CN 202110517607A CN 113259650 A CN113259650 A CN 113259650A
- Authority
- CN
- China
- Prior art keywords
- view
- stereoscopic image
- target
- views
- viewer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000000034 method Methods 0.000 title claims abstract description 55
- 238000000605 extraction Methods 0.000 claims abstract description 43
- 230000003068 static effect Effects 0.000 claims abstract description 20
- FACXGONDLDSNOE-UHFFFAOYSA-N buta-1,3-diene;styrene Chemical compound C=CC=C.C=CC1=CC=CC=C1.C=CC1=CC=CC=C1 FACXGONDLDSNOE-UHFFFAOYSA-N 0.000 claims description 15
- 229920000468 styrene butadiene styrene block copolymer Polymers 0.000 claims description 15
- 238000006243 chemical reaction Methods 0.000 claims description 7
- 238000004590 computer program Methods 0.000 claims description 4
- 230000000694 effects Effects 0.000 abstract description 10
- 230000000007 visual effect Effects 0.000 abstract description 6
- 239000002609 medium Substances 0.000 description 9
- 238000010586 diagram Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 208000002173 dizziness Diseases 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 239000012120 mounting media Substances 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/366—Image reproducers using viewer tracking
- H04N13/383—Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
The embodiment of the application discloses a stereoscopic image display method, a stereoscopic image display device, a stereoscopic image display medium and a stereoscopic image display system based on eye tracking. The method comprises the following steps: acquiring a view set formed by at least three views of a stereoscopic image to be displayed; extracting two target views from the view set according to a preset static extraction rule or a preset dynamic extraction rule; the method comprises the steps of obtaining eye space coordinates of a viewer, and displaying two target views of a to-be-displayed three-dimensional image according to the eye space coordinates. According to the technical scheme, the display of the stereoscopic image based on the human eye tracking multi-view can be realized by extracting the two target views in the view set of the stereoscopic image. The 3D display effect is good, the visual area is large, the viewer does not need to look for the viewing angle or keep the viewing angle, and the experience of the viewer is improved.
Description
Technical Field
The embodiment of the application relates to the technical field of eye tracking, in particular to a method, a device, a medium and a system for displaying a stereoscopic image based on eye tracking.
Background
The principle of naked-eye 3D display is generally to split an image displayed by a display through a grating or a lens, so that human eyes receive different images, thereby realizing 3D display.
With the popularity and technical maturity of depth cameras, stereoscopic images including multiple views are increasing. Such as stereoscopic images in a 2D + depth map format and stereoscopic images in at least two parallax view formats. The stereoscopic image in the 2D + depth map format is a stereoscopic image with a left color 2D image and a right gray scale map with depth information corresponding to the left 2D image. The stereoscopic image in at least two parallax view formats refers to a stereoscopic image in which a plurality of offset views are placed in a frame in a nine-grid manner or other manners.
The SBS left and right stereoscopic image means a stereoscopic image in which both left and right sides are color 2D images, but there is a view. The conventional SBS-based left and right stereoscopic image display is generally supported by naked-eye 3D display with eye tracking in the prior art. Such display of stereoscopic images including multiple views is not supported.
Disclosure of Invention
The embodiment of the application provides a method, a device, a medium and a system for displaying stereoscopic images based on human eye tracking. The 3D display effect is good, the visual area is large, the viewer does not need to look for the viewing angle or keep the viewing angle, and the experience of the viewer is improved.
In a first aspect, an embodiment of the present application provides a stereoscopic image display method based on eye tracking, where the method includes:
acquiring a view set formed by at least three views of a stereoscopic image to be displayed;
extracting two target views from the view set according to a preset static extraction rule or a preset dynamic extraction rule;
the method comprises the steps of obtaining eye space coordinates of a viewer, and displaying two target views of a to-be-displayed three-dimensional image according to the eye space coordinates.
In a second aspect, an embodiment of the present application provides a stereoscopic image display device based on eye tracking, including:
the device comprises a view set acquisition unit, a view display unit and a display unit, wherein the view set acquisition unit is used for acquiring a view set formed by at least three views of a stereoscopic image to be displayed;
the target view extraction unit is used for extracting two target views from the view set according to a preset static extraction rule or a preset dynamic extraction rule;
and the target view display unit is used for acquiring the eye space coordinates of the viewer and displaying two target views of the three-dimensional image to be displayed according to the eye space coordinates.
In a third aspect, an embodiment of the present application provides a computer-readable medium, on which a computer program is stored, where the computer program, when executed by a processor, implements a method for displaying stereoscopic images based on eye tracking according to an embodiment of the present application.
In a fourth aspect, an embodiment of the present application provides a stereoscopic image display system based on eye tracking, where the system includes a stereoscopic image output module, a target view acquisition module, and a 3D display module;
the stereoscopic image output module is connected with the target view acquisition module, and is used for acquiring a view set formed by at least three views of a stereoscopic image to be displayed and transmitting the view set to the target view acquisition module;
the target view module is connected with the 3D display module and used for extracting two target views from the view set according to a preset static extraction rule or a preset dynamic extraction rule; sending the target view to the 3D display module;
and the 3D display module is used for displaying two target views of the to-be-displayed three-dimensional image according to the space coordinates of the human eyes.
According to the technical scheme provided by the embodiment of the application, a view set formed by at least three views of a to-be-displayed stereoscopic image is obtained; extracting two target views from the view set according to a preset static extraction rule or a preset dynamic extraction rule; and acquiring the human eye space coordinates of the viewer, and displaying two target views of the to-be-displayed three-dimensional image according to the human eye space coordinates. According to the technical scheme, the display of the stereoscopic image based on the human eye tracking multi-view can be realized by extracting the two target views in the view set of the stereoscopic image. The 3D display effect is good, the visual area is large, the viewer does not need to look for the viewing angle or keep the viewing angle, and the experience of the viewer is improved.
Drawings
Fig. 1 is a flowchart illustrating a stereoscopic image displaying method based on eye tracking according to an embodiment of the present disclosure;
fig. 2 is a schematic view of a stereoscopic image in a 2D + depth map format according to an embodiment of the present disclosure;
fig. 3 is a schematic view of a stereoscopic image view in at least two parallax view formats according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a stereoscopic image display device based on eye tracking according to a second embodiment of the present disclosure;
fig. 5 is a schematic structural diagram of a stereoscopic image display system based on eye tracking according to a fourth embodiment of the present disclosure.
Detailed Description
The present application will be described in further detail with reference to the following drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting of the application. It should be further noted that, for the convenience of description, only some of the structures related to the present application are shown in the drawings, not all of the structures.
Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the steps as a sequential process, many of the steps can be performed in parallel, concurrently or simultaneously. In addition, the order of the steps may be rearranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, and the like.
Example one
Fig. 1 is a flowchart of a method for displaying stereoscopic images based on eye tracking according to an embodiment of the present disclosure, where the method is applicable to a case of displaying stereoscopic images based on eye tracking, and the method can be executed by a device for displaying stereoscopic images based on eye tracking according to an embodiment of the present disclosure, and the device can be implemented by software and/or hardware, and can be integrated in an intelligent terminal for displaying stereoscopic images.
As shown in fig. 1, the method for displaying stereoscopic images based on eye tracking includes:
s110, acquiring a view set formed by at least three views of a stereoscopic image to be displayed;
in the scheme, the principle of naked eye 3D display is generally to split an image displayed by a display through a grating or a lens, so that human eyes receive different images, thereby realizing 3D display. By extracting the target view in the view set of the stereoscopic image to be displayed, the target view can be projected to the viewer through the light splitting device of the display.
In this embodiment, the stereoscopic image to be displayed may be acquired from the database. The to-be-displayed stereoscopic image comprises at least three views.
In this technical solution, optionally, the stereoscopic image to be displayed includes a stereoscopic image in a 2D + depth map format and a stereoscopic image in at least two parallax view formats.
The stereoscopic image in the 2D + depth map format is a stereoscopic image with a left color 2D image and a right gray scale map with depth information corresponding to the left 2D image.
In the present embodiment, the at least two parallax-view format stereoscopic images are stereoscopic images in which a plurality of offset views are placed in a frame in a grid pattern or other forms. For example, the stereoscopic image in at least two parallax view formats may refer to a stereoscopic image in which 9 offset views are placed in a frame in a nine-grid format. The stereoscopic image in the at least two parallax view formats includes not only a plurality of parallax views having 3D parallax in one direction, but also a plurality of views having both horizontal and vertical parallax.
For example, fig. 2 is a schematic view of a stereoscopic image view in a 2D + depth map format according to an embodiment of the present disclosure. As shown in fig. 2, the views in the stereoscopic image in the 2D + depth map format are sequentially ordered in order. The parallax is greatest for view 1 and view 9.
For example, fig. 3 is a schematic view of a stereoscopic image view in at least two parallax view formats provided in an embodiment of the present application. As shown in fig. 3, the views in the stereoscopic images in the at least two parallax view formats are ordered in the order of the squared figures. Where the disparity is greatest for view 1 and view 9.
By extracting two target views in a view set of the stereoscopic image, the display of the multi-view stereoscopic image based on human eye tracking can be realized.
S120, extracting two target views from the view set according to a preset static extraction rule or a preset dynamic extraction rule;
in this embodiment, the preset static extraction rule may refer to a rule for extracting two target views with fixed sequence numbers in the view set. For example, the disparity maximum view 1 and view 9 are extracted from the view set. Wherein the disparity differs between different views. Illustratively, the views in the view set are ordered sequentially in order, and the disparity between view 1 and view 9 is greater than the disparity between view 1 and view 8.
The preset dynamic extraction rule may be a rule that the sequence numbers of the two target views are adjusted according to the spatial coordinates of the human eyes, so that the target views can meet the parallax requirement of the viewer. For example, the view 1 and the view 9 with the maximum parallax are extracted from the view set for 3D display, and the viewer may feel dizziness, at this time, the serial number of the extracted target view may be adjusted in real time according to the spatial coordinates of human eyes. Such as extracting two views, view 3 and view 7, to obtain a 3D display result with a relatively small amount of parallax to meet the parallax requirement of the viewer.
In this technical solution, optionally, if the stereoscopic image to be displayed is a stereoscopic image in a 2D + depth map format, then:
extracting two target views from the view set according to a preset static extraction rule or a preset dynamic extraction rule, wherein the method comprises the following steps:
extracting two target views with fixed sequence numbers from the view set according to the view arrangement sequence;
or,
and extracting two target views meeting the parallax constraint condition from the view set according to the view arrangement sequence and the human eye space coordinates.
In this embodiment, the view arrangement order may refer to a rule of parallel sorting according to order. The views in the stereoscopic image in the 2D + depth map format are ordered in parallel in order.
In the scheme, two target views with fixed serial numbers can be extracted, and two target views can also be extracted dynamically according to the space coordinates of human eyes.
By extracting the two target views, the 3D effect can be well displayed. And the extracted view can be adjusted according to the space coordinates of the human eyes, so that a viewer does not need to look for the viewing angle or keep the viewing angle, and the experience of the viewer is improved.
In this technical solution, optionally, if the stereoscopic image to be displayed is a stereoscopic image in at least two parallax view formats, then:
extracting two target views from the view set according to a preset static extraction rule or a preset dynamic extraction rule, wherein the method comprises the following steps:
extracting two target views with fixed sequence numbers from the view set according to a view sorting rule;
or,
and extracting two target views meeting the parallax constraint condition from the view set according to a view sorting rule and the human eye space coordinates.
In this embodiment, the view ordering rule may refer to a rule that orders according to the squared figure. And 2, sorting the views in the stereoscopic images in the at least two parallax view formats according to a squared figure. The rule for selecting two views having disparity is different between the stereoscopic image of the 2D + depth map format and the stereoscopic image of the at least two disparity view format. The specific extraction mode can be set according to the view arrangement order and the view sorting rule.
By extracting the two target views, the 3D effect can be well displayed. And the extracted view can be adjusted according to the space coordinates of the human eyes, so that a viewer does not need to look for the viewing angle or keep the viewing angle, and the experience of the viewer is improved.
S130, obtaining eye space coordinates of a viewer, and displaying two target views of the stereoscopic image to be displayed according to the eye space coordinates.
Wherein, the eye space coordinates of the viewer can be recognized from the face image by adopting a conventional recognition algorithm. And based on the tracked human eye coordinate information of the viewer, projecting the two extracted target views to the current position of the viewer through a light splitting device in the 3D display.
In this technical solution, optionally, the obtaining of the spatial coordinates of the human eye of the viewer includes:
acquiring a viewer image including the eyes of a viewer by using a camera, and determining the eye space coordinates of the viewer according to the viewer image; wherein the human eye spatial coordinates comprise left eye spatial coordinates and right eye spatial coordinates;
or,
the spatial coordinates of the viewer's eyes are acquired using a sensor.
In the scheme, a camera is used for acquiring a face image of a viewer, a conventional image recognition method can be used for acquiring coordinates of human eyes, and spatial coordinates of the human eyes are formed by acquiring the distance between the position of the human and a display screen. The embodiment of the image recognition method is not particularly limited.
The sensor may be a sensor dedicated for human eye recognition. For example, sensors for eye tracking can capture the positions of both eyes of a person directly by iris recognition.
By acquiring the spatial coordinates of the human face, the extracted view can be adjusted, and a viewer does not need to look for the viewing angle or keep the viewing angle, so that the experience of the viewer is improved.
In this technical solution, optionally, after obtaining the spatial coordinates of the human eye of the viewer, the method includes:
converting the eye space coordinates into display parameters of the target view;
and processing the sub-pixels in the target view according to the display parameters to obtain a final target view.
In this embodiment, the display parameters may refer to parameters required by the naked-eye 3D display to display the target view. For example, the display parameter may be a photometric quantity, a colorimetric quantity, or the like.
In the scheme, display parameters can be formed according to the moving angle of human eyes, and the sub-pixels in the target view are adjusted. I.e. the resolution of the target view is adjusted. The position of the grating or the lens relative to the display screen can be adjusted according to the display parameters converted from the space coordinates of the human eyes.
The resolution in the target view can be adjusted through the display parameters, so that the target view can be better displayed in a 3D mode, and the 3D display effect is improved.
In this technical solution, optionally, the method further includes:
acquiring two target views in an SBS (styrene-butadiene-styrene) stereoscopic image; the SBS stereoscopic image is a stereoscopic image with the left side and the right side being colorful 2D images and is viewed;
the method comprises the steps of obtaining eye space coordinates of a viewer, and displaying two target views of a to-be-displayed three-dimensional image according to the eye space coordinates.
In this embodiment, the SBS stereoscopic image includes two left and right object views, and the two object views of the stereoscopic image to be displayed can be displayed by directly using the light splitting device in the 3D display.
Through showing SBS stereoscopic image, 3D display effect is good, and visual area is big.
According to the technical scheme provided by the embodiment of the application, a view set formed by at least three views of a to-be-displayed stereoscopic image is obtained; extracting two target views from the view set according to a preset static extraction rule or a preset dynamic extraction rule; the method comprises the steps of obtaining eye space coordinates of a viewer, and displaying two target views of a to-be-displayed three-dimensional image according to the eye space coordinates. By executing the technical scheme, the display of the stereoscopic image based on the human eye tracking multi-view can be realized by extracting two target views in the multi-view stereoscopic image. The 3D display effect is good, the visual area is large, the viewer does not need to look for the viewing angle or keep the viewing angle, and the experience of the viewer is improved.
Example two
Fig. 4 is a schematic structural diagram of a stereoscopic image display device based on eye tracking according to a second embodiment of the present disclosure, and as shown in fig. 4, the stereoscopic image display device based on eye tracking includes:
a view set acquiring unit 410, configured to acquire a view set formed by at least three views of a stereoscopic image to be displayed;
a target view extracting unit 420, configured to extract two target views from the view set according to a preset static extraction rule or a preset dynamic extraction rule;
and the target view display unit 430 is configured to obtain a spatial coordinate of eyes of a viewer, and display two target views of the stereoscopic image to be displayed according to the spatial coordinate of the eyes.
In this technical solution, optionally, the stereoscopic image to be displayed includes a stereoscopic image in a 2D + depth map format and a stereoscopic image in at least two parallax view formats.
In this technical solution, optionally, if the stereoscopic image to be displayed is a stereoscopic image in a 2D + depth map format, then:
the target view extracting unit 420 is specifically configured to:
extracting two target views with fixed sequence numbers from the view set according to the view arrangement sequence;
or,
and extracting two target views meeting the parallax constraint condition from the view set according to the view arrangement sequence and the human eye space coordinates.
In this technical solution, optionally, if the stereoscopic image to be displayed is a stereoscopic image in at least two parallax view formats, then:
the target view extracting unit 420 is specifically configured to:
extracting two target views with fixed sequence numbers from the view set according to a view sorting rule;
or,
and extracting two target views meeting the parallax constraint condition from the view set according to a view sorting rule and the human eye space coordinates.
In this embodiment, optionally, the target view display unit 430 includes:
the human eye space coordinate obtaining subunit is used for obtaining an image of a viewer including human eyes of the viewer by using the camera and determining the human eye space coordinate of the viewer according to the image of the viewer; wherein the human eye spatial coordinates comprise left eye spatial coordinates and right eye spatial coordinates;
or,
and the human eye space coordinate acquisition subunit is used for acquiring the human eye space coordinates of the viewer by using the sensor.
In this embodiment, optionally, the target view display unit 430 further includes:
the display parameter acquisition subunit is used for converting the human eye space coordinates into display parameters of the target view;
and the target view processing subunit is used for processing the sub-pixels in the target view according to the display parameters to obtain a final target view.
In this technical solution, optionally, the apparatus further includes:
the system comprises an SBS stereoscopic image view acquisition unit, a target view acquisition unit and a target view acquisition unit, wherein the SBS stereoscopic image view acquisition unit is used for acquiring two target views in an SBS stereoscopic image; the SBS stereoscopic image is a stereoscopic image with the left side and the right side both being colorful 2D images and being viewed;
and the SBS stereoscopic image view display unit is used for acquiring the eye space coordinates of a viewer and displaying two target views of the stereoscopic image to be displayed according to the eye space coordinates.
The product can execute the method provided by the embodiment of the application, and has the corresponding functional modules and beneficial effects of the execution method.
EXAMPLE III
Embodiments of the present application also provide a medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform a method for displaying stereoscopic images based on eye tracking, the method including:
acquiring a view set formed by at least three views of a stereoscopic image to be displayed;
extracting two target views from the view set according to a preset static extraction rule or a preset dynamic extraction rule;
the method comprises the steps of obtaining eye space coordinates of a viewer, and displaying two target views of a to-be-displayed three-dimensional image according to the eye space coordinates.
Media-any of various types of memory devices or storage devices. The term "media" is intended to include: mounting media such as CD-ROM, floppy disk, or tape devices; computer system memory or random access memory such as DRAM, DDR RAM, SRAM, EDO RAM, Lanbas (Rambus) RAM, etc.; non-volatile memory such as flash memory, magnetic media (e.g., hard disk or optical storage); registers or other similar types of memory elements, etc. The medium may also include other types of memory or combinations thereof. In addition, the medium may be located in the computer system in which the program is executed, or may be located in a different second computer system, which is connected to the computer system through a network (such as the internet). The second computer system may provide the program instructions to the computer for execution. The term "media" may include two or more media that may reside in different locations, such as in different computer systems that are connected by a network. The media may store program instructions (e.g., embodied as computer programs) that are executable by one or more processors.
Of course, the medium provided by the embodiments of the present application includes computer-executable instructions, and the computer-executable instructions are not limited to the operation of displaying stereoscopic images based on human eye tracking as described above, and may also perform related operations in the method of displaying stereoscopic images based on human eye tracking as provided by any embodiments of the present application.
Example four
The embodiment of the application provides a structural schematic diagram of a stereoscopic image display system based on eye tracking, and the system comprises a stereoscopic image output module 510, a target view acquisition module 520 and a 3D display module 530;
the stereoscopic image output module 510 is connected to the target view acquiring module 520, and is configured to acquire a view set formed by at least three views of a stereoscopic image to be displayed, and transmit the view set to the target view acquiring module 520;
the target view module 520 is connected to the 3D display module 530, and configured to extract two target views from the view set according to a preset static extraction rule or a preset dynamic extraction rule; and sends the target view to the 3D display module 530;
the 3D display module 530 is configured to display two target views of the stereoscopic image to be displayed according to the spatial coordinates of the human eyes.
Specifically, the stereoscopic image output module 510 obtains a view set formed by at least three views of the stereoscopic image to be displayed from the database, and the target view module 520 extracts two target views from the view set according to a preset static extraction rule or a preset dynamic extraction rule, and projects the two target views to the viewer through the light splitting device of the 3D display module 530.
In this technical solution, optionally, the system further includes an eye tracking module 540 and an eye position algorithm conversion module 550;
the eye tracking module 540 is connected to the eye position algorithm conversion module 550, and is configured to obtain eye space coordinates;
the human eye position algorithm conversion module 550 is connected to the 3D display module 530, and is configured to convert the human eye space coordinate into a display parameter of the target view;
the 3D display module 530 is configured to process the sub-pixels in the target view according to the display parameters to obtain a final target view, obtain eye space coordinates of a viewer, and display two target views of the stereoscopic image to be displayed according to the eye space coordinates.
In this embodiment, the eye tracking module 540 is configured to obtain the width of the human eye and the face or the spatial coordinates of the human eye. The human eye position algorithm conversion module 550 is configured to convert a human eye face width or a human eye spatial coordinate into a specific optical 3D display parameter in the 3D display screen, and the 3D display module 530 is configured to process sub-pixels in the target view according to the display parameter to obtain a final target view, and display two target views of the to-be-displayed stereoscopic image according to the human eye spatial coordinate.
The extracted view is adjusted according to the space coordinates of the human eyes, so that a viewer does not need to look for a viewing angle or keep the viewing angle, and the experience of the viewer is improved.
According to the technical scheme provided by the embodiment of the application, the stereoscopic image output module is connected with the target view acquisition module and used for acquiring a view set formed by at least three views of the stereoscopic image to be displayed and transmitting the view set to the target view acquisition module; the target view module is connected with the 3D display module and used for extracting two target views from the view set according to a preset static extraction rule or a preset dynamic extraction rule; sending the target view to a 3D display module; and the 3D display module is used for displaying the two target views of the to-be-displayed three-dimensional image according to the space coordinates of the human eyes. By executing the technical scheme, the display of the stereoscopic image based on the human eye tracking multi-view can be realized by extracting two target views in the multi-view stereoscopic image. The 3D display effect is good, the visual area is large, the viewer does not need to look for the viewing angle or keep the viewing angle, and the experience of the viewer is improved.
The device, medium, and system for displaying stereoscopic images based on eye tracking provided in the above embodiments may perform the method for displaying stereoscopic images based on eye tracking provided in any of the embodiments of the present application, and have corresponding functional modules and advantageous effects for performing the method. For details of the stereoscopic image display method based on eye tracking, reference may be made to any embodiments of the present disclosure.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present application and the technical principles employed. It will be understood by those skilled in the art that the present application is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the application. Therefore, although the present application has been described in more detail with reference to the above embodiments, the present application is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present application, and the scope of the present application is determined by the scope of the appended claims.
Claims (11)
1. A stereoscopic image display method based on eye tracking is characterized by comprising the following steps:
acquiring a view set formed by at least three views of a stereoscopic image to be displayed;
extracting two target views from the view set according to a preset static extraction rule or a preset dynamic extraction rule;
the method comprises the steps of obtaining eye space coordinates of a viewer, and displaying two target views of a to-be-displayed three-dimensional image according to the eye space coordinates.
2. The method according to claim 1, wherein the stereoscopic images to be presented comprise stereoscopic images in a 2D + depth map format and stereoscopic images in at least two parallax view formats.
3. The method according to claim 2, wherein if the stereoscopic image to be displayed is a stereoscopic image in a 2D + depth map format:
extracting two target views from the view set according to a preset static extraction rule or a preset dynamic extraction rule, wherein the method comprises the following steps:
extracting two target views with fixed sequence numbers from the view set according to the view arrangement sequence;
or,
and extracting two target views meeting the parallax constraint condition from the view set according to the view arrangement sequence and the human eye space coordinates.
4. The method according to claim 2, wherein if the stereoscopic image to be displayed is a stereoscopic image in at least two parallax view formats:
extracting two target views from the view set according to a preset static extraction rule or a preset dynamic extraction rule, wherein the method comprises the following steps:
extracting two target views with fixed sequence numbers from the view set according to a view sorting rule;
or,
and extracting two target views meeting the parallax constraint condition from the view set according to a view sorting rule and the human eye space coordinates.
5. The method of claim 1, wherein obtaining eye space coordinates of the viewer comprises:
acquiring a viewer image including the eyes of a viewer by using a camera, and determining the eye space coordinates of the viewer according to the viewer image; wherein the human eye spatial coordinates comprise left eye spatial coordinates and right eye spatial coordinates;
or,
the spatial coordinates of the viewer's eyes are acquired using a sensor.
6. The method of claim 1, wherein after obtaining the spatial coordinates of the viewer's eye, the method comprises:
converting the eye space coordinates into display parameters of the target view;
and processing the sub-pixels in the target view according to the display parameters to obtain a final target view.
7. The method of claim 1, further comprising:
acquiring two target views in an SBS (styrene-butadiene-styrene) stereoscopic image; the SBS stereoscopic image is a stereoscopic image with the left side and the right side being colorful 2D images and is viewed;
the method comprises the steps of obtaining eye space coordinates of a viewer, and displaying two target views of a to-be-displayed three-dimensional image according to the eye space coordinates.
8. A stereoscopic image display device based on eye tracking, comprising:
the device comprises a view set acquisition unit, a view display unit and a display unit, wherein the view set acquisition unit is used for acquiring a view set formed by at least three views of a stereoscopic image to be displayed;
the target view extraction unit is used for extracting two target views from the view set according to a preset static extraction rule or a preset dynamic extraction rule;
and the target view display unit is used for acquiring the eye space coordinates of the viewer and displaying two target views of the three-dimensional image to be displayed according to the eye space coordinates.
9. A computer-readable medium, on which a computer program is stored, wherein the program, when executed by a processor, implements the method for displaying stereoscopic images based on eye-tracking according to any one of claims 1 to 7.
10. A stereoscopic image display system based on human eye tracking is characterized by comprising a stereoscopic image output module, a target view acquisition module and a 3D display module;
the stereoscopic image output module is connected with the target view acquisition module, and is used for acquiring a view set formed by at least three views of a stereoscopic image to be displayed and transmitting the view set to the target view acquisition module;
the target view module is connected with the 3D display module and used for extracting two target views from the view set according to a preset static extraction rule or a preset dynamic extraction rule; sending the target view to the 3D display module;
and the 3D display module is used for displaying two target views of the to-be-displayed three-dimensional image according to the space coordinates of the human eyes.
11. The system of claim 10, further comprising an eye tracking module and an eye position algorithm conversion module;
the human eye tracking module is connected with the human eye position algorithm conversion module and used for acquiring a human eye space coordinate;
the human eye position algorithm conversion module is connected with the 3D display module and used for converting the human eye space coordinate into the display parameter of the target view;
and the 3D display module is used for processing the sub-pixels in the target view according to the display parameters to obtain a final target view, acquiring the eye space coordinates of a viewer, and displaying two target views of the stereoscopic image to be displayed according to the eye space coordinates.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110517607.7A CN113259650A (en) | 2021-05-12 | 2021-05-12 | Stereoscopic image display method, device, medium and system based on eye tracking |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110517607.7A CN113259650A (en) | 2021-05-12 | 2021-05-12 | Stereoscopic image display method, device, medium and system based on eye tracking |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113259650A true CN113259650A (en) | 2021-08-13 |
Family
ID=77223180
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110517607.7A Withdrawn CN113259650A (en) | 2021-05-12 | 2021-05-12 | Stereoscopic image display method, device, medium and system based on eye tracking |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113259650A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113689551A (en) * | 2021-08-20 | 2021-11-23 | 纵深视觉科技(南京)有限责任公司 | Three-dimensional content display method, device, medium and electronic equipment |
| CN114020150A (en) * | 2021-10-27 | 2022-02-08 | 纵深视觉科技(南京)有限责任公司 | Image display method, image display device, electronic apparatus, and medium |
-
2021
- 2021-05-12 CN CN202110517607.7A patent/CN113259650A/en not_active Withdrawn
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113689551A (en) * | 2021-08-20 | 2021-11-23 | 纵深视觉科技(南京)有限责任公司 | Three-dimensional content display method, device, medium and electronic equipment |
| CN114020150A (en) * | 2021-10-27 | 2022-02-08 | 纵深视觉科技(南京)有限责任公司 | Image display method, image display device, electronic apparatus, and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109615703B (en) | Augmented reality image display method, device and equipment | |
| US6205241B1 (en) | Compression of stereoscopic images | |
| CN101783967B (en) | Signal processing device, image display device, signal processing method, and computer program | |
| JP5036132B2 (en) | Critical alignment of parallax images for autostereoscopic display | |
| US20120242795A1 (en) | Digital 3d camera using periodic illumination | |
| EP3350989B1 (en) | 3d display apparatus and control method thereof | |
| CN104883556A (en) | Three dimensional display method based on augmented reality and augmented reality glasses | |
| US20140055580A1 (en) | Depth Of Field Maintaining Apparatus, 3D Display System And Display Method | |
| CN103136744A (en) | Apparatus and method for calculating three dimensional (3D) positions of feature points | |
| CN101729920A (en) | Method for displaying stereoscopic video with free visual angles | |
| EP2787735A1 (en) | Image processing device, image processing method and program | |
| CN107249128B (en) | Camera correction method and device | |
| KR100668073B1 (en) | Method for calibrating distortion of multi-view image | |
| CN113259650A (en) | Stereoscopic image display method, device, medium and system based on eye tracking | |
| EP3779892A1 (en) | Light-field image generation system, image display system, shape information acquisition server, image generation server, display device, light-field image generation method and image display method | |
| JPH07296185A (en) | Three-dimensional image display device | |
| CN113253845A (en) | View display method, device, medium and electronic equipment based on eye tracking | |
| JPWO2012117706A1 (en) | Video processing apparatus, video processing method, and program | |
| CN108282650B (en) | Naked eye three-dimensional display method, device and system and storage medium | |
| US20170257614A1 (en) | Three-dimensional auto-focusing display method and system thereof | |
| CN107659772B (en) | 3D image generation method and device and electronic equipment | |
| CN112085777A (en) | Six-degree-of-freedom VR glasses | |
| CN110087059B (en) | Interactive auto-stereoscopic display method for real three-dimensional scene | |
| CN107103620B (en) | Depth extraction method of multi-optical coding camera based on spatial sampling under independent camera view angle | |
| JP6168597B2 (en) | Information terminal equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20210813 |