CN114020150A - Image display method, image display device, electronic apparatus, and medium - Google Patents
Image display method, image display device, electronic apparatus, and medium Download PDFInfo
- Publication number
- CN114020150A CN114020150A CN202111256026.9A CN202111256026A CN114020150A CN 114020150 A CN114020150 A CN 114020150A CN 202111256026 A CN202111256026 A CN 202111256026A CN 114020150 A CN114020150 A CN 114020150A
- Authority
- CN
- China
- Prior art keywords
- display screen
- display
- image
- target object
- stereoscopic image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 55
- 238000006243 chemical reaction Methods 0.000 claims description 7
- 230000002194 synthesizing effect Effects 0.000 claims description 5
- 238000004590 computer program Methods 0.000 claims description 4
- 230000000694 effects Effects 0.000 abstract description 4
- 238000010586 diagram Methods 0.000 description 10
- 230000003287 optical effect Effects 0.000 description 8
- 230000006870 function Effects 0.000 description 5
- 239000011159 matrix material Substances 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
- G02B30/20—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
- G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10004—Still image; Photographic image
- G06T2207/10012—Stereo images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Optics & Photonics (AREA)
- Controls And Circuits For Display Device (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
The embodiment of the application discloses an image display method, an image display device, electronic equipment and a medium. The method comprises the following steps: acquiring a stereoscopic image of a target object in front of a display screen acquired by a stereoscopic image sensor, and transmitting the stereoscopic image to target equipment so that the target equipment performs image display according to the stereoscopic image; determining coordinate information of two eyes of the target object relative to the display screen according to the three-dimensional image; and determining the distribution display parameters of the display screen according to the coordinate information, and controlling the display screen to display the image to be displayed according to the distribution display parameters. The technical scheme solves the limitation that the display of the 3D stereoscopic image needs to be completed through two sets of equipment, namely the stereoscopic image sensor and the human eye tracker, the position of the human eye relative to the display screen can be obtained only according to the calibration parameters of the stereoscopic image sensor and the shot stereoscopic image, the display screen is controlled to perform stereoscopic display to obtain the display effect of the 3D stereoscopic image, and the technical scheme is simple to operate and reduces the cost.
Description
Technical Field
The embodiment of the application relates to the technical field of naked eye 3D display, in particular to an image display method, an image display device, electronic equipment and a medium.
Background
With the increasing popularization of naked eye 3D display devices, most people begin to use the naked eye 3D display devices to perform remote video, and 3D stereoscopic pictures of video objects can be seen through the naked eye 3D display devices.
It is common in the prior art to equip a naked-eye 3D display device with two cameras and a set of eye tracking devices. The two cameras are used for shooting left and right views of a collected object in real time and transmitting the left and right views to both video parties, and the human eye tracking equipment is used for capturing the positions of human eyes in real time so that the display equipment can transmit the left and right views transmitted by the other party to the left and right eyes respectively according to the positions of the human eyes, and therefore a 3D picture is generated. However, the above 3D stereoscopic image display method has a complicated process, and the installation of two cameras and one set of eye tracking equipment in the naked-eye 3D display equipment may result in high cost.
Disclosure of Invention
The embodiment of the application provides an image display method, an image display device, electronic equipment and a medium, and the 3D image display function can be provided for a remote video person through a set of shooting system.
In a first aspect, an embodiment of the present application provides an image display method, where the method includes:
acquiring a stereoscopic image of a target object in front of a display screen, which is acquired by a stereoscopic image sensor, and transmitting the stereoscopic image to target equipment so that the target equipment performs image display according to the stereoscopic image;
determining coordinate information of two eyes of the target object relative to the display screen according to the three-dimensional image;
and determining the distribution display parameters of the display screen according to the coordinate information, and controlling the display screen to display the image to be displayed according to the distribution display parameters.
In a second aspect, an embodiment of the present application provides an image display apparatus, including:
the system comprises a three-dimensional image acquisition module, a display screen display module and a display screen display module, wherein the three-dimensional image acquisition module is used for acquiring a three-dimensional image of a target object in front of the display screen, which is acquired by a three-dimensional image sensor, and transmitting the three-dimensional image to target equipment so that the target equipment can display images according to the three-dimensional image;
the coordinate information acquisition module is used for determining the coordinate information of the two eyes of the target object relative to the display screen according to the three-dimensional image;
and the image display control module is used for determining the distribution display parameters of the display screen according to the coordinate information and controlling the display screen to display the image to be displayed according to the distribution display parameters.
In a third aspect, an embodiment of the present application provides an electronic device, including one or more processors; a memory for storing one or more programs; the one or more processors, when executing the one or more programs, implement the image display method as described in embodiments of the present application.
In a fourth aspect, the present application provides a computer-readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, implements an image display method according to the present application.
The embodiment of the application discloses an image display method, an image display device, electronic equipment and a medium. The method comprises the following steps: acquiring a stereoscopic image of a target object in front of a display screen, which is acquired by a stereoscopic image sensor, and transmitting the stereoscopic image to target equipment so that the target equipment performs image display according to the stereoscopic image; determining coordinate information of two eyes of the target object relative to the display screen according to the three-dimensional image; and determining the distribution display parameters of the display screen according to the coordinate information, and controlling the display screen to display the image to be displayed according to the distribution display parameters. The technical scheme solves the problem that in the prior art, the display of the 3D stereoscopic image needs to be completed through two sets of equipment, namely the stereoscopic image sensor and the human eye tracking equipment, the relative position of the human eye can be obtained only according to the calibration parameters of the stereoscopic image sensor and the stereoscopic image shot by the stereoscopic image sensor, and the display effect of the 3D stereoscopic picture can be obtained by displaying the left view and the right view according to the relative position of the human eye.
Drawings
FIG. 1 is a flow chart of an image display method provided by an embodiment of the present application;
FIG. 2 is a schematic diagram of remote video communication provided by an embodiment of the present application;
FIG. 3 is a flow chart of an image display method according to another embodiment of the present application;
FIG. 4 is a schematic diagram of an image display process provided in another embodiment of the present application;
FIG. 5 is a schematic view of another image display process provided in another embodiment of the present application;
FIG. 6 is a block diagram of an image display device according to an embodiment of the present application;
fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The present application will be described in detail with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting of the application. It should be further noted that, for the convenience of description, only some of the structures related to the present application are shown in the drawings, not all of the structures.
Fig. 1 is a flowchart of an image display method according to an embodiment of the present application, where the embodiment is applicable to a scene of a remote video using a naked-eye 3D display device. The method can be executed by the image display device provided by the embodiment of the application, the device can be realized by software and/or hardware and is integrated in an electronic device, and the electronic device can be a naked eye 3D display device.
As shown in fig. 1, the image display method provided in the embodiment of the present application may include the following steps:
s110, acquiring a stereoscopic image of a target object in front of a display screen, acquired by a stereoscopic image sensor, and transmitting the stereoscopic image to target equipment so that the target equipment displays an image according to the stereoscopic image.
The display screen can be a display screen of a naked eye 3D display device, and the naked eye 3D display device is a display device which can obtain a vivid three-dimensional image with space and depth by utilizing the characteristic that two eyes of a person have parallax without any auxiliary device (such as 3D glasses, helmets and the like).
In the embodiment of the application, the stereoscopic image sensor is a binocular image sensor, or a combination of the image sensor and a depth information sensor. When the stereoscopic image sensor is a binocular image sensor, the binocular image sensor can simulate the left eye and the right eye of a human to acquire left and right views of a target object, the left view is an image acquired by the angle of the left ocular lens to the target object, and the right view is an image acquired by the right ocular lens to the target object. When the stereo image sensor is a combination of an image sensor and a depth information sensor, the image sensor may be a common camera, and the depth information sensor may be a laser ranging sensor, an ultrasonic ranging sensor, or the like. The stereoscopic image sensor may be externally connected with the naked eye 3D display device, or may be integrated in the naked eye 3D display device.
The target object may be an object that is being remotely video through a naked eye 3D display device. In an embodiment of the present application, the stereoscopic image of the target object includes: a pair of images of the target object having binocular disparity, or a combination of the image of the target object and depth information. The depth information acquisition method mainly includes TOF (Time of Flight), structured light, laser scanning and the like, and is acquired by a depth information sensor. In the embodiment of the present application, the format of the transmitted image is not limited to the format of the image acquired by the stereoscopic image sensor, and the image acquired by the binocular image sensor and having binocular parallax may be transmitted in a form of combining the image converted into the target image with the depth information, or in a form of combining the image of the target image acquired by the combination of the image sensor and the depth information sensor into a form of combining the image with the depth information, having binocular difference, and transmitted.
The target device is a device for receiving and displaying a stereoscopic image, and the target device may be a naked-eye 3D display device. Fig. 2 is a schematic diagram of remote video communication provided by an embodiment of the present application. As shown in fig. 2, two persons at different places perform remote video through naked-eye 3D display devices. The device B receives and displays the stereoscopic image, and the device B is a target device of the device A; meanwhile, a stereoscopic image sensor of the device B acquires a stereoscopic image of a target object in front of the display screen and transmits the stereoscopic image to the device A through the network, the device A receives and displays the stereoscopic image, and the device A is a target device of the device B.
In this application embodiment, acquire the stereoscopic image of the display screen front target object that stereoscopic image sensor gathered to transmit to target device stereoscopic image, so that target device carries out image display according to stereoscopic image, still include:
and if the stereoscopic images are the image pairs with binocular parallax, synthesizing the stereoscopic images according to a left-right format, and transmitting the synthesized images to the target equipment so that the target equipment displays images according to the synthesized images.
The synthesizing of the stereoscopic image in the left-right format means synthesizing a 3D image from two left and right views in the 2D format.
And S120, determining coordinate information of the two eyes of the target object relative to the display screen according to the three-dimensional image.
Specifically, after a stereoscopic image including left and right views is acquired, spatial coordinates of both eyes of the target object in the left and right views relative to the stereoscopic image sensor are calculated from the stereoscopic image by using parameters calibrated by the stereoscopic image sensor. The spatial coordinate system of the spatial coordinates may be established by using the left eyepiece or the right eyepiece of the stereoscopic image sensor as a coordinate origin, or may be established by using any point between the connecting lines of the left eyepiece and the right eyepiece as the coordinate origin, that is, the spatial coordinates of the two eyes of the target object relative to the stereoscopic image sensor represent the position information of the two eyes of the target object relative to the stereoscopic image sensor.
Further, the relative position of the stereo image sensor and the display screen is calculated, and the space coordinates of the two eyes of the target object relative to the stereo image sensor are converted into the space coordinates of the two eyes of the target object relative to the display screen. The spatial coordinate system in which the spatial coordinates of the two eyes of the target object relative to the display screen are located may be established by using any point in the display screen as a coordinate origin, that is, the spatial coordinates of the two eyes of the target object relative to the display screen represent position information of the two eyes of the target object relative to the display screen.
S130, determining the distribution display parameters of the display screen according to the coordinate information, and controlling the display screen to display the image to be displayed according to the distribution display parameters.
The image to be displayed refers to a stereoscopic image of a target object in front of a display screen, which is acquired by a stereoscopic image sensor. The distributed display parameters of the display screen are used for determining the arrangement sequence of each pixel in the image to be displayed in the display screen. The naked eye 3D display equipment controls the display screen to display the image to be displayed according to the distribution display parameters of the display screen, so that the left eye of a person in front of the display screen can see the left view in the image to be displayed, the right eye can see the right view in the image to be displayed, and a 3D picture is presented further according to the visual angle difference of the left view and the right view.
It is noted that steps S110-S130 are performed simultaneously on two remote video devices. As shown in fig. 2, two persons at different places take remote videos through a device a and a device B, respectively. The device a will simultaneously perform the following steps: 1. acquiring a three-dimensional image of a target object in front of a display screen, which is acquired by a three-dimensional image sensor, determining coordinate information of two eyes of the target object relative to the display screen according to the three-dimensional image, and determining distribution display parameters of the display screen according to the coordinate information; 2. transmitting the stereoscopic image to the device B; 3. and receiving the stereoscopic image from the equipment B, and displaying the stereoscopic image transmitted by the equipment B according to the distribution display parameters of the display screen. Similarly, the device B will also perform the following steps simultaneously: 1. acquiring a three-dimensional image of a target object in front of a display screen, which is acquired by a three-dimensional image sensor, determining coordinate information of two eyes of the target object relative to the display screen according to the three-dimensional image, and determining distribution display parameters of the display screen according to the coordinate information; 2. transmitting the stereoscopic image to the equipment A; 3. and receiving the stereoscopic image from the equipment A, and displaying the stereoscopic image transmitted by the equipment A according to the distribution display parameters of the display screen.
The embodiment of the application realizes the function of providing 3D stereoscopic pictures for people with remote videos through one set of shooting system by the following method: acquiring a stereoscopic image of a target object in front of a display screen, which is acquired by a stereoscopic image sensor, and transmitting the stereoscopic image to target equipment so that the target equipment performs image display according to the stereoscopic image; determining coordinate information of two eyes of the target object relative to the display screen according to the three-dimensional image; and determining the distribution display parameters of the display screen according to the coordinate information, and controlling the display screen to display the image to be displayed according to the distribution display parameters. The technical scheme solves the problem that in the prior art, the display of the 3D stereoscopic image needs to be completed through two sets of equipment, namely the stereoscopic image sensor and the human eye tracking equipment, the relative position of the human eye can be obtained only according to the calibration parameters of the stereoscopic image sensor and the stereoscopic image shot by the stereoscopic image sensor, and then the left view and the right view are displayed according to the relative position of the human eye so as to present the effect of the 3D stereoscopic picture.
Fig. 3 is a flowchart of an image display method according to another embodiment of the present application, which is optimized based on the above embodiments. The concrete optimization is as follows: according to the stereoscopic image, determining coordinate information of the two eyes of the target object relative to the display screen, wherein the coordinate information comprises the following steps: determining first coordinate information of two eyes of a target object in a three-dimensional image sensor coordinate system according to a binocular camera calibration algorithm; and determining second coordinate information of the two eyes of the target object in a display screen coordinate system according to the first coordinate information and the position relation between the stereoscopic image sensor and the display screen.
As shown in fig. 3, the image display method provided in the embodiment of the present application may include the following steps:
s210, acquiring a stereoscopic image of a target object in front of a display screen, acquired by a stereoscopic image sensor, and transmitting the stereoscopic image to target equipment so that the target equipment displays an image according to the stereoscopic image.
S220, determining first coordinate information of two eyes of the target object in a stereoscopic image sensor coordinate system according to a binocular camera calibration algorithm.
The coordinate system of the stereoscopic image sensor can be established by taking a left eyepiece or a right eyepiece in the stereoscopic image sensor as a coordinate origin, or can be established by taking any point between connecting lines of the left eyepiece and the right eyepiece as the coordinate origin, or can be established by taking the center of the stereoscopic image sensor as the coordinate origin. The first coordinate information represents position information of both eyes of the target object with respect to the stereoscopic image sensor.
And S230, determining second coordinate information of the two eyes of the target object in a display screen coordinate system according to the first coordinate information and the position relation between the stereoscopic image sensor and the display screen.
The position relationship between the stereoscopic image sensor and the display screen can be obtained by using a coordinate system established by taking any point in the display screen as a coordinate origin and a coordinate system of the stereoscopic image sensor.
The display screen coordinate system can be established by taking any point in the display screen as a coordinate origin. The second coordinate information represents position information of both eyes of the target object with respect to the display screen.
In an embodiment of the present application, determining second coordinate information of two eyes of a target object in a display screen coordinate system according to the first coordinate information and a position relationship between a stereoscopic image sensor and the display screen includes:
determining a conversion relation between a three-dimensional image sensor coordinate system and a display screen coordinate system according to the position relation between the three-dimensional image sensor and the display screen;
and determining second coordinate information of the two eyes of the target object in a display screen coordinate system according to the conversion relation and the first coordinate information of the two eyes of the target object in the stereo image sensor coordinate system.
In the embodiment of the present application, the conversion relationship between the coordinate system of the stereoscopic image sensor and the coordinate system of the display screen may be expressed by the following formula.
Wherein R represents a stereoscopic image sensor anda positional relationship matrix of the display screen,
a first coordinate information matrix of the two eyes representing the target object in the coordinate system of the stereo image sensor,
and a second coordinate information matrix of the two eyes representing the target object in the display screen coordinate system.
S240, determining the distribution display parameters of the display screen according to the coordinate information, and controlling the display screen to display the image to be displayed according to the distribution display parameters.
In the embodiment of the present application, the coordinate system of the stereo image sensor is a coordinate system using any camera in the stereo image sensor as an origin, or a coordinate system using a midpoint of the stereo image sensor as an origin; the display screen coordinate system is a coordinate system taking the middle point of the display screen as an origin.
In an embodiment of the present application, the method further includes:
and if any image in the stereoscopic image comprises at least two candidate objects, determining the target object according to the coordinate information of the two eyes of the at least two candidate objects relative to the display screen.
The target object is determined according to coordinate information of two eyes of at least two candidate objects relative to the display screen, the candidate object with the two eyes closest to the display screen can be used as the target object, and the candidate object with the smallest distance value between the horizontal direction coordinate or the vertical direction coordinate in the coordinate information and the origin of the coordinate system of the display screen can also be used as the target object.
In this embodiment of the present application, if any one of the images in the stereoscopic image includes at least two candidate objects, the method for displaying the stereoscopic image according to the coordinate information of the two eyes of the at least two candidate objects relative to the display screen includes:
taking a candidate object corresponding to the two eyes with the minimum distance value of the display screen as a target object; alternatively, the first and second electrodes may be,
and taking the candidate object with the minimum distance value between the horizontal direction coordinate and the origin of the display screen coordinate system in the coordinate information as the target object.
The selection conditions for determining the target object may be prioritized and determined according to the priority. For example, if the priority of the minimum distance value to the display screen is greater than the priority of the minimum distance value between the horizontal coordinate and the origin of the display screen coordinate system in the coordinate information, when any image of the image pair includes at least two candidate objects, the distance values between the two eyes of the at least two candidate objects and the display screen are firstly judged, the candidate object corresponding to the two eyes with the minimum distance value to the display screen is taken as the target object, if the distance values between the two eyes of the at least two candidate objects and the display screen are the same, the horizontal coordinates of the two eyes of the at least two candidate objects and the origin of the display screen coordinate system are continuously judged, and the candidate object with the minimum distance value between the horizontal coordinates of the two eyes in the coordinate information and the origin of the display screen coordinate system is taken as the target object.
The embodiment of the application determines the coordinate information of the human eyes relative to the display screen by the following method: according to the stereoscopic image, determining coordinate information of the two eyes of the target object relative to the display screen, wherein the coordinate information comprises the following steps: determining first coordinate information of two eyes of a target object in a three-dimensional image sensor coordinate system according to a binocular camera calibration algorithm; and determining second coordinate information of the two eyes of the target object in a display screen coordinate system according to the first coordinate information and the position relation between the stereoscopic image sensor and the display screen. According to the technical scheme of the embodiment of the application, the image acquisition and the tracking of human eyes are completed only through the stereoscopic image sensor, a simple and effective method is provided for the naked eye 3D equipment to provide a 3D stereoscopic display picture with higher quality for a user, and the cost is lower.
Fig. 4 is a schematic diagram of an image display process according to another embodiment of the present application. Fig. 5 is a schematic diagram of another image display process according to another embodiment of the present application. Fig. 4 and 5 include the whole process of image capturing and image displaying of both remote videos, where the video area shown in fig. 4 is area a and the video area shown in fig. 5 is area B. The process comprises the following steps:
the area A host acquires left and right views of the area A user in real time through a local binocular camera.
The host computer of the area A synthesizes the left view and the right view of the local user according to the left format and the right format, and transmits the synthesized image to the host computer of the area B in real time in a streaming media mode through a network.
The host in area A acquires the image synthesized by the left view and the right view of the user in area B through the network.
And the host in the area A locally calculates the space coordinates of the two eyes of the user relative to the binocular camera according to the left view, the right view and the calibration parameters of the binocular camera. And calculating the space coordinates of the two eyes of the user relative to the display screen according to the position relation between the binocular camera and the display screen. And determining optical writing parameters of the 3D display screen according to the control coordinates of the display screen by the two eyes, and further calculating parameters for controlling the 3D display screen to display according to the optical parameters of the 3D display screen. And the host computer of the area A displays the left view and the right view of the user of the area B to a local screen of the area A according to the control display parameters.
The host computers of the area A and the area B perform the same process.
The embodiment of the present application has the same advantageous effects as any of the embodiments described above.
Fig. 6 is a block diagram of an image display device according to an embodiment of the present application, where the image display device is capable of executing an image display method according to any embodiment of the present application, and has functional modules and beneficial effects corresponding to the execution method. As shown in fig. 6, the apparatus may include:
the stereoscopic image obtaining module 310 is configured to obtain a stereoscopic image of a target object in front of a display screen, which is collected by a stereoscopic image sensor, and transmit the stereoscopic image to a target device, so that the target device performs image display according to the stereoscopic image.
And a coordinate information obtaining module 320, configured to determine, according to the stereoscopic image, coordinate information of two eyes of the target object relative to the display screen.
And the image display control module 330 is configured to determine a distribution display parameter of the display screen according to the coordinate information, and control the display screen to display an image to be displayed according to the distribution display parameter.
In this embodiment of the application, the coordinate information obtaining module 320 includes:
and the first coordinate information acquisition unit is used for determining first coordinate information of the two eyes of the target object in the coordinate system of the stereoscopic image sensor according to a binocular camera calibration algorithm.
And the second coordinate information acquisition unit is used for determining second coordinate information of the two eyes of the target object in a display screen coordinate system according to the first coordinate information and the position relation between the stereoscopic image sensor and the display screen.
In the embodiment of the present application, the stereoscopic image sensor is a binocular image sensor, or a combination of an image sensor and a depth information sensor.
In an embodiment of the present application, the stereoscopic image of the target object includes: a pair of images of the target object having binocular disparity, or a combination of the image of the target object and depth information.
In an embodiment of the present application, the second coordinate information obtaining unit is specifically configured to:
determining a conversion relation between a three-dimensional image sensor coordinate system and a display screen coordinate system according to the position relation between the three-dimensional image sensor and the display screen;
and determining second coordinate information of the two eyes of the target object in a display screen coordinate system according to the conversion relation and the first coordinate information of the two eyes of the target object in the stereo image sensor coordinate system.
In the embodiment of the present application, the coordinate system of the stereoscopic image sensor is a coordinate system using any camera in the stereoscopic image sensor as an origin, or a coordinate system using a midpoint of the stereoscopic image sensor as an origin; the display screen coordinate system is a coordinate system taking the middle point of the display screen as an origin.
In an embodiment of the present application, the apparatus further includes:
and the image synthesis module is used for synthesizing the stereoscopic images according to a left-right format and transmitting the synthesized images to the target equipment if the stereoscopic images are the image pairs with binocular parallax so as to enable the target equipment to display the images according to the synthesized images.
In an embodiment of the present application, the apparatus further includes:
and the target object determining module is used for determining the target object according to the coordinate information of the two eyes of the at least two candidate objects relative to the display screen if any image in the stereoscopic image comprises the at least two candidate objects.
In an embodiment of the present application, the target object determining module is specifically configured to:
taking a candidate object corresponding to the two eyes with the minimum distance value of the display screen as a target object; alternatively, the first and second electrodes may be,
and taking the candidate object with the minimum distance value between the horizontal direction coordinate and the origin of the display screen coordinate system in the coordinate information as the target object.
The product can execute the image display method provided by the embodiment of the application, and has the corresponding functional modules and beneficial effects of the execution method.
Fig. 7 is a schematic structural diagram of an electronic device according to an embodiment of the present application. FIG. 7 illustrates a block diagram of an exemplary electronic device 412 suitable for use in implementing embodiments of the present application. The electronic device 412 shown in fig. 7 is only an example and should not bring any limitation to the functions and the scope of use of the embodiments of the present application.
As shown in fig. 7, the electronic device 412 may include: one or more processors 416; the memory 428 is configured to store one or more programs, and when the one or more programs are executed by the one or more processors 416, the one or more processors 416 may enable the one or more processors 416 to implement the image display method provided in the embodiment of the present application, including:
acquiring a stereoscopic image of a target object in front of a display screen, which is acquired by a stereoscopic image sensor, and transmitting the stereoscopic image to target equipment so that the target equipment performs image display according to the stereoscopic image; determining coordinate information of two eyes of the target object relative to the display screen according to the three-dimensional image; and determining the distribution display parameters of the display screen according to the coordinate information, and controlling the display screen to display the image to be displayed according to the distribution display parameters.
The components of the electronic device 412 may include, but are not limited to: one or more processors 416, a memory 428, and a bus 418 that couples the various device components (including the memory 428 and the processors 416).
A program/utility 440 having a set (at least one) of program modules 442 may be stored, for instance, in memory 428, such program modules 442 including, but not limited to, an operating device, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. The program modules 442 generally perform the functions and/or methods of the embodiments described herein.
The electronic device 412 may also communicate with one or more external devices 414 and/or a display 424, etc., and may also communicate with one or more devices that enable a user to interact with the electronic device 412, and/or with any devices (e.g., network cards, modems, etc.) that enable the electronic device 412 to communicate with one or more other computing devices. Such communication may occur via input/output (I/O) interfaces 422. Also, the electronic device 412 may communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the internet) through the network adapter 420. As shown in FIG. 7, network adapter 420 communicates with the other modules of electronic device 412 over bus 418. It should be appreciated that although not shown in FIG. 7, other hardware and/or software modules may be used in conjunction with the electronic device 412, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID devices, tape drives, and data backup storage devices, among others.
The processor 416 executes various functional applications and data processing, such as implementing an image display method provided by an embodiment of the present application, by executing at least one of the other programs stored in the memory 428.
An embodiment of the present application provides a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform an image display method, including:
acquiring a stereoscopic image of a target object in front of a display screen, which is acquired by a stereoscopic image sensor, and transmitting the stereoscopic image to target equipment so that the target equipment performs image display according to the stereoscopic image; determining coordinate information of two eyes of the target object relative to the display screen according to the three-dimensional image; and determining the distribution display parameters of the display screen according to the coordinate information, and controlling the display screen to display the image to be displayed according to the distribution display parameters.
The computer storage media of the embodiments of the present application may take any combination of one or more computer-readable storage media. The computer readable storage medium may be a computer readable signal storage medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor device, apparatus, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In embodiments of the present application, a computer readable storage medium may be any tangible storage medium that can contain, or store a program for use by or in connection with an instruction execution apparatus, device, or apparatus.
A computer readable signal storage medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal storage medium may also be any computer readable storage medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution apparatus, device, or apparatus.
Program code embodied on a computer readable storage medium may be transmitted using any appropriate storage medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present application may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or device. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present application and the technical principles employed. It will be understood by those skilled in the art that the present application is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the application. Therefore, although the present application has been described in more detail with reference to the above embodiments, the present application is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present application, and the scope of the present application is determined by the scope of the appended claims.
Claims (12)
1. An image display method, characterized in that the method comprises:
acquiring a stereoscopic image of a target object in front of a display screen, which is acquired by a stereoscopic image sensor, and transmitting the stereoscopic image to target equipment so that the target equipment performs image display according to the stereoscopic image;
determining coordinate information of two eyes of the target object relative to the display screen according to the three-dimensional image;
and determining the distribution display parameters of the display screen according to the coordinate information, and controlling the display screen to display the image to be displayed according to the distribution display parameters.
2. The method of claim 1, wherein the stereoscopic image sensor is a binocular image sensor, or a combination of an image sensor and a depth information sensor.
3. The method of claim 1, wherein the stereoscopic imagery of the target object is a pair of imagery of the target object having binocular disparity or a combination of imagery of the target object and depth information.
4. The method of claim 1, wherein determining coordinate information of the two eyes of the target object relative to the display screen according to the stereoscopic image comprises:
determining first coordinate information of two eyes of a target object in a three-dimensional image sensor coordinate system according to a binocular camera calibration algorithm;
and determining second coordinate information of the two eyes of the target object in a display screen coordinate system according to the first coordinate information and the position relation between the stereoscopic image sensor and the display screen.
5. The method of claim 4, wherein determining second coordinate information of the two eyes of the target object in the display screen coordinate system according to the first coordinate information and the position relationship between the stereoscopic image sensor and the display screen comprises:
determining a conversion relation between a three-dimensional image sensor coordinate system and a display screen coordinate system according to the position relation between the three-dimensional image sensor and the display screen;
and determining second coordinate information of the two eyes of the target object in a display screen coordinate system according to the conversion relation and the first coordinate information of the two eyes of the target object in the stereo image sensor coordinate system.
6. The method according to claim 4 or 5, wherein the stereo image sensor coordinate system is a coordinate system with any camera in the stereo image sensor as an origin, or a coordinate system with a midpoint of the stereo image sensor as an origin; the display screen coordinate system is a coordinate system taking the middle point of the display screen as an origin.
7. The method of claim 1, wherein transmitting the stereoscopic imagery to a target device for image display by the target device according to the stereoscopic imagery comprises:
and if the stereoscopic images are the image pairs with binocular parallax, synthesizing the stereoscopic images according to a left-right format, and transmitting the synthesized images to the target equipment so that the target equipment displays images according to the synthesized images.
8. The method of claim 1, further comprising:
and if any image in the stereoscopic image comprises at least two candidate objects, determining the target object according to the coordinate information of the two eyes of the at least two candidate objects relative to the display screen.
9. The method according to claim 8, wherein if at least two candidate objects are included in any one of the images of the stereoscopic image, the method further comprises, according to the coordinate information of the two eyes of the at least two candidate objects relative to the display screen:
taking a candidate object corresponding to the two eyes with the minimum distance value of the display screen as a target object; alternatively, the first and second electrodes may be,
and taking the candidate object with the minimum distance value between the horizontal direction coordinate and the origin of the display screen coordinate system in the coordinate information as the target object.
10. An image display apparatus, characterized in that the apparatus comprises:
the system comprises a three-dimensional image acquisition module, a display screen display module and a display screen display module, wherein the three-dimensional image acquisition module is used for acquiring a three-dimensional image of a target object in front of the display screen, which is acquired by a three-dimensional image sensor, and transmitting the three-dimensional image to target equipment so that the target equipment can display images according to the three-dimensional image;
the coordinate information acquisition module is used for determining the coordinate information of the two eyes of the target object relative to the display screen according to the three-dimensional image;
and the image display control module is used for determining the distribution display parameters of the display screen according to the coordinate information and controlling the display screen to display the image to be displayed according to the distribution display parameters.
11. An electronic device, characterized in that the electronic device comprises:
one or more processors;
a memory for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement the image display method of any one of claims 1-9.
12. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out an image display method according to any one of claims 1 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111256026.9A CN114020150A (en) | 2021-10-27 | 2021-10-27 | Image display method, image display device, electronic apparatus, and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111256026.9A CN114020150A (en) | 2021-10-27 | 2021-10-27 | Image display method, image display device, electronic apparatus, and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114020150A true CN114020150A (en) | 2022-02-08 |
Family
ID=80058076
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111256026.9A Pending CN114020150A (en) | 2021-10-27 | 2021-10-27 | Image display method, image display device, electronic apparatus, and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114020150A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115761249A (en) * | 2022-12-28 | 2023-03-07 | 北京曼恒数字技术有限公司 | Image processing method, system, electronic equipment and computer program product |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104539924A (en) * | 2014-12-03 | 2015-04-22 | 深圳市亿思达科技集团有限公司 | Holographic display method and holographic display device based on eye tracking |
| CN108989785A (en) * | 2018-08-22 | 2018-12-11 | 上海玮舟微电子科技有限公司 | Naked eye 3D display method, apparatus, terminal and medium based on tracing of human eye |
| CN112243121A (en) * | 2019-07-18 | 2021-01-19 | 格相科技(北京)有限公司 | Multi-mode display method of naked eye 3D display |
| CN113259650A (en) * | 2021-05-12 | 2021-08-13 | 纵深视觉科技(南京)有限责任公司 | Stereoscopic image display method, device, medium and system based on eye tracking |
| CN113411574A (en) * | 2021-06-17 | 2021-09-17 | 纵深视觉科技(南京)有限责任公司 | Method, device, medium and system for evaluating naked eye 3D display effect |
-
2021
- 2021-10-27 CN CN202111256026.9A patent/CN114020150A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104539924A (en) * | 2014-12-03 | 2015-04-22 | 深圳市亿思达科技集团有限公司 | Holographic display method and holographic display device based on eye tracking |
| CN108989785A (en) * | 2018-08-22 | 2018-12-11 | 上海玮舟微电子科技有限公司 | Naked eye 3D display method, apparatus, terminal and medium based on tracing of human eye |
| CN112243121A (en) * | 2019-07-18 | 2021-01-19 | 格相科技(北京)有限公司 | Multi-mode display method of naked eye 3D display |
| CN113259650A (en) * | 2021-05-12 | 2021-08-13 | 纵深视觉科技(南京)有限责任公司 | Stereoscopic image display method, device, medium and system based on eye tracking |
| CN113411574A (en) * | 2021-06-17 | 2021-09-17 | 纵深视觉科技(南京)有限责任公司 | Method, device, medium and system for evaluating naked eye 3D display effect |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115761249A (en) * | 2022-12-28 | 2023-03-07 | 北京曼恒数字技术有限公司 | Image processing method, system, electronic equipment and computer program product |
| CN115761249B (en) * | 2022-12-28 | 2024-02-23 | 北京曼恒数字技术有限公司 | Image processing method, system, electronic equipment and computer program product |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6759371B2 (en) | Systems and methods for creating 3D prenoptic video images | |
| US10078367B2 (en) | Stabilization plane determination based on gaze location | |
| US11632537B2 (en) | Method and apparatus for obtaining binocular panoramic image, and storage medium | |
| US8581966B2 (en) | Tracking-enhanced three-dimensional display method and system | |
| US10715791B2 (en) | Virtual eyeglass set for viewing actual scene that corrects for different location of lenses than eyes | |
| US6556236B1 (en) | Intelligent method and system for producing and displaying stereoscopically-multiplexed images of three-dimensional objects for use in realistic stereoscopic viewing thereof in interactive virtual reality display environments | |
| CN109743626B (en) | Image display method, image processing method and related equipment | |
| US20160210783A1 (en) | Holographic bird's eye view camera | |
| US10382699B2 (en) | Imaging system and method of producing images for display apparatus | |
| KR101675961B1 (en) | Apparatus and Method for Rendering Subpixel Adaptively | |
| CN106327584B (en) | Image processing method and device for virtual reality equipment | |
| CN108259883B (en) | Image processing method, head-mounted display, and readable storage medium | |
| CN104536579A (en) | Interactive three-dimensional scenery and digital image high-speed fusing processing system and method | |
| WO2008084937A1 (en) | Method and apparatus for generating stereoscopic image from two-dimensional image by using mesh map | |
| WO2021110038A1 (en) | 3d display apparatus and 3d image display method | |
| CN112655202B (en) | Reduced bandwidth stereoscopic distortion correction for fisheye lenses of head-mounted displays | |
| CN103517060A (en) | Method and device for display control of terminal device | |
| CN114020150A (en) | Image display method, image display device, electronic apparatus, and medium | |
| CN109255838B (en) | Method and device for avoiding double image watching of augmented reality display device | |
| US11521297B2 (en) | Method and device for presenting AR information based on video communication technology | |
| CN115202475A (en) | Display method, display device, electronic equipment and computer-readable storage medium | |
| US20230316810A1 (en) | Three-dimensional (3d) facial feature tracking for autostereoscopic telepresence systems | |
| US20230005213A1 (en) | Imaging apparatus, imaging method, and program | |
| US20210208390A1 (en) | Inertial measurement unit signal based image reprojection | |
| JP2020167657A (en) | Image processing apparatus, head-mounted display, and image display method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |