CN112584118A - Immersive virtual reality display method and device based on LED3D screen - Google Patents
Immersive virtual reality display method and device based on LED3D screen Download PDFInfo
- Publication number
- CN112584118A CN112584118A CN202011474750.4A CN202011474750A CN112584118A CN 112584118 A CN112584118 A CN 112584118A CN 202011474750 A CN202011474750 A CN 202011474750A CN 112584118 A CN112584118 A CN 112584118A
- Authority
- CN
- China
- Prior art keywords
- picture
- virtual reality
- immersive virtual
- screen
- reality display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 45
- 239000011521 glass Substances 0.000 claims abstract description 73
- 230000001360 synchronised effect Effects 0.000 claims description 13
- 230000008859 change Effects 0.000 claims description 11
- 238000004590 computer program Methods 0.000 claims description 11
- 238000012545 processing Methods 0.000 claims description 8
- 230000000694 effects Effects 0.000 abstract description 10
- 238000005516 engineering process Methods 0.000 description 12
- 238000009877 rendering Methods 0.000 description 8
- 238000004891 communication Methods 0.000 description 6
- 230000000007 visual effect Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 239000004973 liquid crystal related substance Substances 0.000 description 3
- 230000003993 interaction Effects 0.000 description 2
- 230000007774 longterm Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 206010044565 Tremor Diseases 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 230000001427 coherent effect Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000011664 signaling Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 238000002834 transmittance Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/111—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
- H04N13/117—Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/167—Synchronising or controlling image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/239—Image signal generators using stereoscopic image cameras using two 2D image sensors having a relative position equal to or related to the interocular distance
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/327—Calibration thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/366—Image reproducers using viewer tracking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/385—Image reproducers alternating rapidly the location of the left-right image components on the display screens
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The invention provides an immersive virtual reality display method and device based on an LED3D screen, wherein the method comprises the following steps: acquiring real-time positions of two eyes of a user in an immersive virtual reality display system, wherein the immersive virtual reality display system is constructed based on an LED3D screen; acquiring a first picture and a second picture displayed in the 3D glasses of the user according to the real-time positions of the two eyes; and alternately displaying the first picture and the second picture on the immersive virtual reality display system, acquiring the alternate display switching frequency of the first picture and the second picture, and switching the 3D glasses on and off according to the alternate display switching frequency so as to display the immersive virtual reality. The invention can be suitable for the environment with stronger light, the color saturation of the virtual display space picture is higher, the splicing among the display screens is seamless, the viewing effect is improved, and the service life is longer.
Description
Technical Field
The invention relates to the technical field of computer graphics and virtual reality, in particular to an immersive virtual reality display method and device based on an LED3D screen.
Background
Immersive virtual reality display system is a room type visual collaborative environment based on multi-channel visual scene synchronization technology, three-dimensional space reshaping correction algorithm and stereoscopic display technology, the system can provide a four-face (or five-face/six-face) cube projection display space with the same room size for a plurality of people to participate, all participants are completely immersed in a high-level virtual simulation environment surrounded by a three-dimensional stereoscopic projection picture, and by means of corresponding virtual reality interaction equipment (such as data gloves, force feedback devices, position trackers and the like), an immersive high-resolution three-dimensional audiovisual image and 6-freedom degree interaction feeling are obtained. Since the projection surface can only cover all of the user's field of view, the system can provide the user with an unprecedented immersive and immersive experience.
The immersive virtual reality display system can be applied to any virtual simulation application field with immersive requirements. For example, virtual design and manufacturing, virtual demonstration and collaborative planning, etc. are widely used. In most existing immersive virtual reality display systems, the walls of the virtual display space are usually composed of rear projection walls, and the display of the ground part can be performed by rear projection, and a projector can be arranged above the display space and projected onto the ground. With the development of technology, a technology of replacing projection Display with a Liquid Crystal Display (LCD) 3D tiled screen or a large-sized LCD 3D screen has also appeared.
However, existing immersive virtual reality display systems suffer from the following disadvantages: the immersive virtual reality display system for forming virtual display by the rear projection wall has the advantages that the immersive virtual reality display system can be seen clearly only in a dark environment, the requirement on ambient light is high, the color saturation of a display picture is low, the viewing effect is poor, the service life of a projector is short, and the projector needs to be maintained and replaced frequently; compared with a rear projection wall, the immersive virtual reality display system based on the LCD 3D spliced screen or the large-size LCD screen has the advantages that although the requirements on ambient light are not high, the color saturation is higher, and the brightness and the color attenuation between units are inconsistent and can not be restored after long-term use. Therefore, there is a need for an immersive virtual reality display method and apparatus based on an LED3D screen to solve the above problems.
Disclosure of Invention
Aiming at the problems in the prior art, the invention provides an immersive virtual reality display method and system based on an LED3D screen.
The invention provides an immersive virtual reality display method based on an LED3D screen, which comprises the following steps:
acquiring real-time positions of two eyes of a user in an immersive virtual reality display system, wherein the immersive virtual reality display system is constructed based on an LED3D screen;
acquiring a first picture and a second picture displayed in the 3D glasses of the user according to the real-time positions of the two eyes;
and alternately displaying the first picture and the second picture on the immersive virtual reality display system, acquiring the alternate display switching frequency of the first picture and the second picture, and switching the 3D glasses on and off according to the alternate display switching frequency so as to display the immersive virtual reality.
According to the immersive virtual reality display method based on the LED3D screen, the step of acquiring the real-time positions of the eyes of the user in the immersive virtual reality display system comprises the following steps:
acquiring infrared mark points on 3D glasses of a user through a plurality of infrared cameras arranged in an immersive virtual reality display system, and acquiring mark point real-time position parameters of the infrared mark points;
and acquiring the real-time positions of the eyes of the user according to the real-time position parameters of the mark points.
According to the immersive virtual reality display method based on the LED3D screen provided by the invention, after the first picture and the second picture displayed in the 3D glasses of the user are acquired according to the real-time positions of the two eyes, the method further comprises the following steps:
generating a picture control signal according to the real-time positions of the two eyes;
and calibrating the first picture and the second picture according to the picture control signal, so that the calibrated first picture and the calibrated second picture are alternately displayed on the immersive virtual reality display system.
According to the immersive virtual reality display method based on the LED3D screen provided by the invention, after the first picture and the second picture displayed in the 3D glasses of the user are acquired according to the real-time positions of the two eyes, the method comprises the following steps:
acquiring a first picture and a second picture displayed at the current moment in the 3D glasses of the user according to the real-time positions of the two eyes;
when the positions of the two eyes of the user change, the change parameters of the positions of the two eyes of the user are obtained in real time, and the first picture and the second picture displayed on the immersive virtual reality display system are adjusted according to the change parameters of the positions of the two eyes.
According to the immersive virtual reality display method based on the LED3D screen, the switching of the 3D glasses according to the alternate display switching frequency comprises the following steps:
and generating a synchronous signal according to the alternate display switching frequency, so that the frequency of switching the switch of the 3D glasses and the alternate display switching frequency are kept synchronous according to the synchronous signal.
According to the immersive virtual reality display method based on the LED3D screen, the alternating display switching frequency is at least 120 Hz.
According to the immersive virtual reality display method based on the LED3D screen, the immersive virtual reality display system is composed of a front screen, a left screen, a right screen and a ground screen, wherein the front screen, the left screen, the right screen and the ground screen are composed of a plurality of LED3D screens.
The invention also provides an immersive virtual reality display device based on the LED3D screen, which comprises the following components:
the positioning module is used for acquiring the real-time positions of two eyes of a user in an immersive virtual reality display system, and the immersive virtual reality display system is constructed on the basis of an LED3D screen;
the first processing module is used for acquiring a first picture and a second picture displayed in the 3D glasses of the user according to the real-time positions of the two eyes;
and the second processing module is used for alternately displaying the first picture and the second picture on the immersive virtual reality display system, acquiring the alternate display switching frequency of the first picture and the second picture, and switching the 3D glasses on and off according to the alternate display switching frequency so as to display the immersive virtual reality.
The invention also provides an electronic device, which comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the processor executes the program to realize the steps of the LED3D screen-based immersive virtual reality display method.
The present invention also provides a non-transitory computer readable storage medium having stored thereon a computer program which, when executed by a processor, carries out the steps of the method of immersive virtual reality display based on an LED3D screen as claimed in any one of the above.
According to the immersive virtual reality display method and device based on the LED3D screen, the immersive virtual reality display system is constructed based on the LED3D screen, the immersive virtual reality display system can be suitable for the environment with strong light, the color saturation of the virtual display space picture is higher, the display screens are spliced seamlessly, the viewing effect is improved, and the service life is longer.
Drawings
In order to more clearly illustrate the technical solutions of the present invention or the prior art, the drawings needed for the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
Fig. 1 is a schematic flow chart of an immersive virtual reality display method based on an LED3D screen according to the present invention;
fig. 2 is a schematic structural diagram of an immersive virtual reality display device based on an LED3D screen according to the present invention;
fig. 3 is a schematic structural diagram of an electronic device provided in the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is obvious that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The immersive virtual reality display system can be applied to any virtual simulation application field with immersive demands, and at present, the immersive virtual reality display system is constructed by replacing projection display technology with an LCD 3D splicing screen or a large-size LCD 3D screen. Two common immersive virtual reality display systems in the prior art include:
the immersive virtual reality display system based on the rear projection wall comprises a virtual display space consisting of more than 3 (including 3) hard rear projection walls, displays the whole three-dimensional scene content on the projection wall by using a multichannel visual synchronization technology, places infrared cameras at corners of the virtual display space for positioning two eyes of a user when the user stands in the virtual display space and wears 3D glasses for watching three-dimensional imaging of the video wall, wherein the 3D glasses are attached with infrared mark points. The distance between the position of the infrared mark point on the 3D glasses and the position of the eyes of the user is not large, so that the specification of the whole system is compared and can be ignored, and the system acquires the position parameter of the infrared mark point by using the infrared camera so as to acquire the position parameter of the eyes of the user. The system adjusts the shadow wall image to match the current position watched by the user according to the obtained parameters of the positions of the human eyes of the user (for example, a picture close to the shadow wall is enlarged, and a picture far away from the shadow wall is reduced). And moreover, the frame at the corner is calibrated by combining a frame calibration system, so that the displayed image cannot be distorted.
And secondly, an immersive virtual reality display system based on an LCD 3D spliced screen or a large-size LCD screen. The technical principle is basically consistent with the technical scheme, but the virtual display space is formed by replacing a rear projection wall with an LCD 3D spliced screen or a large-size LCD screen (except a ground screen), and is changed to display a matched rendering channel and a splicing processor.
However, the immersive virtual reality display system for forming virtual display by the rear projection wall needs to be seen clearly in a dark environment, has high requirements on ambient light, has low color saturation of a display picture, has poor viewing effect, and has a short service life of a projector and needs to be maintained and replaced frequently; compared with a rear projection wall, the immersive virtual reality display system based on the LCD 3D spliced screen or the large-size LCD screen has the advantages that although the requirements on ambient light are not high, the color saturation is higher, and long-term use can cause inconsistent brightness and color attenuation among units and can not be restored. In addition, there is the physics piece between the screen of LCD 3D concatenation screen, influences and watches the effect, and there is the transportation problem of stranded in jumbo size LCD screen.
With the improvement of display screen manufacturing technology, Light Emitting Diode (LED) 3D display screens have appeared. The LED3D display screen self-emits light and is not limited by ambient light; the color saturation of the display picture is high, the splicing among the display screens is seamless, and the service life is long. The 3D glasses matched with the LED3D display mainly achieve a 3D effect by improving the fast refresh rate of a picture (at least 120Hz), and belong to an active 3D technology, namely a time division shading technology or a liquid crystal time division technology. When 3D signals are input to a display device (such as a display, a projector, etc.), images are generated alternately in left and right frames in a frame sequence format, the frame signals are transmitted out through an infrared transmitter, a bluetooth, etc. in a wireless manner, the received 3D glasses are in charge of refreshing and synchronously viewing corresponding images by left and right eyes, the same frame number as a 2D video is kept, two eyes of a viewer see different rapidly switched images, illusions (the effect that the camera cannot shoot) are generated in the brain, and stereoscopic images are viewed. According to the invention, the LED3D screen is applied to the immersive virtual reality display system, so that the limitation of display of various terminals in the existing immersive virtual reality display system can be greatly reduced. The immersive virtual reality display system is explained by the composition of four LED3D display screens.
Fig. 1 is a schematic flow diagram of an immersive virtual reality display method based on an LED3D screen provided by the present invention, and as shown in fig. 1, the present invention provides an immersive virtual reality display method based on an LED3D screen, including:
In the invention, after a user is placed in the immersive virtual reality display system, the coordinate positions of the infrared mark points on the 3D glasses worn by the user are collected, and the real-time positions of the two eyes of the user are estimated by utilizing the coordinate positions. In the invention, the immersive virtual reality display system is composed of a front screen, a left screen, a right screen and a ground screen which are composed of a plurality of LED3D screens. In an embodiment, the virtual display space of the immersive virtual reality display system is composed of four LED3D display screens, and the LED3D display screens have the following characteristics: self-luminous and not limited by ambient light; the color saturation of the display picture is high, the splicing among the display screens is seamless, and the service life is long. Furthermore, a plurality of infrared cameras are arranged at each spatial corner of the LED3D display screen; the number of the cameras can be at least 3 to a plurality of cameras, and is determined according to specific requirements. The screen motion capture computer (motion capture computer) obtains the position parameters of the infrared mark points on the 3D glasses through the network switch, and accordingly the position parameters of the two eyes of the user are indirectly obtained. Since two fixed-distance mark points, such as infrared LEDs, are provided on the frame of each 3D glasses. In the image obtained by the infrared camera, the infrared LED is the brightest point in most cases, and the LED position can be separated from the background by taking a proper threshold value. The two infrared mark points are arranged on the 3D glasses, which is equivalent to the two eyes of a user, and then the infrared mark points are tracked by the infrared camera, so that the coordinate positions of the 3D glasses are obtained, and the positions of the two eyes of the user are determined.
And 102, acquiring a first picture and a second picture displayed in the 3D glasses of the user according to the real-time positions of the two eyes.
In the present invention, two sets of pictures correspondingly displayed in the 3D glasses at this time are calculated according to the real-time positions of the two eyes obtained in the above embodiment, wherein the first picture is a picture in the left glasses, and the second picture is a picture in the right glasses. Specifically, the picture displayed on the LED3D screen is composed of two sets of pictures obtained by simulating the left and right eyes of a human by two virtual cameras of the immersive virtual reality display system and shooting existing materials. The infrared camera tracks to obtain the coordinate position of the 3D glasses and sends the coordinate position to the network switch; the moving capture computer obtains the coordinate position through a network switch to obtain the position parameters of the two eyes of the user; then, the position parameter is transmitted to a multi-channel control server through a network switch; the multi-channel control server generates picture control signals according to the received position parameters and respectively sends the picture control signals to the plurality of channel rendering servers; and according to the control of the rendering servers of the multiple channels, continuously and alternately displaying the two groups of calibrated picture images on the LED3D screens respectively.
In the invention, two groups of pictures in the 3D glasses are alternately displayed on the LED3D screen, and meanwhile, the switching frequency of the left lens and the switching frequency of the right lens of the 3D glasses are kept synchronous with the alternate display frequency of the LED3D screen, so that the switching frequency is matched with the alternate display frequency, and a user can experience an immersive stereoscopic vision virtual environment. In the invention, the switching of the left and right lens switches of the 3D glasses specifically comprises the following steps: when a left eye picture appears on the LED3D screen, the left lens of the 3D glasses is opened, and the right lens of the 3D glasses is closed; when a right eye picture appears on the LED3D screen, the right glasses lens of the 3D glasses is opened, and the left glasses lens is closed. And receiving a synchronous signal sent by the multi-channel control server through an Infrared (IR) emitter, emitting an infrared signal according to the synchronous signal, and controlling the switching frequency of the left lens and the right lens of the 3D glasses.
According to the immersive virtual reality display method based on the LED3D screen, the immersive virtual reality display system is constructed based on the LED3D screen, the immersive virtual reality display system can be suitable for the environment with strong light, the color saturation of the picture in the virtual display space is higher, the display screens are spliced seamlessly, the viewing effect is improved, and the service life is longer.
On the basis of the above embodiment, the acquiring the real-time positions of the two eyes of the user in the immersive virtual reality display system includes:
acquiring infrared mark points on 3D glasses of a user through a plurality of infrared cameras arranged in an immersive virtual reality display system, and acquiring mark point real-time position parameters of the infrared mark points;
and acquiring the real-time positions of the eyes of the user according to the real-time position parameters of the mark points.
In the invention, the position of the infrared LED signal of the 3D glasses in the image reflects the horizontal angle of the user relative to the camera and the height of the user, and the distance between the infrared camera and the infrared mark point reflects the distance between the user and the camera. Therefore, equivalent to obtaining the user coordinates in a cylindrical coordinate system with the camera as the origin, the absolute coordinates of the user can be obtained by combining the position coordinates of the camera and performing simple coordinate system transformation. Because the visual angle of a single infrared camera is limited, the task of capturing at a position of 360 degrees cannot be completed, and a plurality of infrared cameras can be arranged for splicing the visual fields; and a ring-shaped camera can be used, so that the task of capturing at 360-degree positions can be realized by one camera, and the principle is the same as that of the infrared camera. Further, the position parameter information of the two eyes of the user is transmitted to a four-channel rendering server (an immersive virtual reality display system formed by four LED3D screens) and a multi-channel control server through a switch by utilizing tracking software in the server.
On the basis of the above embodiment, after acquiring the first picture and the second picture displayed in the 3D glasses of the user according to the real-time positions of the two eyes, the method further includes:
generating a picture control signal according to the real-time positions of the two eyes;
and calibrating the first picture and the second picture according to the picture control signal, so that the calibrated first picture and the calibrated second picture are alternately displayed on the immersive virtual reality display system.
In the invention, the real-time positions of the eyes of a user can be sent to the multi-channel control server, and then the multi-channel control server generates picture control signals of four LED3D screens according to the real-time positions of the eyes; and then, the multi-channel control server respectively sends the picture control signals of the four LED3D screens to the four-channel rendering servers so as to realize that the two groups of calibrated pictures are continuously and alternately displayed on the four LED3D screens.
On the basis of the above embodiment, after the acquiring a first picture and a second picture displayed in the 3D glasses of the user according to the real-time positions of the two eyes, the method includes:
acquiring a first picture and a second picture displayed at the current moment in the 3D glasses of the user according to the real-time positions of the two eyes;
when the positions of the two eyes of the user change, the change parameters of the positions of the two eyes of the user are obtained in real time, and the first picture and the second picture displayed on the immersive virtual reality display system are adjusted according to the change parameters of the positions of the two eyes.
In the invention, the images in the display space are respectively adjusted according to the change of the positions of the two eyes of the user so as to match the current position currently watched by the user (for example, a picture close to the display screen is enlarged, and a picture far away from the display screen is reduced), and the pictures at the corners are calibrated, so that the images in the display space are not distorted.
On the basis of the above embodiment, the switching the 3D glasses according to the alternate display switching frequency includes:
and generating a synchronous signal according to the alternate display switching frequency, so that the frequency of switching the switch of the 3D glasses and the alternate display switching frequency are kept synchronous according to the synchronous signal.
On the basis of the above embodiment, the alternating display switching frequency is at least 120 Hz.
In the invention, each lens of the 3D glasses comprises a liquid crystal layer which can be blackened (the light transmittance is reduced) under the condition of loading a certain voltage; otherwise, it is similar to a normal lens without an additional voltage. Because the 3D image of each frame includes two pictures shot at different angles, the viewer can see the 3D image only when the left picture passes through the left lens (no fixed voltage is loaded on the lens) and the right picture passes through the right lens. Further, the principle of the 3D technology is implemented according to the refreshing time of human eyes to the video frequency, so that by increasing the fast refreshing rate of the picture (generally up to 120Hz), the fast refreshing of 60Hz for each of the left and right eyes will not cause the human to feel the trembling of the image, and keep the same frame number as the 2D video. And the 3D glasses and the screen are accurately synchronized through the IR transmitter. The left eye and the right eye can be played alternately on the display screen, when the left image is played, the left glasses are opened, the right glasses are closed, the left eye of a viewer can only see the image which needs to be seen by the left eye, and the right eye can not see anything; when the right-eye picture is played, the right eye sees the right picture, and the left eye cannot see the picture, so that the left eye and the right eye respectively see the left picture and the right picture, and the 3D effect is achieved. The process is alternated at least to 120 times per second, and the human eyes can enjoy the 3D pictures which are coherent and not twinkling, so the active 3D display technology requires that the refresh rate of the screen reaches at least 120 Hz.
In one embodiment, the immersive virtual reality display method based on the LED3D screen includes the following steps:
and step S1, acquiring the coordinate position of the infrared mark point on the 3D glasses. The invention uses an infrared positioning system consisting of a plurality of cameras, reads the position parameters of the two eyes of the user by shooting the infrared mark points attached to the 3D glasses, and calculates the position parameters of the two cameras (namely the display pictures currently seen by the two eyes of the user) in the virtual environment in the immersive virtual reality display system.
And step S2, estimating the positions of the eyes of the user by using the coordinate positions of the infrared mark points. The moving capture computer obtains position parameters of infrared mark points on the 3D glasses through a network switch by a plurality of infrared cameras (preferably eight infrared cameras which are respectively arranged at corresponding positions of the LED3D screen), so that the position parameters of the two eyes of the user are indirectly obtained. And then, transmitting the position parameter data of the two eyes to a four-channel rendering server and a multi-channel control server through a switch by using tracking resolving software in the server.
Step S3, two sets of pictures (i.e. pictures seen by the 3D glasses at this time) displayed by the 3D glasses are calculated according to the position parameters of the two eyes. The immersive virtual reality display system respectively adjusts the images of the display space to match the current position viewed by the user according to the change of the positions of the two eyes of the user.
In step S4, two sets of pictures (i.e., left-eye picture and right-eye picture) are alternately displayed on the LED3D screen. The multi-channel control server generates picture control signals of the four LED3D screens according to the positions of the 3D glasses, and then the picture control signals of the four LED3D screens are respectively sent to the four-channel rendering servers, so that two groups of calibrated pictures are continuously and alternately displayed on the four LED3D screens.
And step S5, switching the left and right lens switches of the 3D glasses, and the switching frequency is matched with the switching frequency of the alternate display of the two groups of pictures on the LED3D screen, so that the user can experience the immersive stereoscopic visual virtual environment.
In the invention, an LED3D display screen with a point spacing of P1.667 is used, a front screen, a left screen, a right screen and a ground screen are built, a four-side display space is formed by the front screen, the left screen, the right screen and the ground screen, and a video splicer is an MVC series. In order to respectively render the pictures on the LED screen, four three-dimensional channel rendering servers are also needed. In addition, an infrared tracking system is further arranged, and the two eyes of the user are spatially positioned through an infrared camera.
Fig. 2 is a schematic structural diagram of an immersive virtual reality display device based on an LED3D screen according to an embodiment of the present invention, as shown in fig. 2, the present invention provides an immersive virtual reality display device based on an LED3D screen, which includes a positioning module 201, a first processing module 202, and a second processing module 203, where the positioning module 201 is configured to obtain real-time positions of two eyes of a user in an immersive virtual reality display system, and the immersive virtual reality display system is constructed based on an LED3D screen; the first processing module 202 is configured to obtain a first picture and a second picture displayed in the 3D glasses of the user according to the real-time positions of the two eyes; the second processing module 203 is configured to alternately display the first picture and the second picture on the immersive virtual reality display system, acquire an alternate display switching frequency of the first picture and the second picture, and switch the 3D glasses according to the alternate display switching frequency to perform immersive virtual reality display.
The immersive virtual reality display device based on the LED3D screen, provided by the invention, has the advantages that the immersive virtual reality display system is constructed based on the LED3D screen, the immersive virtual reality display system can be suitable for the environment with stronger light, the color saturation of the picture in the virtual display space is higher, the display screens are spliced seamlessly, the viewing effect is improved, and the service life is longer.
The apparatus provided in the embodiment of the present invention is used for executing the above method embodiments, and for details of the process and the details, reference is made to the above embodiments, which are not described herein again.
Fig. 3 illustrates a physical structure diagram of an electronic device, which may include, as shown in fig. 3: a processor (processor)301, a communication interface (communication interface)302, a memory (memory)303 and a communication bus 304, wherein the processor 301, the communication interface 302 and the memory 303 complete communication with each other through the communication bus 304. Processor 301 may invoke logic instructions in memory 303 to perform an LED3D screen based immersive virtual reality display method comprising: acquiring real-time positions of two eyes of a user in an immersive virtual reality display system, wherein the immersive virtual reality display system is constructed based on an LED3D screen; acquiring a first picture and a second picture displayed in the 3D glasses of the user according to the real-time positions of the two eyes; and alternately displaying the first picture and the second picture on the immersive virtual reality display system, acquiring the alternate display switching frequency of the first picture and the second picture, and switching the 3D glasses on and off according to the alternate display switching frequency so as to display the immersive virtual reality.
In addition, the logic instructions in the memory 303 may be implemented in the form of software functional units and stored in a computer readable storage medium when the logic instructions are sold or used as independent products. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read-only memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk.
In another aspect, the present invention also provides a computer program product comprising a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions which, when executed by a computer, enable the computer to perform the method for immersive virtual reality display based on an LED3D screen provided by the above methods, including: acquiring real-time positions of two eyes of a user in an immersive virtual reality display system, wherein the immersive virtual reality display system is constructed based on an LED3D screen; acquiring a first picture and a second picture displayed in the 3D glasses of the user according to the real-time positions of the two eyes; and alternately displaying the first picture and the second picture on the immersive virtual reality display system, acquiring the alternate display switching frequency of the first picture and the second picture, and switching the 3D glasses on and off according to the alternate display switching frequency so as to display the immersive virtual reality.
In yet another aspect, the present invention also provides a non-transitory computer readable storage medium, on which a computer program is stored, the computer program being implemented by a processor to execute the method for immersive virtual reality display based on an LED3D screen provided in the above embodiments, including: acquiring real-time positions of two eyes of a user in an immersive virtual reality display system, wherein the immersive virtual reality display system is constructed based on an LED3D screen; acquiring a first picture and a second picture displayed in the 3D glasses of the user according to the real-time positions of the two eyes; and alternately displaying the first picture and the second picture on the immersive virtual reality display system, acquiring the alternate display switching frequency of the first picture and the second picture, and switching the 3D glasses on and off according to the alternate display switching frequency so as to display the immersive virtual reality.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. An immersive virtual reality display method based on an LED3D screen is characterized by comprising the following steps:
acquiring real-time positions of two eyes of a user in an immersive virtual reality display system, wherein the immersive virtual reality display system is constructed based on an LED3D screen;
acquiring a first picture and a second picture displayed in the 3D glasses of the user according to the real-time positions of the two eyes;
and alternately displaying the first picture and the second picture on the immersive virtual reality display system, acquiring the alternate display switching frequency of the first picture and the second picture, and switching the 3D glasses on and off according to the alternate display switching frequency so as to display the immersive virtual reality.
2. The method of immersive virtual reality display based on the LED3D screen of claim 1, wherein said obtaining the real-time positions of the eyes of the user in the immersive virtual reality display system comprises:
acquiring infrared mark points on 3D glasses of a user through a plurality of infrared cameras arranged in an immersive virtual reality display system, and acquiring mark point real-time position parameters of the infrared mark points;
and acquiring the real-time positions of the eyes of the user according to the real-time position parameters of the mark points.
3. The immersive virtual reality display method based on the LED3D screen of claim 2, wherein after acquiring the first and second pictures displayed in the 3D glasses of the user according to the binocular real-time positions, the method further comprises:
generating a picture control signal according to the real-time positions of the two eyes;
and calibrating the first picture and the second picture according to the picture control signal, so that the calibrated first picture and the calibrated second picture are alternately displayed on the immersive virtual reality display system.
4. The immersive virtual reality display method based on the LED3D screen of claim 1, wherein after the acquiring the first and second pictures displayed in the user's 3D glasses according to the binocular real-time positions, comprising:
acquiring a first picture and a second picture displayed at the current moment in the 3D glasses of the user according to the real-time positions of the two eyes;
when the positions of the two eyes of the user change, the change parameters of the positions of the two eyes of the user are obtained in real time, and the first picture and the second picture displayed on the immersive virtual reality display system are adjusted according to the change parameters of the positions of the two eyes.
5. The immersive virtual reality display method based on the LED3D screen of claim 1, wherein the switching the 3D glasses according to the alternate display switching frequency comprises:
and generating a synchronous signal according to the alternate display switching frequency, so that the frequency of switching the switch of the 3D glasses and the alternate display switching frequency are kept synchronous according to the synchronous signal.
6. The method of immersive virtual reality display based on an LED3D screen of claim 1, wherein the alternating display switching frequency is at least 120 Hz.
7. The immersive virtual reality display method based on the LED3D screen of claim 1, wherein the immersive virtual reality display system is composed of a front screen, a left screen, a right screen, and a ground screen composed of a plurality of LED3D screens.
8. An immersive virtual reality display device based on an LED3D screen, comprising:
the positioning module is used for acquiring the real-time positions of two eyes of a user in an immersive virtual reality display system, and the immersive virtual reality display system is constructed on the basis of an LED3D screen;
the first processing module is used for acquiring a first picture and a second picture displayed in the 3D glasses of the user according to the real-time positions of the two eyes;
and the second processing module is used for alternately displaying the first picture and the second picture on the immersive virtual reality display system, acquiring the alternate display switching frequency of the first picture and the second picture, and switching the 3D glasses on and off according to the alternate display switching frequency so as to display the immersive virtual reality.
9. An electronic device comprising a memory, a processor and a computer program stored on said memory and executable on said processor, characterized in that said processor, when executing said computer program, implements the steps of the immersive virtual reality display method based on an LED3D screen as claimed in any one of claims 1 to 7.
10. A non-transitory computer readable storage medium having stored thereon a computer program, wherein the computer program when executed by a processor implements the steps of the LED3D screen based immersive virtual reality display method of any of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011474750.4A CN112584118A (en) | 2020-12-14 | 2020-12-14 | Immersive virtual reality display method and device based on LED3D screen |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011474750.4A CN112584118A (en) | 2020-12-14 | 2020-12-14 | Immersive virtual reality display method and device based on LED3D screen |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112584118A true CN112584118A (en) | 2021-03-30 |
Family
ID=75135833
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011474750.4A Pending CN112584118A (en) | 2020-12-14 | 2020-12-14 | Immersive virtual reality display method and device based on LED3D screen |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112584118A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105657408A (en) * | 2015-12-31 | 2016-06-08 | 北京小鸟看看科技有限公司 | Method for implementing virtual reality scene and virtual reality apparatus |
| CN107147899A (en) * | 2017-06-06 | 2017-09-08 | 北京德火新媒体技术有限公司 | A kind of CAVE of use LED 3D screens shows system and method |
| CN107239143A (en) * | 2017-06-06 | 2017-10-10 | 北京德火新媒体技术有限公司 | A kind of CAVE using small spacing LED screen shows system and method |
| CN206775654U (en) * | 2017-06-06 | 2017-12-19 | 北京德火新媒体技术有限公司 | A kind of CAVE display systems using LED 3D screens |
-
2020
- 2020-12-14 CN CN202011474750.4A patent/CN112584118A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105657408A (en) * | 2015-12-31 | 2016-06-08 | 北京小鸟看看科技有限公司 | Method for implementing virtual reality scene and virtual reality apparatus |
| CN107147899A (en) * | 2017-06-06 | 2017-09-08 | 北京德火新媒体技术有限公司 | A kind of CAVE of use LED 3D screens shows system and method |
| CN107239143A (en) * | 2017-06-06 | 2017-10-10 | 北京德火新媒体技术有限公司 | A kind of CAVE using small spacing LED screen shows system and method |
| CN206775654U (en) * | 2017-06-06 | 2017-12-19 | 北京德火新媒体技术有限公司 | A kind of CAVE display systems using LED 3D screens |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107147899B (en) | CAVE display system and method adopting LED3D screen | |
| US10750154B2 (en) | Immersive stereoscopic video acquisition, encoding and virtual reality playback methods and apparatus | |
| US11438566B2 (en) | Three dimensional glasses free light field display using eye location | |
| US11575876B2 (en) | Stereo viewing | |
| US20200092536A1 (en) | Systems and Methods for Creating an Immersive Video Content Environment | |
| US9241155B2 (en) | 3-D rendering for a rotated viewer | |
| US8514275B2 (en) | Three-dimensional (3D) display method and system | |
| US20160366392A1 (en) | Image encoding and display | |
| US20160337630A1 (en) | Image encoding and display | |
| WO2011036827A1 (en) | 3d image display device and 3d image display method | |
| US20130222410A1 (en) | Image display apparatus | |
| KR20160042808A (en) | Display device and visual display method for simulating holographic 3d scene | |
| US9167237B2 (en) | Method and apparatus for providing 3-dimensional image | |
| US20180102082A1 (en) | Apparatus, system, and method for video creation, transmission and display to reduce latency and enhance video quality | |
| KR101329057B1 (en) | An apparatus and method for transmitting multi-view stereoscopic video | |
| CN108989784A (en) | Image display method, device, equipment and the storage medium of virtual reality device | |
| Wu et al. | Backward compatible stereoscopic displays via temporal psychovisual modulation | |
| CN113900273A (en) | Naked eye 3D display method and related equipment | |
| CA3057507C (en) | Virtual reality system and method for displaying on a real-world display a viewable portion of a source file projected on an inverse spherical virtual screen | |
| WO2012021129A1 (en) | 3d rendering for a rotated viewer | |
| CN112584118A (en) | Immersive virtual reality display method and device based on LED3D screen | |
| CN107888900A (en) | A kind of projection robot of full parallax Three-dimensional Display and the projecting method of the robot | |
| CN102970498A (en) | Display method and display device for three-dimensional menu display | |
| KR20170096567A (en) | Immersive display system for virtual reality and virtual reality display method using the same | |
| Sawahata et al. | Depth-compressed expression for providing natural, visual experiences with integral 3D displays |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210330 |
|
| RJ01 | Rejection of invention patent application after publication |