CN113382224B - Interactive handle display method and device based on holographic sand table - Google Patents

Interactive handle display method and device based on holographic sand table Download PDF

Info

Publication number
CN113382224B
CN113382224B CN202110588133.5A CN202110588133A CN113382224B CN 113382224 B CN113382224 B CN 113382224B CN 202110588133 A CN202110588133 A CN 202110588133A CN 113382224 B CN113382224 B CN 113382224B
Authority
CN
China
Prior art keywords
display device
sand table
display
holographic
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110588133.5A
Other languages
Chinese (zh)
Other versions
CN113382224A (en
Inventor
谢国勇
刘嘉兴
师润乔
许秋子
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Realis Multimedia Technology Co Ltd
Original Assignee
Shenzhen Realis Multimedia Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Realis Multimedia Technology Co Ltd filed Critical Shenzhen Realis Multimedia Technology Co Ltd
Priority to CN202110588133.5A priority Critical patent/CN113382224B/en
Publication of CN113382224A publication Critical patent/CN113382224A/en
Application granted granted Critical
Publication of CN113382224B publication Critical patent/CN113382224B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/332Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03HHOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/0005Adaptation of holography to specific applications
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012Head tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1407General aspects irrespective of display type, e.g. determination of decimal point position, display with fixed or driving decimal point, suppression of non-significant zeros
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/133Equalising the characteristics of different image components, e.g. their average brightness or colour balance
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/366Image reproducers using viewer tracking

Abstract

The application discloses an interactive handle display method and device based on a holographic sand table, wherein the method comprises the following steps: when the sand table type display device displays the holographic image according to the first display signal, if an interaction instruction is received, the hand position of a user wearing the head-mounted display device is identified; obtaining viewpoint information of a user, wherein the viewpoint information shows the user binocular position and the user binocular viewing angle; determining a first position for generating a handheld end of the interactive handle according to the hand position; determining a second position of an indication end for generating the interactive handle according to the hand position and the viewpoint information; the hand-held end is one end of the interactive handle, and the interactive end is the other end of the interactive handle; and generating a second display signal according to the first position and the second position, and sending the second display signal to the sand table type display device, so that the sand table type display device displays the holographic image according to the first display signal and the second display signal.

Description

Interactive handle display method and device based on holographic sand table
Technical Field
The application relates to the technical field of simulation display, in particular to an interactive handle display method and device based on a holographic sand table.
Background
The holographic display technology (Front-Projected Holographic Display) is also called virtual imaging technology, is a technology for recording and reproducing real three-dimensional images of objects by utilizing interference and diffraction principles, and has the advantages of meeting all the perception of human vision and even enabling a viewer to watch the three-dimensional images without help of auxiliary devices such as helmets, glasses and the like. With the continuous development of display technology, holographic display technology has gained more and more attention.
In application scenes such as cinema, science and technology museum, virtual Reality (VR) helmets, the arc-shaped or annular holographic images can enable viewers to obtain the looking-around effect, so that the watching experience of the viewers is greatly improved, and the viewers feel of being in the scene.
Disclosure of Invention
The embodiment of the application provides an interactive handle display method and device based on a holographic sand table, which aim to at least partially solve the technical problems.
The embodiment of the application adopts the following technical scheme:
in a first aspect, an embodiment of the present application provides a holographic sand table-based interactive handle display method, the method being based on a holographic display system, the holographic display system comprising: display processing equipment, a sand table type display device and a head-mounted display device; the sand table type display device is a holographic sand table;
The display processing equipment is electrically connected with the sand table display device and the head-mounted display device respectively; the interactive handle display method based on the holographic sand table is executed by the display processing equipment, and comprises the following steps:
when the sand table type display device displays the holographic image according to the first display signal, if an interaction instruction is received, the hand position of a user wearing the head-mounted display device is identified;
the viewpoint information of the user is obtained, and the viewpoint information shows the dual-purpose position of the user and the dual-purpose view angle of the user;
determining a first position for generating a handheld end of the interactive handle according to the hand position; determining a second position of an indication end for generating an interactive handle according to the hand position and the viewpoint information; the hand-held end is one end of the interactive handle, and the interactive end is the other end of the interactive handle;
and generating a second display signal according to the first position and the second position, and sending the second display signal to the sand table type display device, so that the sand table type display device displays the holographic image according to the first display signal and the second display signal.
In an alternative embodiment of the present specification, before the method, the method further includes:
judging whether the sand table type display device is displaying the holographic image according to a first display signal;
if yes, detecting an interaction instruction;
if not, the judgment is executed again.
In an optional embodiment of the present disclosure, determining, according to the hand position and the viewpoint information, a second position for generating an indication end of the interactive handle includes:
extending the hand position serving as a starting point by a specified length, enabling an end point obtained by extension to meet the sight line of the user, and determining the end point to be a second position; the sight line of the user is obtained according to the viewpoint information.
In an alternative embodiment of the present specification, the interaction implemented by the interaction handle includes at least one of: and amplifying, shrinking, moving, rotating, selecting and replacing the image output by the sand table type display device.
In an alternative embodiment of the present specification, the method further comprises, after:
judging whether the outline of the holographic image displayed by the sand table type display device is intersected with the indication end of the interactive handle or not;
If not, amplifying the holographic image displayed by the sand table type display device until the outline of the holographic image intersects with the indication end of the interactive handle.
In an alternative embodiment of the present specification, the method further comprises:
generating a left-eye first display signal and a right-eye first display signal according to the viewpoint information of the user;
processing the left-eye first display signal and the right-eye first display signal to generate a first display signal, and outputting the first display signal to the sand table type display device, so that the sand table type display device outputs an image according to the first display signal;
generating a synchronizing signal, and sending the synchronizing signal to the head-mounted display device, so that the head-mounted display device collects images output by the sand table type display device according to the synchronizing signal, and displaying the collected images to a user wearing the head-mounted display device alternately.
In an alternative embodiment of the present specification, the holographic display system further comprises: a virtual camera; the position of the virtual camera is the same as the double-purpose position of the user, and the visual angle of the virtual camera is the same as the double-purpose visual angle of the user; the virtual camera is used for collecting images of the environment where the head-mounted display device is located according to the position and the view angle where the virtual camera is located;
The method further comprises the steps of:
acquiring an image acquired by the virtual camera;
and generating a first display signal according to the image acquired by the virtual camera, so that at least part of the content in the environment is shown in the holographic image displayed by the sand table type display device.
In an alternative embodiment of the present specification, the holographic display system further comprises: a dynamic capturing camera;
the hand position of the user is obtained according to the data acquired by the dynamic camera.
In a second aspect, an embodiment of the present application further provides a holographic display device, configured to implement any one of the foregoing holographic display devices.
In a third aspect, an embodiment of the present application further provides an electronic device, including:
a processor; and
a memory arranged to store computer executable instructions which, when executed, cause the processor to perform the method of the first aspect.
In a fourth aspect, embodiments of the present application also provide a computer-readable storage medium storing one or more programs, which when executed by an electronic device comprising a plurality of application programs, cause the electronic device to perform the method of the first aspect.
The above at least one technical scheme adopted by the embodiment of the application can achieve the following beneficial effects: according to the interactive handle display method and device based on the holographic sand table, the holographic image is displayed to a user in a mode that the sand table display device is matched with the head-mounted display device, the sand table display device is high in controllability, the brightness of display can be adjusted according to the brightness of a scene where the sand table display device is located, and good holographic image display effect can be achieved even in a darker scene. In addition, the process in the specification can realize interaction between the user and the holographic display system by displaying the interaction handle for the user when the user views the holographic image, and is beneficial to improving user experience.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this specification, illustrate embodiments of the application and together with the description serve to explain the application and do not constitute a limitation on the application. In the drawings:
fig. 1a is a schematic diagram of a holographic display scene provided in an embodiment of the present disclosure;
fig. 1b is a schematic diagram of a holographic image provided for a user by an interactive handle display method based on a holographic sand table according to an embodiment of the present disclosure;
Fig. 2 is a schematic diagram of an interactive handle display process based on a holographic sand table according to an embodiment of the present disclosure;
FIG. 3 is a schematic diagram of a holographic display device according to an embodiment of the present disclosure;
fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The application will be described in further detail below with reference to the drawings by means of specific embodiments. Wherein like elements in different embodiments are numbered alike in association. In the following embodiments, numerous specific details are set forth in order to provide a better understanding of the present application. However, one skilled in the art will readily recognize that some of the features may be omitted, or replaced by other elements, materials, or methods in different situations. In some instances, related operations of the present application have not been shown or described in the specification in order to avoid obscuring the core portions of the present application, and may be unnecessary to persons skilled in the art from a detailed description of the related operations, which may be presented in the description and general knowledge of one skilled in the art.
Furthermore, the described features, operations, or characteristics of the description may be combined in any suitable manner in various embodiments. Also, various steps or acts in the method descriptions may be interchanged or modified in a manner apparent to those of ordinary skill in the art. Thus, the various orders in the description and drawings are for clarity of description of only certain embodiments, and are not meant to be required orders unless otherwise indicated.
The numbering of the components herein, itself, e.g. "second", etc., is used solely to distinguish between the described objects and does not have any sequential or technical meaning. The term "coupled" as used herein includes both direct and indirect coupling (coupling), unless otherwise indicated.
The following describes in detail the technical solutions provided by the embodiments of the present application with reference to the accompanying drawings.
In order to realize holographic display, the specification provides an interactive handle display method based on a holographic sand table. The interactive handle display method based on the holographic sand table comprises a holographic display system, wherein the holographic display system comprises the following steps: the device comprises a display processing device, a sand table display device and a head-mounted display device, wherein the number of the head-mounted display devices is a plurality of, different head-mounted display devices are worn by different users, and the head-mounted display devices move along with the movement of the users. Different head-mounted display devices have different viewpoints due to different poses of different users relative to the sand table display device.
In the holographic display system, the display processing device is electrically connected with the sand table display device and the head-mounted display device respectively. As shown in fig. 1a and 1b, a scene in which a holographic image is displayed to a user by using a holographic display system is schematically shown, in the scene shown in fig. 1a and 1b, a sand table display device is fixedly arranged in a site where the holographic image is displayed, and the user wears a head-mounted display device on his body. The users are plural, and different users wear different head mounted display devices (head mounted display devices 1 to n as shown in fig. 1a and 1 b). It should be noted that, the specific number of the head-mounted display devices of the holographic display system is not limited in the present specification, and the interactive handle display method and the holographic display system based on the holographic sand table in the present specification are also applicable to a scene with only one user.
In an alternative embodiment of the present description, the display processing apparatus may be integrated with a sand table display device. The head-mounted display device may be glasses having a display function.
The arrangement mode of the sand table type display device in the holographic display field is not particularly limited in the specification, and for example, the sand table type display device can be hung on a wall or arranged on the ground.
The number of sand table display devices included in the holographic display system is also not particularly limited in this specification. In the case where there are a plurality of sand table display devices, the arrangement and placement of the different sand table display devices in the field may be the same or different.
The holographic sand table based interactive handle display process in this specification may be performed by a display processing device in a holographic display system, which may include at least some of the following steps.
S200: when the sand table type display device displays the holographic image according to the first display signal, if an interaction instruction is received, the hand position of a user wearing the head-mounted display device is identified.
The process in this specification aims at outputting a holographic image to a user in order to enable the user to experience the stereoscopic impression of the holographic image and at the same time to achieve an interaction between the user and the holographic display system. Thus, the process in this specification takes the receipt of the interaction instruction as the timing to start the interaction.
The interactive instructions in this specification are generated based on user triggers. The manner in which the user triggers the interaction instruction is not particularly limited in this specification, for example, the user may trigger the interaction instruction by means of voice, a specified gesture, or the like.
In an alternative embodiment of the present specification, the holographic display system further comprises: and a dynamic camera. The appointed gesture of the user can be recognized through the image acquired by the auxiliary camera, and then the interaction instruction is triggered.
In addition, in other optional embodiments of the present disclosure, the holographic display system further detects an interaction termination instruction, and if the interaction termination instruction is detected, the display of the interaction handle is terminated.
Further, in other optional embodiments of the present disclosure, it may also be determined, before this step, whether the sand table display device is performing holographic image presentation according to the first display signal; if yes, the sand table type display device is indicated to be in a use state currently, and detection aiming at the interaction instruction is carried out; if not, the judgment is executed again.
S202: and obtaining viewpoint information of the user, wherein the viewpoint information shows the dual-purpose position of the user and the dual-purpose view angle of the user.
The process in this specification aims to output holograms to users at a plurality of different viewpoints. Since the point of view of each user (i.e., the point of view of the head mounted display device worn by the user) varies to a different extent, the display processing apparatus in this specification determines the point of view thereof for each head mounted display device.
In an alternative embodiment of the present description, the display processing device outputs display signals, i.e. a left-eye first display signal and a right-eye first display signal, respectively, for a dual-purpose viewing angle of a user. Certain differences exist between the left-eye first display signal and the right-eye first display signal so as to simulate the difference of the visual angles of the two eyes of a user and further realize the display with stereoscopic impression.
In an alternative embodiment of the present disclosure, the image specifications corresponding to the left-eye first display signal and the right-eye first display signal are 1920 pixels×1080 pixels. The output frequency of the left eye first display signal and the right eye first display signal is 60 Hz.
And the display processing equipment processes the left-eye first display signal and the right-eye first display signal, so that the obtained first display signal can be displayed through the sand table type display device.
S204: and determining a first position of a handheld end for generating the interactive handle according to the hand position.
Specifically, a coordinate system may be established in a scene where the sand table display device is located, an image acquired by the auxiliary camera is mapped to the coordinate system, and a position of the hand of the user in the coordinate system is identified in the mapped image and is used as a hand position of the user.
In addition, other positional concepts referred to in the present specification may be positions in the coordinate system.
S206: and determining a second position of the indication end for generating the interactive handle according to the hand position and the viewpoint information.
In the specification, the indication end of the interaction handle is the end of the interaction handle far away from the hand of the user. In an optional embodiment of the present disclosure, the hand position may be taken as a starting point, and extended by a specified length, so that an end point obtained by extension intersects with the line of sight of the user, and the end point is determined to be the second position; the sight line of the user is obtained according to the viewpoint information.
S208: and generating a second display signal according to the first position and the second position, and sending the second display signal to the sand table type display device.
The second display signal is used to present the interactive handle in the holographic image presented to the user. Thereafter, the user may interact with the holographic display system through the interaction handle.
The interactive mode is not particularly limited in this specification, for example, the interactive mode may be to zoom in, zoom out, move, rotate, select, and replace the image output by the sand table display device.
Specifically, the user gesture can be identified, a standard gesture matched with the user gesture is determined in preset standard gestures, and interaction is performed according to an interaction mode corresponding to the determined standard gesture. Specifically, if the determined interaction mode is rotation, the image output by the disc display device is rotated.
In an alternative embodiment of the present description, the sand table display device is an LED (Light Emitting Diode ) display device. The image specification corresponding to the first display signal is 1920 pixels by 1080 pixels, and the output frequency of the first display signal is 120 Hz, so that the binocular alternating output picture of a user at the frequency of 60 Hz is realized.
After receiving the first display signal, the sand table type display device outputs an image according to the first display signal so as to be watched by a user wearing the head-mounted display device.
In order to enable the sand table type display device and the head-mounted display device to be matched, the display processing equipment generates a synchronous signal according to the left-eye first display signal and the right-eye first display signal, so that the head-mounted display device collects images output by the sand table type display device according to the synchronous signal, and the collected images are displayed to a user wearing the head-mounted display device alternately. It can be seen that the synchronization signal is used to achieve a binocular alternating output picture to the user.
In an alternative embodiment of the present specification, the head mounted display device is shutter type 3D glasses.
Further, when the hologram display system in the present specification provides hologram display for a plurality of users at the same time, since the viewpoints of each user (i.e., the viewpoints of the head-mounted display devices worn by the users) are different to some extent, the display processing apparatus in the present specification determines the viewpoints thereof for each head-mounted display device. Because the number of the head-mounted display devices is not unique, the first display signals received by the sand table display devices are not unique, and the sand table display devices need to display holographic images to different head-mounted display devices respectively according to different first display signals.
Further, in an alternative embodiment of the present disclosure, the hologram displayed by the sand table display device may also cooperate with an interactive handle to provide a user with a more interactive experience. Specifically, the display processing device judges whether the outline of the holographic image displayed by the sand table type display device intersects with the indication end of the interactive handle. If not, indicating that the indication end of the interactive handle is not pointed on the holographic image, and causing the indication position of the interactive handle on the holographic image to be ambiguous, amplifying the holographic image displayed by the sand table display device until the outline of the holographic image is intersected with the indication end of the interactive handle.
From the foregoing, it can be seen that the holographic display in this description requires a sand table display device to be mated with a head mounted display device. The coordination is to some extent achieved by means of a synchronization signal. In an alternative embodiment of the present disclosure, control of all head-mounted display devices may be achieved by one synchronization signal; in another alternative embodiment of the present disclosure, the synchronization signal may be generated separately for each head mounted display device separately to control the different head mounted display devices separately.
Specifically, aiming at a certain head-mounted display device, the synchronous signal controls the head-mounted display device to collect the content displayed by the sand table display device when the sand table display device displays the holographic image under the viewpoint of the head-mounted display device, and displays the content to a user according to the collected result.
In an alternative embodiment of the present disclosure, the head-mounted display device captures images output by the sand table display device according to the synchronization signal, so as to alternately display the captured images to a user wearing the head-mounted display device.
According to the interactive handle display method based on the holographic sand table, the sand table display device and the head-mounted display device are matched, the holographic images are displayed for users, the sand table display device is high in controllability, the displayed brightness can be adjusted according to the brightness of a scene where the sand table display device is located, and good holographic image display effect can be achieved even in a darker scene. Because holographic image in this description is by sand table display device auxiliary display, then wear-type display device in this description compares current VR glasses, need not to carry out comparatively complicated data processing, is favorable to reducing wear-type display device's volume and weight for user's somatosensory more comfortable.
In addition, existing 3D display products generally only have a narrow viewing point or only can see an ideal effect at a fixed position, i.e., the existing 3D display products only support a single point of view, but the 3D interactive display system of the single point of view display is increasingly unable to meet the needs of customers. According to the interactive handle display method based on the holographic sand table, the sand table display device and the head-mounted display device are matched, so that even if the viewpoint of a user changes (which can be caused by movement of the user), holographic images with stereoscopic impression can be displayed to the user, and the user experience is improved.
In addition, the display processing equipment in the holographic display system controls the display of the sand table type display device according to the viewpoint of the head-mounted display device, and even if the head-mounted display device moves along with a user, the head-mounted display device can acquire holographic images suitable for the user to watch based on the content displayed by the sand table type display device. Further, the holographic display system comprises a plurality of head-mounted display devices, when different head-mounted display devices are worn by different users, the different head-mounted display devices can be caused to have different viewpoints, and by the method in the specification, holographic image display can be simultaneously carried out on the plurality of head-mounted display devices with different viewpoints through the same sand table type display device.
In order to flexibly and efficiently control the sand table display device, in an optional embodiment of the present specification, after generating the first display signals corresponding to each view point, the display processing device performs a merging process on the first display signals corresponding to each view point; and outputting the composite signal obtained after the combination processing to the sand table type display device.
In an alternative embodiment of the present disclosure, the image specification corresponding to the composite signal is 1920 pixels×1080 pixels. The output frequency of the composite signal is 120 x k hz. Where k is the number of head mounted display devices. When k is equal to 2, the output frequency of the composite signal is 240 hz.
In order to realize data transmission between the display processing device and the sand table display device and effectively drive the sand table display device in cooperation with the scene of multi-view output, in an alternative embodiment of the present specification, the holographic display system may further include a receiving card. The display processing device outputs the composite signal to the receiving card after generating the composite signal. The receiving card restores the composite signal to each first display signal, and drives the sand table type display device to display the holographic image according to each first display signal.
Specifically, the receiving card outputs each first display signal to the sand table type display device in a time-sharing manner, so that the sand table type display device performs holographic image display according to each first display signal in a time-sharing manner. When the sand table type display device displays the hologram according to the first display signal corresponding to the ith (i can be any integer and represents any one) head-mounted display device, the ith head-mounted display device acquires the hologram displayed by the sand table type display device according to the synchronous signal, and the acquired result is matched with the viewpoint of the ith head-mounted display device.
Therefore, the receiving card in the specification has a certain interface function so as to cooperate with a plurality of sand table type display devices to display images simultaneously and/or cooperate with sand table type display devices of different models to display images.
By the interactive handle display method based on the holographic sand table, holographic images with strong stereoscopic impression and high image quality can be displayed for users in various scenes with different brightness. In an actual scene, a user may move in a place where the sand table display device is disposed according to the user's own needs, and there is a possibility that a hologram displayed by the sand table display device is not matched with an actual viewpoint of the user due to the movement of the user.
In order to provide a hologram with excellent display effect and display holograms at different viewpoints for different simultaneous applications during movement of a user, in an alternative embodiment of the present specification, the holographic display system further includes: and a dynamic camera. The dynamic camera is arranged on the sand table type display device. The number of the dynamic capturing cameras and the setting positions and shooting angles on the sand table type display device in this specification are determined according to the setting placement, shape, size, and the like of the sand table type display device. Specifically, the number of the dynamic cameras is 4, and the dynamic cameras are respectively arranged at corners of the sand table type display device. The dynamic camera is used for collecting (shooting) images of the environment around the sand table type display device so as to capture the position of a user in the scene and further obtain the viewpoint of the head-mounted display device.
In other implementations of the present disclosure, the dynamic camera may be disposed above the sand table display device to capture images of the environment from a bird's eye view.
The motion capture camera may perform image acquisition under control of the display processing device.
In an optional embodiment of the present disclosure, the motion capture camera first acquires 3D coordinate information of the head-mounted display device in space, and then combines the acquired eye viewpoint coordinate information of the user wearing the head-mounted display device in the motion capture space, so as to complete tracking and positioning of the viewing angle of the user, and then transmits the positioning information to the display processing device. And synchronizing a position signal of the display processing device in the motion capture space to the hologram, and taking the three-dimensional position of the head-mounted display device in the motion capture space as the position of the virtual camera in the hologram (namely, the position of the head-mounted display device) so as to calculate the viewpoint picture of the virtual camera.
Further, the head-mounted display device comprises shutter type active three-dimensional glasses, a rigid body formed by at least three reflective mark points and the like. The number of retroreflective marker dots may be 4. Wherein, the at least three reflective mark points are embedded on the shell structure of the shutter type active three-dimensional glasses. The shutter type active three-dimensional glasses are used for receiving viewpoint pictures (three-dimensional signals) transmitted by the sand table type display device, so that right and left eye pictures are obtained. Specifically, the shutter type active three-dimensional glasses receive three-dimensional signals emitted by the three-dimensional signal emitter in the sand table type display device.
The rigid body formed by the at least three reflective marking points is used for marking the position of the shutter type active three-dimensional glasses in the motion capture space, so that the position information of the head-mounted display device in the motion capture space and the viewpoint position information of a user wearing the head-mounted display device in the motion capture space can be captured. Thus, the position of the shutter type active three-dimensional glasses in the motion capture space is captured, so that a user can see a stereoscopic picture of display content in the floating space by wearing the shutter type active three-dimensional glasses, and can watch the three-dimensional picture (namely, the holographic image) from various angles.
In an alternative embodiment of the present disclosure, the display processing apparatus may be formed of a plurality of devices, and the functions of the display processing apparatus may be implemented by cooperation of the devices forming the display processing apparatus.
Specifically, the display processing device may include: a display server, a display processor and a synchronization transmitter. The first display signal is generated by a display server; the composite signal and/or the synchronization signal is generated by the display processor; the synchronization signal is sent by the synchronization transmitter to the head mounted display device. Optionally, the aforementioned left-eye display signal and right-eye display signal are generated by a display server, and the display server sends the generated left-eye display signal and right-eye display signal to a display processor. The display processor generates a first display signal according to the left eye display signal and the right eye display signal and sends the first display signal to the sand table type display device. The synchronization signal is sent by the synchronization transmitter to the head mounted display device.
Optionally, the display server is electrically connected with the display processor through a DP or HDMI line; the display processor is electrically connected with the receiving card through the network port; the display processor is electrically connected with the synchronous transmitter through a cable. The receiving card is electrically connected with the sand table type display device through a flat cable.
In an alternative embodiment of the present disclosure, the sand table display device may be composed of a small-pitch LED display screen, and the sand table display device includes an LED display screen body, a three-dimensional video fusion device, a three-dimensional signal transmitter, and the like.
The three-dimensional video fusion device is connected with the sending card of the LED display screen body. The three-dimensional signal transmitter is connected to the three-dimensional video fusion device, the three-dimensional video fusion device receives viewpoint picture information of the virtual camera (namely, the head-mounted display device) processed by the display processor in the display processing device, the display frequency is adjusted, pictures are displayed on the LED display screen body through the transmitting card, so that left and right eye pictures are displayed, and the holographic three-dimensional display algorithm is carried in the display processor. The three-dimensional signal transmitter synchronously transmits the display frequency to the holographic 3D glasses so as to realize real-time display of pictures which are adjusted according to different viewpoint positions of users wearing the holographic 3D glasses.
In the present description, in the virtual three-dimensional scene, the three-dimensional position of the head-mounted display device in the motion capture space is taken as the position of the virtual camera in the virtual space, so that the position of one virtual camera can be simulated to capture the picture of the position of the head-mounted display device, and the virtual three-dimensional scene is set according to the position of the virtual camera in the virtual space.
The picture photographed by the virtual camera (i.e., the picture under the viewpoint of the head-mounted display device) is the three-dimensional virtual scene picture (i.e., the hologram) seen by the viewpoint of the user wearing the head-mounted display device, i.e., the virtual three-dimensional scene photographed by the virtual camera is the 3D viewpoint picture seen by the user. The display processing equipment can process the picture to be displayed in real time according to the viewpoint position information of the head-mounted display device in the motion capture space, and simultaneously adopts the sand table type display device to display the viewpoint picture, so that the excellent holographic three-dimensional display effect can be realized, and the excellent screen-out feeling and holographic visual feeling are obtained.
Compared with other products, the holographic display system provided by the application has the advantages that the cost is greatly reduced, the picture display is finer and richer, and the color is richer. The display effect has strong stability, the use of the user is more convenient, and the operation control is simpler. The sand table type display device is fine in display effect, high in brightness and low in cost, and the LED active 3D stereoscopic display technology is combined with the space position information of the observation view point, so that the 3D stereoscopic effect that the virtual object is suspended on the LED display screen is achieved, the user's impression can be improved, and the holographic display effect is improved.
In addition, in an alternative embodiment of the present specification, the process in the present specification can be used not only to present a hologram to a user, but also to enable interaction with the user. Specifically, when receiving an interaction instruction, the display processing device generates a second display signal and outputs the second display signal to the sand table type display device, so that the sand table type display device outputs an image for displaying the interaction handle according to the second display signal, and a user can operate the interaction handle to realize interaction; the interaction includes at least one of: and (3) amplifying, shrinking, moving, rotating, selecting and replacing the image output by the sand table type display device.
Alternatively, the interaction instruction is triggered by a specified action by the user, which may be captured by the dynamic capture camera. The image of the interactive handle may be a bar-shaped image, and one end of the interactive handle is matched with the hand action of the user, and moves in the image generated by the sand table type display device along with the hand action of the user.
In an alternative embodiment of the present description, the display processing device employs a UE4 processing system. The holographic display system and the interactive handle display method based on the holographic sand table in the specification are wide in application scene, and particularly can be applied to military situation deduction, industrial equipment simulation operation, simulation design, education and teaching training room, medical simulation training and other scenes.
Based on the same thought, the embodiment of the present disclosure also provides a holographic display corresponding to the part of the process shown in fig. 2. The holographic display device is applied to display processing equipment of a holographic display system. In addition, the holographic display system also comprises a sand table type display device and a head-mounted display device. The display processing equipment is electrically connected with the sand table type display device and the head-mounted display device respectively. As shown in fig. 3, the holographic display may include one or more of the following modules:
the hand position determining module 300 is configured to identify the hand position of the user wearing the head-mounted display device if the interaction instruction is received when the sand table display device displays the holographic image according to the first display signal;
the viewpoint information determining module 302 is configured to obtain viewpoint information of the user, where the viewpoint information shows the user dual-purpose position and the user dual-purpose view angle.
A first position determination module 304 is configured to determine a first position of the hand-held end for generating the interactive handle based on the hand position.
A second position determining module 306 configured to determine a second position for generating an indication end of the interactive handle according to the hand position and the viewpoint information; the hand-held end is one end of the interactive handle, and the interactive end is the other end of the interactive handle.
And a second display signal determining module 308, configured to generate a second display signal according to the first position and the second position, and send the second display signal to the sand table display device, so that the sand table display device performs holographic image display according to the first display signal and the second display signal.
In an optional embodiment of the present disclosure, the apparatus further includes a first determining module.
The first judging module is configured to: judging whether the sand table type display device is displaying the holographic image according to a first display signal; if yes, detecting an interaction instruction; if not, the judgment is executed again.
In an alternative embodiment of the present disclosure, the second position determining module 306 is specifically configured to extend a specified length from the hand position as a starting point, such that an end point obtained by extension intersects the line of sight of the user, and determine that the end point is the second position; the sight line of the user is obtained according to the viewpoint information.
In an alternative embodiment of the present description, the interaction includes at least one of: and amplifying, shrinking, moving, rotating, selecting and replacing the image output by the sand table type display device.
In an optional embodiment of the present disclosure, the apparatus further includes a second determining module.
The second judging module is configured to: judging whether the outline of the holographic image displayed by the sand table type display device is intersected with the indication end of the interactive handle or not; if not, amplifying the holographic image displayed by the sand table type display device until the outline of the holographic image intersects with the indication end of the interactive handle.
In an alternative embodiment of the present specification, the apparatus further comprises an output module.
The output module is configured to generate a left-eye first display signal and a right-eye first display signal according to viewpoint information of the user; processing the left-eye first display signal and the right-eye first display signal to generate a first display signal, and outputting the first display signal to the sand table type display device, so that the sand table type display device outputs an image according to the first display signal; generating a synchronizing signal, and sending the synchronizing signal to the head-mounted display device, so that the head-mounted display device collects images output by the sand table type display device according to the synchronizing signal, and displaying the collected images to a user wearing the head-mounted display device alternately.
In an alternative embodiment of the present specification, the holographic display system further comprises: a virtual camera; the position of the virtual camera is the same as the double-purpose position of the user, and the visual angle of the virtual camera is the same as the double-purpose visual angle of the user; the virtual camera is used for collecting images of the environment where the head-mounted display device is located according to the position and the view angle where the virtual camera is located.
The device also comprises an acquisition module. The acquisition module is configured to acquire an image acquired by the virtual camera; and generating a first display signal according to the image acquired by the virtual camera, so that at least part of the content in the environment is shown in the holographic image displayed by the sand table type display device.
It can be understood that the above-mentioned holographic display device can implement each step of the holographic sand table-based interactive handle display process performed by the holographic display device provided in the foregoing embodiment, and the relevant explanation about the holographic sand table-based interactive handle display method is applicable to the holographic display device, which is not described herein.
Fig. 4 is a schematic structural view of an electronic device according to an embodiment of the present application. Referring to fig. 4, at the hardware level, the electronic device includes a processor, and optionally an internal bus, a network interface, and a memory. The Memory may include a Memory, such as a Random-Access Memory (RAM), and may further include a non-volatile Memory (non-volatile Memory), such as at least 1 disk Memory. Of course, the electronic device may also include hardware required for other services.
The processor, network interface, and memory may be interconnected by an internal bus, which may be an ISA (Industry Standard Architecture ) bus, a PCI (Peripheral Component Interconnect, peripheral component interconnect standard) bus, or EISA (Extended Industry Standard Architecture ) bus, among others. The buses may be classified as address buses, data buses, control buses, etc. For ease of illustration, only one bi-directional arrow is shown in FIG. 4, but not only one bus or type of bus.
And the memory is used for storing programs. In particular, the program may include program code including computer-operating instructions. The memory may include memory and non-volatile storage and provide instructions and data to the processor.
The processor reads the corresponding computer program from the non-volatile memory into the memory and then runs to form a holographic display and/or a second holographic display on a logic level. The processor is used for executing the program stored in the memory and particularly used for executing any interactive handle display process based on the holographic sand table.
The method performed by one of the holographic display devices disclosed above in the embodiment of fig. 2 of the present application and/or the second holographic display device may be implemented in or by a processor. The processor may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the above method may be performed by integrated logic circuits of hardware in a processor or by instructions in the form of software. The processor may be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU), a network processor (Network Processor, NP), etc.; but also digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), field programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. The disclosed methods, steps, and logic blocks in the embodiments of the present application may be implemented or performed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the method disclosed in connection with the embodiments of the present application may be embodied directly in the execution of a hardware decoding processor, or in the execution of a combination of hardware and software modules in a decoding processor. The software modules may be located in a random access memory, flash memory, read only memory, programmable read only memory, or electrically erasable programmable memory, registers, etc. as well known in the art. The storage medium is located in a memory, and the processor reads the information in the memory and, in combination with its hardware, performs the steps of the above method.
The electronic device may further perform at least part of the method steps performed by the holographic display device in fig. 2, and implement the functions of one holographic display device and/or the second holographic display device in the embodiment shown in fig. 2, which are not described herein.
The embodiment of the application also provides a computer readable storage medium, which stores one or more programs, the one or more programs including instructions, which when executed by an electronic device including a plurality of application programs, enable the electronic device to execute a method executed by one holographic display device and/or a second holographic display device in the embodiment shown in fig. 2, and is specifically used for executing any one of the foregoing interactive handle display methods based on a holographic sand table.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In one typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include volatile memory in a computer-readable medium, random Access Memory (RAM) and/or nonvolatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of computer-readable media.
Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. Computer-readable media, as defined herein, does not include transitory computer-readable media (transmission media), such as modulated data signals and carrier waves.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises an element.
It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The foregoing is merely exemplary of the present application and is not intended to limit the present application. Various modifications and variations of the present application will be apparent to those skilled in the art. Any modification, equivalent replacement, improvement, etc. which come within the spirit and principles of the application are to be included in the scope of the claims of the present application.

Claims (10)

1. An interactive handle display method based on a holographic sand table, which is characterized in that the method is based on a holographic display system, and the holographic display system comprises: display processing equipment, a sand table type display device and a head-mounted display device; the sand table type display device is a holographic sand table;
the display processing equipment is electrically connected with the sand table display device and the head-mounted display device respectively; the interactive handle display method based on the holographic sand table is executed by the display processing equipment, and comprises the following steps:
when the sand table type display device displays the holographic image according to the first display signal, if an interaction instruction is received, the hand position of a user wearing the head-mounted display device is identified;
the viewpoint information of the user is obtained, and the viewpoint information shows the dual-purpose position of the user and the dual-purpose view angle of the user;
determining a first position for generating a handheld end of the interactive handle according to the hand position; determining a second position of an indication end for generating an interactive handle according to the hand position and the viewpoint information; the hand-held end is one end of the interactive handle, and the interactive end is the other end of the interactive handle;
Generating a second display signal according to the first position and the second position, and sending the second display signal to the sand table type display device, so that the sand table type display device displays holographic images according to the first display signal and the second display signal; the second display signal is used to present the interactive handle in the holographic image presented to the user.
2. The method of claim 1, wherein prior to the method, further comprising:
judging whether the sand table type display device is displaying the holographic image according to a first display signal;
if yes, detecting an interaction instruction;
if not, the judgment is executed again.
3. The method of claim 1, wherein determining a second location for generating an indicated end of an interactive handle based on the hand position and the viewpoint information comprises:
extending the hand position serving as a starting point by a specified length, enabling an end point obtained by extension to meet the sight line of the user, and determining the end point to be a second position; the sight line of the user is obtained according to the viewpoint information.
4. The method of claim 1, wherein the interaction achieved by the interaction handle comprises at least one of: and amplifying, shrinking, moving, rotating, selecting and replacing the image output by the sand table type display device.
5. The method of claim 1, further comprising, after the method:
judging whether the outline of the holographic image displayed by the sand table type display device is intersected with the indication end of the interactive handle or not;
if not, amplifying the holographic image displayed by the sand table type display device until the outline of the holographic image intersects with the indication end of the interactive handle.
6. The method of claim 1, wherein the method further comprises:
generating a left-eye first display signal and a right-eye first display signal according to the viewpoint information of the user;
processing the left-eye first display signal and the right-eye first display signal to generate a first display signal, and outputting the first display signal to the sand table type display device, so that the sand table type display device outputs an image according to the first display signal;
generating a synchronizing signal, and sending the synchronizing signal to the head-mounted display device, so that the head-mounted display device collects images output by the sand table type display device according to the synchronizing signal, and displaying the collected images to a user wearing the head-mounted display device alternately.
7. The method of claim 1, wherein the holographic display system further comprises: a virtual camera; the position of the virtual camera is the same as the double-purpose position of the user, and the visual angle of the virtual camera is the same as the double-purpose visual angle of the user; the virtual camera is used for collecting images of the environment where the head-mounted display device is located according to the position and the view angle where the virtual camera is located;
The method further comprises the steps of:
acquiring an image acquired by the virtual camera;
and generating a first display signal according to the image acquired by the virtual camera, so that at least part of the content in the environment is shown in the holographic image displayed by the sand table type display device.
8. The method of claim 1, wherein the holographic display system further comprises: a dynamic capturing camera;
the hand position of the user is obtained according to the data acquired by the dynamic camera.
9. A holographic display, the device comprising:
the hand position determining module is configured to identify the hand position of a user wearing the head-mounted display device if an interaction instruction is received when the sand table display device displays the holographic image according to the first display signal;
the viewpoint information determining module is configured to acquire viewpoint information of the user, wherein the viewpoint information shows the user binocular position and the user binocular viewing angle;
a first position determining module configured to determine a first position of a hand-held end for generating an interactive handle according to the hand position;
the second position determining module is configured to determine a second position for generating an indication end of the interactive handle according to the hand position and the viewpoint information; the hand-held end is one end of the interactive handle, and the interactive end is the other end of the interactive handle;
The second display signal determining module is configured to generate a second display signal according to the first position and the second position and send the second display signal to the sand table type display device, so that the sand table type display device displays a holographic image according to the first display signal and the second display signal; the second display signal is used to present the interactive handle in the holographic image presented to the user.
10. An electronic device, comprising:
a processor; and
a memory arranged to store computer executable instructions which, when executed, cause the processor to perform the method of any of claims 1 to 8.
CN202110588133.5A 2021-05-27 2021-05-27 Interactive handle display method and device based on holographic sand table Active CN113382224B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110588133.5A CN113382224B (en) 2021-05-27 2021-05-27 Interactive handle display method and device based on holographic sand table

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110588133.5A CN113382224B (en) 2021-05-27 2021-05-27 Interactive handle display method and device based on holographic sand table

Publications (2)

Publication Number Publication Date
CN113382224A CN113382224A (en) 2021-09-10
CN113382224B true CN113382224B (en) 2023-09-12

Family

ID=77572323

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110588133.5A Active CN113382224B (en) 2021-05-27 2021-05-27 Interactive handle display method and device based on holographic sand table

Country Status (1)

Country Link
CN (1) CN113382224B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113900514B (en) * 2021-09-26 2022-06-14 连云港市规划展示中心 Man-machine interactive visualization system and method based on multi-sensor network
CN113891063B (en) * 2021-10-09 2023-09-01 深圳市瑞立视多媒体科技有限公司 Holographic display method and device

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109710056A (en) * 2018-11-13 2019-05-03 宁波视睿迪光电有限公司 The display methods and device of virtual reality interactive device
US11320957B2 (en) * 2019-01-11 2022-05-03 Microsoft Technology Licensing, Llc Near interaction mode for far virtual object
CN110609622A (en) * 2019-09-18 2019-12-24 深圳市瑞立视多媒体科技有限公司 Method, system and medium for realizing multi-person interaction by combining 3D and virtual reality technology
CN111580677A (en) * 2020-05-21 2020-08-25 深圳布莱克实验室科技有限公司 Man-machine interaction method and man-machine interaction system
CN112435558A (en) * 2020-11-10 2021-03-02 深圳市瑞立视多媒体科技有限公司 Holographic 3D intelligent interactive digital virtual sand table and interactive method thereof

Also Published As

Publication number Publication date
CN113382224A (en) 2021-09-10

Similar Documents

Publication Publication Date Title
EP2979127B1 (en) Display method and system
CN106066701B (en) A kind of AR and VR data processing equipment and method
JP4903888B2 (en) Image display device, image display method, and image correction method
Sauer et al. Augmented workspace: Designing an AR testbed
CN113382224B (en) Interactive handle display method and device based on holographic sand table
KR101198557B1 (en) 3D stereoscopic image and video that is responsive to viewing angle and position
CN107948631A (en) It is a kind of based on cluster and the bore hole 3D systems that render
EP3038061A1 (en) Apparatus and method to display augmented reality data
CN102799378B (en) A kind of three-dimensional collision detection object pickup method and device
JP6649010B2 (en) Information processing device
CN113382222B (en) Display method based on holographic sand table in user moving process
JP6963399B2 (en) Program, recording medium, image generator, image generation method
CN113891063B (en) Holographic display method and device
CN112752085A (en) Naked eye 3D video playing system and method based on human eye tracking
CN104216126A (en) Zooming 3D (third-dimensional) display technique
CN113376858A (en) Holographic display method and device based on holographic sand table
CN113485547A (en) Interaction method and device applied to holographic sand table
CN101908233A (en) Method and system for producing plural viewpoint picture for three-dimensional image reconstruction
KR20200115631A (en) Multi-viewing virtual reality user interface
EP3506629A1 (en) Multi-camera display
EP3707580A1 (en) Content generation apparatus and method
CN113382229B (en) Dynamic auxiliary camera adjusting method and device based on holographic sand table
CN113382225B (en) Binocular holographic display method and device based on holographic sand table
CN207603821U (en) A kind of bore hole 3D systems based on cluster and rendering
CN113206991A (en) Holographic display method, system, computer program product and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant