CN114882813B - Floating image system - Google Patents

Floating image system Download PDF

Info

Publication number
CN114882813B
CN114882813B CN202110068275.9A CN202110068275A CN114882813B CN 114882813 B CN114882813 B CN 114882813B CN 202110068275 A CN202110068275 A CN 202110068275A CN 114882813 B CN114882813 B CN 114882813B
Authority
CN
China
Prior art keywords
floating image
image display
display device
image information
floating
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110068275.9A
Other languages
Chinese (zh)
Other versions
CN114882813A (en
Inventor
杨钧翔
丁志宏
张凯杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mirage Start Co ltd
Original Assignee
Mirage Start Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mirage Start Co ltd filed Critical Mirage Start Co ltd
Priority to CN202110068275.9A priority Critical patent/CN114882813B/en
Publication of CN114882813A publication Critical patent/CN114882813A/en
Application granted granted Critical
Publication of CN114882813B publication Critical patent/CN114882813B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09F—DISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F19/00—Advertising or display means not otherwise provided for
    • G09F19/12—Advertising or display means not otherwise provided for using special optical effects
    • G09F19/18—Advertising or display means not otherwise provided for using special optical effects involving the use of optical projection means, e.g. projection of images on clouds
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Business, Economics & Management (AREA)
  • Accounting & Taxation (AREA)
  • Marketing (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

The invention discloses an aerial image system. The floating image system comprises a controller, a first floating image display device and a second floating image display device. The second floating image display device is detachably connected to the first floating image display device. The first floating image display device and the second floating image display device respectively provide a plurality of first floating image information and a plurality of second floating image information so as to jointly display an integrated floating image information.

Description

Floating image system
Technical Field
The present invention relates to a floating image system, and more particularly, to a floating image system that displays two-dimensional image information and three-dimensional floating image information simultaneously.
Background
Conventional image display systems are mainly two-dimensional flat display devices. Although the resolution of display devices in recent years continues to increase, it is possible to provide a better visual feeling to the user. But the image information provided by the display device is still at a fixed shooting angle.
Therefore, how to provide a multi-angle background floating image system has become one of the important issues to be resolved by the industry.
Disclosure of Invention
The technical problem to be solved by the present invention is to provide a floating image system for solving the shortcomings of the prior art, comprising: a controller; the first floating image display device is electrically connected with the controller; the second floating image display device is electrically connected with the controller and detachably connected with the first floating image display device; the first floating image display device and the second floating image display device respectively provide a plurality of first floating image information and a plurality of second floating image information so as to jointly display integrated floating image information.
Preferably, the method further comprises: the first floating image display device is connected with the second floating image display device through the connecting module, and an included angle is formed between the first floating image display device and the second floating image display device.
Preferably, the first floating image display device displays a plurality of first floating image information in a space of a first side of the first floating image display device, the second floating image display device displays a plurality of second floating image information in a space of a first side of the second floating image display device, and the integrated floating image is displayed in a space between the first floating image display device and the second floating image display device.
Preferably, the display device further comprises an environment detection device for detecting a plurality of first environment image information on a second side of the first floating image display device or a plurality of second environment image information on a second side of the second floating image display device, wherein the environment detection device is electrically connected to the controller, and the first environment image information and the second environment image information are transmitted to the controller.
Preferably, the controller displays a plurality of first adjusted ambient image information on a first display module of the first side of the first floating image display device according to the plurality of first ambient image information.
Preferably, the controller displays a plurality of second adjustment environment image information on a second display module of the first side of the second floating image display device according to the plurality of second environment image information.
Preferably, the system further comprises a sight line tracking sensor arranged on the first side of the first floating image display device or the first side of the second floating image display device for detecting a user sight line signal.
Preferably, the user gaze signal detected by the gaze tracking sensor comprises a pupil position and a gaze angle of a user.
Preferably, the controller adjusts the plurality of first adjustment environment image information displayed by the first display module or the plurality of second adjustment environment image information displayed by the second display module according to the user line-of-sight signal.
Preferably, the controller is communicatively connected to a server, and the controller of the floating image system transmits the plurality of first floating image information, the second floating image information, the integrated floating image information, the plurality of first environment image information, the plurality of second environment image information, the plurality of first adjustment environment image information, and the plurality of second adjustment environment image information to the server for calculation.
Preferably, the method further comprises: the storage module is electrically connected with the controller; the communication module is electrically connected with the controller; the power supply module is electrically connected with the controller and provides driving electric energy for the controller, the storage module, the communication module, the first floating image display device, the second floating image display device, the environment detection device and the sight tracking sensor; wherein the first plurality of floating image information, the second floating image information, the integrated floating image information, the first plurality of ambient image information, the second plurality of ambient image information, the first plurality of adjusted ambient image information, and the second plurality of adjusted ambient image information are stored in the storage module; the controller is in communication connection with the server through the communication module.
Preferably, the floating image system detects three-dimensional coordinate values of an object so as to enable the object to interact with the first floating image information, the second floating image information or the integrated floating image information displayed by the floating image system.
The invention also discloses a floating image system, which comprises: a controller; the first floating image display device is electrically connected with the controller, and when the first floating image display device is folded, the first floating image display device at least comprises a first floating image display area and a second floating image display area, the first floating image display area and the second floating image display area are adjacently arranged, and a display included angle is formed between the first floating image display area and the second floating image display area; the first floating image display area and the second floating image display area of the first floating image display device respectively provide a plurality of first floating image information and a plurality of second floating image information so as to jointly display integrated floating image information.
Preferably, the first floating image display device further includes a third floating image display area, the first floating image display area, the second floating image display area and the third floating image display area are disposed adjacently, the third floating image display area provides a plurality of third floating image information, and the plurality of first floating image information, the plurality of second floating image information and the third floating image information jointly display the floating image information.
The floating image system provided by the invention has the beneficial effects that the background information capable of simultaneously displaying two-dimensional image information and three-dimensional floating image information can be created through a single floating image display device or a plurality of floating image display devices, so that a rich visual environment is presented, and the user experience can be effectively improved.
For a further understanding of the nature and the technical aspects of the present invention, reference should be made to the following detailed description of the invention and the accompanying drawings, which are provided for purposes of reference only and are not intended to limit the invention.
Drawings
Fig. 1 is a schematic diagram of an aerial image system in accordance with a first embodiment of the present invention.
Fig. 2 is a schematic diagram of the first floating image display device and the second floating image display device together displaying an integrated floating image information.
Fig. 3 is a schematic diagram of first floating image and second floating image information.
Fig. 4 is another schematic view of the floating image display system of the present invention.
Fig. 5 is another schematic view of the floating image display system of the present invention.
Fig. 6 is another schematic diagram of the floating image display system of the present invention.
Fig. 7 is a schematic diagram of an aerial image system in accordance with a second embodiment of the present invention.
Fig. 8 is another schematic view of an aerial image system of a second embodiment of the present invention.
Fig. 9 is a schematic view of a first floating image display device of the present invention.
Fig. 10 is an exploded schematic view of the first floating image display device of the present invention.
Fig. 11 is a schematic diagram showing the relative arrangement of lens arrays of the first floating image display device of the present invention.
Fig. 12 is a schematic view showing a lens array staggered arrangement of the first floating image display device of the present invention.
Fig. 13 is a schematic view of a single lens focusing situation of the first floating image display device of the present invention.
FIG. 14 is a schematic diagram of the interaction of floating image information of a first floating image display device or a second floating image display device with an object.
FIG. 15 is another schematic diagram of the interaction of the floating image information of the first floating image display device or the second floating image display device with an object.
FIG. 16 is another schematic illustration of the interaction of floating image information of the first floating image display device or the second floating image display device with an object.
FIG. 17 is another schematic diagram of the interaction of the floating image information of the first floating image display device or the second floating image display device with an object.
Detailed Description
The following description is given of specific embodiments of the present invention with respect to an "floating image system", and those skilled in the art will appreciate the advantages and effects of the present invention from the disclosure herein. The invention is capable of other and different embodiments and its several details are capable of modification and variation in various respects, all from the point of view and application, all without departing from the spirit of the present invention. The drawings of the present invention are merely schematic illustrations, and are not intended to be drawn to actual dimensions. The following embodiments will further illustrate the related art content of the present invention in detail, but the disclosure is not intended to limit the scope of the present invention. In addition, the term "or" as used herein shall include any one or combination of more of the associated listed items as the case may be.
First embodiment
Referring to fig. 1, 2 and 3, fig. 1 is a schematic diagram of an aerial image system according to a first embodiment of the present invention. Fig. 2 is a schematic diagram of the first floating image display device and the second floating image display device together displaying an integrated floating image information. Fig. 3 is a schematic diagram of the first floating image display device and the second floating image display device displaying the first floating image information and the second floating image information, respectively.
In the present embodiment, the floating image system 1 includes a controller 11, a storage module 12, a communication module 13, a first floating image display device 14, a second floating image display device 15, an environment detecting device 16, a power module 17, and a sight tracking sensor 18.
The controller 11 is electrically connected to the storage module 12, the communication module 13, the first floating image display device 14, the second floating image display device 15, the environment detection device 16, the power module 17 and the gaze tracking sensor 18.
The second floating image display device 15 is detachably connected to the first floating image display device 14. That is, the first floating image display device 14 and the second floating image display device 15 may operate independently or cooperatively. The first floating image display device 14 is provided in connection with one side of the second floating image display device 15. In the present embodiment, the first floating image display device 14 is connected to the second floating image display device 14 through a connection module 19. The connection module 19 is a hinge. In other embodiments, the first floating image display device 14 may be electrically connected to the second floating image display device 15 to further improve the cooperating state.
The connection module 19 is disposed between the first floating image display device 14 and the second floating image display device 15. The first floating image display device 14 and the second floating image display device 15 have an angle θ therebetween.
In the present embodiment, when the first floating image display device 14 is connected to the second floating image display device 15, the first floating image display device 14 and the second floating image display device 15 respectively provide a plurality of first floating image information G1 and a plurality of second floating image information G2 to jointly display an integrated floating image information GIN. The plurality of first floating image information G1, the plurality of second floating image information G2, and the integrated floating image information GIN are all three-dimensional floating image information. That is, the user can view the floating image information from various angles.
That is, the first floating image display device 14 and the second floating image display device 15 may independently display a plurality of floating image information, respectively. The first floating image display device 14 and the second floating image display device 15 may also respectively provide a plurality of floating image information to be commonly displayed as one integrated floating image information GIN.
Further, in the present embodiment, the first floating image display device 14 displays a plurality of first floating image information G1 in a space on a first side of the first floating image display device 14. The second floating image display device 15 also displays a plurality of second floating image information in a space on a first side of the second floating image information G2 display device 15. That is, the integrated floating image information GIN is displayed in the space between the first floating image display device 14 and the second floating image display device 15.
In the present embodiment, the environment detection means 16 is provided on the second side of the first floating image display device 14. The environment detecting means 16 are for detecting a plurality of first environment image information EIN1 of a second side of the first floating image display device 14.
In other embodiments, the environment detecting device 16 may be disposed on the second side of the first floating image display device 14 or the second side of the second floating image display device 15, for detecting a plurality of first environment image information on the second side of the first floating image display device 14 or a plurality of second environment image information on the second side of the second floating image display device 15. In the present embodiment, the first side and the second side of the first floating image display device 14 are opposite sides. The first side and the second side of the second floating image display device 15 are also opposite sides. The second side of the second floating image display device 15 is below and the first side of the second floating image display device 15 is above. The environment detection device 16 transmits the first environment image information or the second environment image information to the controller 11.
The controller 11 displays a plurality of first adjusted ambient image information MEIN1 on a first display module 141 on a first side of the first floating image display device 14 according to the plurality of first ambient image information EIN 1.
In other embodiments, the controller 11 may display a plurality of second adjusted environmental image information MEIN2 on a second display module 151 on the first side of the second floating image display device 15 according to the plurality of second environmental image information EIN 2.
The first adjustment environment image information MEIN1 and the second adjustment environment image information MEIN2 may be calculated by predetermined two-dimensional image information or three-dimensional image information (image information having depth information).
The gaze tracking sensor 18 is disposed on the first side of the first floating image display device 14 or the first side of the second floating image display device 15 for detecting a user gaze signal. In the present embodiment, the gaze tracking sensor 18 is disposed on a first side of the first floating image display device 14. The gaze tracking sensor 18 is a camera unit (camera). The user gaze signal detected by gaze tracking sensor 18 includes a pupil position and a gaze angle of a user.
The controller 11 adjusts the plurality of first adjusted environmental image information MEIN1 displayed by the first display module 141 or the plurality of second adjusted environmental image information MEIN2 displayed by the second display module 151 according to the user line-of-sight signal.
Further, the controller 11 of the floating image system 1 may be communicatively connected to the server 9 through a communication module. The controller 11 in the floating image system 1 may transmit the plurality of first floating image information G1, the second floating image information G2, the integrated floating image information GIN, the plurality of first environment image information EIN1, the plurality of second environment image information EIN2, the plurality of first adjustment environment image information MEIN1, and the plurality of second adjustment environment image information MEIN2 to the server 9 to perform calculation. That is, the plurality of first adjustment environment image information MEIN1 and the plurality of second adjustment environment image information MEIN2 of the floating image system 1 may be adjusted according to the line of sight angle of the user. At this time, the environment seen from the view of the user is mutually blended with the plurality of first adjusted environment image information MEIN1 and the plurality of second adjusted environment image information MEIN 2. That is, the plurality of first adjustment environment image information MEIN1 and the plurality of second adjustment environment image information MEIN2 are image information showing the angle of the line of sight of the user, and the user does not feel that the view is blocked by the first floating image display device 14 and the second floating image display device 15 in front of the eyes, as seen in which direction the user looks. Instead, the user can see the environmental images behind the first floating image display device 14 and the second floating image display device 15 through the first floating image display device 14 and the second floating image display device 15, so that the visual field is widened or transparent.
The power module 17 is for providing driving power to the controller 11, the storage module 12, the communication module 13, the first floating image display device 14, the second floating image display device 15, the environment detecting device 16 and the sight tracking sensor 18.
The first floating image information G1, the second floating image information G2, the integrated floating image information GIN, the first environment image information EIN1, the second environment image information EIN2, the first adjusted environment image information MEIN1 and the second adjusted environment image information MEIN2 can be stored in the storage module 12 or the server 9.
The user line-of-sight signal directly affects the effect of the presentation of the ambient image information. That is, the user views the integrated floating image information GIN from the left side or the right side of the floating image system 1, and obtains the viewing experience of the first adjusted ambient image information MEIN1 at different angles. In addition, when the second floating image display device 15 also provides a plurality of second adjustment environment image information MEIN2, the user views the integrated floating image information GIN at different angles, and the viewing experience of the second adjustment environment image information MEIN2 at different angles can also be obtained.
The controller 11 is a Central Processing Unit (CPU), an image processor (GPU), an Application Specific Integrated Circuit (ASIC), or a Microprocessor (MCU).
The storage module 12 is a flash memory, a rom, a regularized rom, an electrically rewritable rom, an erasable regularized rom, or an electrically erasable regularized rom.
The communication module 13 includes a wired communication unit (not shown) and a wireless communication unit (not shown). The wired communication unit (not shown) may also be independently arranged to be in communication with the server 9, to receive control signals from the server 9 or to receive data from a database of the server 9. When the communication module 13 is a wireless communication unit, the communication module 13 may be a Wi-Fi communication unit, a bluetooth communication unit, a Zigbee communication unit (Zigbee), a LoRa communication unit, a Sigfox communication unit, or an NB-IoT communication unit.
The environment sensing device 16 at least comprises an image extraction unit. The environment sensing device 16 may be a visible light image extraction unit, an infrared image extraction unit, or a thermal imaging unit. In other embodiments, the environmental sensing device 16 may include an optical sensor, an image extraction module, a timer, a gyroscope sensor, a multi-dimensional acceleration sensor, or an odor sensor.
The power module 17 may be a dc-dc converter or an ac-dc converter. The power module 17 may also include a battery unit (not shown). The battery unit (not shown) is a lithium ion battery, a lithium manganese battery, a lithium polymer battery or a nickel-hydrogen battery.
The gaze tracking sensor 18 is an image extraction unit. The gaze tracking sensor 18 may be a visible light image extraction unit, an infrared image extraction unit, or a thermal imaging unit.
In addition, the floating image system 1 further includes a microphone MP and a speaker SP. The microphone MP and the speaker SP are electrically connected to the controller 11. The user can control and interact with the first floating image information G1, the second floating image information G2 or the integrated floating image information GIN by using the audio control signal through the microphone MP and the speaker SP.
Further, the controller 11, the storage module 12, the communication module 13, the first floating image display device 14, the second floating image display device 15, the environment detection means 16, the power supply module 17, the line-of-sight tracking sensor 18, the microphone MP, and the speaker SP may be provided in a housing (not shown).
In other embodiments, the controller 11, the storage module 12, the communication module 13, the environment detection device 16, the power module 17, the gaze tracking sensor 18, the microphone MP, and the speaker SP may be provided in the first floating image display device 14 or the second floating image display device 15. That is, either the first floating image display device 14 or the second floating image display device 15 can independently process two-dimensional image information or three-dimensional floating image information. When the first floating image display device 14 and the second floating image display device 15 are electrically connected, the respective components in the first floating image display device 14 and the second floating image display device 15 can be resource-shared with each other and cooperate with each other.
Before displaying the complete stereo image, the computer algorithm divides the complete image into different blocks, calculates the image of each block, focuses the light emitted by the display units of the first floating image display device in space to form the block, and combines the images of the different blocks to form the complete stereo image. 14 may display a portion of a full stereoscopic image, and 15 may display another portion of the full stereoscopic image, both of which may be combined into a full stereoscopic image.
Referring to fig. 4, 5 and 6, in the present embodiment, the floating image display system 1 may be connected by a plurality of floating image display devices, such as those of fig. 4, 5 and 6.
As shown in fig. 4, two floating image display devices FD01, FD02 are detachably provided on both sides of the first floating image display device 14 and the second floating image display device 15.
As shown in fig. 5, the floating image display devices FD01, FD02, FD03 are detachably connected in a lateral manner.
In fig. 6, six floating image display devices FD01, FD02, FD03, FD04, FD05, FD06 are used to construct a space, and the six floating image display devices are used to display respective floating image information, or the plurality of floating image display devices are used to display a plurality of integrated floating image information. In other embodiments, the floating image system 1 may include a plurality of floating image display devices connected in different manners to provide a plurality of floating image information.
In this embodiment, before the floating image system 1 displays the complete floating stereoscopic image, the controller 11 divides the complete image into different blocks according to a computer algorithm, and the image of each block is divided after calculation, and multiple light beams are provided by the display unit of the first floating image display device 14 or multiple display units of the second floating image display device 15 to focus and form the block in space, so that a complete floating stereoscopic image can be formed by combining the images of the different blocks. That is, the first floating image display device 14 may display a portion of a complete integrated floating image information GIN. The second floating image display device 15 can display another part of the integrated floating image information GIN, and the two can be combined into a complete integrated floating image information GIN.
In addition, the controller 11 adjusts the computer algorithm and the display units of the first floating image display device 14 and the display units of the second floating image display device 15 according to the included angle between the first floating image display device 14 and the second floating image display device 15, so that the first floating image display device 14 and the second floating image display device 15 provide light rays with proper angles to focus the collection in space to form the integrated floating image information GIN.
Second embodiment
Referring to fig. 7 and 8, fig. 7 is a schematic diagram of an aerial image system according to a second embodiment of the present invention. Fig. 8 is another schematic view of an aerial image system of a second embodiment of the present invention.
In the present embodiment, the floating image system 3 includes a controller 31, a storage module 32, a communication module 33, a first floating image display device 34, an environment detection device 36, a power module 37, and a gaze tracking sensor 38. The controller 31 is electrically connected to the storage module 32, the communication module 33, the first floating image display device 34, the environment detection device 36, the power module 37, and the gaze tracking sensor 38.
The floating image system 3 is similar to the floating image system 1, with the main difference that the first floating image display device 34 of the floating image system 3 is a foldable display device. That is, the mechanical design of the display module and the housing of the first floating image display device 34 allows the first floating image display device 34 to be folded into two display areas. That is, when the first floating image display device 34 is folded, the first floating image display device 34 includes at least a first floating image display area 34-1 and a second floating image display area 34-2. The first floating image display area 34-1 and the second floating image display area 34-2 are disposed adjacently. That is, the folded-thick first floating image display device 34 is folded into two display areas. The first floating image display area 34-1 and the second floating image display area 34-2 have a display angle α therebetween. The display angle alpha may be between 0 and 179 degrees. In other embodiments, the display angle α may be an obtuse angle.
The first and second floating image display areas 34-1 and 34-2 of the first floating image display device 34 may display different floating image information, respectively. The first floating image display area 34-1 and the second floating image display area 34-2 can also respectively provide a plurality of first floating image information and a plurality of second floating image information to jointly display an integrated floating image information GIN.
As shown in fig. 8, the first floating image display device 34 is folded into three display areas, that is, the first floating image display device 34 in fig. 8 includes a first floating image display area 34-1, a second floating image display area 34-2, and a third floating image display area 34-3. The first, second and third floating image display areas 34-1, 34-2 and 34-3 are adjacently disposed. Similarly, the first, second and third floating image display areas 34-1, 34-2 and 34-3 may provide a plurality of floating image information, respectively. The first floating image display area 34-1, the second floating image display area 34-2 and the third floating image display area 34-3 can also respectively provide the first floating image information, the second floating image information and the third floating image information to jointly display at least one integrated floating image information GIN.
Referring to fig. 9, 10, 11, 12 and 13, fig. 9 is a schematic diagram of a first floating image display device according to the present invention. Fig. 10 is an exploded schematic view of the first floating image display device of the present invention. Fig. 11 is a schematic diagram showing the relative arrangement of lens arrays of the first floating image display device of the present invention. Fig. 12 is a schematic view showing a lens array staggered arrangement of the first floating image display device of the present invention. Fig. 13 is a schematic view of a single lens focusing situation of the first floating image display device of the present invention.
The first floating image display device 14 and the second floating image display device 15 have similar structures and functions, and the structure and functions of the second floating image display device 15 will not be described in detail below by taking the first floating image display device 14 as an example.
The first floating image display device 14 includes a first display module 141, a lens array layer 142 and a microstructure layer 143, and can change the stereoscopic image frame seen by the viewer in the angular position by changing the display image, so that the viewer can view the stereoscopic image in other viewing angle positions.
In addition, the microstructure layer 143 is a dynamic optical element layer. That is, the microstructure layer 143 has a microstructure functional mode and a no microstructure functional mode. The micro-structure layer 143 can be adjusted to a micro-structure functional mode or a non-micro-structure functional mode according to a control signal. When the microstructured layer 143 is switched to the microstructured functional mode, it can be used to modulate the angular direction of light. When the micro structure layer 143 is switched to the micro structure function free mode, the first floating image display device 14 is used to display two-dimensional image information, and three-dimensional image information floating in a space on the side of the first floating image display device 14 is not displayed. However, in the present embodiment, the first floating image display device 14 may display two-dimensional image information and floating image information at the same time.
The micro-structure layer 143 is a Liquid crystal lens array layer (Liquid LENS LAYER) including a plurality of micro-structure Liquid crystal lenses, and the lens array layer is also a Liquid crystal lens array layer (Liquid LENS LAYER) including a plurality of optical adjustment Liquid crystal lenses. That is, the first floating image display device 14 is a display device including at least two liquid crystal lens array layers, and in other embodiments, the first floating image display device 14 may include more liquid crystal lens array layers for light adjustment. Furthermore, in other embodiments, the first floating image display device 14 may be configured to adjust the light of different numbers of first floating image display devices 14 in different areas. In addition, the lens array layer 142 includes a first structural lens array layer (not shown) and a second structural lens array layer (not shown). The first structural lens array layer (not shown) has a lens structure that can be used to manipulate the light field, and the second structural lens array layer (not shown) does not have a lens structure.
The lens array layer 142 may be disposed on a second (middle) layer, and the lens array layer 142 has the effect of modulating the light field. The condensing lens can regulate and control the light angle of the three-dimensional object, so that a user can see different angles of the three-dimensional image to generate a depth three-dimensional sense. Different condensing lenses can give different angle information to the object point, light is converged into the air by the different lenses to form a point with depth data, and information indicating one point in space can be divided into different light angles to be recorded in pixels of the different lenses. The curvature of the condensing lens is determined by the material of the lens and is combined with the flat panel display 141 of the first layer to determine the height, the viewing angle range and the definition of the stereoscopic image. The image displayed by the display surface 1411 that has not been reconstructed can be focused by the lens array layer 142 into a space above the lens instead of the upper surface of the lens. In other embodiments, the microstructured layer may not be included.
The first display module 141 may be a general flat panel display, and the first display module 141 has a display surface 1411 for displaying images. The lens array layer 142 is disposed adjacent to the display surface 1411 of the first display module 141, i.e., the lens array layer 142 may be disposed above the first display module 141. The lens array layer 142 may contact the display surface 1411 of the first display module 141, and the lens array layer 142 may be disposed at a distance from the display surface 1411 of the first display module 141, or an intermediate layer may be disposed between the display surface 1411 of the first display module 141 and the lens array layer 142.
The first display module 141 may be disposed at the lowest layer, and is responsible for displaying a planar image that has not undergone light reproduction, and the planar image may be redistributed and combined by the lens array of the lens array layer 142, so as to display a reconstructed three-dimensional stereoscopic image. The first display module 141 of the first layer only needs to display the target image, so any hardware configuration including a mobile phone, a tablet or a flat screen is possible, the type and configuration of the display 1 are not limited, and the first display module 141 may be a self-luminous display.
The lens array layer 142 may be disposed at the uppermost layer, the lens array layer 142 has the effect of adjusting and controlling the light field, and the lens array layer 142 can adjust and control the light angle of the stereoscopic object, so that the planar images which have not been recombined originally can be redistributed and combined, and then the viewer can see the three-dimensional stereoscopic image.
The lens array layer 142 is made of a material having good optical characteristics, and the material of the lens array layer 142 is not limited. The lens array layer 142 may include a base portion 1421 and a plurality of lenses 1422, the plurality of lenses 1422 are disposed on one surface of the base portion 1421, that is, the plurality of lenses 1422 may be disposed on one surface of the base portion 1421 away from the first display module 141, the arrangement and structure of the lens array layer 142 are not limited, the plurality of lenses 1422 have a focusing function, and the image not yet reconstructed displayed on the display surface 1411 can be recombined through the lens array layer 142 to be recombined into an integrated image, so as to form a stereoscopic image.
The first display module 141 can be any specification as long as the algorithm is applicable, that is, the first display module 141 has an image calculating unit 1412, so that the image of the display 1 needs to be calculated by the image algorithm, and the calculation is matched with the architecture of the lens array to predict various paths of the light beam traveling of the lens array so as to calculate the relative position of the image.
The lens array layer 142 of the present invention has a very important relation to the display effect, and as shown in fig. 9, the lens array may be arranged in a rectangular arrangement, so that the lenses 1422 of every two adjacent columns may be arranged in opposite directions. As shown in fig. 10, the arrangement of the lens arrays may be a hexagonal arrangement, so that the lenses 1422 of every two adjacent rows may be staggered, and the plurality of lenses 1422 may be arranged in other arrangements, so as to display 3D image information.
The microstructure on the lens array layer 142 is a lens with focusing function, and the size of the micro lens will determine the focusing capability of the lens according to the refractive index n value of the material, and the wavelength range of the light can be 300nm to 1100nm. The single lenslet focal length situation is shown in FIG. 11, which corresponds to the formula: 1/f= (n-1) (1/R1-1/R2). Wherein R1 and R2 are the radii of curvature of the two sides of the lens, f is the focal length of the lens, and n is the refractive index of the lens. In addition, the lens diameter is from 100um to 5mm, which is suitable for the pixel size of different display devices. In other embodiments, the microstructure of the lens array layer 142 may be an aspheric lens or a thick lens, and the optical characteristics of the microstructure are different from those of the above-mentioned lens maker, which is not limited in the present invention. In other embodiments, the lens array layer 142 may not include any microstructures.
Referring to fig. 14, 15, 16 and 17, fig. 14 is a schematic diagram showing interaction between floating image information of a first floating image display device or a second floating image display device and an object. FIG. 15 is another schematic diagram of the interaction of the floating image information of the first floating image display device or the second floating image display device with an object. FIG. 16 is another schematic illustration of the interaction of floating image information of the first floating image display device or the second floating image display device with an object. FIG. 17 is another schematic diagram of the interaction of the floating image information of the first floating image display device or the second floating image display device with an object.
The user can interact with the first floating image information G1, the second floating image information G2 or the integrated floating image information GIN by using fingers, the electronic interactive glove ECL and the pen-type interactive component PT.
That is, a sensor 149 of the first floating image display device 14 may be used to detect coordinate values of a predetermined detection point of the object OB (user's hand), for example, at least one predetermined coordinate value of the index finger of the user, the electronic interactive glove ECL, and a predetermined coordinate value of the pen point of the pen-type interactive assembly PT. The sensor 149 continuously records a moving track of the predetermined detection point of the object OB within a predetermined time. The sensor 149 transmits a plurality of coordinate values of a moving track of a predetermined detection point of the object OB within a predetermined time to the controller 11. The controller 11 determines the interaction state of the first floating image information G1 according to at least one predetermined coordinate value of the index finger of the user, the ECL of the electronic interactive glove, or the predetermined coordinate value of the pen point of the pen-type interaction component PT. In the present embodiment, the sensor 149 is a 3D sensor, an optical sensor, an infrared sensor, a dual-axis camera sensor, or a radar sensor.
Similarly, the second floating image information G2 displayed by the second floating image display device 15, the integrated floating image information GIN displayed by the first floating image display device 14 and the second floating image display device 15 together may also interact with the finger, the electronic interaction glove ECL, and the pen-type interaction component P to determine the subsequent image display content.
Further, the user can directly draw lines, planes and three-dimensional patterns provided in the space by using the first floating image display device 14, the second floating image display device 15, and the first and second floating image display devices 14 and 15.
As shown in fig. 14, 15, 16 and 17, the user may draw a plurality of tracks PH1-PHN in the space of one side of the first floating image display device 14 using the hand OB, the pen-type interaction assembly PT, and the electronic interaction glove ECL. The tracks are then moved, adjusted or linked to create a first floating image information G1.
In addition, the first floating image display device 14 may further include a program including a plurality of function processing programs corresponding to the plurality of three-dimensional function buttons FBN. The plurality of three-dimensional function buttons FBN are displayed in the space on one side of the first floating image display device 14 by the first display module 141 in the same manner as the first floating image information G1.
The user can select one of the plurality of three-dimensional function buttons FBN, for example, color, zoom, adjust the material, etc., and process a partial area or a whole area of the first floating image information G1.
That is, the user can selectively process the planar area, the stereoscopic area, or the entire area formed by the plurality of tracks. Similar to the previous embodiment, the first floating image information G1 may be displayed in an exploded view in a space on one side of the first floating image display device 14.
Further, the first floating image display device 14 may be communicatively connected to the server 9 through the controller 11 and the communication module. The server 9 may take over the calculation of a number of trajectories of the first aerial image information G1. In this embodiment, the operation of the two-dimensional image information and the three-dimensional image information may be processed by the first floating image display device 14 and the controller 11, or may be performed by the remote server 9, and the calculated two-dimensional image information and three-dimensional image information may be transmitted to the controller 11.
Advantageous effects of the embodiment
The floating image system provided by the invention has the beneficial effects that the background information capable of simultaneously displaying two-dimensional image information and three-dimensional floating image information can be created through a single floating image display device or a plurality of floating image display devices, so that a rich visual environment is presented, and the user experience can be effectively improved.
The above disclosure is only a preferred embodiment of the present invention and is not intended to limit the claims of the present invention, so that all equivalent technical changes made by the application of the specification and the drawings of the present invention are included in the claims of the present invention.

Claims (9)

1. An aerial image system, comprising:
A controller;
The first floating image display device comprises a first side and a second side, wherein the first side and the second side of the first floating image display device are opposite sides and are electrically connected with the controller; and
The second floating image display device comprises a first side and a second side, the first side and the second side of the second floating image display device are opposite sides and are electrically connected with the controller, and the second floating image display device is detachably connected with the first floating image display device;
the first floating image display device is connected with the second floating image display device through the connecting module, and an included angle is formed between the first floating image display device and the second floating image display device;
An environment detection device for detecting a plurality of first environment image information on the second side of the first floating image display device or a plurality of second environment image information on the second side of the second floating image display device, wherein the environment detection device is electrically connected to the controller, and the first environment image information and the second environment image information are transmitted to the controller; and
The sight tracking sensor is electrically connected with the controller and used for detecting a sight angle of a user;
Wherein an integrated floating image information is cut into two or more partial display areas, so that the first floating image display device and the second floating image display device respectively provide a plurality of three-dimensional first floating image information and a plurality of three-dimensional second floating image information corresponding to a partial display area, so as to jointly display the integrated floating image information in a space between the first side of the first floating image display device and the first side of the second floating image display device;
The controller displays a plurality of two-dimensional first adjustment environment image information on a first display module of the first side of the first floating image display device according to the plurality of first environment image information;
The controller displays a plurality of two-dimensional second adjustment environment image information on a second display module of the first side of the second floating image display device according to the plurality of second environment image information, and the controller provides the first adjustment environment image information or the second adjustment environment image information corresponding to the line of sight angle of the user according to the line of sight angle of the user.
2. The floating image system of claim 1, wherein the gaze tracking sensor is disposed on the first side of the first floating image display device or the first side of the second floating image display device for detecting a user gaze signal.
3. The floating imaging system of claim 2, wherein said user gaze signal detected by said gaze tracking sensor comprises a pupil position of a user and said gaze angle.
4. A floating image system as recited in claim 3, wherein the controller adjusts the plurality of first adjusted ambient image information displayed by the first display module or the plurality of second adjusted ambient image information displayed by the second display module based on the user line-of-sight signal.
5. The floating image system of claim 4 wherein the controller is communicatively coupled to a server, the controller of the floating image system transmitting the plurality of first floating image information, the second floating image information, the integrated floating image information, the plurality of first ambient image information, the plurality of second ambient image information, the plurality of first adjusted ambient image information, and the plurality of second adjusted ambient image information to the server for calculation.
6. The floating imaging system of claim 5, further comprising:
the storage module is electrically connected with the controller;
the communication module is electrically connected with the controller; and
The power supply module is electrically connected with the controller and provides driving electric energy for the controller, the storage module, the communication module, the first floating image display device, the second floating image display device, the environment detection device and the sight tracking sensor;
Wherein the first plurality of floating image information, the second floating image information, the integrated floating image information, the first plurality of ambient image information, the second plurality of ambient image information, the first plurality of adjusted ambient image information, and the second plurality of adjusted ambient image information are stored in the storage module;
the controller is in communication connection with the server through the communication module.
7. The floating image system of claim 1 wherein the floating image system interacts with the plurality of first floating image information, the plurality of second floating image information, or the integrated floating image information displayed by the floating image system by detecting three-dimensional coordinate values of an object.
8. An aerial image system, comprising:
A controller;
The first floating image display device comprises a first side and a second side, the first side and the second side of the first floating image display device are opposite, the first side and the second side of the first floating image display device are electrically connected with the controller, the first floating image display device is foldable, when the first floating image display device is folded, the first floating image display device at least comprises a first floating image display area and a second floating image display area, the first floating image display area and the second floating image display area are positioned on the first side of the first floating image display device, the first floating image display area and the second floating image display area are adjacently arranged, and a display included angle is formed between the first floating image display area and the second floating image display area;
An environment detection device for detecting a plurality of first environment image information on a second side of the first floating image display device, the environment detection device being electrically connected to the controller, the first environment image information being transmitted to the controller; and
The sight tracking sensor is electrically connected with the controller and used for detecting a sight angle of a user;
Wherein an integrated floating image information is cut into two or more partial display areas, so that the first floating image display area and the second floating image display area of the first floating image display device respectively provide a plurality of three-dimensional first floating image information and a plurality of three-dimensional second floating image information to jointly display the integrated floating image information in a space between the first floating image display area and the second floating image display area;
wherein the controller displays a plurality of two-dimensional first adjustment environment image information on the first floating image display area of the first side of the first floating image display device according to the plurality of first environment image information;
wherein the controller is configured to provide the first adjusted environmental image information corresponding to a viewing angle of the user according to the line of sight angle of the user.
9. The floating image system of claim 8 wherein the first floating image display device further comprises a third floating image display area, the first floating image display area, the second floating image display area being disposed adjacent to the third floating image display area, the third floating image display area providing a plurality of third floating image information, the plurality of first floating image information, the plurality of second floating image information, and the third floating image information collectively displaying the integrated floating image information.
CN202110068275.9A 2021-01-19 2021-01-19 Floating image system Active CN114882813B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110068275.9A CN114882813B (en) 2021-01-19 2021-01-19 Floating image system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110068275.9A CN114882813B (en) 2021-01-19 2021-01-19 Floating image system

Publications (2)

Publication Number Publication Date
CN114882813A CN114882813A (en) 2022-08-09
CN114882813B true CN114882813B (en) 2024-05-14

Family

ID=82668323

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110068275.9A Active CN114882813B (en) 2021-01-19 2021-01-19 Floating image system

Country Status (1)

Country Link
CN (1) CN114882813B (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005045824A (en) * 2004-08-06 2005-02-17 Canon Inc Stereoimage regeneration system with its control method and storage medium
JP2008089984A (en) * 2006-10-02 2008-04-17 Pioneer Electronic Corp Image display device
JP2013031139A (en) * 2011-07-29 2013-02-07 Nidek Co Ltd Stereoscopic image display device, program and recording medium
CN106932899A (en) * 2015-12-31 2017-07-07 广东未来科技有限公司 Self-adoptive trace formula 3 d display device and stereoscopic display mobile phone
CN109634431A (en) * 2019-01-22 2019-04-16 像航（上海）科技有限公司 No medium floating projects visual pursuit interaction systems
CN110189660A (en) * 2019-06-06 2019-08-30 中国科学院长春光学精密机械与物理研究所 A kind of immersion panorama floating imaging system
JP3225817U (en) * 2020-01-27 2020-04-02 幻景▲ケイ▼動股▲フン▼有限公司 Electronic products with 3D display devices

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008041313A1 (en) * 2006-10-02 2008-04-10 Pioneer Corporation Image display device
CN102150072B (en) * 2008-07-10 2013-08-21 实景成像有限公司 Broad viewing angle displays and user interfaces
US9179140B2 (en) * 2010-10-19 2015-11-03 Mitsubishi Electric Corporation 3dimension stereoscopic display device
US9804635B2 (en) * 2014-02-06 2017-10-31 Samsung Electronics Co., Ltd. Electronic device and method for controlling displays
US9723300B2 (en) * 2014-03-17 2017-08-01 Spatial Intelligence Llc Stereoscopic display
US9612687B2 (en) * 2014-07-01 2017-04-04 Microsoft Technology Licensing, Llc Auto-aligned illumination for interactive sensing in retro-reflective imaging applications
US20160195849A1 (en) * 2015-01-05 2016-07-07 Intel Corporation Facilitating interactive floating virtual representations of images at computing devices
TWI634350B (en) * 2016-08-10 2018-09-01 群睿股份有限公司 Method for displaying image

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005045824A (en) * 2004-08-06 2005-02-17 Canon Inc Stereoimage regeneration system with its control method and storage medium
JP2008089984A (en) * 2006-10-02 2008-04-17 Pioneer Electronic Corp Image display device
JP2013031139A (en) * 2011-07-29 2013-02-07 Nidek Co Ltd Stereoscopic image display device, program and recording medium
CN106932899A (en) * 2015-12-31 2017-07-07 广东未来科技有限公司 Self-adoptive trace formula 3 d display device and stereoscopic display mobile phone
CN109634431A (en) * 2019-01-22 2019-04-16 像航（上海）科技有限公司 No medium floating projects visual pursuit interaction systems
CN110189660A (en) * 2019-06-06 2019-08-30 中国科学院长春光学精密机械与物理研究所 A kind of immersion panorama floating imaging system
JP3225817U (en) * 2020-01-27 2020-04-02 幻景▲ケイ▼動股▲フン▼有限公司 Electronic products with 3D display devices

Also Published As

Publication number Publication date
CN114882813A (en) 2022-08-09

Similar Documents

Publication Publication Date Title
JP6751594B2 (en) Display device and operation method of display device
US11782193B1 (en) Liquid lens structure with adjustable optical power
US9030749B2 (en) Bifocal head-up display system
US11102467B2 (en) Array detector for depth mapping
EP2842331B1 (en) Auto-stereoscopic display device and driving method
EP3518025B1 (en) Near-eye display device
US11683472B2 (en) Superstereoscopic display with enhanced off-angle separation
CN104216118A (en) Head Mounted Display With Remote Control
CN111381674B (en) Multi-user display and method of operating the same
US20180048883A1 (en) Image display apparatus and image display method
KR102082781B1 (en) Foldable display and method and apparatus for controlling thereof
CN105388613A (en) Image generation equipment, head-up display and method for generating image
JP2015149718A (en) Display apparatus and controlling method thereof
CN107765438B (en) Image display device and image display method
US9727144B2 (en) 3D interaction apparatus, display device including the same, and method of driving the same
JP3245276U (en) Floating 3D image display system
US11448898B2 (en) Floating image system
TWI654448B (en) Image display device
CN114882813B (en) Floating image system
JP5793099B2 (en) Display device, electronic device and control circuit
US20150015484A1 (en) Display device
CN114827566B (en) Floating three-dimensional image display system
CN110879477B (en) True three-dimensional imaging method based on super-surface micro-lens array
US11044460B1 (en) Polychromatic object imager
US10957240B1 (en) Apparatus, systems, and methods to compensate for sub-standard sub pixels in an array

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant