CN109963141B - Visual display system and method and head-mounted display device - Google Patents

Visual display system and method and head-mounted display device Download PDF

Info

Publication number
CN109963141B
CN109963141B CN201711422735.3A CN201711422735A CN109963141B CN 109963141 B CN109963141 B CN 109963141B CN 201711422735 A CN201711422735 A CN 201711422735A CN 109963141 B CN109963141 B CN 109963141B
Authority
CN
China
Prior art keywords
image content
image
mapping relation
optical device
image source
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201711422735.3A
Other languages
Chinese (zh)
Other versions
CN109963141A (en
Inventor
卢智雄
戴景文
贺杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Virtual Reality Technology Co Ltd
Original Assignee
Guangdong Virtual Reality Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Virtual Reality Technology Co Ltd filed Critical Guangdong Virtual Reality Technology Co Ltd
Priority to CN201711422735.3A priority Critical patent/CN109963141B/en
Publication of CN109963141A publication Critical patent/CN109963141A/en
Application granted granted Critical
Publication of CN109963141B publication Critical patent/CN109963141B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/332Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/346Image reproducers using prisms or semi-transparent mirrors
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/398Synchronisation thereof; Control thereof
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/014Head-up displays characterised by optical features comprising information/image processing systems

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

The application relates to a visual display system and a visual display method, and a head-mounted display device. The visual display system includes: an image source, an open-hole 3D film overlaying the image source, and optics disposed adjacent the image source. The image content played by the image source can be imaged in the optical device, wherein the image source is used for playing the image content to be played, and the image content is refracted by the naked eye 3D film and then divided into two groups of light rays emitted towards different directions so as to respectively form a first image content and a second image content. According to the visual display system, the naked eye 3D film is arranged in front of the image source, the naked eye 3D film can refract image content played by the image source into the first image content and the second image content, so that the image source can display the image content to be played in a full screen mode, the visual angle can be increased when stereoscopic display is carried out, and the visual experience of a user is improved.

Description

Visual display system and method and head-mounted display device
Technical Field
The present application relates to the field of light field display, and in particular, to a visual display system and method applied to light field display, and a head-mounted display device.
Background
With the development of technology, machine intelligence and information intelligence are becoming popular, and technologies for identifying user images through visual devices such as machine vision or virtual vision to realize man-machine interaction are becoming important.
Head Mounted Displays (HMDs) have long proven to be very valuable for many applications, spanning the fields of scientific visualization, medical and military training, engineering and prototyping, remote manipulation and telepresence, and personal entertainment systems. In mixed reality and augmented reality systems, optically-see-through HMDs are one of the basic methods of combining computer-generated virtual scenes with views of real-world scenes. Computer-generated images are optically overlaid onto the real world view, typically by an optical combiner, an optical see-through head-mounted display (OST-HMD), while maintaining a direct minimally degraded view of the real world. Modern computing and display technologies have facilitated the development of systems for "Virtual Reality (VR)" or "Augmented Reality (AR)" experiences, in which digitally rendered images or portions thereof are presented to a user in a manner in which they appear to be authentic or can be considered authentic. Virtual reality or "VR" scenes typically involve the presentation of digital or virtual image information, while being opaque to other actual real world visual inputs; augmented reality or "AR" scenes generally involve the presentation of digital or virtual image information as an enhancement to the visualization of the real world around the user.
In most of the existing AR/VR display technologies, a display having two display surfaces is generally used for projection, the two display surfaces of the display are projected to an optical device at the same time, and a left eye image and a right eye image are respectively formed, and the left eye image and the right eye image imaged in the optical device are respectively projected to the left eye and the right eye of a user, so that binocular stereoscopic vision is formed. However, due to the limitation of physical structure, in the above-mentioned AR/VR display technology, a binocular stereoscopic vision effect needs to be formed, the angle of view (FIELDANGLE OF VIEW, FOV) is small, the field of view is approximately square, it is difficult to bring a better immersion feeling to the user, and the square field of view gives people a very narrow visual experience of a window, and the visual feeling is poor.
Content of the application
An objective of an embodiment of the present application is to provide a visual display system and a method with a larger field angle, which are used for solving the above technical problems. It is also necessary to provide a head-mounted display device to which the above visual display system is applied.
The embodiment of the application provides a visual display system which is applied to AR/VR light field display. The visual display system includes an image source, an open-hole 3D film overlaying the image source, and optics disposed adjacent the image source. The image content played by the image source can be imaged in the optical device, wherein the image source is used for playing the image content to be played, and the image content is refracted by the naked eye 3D film and then divided into two groups of light rays emitted towards different directions so as to respectively form a first image content and a second image content.
In some embodiments, the image source is a non-three-dimensional stereoscopic display, and the naked-eye 3D film is attached to a display screen of the image source.
In some embodiments, the image source includes a display screen, and the naked eye 3D film is attached to the display screen, so that the image source and the naked eye 3D film are jointly presented as a naked eye 3D display.
Wherein in some embodiments the optic is a single concave mirror, the concave surface of the optic being disposed toward the image source.
Wherein in some embodiments the optic comprises two foci, the foci being offset to both sides of the optic with respect to the geometric center of the optic, respectively.
Wherein in some embodiments the optic is a concave mirror that both reflects light and transmits light, the image source being disposed toward the concave curved surface of the optic.
In some embodiments, the concave curved surface of the optical device includes a plurality of micro-structure curved surfaces, the curvatures of the micro-structure curved surfaces are the same, and the micro-structure curved surfaces are closely arranged.
Wherein in some embodiments, the visual display system further comprises an adjustment mechanism coupled to the image source, the adjustment mechanism for adjusting a distance between the image source and the optics.
Wherein in some embodiments, the visual display system further comprises a zoom mechanism disposed between the image source and the optics.
The embodiment of the application also provides a head-mounted display device, which comprises a glasses body, a wearing fixing piece connected to the glasses body, and the visual display system of any one of the above, wherein the visual display system is arranged on the head-mounted display device, the optical device is arranged on the glasses body and used as a lens display of the head-mounted display device, and the image source is connected to the glasses body.
The embodiment of the application also provides a head-wearing display device, which comprises a glasses body and a wearing fixing piece connected to the glasses body, and further comprises: the image source interface is used for installing an image source; the naked eye 3D film is arranged adjacent to the image source interface; and an optical device disposed adjacent to the image source interface to enable image content played by the image source to be imaged in the optical device. The image source is used for playing image contents to be played so as to allow the image contents to be refracted by the naked eye 3D film and then divided into two groups of light rays emitted towards different directions, so that a first image content and a second image content are formed respectively.
The embodiment of the application also provides a visual display method applied to AR light field display, comprising the following steps: providing an optical device and an image source, so that the image source can project image content to be played to the optical device; providing a naked eye 3D film, and enabling the naked eye 3D film to cover and be attached to a display screen of the image source; and controlling the image source to play the image content to be played, wherein the image content is refracted towards different directions to form a first image content and a second image content after passing through the naked eye 3D film, and is projected onto the optical device at the same time.
In some embodiments, before the image source plays the image content to be played, distortion correction is performed on the image content to be played.
Wherein, in some embodiments, before the image source plays the image content to be played, the method further comprises: acquiring optical parameters of the optical device; calculating a first forward mapping relation and a first reverse mapping relation between distortion of first image content observed by a user and the first image content according to the optical parameters; calculating a second forward mapping relation and a second reverse mapping relation between distortion of second image content observed by a user and the second image content according to the optical parameters; and rendering the image content to be played by utilizing the first reverse mapping relation and the second direction mapping relation.
Compared with the prior art, in the visual display system provided by the embodiment of the application, the naked eye 3D film is arranged in front of the image source, and the naked eye 3D film can refract the image content played by the image source into the first image content and the second image content, so that the left eye and the right eye of a user can respectively see the first image content and the second image content, the image source does not need to be divided into a left eye image part and a right eye image part, the optical device does not need to be divided into a left eye display part and a right eye display part, the image source can display the image content to be played in a full screen mode, the visual angle of the visual display system is enlarged, the visual display system can have a larger depth of field, and the visual experience of the user is improved.
Drawings
In order to more clearly illustrate the technical solutions of the present application, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of a visual display system according to an embodiment of the present application;
FIG. 2 is a schematic diagram of another view of the visual display system shown in FIG. 1;
FIG. 3 is a schematic cross-sectional view of the optics of the visual display system shown in FIG. 1;
FIG. 4 is a schematic view of the concave curved surface of the optic of the visual display system of FIG. 1;
FIG. 5 is a schematic view of an imaging optical path of optics of the visual display system shown in FIG. 1;
FIG. 6 is a schematic diagram of a visual display system provided in accordance with another embodiment of the present application;
FIG. 7 is a schematic diagram of a visual display system provided by yet another embodiment of the present application;
FIG. 8 is a schematic diagram of a visual display system provided in accordance with yet another embodiment of the present application;
FIG. 9 is a schematic diagram of a visual display system provided by yet another embodiment of the present application;
Fig. 10 is a schematic diagram of a head-mounted display device according to an embodiment of the present application.
Detailed Description
The following description of the embodiments of the present application will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present application, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
It will be understood that when an element is referred to as being "fixed to" another element, it can be directly on the other element or intervening elements may also be present. When a component is considered to be "connected" to another component, it can be directly connected to the other component or intervening components may also be present. When an element is referred to as being "disposed on" another element, it can be directly on the other element or intervening elements may also be present.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein in the description of the application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. The term "and/or" as used herein includes any and all combinations of one or more of the associated listed items.
Referring to fig. 1 and 2, embodiments of the present application provide a visual display system 100, methods, systems and articles of manufacture for stereoscopic vision for virtual reality and/or augmented reality, particularly for virtual reality, augmented reality applications, and other applications such as near-eye display, computing and display applications, or even plain text display, and the like.
In particular, in the embodiment shown in fig. 1 and 2, the visual display system 100 includes an image source 10, optics 30, and an open-hole 3D film 50. The optical device 30 is disposed adjacent to the image source 10, and the naked eye 3D film 50 is disposed between the image source 10 and the optical device 30. When the visual display system 100 works, the image source 10 plays the image content to be played, and the image content to be played can be projected onto the optical device 30 through the naked eye 3D film 50 and imaged on the optical device 30, so that a user can view the image content reflected by the optical device 30 to establish a light field display.
In some embodiments, the image source 10 includes a display screen 11 for playing content to be played, the naked eye 3D film 50 is attached to the display screen 11, after the image content played by the display screen 11 is refracted by the naked eye 3D film, two groups of light rays emitted towards different directions are separated to form a first image content and a second image content respectively, and due to different light ray directions, only light with the same prism direction as that in the naked eye 3D film 30 can enter human eyes, and finally, the left eye and the right eye of a user can receive different images, thereby forming three-dimensional stereoscopic vision. Therefore, after the image content played by the display screen 11 passes through the naked eye 3D film 50, a first image content and a second image content are formed and projected onto the optical device 30 at the same time, the first image content and the second image content can be seen by the left eye and the right eye of the user respectively, and the first image content and the second image content are overlapped with each other in the brain of the user, so that the user can see the stereoscopic image.
Further, the naked eye 3D film 50 includes a prism array (not shown) for refracting light such that only light rays coincident with the direction of the prisms are visible to the user's eyes. Further, the width of the prism array is a preset width, the angle of the prism array is a preset angle, and the focal length of the prism array is a preset focal length, so that after the first image content and the second image content formed by the light rays refracted by the prism array are imaged in the optical device 30, the first image content and the second image content can be reflected to the left eye and the right eye of the user respectively, that is, the left eye of the user only sees the first image content, and the right eye of the user only sees the second image content, thereby enabling the user to see the stereoscopic image.
Because the visual display system 100 is disposed before the image source 10 by using the naked eye 3D film 50, the naked eye 3D film 30 can refract the image content played by the image source 10 into the first image content and the second image content, so that the left eye and the right eye of the user can see the first image content and the second image content respectively, the image source 10 does not need to be divided into a left eye image portion and a right eye image portion, the optical device 30 does not need to be divided into a left eye display portion and a right eye display portion, the image source 10 can display the image content to be played in a full screen manner, the viewing angle of the visual display system 100 is enlarged, the visual display system 100 can have a larger depth of field, and the visual experience of the user is improved. Meanwhile, since the image source 10 does not need to be divided into a left eye image portion and a right eye image portion, the optical device 30 does not need to be divided into a left eye display portion and a right eye display portion, and the user does not have vertical stripes for blocking the line of sight when watching, so that the visual experience of the user is further improved.
In some embodiments, the image source 10 may include any type of self-emissive or illuminating pixel array for playing video, for example, the image source may include, but is not limited to, a liquid crystal on silicon (LCoS) display device, a Liquid Crystal Display (LCD) panel, an Organic Light Emitting Display (OLED), a ferroelectric liquid crystal on silicon (FLCoS) device, a Digital Mirror Device (DMD), a micro-projector or micro-projector based on the foregoing, a projector bundle such as a laser projector or a fiber optic scanner bundle, or any other suitable type of micro-display device.
It will be appreciated that in other embodiments, the optical display system 100 may not include the image source 10, but instead may be provided by a user as the image source 10. At this time, the optical display system 100 may include an image source interface, and the image source 10 is a display connected to the image source interface. In a specific embodiment, the image source interface is used to install and connect with the image source 10 (or the external image source 10) provided by the user.
It will be appreciated that the image source 10 may be a non-three-dimensional stereoscopic display, and the first image content and the second image content may be formed by refracting the played image content by means of the naked eye 3D film overlaid on the display screen 11.
It will be appreciated that in other embodiments, the naked eye 3D film 50 may be integrated into the image source 10 such that the image source 10 appears as a naked eye 3D stereoscopic display. Specifically, the image source 10 may include the display screen 11 and the naked eye 3D film, where the naked eye 3D film covers and is attached to the display screen 11.
It will also be appreciated that in other embodiments, the naked eye 3D film 50 may be omitted and the image source 10 is a naked eye 3D display. The naked eye 3D display can emit light rays emitted towards different directions simultaneously to form the first image content and the second image content, and finally, the left eye and the right eye of a user can receive different images, so that three-dimensional stereoscopic vision is formed. It will be appreciated that in other embodiments, the image source 10 may include an open-hole 3D display screen, where the open-hole 3D display screen is configured to emit light rays emitted in different directions, so as to form the first image content and the second image content.
The optics 30 are used to present the image content played by the image source 10. In this embodiment, the optical device 30 is a concave mirror, and its concave curved surface 32 is disposed toward the image source 10. Further, the optical device 30 is a single concave mirror.
Further, referring to fig. 4, the concave curved surface 32 of the optical device 30 includes a plurality of micro-structural curved surfaces 321, and the micro-structural curved surfaces 321 are invisible to the naked eye. In this embodiment, the curvatures of the micro-structure cambered surfaces 321 are the same, and the micro-structure cambered surfaces 321 are closely arranged, so that the focal point of the optical device 30 may be an eccentric focal point.
Further, the focal point of the optical device 30 is an off-center focal point, i.e. the focal point of the optical device 30 is offset with respect to the geometric center of the optical device 30. Referring to fig. 5, in some embodiments, the optical device 30 has two focuses, and the two focuses of the optical device 30 are respectively offset towards two opposite sides thereof, so that the two focuses are respectively adapted to the left eye and the right eye of the user, and thus the image seen by the user from the optical device 30 is in the middle portion, so as to further improve the visual effect of the visual display system 100.
Further, in particular in the embodiment shown in fig. 5, the optical device 30 has a first focus F1 and a second focus F2. The first focus F1 and the second focus F2 are offset towards opposite sides of the optical device 30, respectively, with respect to the geometrical center of the optical device 30. The image content in the image source 10 forms a virtual image 13 in the optical device 30, enabling a user to observe the virtual image 13 in the optical device 30. Since the focal point of the optical device 30 is an eccentric focal point, the left eye image content seen by the left eye of the user can be located at the center of the left eye field of view of the user, that is, the optical path L11 from the left edge of the virtual image 13 to the left eye of the user is equal to the optical path L12 from the right edge of the virtual image 13 to the left eye of the user; likewise, the right eye image content seen by the right eye of the user can be located in the center of its right eye field of view, i.e., the optical path L21 from the left edge of the virtual image 13 to the right eye of the user is equal to the optical path L22 from the right edge of the virtual image 13 to the right eye of the user. Thus, the user, whether viewing for the left or right eye, sees an image from the optic 30 that is centered in the field of view, enabling the user to obtain a good visual experience.
When the visual display system 100 described above is applied to a near-eye display, such as a head-mounted display device (fig. 10), the focal length of the optics 30 may be small. For example, the focal length of the optic 30 may be greater than or equal to 1 centimeter. When the visual display system 100 is applied to a normal AR light field display, or a naked eye 3D display, the focal length of the optical device 30 may be relatively large, for example, the focal length of the optical device 30 may range from one centimeter to several meters. It will be appreciated that the focal length range of the optical device 30 may be set according to practical requirements, and is not limited to that described in the present specification.
Further, the optical device 30 is a transflective concave mirror capable of reflecting light and transmitting light, so that the image content played by the image source 10 can form a virtual image in the optical device 30, and a user can observe the real environment in front through the optical device 30, so that the played content on the optical device 30 can be fused and superimposed with the real environment more naturally.
Further, when the optical device 30 is a transflective concave mirror capable of reflecting light and transmitting light, the transmittance of the optical device for light ranges from: more than 0% and less than 100%, and is specifically designed according to actual requirements.
Referring also to fig. 3, in some embodiments, the optical device 30 includes a lens body 34 and a transflective film layer 36. The transparent and reflective film 36 is disposed on the side of the lens body 34 facing the user, so that the image content played in the image source 10 can be directly reflected by the transparent and reflective film 36 and enter the eyes of the user, thereby avoiding the influence of the thickness of the optical device 30 on the refraction of light, and being beneficial to improving the display effect of the visual display system 100.
In some embodiments, the transflective film layer 36 may be a reflective film or a thin reflective film. When the transflective film layer 36 is a thin reflective film, the thin reflective film is a nano-sized thickness film having a thickness of about several tens nanometers to hundred nanometers. It will be appreciated that the transflective film layer 36 may cover a portion of the area of the lens body 34 or may cover the entire surface of the lens body 34. It will be appreciated that in some embodiments, the transflective film layer 36 may also be disposed on the side of the lens body 34 facing away from the noted side.
Compared to the prior art, in the visual display system 100 provided in the embodiment of the present application, the naked eye 3D film 50 is disposed before the image source 10, so that the naked eye 3D film 50 can refract the image content played by the image source 10 into the first image content and the second image content, so that the left eye and the right eye of the user can see the first image content and the second image content respectively, the image source 10 does not need to be divided into a left eye image portion and a right eye image portion, the optical device 30 does not need to be divided into a left eye display portion and a right eye display portion, the image source 10 can display the image content to be played in a full screen, the viewing angle of the visual display system 100 is enlarged, the visual display system 100 can have a larger depth of field, and the visual experience of the user is improved.
It will be appreciated that in a specific embodiment, the specific setting position of the image source 10 is not limited, but may be sufficient to ensure that the user can observe a virtual image of the image content played in the image source 10 in the optical device 30. It will also be appreciated that in other embodiments, the optic 30 may be a structure other than a concave mirror, such as a flat mirror, a convex lens, or the like.
For example, referring again to fig. 1, the optical device 30 is a concave mirror, and the display screen 11 of the image source 10 is disposed toward the concave curved surface 32 of the optical device 30. Further, the display screen 11 of the image source 10 is arranged substantially perpendicular to the optical axis 31 of the optical device 30.
For another example, referring to fig. 6, the optical device 30 is a concave mirror, the display screen 11 of the image source 10 is disposed towards the optical axis 31 of the optical device 30, and the image content played by the image source 10 is reflected into the optical device 30 via a reflecting member 12. Further, the display screen 11 of the image source 10 is arranged substantially parallel to the optical axis 31 of the optical device 30.
For another example, referring to fig. 7, the optical device 30 is a concave mirror, the display screen 11 of the image source 10 is disposed away from the optical axis 31 of the optical device 30, and the image content played by the image source 10 is reflected into the optical device 30 via a reflecting member 14.
For another example, referring to fig. 8, the optical device 30 is a plane mirror, the display screen 11 of the image source 10 is disposed towards the optical device 30, and the image content played by the image source 10 is projected into the optical device 30 through a convex lens 16.
For another example, referring to fig. 9, the optical device 30 is a concave lens, the display 11 of the image source 10 is disposed towards the optical device 30, and the optical device 30 is located between the image source 10 and the eyes of the user. The image content played by the image source 10 is projected into the human eye through the naked eye 3D film 50 and the optical device 30. Further, the image source 10, the naked eye 3D film 50, and the optical device 30 are sequentially disposed along the optical axis 31 of the optical device 30. At this time, the visual display system 100 may be applied to a VR display device.
It should be appreciated that the visual display system 100 provided in the embodiment of the present application may be applied to a method, a system and a product for stereoscopic vision of virtual reality and/or augmented reality, and may also be applied to technologies such as naked eye 3D display, AR light field display, near-eye display, and the like.
For example, in some specific embodiments, the visual display system 100 may be applied to AR light field display, the optics 30 may be used as a semi-transparent display screen, and the image source 10 and the naked eye 3D film 50 may be used as a player.
Further, to facilitate controlling the imaging of the play content in the optical device 30, the visual display system 100 may further comprise an adjustment mechanism (not shown in the figure) for adjusting the object distance of the image source 10 in front of the optical device 30 and adjusting the imaging depth of the play content. Specifically, the adjustment mechanism is coupled to the image source 10, which may be an electric motor mechanism or other suitable mechanism. Further, in order to facilitate adjusting parameters such as the imaging size or definition, depth/distance of the imaging plane, etc. of the playing content in the optical device 30, the visual display system 100 may further include a zooming mechanism (not shown in the figure). The zoom mechanism may be disposed between the image source 10 and the optics 30. Specifically, the zooming mechanism may be a manual zooming mechanism or an electric zooming mechanism, and the zooming mechanism may generally include a lens assembly, which is not described in detail in this specification.
As another example, in some other embodiments, the visual display system 100 may be applied to a near-eye display, such as in the head-mounted display device 200 shown in fig. 10.
Meanwhile, the embodiment of the application further provides a head-mounted display device 200, referring to fig. 1 and 10, the head-mounted display device 200 includes a glasses body 201 and a wearing fixing member 203 connected to the glasses body 201, and in this embodiment, the wearing fixing member 203 is an adjustable elastic belt. The visual display system 100 is disposed in the head-mounted display device 200, specifically, the optical device 30 is disposed in front of the glasses body 201 and is used as a lens display of the head-mounted display device 200, and the image source 10 and the naked eye 3D film 50 are connected to the glasses body 201 or disposed in the glasses body 201.
In this embodiment, in order to facilitate adjusting parameters such as the imaging size or definition, the depth/distance of the imaging plane, etc. of the playing content in the optical device 30, the visual display system 100 may further include a zooming mechanism (not shown in the figure). The zoom mechanism is disposed within the eyeglass body 201 and may be located between the image source 10 and the optics 30. Specifically, the zooming mechanism may be a manual zooming mechanism or an electric zooming mechanism, and the zooming mechanism may generally include a lens assembly, which is not described in detail in this specification.
Further, the head-mounted display device 200 further includes a controller 205 disposed on the glasses body 201. The controller 205 is disposed at a side of the glasses body 201, and is used for controlling the visual display system 100 and providing an operation portion for a user to operate the head-mounted display device 200. In some embodiments, the controller 205 may include an operation panel 2051 and a display panel 2053, where the operation panel 2051 may be a key panel for controlling play content, imaging depth, display color, display brightness, play volume, and the like, and accordingly, the operation panel 2051 may include a play content selection key, an imaging depth adjustment key, a display color adjustment key, a display brightness adjustment key, a volume adjustment key. The display panel 2053 is configured to display a current state of the head mounted display device 200, such as a playing content, an imaging depth, a display color, a display brightness, or/and a current time, a current power, a current volume, or the like.
It will be appreciated that in other embodiments, the optical display system 100 may not include the image source 10 in the head mounted display apparatus 200, but an image source (e.g., a smart play device such as a cell phone, etc.) provided by a user may be used as the image source 10. At this time, the optical display system 100 includes an image source interface 90, and the naked eye 3D film 50 is disposed in the glasses body 201 and adjacent to the image source interface 90, and the image source interface 90 is used for installing and connecting with the image source 10 provided by the user. In use, a user inserts his own image source 10 directly onto the image source interface 90 with the naked eye 3D film 50 in front of the inserted image source 10.
Further, the head-mounted display device 200 further includes an image generation processor (not shown in the figure), which is built in the controller 205 and is used for controlling the playing content of the optical display system 100. In particular, in some embodiments, the image generation processor is capable of converting images or video associated with the play content into a format that can be projected onto the optical device 30. For example, in generating 3D content, the play content may need to be formatted such that a portion of a particular image is displayed on a particular depth plane and other portions are displayed at other depth planes (i.e., controlling imaging depth of different portions in the same image); or all images may be generated at a particular depth plane; or the image generation processor may be configured to present slightly different images to the left and right eyes of the user, respectively, so as to generate the first image content and the second image content, so that when the two eyes of the user observe together, the playing content is coherent and comfortable, and can also present more realistic stereoscopic images; or the image generation processor may be configured to correct distortion of the image content to be played to enhance the stereoscopic effect of the visual display system 100.
Further, the image generation processor may further include a memory, a CPU (central processing unit), a GPU (graphics processing unit), and other circuits for image generation and processing. The image generation processor may be programmed with the desired play content to be presented to a user of the virtual reality or augmented reality system.
In addition, the embodiment of the application also provides a visual display method which can be applied to any one of the visual display systems in the embodiment or/and the head-mounted display device. Wherein the visual display system comprises an image source, optics, and an open-hole 3D film. The image source is used for projecting image content to be played to the optical device, and the naked eye 3D film is used for refracting the image content played by the image source 10 into first image content and second image content, so that left and right eyes of a user can respectively see the first image content and the second image content. The visual display method comprises the following steps:
Step S101: and providing an optical device, and setting a preset included angle between the optical axis of the optical device and the sight line of a user.
Further, the range of the first preset included angle is as follows: greater than 0 degrees and less than 90 degrees. Wherein, in some embodiments, the optical device is a transflective concave mirror that can reflect light and transmit light, and the transmittance of the optical device for light ranges from: greater than 0% and less than 100%. The optical device comprises a lens body and a transflective film layer, wherein the transflective film layer is arranged on one side of a concave curved surface of the lens body.
Step S103: providing an image source, enabling a display screen of the image source to project image content to be played to the optical device.
Further, when the image source is set, a display screen of the image source is set toward the optical device. Wherein in some embodiments, the display screen of the image source is disposed toward a concave curved surface of the optical device having the transflective film layer thereon.
Step S105: and providing a naked eye 3D film, and enabling the naked eye 3D film to be arranged between the optical device and the image source.
Further, the naked eye 3D film covers and is attached to the display screen of the image source.
Further, the naked eye 3D film includes a prism array (not shown) for refracting light such that only light rays coincident with the direction of the prisms can be seen by the user's eyes. Further, the width of the prism array is a preset width, the angle of the prism array is a preset angle, and the focal length of the prism array is a preset focal length, so that after the first image content and the second image content formed by the light rays refracted by the prism array are imaged in the optical device, the first image content and the second image content can be reflected to the left eye and the right eye of the user respectively, that is, the left eye of the user only sees the first image content, and the right eye of the user only sees the second image content, thereby enabling the user to see the stereoscopic image.
Step S107: and controlling the image source to play the image content to be played. After passing through the naked eye 3D film, the image content played by the image source is refracted towards different directions to form a first image content and a second image content, and is projected onto the optical device at the same time, the first image content and the second image content can be seen by the left eye and the right eye of a user respectively, and the first image content and the second image content are mutually overlapped in the brain of the user, so that the user can see stereoscopic images.
It will be appreciated that in some embodiments, step S105 may be omitted, in which case the image source is a naked eye 3D display. The naked eye 3D display can emit light rays emitted towards different directions simultaneously to form the first image content and the second image content, and finally, the left eye and the right eye of a user can receive different images, so that three-dimensional stereoscopic vision is formed. It will be appreciated that in other embodiments, the image source may include an open-hole 3D display screen, where the open-hole 3D display screen is configured to emit light emitted in different directions to form the first image content and the second image content.
In some embodiments, before the image source plays the image content, distortion correction is performed on the image content, so as to avoid distortion of the edges of the image content seen when the user observes the corresponding image content by a single eye, and thereby eliminate or/and reduce the ghost phenomenon of the edges of the image content finally seen by the user. Specifically, when the image content is subjected to distortion correction, the image content to be played is subjected to anti-distortion treatment respectively, so that when a user observes the corresponding image content in a single eye, the observed image content is a horizontal and vertical picture, thereby eliminating the ghost image finally imaged in human eyes and improving the stereoscopic display effect of the image. The above distortion correction may include the steps of:
Step S1072: acquiring optical parameters of the optical device, and calculating a first forward mapping relation between distortion of first image content observed by the left eye of a user and original first image content according to the optical parameters; it should be understood that, the original first image content is understood to be the first image content that is formed by refracting the image content played by the image source after passing through the naked eye 3D film;
in some embodiments, the optical parameter is a focal parameter of the optical device. It will be appreciated that in other embodiments, the optical parameter may be a curvature parameter or/and a focus parameter of the optical device, etc.;
Step S1073: calculating a first inverse mapping relation of distortion of original first image content and first image content observed by left eyes of a user;
Step S1074: simulating the first forward mapping relation and the first reverse mapping relation by using a function; observing the distortion degree of the first image content observed by the left eye of the simulated user relative to the original first image content, if the distortion degree is within the error allowable range, confirming a first forward mapping relation and a first reverse mapping relation, and if the distortion degree is not within the error allowable range, recalculating the first forward mapping relation and the first reverse mapping relation;
step S1075: confirming a second mapping relation between the distortion of the second image content observed by the right eye of the user and the original second image content according to the optical parameters; it should be understood that, the original second image content is understood to be the second image content that is formed by refracting the image content played by the image source after passing through the naked eye 3D film;
Step S1076: calculating a second inverse mapping relation of distortion of the original second image content and the second image content observed by the right eye of the user;
step S1077: simulating the second forward mapping relation and the second reverse mapping relation by using a function; observing the distortion degree of the second image content observed by the right eye of the simulated user relative to the original second image content, if the distortion degree is within the error allowable range, confirming a second forward mapping relation and a second reverse mapping relation, and if the distortion degree is not within the error allowable range, recalculating the second forward mapping relation and the second reverse mapping relation; and
Step S1078: and rendering the image content to be played in the image source by utilizing the first reverse mapping relation and the second reverse mapping relation.
The visual display system 100 provided by the application can be applied to a method, a system and a product for three-dimensional vision of virtual reality and/or augmented reality, and can also be applied to technologies such as naked eye 3D display, AR light field display, near-to-eye display and the like. Since the naked eye 3D film 50 is disposed before the image source 10, the naked eye 3D film 30 can refract the image content played by the image source 10 into the first image content and the second image content, the image source 10 displays the single image of the image content to be played in full screen, and the first image content and the second image content are generated simultaneously by the naked eye 3D film 50, and the single concave mirror is adopted as the optical device 30, so that the visual display system 100 has a larger viewing angle and a larger depth of field, and the visual effect presented by the system is relatively good.
Meanwhile, as the optical device 30 is adopted as the imaging element, the image content played by the image source 10 can be imaged in the optical device 30, and the image distance can reach beyond one meter or more meters, so that a user does not need to fixedly watch a traditional 3D display screen in a short distance, the eyestrain of the user can be effectively relieved, and the user experience is improved.
Further, the head-mounted display device 100 is used for being worn on the head of the user, and the position of the eyes of the user is always approximately fixed relative to the visual reality system 100 no matter what posture the user takes, and no matter where the user is, so that the stereoscopic effect presented by the visual display system 100 is well ensured, thereby avoiding the inconvenience that the user needs to sit/stand at a fixed position in the conventional 3D display.
Further, the visual display system 100 described above can be applied to the AR field, allowing the user to use with the head tracker, which is advantageous for realizing more realistic stereoscopic effect.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and are not limiting; although the application has been described in detail with reference to the foregoing embodiments, it will be appreciated by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not drive the essence of the corresponding technical solutions to depart from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims (6)

1. A visual display system for use in AR/VR light field display, the visual display system comprising:
An image source;
A naked eye 3D film covering the image source; and
The optical device is arranged adjacent to the image source, so that image content played by the image source can be imaged in the optical device, the optical device is a single concave mirror, a concave curved surface of the optical device is arranged towards the image source, the optical device comprises two focuses, and the two focuses are respectively arranged in an offset manner towards two sides of the optical device relative to the geometric center of the optical device;
The image source is used for carrying out anti-distortion processing on the image content to be played and playing the image content to be played after the anti-distortion processing, and the image content is divided into two groups of rays emitted towards different directions after being refracted by the naked eye 3D film so as to respectively form first image content after the anti-distortion processing and second image content after the anti-distortion processing;
the anti-distortion processing of the image content to be played comprises the following steps:
acquiring optical parameters of the optical device;
According to the optical parameters, calculating a first forward mapping relation and a first reverse mapping relation between distorted first image content observed by a user and first image content formed by refraction of the naked eye 3D film;
Simulating the distortion degree of the distorted first image content observed by the user relative to the first image content formed by refraction of the naked eye 3D film based on the first forward mapping relation and the first reverse mapping relation, and if the distortion degree is not within the error allowable range, recalculating the first forward mapping relation and the first reverse mapping relation;
According to the optical parameters, calculating a second forward mapping relation and a second reverse mapping relation between distorted second image content observed by a user and second image content formed by refraction of the naked eye 3D film;
Simulating the distortion degree of the distorted second image content observed by the user relative to the second image content formed by refraction of the naked eye 3D film based on the second forward mapping relation and the second reverse mapping relation, and if the distortion degree is not within the error allowable range, recalculating the second forward mapping relation and the second reverse mapping relation;
And rendering the image content to be played in the image source by utilizing the first reverse mapping relation and the second reverse mapping relation.
2. The visual display system of claim 1 wherein the image source is a non-three-dimensional stereoscopic display,
The naked eye 3D film is attached to the display screen of the image source;
Or/and the image source comprises a display screen, and the naked eye 3D film is attached to the display screen, so that the image source and the naked eye 3D film are jointly displayed as a naked eye 3D display.
3. The visual display system of claim 1 wherein the optics are concave mirrors that reflect light as well as transmit light, the image source being disposed toward the concave curved surface of the optics;
Or/and the concave curved surface of the optical device comprises a plurality of micro-structure cambered surfaces, the curvatures of the micro-structure cambered surfaces are the same, and the micro-structure cambered surfaces are closely arranged;
Or/and, the visual display system further comprises an adjusting mechanism connected to the image source, the adjusting mechanism being used for adjusting the distance between the image source and the optical device;
Or/and, the visual display system further comprises a zoom mechanism disposed between the image source and the optics.
4. The utility model provides a wear display device, includes the glasses body and connects wear the mounting on the glasses body, its characterized in that still includes the visual display system of any one of claims 1~ 3, visual display system sets up on the wear display device, the optics install in the glasses body to as wear display device's lens display uses, the optics is single concave mirror, the concave curved surface of optics is towards the image source setting, the optics includes two focuses, two the focus is relative to the geometric center of optics is respectively to the both sides skew setting of optics, the image source is connected in the glasses body.
5. The utility model provides a wear display device, includes the glasses body and connects wear the mounting on the glasses body, its characterized in that still includes:
The image source interface is used for installing an image source;
the naked eye 3D film is arranged adjacent to the image source interface; and
The optical device is arranged adjacent to the image source interface, so that image content played by the image source can be imaged in the optical device, the optical device is a single concave mirror, a concave curved surface of the optical device is arranged towards the image source, the optical device comprises two focuses, and the two focuses are respectively arranged to two sides of the optical device in an offset mode relative to the geometric center of the optical device;
The image source is used for carrying out anti-distortion processing on the image content to be played, and playing the image content to be played after the anti-distortion processing, so as to allow the image content to be divided into two groups of rays emitted towards different directions after being refracted by the naked eye 3D film, and a first image content after the anti-distortion processing and a second image content after the anti-distortion processing are respectively formed;
The image source performs anti-distortion processing on the image content to be played, and the method comprises the following steps: acquiring optical parameters of the optical device; according to the optical parameters, calculating a first forward mapping relation and a first reverse mapping relation between distorted first image content observed by a user and first image content formed by refraction of the naked eye 3D film; simulating the distortion degree of the distorted first image content observed by the user relative to the first image content formed by refraction of the naked eye 3D film based on the first forward mapping relation and the first reverse mapping relation, and if the distortion degree is not within the error allowable range, recalculating the first forward mapping relation and the first reverse mapping relation; according to the optical parameters, calculating a second forward mapping relation and a second reverse mapping relation between distorted second image content observed by a user and second image content formed by refraction of the naked eye 3D film; simulating the distortion degree of the distorted second image content observed by the user relative to the second image content formed by refraction of the naked eye 3D film based on the second forward mapping relation and the second reverse mapping relation, and if the distortion degree is not within the error allowable range, recalculating the second forward mapping relation and the second reverse mapping relation; and rendering the image content to be played in the image source by utilizing the first reverse mapping relation and the second reverse mapping relation.
6. A visual display method, applied to AR light field display, comprising:
Providing an optical device and an image source, enabling the image source to project image content to be played to the optical device, wherein the optical device is a single concave mirror, a concave curved surface of the optical device is arranged towards the image source, the optical device comprises two focuses, and the two focuses are respectively arranged to two sides of the optical device in an offset manner relative to the geometric center of the optical device;
providing a naked eye 3D film, and enabling the naked eye 3D film to cover and be attached to a display screen of the image source; and
Controlling the image source to perform anti-distortion processing on the image content to be played, playing the image content subjected to the anti-distortion processing, and refracting the image content towards different directions to form first image content subjected to the anti-distortion processing and second image content subjected to the anti-distortion processing after passing through the naked eye 3D film, and simultaneously projecting the first image content and the second image content subjected to the anti-distortion processing onto the optical device;
The controlling the image source to carry out anti-distortion processing on the image content to be played comprises the following steps: acquiring optical parameters of the optical device; according to the optical parameters, calculating a first forward mapping relation and a first reverse mapping relation between distorted first image content observed by a user and first image content formed by refraction of the naked eye 3D film; simulating the distortion degree of the distorted first image content observed by the user relative to the first image content formed by refraction of the naked eye 3D film based on the first forward mapping relation and the first reverse mapping relation, and if the distortion degree is not within the error allowable range, recalculating the first forward mapping relation and the first reverse mapping relation; according to the optical parameters, calculating a second forward mapping relation and a second reverse mapping relation between distorted second image content observed by a user and second image content formed by refraction of the naked eye 3D film; simulating the distortion degree of the distorted second image content observed by the user relative to the second image content formed by refraction of the naked eye 3D film based on the second forward mapping relation and the second reverse mapping relation, and if the distortion degree is not within the error allowable range, recalculating the second forward mapping relation and the second reverse mapping relation; and rendering the image content to be played in the image source by utilizing the first reverse mapping relation and the second reverse mapping relation.
CN201711422735.3A 2017-12-25 2017-12-25 Visual display system and method and head-mounted display device Active CN109963141B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711422735.3A CN109963141B (en) 2017-12-25 2017-12-25 Visual display system and method and head-mounted display device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711422735.3A CN109963141B (en) 2017-12-25 2017-12-25 Visual display system and method and head-mounted display device

Publications (2)

Publication Number Publication Date
CN109963141A CN109963141A (en) 2019-07-02
CN109963141B true CN109963141B (en) 2024-04-26

Family

ID=67021168

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711422735.3A Active CN109963141B (en) 2017-12-25 2017-12-25 Visual display system and method and head-mounted display device

Country Status (1)

Country Link
CN (1) CN109963141B (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6222675B1 (en) * 1998-12-01 2001-04-24 Kaiser Electro-Optics, Inc. Area of interest head-mounted display using low resolution, wide angle; high resolution, narrow angle; and see-through views
CN104280886A (en) * 2014-09-25 2015-01-14 清华大学 Microscopic system and microscopic method based on in-situ three-dimensional enhanced display
CN104714303A (en) * 2015-03-12 2015-06-17 深圳市安华光电技术有限公司 Single-image-source binocular near-to-eye display device
CN105894473A (en) * 2016-04-20 2016-08-24 北京小鸟看看科技有限公司 FPGA-based image rectification method and apparatus
CN106162203A (en) * 2016-07-05 2016-11-23 实野文化传媒(上海)有限公司 Panoramic video player method, player and wear-type virtual reality device
CN106447602A (en) * 2016-08-31 2017-02-22 浙江大华技术股份有限公司 Image mosaic method and device
CN106444058A (en) * 2016-09-28 2017-02-22 惠州Tcl移动通信有限公司 Virtual reality display helmet-mounted device and optical component
CN106873162A (en) * 2017-03-14 2017-06-20 上海天马微电子有限公司 The pixel arrangement method of display device, display device and near-eye display device
CN206497255U (en) * 2017-02-14 2017-09-15 毛颖 Augmented reality shows system

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8896579B2 (en) * 2012-03-02 2014-11-25 Adobe Systems Incorporated Methods and apparatus for deformation of virtual brush marks via texture projection
US9946343B2 (en) * 2016-04-26 2018-04-17 Oculus Vr, Llc Motion tracker with an array of distinct light sources

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6222675B1 (en) * 1998-12-01 2001-04-24 Kaiser Electro-Optics, Inc. Area of interest head-mounted display using low resolution, wide angle; high resolution, narrow angle; and see-through views
CN104280886A (en) * 2014-09-25 2015-01-14 清华大学 Microscopic system and microscopic method based on in-situ three-dimensional enhanced display
CN104714303A (en) * 2015-03-12 2015-06-17 深圳市安华光电技术有限公司 Single-image-source binocular near-to-eye display device
CN105894473A (en) * 2016-04-20 2016-08-24 北京小鸟看看科技有限公司 FPGA-based image rectification method and apparatus
CN106162203A (en) * 2016-07-05 2016-11-23 实野文化传媒(上海)有限公司 Panoramic video player method, player and wear-type virtual reality device
CN106447602A (en) * 2016-08-31 2017-02-22 浙江大华技术股份有限公司 Image mosaic method and device
CN106444058A (en) * 2016-09-28 2017-02-22 惠州Tcl移动通信有限公司 Virtual reality display helmet-mounted device and optical component
CN206497255U (en) * 2017-02-14 2017-09-15 毛颖 Augmented reality shows system
CN106873162A (en) * 2017-03-14 2017-06-20 上海天马微电子有限公司 The pixel arrangement method of display device, display device and near-eye display device

Also Published As

Publication number Publication date
CN109963141A (en) 2019-07-02

Similar Documents

Publication Publication Date Title
US10054797B2 (en) Combining a high resolution narrow field display and a mid resolution wide field display
US10602033B2 (en) Display apparatus and method using image renderers and optical combiners
US20220311992A1 (en) System and method for displaying an object with depths
CN207625712U (en) Vision display system and head-wearing display device
CN107728319B (en) Visual display system and method and head-mounted display device
US20180018943A1 (en) Dual display immersive screen technology
CN107111143B (en) Vision system and film viewer
CN113272710A (en) Extending field of view by color separation
CN109963145B (en) Visual display system and method and head-mounted display device
CN109963142B (en) Visual display system and method and head-mounted display device
CN207516640U (en) Vision display system and head-wearing display device
TW201805688A (en) Display adjustment method for near-eye display device wherein the effect of focusing image multiple times can be achieved if the image outputted to one, or any two or more layers of the display module is processed in a symmetrical manner
CN110967828A (en) Display system and head-mounted display device
US20220163816A1 (en) Display apparatus for rendering three-dimensional image and method therefor
CN109963141B (en) Visual display system and method and head-mounted display device
JP2019106723A (en) Display device and display method using context display and projector
CN108873346A (en) Compact waveguide light field augmented reality display device
CN207625713U (en) Vision display system and head-wearing display device
Hua et al. Near-eye displays: state-of-the-art and emerging technologies
CN207625711U (en) Vision display system and head-wearing display device
CN218524969U (en) Image display device and vehicle
US20230115411A1 (en) Smart eyeglasses
CN208834001U (en) Display system and head-wearing display device
US20230258937A1 (en) Hybrid waveguide to maximize coverage in field of view (fov)
US20240069346A1 (en) Multi-laser illuminated mixed waveguide display with volume bragg grating (vbg) and mirror

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant