WO2016086439A1

WO2016086439A1 - Auto-aligning light-transmitting head-worn display device

Info

Publication number: WO2016086439A1
Application number: PCT/CN2014/093531
Authority: WO
Inventors: 杨小康; 翟广涛; 李铎; 闵雄阔
Original assignee: 上海交通大学
Priority date: 2014-12-04
Filing date: 2014-12-11
Publication date: 2016-06-09
Also published as: CN104483753A

Abstract

The invention provides an auto-aligning light-transmitting head-worn display device, comprising: a head-worn eyepiece frame (1) for mounting and connecting each part of the auto-aligning light-transmitting head-worn display device and facilitating wearing by a user; a display device (3); an image acquisition device for receiving external image information; a projection device for projecting the image; various sensors for collecting eyepiece state information and surrounding environment information; and a data processing center responsible for an operation algorithm and a feedback algorithm for feeding back to the projection device (2) a processed image obtained by a camera and processed sensor data; the auto-aligning light-transmitting head-worn display device acquires real scenes in real time, and utilizes the transmitting and reflecting properties of a semi-transparent film, such that when the camera acquires an image, an equivalent display position is completely superposed with human eyes, and the display of the projection device and a scene of the real world are superposed, thus enhancing vision.

Description

Self-aligning transmissive head-mounted display device

Technical field

The present invention relates to the field of augmented reality head mounted devices, and in particular to a self-aligned transmissive head mounted display device.

Background technique

Modern mobile terminals are becoming more and more popular in people's lives, and they are playing an increasingly important role in people's lives. The functions of end products such as laptops and smart phones are becoming more and more powerful as people's application demands increase. Nowadays, many new types of smart phones integrate video and audio playback, voice communication, web browsing and many other functions. They can also be used for photographing, video recording or video surveillance. The application prospects are very wide.

However, traditional mobile terminals have their own limitations, that is, these systems require two-handed operation, and people cannot use their hands to liberate their hands. For some special environments, such as weightless environment in space capsules, battlefield detection, traffic command or high-altitude climbing and other specific environments, it is impossible to free up the cumbersome operations, which greatly restricts the space that mobile terminals play.

With the development of technology, head-mounted display devices are becoming more and more well known to the public. The so-called head-mounted display device, as its name suggests, is a display device that can be worn on the head and can be easily used without the need for two-hand operation. Head-mounted display devices not only have better operating experience than ordinary mobile terminals, but also have a better sense of immersion, making people more immersed in the virtual world. This kind of experience is very important for entertainment, audio and video, education, health and other fields.

Unlike a normal head-mounted display device, a transmissive headset not only sees a virtual image, but also sees the world of the display through the screen. In this way, the fusion of virtual information and the real environment can be realized by using the perspective wearing device. Some of the headsets currently on the market, such as Google Glass and Epson Glasses, are transmissive headsets. The shortcoming of the transmissive headset on the market is that the position of the camera and the human glasses are inconsistent, which causes the parallax generated when the image is taken. This parallax will make the headset display the device. The picture is not real, even wearing it for a long time will cause dizziness.

In summary, the transmissive head-mounted display device usually does not automatically register the image captured by the camera and the human eye, which causes trouble to the wearer. To solve this problem, this patent proposes a self-aligned transmissive head-mounted display device solution.

Summary of the invention

In view of the defects in the prior art, an object of the present invention is to provide a self-aligned transmissive head-mounted display device, which can collect real-time scenes in real time, process the collected images and display them in a projection display manner. On the semi-permeable membrane, the real scene is superimposed with the processed image to form an augmented reality.

The invention provides a self-aligning transmissive head-mounted display device, in which a technique of reflection transmission is adopted, so that the picture captured by the camera is completely equivalent to the angle and position of the picture actually seen by the human eye, so that The picture displayed on the headset is more realistic and reliable. At the same time, the feedback structure (display device, image acquisition device, projection device and data processing center; image acquisition device collects the image superimposed on the image on the external environment and the real device, and sends the image to the data processing center; data processing The center processes the image by using an algorithm, transmits the corresponding image to be displayed to the projection device, and the projection device performs projection display, so that the whole system forms a feedback structure), and the head wear device can process the image by using an algorithm, and then project the image in front of the human eye. Perfectly superimposed with natural images to present augmented reality.

To achieve the above object, the present invention provides a self-aligning transmissive head-mounted display device comprising:

Various components for mounting and connecting the system and a headset for wearing by the user;

a display device for displaying an image projection;

An image collection device that receives external world image information and/or acquires internal storage information;

a projection device for projecting an image onto a display device;

Various types of sensors for collecting device status information and surrounding environment information;

Responsible for feeding back the image acquired by the image acquisition device and feeding back the feedback algorithm to the projection device and the data processing center running the algorithm;

The display device directly projects half of the light transmitted from the outside into the human eye, and the other half is reflected into the image capturing device, and the light projected by the projection device on the semipermeable membrane is also reflected into the human eye, and the user can not only see the projection. The displayed picture can also see the picture of the external environment, and the projected picture is superimposed with the external environment picture to form enhanced vision.

Preferably, the display of the system is a binocular display or a monocular display; the image acquisition device is a dual channel acquisition or a single channel acquisition; if it is a single eye, a single channel, the display device, the image acquisition device, and the projection device only need All the way.

Further, if it is a binocular or a dual channel, the display device, the image capturing device, and the projection device are two channels, that is, the display device includes:

a left eye display device embedded in the left eyeglass frame of the head mounted frame for displaying a left eye image;

a right eye display device embedded in the right eyeglass frame of the head mounted frame for displaying the right eye image;

The two-way image acquisition device is composed of two miniature cameras and is distributed on the left and right sides of the head-mounted glasses holder;

The projection device is also distributed on the eyeglass holder, and the position is between the left and right eye display devices or on the left and right sides of the eyeglass frame according to actual needs.

Further, the two-way image acquisition device separately collects the real scenes seen by the left and right eyes from the perspective of the human eye, and performs real-time projection onto the left and right eye display devices after being processed by the data processing center.

Further, the projection device is also distributed on the eyeglass holder, and the position may be between the left and right eye display devices or the left and right sides of the eyeglass frame according to actual needs. The projection device is not limited to a projector, and the projection device may be a pico projector, or may be a liquid crystal screen having sufficient brightness and satisfying requirements or an LED dot matrix screen, and the form of its existence does not affect the essence of the present invention.

Preferably, the display mode of the system is a projection display, and the display device can transmit natural light, that is, the wearer can see the image displayed by the system projection, and can also see the external image, and the two images are superimposed to form a final The picture that the human eye sees.

Preferably, the display device adopts a semi-permeable membrane, and the display device is composed of one semi-permeable membrane or two semi-permeable membranes respectively.

Further, when the display device adopts a semi-permeable membrane, the semi-permeable membrane and the human face face an angle of forty-five degrees, the image of the natural scene is transmitted to the semi-permeable membrane, and a part of the image is reflected by the semi-transparent membrane into the image acquisition device. The other part is directly transmitted into the human eye. After the image acquisition device acquires the image, the image is sent to the data processing center for image processing, and the processed image is sent to the projection device for projection display. Part of the screen projected by the projection device passes directly through the semi-permeable membrane, and the other portion is reflected into the human eye. The portion of the natural image that enters the human eye is superimposed with the image that the projection device reflects into the human eye to form a visual augmented reality. The projection device is one way or two channels; if the non-projection display mode is adopted, the image is directly displayed on the screen of the display device.

Further, when the display device adopts a semi-transparent film, mutually orthogonal polarizing plates can be added before the image capturing device and the projection device, respectively. This is to effectively prevent the light from the projection device from entering the image acquisition device through the semi-transmissive film, which interferes with the natural image captured by the image acquisition device.

Further, when the display device adopts two semi-permeable membranes, the two semi-permeable membranes are respectively at an angle of forty-five degrees with respect to the human face, and the two semi-permeable membranes are arranged from the inside to the outside, and the outer semi-permeable membrane The orientation is such that the image of the natural scene can be reflected into the image acquisition device, the orientation of the inner semi-permeable membrane being such that the image projected by the projection device can be reflected into the human eye. The image of the natural scene is transmitted to the semi-permeable membrane, part of which is reflected by the semi-permeable membrane into the image acquisition device, and the other part is directly transmitted into the human eye. After the image acquisition device acquires the image, the image is sent to the data processing center for image processing, and the processed image is sent to the projection device for projection display. Part of the screen projected by the projection device passes directly through the semi-permeable membrane, and the other portion is reflected into the human eye. The portion of the natural image that enters the human eye is superimposed with the image that the projection device reflects into the human eye to form a visual augmented reality.

Further, when the display device uses two semi-permeable membranes, the two semi-permeable membranes may be perpendicular or parallel to each other. When the two semipermeable membranes are placed perpendicular to each other, the image capturing device and the projection device should be on the same side of the semipermeable membrane group; when the two semipermeable membranes are placed in parallel with each other, the image capturing device and the projection device should be in the semipermeable membrane group. On both sides.

Preferably, the display of the system may be either binocular or monocular; the image acquisition device may be dual channel acquisition or single channel acquisition.

Preferably, the two-way image acquisition device separately collects the real scenes seen by the left and right eyes at the perspective of the human eye, and performs real-time projection onto the left and right display devices after being processed by the data processing center.

The data processing center of the invention is used for overall control of the system, and the image obtained by the image acquisition device is processed and fed back to the feedback algorithm of the projection device and the running algorithm, and the image acquisition, processing and display of the image display device are controlled, The sensor data is accepted and processed; the feedback algorithm can feed back corresponding information according to the data obtained by the camera. The source of the information is not only the image information obtained by the camera itself, but also other information and sensor information already stored by the device itself. Network data, etc., the algorithm fuses this information together to form a complete image that is projected through the projector. The image processing algorithm of the data processing center of the present invention has different settings according to different functions required; the device can be used as a head-mounted device for augmented reality, and can be used for games, entertainment, medical, military, health, Sports and many other fields.

Compared with the prior art, the present invention has the following beneficial effects:

The invention is a wearable device, which has the advantages of simple portability, easy expansion and the like, and can be used by people in daily life; the invention can be used as a head-mounted device for augmented reality, and can also be used as a visual aid device; The invention has advantages over other transmissive headsets in that the system of the present invention more easily aligns the natural scene image with the projected display image, and is captured by the camera of the system of the present invention. The image is completely consistent with the human eye directly watching the natural image, and the image captured by the camera is more natural and conforms to the characteristics of the human eye. Such an image acquisition method and display mode are more natural, more convenient, and more scientific than the display mode of the conventional transmissive headset.

DRAWINGS

Other features, objects, and advantages of the present invention will become apparent from the Detailed Description of Description

1 is a schematic overall structural view of a system according to a preferred embodiment of the present invention;

2 is a schematic diagram of a display device composed of a single transflective film according to a preferred embodiment of the present invention;

3 is a schematic diagram of a display device composed of a double vertical transflective film according to a preferred embodiment of the present invention;

4 is a schematic diagram of a display device composed of a double parallel transflective film according to a preferred embodiment of the present invention;

5 is a schematic diagram of a display device composed of a single semi-transflective film according to a preferred embodiment of the present invention;

Among them, 1 is a head-mounted glasses holder, various sensors are mounted on the glasses holder; 2 is a data processing center; and 3 is a display device.

detailed description

The invention will now be described in detail in connection with specific embodiments. The following examples are intended to further understand the invention, but are not intended to limit the invention in any way. It should be noted that a number of variations and modifications may be made by those skilled in the art without departing from the inventive concept. These are all within the scope of protection of the present invention.

1 is a schematic structural view of a system according to a preferred embodiment of the present invention; in the figure, 1 is a head-mounted glasses holder, and various sensors are mounted on the glasses holder for detecting the surrounding environment and the state of the glasses themselves, and transmitting information to a data processing center; 2 is a data processing center for processing sensor data and image data; 3 is a display device; wherein an image capturing device that receives external world image information, a projection device for projecting an image onto a display device is not displayed In the drawings.

2 is a schematic diagram of a display device composed of a single semi-permeable membrane according to a preferred embodiment of the present invention, which includes a display device, an image acquisition device, and a projection device. The natural scene is directed onto the semi-permeable membrane, partially reflected through the semi-permeable membrane to the camera, and the other directly into the human eye. After being reflected into the image acquisition device, after being processed by the feedback algorithm of the data center, the data center transmits the image data to the projection device, and the projection device projects the display on the semi-permeable membrane. At this time, the projected image on the semipermeable membrane overlaps with the real image of the natural scene to achieve the effect of augmented reality.

3 is a schematic diagram of a display device constructed of a dual vertical transflective film in accordance with a preferred embodiment of the present invention. The figure includes a display device, an image acquisition device, and a projection device. Wherein, the two semi-permeable membranes of the display device are arranged from the inside to the outside, and the natural scene is directly transmitted to the semi-permeable membrane, and a part of the semi-permeable membrane is reflected to the camera through the outer semi-permeable membrane, and another portion is directly incident into the human eye. After being reflected into the image acquisition device, after being processed by the feedback algorithm of the data center, the data center transmits the image data to the projection device, and the projection device projects the image on the inner semipermeable membrane. At this time, the projected image on the semipermeable membrane overlaps with the real image of the natural scene to achieve the effect of augmented reality. The advantage of using a double semi-permeable membrane is that the light projected by the projection device does not pass through the semi-permeable membrane into the image acquisition device (such as the camera), interfering with the image acquisition device.

4 is a schematic diagram of a display device composed of a double parallel transflective film according to a preferred embodiment of the present invention, which includes a display device, an image acquisition device, and a projection device. Wherein, the two semi-permeable membranes of the display device are arranged from the inside to the outside, and the natural scene is directly transmitted to the semi-permeable membrane, and a part of the semi-permeable membrane is reflected to the camera through the outer semi-permeable membrane, and another portion is directly incident into the human eye. After being reflected into the image acquisition device, after being processed by the feedback algorithm of the data center, the data processing center transmits the image data to the projection device, and the projection device projects the display on the inner semi-permeable membrane. At this time, the projected image on the semipermeable membrane overlaps with the real image of the natural scene to achieve the effect of augmented reality.

FIG. 5 is a schematic diagram of a display device composed of a single semi-permeable membrane according to a preferred embodiment of the present invention, which includes a display device, an image acquisition device, and a projection device. Wherein, the single semi-permeable membrane of the display device is at a 45 degree angle to the human face, and the natural scene is directly directed onto the semi-permeable membrane, and a part of the semi-permeable membrane is reflected to the camera, and the other portion is directly incident into the human eye. After being reflected into the image acquisition device, after processing by the feedback algorithm of the data processing center, the data processing center transmits the image data to the projector, and the projection device projects the display on the semi-permeable membrane. The difference from the display device in FIG. 2 is that, in FIG. 5, the polarizing plate 1 and the polarizing plate 2 which are orthogonal to each other are respectively added to the image capturing device and the projection device, so that the projection of the projection device can be effectively prevented from entering the image capturing device. , a disturbance occurred.

The display device of this embodiment may further provide a lens group for adjusting (focusing or diverging) the light of the projected display such that the projected image is conveniently viewed by the human eye at a suitable distance.

In addition to the physical components described above, the system in this embodiment further includes a matching data processing center, and the data processing center includes a corresponding processing algorithm. This module collects images in real time from a two-way camera and transmits it to the data processing center 2 to process the acquired images. The principle of the image processing algorithm is to extract some information according to the input image, and output the corresponding information to be displayed according to the information. It is not image processing in a narrow sense, but includes pattern recognition, intelligent scene analysis, information extraction, and the like. Functional image feedback algorithm. Data processing center map The processing algorithms are different depending on the required functions, and have different settings. The device can be used as an augmented reality head-mounted device and can be used in games, entertainment, medical, military, health, sports and many other fields.

Various application scenarios and corresponding image processing methods are not enumerated here, and changing the image processing algorithm does not affect the essence of the system. The image processing algorithm may use the prior art, or an algorithm that is innovative in order to adapt to the visual aid system. such as:

For night blindness patients, increase the night vision of patients by increasing contrast sensitivity;

For patients with age-related macular degeneration, central serous retinopathy, and cataract, these patients have normal images by image deformation;

For red-green blind patients, let the computer change red and green to the color that the patient can distinguish;

For low vision patients, let the computer enlarge the image for easy reading;

Increase the contrast and audible prompts for moving objects to alert the patient;

For visual disturbances caused by other conditions, the corresponding algorithm is used to improve or treat the patient's vision.

As shown in FIG. 2-5, it is a working principle diagram of an image collection device, a projection device, and a display device according to an embodiment of the present invention. The workflow includes the following steps:

First, image acquisition

The part is completed by two cameras of the two-way image acquisition device, and the left and right cameras respectively receive the reflected light from the semi-permeable membrane, and collect the image of the real scene from the perspective of the human eye, and the video of the realistic scene captured by the camera is video. The form of the stream is transmitted to the data processing center 2;

Second, image processing

The part is completed by the data processing center 2 of the system, and the data processing center 2 uses a related image processing algorithm to perform specific processing on the image collected from the two-way image capturing device; in this step, image processing and machine vision related algorithms are needed. At the same time, it is also possible to add information that is not originally included in the image, such as driving speed indication, animation prompt information, etc.; the system has high performance requirements on related image processing algorithms, and requires real-time requirements, so the image is performed. When dealing with algorithm design, we must consider the problem of real-time. We can't use algorithms with too high complexity and unable to meet real-time requirements. If there are some more complicated algorithms, we should make corresponding simplification or innovation for this system to make the algorithm more Good cooperation with this system. The image processing algorithm may use the prior art, or an algorithm that is innovative in order to adapt to the visual aid system. The images acquired by the two-way image acquisition device are processed in real time and then transmitted to the left eye display device and the right eye display device, respectively.

The feedback algorithm of the data processing center is not limited to an algorithm designed to enhance vision, but can be designed differently according to actual needs. The device can be used for both enhanced vision and augmented reality. , In the field of human-computer interaction, it can also be used in games, entertainment, medical, military, health, and sports.

Third, the projection display

The display mode of the system of the present invention is a projection type. The left and right eye projection devices are respectively projected on the left and right display devices, and a virtual image is formed at a certain distance in front of the human eye.

The projection display is completed by the left and right eye projection devices and the left and right eye display devices (semi-permeable film), and the left and right eye projection devices respectively project the processed left and right eye images transmitted from the data processing center to the left, a right eye display device that allows a user to see images from left and right eye display devices that are processed by image processing and machine vision related algorithms and that add other information;

The projection device can use a projector, but the projection device is not limited to the projector, and the projection device can also display and display by using an LED screen, a liquid crystal screen or the like.

Compared with the conventional head-mounted device, the present invention is a wearable device, which has the advantages of being simple and portable, easy to expand, and the like, and can be used in daily life; the present invention can be used as a head-mounted device for augmented reality. It can also be used as a visual aid; the advantage of this system over other transmissive headsets is that the system described in this patent makes it easier to align natural scene images with projected images, and the system described in this patent The image captured by the camera is exactly the same as the natural image directly viewed by the human eye. The image captured by the camera is more natural and conforms to the characteristics of the human eye. Such an image acquisition method and display mode are more natural, more convenient, and more scientific than the display mode of the conventional transmissive headset.

The specific embodiments of the present invention have been described above. It is to be understood that the invention is not limited to the specific embodiments described above, and various modifications and changes may be made by those skilled in the art without departing from the scope of the invention.

Claims

A self-aligning transmissive head mounted display device, comprising:

Various components for mounting and connecting the system and a headset for wearing by the user;

a display device for displaying an image projection;

An image collection device that receives external world image information and/or acquires internal storage information;

a projection device for projecting an image onto a display device;

Various types of sensors for collecting device status information and surrounding environment information;

Responsible for feeding back the image acquired by the image acquisition device and feeding back the feedback algorithm to the projection device and the data processing center running the algorithm;

The display device directly projects half of the light transmitted from the outside into the human eye, and the other half is reflected into the image capturing device, and the light projected by the projection device on the semipermeable membrane is also reflected into the human eye, and the user can not only see the projection. The displayed picture can also see the picture of the external environment, and the projected picture is superimposed with the external environment picture to form enhanced vision.
The self-aligning transmissive head mounted display device according to claim 1, wherein the display of the system is a binocular display or a monocular display; the image acquisition device is a dual channel acquisition or a single channel acquisition; It is a single eye, a single channel, and the display device, image acquisition device, and projection device all need only one way.
The self-aligning transmissive head-mounted display device according to claim 2, wherein, if it is a binocular or a dual channel, the display device, the image capturing device, and the projection device are two left and right paths, that is, The display device includes:

a left eye display device embedded in the left eyeglass frame of the head mounted frame for displaying a left eye image;

a right eye display device embedded in the right eyeglass frame of the head mounted frame for displaying the right eye image;

The two-way image acquisition device is composed of two miniature cameras and is distributed on the left and right sides of the head-mounted glasses holder;

The projection device is also distributed on the eyeglass holder, and the position is between the left and right eye display devices or on the left and right sides of the eyeglass frame according to actual needs.
The self-aligning transmissive head-mounted display device according to claim 1, wherein the display mode of the system is a projection display, and the display device can transmit natural light, that is, the wearer can see the system projection. The displayed picture can also see the outside picture, and the two pictures are superimposed to form the picture that the final human eye sees.
A self-aligning transmissive head mounted display device according to claim 3, wherein said The two-way image capturing device separately collects the real scenes seen by the left and right eyes at the perspective of the human eye, and processes them on the left and right eye display devices in real time after being processed by the data processing center.
The self-aligning transmissive head-mounted display device according to claim 1, wherein the display device adopts a semi-permeable membrane, and the display device is respectively composed of a semi-permeable membrane or two semi-permeable membranes respectively. Composition.
The self-aligning transmissive head-mounted display device according to claim 6, wherein when the display device adopts a semi-permeable membrane, the semi-permeable membrane is at an angle of forty-five degrees with the human face. The image of the natural scene is transmitted to the semi-permeable membrane, part of which is reflected by the semi-transparent film into the image acquisition device, and the other part is directly transmitted into the human eye; after the image acquisition device acquires the image, the image is sent to the data processing center for image processing, and after processing The image is sent to the projection device for projection display; part of the screen projected by the projection device passes directly through the semi-permeable membrane, and the other portion is reflected into the human eye; the portion of the natural image entering the human eye is superimposed on the image reflected by the projection device into the human eye. Together, form a vision of augmented reality.
The self-aligning transmissive head-mounted display device according to claim 7, wherein when the display device adopts a semi-transparent film, two orthogonal ones are added before the projection device and the image capturing device respectively. Polarizer.
A self-aligning transmissive head-mounted display device according to claim 6, wherein when the display device uses two semi-permeable membranes, the two semi-permeable membranes are perpendicular or parallel to each other; When the films are placed perpendicular to each other, the image capturing device and the projection device should be on the same side of the semipermeable membrane group; when the two semipermeable membranes are placed in parallel with each other, the image capturing device and the projection device should be on both sides of the semipermeable membrane group.
The self-aligning transmissive head-mounted display device according to claim 6, wherein when the display device adopts two semi-permeable membranes, the two semi-permeable membranes are perpendicular to each other and face the human face respectively. At a 45-degree angle, the two semi-permeable membranes are arranged from the inside to the outside, and the outer semi-permeable membrane is oriented so that the image of the natural scene can be reflected into the image acquisition device, and the orientation of the inner semi-permeable membrane just happens to cause the projection device to cast The image can be reflected into the human eye; the part of the natural image entering the human eye is superimposed with the image reflected by the projection device into the human eye to form a visual augmented reality.
The self-aligning transmissive head-mounted display device according to claim 6, wherein when the display device uses two semi-permeable membranes, the two semi-permeable membranes are parallel to each other, and are respectively oriented with the human face. At a fifteen-degree angle, two semi-transparent films are arranged from the inside to the outside, and the image capturing device and the projection device are respectively located on both sides of the display device, and the outer semi-permeable film is oriented such that the image of the natural scene can be reflected into the image capturing device. The inner semi-permeable membrane is oriented such that the image projected by the projection device can be reflected into the human eye; two mutually parallel semi-permeable membranes change their spacing as needed to save some space.
A self-aligning transmissive head mounted display device according to any one of claims 1 to 11, wherein the various types of sensors for collecting eyeglass state information and surrounding environment information include an accelerometer and a gyroscope One or more of a magnetic field sensor, a temperature sensor, and an infrared sensor.
The self-aligned transmissive head mounted display device according to any one of claims 1 to 11, wherein the feedback algorithm of the data processing center has different settings according to different functions; The feedback algorithm feeds back corresponding information according to the data obtained by the image collecting device. The source of the information is not only the image information obtained by the image collecting device itself, but also other information, sensor information, and network data that the device itself has stored, and the algorithm will The information is fused together to form a complete image that is projected through the projection device.
A self-aligning transmissive head mounted display device according to any of claims 1-11, wherein the system more easily aligns the natural scene image with the projected displayed image, and the image of the system The image captured by the acquisition device is completely consistent with the human eye directly viewing the natural image, and the image captured by the image acquisition device is more natural and conforms to the characteristics of the human eye.
A self-aligned transmissive head mounted display device according to claim 13, wherein the feedback algorithm of the data processing center can be used to enhance the visual field:

For night blindness patients, increase the night vision of patients by increasing contrast sensitivity;

For patients with age-related macular degeneration, central serous retinopathy, and cataract, these patients have normal images by image deformation;

For red-green blind patients, let the computer change red and green to the color that the patient can distinguish;

For low vision patients, let the computer enlarge the image for easy reading;

Increase the contrast and audible prompts for moving objects to alert the patient;

For visual disturbances caused by other conditions, the corresponding algorithm is used to improve or treat the patient's vision.
A self-aligned transmissive head mounted display device according to claim 13, wherein the feedback algorithm of the data processing center is not limited to an algorithm designed to enhance vision, but may be based on The actual needs of different designs, the device can be used to enhance vision, but also can be used in augmented reality, human-computer interaction, but also in the field of games, entertainment, medical, military, health, sports.