WO2021088540A1

WO2021088540A1 - Stereoscopic spectacles

Info

Publication number: WO2021088540A1
Application number: PCT/CN2020/116604
Authority: WO
Inventors: 彭波; 毛玉; 毛新
Original assignee: 彭波
Priority date: 2019-11-08
Filing date: 2020-09-21
Publication date: 2021-05-14
Also published as: WO2021088539A1

Abstract

Disclosed are stereoscopic spectacles. A user sees a front real scene by means of spectacle lenses of the spectacles. When an eyeball is moved upwards or downwards, the front real scene in the spectacle lenses is replaced with content of two different types from a screen of a screen module on a screen lens. The first content type is an image of the front real scene captured by a stereoscopic camera on the stereoscopic spectacles and the second content type is an image acquired by superimposing the image of the front real scene captured by the stereoscopic camera on the stereoscopic spectacles on a pre-configured image. A same-screen chip is also disclosed. The invention resolves the issue in which a focal plane of the eye deviates from an image plane of a stereoscopic image. A healthy stereoscopic player is provided and ensures that measurement of a stereoscopic image is smart, simple, and accurate. The present invention is applicable to medical treatment, industry, science, education, entertainment, stereoscopic image manufacturing, and other fields.

Description

Three-dimensional glasses

Technical field

The invention relates to a mixed reality (MR) three-dimensional glasses, a linear optical design of a three-dimensional image, a technology for overlapping the focal plane of the eye and the image plane of the three-dimensional image, a three-dimensional image measurement technology and a positioning tracking technology.

Background technique

At present, all augmented reality (AR) and mixed reality (MR) glasses insert a pre-made image in the front real scene. The problems with this kind of glasses are: first, a pre-made image inserted in the real scene will block the real scene in front, causing a local picture loss and visual distress; second, the picture quality of the pre-made picture cannot be greatly improved because of the light The accuracy and contrast of the pixels displayed by the waveguide technology and the micro-projector can not be compared with the screen; third, the darkness and brightness of the inserted prefabricated image are limited; fourth, the viewing angle (FOV) of the optical waveguide technology is small; Fifth, it is impossible to zoom in on the real scene ahead.

At present, the display technology of all stereo players, including AR and MR glasses, are based on flat screen display technology. The biggest problem with this technique is that the focal plane of the eye is separated from the image plane of the stereo image. This problem is one of the main reasons why the eyes feel fatigue and physical discomfort after watching stereo images for a period of time.

Doctors usually wear special customized magnifying glasses when performing minimally invasive surgery and neurosurgery. The left and right lenses of the magnifying glasses are respectively fixed with two optical magnifying lenses with magnification ratios of 2 to 3 times. The problems of this kind of magnifying glasses are as follows: First, the change of the distance between the magnifying glasses and the diseased tissue will cause the optical magnifying lens to lose focus on the diseased tissue. In order to prevent loss of focus, doctors need to keep the body in a fixed position and posture for a long time; second, the magnification and angle of view of the optical magnifying lens are small.

The mainstream AR and MR glasses cannot provide doctors who need to return to the real scene at any time, because an optical waveguide lens causes visual interference and obstruction to the front real scene in the common field of view.

The three-dimensional glasses proposed by the present invention solve the problems existing in the above-mentioned different application fields. The use of stereo glasses is not only consistent with daily use habits, but also the use effect is natural, controllable, simple to operate, low cost, easy to promote and popularize.

Summary of the invention

The purpose of the present invention is to provide a three-dimensional glasses with two independent fields of view. First, it solves the technical problem of visual interference and obstruction to the real scene in front because a prefabricated image is inserted into the field of view of the glasses lens; second, Solve the technical problem of mutual conversion between the two fields of view; third, solve the technical problem of separating the focal plane of the eye from the image plane of the stereo image; fourth, solve the problem of turning a stereo player into a healthy stereo player Fifth, it solves the technical problem of smarter, simpler and more accurate stereo image measurement process.

A stereo glasses includes two left and right eye lenses, two left and right eye lenses, two left and right screen lenses, two left and right screen modules, a core-shifting stereo camera, two wireless modules, and an image processor.

A 3D glasses is the same as a traditional glasses. It has a frame, two left and right temples, and two left and right spectacle lenses. The left and right spectacle lenses are a left spectacle lens and a right spectacle lens. A left eye lens is composed of a left eye lens and a left screen lens. A right eye lens is composed of a right eye lens and a right screen lens. The eye lens and the screen lens in the left spectacle lens or the right spectacle lens are arranged together in an up-and-down manner. An eye lens and a screen lens in a spectacle lens are arranged up and down in different ways. A spectacle lens is divided into traditional and non-traditional designs. The traditional design is that one eye lens in a spectacle lens is located above a screen lens. The non-traditional design is that one eye lens in a spectacle lens is located below the screen lens. The left and right eyeglasses in a stereo glasses have the same design, and whether a traditional design or a non-traditional design is adopted depends on the user's usage habits, different application purposes and application scenarios.

An eye lens can be a normal lens or a vision correction lens, or a transparent lens or a colored lens with a surface coating or film. The user's eyes see the front real scene through the left and right eye lenses, and there is no image inserted in the front real scene. The two left and right straight lines passing through the center of the left and right eye lenses and the center of the left and right eye pupils are called the center line of the left eye lens and the center line of the right eye lens, respectively. The center lines of the left and right eye lenses are parallel to each other, and the horizontal distance between each other is equal to the interpupillary distance of the two eyes.

A screen lens is an ordinary lens. A screen lens can be a tinted lens with a mold or film on the surface. A screen module is fixed on the inner surface of a screen lens.

For a user with normal vision, the left spectacle lens and the right spectacle lens of a stereo glasses can be two complete ordinary lenses. A spectacle lens is divided into two different areas of the eye lens and the screen lens according to different functions, and there is no dividing line between the two different areas. The outer surface of a spectacle lens is a complete and continuously changing surface.

For a user who needs to wear vision correction lenses, both the left eye lens and the right eye lens are vision correction lenses. At this time, there are two different designs of spectacle lenses;

In the first design, the left spectacle lens and the right spectacle lens are two complete ordinary lenses. A spectacle lens is divided into two different areas of the eye lens and the screen lens according to different functions, and there is no dividing line between the two different areas. The shape and radius of curvature of the inner surface of the area corresponding to the spectacle lens on the left and right spectacle lenses are the same as the shape and radius of curvature of the outer surfaces of the left and right vision correction lenses. The left and right vision correction lenses are respectively pasted on the inner surfaces of the areas corresponding to the eye lenses on the left and right spectacle lenses along the outer surfaces. The outer surfaces of the left spectacle lens and the right spectacle lens of this design are two complete and continuously changing outer surfaces.

In the second design, the vision correction lens and the screen lens are two different lenses. For a traditionally designed spectacle lens, the lower edge of a vision correction lens is glued together along the upper edge of a screen lens. For a spectacle lens of non-traditional design, the upper edge of a vision correction lens is glued together along the lower edge of a screen lens.

The inner surfaces of the screen lenses on the left and right glasses of a stereo glasses are respectively fixed with two left and right screen modules. A screen module is composed of a screen base, a screen, a housing, a lens group and a module vision correction lens. The shape and radius of curvature of the lower surface of the screen base are the same as the shape and radius of curvature of the inner surface of the screen lens. The left and right screen modules are respectively fixed on the inner surfaces of the left and right screen lenses through the lower surface of the base. The upper surface of the screen base may be a flat surface or a curved surface, and the shape and radius of curvature of the curved surface are the same as the shape and radius of curvature of the back surface of a screen fixed on the upper surface.

A screen can be an OLED or Micro LED screen. The screen can be a flexible screen or a non-flexible screen. The shape of the screen can be a flat shape or a curved shape. The shape and radius of curvature of the back of the screen are the same as the shape and radius of curvature of the upper surface of the screen base. The screen is fixed together with the upper surface of the screen base through the back of the screen. The two left and right straight lines respectively passing through the center of the effective playing surface of the left and right screens and the center of the user's eye pupil are called the center lines of the left and right screen modules of the stereo glasses. The center lines of the left and right screen modules of a stereo glasses are parallel to each other, and the distance between the center lines of the left and right screen modules is equal to the pupil distance of the eyes. A straight line passing through the center of the effective playback surface of the screen and perpendicular to a tangent plane passing through the center is called the center line of the screen. The center lines of the left and right screens and the center lines of the left and right screen modules respectively intersect at the center of the effective playback surface of the left and right screens. The angle between the center line of the screen module and the center line of the screen is called the screen tilt angle θ.

A lens group is composed of one or more spherical or aspherical lenses, and can also be a Fresnel lens or a lens group including a Fresnel lens. The back surface of a Fresnel lens can be spherical or aspherical. The center line of a lens group or a Fresnel lens coincides with the center line of the screen module. The content on the screen that the eye sees through the lens group is a magnified virtual image. The optical magnification of the lens group can be determined according to customer requirements, different purposes of use, application areas and market needs. The lens in the lens group can be a traditional round lens or a non-circular lens. The lens group is an optical module with ultra-short focus capability, which minimizes the height of the entire screen module along the center line of the screen module. The smaller screen module height makes it more comfortable and convenient to wear. An anti-fouling coating is plated on the outer surface of the eyepiece of the lens group. The anti-fouling coating not only prevents the oil on the skin of the face from staining the outer surface of the eyepiece of the lens group, but also makes it easier to clean off the oil and other foreign objects attached to the outer surface of the eyepiece.

The inner surface of a screen module housing is plated with a coating or pasted with a material. The coating or material can absorb the light from the screen and prevent the inner surface of the housing from reflecting the light from the screen to the screen.

The modular vision correction lens is a vision correction lens. For those users who need to wear vision correction glasses, the left and right module vision correction lenses are respectively pasted on the outer surface of the eyepieces of the lens groups in the left and right screen modules, which can be removed and reused. The shape of the modular vision correction lens is the same as that of the lens in the lens group, and it can be a round lens or a non-circular lens. The center line of the vision correction lens of the module coincides with the center line of the screen module. The external surface of the modular vision correction lens is plated with an anti-fouling coating, which can not only prevent the oil on the facial skin from staining the external surface of the modular vision correction lens, but also it is easier to clean off the external surface of the modular vision correction lens. Oil stains and other foreign objects on the surface. For those users with normal vision, there is no need to use modular vision correction lenses.

The screen generates heat during operation, so the temperature control of the screen module is a design factor that cannot be ignored. In engineering practice, a number of solutions for natural ventilation and heat dissipation have been proposed. One of the simple and effective solutions is to set up multiple interconnected channels in the screen base, and each channel is directly connected to the atmosphere. The screen lens can be provided with multiple ventilation holes and directly communicate with the channel in the screen base. The heat generated on the back of the screen can be transferred to the atmosphere through natural convection through the channel in the base of the screen. The shell of the screen module is provided with a plurality of vent holes, and the heat generated on the surface of the screen can directly convection into the atmosphere through these vent holes.

The user switches from the front real scene in the eye lens to the content played on the screen of the screen module by rotating the eyeball upward or downward, or from the content played on the screen of the screen module to the real front scene in the eye lens. The screen in the screen module plays two different contents. The first kind of content is a real image of the front scene collected by a stereo camera on the stereo glasses. The second type of content is an image of the front real scene captured by a stereo camera on the 3D glasses and a pre-made image superimposed together. The two different contents can be switched at any time. The pre-made images come from a database in an image processor, a third-party database or the Internet. The pre-made image can be a flat image or a three-dimensional image.

The left and right eyes of the user respectively see the left and right images with different viewing angles from the screens of the left and right screen modules in one stereo glasses. The brain will feel a three-dimensional image after fusing the left and right images with different perspectives seen by the left and right eyes. This three-dimensional image is a virtual image.

When human eyes observe an object of interest at infinity, the eyes are in a natural and comfortable viewing state. So after watching for a long time, the eyes will not feel fatigue and physical discomfort. The center lines of the left and right eye lenses of a 3D glasses and the center lines of the left and right screen modules respectively form two vertical planes, which are respectively called the two vertical viewing planes of a 3D glasses. The left and right vertical viewing planes of a stereo glasses are parallel to each other. The horizontal distance between the two vertical viewing planes is equal to the interpupillary distance of the two eyes of the user.

The vertical angle between the center line of the glasses lens of a 3D glasses and the center line of the screen module is called the field of view conversion angle

Two field of view conversion angles left and right

equal. Field of View Conversion Angle

The range of change from 10° to 60° is a reasonable range. When the eye changes from one field of view to another, the field of view transition angle

The smaller the size, the more natural, relaxed and comfortable the eyes feel. However, when the eyes watch the real scene ahead through the glasses lens, the content played on the screen will cause a bypass interference to the eyes. And the field of view conversion angle

The smaller the value, the greater the bypass interference. Field of View Conversion Angle

The bigger, the eyes will feel tired after watching the content on the screen for a long time, and the fatigue will change with the angle of the field of view

The bigger and stronger. An ideal field of view conversion angle

It is related to the screen tilt angle θ, the height of the screen module and the facial features of the person.

When the human eyes are located directly in front of the center of a screen to watch the image played on the screen, the brightness, contrast and color changes of the screen have the best performance and effect, and the image distortion is minimal. Whether the center line of the screen module coincides with the center line of the screen depends on the following factors (not limited to), the vertical height of the screen, the height of the screen module, facial features and size. When θ=0°, the center line of the screen coincides with the center line of the screen module. The brightness, contrast, and color of the image seen by the eyes on the screen have not changed, and the image has not been deformed. When θ>0°, because the screen tilt angle θ occurs in the vertical direction, the image in the horizontal direction will not be affected by the screen tilt angle θ. The image that the eye sees from a screen tilted in the vertical direction has vertical keystone distortion and compression. These problems can be solved by magnifying the image in the vertical direction and compensating the brightness, color and contrast of the image. Although the angle θ between the center line of the screen module of the stereo glasses and the center line of the screen is negligible compared with the viewing angle of the TV screen, because the magnification of the screen module is larger, the screen tilt angle θ becomes A factor that cannot be ignored.

Generally, the horizontal field of view of the user's eyes through the left and right eye lenses to see the real scene ahead is larger than the horizontal field of view of the image seen by the eyes from the screen of the screen module. The closer the field angles of the two different fields of view are, the user's eyes will feel a more natural, real and comfortable transition effect when switching between the two different fields of view. In fact, the frame of the stereo glasses limits the field of view of the front real scene and reduces the field of view of the front real scene. When designing, when the image distortion of the lens group in the screen module is effectively controlled, it is best that the angle of view of the lens group is close to or equal to the front view angle of the glasses lens.

Two cameras usually use two shooting methods when shooting stereo images, the convergence method and the parallel method. The three-dimensional image effect obtained by using the convergence method to shoot an object of interest is the same as the way and effect of the eye observing an object of interest. When the left and right cameras converge the centerline of the lens group on an object of interest located on the central axis of the stereo camera, the left and right images collected by the left and right cameras are respectively imaged at the center of the effective imaging surfaces of the left and right image sensors. However, the obtained left and right images have trapezoidal distortion along the horizontal direction and cannot be perfectly blended. Moreover, the horizontal keystone distortion and the vertical keystone distortion described in [0024] above cannot cancel each other out. Using the parallel method to photograph an object of interest is the same as the way the eyes observe an object of interest located at infinity, and the obtained image has no keystone distortion. However, for an object of interest located at a limited distance, the three-dimensional image of the object of interest obtained by the parallel method is different from the way the eyes observe an object of interest, and the stereoscopic effect of the screen is not an ideal way of expression.

The principle of equivalent convergence is that in a stereo camera composed of two independent lens groups with the same centerline and parallel to each other, the two lens groups or two image sensors are along a plane formed by the center lines of the two lens groups. The upper part and the linear direction perpendicular to the center lines of the two lens groups are translated equally, so that two images of an object of interest on the central axis of the stereo camera collected by the two lens groups are respectively on the effective imaging surfaces of the two image sensors Center imaging. The equivalent convergence method is a stereoscopic shooting method based on the equivalent convergence principle. Before shooting, put two lens groups or two image sensors in a stereo camera composed of two independent lens groups with the same and center lines parallel to each other along a plane formed by the center lines of the two lens groups. And it is translated by a distance of L=T÷(2A) or h=T÷(2A) in a straight line direction perpendicular to the center lines of the two lens groups. The three-dimensional effect of a three-dimensional image of an object of interest obtained by using the equivalent convergence method is the same as the three-dimensional effect of a three-dimensional image of an object of interest obtained by the convergence method, but there is no trapezoidal distortion in the two images. In fact, the most important significance of the principle of equivalent convergence and the use of the equivalent convergence method is to establish a linear relationship between the stereo depth of an object of interest in the real scene and the stereo depth of the convergent point of the stereo image of the object of interest. The physical meaning is that the three-dimensional image of a focus, a focus line and a focus plane corresponding to a focus point, a focus line and a focus plane in the real scene is unique and undistorted.

According to the above-mentioned [0027], using the equivalent convergence method to shoot an object of interest in a real scene is a sufficient and necessary condition for a linear relationship between the stereo depth of the object of interest in the real scene and the stereo depth of the stereo image convergence point of the object of interest. Two kinds of stereo cameras are designed based on the principle of equivalent convergence; the first is an axis-shifting stereo camera. Before shooting, the two lens groups of an axis-shifting stereo camera are located on a plane formed by the center lines of the two lens groups and are perpendicular to the center lines of the two lens groups, facing each other in the opposite direction. Translation L=T÷(2A) distance. When panning, the position of one or two image sensors in the axis-shifting stereo camera remains unchanged. After the axis is shifted, an axis-shifting stereo camera images an object of interest located on the central axis at the center of the effective imaging surfaces of the two image sensors. For a stereo camera equipped with an image sensor, an axis-shift stereo camera is an ideal optical design and solution. The second type is a core-moving stereo camera. Before shooting, the two image sensors in a core-shifting stereo camera are located on a plane formed by the center lines of the two lens groups and are perpendicular to the center lines of the two lens groups, and face in opposite directions. Translation h=T÷(2A) distance. When panning, the positions of the two lens groups in the core-shifting stereo camera remain unchanged. After the core is moved, a core-moving stereo camera images an object of interest located on the central axis at the center of the effective imaging surfaces of the two image sensors. In the above two types of stereo cameras, the translation formulas L=T÷(2A) and h=T÷(2A), the coordinate system and the origin of the coordinate system are all the same. However, the meaning of t in the two different stereo cameras is different. The t in the tilt-shift stereo camera is the distance between the center lines of the two lens groups after the tilt. The t in the core-shifting stereo camera is the distance between the center lines of the left and right lens groups. The relationship between shifting axis and shifting core is L=t×h÷(t+2h).

A kind of stereo image translation command is based on the principle of equivalent convergence, the two images collected by a stereo camera composed of two independent lens groups or cameras arranged in parallel with the center line are located along a line in the two lens groups or On a plane formed by the center line of the camera and in a straight line direction perpendicular to the two lens groups or the center line of the camera, the distance h=T÷(2A) is respectively translated toward the opposite direction. After translation, the three-dimensional effect of the two images is the same as the three-dimensional effect of the two images obtained by the equivalent convergence method. For a core-moving stereo camera equipped with an image sensor, because an image sensor cannot be divided and translated, a stereoscopic image translation instruction provides an optical alternative solution for a core-moving stereo camera with an image sensor. A three-dimensional image translation instruction can also be applied to a pivot-shifting stereo camera and a core-shifting stereo camera with two image sensors. There are many ways to translate the image. The following example is just a boobs and explains the image translation in principle. For a left-right format image; in the first step, a vertical line intersecting the right edge of the left image and the left edge of the right image in the left-right format image is used as a dividing line. In the left image, the left image is cut along a vertical straight line with a distance dividing line h=T÷(2A)=(T×w)÷(4W), and the left image of the cut vertical straight line is retained. In the right image, the right image is cut along a vertical straight line with a distance dividing line h=T÷(2A)=(T×w)÷(4W), and the image on the right of the cut vertical straight line is retained. The second step is to move the retained left image to the right by the distance h=T÷(2A)=(T×w)÷(4W). Move the retained right image to the left by a distance of h=T÷(2A)=(T×w)÷(4W). The left and right images are re-spliced into a new left and right format image. In a new left-right format image, the left edge of the left image and the right edge of the right image have two vertical image blank areas each with a width of h. For two independent images on the left and right; in the first step, in the left image, cut the left image along a vertical straight line from the right edge of h=T÷(2A)=(T×w)÷(2W) , Keep the image on the left of the vertical straight line after cutting. In the right image, the right image is cut along a vertical straight line that is h=T÷(2A)=(T×w)÷(2W) from the left edge, and the image on the right of the cut vertical straight line is retained. This translation method causes two vertical image blank areas with a width of h at the left edge of the left image and the right edge of the right image respectively. Compared with the axis-shifting stereo camera and the core-shifting stereo camera described in [0028], the advantages of a stereo image translation instruction are (not limited to); first, it solves the core-shifting stereo camera with an image sensor The problem that the image sensor cannot be translated; secondly, after translation, the stereoscopic effect of the stereoscopic image is the same as the stereoscopic effect obtained by the shifting or core-shifting stereo camera; thirdly, it can not only be used in the shifting and core-shifting stereo cameras, but also It can also be applied to all stereo cameras composed of two independent left and right lens groups or cameras arranged in parallel with the center line; fourth, it can be applied not only to stereo cameras equipped with an image sensor, but also to stereo cameras equipped with an image sensor. A stereo camera with two image sensors; Fifth, for the shooting needs of frequently changing objects of interest, the process of resetting a new object of interest is simple, easy to operate and easy to use; Sixth, the stereo image convergence of different objects of interest can be changed at any time Click to obtain the three-dimensional effect and expression mode that changes the original scene of the entire three-dimensional image. However, the shortcomings of this technology are also obvious; first, after translation, the image of a vertical area where the left and right outer edges of the image have a width of h is cut, which is equivalent to reducing the angle of view of the lens group; second, Cause image delay.

A core-shifting stereo camera is arranged on a stereo glasses. A core-shifting stereo camera is composed of two independent, identical, centerline parallel lens groups and one or two identical image sensors CCD or CMOS. The two image sensors can be located along the center of the two lens groups. The linear directions on a plane formed by the lines and perpendicular to the center lines of the two lens groups are respectively shifted in directions opposite to each other by a distance h=T÷(2A). In order to ensure that the center lines of the two cameras on the stereo glasses can be kept parallel to each other at all times, the two cameras are set on the stereo glasses frame with the lenses facing the front direction. The left and right two independent images collected by the left and right cameras are respectively imaged on their respective image sensors, and the left and right independent images are output. According to the above-mentioned [0029], a stereoscopic image translation pair obtains the stereoscopic effect of the stereoscopic image translation and the stereoscopic effect of the stereoscopic image collected by a core-shifting stereo camera is the same and equivalent.

After the core is moved, the minimum imaging circle when the two images obtained by the two lens groups meet the required image resolution format is the minimum core-shifting imaging circle of the two lens groups. The smallest axis-shifting imaging circle diameters of the two lens groups in a core-shifting stereo camera are the same. For a core-shifting stereo camera provided with an image sensor, the minimum core-shifting imaging circle diameter of the two lens groups is D _min =2√[(w/4+h) ² +(g/2) ² ]. For a core-shifting stereo camera equipped with two image sensors, the minimum core-shifting imaging circle diameter of the two lens groups is D _min =2√[(w/2+h) ² +(g/2) ² ]. Among them, g is the vertical height of the required image resolution format.

A core shifting device is to move the two image sensors in a core shifting stereo camera along a straight line which is located on a plane formed by the center lines of the two lens groups and is perpendicular to the center lines of the two lens groups, respectively facing opposite to each other A device that translates in the direction of h=T÷(2A). For an axis-shifting stereo camera with two image sensors, the translation amount of each lens group is h=(T×w)÷(2W) distance. When the core is moved, the positions of the two lens groups in the core-moving stereo camera remain unchanged. A core-moving device has two different core-moving setting modes; the first setting mode is fixed. After the terminal stereo player has been determined, a core-shifting stereo camera can preset the translation amount h required by the image sensor before packaging. However, the images obtained by such a core-shifting stereo camera need to be played in a certain stereo player to obtain the best stereo effect. If the terminal stereo player changes, a kind of stereo image translation instruction can be used to perform additional compensation on the shift axis h to obtain an ideal stereo effect. The second setting mode is adjustable; a core-moving device is equipped with a core-moving fine-tuning mechanism and knob with original zero point and scale. Adjusting the knob on the fine-tuning mechanism can synchronously change the distance between the two image sensors. When the knob is rotated in one direction, the two image sensors translate in the opposite direction to each other. When the knob is rotated in the opposite direction, the two image sensors are translated in the direction opposite to each other. Because the change in the distance between the two image sensors is very small, the core shifting device is a precise fine-tuning device. For a core-moving stereo camera equipped with an image sensor, a core-moving device is not needed, but a stereoscopic image translation instruction is used.

A core-shifting stereo camera outputs two different core-shifting image formats, a core-shifting left-right format and two independent core-shifting image formats. For a core-shifting stereo camera equipped with an image sensor, the center lines of the left and right lens groups respectively pass through the center of the left half and the center of the right half of the imaging surface of an image sensor. When the core is shifted, the two lens groups are respectively shifted in the horizontal direction toward the opposite direction by a distance of h=T÷(2A)=(T×w)÷(4W). After the core is shifted, the left and right images collected by the left and right lens groups are respectively imaged on the left and right half of the imaging surface of an image sensor and output a core shifted left and right format image. An image in the shifted left and right format is composed of a left image and a right image arranged in a left-to-right arrangement to form a complete image.

For a core-shifting stereo camera provided with two independent image sensors, the center lines of the left and right lens groups respectively pass through the imaging surface centers of the left and right image sensors. When the core is shifted, the left and right lens groups are respectively shifted in the horizontal direction toward the opposite direction by a distance of h=T÷(2A)=(T×w)÷(2W). After the core is moved, the left and right images collected by the left and right lens groups are respectively formed on the imaging surface of the left and right independent image sensors and output two independent left and right core images.

Compared with the traditional left-right format images and two independent images, the advantages of one shifting left-right format image and two independent shifting images are (not limited to); first, in the moving-core format image, the real scene There is a linear relationship between the stereo depth of an object of interest and the stereo depth of the convergent point of the stereo image of the object of interest; second, an object of interest in the real scene corresponds to the only stereo image without distortion; third, for a The object of interest on the central axis of the stereo camera is imaged at the center of the effective imaging surface of the image sensor.

An image processor is an image processor with two image processing chips ISP, two wireless modules, an image synchronizer, a touch screen, a data memory and an operating system. It also includes an integrated and stored multiple instructions, which are processed by A device with the same screen chip loaded and executed by the device.

Two image processing chips in an image processor process, correct and optimize each frame of images from the image sensors of the left and right cameras on a stereo glasses, including (not limited to) white balance and color increase Saturation, increase sharpness, brightness, contrast, reduce noise, image edge and detail restoration, compression and other parameters.

An image processor is equipped with two wireless modules, which respectively receive images, pictures and audio signals output from two corresponding wireless modules on a stereo glasses, and respectively output the images, pictures and audio signals to the image processor Processing, correction and optimization are performed in the two corresponding image processing chips. Finally, the processed, corrected and optimized images, pictures, audios, data and operating instructions are respectively output to the corresponding two wireless modules, earphones, memory and other third parties on the stereo glasses, and can perform multimedia with the third party in real time. Interaction and communication.

A touch screen in an image processor provides a human-computer interaction interface of an operating system. The operation methods include touch screen pen, finger, mouse and keyboard. During operation, the moving logo (icon) on the screen appears on the screen of the image processor and the screen in the screen module of the stereo glasses at the same time. The mouse can use a wireless ring mouse. The user only needs to turn a small wheel on the ring mouse to move the moving mark on the screen, and confirm and execute operations by pressing a button on the ring mouse.

An operating system set in an image processor manages pages and images, image input, output, storage, loading and execution of instructions for integration and storage of a same-screen chip, open interfaces and two microphones on the stereo glasses, through Wired or wirelessly processed, corrected and optimized images, pictures, audios, data and operating instructions are respectively output to the stereo glasses, touch screen, remote control center and database. The open interface is compatible with other operating systems and third-party application software. , Download various applications and APP links, realize real-time multimedia interaction and communication with third parties.

An on-screen chip in an image processor is an integrated and stored three-dimensional image translation instruction, a three-dimensional image measurement instruction, a three-dimensional image positioning tracking instruction, a three-dimensional image on-screen instruction and an equivalent convergence Click the reset instruction chip. A same-screen chip is set in the image processor as an application chip, and the processor loads and executes the functions of stereo image positioning, matching, tracking, measurement, equivalent convergence point reset and the same screen.

There are two wireless modules on a stereo glasses, which output the left and right independent images, pictures and audio signals collected by the left and right cameras on the stereo glasses to the corresponding two wireless modules in the image processor, and receive them respectively. The processed, corrected and optimized images, pictures, audios, data and operation instructions input by the two corresponding wireless modules in the image processor.

Two microphones are provided on one stereo glasses. Two microphones are respectively arranged on the left and right sides of the stereo glasses frame to form a two-channel stereo sound collection system. The user's voice and the sound in the environment are simultaneously recorded by the microphone and output directly to the image processor.

Two sockets are respectively provided on the left and right temples of a stereo glasses, one is a power socket, and the other is a data line socket. A peripheral battery is connected to a power socket through a power cord to supply power to the stereo glasses. The images, audio and signals between the stereo glasses and the image processor can be transmitted through a data line or wirelessly.

The origin (0', 0', 0') of a three-dimensional image acquisition space coordinate system (x', y', z') is located at the midpoint of the line connecting the two centerlines of the camera lens that are arranged parallel to each other. The origin (0”, 0”, 0”) of the coordinate system (x”, y”, z”) of a stereoscopic video playback space is located at the midpoint of the line connecting the human eyes. Place a stereoscopic image acquisition space coordinate system (x',y',z') and a stereoscopic image playback space coordinate system (x”,y”,z”) together, and place the origin of the two coordinate systems (0 ',0',0') and (0”,0”,0”) overlap to form a new coordinate system (x,y,z) and (0,0,0). In the new coordinate system, the relationship between the three-dimensional depth of an object of interest in the real scene collected by a core-shifting stereo camera and the three-dimensional depth of the convergent point of the three-dimensional image of the object of interest is Z _C ＝Z _D ×[T÷(A×F ×t)]×Z. The formula shows that the relationship between the stereo depth Z of an object of interest in the real scene and the stereo depth Z _{C of the} convergent point of the stereo image of the object of interest is a linear relationship. In the formula, Z _D is the distance from the origin of the coordinate system to the flat screen, Z is the stereo depth of an object of interest in the real scene, and Z _C is the stereo depth of the convergence point of the stereo image of the object of interest.

All the mainstream stereoscopic image display technologies in the current market are based on the principle of convergence of stereoscopic images on flat screens. When the left and right images of an object of interest collected by the left and right cameras with different perspectives are projected onto a flat screen at the same time and the left and right eyes can only see the left and right images on the screen, the brain is aligned with the left and right images. The left and right images with different perspectives seen by the eyes are merged to feel a three-dimensional image.

In real life, when observing an object of interest, the eyes will automatically converge on the object of interest. After the brain merges two images with different perspectives obtained by the eyes, a three-dimensional image felt by the brain appears on the object of interest. In a flat screen playback system, a person's left and right eyes focus on the left and right images on the flat screen, respectively, so the flat screen is the focus plane of the eyes. Z _D is a constant. According to the experience in real life, the eyes are focused on the left and right images on a flat screen. After the brain fusion, the convergence point of the two images should also appear on the screen, Z _C =Z _D. _{But the formula Z C} =Z _D ×[T÷(A×F×t)]×Z stated in the above [0025] _{indicates that Z C is} not equal to Z _D , or the image plane of the focal plane of the eye and the converging point of the stereoscopic image It does not overlap. This phenomenon is one of the fundamental reasons that cause the eyes to feel fatigue, dizziness and physical discomfort after watching a three-dimensional image for a period of time.

A three-dimensional image same-screen instruction is based on the principle of equivalent convergence. When the relationship between the screen magnification A and the three-dimensional depth Z of an object of interest in the real scene changes according to the formula A=[T÷(F×t)]×Z, A convergent point of a three-dimensional image of an object of interest in a real scene collected by a stereo camera is always kept on the screen. _{The formula Z C} =Z _D ×[T÷(A×F×t)]×Z stated in the above [0043] shows that the necessary and sufficient condition for the coincidence of the focal plane of the human eye and the image plane of the stereo image is [T÷ (A×F×t)]×Z=1 or A=[T÷(F×t)]×Z=k×Z, where k=T÷(F×t) is a constant. When the three-dimensional depth coordinate Z of an object of interest in the real scene changes by ΔZ, ΔA=k×ΔZ. According to the definition, A=W/w, ΔA=W/Δw, Δw=W÷(k×ΔZ). In the formula, the parameter W is a constant, and the parameter w is regarded as a variable. When the distance Z between an object of interest and the camera changes in the real scene, w will be equivalently changed synchronously. The equivalent result of this change is that the stereoscopic image on the playback screen is enlarged or reduced, which is equivalent to the zooming process of a zoomable lens. When an object of interest in the real scene becomes farther away from the camera, ΔZ>0, then ΔA>0, Δw<0, which is equivalent to that the focal length of the stereo camera becomes larger, the viewing angle becomes smaller, and the image on the image sensor becomes smaller, so the screen The images in became smaller and smaller. The visual effect looks like a three-dimensional image equivalent to an object of interest in the real scene becomes more and more distant on the screen. In the same way, when an object of interest in the real scene is closer to the camera, ΔZ<0, then ΔA<0, Δw>0, which is equivalent to the focal length of the stereo camera becomes smaller, the viewing angle becomes larger, and the image on the image sensor becomes larger, so The image on the screen becomes bigger and bigger. The visual effect looks like a three-dimensional image equivalent to an object of interest in the real scene becomes closer and closer on the screen. The changing method, process and perspective effect of the image on the screen are consistent with the way human eyes observe an object of interest in the real scene, experience and perspective effect. The above description is a qualitative description of the change of the image magnification A in order to meet the same screen condition. The specific and clear quantitative results of ΔA need to introduce the concept of parallax between the two images, and the detailed derivation will be derived in the following description. The vertical magnification of the screen is B=V/v, where V is the vertical height of the effective playback surface of the screen, and v is the vertical height of the effective imaging surface of the image sensor. When the three-dimensional depth of an object of interest in the real scene changes by ΔZ, the three-dimensional image on the screen will also be enlarged or reduced, and the magnification change rate in the horizontal and vertical directions of the screen is equal, ΔB=ΔA.

For a core-moving stereo camera, the screen magnification A can be used to determine or change the space coordinates (0,0,Z _conv ) of the equivalent convergence point M of a core-moving stereo camera, where Z _conv = (F×t )÷(2h)=(A×F×t)÷T=C×A, where C=(F×t)÷T=1/k is a constant. Because h=T÷(2A), the same result can be obtained by changing A or h. When the equivalent convergence point M of a core-moving stereo camera is set on an object of interest, the spatial coordinates of the object of interest are (0,0,Z=Z _conv ). When the left and right images of the object of interest are projected on the screen, the images of the left and right images on the flat screen are superimposed, and the three-dimensional images of the object of interest appear in the brain. At this time, the two left and right images of the object of interest appear on the screen. The parallax of the image is zero. When the equivalent convergence point M of a stereo camera is set behind an object of interest, the spatial coordinates of the object of interest are (0,0,Z>Z _conv ). When the left and right images of the object of interest are projected on the screen, the brain feels that the three-dimensional image of the object of interest appears behind the screen. At this time, the parallax of the left and right images is positive. When the equivalent convergence point M of a stereo camera is set between an object of interest and the stereo camera, the spatial coordinates of the object of interest are (0,0,Z<Z _conv ). When the left and right images of the object of interest are projected on the screen, the three-dimensional images of the object felt in the brain appear between the screen and the audience. At this time, the parallax of the left and right images of the object of interest is negative.

The stereo depth magnification ratio of an object of interest and the corresponding stereo image is η=(Z _c2 －Z _c1 )÷(Z ₂ －Z ₁ )=(Z _D ×T)÷(A×F×t)=(Z _D /Z _conv ). The formula shows that the stereo depth magnification ratio η is proportional to the distance between the eyes and the screen.

According to Gauss's law and the definition of the lateral magnification of the camera lens:

m=x′/x=y′/y=s′/s

Among them, s'=F×(1-m) is the image distance, and s=F×(1/m-1) is the object distance. The horizontal magnification of a three-dimensional image of an object of interest on the screen is m×A (x and y directions).

Defined according to the longitudinal magnification of the camera lens:

In the above formula, s1 and s2 are the depth coordinates _{of the front and rear end faces of an object of interest in the real scene respectively, and m 1} and m ₂ are the lateral magnifications of the lens at the front and rear end faces of an object of interest in the real scene. . In a linear space, according to the definition of image magnification, the lateral magnification has nothing to do with the position of the object of interest, or m = m ₁ = m ₂ . The above formula also shows; the longitudinal magnification of the camera lens

It has nothing to do with the screen magnification A, because m×A is used instead of m in the formula. yield:

Get Z _D ×[T÷(A×F×t)]=(Z _D /Z _conv )=m ²

The formula η=(Z _D /Z _conv )=m ² or Z _D =m ² ×Z _conv . The formula surface, when the distance between the human eye and the stereo screen Z _D =m ² ×Z _conv , the human eye feels a stereo image of an object of interest is a magnified m×A times (x and y direction) and m ² times (z direction) 3D image without distortion.

A kind of stereo image measurement instruction is to establish the two left and right sides of one focus on the focus object based on the geometric relationship between two independent cameras with the same centerline and parallel to each other and an object of interest and the principle of equivalent convergence. The relationship between the parallax of the image and the spatial coordinates of the point of interest in the real scene; establish a relationship between the area of the image on the surface of the object of interest and the actual area of the surface of the object of interest in the real scene. A stereoscopic image measurement command can accurately determine the spatial coordinates (x, y, z) of a point of interest depends on whether the left and right images of the point of interest can be accurately positioned in a left and right format image screenshot or two left and right images. _{The abscissas X L} and X _R in the left image screenshot and the right image screenshot in the independent image screenshot. The left and right images of a point of interest are located on the same horizontal line in one left and right format image screenshot or left and right image screenshots in two independent image screenshots, or Y _L = Y _R , where Y _L And Y _R are the ordinates of the focus point in the left image screenshot and the right image screenshot, respectively. In a stereo camera, the left and right images collected by the left and right cameras have parallax in the horizontal direction, and there is no parallax in the vertical direction. The horizontal parallax of the left and right images of a point of interest is P=(X _R −X _L ), and the vertical parallax is zero V=(Y _R −Y _L )=0. The origins of the left and right coordinate systems in a left and right format image screenshot or two independent left and right image screenshots are located at the center of the left image screenshot and the right image screenshot respectively. The coordinate symbols are defined as: X _L and X _R are positive when they are located on the right half of the center vertical axis of the left and right coordinate systems, and negative when they are located on the left half of the center vertical axis of the left and right coordinate systems, respectively. When the center of the coordinate system is zero, it is zero.

For images in a center-shifting left-right format and a traditional left-right format, the parallax of the left and right images of a point of interest in the real scene in an image screenshot of the left-right format is P=(X _R －X _L ), and the space seat of the point of interest Mark is

x=t×(X _L +T/2)÷[T－(X _R －X _L )]－t/2

y=Y _L ÷(m×A)=Y _R ÷(m×A)

z=(A×F×t)÷[T－(X _R －X _L )]

For the two independent left and right moving images and the traditional left and right images, the parallax of the left and right images of a focus in the real scene in the left and right independent image screenshots is P=(X _R －X _L ), pay attention The spatial coordinates of the point are;

x=t×(X _L +T/2)÷[T－(X _R －X _L )]－t/2

y=Y _L ÷(m×A)=Y _R ÷(m×A)

z=(A×F×t)÷[T－(X _R －X _L )]

In the following description of the measurement process and method of a stereo image measurement instruction, only the positioning and measurement process and method of the left and right images of a focus point in an image screenshot of the left and right format are taken as an example. The positioning and measurement process and method of the left and right images of a point of interest in the left and right independent image screenshots are exactly the same as the positioning and measurement processes and methods in the left and right format image screenshots.

A three-dimensional image measurement instruction determines the spatial coordinates (x, y, z) of a point of interest based on the left and right images of a point of interest on an object of interest; the first step is to obtain a left and right image that includes the point of interest. An image screenshot of the left and right format of the image; the second step, use the touch screen pen to click and confirm the abscissa X _L of the left image of the focus point on the screen in the left image screenshot; the third step, when the left image of the focus point is on the left When the position in the image screenshot is located on a reference image with geometric characteristics, for example, a non-horizontal straight line, a curve, a geometric mutation on the surface of the object or a geometric feature, the right image of the point of interest is in the right image screenshot The abscissa X _{R of} is located on a _{horizontal straight line that passes through X L} and crosses the left and right image screenshots, at the intersection of the left image of the point of interest with the reference object image with the same geometric characteristics in the left image screenshot. _{Use the touch screen pen to click and determine the abscissa X R} of the right image of the focus point in the right image screenshot. _{After the horizontal coordinates X L} and X _R of the left and right images of a point of interest are located in a screenshot of the left and right format image, the parallax of the two images of the point of interest is P = (X _R －X _L ) and the spatial coordinates (x ,y,z) is determined.

A stereo image measurement process starts with the following two steps. The first step is to obtain an image screenshot in the left and right format including one or more points of interest on the surface of the object of interest, the surface of interest, the volume of interest, surface cracks or the uneven part of the damaged surface from the image; the second step, in the menu Select the destination of this measurement (not limited to), point-camera, point-point, point-line, point-plane, surface area, volume, surface crack, surface crack area, surface crack cross section, surface damage parameter, surface Damaged area, damaged surface cross-section and maximum depth.

The measurement process and method of the distance between a focus point a and the camera lens: the first step is to obtain a screenshot of the left and right format image from the image; the second step, select "point-camera" in the menu; the third step, use the touch screen _{Click the pen to determine the horizontal coordinate X La} of the left image of the focus point a in the left image screenshot, and a horizontal _{line passing through the X La} coordinate and across the left and right image screenshots will automatically appear on the screen; the fourth step, use the touch screen The pen clicks on the horizontal line of the right image screenshot and determines the abscissa X _Ra of the right image of the focus point a in the right image screenshot. The distance from a focus a to the camera is;

Dc=√[xa ² +ya ² +(za－c) ² ]

Among them, c is the distance from the center of the camera to the center of the outer surface of the objective lens.

The measurement process and method of the distance between the two focus points a and b: the first step is to obtain a screenshot of the left and right format from the image; the second step is to select "point-point" in the menu; the third step is to determine the two respectively _{The horizontal coordinates X La} , X _Ra , X _Lb and X _Rb of the left and right images of the two focus points a and b in the left and right image screenshots. The distance between the two attention points a and b is;

Dab＝√[(xb－xa) ² +(yb－ya) ² +(zb－za) ² ]

The measurement process and method of the distance from a point of interest a to a straight line in space: The first step is to obtain a screenshot of the left and right format from the image; the second step is to select "point-line" in the menu; the third step is to determine separately _{Focus on the horizontal coordinates X La} and X _Ra of the left and right images of point a in the screenshots of the left and right images; the fourth step is to determine the two feature points b and c on a straight line in the space. The left and right images are on the left and right. _{The abscissas X Lb} , X _Rb , X _Lc and X _Rc in the two image screenshots. The distance from a focus point a to a straight line passing through two feature points b and c is:

Da-bc=√{[xa－λ(xc－xb)－xb] ² +[ya－λ(yc－yb)－yb] ² +[za－λ(zc－zb)－zb)] ² }

Among them, λ=[(xb－xa)×(xc－xb)+(yb－ya)×(yc－yb)+(zb－za)×(zc－zb)]÷[(xc－xb) ² + (yc－yb) ² +(zc－zb) ² ]

The measurement process and method of the distance from a point of interest a to a spatial plane: The first step is to obtain a screenshot of the left and right format image from the image; the second step, select "point-plane" in the menu; the third step, determine separately _{Focus on the horizontal coordinates X La} and X _Ra of the left and right images of point a in the left and right image screenshots; the fourth step is to determine the three feature points b, c, and d that are located on a spatial plane but not on a straight line. The horizontal coordinates of the left and right images are X _Lb , X _Rb , X _Lc , X _Rc , X _Ld and X _Rd in the left and right image screenshots. The distance from a point of interest a to a plane that includes three feature points b, c, and d that are not on a straight line is;

Da-(bcd)=[I Axa+Bya+Cza+D I]÷√(A ² +B ² +C ² )

Among them, A, B, C are obtained from the following determinant, D =-(Axb+Byb+Czb)

Moving the stylus on the touch screen, the three different paths of the finger or the mouse from one pixel to the next adjacent pixel are along the horizontal direction, the vertical direction and a triangle with horizontal and vertical pixels as right-angled sides. The hypotenuse direction. A curve on the touch screen can be approximately regarded as a horizontal straight line between a number of adjacent pixels, a vertical straight line and the horizontal and vertical lines between two adjacent pixels are a right-angled triangle oblique. A splicing curve formed by splicing edges. The larger the resolution PPI of the touch screen, the closer the actual length of a curve to the length of a splicing curve. Similarly, the area enclosed by a closed-loop curve is closer to the total area of all pixel units enclosed by a closed-loop splicing curve. The horizontal distance between two adjacent pixels is a and the vertical distance is b. The sum of the area of all pixels surrounded by a closed-loop splicing curve is Ω=∑(a×b)+∑(a×b)÷2. The actual surface area of the object of interest is Q=Ω÷(m ² ×A×B).

A measurement process and method focusing on surface area: The first step is to obtain a screenshot of the left and right format from the image; the second step, select "Area" from the menu, the system will automatically retain one of the image screenshots and zoom in to the entire Screen; The third step is to use a touch screen pen to draw a closed-loop splicing curve along the edge of the image of the surface of interest on the screen. The image area enclosed by the closed-loop splicing curve is the area of the image of the surface of interest. The surface area of interest is the area of the image of the surface of interest divided by (m ² ×A×B).

The area of the surface of interest described in the above [0059] is only the area where the actual area of the surface of interest is projected on a plane perpendicular to the center line (Z axis) of the stereo camera. The fourth step is to return to the image screenshots in the left and right format. When the surface of the object of interest is a flat surface or a curved surface with a radius of curvature that is much larger than the surface length, determine the planes respectively according to the method described in [0057] above On the surface, the left and right images of the three feature points b, c and d that are not on the same straight line have the abscissas X _Lb , X _Rb , X _Lc , X _Rc , X _Ld and X _Rd in the left and right image screenshots. The actual area of a surface of interest is equal to the surface area of interest obtained by the method described in [0059] above divided by the cosine of the angle between the normal vector N of the surface of the object of interest and the center line (Z axis) of the stereo camera.

A process and method for measuring the volume of a flat panel: the first step is to obtain a screenshot of the left and right format from the image; the second step is to select the volume in the menu; the third step is according to the method described in the above-mentioned [0060] Obtain the actual area of the surface of the attention plate; the fourth step, when the attention plate is a curved surface with a radius of curvature much larger than the length of the surface, determine the left and right sides of the two characteristic points a and b with typical thickness on the attention plate. _{The abscissas X La} , X _Ra , X _Lb and X _{Rb of} each image in the left and right image screenshots. The thickness of a plate of interest is equal to the distance between two characteristic points a and b multiplied by the cosine of the angle between the vector ab and the normal vector N of the surface of the plate of interest. The actual volume of a slab of interest is equal to the actual area of the slab of interest obtained in the third step above multiplied by the thickness of the slab obtained in the fourth step.

The measurement process and method of the cross section of an object surface crack: The first step is to adjust the position and direction of the center line of the stereo camera to be consistent with the longitudinal direction of the crack and parallel to the surface of the object. When the cross section of the crack of interest is opened, a screenshot of the left and right format is taken; the second step is to use the touch screen pen to determine the two intersection points a and b at the two edges of the surface of the object of interest and the crack cross section opening. The horizontal coordinates of the image in the left and right image screenshots are X _La , X _Ra , X _Lb and X _Rb ; in the third step, select "Crack Cross Section" in the menu, and the system will automatically retain one of the image screenshots and zoom in to the entire screen. _{Use a touch screen pen to determine the abscissas X L1} , X _L2 , X _L3 , ... and X _R1 , X _R2 , of multiple characteristic points with inflection points, turning points and peak points on the left and right edges of the crack cross-sectional opening. X _R3 ,……. There is no relationship between _{the characteristic point X L#} on the left edge of the _{crack opening and the characteristic point X R#} on the right edge of the crack opening. The abscissa of each feature point X _L# and X _R# and the above two intersection points a and b are on the same crack cross section, and the parallax of the feature points on the left and right opening edges of all crack cross sections and point a The parallax is the same as the point b, or the convergence depth coordinate Zc of the point a and the point b is the same as the stereo image depth coordinate Zc of all the characteristic points on the left and right crack opening edges of the crack cross section. The left edge of the opening of the crack cross-section is composed of a straight line _{starting from point a, which sequentially connects all adjacent characteristic points X L# on the left edge of the crack cross-section opening.} The right edge of the opening of the crack cross section is composed of a straight line _{starting from point b, which successively connects all adjacent characteristic points X R# on the right edge of the crack cross section opening.} The left and right edges of the crack cross-section form a "V"-shaped cross-sectional opening. The more feature points are selected, the closer the edge of the crack cross-section is to the edge of the actual crack cross-section. The vertical distance Y _L# between point a and each feature point X L# on the left edge of the crack cross-sectional opening _{Y L#} and the vertical distance Y _R _{between point b and each feature point X R#} on the right edge of the crack cross-sectional opening _# , The distance between point a and point b or the width of the crack cross section will be listed on the cross section diagram.

The measurement process and method of the cross-section and maximum depth of the concave-convex part of an object surface: Here, only the depression caused by the damage or corrosion of the surface of the object is described as an example. The first step is to adjust the position and direction of the center line of the stereo camera to be parallel to the surface of the object. When the typical features and interesting parts of the surface depression of the object are seen on the screen, a left-right format image screenshot is taken, and one of the image screenshots is retained. _{And zoom in to the full screen; the second step is to determine the horizontal coordinates X La} , X _Ra , X of the left and right images of the two intersection points a and b where the surface of the object and the edge of the damaged cross section intersect in the left and right image screenshots. _Lb and X _Rb ; the third step, select "damaged cross section" in the menu, and enter the radius of curvature of the damaged surface +R, (convex surface) or -R (concave surface) in the next level of the menu. A curve with a radius of curvature of R passing through point a and point b will appear on the screen. If the radius of curvature of the damaged surface cannot be obtained, use a touch screen pen to draw a splicing curve between the two intersection points a and b. The splicing curve is smoothly linked with the left surface curve of point a and the right surface curve of point b. In the fourth step, use a touch screen pen to draw a splicing curve between the two intersection points a and b along the edge of the damaged part in the cross-sectional view. The closed-loop splicing curve of the damaged cross-section is composed of a curve with curvature R between points a and b and a splicing curve. Step 5: Go back to the left and right image screenshots, click on the stitching curve and determine the abscissa X _Lc and X _{Rc of the} lowest point C of the damaged section. The area of the damaged cross section of an object surface, the distance between point a and point b, and the vertical distance Yc from the lowest point c of the cross section are all listed on the cross section diagram.

In the actual measurement process, when the measurement purpose and requirements are different from the above-mentioned basic measurement methods, different and reasonable measurement methods and solutions need to be proposed according to different situations. The new measurement method and solution can be a combination of the above-mentioned basic measurement methods or other new methods.

A stereo image positioning and tracking command is based on the principle of equivalent convergence, a focus point or a line of focus on the left and right of the left and right images captured by two lens groups or cameras that are independent of each other, the same and the center line is parallel to each other. After the position of the image or the right image in a left and right format image screenshot or two separate left and right image screenshots in the left image screenshot or right image screenshot is located, locate and track the point of interest or focus on the straight right image or left image The position in the right image screenshot or the left image screenshot in the same left and right format image screenshot or two independent left and right image screenshots. A three-dimensional image positioning and tracking instruction includes three different processes: image positioning, image matching, and image tracking. First, the positioning process is to use a rectangular box to enclose a point of interest or a point of interest. The four perimeters of the rectangular box are parallel to the two coordinate axes in the left and right image screenshots. The center of the rectangular box is The point of the same name in the rectangular box. The positioning process is to determine the positions of the points with the same name of the rectangular box in the left and right image screenshots respectively. The rectangular box surrounding a point of interest is a square box, and the point of interest is also a point with the same name as the square box. The rectangular box surrounding a line of interest is a rectangular box. The center of the rectangular box is the midpoint of the attention line or the point of the same name, and a diagonal line of the rectangular box is the attention line. Second, the matching process is a process of feature matching combined with a simplified gray-scale matching instruction, which is a process of feature and gray-scale search, contrast, comparison and matching of images limited to a limited rectangular box. The matching content includes the relationship between the left and right images and the reference object, corner points, edge points, edge lines, and other geometric features, and the color features, surface textures, color and texture change patterns and rules in the rectangular box. Third, the tracking process is that when a point of interest or the left and right images of a line of interest are located, when the point of interest or the image of the line of interest moves to a new position, the automatic tracking has been positioned and surrounded by a rectangular box. The new position, coordinates, parallax and distance to the stereo camera of the point with the same name in the rectangular box at any moment in the left and right images of the focus point or the focus line. The reason for the movement of a point of interest or an image of a line of interest can be a change in the position of the point of interest or the line of interest and a change in the position or angle of the stereo camera.

The image positioning process of a point of interest or a line of interest: the first step, for a point of interest a, use a touch screen pen to click on the screen at the left image of the point of interest a. A square box encloses the focus point a, and the center of the square box is the left image of focus point a, or the point with the same name, with coordinates (X _La , Y _La ). For a focus on straight line bc, using the stylus along the screen to slide the other endpoint b c bc straight left video image from a left end of the line bc. A rectangular box encloses the left image of the attention line, and the center of the rectangular box is the midpoint or the point of the same name of the left image of the attention line bc. The left image of the attention line bc is a diagonal line of the rectangular box. The coordinates of the two end points b and point c of the left image of the attention line bc _{are (X Lb} , Y _Lb ) and (X _LC , Y _LC ), respectively. In the second step, the matching process starts to search and locate the same features in the right image screenshot as the left image in the left image screenshot. The points with the same name have the following features in the left and right screenshots; the first feature is a point of interest or a line of interest on the left image in the left image screenshot on the reference object, corner points, edge points, edge lines and others For geometric features, the point with the same name in the right image screenshot is also located on the same geometric feature reference, corner point, edge point, edge line and the same geometric feature; the second feature is a point of interest and a line of interest The positions of the points with the same name in the left and right image screenshots are located on a horizontal line that crosses the left and right image screenshots; the third feature is that the ordinates of the two end points b and point c of a line of interest are equal, Y _Lb = Y _LC ; The fourth feature is that the color, surface texture, color and texture change patterns and laws in a rectangular box enclosing a point of interest or a line of interest are consistent; the fifth feature is the pattern and feature matching, The search, comparison, and comparison process is limited to a limited rectangular box. After the matching is completed, confirm that the coordinates of the point of interest and the right image of the line of interest in the right image screenshot are (X _Ra , Y _Ra ), (X _Rb , Y _Rb ) and (X _RC , Y _RC ), with the same name The parallaxes corresponding to the points are (X _Ra －X _La ) and (X _Rbc －X _Lbc ).

According to the above-mentioned [0046], the necessary and sufficient condition for the coincidence of the focal plane of the eye and the image plane of the stereoscopic image is A=[T÷(F×t)]×Z=k×Z, and the same-screen principle of vision The effect is a qualitative description. According to how to obtain the parallax of two images of one focus and the process described in [0049], a quantitative calculation is made on the principle of the same screen to obtain a quantitative result of the need to change the screen magnification. When the stereo depth Z of an object of interest in the real scene changes, a stereo image positioning tracking instruction will automatically track the change of the position of the object of interest, and bring the change of the parallax of the point of the same name into the formula (1) to obtain; ΔZ=( A×F×t)÷{[T－(X _R2 －X _L2 )] ^-1 －[T－(X _R1 －X _L1 )] ^-1 }. Substitute the ΔZ result of formula (1) into formula (2) to obtain; ΔA=[T÷(F×t)]×ΔZ=[T÷(F×t)]×ΔZ=(A×T)×{[ T－(X _R2 －X _L2 )] ^-1 －[T－(X _R1 －X _L1 )] ^-1 }. In formula (1), the screen magnification A (=W/w) is a constant. In formula (2), the screen magnification ratio A comes from formula (1) and has nothing to do with ΔA. According to the principle of the same screen, the enlargement and reduction of the stereoscopic image in the stereoscopic playback screen will not have any influence on the position of a focus in the real scene. This is the meaning of "equivalent" in the equivalent change, equivalent process, and equivalent result described in [0028] above. A three-dimensional image on-screen instruction makes the ΔA obtained by the formula of the image played on the screen synchronously change with the three-dimensional depth Z of an object of interest in the real scene. At this time, the convergence points of the left and right images of the object of interest will be directly implemented on the screen, and the position of the focal plane of the eye and the position of the image plane of the stereoscopic image will overlap. The distance between an object of interest and the stereo camera can be measured in real time by an external laser or infrared rangefinder, or by a same-screen chip built in the image processor. Compared with peripheral devices, a same-screen chip has the advantages of faster speed, higher efficiency, smaller delay, more convenient operation, smaller size, lower cost and more user-friendly.

An equivalent convergence point reset command is to set the object as a new focus object through the stereo image of an object on the screen during the playback of the stereo image, and then use the stereo image of the new focus object to converge the equivalent of the stereo camera The point is reset to the new object of interest. _{According to the formula Z conv} =(A×F×t)÷T described in the above [0047], changing the screen magnification A can change the position Z _{conv of the} equivalent convergence point M of an object of interest. In fact, an equivalent convergence point reset instruction combined with other instructions perfectly solves the three current application requirements and problems. The first application is that the stereo player can become a healthy stereo player; the second application is that the audience can interact with the content being played in a stereo player; the third application is during shooting, the stereo camera lens shoots When the subject transfers from one object of interest to another new object of interest, the equivalent convergence point of a core-moving stereo camera needs to be transferred from the previously set object of interest to the new object of interest.

The definition of a healthy 3D player is a 3D player in which the convergent point of the 3D image of the object of interest in the 3D image played in the 3D player appears on the screen. First of all, by setting a same-screen chip in a stereo player, most stereo players can be turned into healthy stereo players. Secondly, after setting up a same-screen chip in a stereo player, the audience can have a new kind of interventional interaction with the content being played in the stereo player, feel and participate in it. First, there are multiple images of different characters or objects of interest surrounded by boxes on the screen, and the audience uses the remote control to determine which one of them is most interested in a new object or character of interest. In fact, the image of the new object of interest determined by the audience on the screen is a three-dimensional image of the convergence of the left and right images of the new object of interest. Secondly, a same-screen chip will obtain an image screenshot from the input image in a left and right format or two independent images, and determine the left and right images according to the process and method described in [0065] and [0066] above. The coordinates of the points with the same name in the two image screenshots surrounding the left and right new object images of interest, so as to obtain the disparity of the two points with the same name on the left and right P=(X _R －X _L ) and enter the formula Z=(A×F× t)÷[T－(X _R －X _L )] and the formula Z _C =Z _D ×[T÷(A×F×t)]×(A×F×t)÷[T－(X _R －X _L )]=(Z _D ×T)÷[T－(X _R －X _L )], Z _{C is} obtained. Let the obtained Z _C =Z _conv =(A×F×t)÷T, determine the position of the equivalent convergence point M of the new object of interest or the stereo depth Z _conv and the distance to be moved h=(F×t) ÷(2Z _conv ). Summarize the above process; firstly, a same-screen chip set in a stereo player obtains a left-right format or two independent image screenshots from the input stereo image, and captures the left and right images of a newly determined object of interest. Perform positioning, matching and tracking, and obtain the stereo depth Z _{C of the} convergence point of the stereo image of the new object of interest, let Z _C =Z _conv ; The second step is to correct the amount of core shift of the object of interest h. If the content being played comes from a stereo camera designed according to the principle of equivalent convergence, the core shift amount h represents the correction of the core shift amount of a newly set new object of interest. If the content comes from a stereo camera that uses the parallel method to shoot, the core shift amount h represents the change of the stereo camera to a stereo camera that satisfies the principle of equivalent convergence. If the content comes from a stereo camera that uses the convergence method to shoot, the focus plane of the eye and the image plane of the stereo image still cannot perfectly coincide. In the third step, a same-screen chip locates, matches and tracks the left and right images of the new object of interest through the processes and methods described above, including the position of the point with the same name, coordinates, parallax and the distance to the stereo camera, in real time Change the screen magnification rate and ensure that the convergence point of the stereo image of the new object of interest is implemented on the stereo player screen.

Most of the prefabricated images obtained through database or Internet download emphasize versatility and do not have a unified standard. The diversity of content sources makes the equivalent convergence point M'of each stereoscopic prefabricated image and a superimposed stereoscopic image equal. There is a possibility of conflict between the effective convergence points M. If the stereo image and convergence point obtained from a core-moving stereo camera on the stereo glasses are used as the main stereo image and the main equivalent convergence point M, the equivalent convergence point M'of the stereo pre-cast image and the main equivalent convergence point The stereo depth difference of M determines the front and back positional relationship between the main stereo image and the stereo precast image on the screen. When this relative positional relationship conflicts or does not conform to daily experience, the position of the equivalent convergence point M'of the stereo precast image needs to be corrected. According to the process and method described in [0069] above, the position of the equivalent convergence point M'of the stereo precast image can be reset. Because the main 3D image and the 3D pre-production image are two different images that are independent of each other, zooming in or out of the 3D pre-production image will not have any influence on the main 3D image. The reasonable relative position between the main equivalent convergence point M and the equivalent convergence point M'of the prefabricated three-dimensional image can make the user feel more natural, conform to the habit and daily experience of human eyes to observe the world, and have a better sense of realism and more Comfortable experience.

The above-mentioned basic measurement method appears inconvenient, lacks efficiency, and is not easy to accurately determine the position of the right image of a point of interest in the right image screenshot. A same-screen chip simplifies the above-mentioned basic measurement process to one or two steps to accurately locate the position of the right image of a point of interest in the right image screenshot, making the real-time measurement process of the stereo image simpler, more efficient, and more efficient. Humane and precise. At the same time, line/diameter/height, graphic matching, and volume are added to the menu.

The measurement process and method of a same-screen chip are as follows: First, manually determine the abscissa X _L of the left image of a point of interest in the left image screenshot in a left-right image screenshot. A same-screen chip will match the left and right images of the point of interest around the same feature at the point with the same name, obtain the abscissa X _{R of the} point with the same name in the right image screenshot, and calculate the parallax of the point of interest P = (X _R － X _L ) and measurement results.

The measurement process and method of the distance between a focus point a and the camera lens: The first step is to obtain an image screenshot in the left and right format from the image, save one of the image screenshots and zoom in to the full screen; in the second step, select "Point" in the menu -Camera"; the third step, use the touch screen pen to click and determine the position of point a. A chip on the same screen will calculate the distance from a focus point a to the midpoint of the line connecting the midpoints on the outer surfaces of the two camera objective lenses as;

Dc=√[xa ² +ya ² +(za－c) ² ]

The measurement process and method of the straight-line distance between the two focus points a and b: The first step is to obtain an image screenshot in the left and right format from the image, save one of the image screenshots and zoom in to the full screen; the second step, the menu Select "straight line/diameter/height"; in the third step, use the touch screen pen to click and confirm the position of point a and keep the touch screen pen sliding to the position of point b on the screen. A chip with the same screen will calculate the distance between the two focus points a and b as:

Dab＝√[(xb－xa) ² +(yb－ya) ² +(zb－za) ² ]

The process and method of measuring the distance from a point of interest a to a straight line in space: the first step is to obtain an image screenshot in the left and right format from the image, save one of the image screenshots and zoom in to the full screen; the second step, select from the menu "Point-line"; the third step, use the touch screen pen to click and confirm the position of point a; the fourth step, use the touch screen pen to click and confirm the position of point b in a straight line and keep the touch screen pen on the screen Slide to point c. A chip on the same screen will calculate the distance from a focus point a to a straight line passing through two feature points b and c;

The measurement process and method of the distance from a point of interest a to a spatial plane: The first step is to obtain an image screenshot in the left and right format from the image, save one of the image screenshots and zoom in to the full screen; the second step, select from the menu "Point-plane"; the third step, use the touch screen pen to click and confirm the position of point a; the fourth step, use the screen pen to click and confirm the position of point b and keep the touch screen pen continuously sliding on the screen to points c and The position of point d, where point b, point c, and point d are three points that are not all on a straight line. A chip with the same screen will calculate the plane distance from a focus a to a three feature points b, c and d that are not all in a straight line;

Da-(bcd)=[I Axa+Bya+Cza+D I]÷√(A ² +B ² +C ² )

A same-screen chip can not only be applied to the axis-shifting stereo camera, but also can be applied to all two independent, identical, and parallel-centered stereo cameras, and make the stereo images collected by the stereo camera have the equivalent convergence method The three-dimensional image obtained has the same three-dimensional effect.

The three-dimensional glasses and device proposed by the present invention not only solve the problems existing in the current mainstream AR and MR glasses and stereo players, but also have a highly integrated structural design, and an intelligent and humanized operation method. It has the characteristics of simple operation, high efficiency, high image restoration, low delay, low cost, and easy promotion and popularization.

Description of the drawings

Figure 1 A schematic diagram of a small viewing distance stereo glasses and system;

Figure 2 A schematic diagram of orthogonal viewing distance stereo glasses and system;

Figure 3-1 A schematic diagram of the front view of a spectacle lens with ordinary lenses;

Figure 3-2 A schematic diagram of the cross-section A of a spectacle lens of a common lens;

Figure 3-3 A schematic diagram of the cross-section B of a spectacle lens of a common lens;

Figure 4-1 A schematic diagram of the front view of a spectacle lens with corrective vision lenses;

Figure 4-2 A schematic diagram of a cross-section A of a spectacle lens with a corrective vision lens;

Figure 4-3 A schematic diagram of a cross-section B of a spectacle lens for corrective vision lenses;

Figure 5-1 A schematic diagram of the front view of a spectacle lens with a separable vision correction lens;

Figure 5-2 A schematic diagram of the cross-section A of a spectacle lens with a separable vision correction lens;

Figure 5-3 A schematic diagram of a cross-section B of a spectacle lens with a separable vision correction lens;

Figure 6-1 A schematic diagram of the front view of the screen module of a curved screen;

Figure 6-2 A schematic diagram of the cross-section A of the screen module of a curved screen;

Figure 6-3 A schematic diagram of the cross-section B of the screen module of a curved screen;

Figure 7-1 A schematic diagram of the front view of the screen module of a flat screen;

Figure 7-2 A schematic diagram of the cross-section A of the screen module of a flat screen;

Figure 7-3 A schematic diagram of the cross-section B of the screen module of a flat screen;

Figure 8 A schematic diagram of a small viewing distance stereo glasses;

Fig. 9 A schematic diagram of orthogonal viewing distance stereo glasses;

Figure 10-1 A schematic diagram of a three-dimensional image collection space;

Figure 10-2 A schematic diagram of a 3D video playback space;

Figure 11-1 Schematic diagram of the relative position of the image sensor and the minimum imaging circle of the core before the core is moved;

Figure 11-2 After the core is moved, the relative position of the image sensor and the minimum imaging circle of the core is moved;

Figure 11 Schematic diagram of the minimum imaging circle diameter of the core shift;

Figure 12-1 Schematic diagram of the shooting principle of the stereo image convergence method;

Figure 12-2 Schematic diagram of the principle of parallel shooting of stereo images;

Figure 12-3 Schematic diagram of the shooting principle of the stereo image equivalent convergence method;

Figure 13 Schematic diagram of the parallax principle of the shift-core equivalent convergence method;

Figure 14-1 Schematic diagram of the image plane on the screen;

Figure 14-2 The image plane is in front of the focal plane;

Figure 14-3 The image plane is behind the focal plane;

Figure 14-4 Schematic diagram of the principle that the image plane and the focal plane are on the same screen;

Figure 15 A schematic diagram of the positions of the left and right images of a point of interest in a left and right format screenshot;

Figure 16 A schematic diagram of the coordinate of any point in space and the parallax principle of the image sensor after the axis is shifted;

Figure 17 A schematic diagram of measuring the distance from a point of interest to a stereo camera;

Figure 18 Schematic diagram of measuring the distance between two points of interest;

Figure 19 Schematic diagram of measuring the distance from a point of interest to a straight line;

Figure 20 A schematic diagram of measuring the distance from a point of interest to a plane;

Figure 21 Schematic diagram of measuring the surface area of a flat object;

Figure 22 Schematic diagram of measuring the volume of a flat object;

Figure 23-1 Collecting a schematic diagram of a cross-section of a surface crack;

Figure 23-2 Schematic diagram of measuring a cross-section of a surface crack;

Figure 24-1 A schematic diagram of a cross-sectional view of a damaged depression on the surface.

Figure 24-2 Schematic diagram of measuring a cross-section of a damaged surface.

Detailed ways

The specific embodiment of the present invention represents an example of the embodiment of the present invention, and has a corresponding relationship with the specific matters in the claims and the content of the invention. The present invention does not limit the embodiments, and can be embodied in various different embodiments within the scope not departing from the gist of the present invention. All the illustrated cases in the schematic diagrams are examples of the described practicable technical solutions.

Figure 1 shows a schematic diagram of a small-distance stereo glasses and system. In the figure, a small viewing distance stereo glasses is composed of an eye frame 1, two left and right temples 2, two left and right glasses lenses 3, a stereo camera, and a small viewing distance stereo camera with two left and right cameras 4 set in the glasses frame The middle of 1. Two left and right wireless modules 5 and two left and right sockets 6 and 8 are respectively provided in the left and right glasses 2. An image processor 10 is connected to the socket 6 through a data line and a plug 7. An external battery is connected to the socket 8 through a power cord and a plug 9 and provides power to the stereo glasses. In the figure, an image processor 10 is combined with a peripheral battery.

Figure 2 shows a schematic diagram of an orthogonal viewing distance stereo glasses and system. In the figure, an orthogonal viewing distance stereo glasses is composed of an eye frame 1, two left and right glasses legs 2, two left and right glasses 3, and a stereo camera. The left and right cameras 4 of an orthogonal viewing distance stereo camera are respectively arranged on the left and right sides of the glasses frame 1. The center lines of the left and right cameras 4 are parallel to each other. Two left and right wireless modules 5 and two left and right sockets 6 and 8 are respectively provided in the left and right glasses 2. An image processor 10 is connected to the socket 6 through a data line and a plug 7. An external battery is connected to the socket 8 through a power cord and a plug 9 and provides power to the stereo glasses. In the figure, an image processor 10 is combined with a peripheral battery.

Figure 3-1 shows a schematic diagram of the front view of a common lens spectacle lens. The spectacle lens 3 shown in the figure is a conventional design and a complete ordinary lens. The upper part of the spectacle lens 3 is an eye lens 12 and the lower part is a screen lens 13. A screen module 14 is fixed on the inner surface of the screen lens 13. C is the lens center of the eye lens 12.

Figure 3-2 shows a schematic diagram of a cross-section A of a common lens spectacle lens. Shown in the figure is a view of a cross section A-A of the spectacle lens 3.

Figure 3-3 shows a schematic diagram of a cross-section B of a common lens spectacle lens. Shown in the figure is a cross section BB of the spectacle lens 3. The eye sees the real scene ahead through the eye lens 12, and turns the eyeball downward along the center line 16 of the screen module to see the content played in the screen module 14 through the screen module lens group 17. A straight line 15 passes through the center of the pupil of the eye and the center C of the eyeglass lens. The angle between the line 15 and the center line 16 of the screen module

It is the conversion angle of the field of view of the stereo glasses.

Figure 4-1 shows a schematic diagram of the front view of a spectacle lens with a vision correction lens. The spectacle lens 3 shown in the figure is a conventional design and a complete ordinary lens. The upper part of the spectacle lens 3 is an eye lens 12 and the lower part is a screen lens 13. The shape and radius of curvature of the inner surface of the eye lens 12 part are the same as the shape and radius of curvature of the back of a vision correction lens 18. The vision correction lens 18 is bonded to the inner surface of the spectacle lens 12 along the back.

Figure 4-2 shows a schematic diagram of a cross-section A of a spectacle lens of a vision correction lens. Shown in the figure is a view of a section A-A of the spectacle lens 3.

Figure 4-3 shows a schematic diagram of a cross-section B of a spectacle lens of a vision correction lens. The eye sees the real scene ahead through the vision correction lens 18 and the ordinary eye lens 12, and turns the eyeball downward along the center line 16 of the screen module to see the content played in the screen module 14 through the screen module lens group 17. A straight line 15 passes through the center of the pupil of the eye and the center C of the eyeglass lens. The angle between the line 15 and the center line 16 of the screen module

It is the conversion angle of the field of view of the stereo glasses.

Figure 5-1 shows a schematic diagram of the front view of a split vision correction spectacle lens. The spectacle lens 3 shown in the figure is a conventional design and a complete ordinary lens, which is composed of a vision correction lens 18 and a screen lens 13. The vision correction lens 18 is bonded to the upper edge of the screen lens 13 along the lower edge.

Figure 5-2 shows a schematic diagram of a cross-section A of a split vision correction spectacle lens. Shown in the figure is a view of a section A-A of the spectacle lens 3.

Figure 5-3 shows a schematic diagram of a cross-section B of a split vision correction spectacle lens. The eye sees the real scene ahead through the vision correction lens 18, and rotates the eyeball downward along the center line 16 of the screen module to see the content played in the screen module 14 through the screen module lens group 17. A straight line 15 passes through the center of the pupil of the eye and the center C of the eyeglass lens. The angle between the line 15 and the center line 16 of the screen module

It is the conversion angle of the field of view of the stereo glasses.

Figure 6-1 shows a schematic diagram of the front view of the screen module of a curved screen. A screen module 14 and a screen lens module 17 are shown in the figure.

Figure 6-2 shows a schematic diagram of the cross-section A of the screen module of a curved screen. A screen module 14 shown in the figure is composed of a base 19, a curved screen 20, a module housing 21 and a screen module lens group 17.

Figure 6-3 shows a schematic diagram of the cross-section B of the screen module of a curved screen. The eyes see the content played on the curved screen 20 through the screen module lens group 17 along the direction of the center line 16 of the screen module. The screen center line 22 passes through the center of the curved screen 20 and is perpendicular to a tangent plane passing through the center. In the figure, the center line 22 of the screen coincides with the center line 16 of the screen module.

Figure 7-1 shows a schematic diagram of the front view of a flat screen screen module. A screen module 14 and a screen lens module 17 are shown in the figure.

Figure 7-2 shows a schematic diagram of the cross-section A of the screen module of a flat screen. A screen module 14 shown in the figure is composed of a base 19, a flat screen 20, a module housing 21 and a screen module lens group 17.

Figure 7-3 shows a schematic diagram of the cross-section B of the screen module of a flat screen. The eyes see the content played on the flat screen 20 through the screen module lens group 17 along the direction of the center line 16 of the screen module. The screen center line 22 passes through the center of the flat screen 20 and is perpendicular to the flat screen 20. In the figure, the angle θ between the screen center line 22 and the screen mold center line 16 is the screen tilt angle.

Figure 8 shows a schematic diagram of a small-distance stereo glasses. In the figure, the left and right cameras 4 of a small viewing distance stereo camera on a small viewing distance stereoscopic glasses are arranged in the middle of the glasses frame 1. The center lines of the two cameras 4 are parallel to each other. Shown in the picture is a traditionally designed 3D glasses with two ordinary lenses on the left and right. Two left and right screen modules 14 are respectively fixed on the inner surfaces of the left and right screen lenses 13. The interpupillary distance Teye of the user's two eyes is equal to the distance Tlens between the centers of the left and right spectacle lenses. Two left and right wireless modules 5 are provided in the left and right glasses 2 respectively.

Figure 9 shows a schematic diagram of orthogonal stereoscopic glasses. In the figure, the left and right cameras 4 of an orthogonal viewing distance stereo camera on an orthogonal viewing distance stereoscopic glasses are respectively arranged on the left and right sides of the glasses frame 1, and are connected to the hinged connection parts of the left and right glasses 2 front. Shown in the picture is a traditionally designed 3D glasses. Two screen modules 14 are respectively fixed on the inner surfaces of the left and right screen lenses 13. The interpupillary distance Teye of the user's left and right eyes is equal to the distance Tlens between the centers of the left and right spectacle lenses. Two left and right wireless modules 5 are provided in the left and right glasses 2 respectively.

Figure 10-1 shows a schematic diagram of a three-dimensional image collection space. In the figure, the left and

right cameras

23 and 24 rotate inwardly around the center of the camera lens at the same time until the center lines of the two

cameras

23 and 24 converge on an object of interest 27 in the real scene to start shooting. This method of shooting stereo images is called the convergence method. The scene in front of the attention object 17 is referred to as the foreground object 28, and the scene behind is referred to as the back scene 29.

Figure 10-2 shows a schematic diagram of a 3D video playback space. In the figure, the left and

right images

33 and 34 captured by the left and

right cameras

23 and 24 are simultaneously projected onto a flat screen 32 with a width of W. The horizontal distance between the projections of the left and

right images

33 and 34 on the screen Is the parallax P of the left and

right images

33 and 34. When a person’s left eye 30 and right eye 31 can only see the projection of the left image 33 and the right image 34 on the screen 32, respectively, the human brain will project the two

images

33 and 34 seen by the left eye and the right eye. The three-

dimensional images

35, 36, and 37 corresponding to the objects of

interest

27, 28, and 29 that are felt after the fusion.

According to the geometric relationship shown in Figure 10-2, the following relationship is obtained,

Z _C ＝Z _D ×T÷(T－P) (1)

Among them, Z _C -the distance from the midpoint of the connection between the eyes to the convergence point of the left and

right images

33 and 34 on the screen

Z _D -the distance from the midpoint of the connection between the eyes to the screen

T-the distance between the eyes

P-Parallax, the horizontal distance between the projection of the left and

right images

33 and 34 on the screen

ΔP=P _max －P _min ＝T×Z _D (1/Z _cnear －1/Z _cfar ) (2)

Among them: P _max -the maximum parallax between the left and

right images

33 and 34 on the screen

P _min -the minimum parallax between the left and

right images

33 and 34 on the screen

Z _cnear -the closest distance between the eyes to the convergence point of the left and

right images

33 and 34, (P<0 negative parallax, audience space)

Z _cfar -the farthest distance between the eyes and the convergence point of the left and

right images

33 and 34, (P>0 positive parallax, screen space)

Definition, P _rel =ΔP/W

Among them: P _rel -the parallax change per unit width of the flat screen

W-the horizontal length of the flat screen

Figure 11-1 shows a schematic diagram of the relative position of the image sensor and the minimum imaging circle of the core before the core is moved. In the figure, an image sensor 25 is fully covered by an imaging circle with a radius r. The center of the image sensor 25 coincides with the center of the imaging circle. The horizontal length of the image sensor 25 is w and the vertical height is v.

Figure 11-2 shows a schematic diagram of the relative position of the image sensor and the minimum imaging circle of the core after the core is moved. When the core is moved, the image sensor 25 is translated by a distance of h in the left direction along the horizontal direction, and the imaging circle remains stationary. After the core is moved, the distance between the center of the image sensor 25 at the new position and the center of the imaging circle is h. The minimum diameter of the imaging circle is;

D _min ＝2R＝2√[(w/2+h) ² +(v/2) ² ]

Figure 12-1 shows a schematic diagram of the shooting principle of the stereo image convergence method. In the figure, when the left and

right cameras

23 and 24 photograph an object of interest 38 located on the center line of the stereo camera by the convergence method, the object of interest 38 is imaged at the center of the left and

right image sensors

25 and 26.

Figure 12-2 shows a schematic diagram of the principle of parallel stereo image shooting. In the figure, when the left and

right cameras

23 and 24 photograph an object of interest 38 located on the center line of the stereo camera by the parallel method, the imaging of the object of interest 38 on the left and

right image sensors

25 and 26 deviates from the two images. Center of

sensors

25 and 26.

Figure 12-3 shows a schematic diagram of the shooting principle of the stereo image equivalent convergence method. In the figure, the center lines of the two

cameras

23 and 24 are parallel to each other, and an object of interest 38 located on the center line of the stereo camera is photographed. Before shooting, the left and

right image sensors

25 and 26 are respectively shifted by a distance of h along the horizontal direction in directions opposite to each other. An object of interest 38 located on the center line of the stereo camera is imaged at the center of the

image sensors

25 and 26.

Figure 13 shows a schematic diagram of the equivalent convergence method and the principle of parallax by moving the core. In the figure, the left and

right cameras

23 and 24 photograph a point of interest 27 in the space.

According to the geometric relationship shown in Figure 13, we get the following relationship,

d=t×F×(1/Z _C －1/Z)=2h－(t×F)÷Z (3)

Among them, the parallax of a point 27 in d-space on the left and right image sensors

h-the translation of an image sensor along the horizontal direction

t-the distance between the center lines of the two

cameras

23 and 24, the apparent distance

F-the equivalent focal length of the camera lens

Z-the stereo depth of a point 27 in space

Z _C -the three-dimensional depth of the convergence point of the left and

right images

33 and 34

According to formula (3), the following formula can be derived;

Δd = d _max- d _min = t × F × (1/Z _near －1/Z _far ) (4) where: d _max -the maximum parallax of the two

images

33 and 34 on the left and right image sensors

d _min -the minimum parallax of the two

images

33 and 34 on the left and right image sensors

Z _near -the three-dimensional depth of the foreground object 28 in space

Z _far -the three-dimensional depth of the back scene 29 in space

Definition, d _rel =Δd/w

Among them: d _re -parallax change per unit width of the image sensor

w-the horizontal length of the effective imaging surface of the image sensor

Let, P _rel = d _rel

Inferred: t=[(Z _D ÷A×F)×(1/Z _cnear －1/Z _cfar )÷(1/Z _near －1/Z _far )]×T (5) where: A – screen zoom in Rate W/w

The formula (5) shows that the visual distance between the two cameras is not equal to the distance between human eyes.

Let: P=A×d and formula (3) are substituted into formula (1):

Z _C =(Z _D ×T)÷(T－P)=(Z _D ×T)÷(T－A×d)=(Z _D ×T×Z)÷[A×t×F－(2A× h－T)×Z] (6)

Equation (6) shows that the _{relationship between Z C} and Z is not linear. Ideal imaging is any point in the 3D image acquisition space. A straight line and a plane correspond to the only point, a straight line and a plane in the 3D image playback space. The sufficient and necessary condition for ideal imaging is that the relationship between the stereo depth Z of an object of interest in the real scene and the stereo depth Z _{C of the} convergent point of the stereo image of the object of interest is a linear relationship. It can be seen from formula (6) that the necessary and sufficient condition for the linear relationship between _{Z C and Z is}

(2A)×h－T=0 or h=T÷(2A)

Equation (6) is linearized and simplified into the following equation,

Z _C ＝Z _D ×[T÷(A×F×t)]×Z (7)

Formula (7) shows that the relationship between the stereo depth of an object of interest in the real scene and the stereo depth of the convergence points of the two images of the object of interest is a linear relationship.

Figure 14-1 shows a schematic diagram of the image plane on the screen. In the figure, when the projections of the left and

right images

33 and 34 overlap on the screen, the parallax P=0 of the left and

right images

33 and 34, and a stereoscopic image 35 after brain fusion appears on the screen 32.

Figure 14-2 shows the image plane in front of the screen. In the figure, when the positions of the left and

right images

33 and 34 projected on the screen 32 cross in reverse, the parallax of the left and

right images

33 and 34 is P<0, and the convergence point of a three-dimensional image 36 after brain fusion appears on the screen. And the audience.

Figure 14-3 shows the image plane behind the screen. In the figure, when the projection positions of the left and

right images

33 and 34 on the screen 32 are positively crossed, the parallax of the left and

right images

33 and 34 is P>0, and the convergence point of a three-dimensional image 37 after the brain fusion appears on the screen. The rear.

Figure 14-4 shows a schematic diagram of the principle that the image plane and the focal plane are on the same screen. In the figure, by changing the screen magnification A, the positions of the left and

right images

33 and 34 projected on the screen 32 are always kept coincident. The position of the convergence point of a three-

dimensional image

35, 36, and 37 after the brain fusion is always maintained on the screen 32.

Figure 15 is a schematic diagram of the positions of the left and right images of a point of interest in a left and right format screenshot. In the figure, the abscissa of the left image 41 of a focus point a in the left image screenshot 39 in a left-right format image screenshot is X _L _{, and X L} <0 according to the symbol rule. The abscissa of the right image 42 of the focus point a in the right image screenshot 40 in a left-right format image screenshot is X _R , and X _R >0. The positions of the left image 41 of the attention point a in the left image screenshot 39 and the right image 42 in the right image screenshot 40 are both located on the same horizontal line 43 across the screen. _{The ordinate Y L} of the left image 41 of the focus point a in the left image screenshot 39 is equal to the ordinate YR of the right image 42 in the right image screenshot 40. The parallax between the left image 41 and the right image 42 of the attention point a is P=(X _R −X _L ).

For an image in the center-shift left-right format and the traditional left-right format, the parallax of the left and right images of a focus point a in the

image screenshots

39 and 40 of the left-right format is P=(X _R －X _L ), which is substituted into the formula ( 1) Obtained;

Z _C =Z _D ×T÷(T－P)=(Z _D ×T)÷[T－(X _R －X _L )] (8a)

Substituting formula (7) into formula (8a), simplified to obtain,

Z=(A×F×t)÷[T－(X _R －X _L )] (9a)

For two independent moving core images and traditional two independent images, the left and right image screenshots are two independent image screenshots. The parallax of the left and right images of a focus a in two independent image screenshots is P=(X _R －X _L ), which is obtained by substituting into formula (1);

Z _C =Z _D ×T÷(T－P)=(Z _D ×T)÷[T－(X _R －X _L )] (8b)

Substitute formula (7) into formula (8b), and get the formula after simplification:

Z=(A×F×t)÷[T－(X _R －X _L )] (9b)

Figure 16 shows a schematic diagram of the coordinate of a point in space and the parallax principle of the image sensor after the core is moved. According to the geometric relationship shown in Figure 16, the following relationship is obtained,

d ₁ +h=F×(x+t/2)÷Z; d ₂ －h=F×(x－t/2)÷Z

Get the formula for coordinates x and Z:

x=[(d ₁ +h)×Z÷F]－t/2 (10)

For an image in the shifting left and right format and an image in the traditional left and right format, d ₁ =X _L /A, h = T/2A and formula (9a) are introduced into formula (10) to obtain after simplification,

x=t×(X _L +T/2)÷[T－(X _R －X _L )]－t/2 (11a)

The spatial coordinate a(x,y,z) of a focus point a is;

x=t×(X _L +T/2)÷[T－(X _R －X _L )]－t/2

y=Y _L ÷(m×A)=YR÷(m×A)

z=(A×F×t)÷[T－(X _R －X _L )]

For two independent core-moving images and traditional two independent images, d ₁ =X _L /A, h = T/2A and formula (9b) are introduced into formula (10) and simplified;

x=t×(X _L +T/2)÷[T－(X _R －X _L )]－t/2 (11b)

The spatial coordinate a(x,y,z) of a focus point a is;

x=t×(X _L +T/2)÷[T－(X _R －X _L )]－t/2

y=Y _L ÷(m×A)=YR÷(m×A)

z=(A×F×t)÷[T－(X _R －X _L )]

Figure 17 shows a schematic diagram of measuring the distance from a point of interest to a stereo camera. _{According to the process and method described in [0110] above, determine the abscissas X La} and X _Ra of the left and

right images

41 and 42 of a focus point a in the left and

right image screenshots

39 and 40, respectively. The distance from a point of interest a to the midpoint of the line connecting the outer surfaces of the objective lenses of the

stereo cameras

23 and 24 is:

Dc=√[xa ² +ya ² +(za－c) ² ]

Among them, c is the distance from the center of the lens group of the

camera

23 or 24 to the center of the objective lens surface.

Figure 18 shows a schematic diagram of measuring the distance between two points of interest. _{According to the process and method described in [0110] above, determine the horizontal coordinates X La} and X _Ra of the left and

right images

41 and 42 of the two focus points a and b in the left and

right image screenshots

39 and 40, respectively. X _Lb and X _Rb . The distance between the two attention points a and b is;

Dab＝√[(x _b －xa) ² +(yb－ya) ² +(zb－za) ² ]

Figure 19 shows a schematic diagram of measuring the distance from a point of interest to a straight line passing through two feature points. _{The first step is to determine the horizontal coordinates X La} and X _Ra of the left and

right images

41 and 42 in the left and

right image screenshots

39 and 40 of the left and

right images

41 and 42 of a focus point a according to the process and method described in [0110] above. . _{The second step is to determine the abscissas X Lb} , X _Rb , X _Lc and X _Rc of the left and

right images

41 and 42 of the two feature points b and c on a straight line in the left and

right image screenshots

39 and 40 respectively. . The distance from a concern a to a straight line passing through two feature points b and c is;

Da- bc ＝√{[xa－λ(xc－xb)－xb] ² +[ya－λ(yc－yb)－yb] ² +[za－λ(zc－zb)－zb)] ² }

Figure 20 shows a schematic diagram of measuring the distance from a point of interest to a plane. _{The first step is to determine the horizontal coordinates X La} and X _Ra of the left and

right images

41 and 42 in the left and

right image screenshots

39 and 40 of the left and

right images

41 and 42 of a focus point a according to the process and method described in [0110] above. . _{The second step is to determine the horizontal coordinates X Lb} of the left and

right images

41 and 42 of the left and

right images

41 and 42 in the left and

right image screenshots

39 and 40 of the three feature points b, c, and d that are not all on the same straight line on the plane 44. , X _Rb , X _Lc , X _Rc , X _Ld and X _Rd . The distance from a point of interest a to a plane 44 that includes three feature points b, c, and d is:

Da-(bcd)=[I Axa+Bya+Cza+D I]÷√(A ² +B ² +C ² )

Figure 21 shows a schematic diagram of measuring the surface area of a flat object. A method and steps for measuring the surface area of the plane of interest 46 surrounded by a closed-loop curve 45; the first step is to follow the procedures and methods described in [0059] and [0060] above, using a touch screen pen on the touch screen Draw a closed loop curve 45 that includes the surface area of a plane of interest 46. The area enclosed by a closed loop curve 45 is obtained. In the second step, according to the process and method described in [0057], the left and right images 41 including the three feature points b, c, and d that are not all in a straight line on the surface of the plane of interest 46 are determined respectively. _{And 42 are X Lb} , X _Rb , X _Lc , X _Rc , X _Ld and X _Rd in the two left and

right image screenshots

39 and 40. The actual area of the surface of a plane of interest 46 is equal to the orthographic projection area obtained in the first step divided by a normal vector N determined by the three feature points b, c, and d on the surface of the plane of interest 46 sandwiched between the Z axis The cosine of the angle.

Figure 22 shows a schematic diagram of measuring the volume of a flat object. A method and procedure for measuring the volume of the plate of interest; the first step is to obtain the actual area of the surface 48 of the plate of interest 47 according to the procedures and methods described in [0059] and [0060] above. In the second step, according to the process and method described in [0055], the actual thickness at the two characteristic points a and b with thickness on the attention plate 47 is equal to the length of the two characteristic points a and b multiplied by two The cosine of the angle between the vector ab formed by the feature points and the surface normal vector N of the attention plate 47. The actual volume of a plate 47 of interest is equal to the actual area of the surface 48 of the plate 47 multiplied by the actual thickness.

Figure 23-1 shows a schematic diagram of the cross-section of a surface crack. In the figure, a crack 49 appears on the surface of an object of interest. Method and steps for measuring the shape and depth of the opening at the cross section 50 of the surface crack: According to the process and method described in [0062] above, the first step is to adjust the center line of the stereo camera to be consistent with the longitudinal direction of the crack 49 and to be consistent with the surface of the object. parallel. When a representative position in the cross section 50 of the crack on the surface of the object is seen on the screen, an

image screenshot

39 and 40 in the left and right format is collected.

Figure 23-2 shows a schematic diagram of measuring a cross-section of a surface crack. The second step is to determine the distance V between the left and right edges of the crack 49 at the crack cross section 50 and the two intersection points a and b of the surface of the object of interest, where V is the surface crack width of the crack 49 at the crack cross section 50. In the third step, use the touch screen pen to determine the characteristic points X _L1 , X _L2 , X _L3 , ... on the left edge of the crack 49 and the characteristic points X _R1 , X _R2 , X _R3 , ... on the right edge. The left and right edges of the crack 49 are composed of straight line segments _{connecting the adjacent feature points X L#} and X _R# on the left and right edges of the crack 49 with points a and b as starting points respectively. _{The vertical heights y L#} and y _R# between each feature point X _L# and X _R# and point a and point b respectively represent the depth of the feature point from the surface of the object of interest.

Figure 24-1 shows a schematic diagram of a cross-sectional view of a damaged depression on the surface. In the figure, a concave portion 51 appears on the surface of an object of interest. Method and steps for measuring the cross section 52 of the recessed part of the surface of the object: According to the process and method described in [0063] above, the first step is to adjust the center line of the stereo camera to be parallel to the surface of the object and see the recessed surface of the object on the touch screen. A representative part of the part 51 is to capture an

image screenshot

39 and 40 in the left and right format.

Figure 24-2 shows a schematic diagram of measuring a cross-section of a damaged surface. The second step is to determine the distance U between the two intersection points a and b of the cross section 52 and the surface of the object. The third step is to select "damaged cross section" in the menu of the touch screen and enter the radius of curvature of the surface of the object at the cross section of the damaged part +R (convex surface) or -R (concave surface). A curve 53 passing through points a and b and a radius of curvature R will appear on the touch screen. The fourth step is to use a touch screen pen, finger or mouse to draw a curve 54 between the two intersection points a and b along the edge of the recessed part in the image screenshot. A closed loop curve on a concave cross section 52 on the surface of the object is composed of a curve 53 with a radius of curvature of R and a curve 54 on the image edge of the concave part. The fifth step is to determine the position of the lowest point c of the cross section 52 in an image screenshot. The depths ya and yb between the point a and the point b from the point c and the area of the cross section 52 (shaded part in the figure).

Claims

A three-dimensional glasses, characterized by comprising; two left and right eyeglasses, two left and right eye lenses, two left and right screen lenses, two left and right screen modules, a core-shifting stereo camera, and an image processor; The left spectacle lens is composed of one said left eye lens and one said left screen lens, a right spectacle lens is composed of one said right eye lens and one said right screen lens; the left eye lens or right The eye lens and the screen lens in the spectacle lens are arranged in an up-and-down manner; the eye lens is an ordinary lens or a vision correction lens, and the user’s eye sees the real scene in front through the eye lens; the screen lens is an ordinary lens, The left and right screen modules are respectively fixed on the inner surface of the left and right screen lenses; two different contents are played on the screen of the screen module. The first kind of content is collected by a stereo camera on the stereo glasses The second content is the image of the front real scene collected by a stereo camera on the stereo glasses and a pre-made image superimposed together; the user moves the eyeball up or down from the eye lens The front real scene is converted to the content played on the screen of the screen module on the screen lens or from the content played on the screen of the screen module on the screen lens to the front real scene in the eye lens; said a core-shifting stereo camera It is composed of two independent lens groups with the same center line parallel to each other and one or two identical image sensors CCD or CMOS. The two image sensors can be along a plane formed by the center lines of the two lens groups. On the straight line direction perpendicular to the center lines of the two lens groups, the two lens groups are shifted in the opposite direction by a distance of h=T÷(2A). When the two image sensors are shifted, the two lens groups remain stationary; for one setting A core-shifting stereo camera with an image sensor, two images collected by two lens groups are respectively imaged on the left and right half of the imaging surface of an image sensor, and output a core-shifting left-right format image; for one set of The core-shifting stereo camera with two independent image sensors, the two images collected by the two lens groups are respectively formed on the imaging surface of an image sensor in the respective lens groups, and two independent core-shifting images are output; in the above formula, T Is the distance between the eyes of a person, and A is the magnification of the screen.
The three-dimensional glasses according to claim 1, wherein the one image processor is an image processor provided with one or two image processing chips ISP, a touch screen, a data memory, and also includes an integrated and storage A device composed of multiple instructions loaded and executed by a processor on the same screen;

Among them, a three-dimensional image same-screen instruction is based on the principle of equivalent convergence. When the screen magnification A and the three-dimensional depth Z of an object of interest in the real scene change according to the formula A=[T÷(F×t)]×Z, A stereo camera composed of two lens groups or cameras that are independent of each other, the same and the center lines are arranged parallel to each other. The convergence point of the stereo image of an object of interest in the real scene collected by the real scene is always kept on the screen; where F is the lens group or camera The focal length of the lens, t is the distance between the two lens groups or the center line of the camera lens;

A kind of stereo image measurement instruction is to establish a focus on an object based on the geometric relationship between two independent lens groups or cameras and an object of interest in the real scene, the same and the center line is set parallel to each other. The relationship between the parallax of the left and right images of a point and the spatial coordinates of the point of interest in the real scene; establish a relationship between the area of the image on the surface of the object of interest and the actual surface area of the object of interest in the real scene;

For an image in the shifting left and right format, the spatial coordinates of a point of interest are;

x=t×(XL+T/2)÷[T－(XR－XL)]－t/2

y=YL÷(m×A)=YR÷(m×A)

z=(A×F×t)÷[T－(XR－XL)]

For two independent left and right moving core images, the spatial coordinates of a focus point are;

x=t×(XL+T/2)÷[T－(XR－XL)]－t/2

y=YL÷(m×A)=YR÷(m×A)

z=(A×F×t)÷[T－(XR－XL)]

Among them, XL, XR, YL, and YR are the horizontal and vertical coordinates of the left and right image screenshots of the left and right image screenshots in a left and right format image screenshot of the left and right images of a point of interest, or two independent image screenshots of the left and right. ; M is the magnification of the lens group or camera lens;

A three-dimensional image positioning and tracking command is based on the principle of equivalent convergence, a focus point or a straight line of interest in the left and right images in the real scene collected by two independent, identical and centerline lens groups or cameras. After the position of the left or right image in a left and right format image screenshot or two separate left and right image screenshots in the left image screenshot or right image screenshot is located, locate and track the point of interest or focus on the straight right image or The position of the left image in the right image screenshot or the left image screenshot in the same left and right format image screenshot or two separate left and right image screenshots;

An equivalent convergence point reset command is to set the object as a new focus object through the stereo image of an object on the screen during the playback of the stereo image, and then use the stereo image of the new focus object to converge the equivalent of the stereo camera The point is reset to the new object of interest.
The stereo glasses according to claim 1, wherein the screen module is composed of a screen base, a screen, a housing, a lens group and a module corrective lens.
The 3D glasses according to claim 3, wherein the one screen is an OLED or Micro LED screen, which is a flexible screen or an inflexible screen, and the shape of the screen surface is a flat shape or a curved shape.
The 3D glasses according to claim 3, wherein a lens group is composed of one or more spherical lenses or aspheric lenses, and can also be a Fresnel lens.
The 3D glasses according to claim 3, wherein a module corrective lens is a vision corrective lens, which is pasted on the outer surface of the eyepiece of the lens group in a screen module, which is not suitable for users with normal vision. Need to use vision correction lenses.