CN111965826B - Control method and device of intelligent glasses, storage medium and intelligent glasses - Google Patents
Control method and device of intelligent glasses, storage medium and intelligent glasses Download PDFInfo
- Publication number
- CN111965826B CN111965826B CN202010879364.7A CN202010879364A CN111965826B CN 111965826 B CN111965826 B CN 111965826B CN 202010879364 A CN202010879364 A CN 202010879364A CN 111965826 B CN111965826 B CN 111965826B
- Authority
- CN
- China
- Prior art keywords
- optical waveguide
- display
- virtual
- determining
- display state
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 40
- 239000011521 glass Substances 0.000 title claims abstract description 28
- 230000003287 optical effect Effects 0.000 claims abstract description 183
- 238000006073 displacement reaction Methods 0.000 claims abstract description 99
- 239000004984 smart glass Substances 0.000 claims description 86
- 210000001508 eye Anatomy 0.000 claims description 23
- 238000004590 computer program Methods 0.000 claims description 16
- 238000003384 imaging method Methods 0.000 claims description 10
- 238000013507 mapping Methods 0.000 claims description 8
- 238000004364 calculation method Methods 0.000 claims description 3
- 238000002156 mixing Methods 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 13
- 230000005540 biological transmission Effects 0.000 description 11
- 210000005252 bulbus oculi Anatomy 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 7
- 230000033001 locomotion Effects 0.000 description 7
- 230000006870 function Effects 0.000 description 3
- 230000000007 visual effect Effects 0.000 description 3
- 238000005452 bending Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000018109 developmental process Effects 0.000 description 2
- 206010034960 Photophobia Diseases 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 210000001061 forehead Anatomy 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 208000013469 light sensitivity Diseases 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000035515 penetration Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000035807 sensation Effects 0.000 description 1
- 239000002356 single layer Substances 0.000 description 1
- 239000000758 substrate Substances 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Abstract
The embodiment of the application discloses a control method and device of intelligent glasses, a storage medium and the intelligent glasses, wherein the intelligent glasses comprise a controller, an optical waveguide and an optical waveguide driving module which are electrically connected with the controller, the optical waveguide is a flexible optical waveguide, and the controller is used for: determining a display area corresponding to a current display picture; determining a virtual imaging distance, and determining a field angle according to the virtual imaging distance and the display area; when the field angle is larger than a preset threshold value and the virtual display screen is in a plane display state at present, determining the displacement of a first target according to the field angle; the optical waveguide driving module is controlled to drive the edge of the optical waveguide to move according to the first target displacement, so that the virtual display screen is adjusted from a planar display state to a curved display state, the deformation of a display picture at the edge is avoided, and the blending feeling of a user when the user watches the display picture is improved.
Description
Technical Field
The application relates to the technical field of intelligent wearable equipment, in particular to a control method and device of intelligent glasses, a storage medium and the intelligent glasses.
Background
AR (Augmented Reality) technology is a technology for superimposing content that is virtually displayed in a real scene. It generates virtual information such as visual image, sound, etc. by computer technology; the virtual information is then applied to the real world. The AR technology not only shows real world information, but also displays virtual information at the same time, and the two kinds of information are mutually supplemented and superposed.
With the development of AR technology, the application of AR smart glasses is also more and more widespread. One virtual display technology commonly used in AR is to project an image onto the eyes of a user by using an optical waveguide technology after displaying content to be displayed on a display, so that the user can see the virtual image.
However, in this technique, the virtual display screen formed by the optical waveguide is generally a plane, and when the angle of view of the virtual display screen is large, the virtual imaging distance from the two sides of the virtual display screen to the eyes of the user is greater than the virtual imaging distance from the middle of the virtual display screen to the eyes of the user, which causes deformation of the display screen at the edge, and thus the user may not have a strong sense of fusion when viewing the display screen.
Disclosure of Invention
The embodiment of the application provides a control method and device for intelligent glasses, a storage medium and the intelligent glasses, which can realize curved surface display of the intelligent glasses, so that deformation of a display picture at the edge is avoided, and the blending-in feeling of a user when watching the display picture is improved.
In a first aspect, an embodiment of the present application provides a pair of smart glasses, each of the smart glasses includes a controller, and an optical device, an optical waveguide, and an optical waveguide driving module electrically connected to the controller, wherein the controller is configured to:
determining a display area corresponding to a current display picture;
determining a virtual imaging distance, and determining a field angle according to the virtual imaging distance and the display area;
when the field angle is larger than the preset threshold value and the virtual display screen is in a plane display state at present, determining first target displacement according to the field angle;
and controlling the optical waveguide driving module to drive the edge of the optical waveguide to move according to the first target displacement so as to adjust the virtual display screen from a planar display state to a curved display state.
In a second aspect, an embodiment of the present application further provides a method for controlling smart glasses, including:
determining a display area corresponding to a current display picture;
determining a virtual imaging distance, and determining a field angle according to the virtual imaging distance and the display area;
when the field angle is larger than the preset threshold value and the virtual display screen is in a plane display state at present, determining first target displacement according to the field angle;
and controlling the edge of the optical waveguide to move according to the first target displacement so as to adjust the virtual display screen from a planar display state to a curved display state.
In a third aspect, an embodiment of the present application further provides a control device for smart glasses, including:
the area determining unit is used for determining a display area corresponding to the current display picture;
the viewing angle calculation unit is used for determining a virtual imaging distance and determining a viewing angle according to the virtual imaging distance and the display area;
the displacement determining unit is used for determining first target displacement according to the field angle when the field angle is larger than the preset threshold and the virtual display screen is in a plane display state currently;
and the control unit is used for controlling the edge of the optical waveguide to move according to the first target displacement so as to adjust the virtual display screen from a planar display state to a curved display state.
In a fourth aspect, embodiments of the present application further provide a storage medium having a computer program stored thereon, where the computer program is executed on a computer, so that the computer executes the method for controlling smart glasses according to any of the embodiments of the present application.
In a fifth aspect, an embodiment of the present application further provides smart glasses, which include a processor and a memory, where the memory has a computer program, and the processor is configured to execute the method for controlling smart glasses according to any embodiment of the present application by calling the computer program.
The intelligent glasses comprise a controller, an optical waveguide and an optical waveguide driving module, wherein the optical waveguide and the optical waveguide driving module are electrically connected with the controller, the controller determines a display area corresponding to a current display picture, determines a virtual imaging distance, determines a field angle according to the virtual imaging distance and the display area, determines a first target displacement according to the field angle when the field angle is larger than a preset threshold and the virtual display screen is in a plane display state currently, and then controls the optical waveguide driving module to drive the edge of the optical waveguide to move according to the first target displacement so as to adjust the virtual display screen from the plane display state to a curved display state.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1a is a schematic view of a first structure of smart glasses according to an embodiment of the present application.
Fig. 1b is a schematic structural diagram of a second kind of smart glasses provided in the embodiment of the present application.
Fig. 1c is a schematic view of light transmission in an optical waveguide of the smart glasses according to an embodiment of the present disclosure.
Fig. 1d is a schematic view of an optical machine of the smart glasses according to the embodiment of the present application.
Fig. 1e is a first schematic diagram of state switching of smart glasses according to an embodiment of the present application.
Fig. 1f is a schematic structural diagram of an optical waveguide driving module of smart glasses according to an embodiment of the present disclosure.
Fig. 1g is another schematic diagram of an optical waveguide of the smart glasses according to an embodiment of the present disclosure.
Fig. 1h is another schematic diagram of an optical waveguide of the smart glasses according to an embodiment of the present disclosure.
Fig. 1i is a third schematic structural diagram of smart glasses provided in the embodiment of the present application.
Fig. 1j is a second schematic diagram of state switching of smart glasses according to an embodiment of the present application.
Fig. 2 is a schematic flowchart of a control method for smart glasses according to an embodiment of the present application.
Fig. 3 is a schematic structural diagram of a control device of smart glasses according to an embodiment of the present application.
Fig. 4 is a fourth schematic structural diagram of smart glasses according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. It is to be understood that the embodiments described are only a few embodiments of the present application and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without inventive step, are within the scope of the present application.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
An embodiment of the present application provides smart glasses, please refer to fig. 1a, where fig. 1a is a first schematic structural diagram of the smart glasses provided in the embodiment of the present application. Referring to fig. 1b, fig. 1b is a schematic view of a second structure of the smart glasses according to the embodiment of the present application. The smart glasses 100 include a controller 101, an optical engine 102 electrically connected to the controller 101, an optical waveguide 103, and an optical waveguide driving module 104. For convenience of explanation of the solution of the present application, fig. 1b shows only the optical waveguide 103 and the optical waveguide driving module 104 of one lens of the smart glasses 100. In some embodiments, the two lenses of the smart glasses 100 are symmetrical in structure, and the lenses not shown on the other side have the same optical waveguide and optical waveguide driving module and are electrically connected to the controller 101. Alternatively, in other embodiments, the smart glasses 100 are single-sided glasses, wherein one side of the smart glasses is a smart lens having a light guide 103 and a light engine, and the virtual image can be displayed, and the other side of the smart glasses is a common lens through which the user can see the real environment.
The optical waveguide 103 is a flexible optical waveguide, and two side edges of the optical waveguide 103 can move along a virtual normal direction of the optical waveguide under the driving of the optical waveguide driving module 104, so that the optical waveguide forms a curved surface.
Next, a display principle of the smart glasses in the embodiment of the present application will be explained. When the intelligent glasses are applied, in order to enable a user to see a real external world and virtual information, the imaging system is required not to be blocked in front of the sight line, and an optical device is added to integrate the virtual information and a real scene into a whole, supplement each other and enhance each other. The optical waveguide 103 in this application serves this function.
Among them, the optical waveguide 103 has high penetration. Referring to fig. 1c, fig. 1c is a schematic view illustrating light transmission in an optical waveguide of smart glasses according to an embodiment of the present disclosure. In AR glasses, an optical waveguide 103 couples light into a glass substrate, transmits the light to the front of the eye by the principle of total reflection, and then releases the light. In the process, the optical waveguide 103 is only responsible for transmitting images, and the display screen and the imaging system can be moved to the top or the side of the forehead far away from the glasses through the optical waveguide 103 serving as a transmission channel, so that the blockage of the optical system to the external sight line is greatly reduced, the weight distribution is more in line with the ergonomics, and the wearing experience of the equipment is improved. The light emitted by the light source is projected to the coupling-in position, diffracted by the coupling-in grating 1031 and enters the optical waveguide 103, the transmission of the light is total reflection in the optical waveguide 103, and the coupling-out grating 1032 guides the light to the human eye for imaging at the coupling-out position. A virtual image can be seen at the position of the human eyes, and a user can also see the real world due to the transparent property of the optical waveguide. Wherein, the structure of the grating can be a bulk phase grating or a surface relief grating. The incoupling grating 1031 and the outcoupling grating 1032 may be designed to correspond to different wavelengths in multiple layers, or in single layer.
When the display frames are different, namely, the virtual display screens are displayed differently, the angles of view of the virtual display screens for users to watch may also be different. The distances from all positions in the virtual display screen to human eyes are different, wherein the distance from the center of the virtual display screen to the human eyes is the closest, and the distance from the edge of the virtual display screen to the human eyes is the farthest. Based on the above, when the viewing angle is large and the user views the virtual image on the virtual display screen, the difference between the distance from the edge of the display screen to the human eyes and the distance from the center of the virtual display screen to the human eyes is too large, so that the edge of the image is deformed. In order to solve the problem, in the embodiment of the application, real content of the virtual display screen is detected, when a display picture of the virtual display screen changes and the size of a corresponding display area changes, the size of a field angle also changes correspondingly, when the field angle is large, the edge of the flexible optical waveguide can be driven to move to adjust the optical waveguide to be in a bent state, and then the virtual display screen is adjusted from a flat display state to a curved display state, so that deformation of the display picture at the edge is avoided, and the blending feeling of a user when the user views the display picture is improved. The method comprises the following specific steps:
the controller 101 of the smart glasses 100 according to the embodiment of the present application is configured to:
determining a display area corresponding to a current display picture;
determining a virtual imaging distance, and determining a field angle according to the virtual imaging distance and the display area;
when the field angle is larger than a preset threshold value and the virtual display screen is in a plane display state at present, determining the displacement of a first target according to the field angle;
and controlling the optical waveguide driving module to drive the edge of the optical waveguide to move according to the first target displacement so as to adjust the virtual display screen from a planar display state to a curved display state.
Referring to fig. 1d, fig. 1d is a schematic view of an optical machine of smart glasses according to an embodiment of the present disclosure. In this embodiment, the optical engine (also referred to as optical engine) 102 mainly includes a display 1021 and a lens 1022. The optical machine is used for projecting images displayed by the display screen 1021 from the optical machine according to a certain proportion and a certain visual angle.
During the use of the smart glasses, the size of the display screen may change, but the display screen of each scene is not always in a large field angle. For example, when a user watches a movie using AR glasses, the display screen is generally large, and a large viewing angle is obtained. For another example, in some scenes where the display screen is not large, such as displaying some auxiliary information or some text information through the AR glasses, the viewing angle may be small.
According to the scheme in the embodiment of the application, the size of the display area corresponding to the display picture is detected. For example, the display screen of the virtual display screen is detected, and when the change of the display area corresponding to the display screen is detected, the display area corresponding to the current display screen is determined. The display area may be a regular area, for example, in an embodiment, the display area includes a minimum rectangular area of the current whole display frame.
And after the display area is determined, acquiring the vertical distance from the virtual display screen to the glasses of the user, namely the virtual imaging distance. The angle of view, which may be a diagonal angle of view or a horizontal angle of view, is calculated from the virtual imaging distance and the display area. In some scenarios, the field of view may also be a vertical field of view.
After the angle of view is determined, if the angle of view is larger than a preset threshold value and the virtual display screen is in a plane display state at present, determining the displacement of the first target according to the virtual imaging distance and the angle of view. The preset threshold value can be preset according to needs. For example, in some embodiments, the preset threshold may be 15-30 °.
In an embodiment, the controller 101 may be further configured to: and determining a preset displacement corresponding to the field angle according to the preset mapping relation, and taking the preset displacement as the first target displacement.
In this embodiment, preset displacements corresponding to the field angles are preset, and corresponding preset displacements are set for different field angles to establish a preset mapping relationship. And acquiring a preset displacement corresponding to the calculated field angle according to the preset mapping relation, and taking the preset displacement as the first target displacement.
Alternatively, in another embodiment, the controller 101 may be further configured to: and determining a preset distance interval corresponding to the virtual imaging distance, acquiring a preset mapping relation corresponding to the preset distance interval, and acquiring a preset displacement corresponding to the calculated field angle according to the preset mapping relation to serve as the first target displacement.
After the first target displacement is determined, the controller 101 controls the optical waveguide driving module 104 to drive the edge of the optical waveguide 103 to move according to the first target displacement, so that the edge portion is bent toward the center, and a curved surface display state is formed. Due to the bending of the light guide, the virtual display screen is also displayed with the same curvature as the light guide. Referring to fig. 1e, fig. 1e is a first schematic view of state switching of smart glasses according to an embodiment of the present disclosure.
Referring to fig. 1f, fig. 1f is a schematic structural diagram of an optical waveguide driving module 104 of smart glasses according to an embodiment of the present disclosure. The optical waveguide driving module 104 includes a motor 1041, a telescopic portion 1042 and a transmission portion 1043, wherein the transmission portion 1043 contacts with the optical waveguide. The motor 1041 drives the telescopic portion 1042 to extend and retract, so as to drive the transmission portion 1043 to drive the edge of the optical waveguide to move, thereby forming a bending state. The motor 1041 may be a stepping motor.
Referring to fig. 1g, fig. 1g is another schematic view of an optical waveguide of smart glasses according to an embodiment of the present disclosure. Wherein fig. 1g is a view of the optical waveguide in the direction of the virtual normal of the optical waveguide. In some embodiments, the middle position of the upper and lower edges of the optical waveguide is used as the fixing region 1033, the fixing module fixes the middle position, the corresponding positions of the left and right edges of the optical waveguide are used as the pushing region 1034, and the driving portion 1043 of the optical waveguide driving module 104 pushes the pushing region 1034 to move, so as to form a curved display state in the horizontal direction as shown in the right side of fig. 1 g.
Referring to fig. 1h, fig. 1h is another schematic view of an optical waveguide of smart glasses according to an embodiment of the present disclosure. Wherein fig. 1h is a view of the optical waveguide in the direction of the virtual normal of the optical waveguide. In some embodiments, the middle position of the left and right edges of the optical waveguide is used as the fixing region 1033, the fixing module fixes the optical waveguide, the corresponding positions of the upper and lower edges of the optical waveguide are used as the pushing region 1034, and the pushing region 1034 is pushed by the transmission portion 1043 of the optical waveguide driving module 104 to move, so as to form a curved display state in the vertical direction as shown in the right side of fig. 1 h.
Wherein, in some embodiments, the optical waveguide comprises a first edge and a second edge; the controller is further configured to: determining the display direction of the display area; when the display direction is the horizontal direction, controlling the optical waveguide driving module to drive the first edge of the optical waveguide to move according to the first target displacement so as to adjust the virtual display screen from the planar display state to the curved display state in the horizontal direction; and when the display direction is the vertical direction, controlling the optical waveguide driving module to drive the second edge of the optical waveguide to move according to the first target displacement so as to adjust the virtual display screen from the planar display state to the curved display state in the vertical direction.
In this embodiment, curved surface display states in different directions can be selected according to the display direction of the display area. Wherein when the length (the size in the horizontal direction) of the display area is larger than the width (the size in the vertical direction), the display direction of the display area is determined to be the horizontal direction, and when the length of the display area is smaller than the width, the display direction of the display area is determined to be the vertical direction. The left and right edges (vertical direction) of the optical waveguide are used as first edges, and the upper and lower edges (horizontal direction) of the optical waveguide are used as second edges.
If the display direction of the display area is horizontal, as shown in fig. 1g, the second edge is fixed by the fixing module, and the first edge is pushed by the transmission part 1043 of the optical waveguide driving module 104 to move, so as to form a curved display state in the horizontal direction as shown in the right side of fig. 1 g.
If the display direction of the display area is vertical, as shown in fig. 1h, the first edge is fixed by the fixing module, and the second edge is pushed by the transmission part 1043 of the optical waveguide driving module 104 to move, so as to form a curved display state in the vertical direction as shown in the right side of fig. 1 h.
It is understood that the fixing module releases the fixing of the first edge before the driving portion 1043 of the optical waveguide driving module 104 pushes the first edge to move. Before the second edge is pushed to move by the transmission part 1043 of the optical waveguide driving module 104, the fixing of the second edge by the fixing module is released.
Further, it is understood that the purpose of controlling the light guide 103 to form the curved display state is to minimize or even eliminate the difference between the distance from the edge of the virtual display screen to the user's eye and the distance from the center of the virtual display screen to the user's eye. However, since the light coupling-out grating 1032 is not disposed at the middle of the light guide 1032, it is generally disposed at one side, and the light coupling-out grating 1032 corresponds to a virtual display screen. Therefore, when the controller 101 controls the optical waveguide driving module 104 to drive the edge of the optical waveguide 103 to move according to the first target displacement, the displacements of the two edge movements on the left and right sides may be different, that is, the first target displacement includes two values corresponding to the displacements of the two edges on the left and right sides, respectively. The value of the displacement corresponding to the edge close to the optical machine is larger than the value of the displacement corresponding to the edge of the principle optical machine.
Wherein, in some embodiments, the controller 101 is further configured to: and when the field angle is smaller than a preset threshold value and the virtual display screen is in a curved surface display state at present, controlling the optical waveguide driving module to move to an initial position so as to adjust the virtual display screen from the curved surface display state to a plane display state.
In this embodiment, when the angle of view is small, the virtual display screen can be restored from the curved display state to the flat display state. The optical waveguide driving module 104 may be controlled to move back to the initial position.
Referring to fig. 1i, fig. 1i is a schematic structural diagram of a third type of smart glasses according to an embodiment of the present disclosure. In some embodiments, the smart glasses 100 further comprise an opto-mechanical drive module 105 electrically connected to the controller 101, the controller 101 further configured to:
determining a second target displacement and a target rotation angle when the optical waveguide is turned off according to the first target displacement of the optical waveguide; and when the optical waveguide moves, controlling the optical machine driving module to drive the optical machine to move according to the second target displacement and rotate according to the target rotation angle, so that the relative position between the optical machine 102 and the optical waveguide 103 is consistent with that before moving.
Referring to fig. 1j, fig. 1j is a second schematic view illustrating state switching of smart glasses according to an embodiment of the present disclosure. In order to ensure that the relative position between the optical engine and the optical waveguide (mainly the portion of the optical waveguide corresponding to the coupled grating) is not changed, the optical engine is driven by the optical engine driving module 105 to move according to the second target displacement and rotate according to the target rotation angle while the edge of the optical waveguide moves. In this embodiment, preset displacements corresponding to the angles of view are preset, and corresponding first preset displacements are set for different angles of view, where the first preset displacements indicate movement of the edge of the optical waveguide, and each first preset displacement has a corresponding second preset displacement and a corresponding preset rotation angle. After the field angle is calculated, according to the preset mapping relation, a first preset displacement corresponding to the calculated field angle is determined to be used as a first target displacement, and a second preset displacement and a preset rotation angle corresponding to the first target displacement are used as a second target displacement and a target rotation angle.
Wherein, in some embodiments, the controller 101 is further configured to: when a curvature adjusting instruction is received, acquiring a current field angle and a current virtual imaging distance, and determining a third target displacement corresponding to the current field angle and the current virtual imaging distance; and controlling the optical waveguide driving module to drive the edge of the optical waveguide to move according to the third target displacement so as to adjust the virtual display screen from the planar display state to the curved display state.
In this embodiment, the user triggers the curvature adjustment instruction by himself, and when detecting the curvature adjustment instruction, the controller 101 determines the displacement of the third target according to the current field angle and the current virtual imaging distance, where please refer to the above method for determining the displacement of the first target for the specific method for determining the displacement of the third target according to the current field angle and the current virtual imaging distance, which is not described herein again. In this embodiment, regardless of the size of the field angle, the user can adjust the virtual display screen from the flat display state to the curved display state as required.
In some embodiments, the controller 101 is further configured to: and when a curvature reset instruction is received, controlling the optical waveguide driving module to move to an initial position so as to adjust the virtual display screen from a curved surface display state to a plane display state.
Wherein, in some embodiments, the smart glasses further comprise a dynamic vision sensor module, and the controller 101 is further configured to:
acquiring imaging information of the eyes in the dynamic vision sensor module, and calculating position coordinates of the eyes according to the imaging information; and when the position coordinate is not positioned on the virtual normal line of the optical waveguide, controlling the optical waveguide driving module to drive the optical waveguide to move so that the position coordinate is positioned on the virtual normal line of the optical waveguide.
In this embodiment, a dynamic vision sensor module is disposed on the smart glasses 100, and the dynamic vision sensor module can be disposed on the smart glasses according to the following positions: when the user wears this intelligence glasses, the eyeball is located the field of view scope of this developments vision sensor module.
The dynamic vision sensor module comprises a dynamic vision sensor and a lens module, the lens module shoots an external object, light rays form an image on a pixel array of the dynamic vision sensor through conversion of the lens module, when the position of the external object changes, the position of the image formed on the pixel array changes along with the change of the light rays, and when the position of the image moves, the light sensation of a corresponding pixel also changes. For example, when the motion vision sensor module shoots an eye of a user, the position of an image reflected on the pixel array of the motion vision sensor moves when the eyeball of the user rotates, and the light sensitivity of the corresponding pixel changes. In this application embodiment, when the eyeball that is located the visual field scope of dynamic vision sensor module rotated, this kind of motion information was caught to the dynamic vision sensor module, gathered the event stream data of dynamic vision sensor module output. After the event stream data output by the dynamic vision sensor is acquired, the event stream data is extracted and calculated to obtain the imaging information of the eyeballs.
In addition, when the user wears the smart glasses, the parts except the eyeballs are still relative to the smart glasses, when the user changes the watching direction of the display screen, the eyeballs can rotate, and therefore the eyeball part of the eyes of the user is imaged on the dynamic vision sensor module according to the event stream data. The center position of the image can be regarded as the position coordinate of the eye, and whether the position coordinate is on the virtual normal line of the optical waveguide is detected. The virtual finding here refers to the virtual normal of the part of the optical waveguide corresponding to the outcoupling grating. If not, the optical waveguide is driven to move so that the position coordinates are located on a virtual normal line of the optical waveguide. In addition, it can be understood that, while the optical waveguide is controlled to move, the optical engine driving module is controlled to drive the optical engine to move according to the same displacement, so that the relative position between the optical engine and the optical waveguide is unchanged. The movement in this embodiment may be a movement in a planar display state, and if the adjustment is required to be in a curved display state, after the translation is completed, the optical waveguide is controlled to be adjusted from the planar display state to the curved display state.
Alternatively, in other embodiments, the position coordinates of the eyes may also be determined by providing a miniature directional light source (e.g., an infrared LED) and a sensor (e.g., an infrared camera) on the smart glasses 100.
As can be seen from the above, the smart glasses provided in the embodiments of the present application include a controller, and an optical waveguide driving module electrically connected to the controller, where the controller determines a display area corresponding to a current display screen, determines a virtual imaging distance, determines a viewing angle according to the virtual imaging distance and the display area, and determines a first target displacement according to the viewing angle when the viewing angle is greater than a preset threshold and the virtual display screen is currently in a planar display state, and then controls the optical waveguide driving module to drive an edge of the optical waveguide to move according to the first target displacement so as to adjust the virtual display screen from the planar display state to a curved display state.
The embodiment of the present application further provides a control method of smart glasses, where an execution main body of the control method of the smart glasses may be the control device of the smart glasses provided in the embodiment of the present application, or the smart glasses integrated with the control device of the smart glasses, where the control device of the smart glasses may be implemented in a hardware or software manner.
Referring to fig. 2, fig. 2 is a schematic flowchart illustrating a control method for smart glasses according to an embodiment of the present application. The specific process of the control method for the intelligent glasses provided by the embodiment of the application can be as follows:
in 201, a display area corresponding to the current display screen is determined.
At 202, a virtual imaging distance is determined, and a field angle is determined based on the virtual imaging distance and the display area.
In 203, when the field angle is greater than the preset threshold and the virtual display screen is currently in a planar display state, determining a first target displacement according to the field angle.
In 204, the edge of the optical waveguide is controlled to move according to the first target displacement, so as to adjust the virtual display screen from a planar display state to a curved display state.
In particular implementation, the present application is not limited by the execution sequence of the described steps, and some steps may be performed in other sequences or simultaneously without conflict.
It should be noted that the control method for the smart glasses provided in the embodiment of the present application and the smart glasses in the above embodiments belong to the same concept, and specific implementation processes thereof are detailed in the embodiment of the smart glasses, and are not described herein again.
As can be seen from the above, the control method of the smart glasses provided in the embodiment of the present application may be applied to smart glasses, determine a display area corresponding to a current display screen, determine a virtual imaging distance, determine a viewing angle according to the virtual imaging distance and the display area, determine, when the viewing angle is greater than a preset threshold and the virtual display screen is currently in a planar display state, a first target displacement according to the viewing angle, and then control an edge of the optical waveguide to move according to the first target displacement so as to adjust the virtual display screen from the planar display state to a curved display state.
In one embodiment, the control device of the intelligent glasses is further provided. Referring to fig. 3, fig. 3 is a schematic structural diagram of a control device 300 of smart glasses according to an embodiment of the present disclosure. The control device 300 of the smart glasses is applied to the smart glasses, and the control device 300 of the smart glasses includes an area determining unit 301, a viewing angle calculating unit 302, a displacement determining unit 303, and a control unit 304, as follows:
an area determining unit 301, configured to determine a display area corresponding to a current display screen;
a field angle calculation unit 302, configured to determine a virtual imaging distance, and determine a field angle according to the virtual imaging distance and the display area;
the displacement determining unit 303 is configured to determine, when the field angle is greater than the preset threshold and the virtual display screen is currently in a planar display state, a first target displacement according to the field angle;
and the control unit 304 is configured to control the edge of the optical waveguide to move according to the first target displacement, so as to adjust the virtual display screen from a planar display state to a curved display state.
In some embodiments, the control unit 304 is further configured to:
and when the field angle is smaller than the preset threshold value and the virtual display screen is in a curved surface display state at present, controlling the optical waveguide to recover to an initial position so as to adjust the virtual display screen from the curved surface display state to a plane display state.
In some embodiments, the optical waveguide comprises a first edge and a second edge; the control unit 304 is further configured to: determining a display direction of the display area;
when the display direction is the horizontal direction, controlling the first edge of the optical waveguide to move according to the first target displacement so as to adjust the virtual display screen from a planar display state to a curved display state in the horizontal direction;
and when the display direction is the vertical direction, controlling the second edge of the optical waveguide to move according to the first target displacement so as to adjust the virtual display screen from a planar display state to a curved display state in the vertical direction.
In some embodiments, the control unit 304 is further configured to: and determining a preset displacement corresponding to the field angle according to a preset mapping relation, and taking the preset displacement as a first target displacement.
In some embodiments, the control unit 304 is further configured to: determining the second target displacement and the target rotation angle according to the first target displacement of the optical waveguide; and controlling the optical machine to move according to the second target displacement while the optical waveguide moves, and rotating according to the target rotation angle so as to keep the relative position of the optical machine and the optical waveguide consistent with that before moving.
In some embodiments, the control unit 304 is further configured to: when a curvature adjusting instruction is received, acquiring a current field angle and a current virtual imaging distance, and determining a third target displacement corresponding to the current field angle and the current virtual imaging distance; and controlling the edge of the optical waveguide to move according to the third target displacement so as to adjust the virtual display screen from a planar display state to a curved display state.
In some embodiments, the smart glasses further comprise a dynamic vision sensor module, and the control unit 304 is further configured to: acquiring imaging information of the eyes in the dynamic vision sensor module, and calculating position coordinates of the eyes according to the imaging information;
and when the position coordinate is not positioned on the virtual normal line of the optical waveguide, controlling the optical waveguide to move so that the position coordinate is positioned on the virtual normal line of the optical waveguide.
In some embodiments, the region determining unit 301 is further configured to: detecting a display picture of a virtual display screen, and determining a display area corresponding to the current display picture when detecting that the display area corresponding to the display picture changes
It should be noted that the control device of the smart glasses provided in the embodiment of the present application and the control method of the smart glasses in the foregoing embodiments belong to the same concept, and any method provided in the control method embodiment of the smart glasses can be implemented by the control device of the smart glasses, and the specific implementation process of the method is detailed in the control method embodiment of the smart glasses, and is not described herein again.
As can be seen from the above, the control device for smart glasses provided in the embodiment of the present application may be applied to smart glasses, determine a display area corresponding to a current display screen, determine a virtual imaging distance, determine a viewing angle according to the virtual imaging distance and the display area, determine a first target displacement according to the viewing angle when the viewing angle is greater than a preset threshold and the virtual display screen is currently in a planar display state, and then control an edge of the optical waveguide to move according to the first target displacement so as to adjust the planar display state of the virtual display screen to a curved display state.
The embodiment of the application further provides intelligent glasses. The smart glasses can be a smart phone, a tablet computer and other devices. Referring to fig. 4, fig. 4 is a schematic view illustrating a fourth structure of smart glasses according to an embodiment of the present application. The smart glasses 400 include a processor 401 and a memory 402. The processor 401 is electrically connected to the memory 402.
The processor 401 is a control center of the smart glasses 400, connects various parts of the entire smart glasses using various interfaces and lines, and performs various functions of the smart glasses and processes data by running or calling a computer program stored in the memory 402 and calling data stored in the memory 402, thereby performing overall monitoring of the smart glasses.
In this embodiment, the processor 401 in the smart glasses 400 loads instructions corresponding to one or more computer program processes into the memory 402 according to the following steps, and the processor 401 runs the computer program stored in the memory 402, so as to implement various functions:
determining a display area corresponding to a current display picture;
determining a virtual imaging distance, and determining a field angle according to the virtual imaging distance and the display area;
when the field angle is larger than the preset threshold value and the virtual display screen is in a plane display state at present, determining first target displacement according to the field angle;
and controlling the edge of the optical waveguide to move according to the first target displacement so as to adjust the virtual display screen from a planar display state to a curved display state.
An embodiment of the present application further provides a storage medium, where a computer program is stored, and when the computer program runs on a computer, the computer executes the method for controlling smart glasses according to any one of the above embodiments.
It should be noted that, all or part of the steps in the methods of the above embodiments may be implemented by hardware related to instructions of a computer program, which may be stored in a computer-readable storage medium, which may include, but is not limited to: a Read Only Memory (ROM), a Random Access Memory (RAM), a magnetic or optical disk, and the like.
Furthermore, the terms "first", "second", and "third", etc. in this application are used to distinguish different objects, and are not used to describe a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, article, or apparatus that comprises a list of steps or modules is not limited to only those steps or modules listed, but rather, some embodiments may include other steps or modules not listed or inherent to such process, method, article, or apparatus.
The method and the device for controlling the smart glasses, the storage medium and the smart glasses provided by the embodiments of the present application are described in detail above. The principle and the embodiment of the present application are explained by applying specific examples, and the above description of the embodiments is only used to help understand the method and the core idea of the present application; meanwhile, for those skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.
Claims (9)
1. The intelligent glasses are characterized by comprising a controller, an optical machine, an optical waveguide and an optical waveguide driving module, wherein the optical machine, the optical waveguide and the optical waveguide driving module are electrically connected with the controller; the controller is configured to:
detecting a display picture of a virtual display screen, and determining a display area corresponding to the current display picture when detecting that the display area corresponding to the display picture changes;
determining a virtual imaging distance, and determining a field angle according to the virtual imaging distance and the display area;
when the field angle is larger than a preset threshold value and the virtual display screen is in a plane display state at present, determining first target displacement according to the field angle;
controlling the optical waveguide driving module to drive the edge of the optical waveguide to move according to the first target displacement so as to adjust the virtual display screen from a planar display state to a curved display state;
the controller is further configured to:
determining a display direction of the display area;
when the display direction is the horizontal direction, controlling the optical waveguide driving module to drive the first edge of the optical waveguide to move according to the first target displacement so as to adjust the virtual display screen from a planar display state to a curved display state in the horizontal direction;
and when the display direction is the vertical direction, controlling the optical waveguide driving module to drive the second edge of the optical waveguide to move according to the first target displacement so as to adjust the virtual display screen from a planar display state to a curved display state in the vertical direction.
2. The smart eyewear of claim 1, wherein the controller is further to:
and when the field angle is smaller than the preset threshold value and the virtual display screen is in a curved surface display state at present, controlling the optical waveguide driving module to move to an initial position so as to adjust the virtual display screen from the curved surface display state to a plane display state.
3. The smart eyewear of claim 1, wherein the controller is further to:
and determining a preset displacement corresponding to the field angle according to a preset mapping relation, and taking the preset displacement as a first target displacement.
4. The smart glasses according to claim 1, further comprising an opto-mechanical drive module electrically connected to the controller; the controller is further configured to:
determining a second target displacement and a target rotation angle according to the first target displacement of the optical waveguide;
and controlling the optical machine driving module to drive the optical machine to move according to the second target displacement while the optical waveguide moves, and rotating according to the target rotation angle, so that the relative position of the optical machine and the optical waveguide is consistent with that before moving.
5. The smart eyewear of claim 1, wherein the controller is further to:
when a curvature adjusting instruction is received, acquiring a current field angle and a current virtual imaging distance, and determining a third target displacement corresponding to the current field angle and the current virtual imaging distance;
and controlling the optical waveguide driving module to drive the edge of the optical waveguide to move according to the third target displacement so as to adjust the virtual display screen from a planar display state to a curved display state.
6. The smart eyewear of claim 1, wherein the smart eyewear further comprises a dynamic vision sensor module, the controller further to:
acquiring imaging information of the eyes in the dynamic vision sensor module, and calculating position coordinates of the eyes according to the imaging information;
and when the position coordinate is not positioned on the virtual normal line of the optical waveguide, controlling the optical waveguide driving module to drive the optical waveguide to move so as to enable the position coordinate to be positioned on the virtual normal line of the optical waveguide.
7. A control method of intelligent glasses is characterized by comprising the following steps:
detecting a display picture of a virtual display screen, and determining a display area corresponding to the current display picture when detecting that the display area corresponding to the display picture changes;
determining a virtual imaging distance, and determining a field angle according to the virtual imaging distance and the display area;
when the field angle is larger than a preset threshold value and the virtual display screen is in a plane display state at present, determining first target displacement according to the field angle;
controlling the edge of the optical waveguide to move according to the first target displacement so as to adjust the virtual display screen from a planar display state to a curved display state, and the method comprises the following steps:
determining a display direction of the display area;
when the display direction is the horizontal direction, controlling an optical waveguide driving module to drive a first edge of the optical waveguide to move according to the first target displacement so as to adjust the virtual display screen from a planar display state to a curved display state in the horizontal direction;
and when the display direction is the vertical direction, controlling the optical waveguide driving module to drive the second edge of the optical waveguide to move according to the first target displacement so as to adjust the virtual display screen from a planar display state to a curved display state in the vertical direction.
8. A control device of intelligent glasses, comprising:
the area determining unit is used for detecting a display picture of the virtual display screen, and determining a display area corresponding to the current display picture when detecting that the display area corresponding to the display picture changes;
the viewing angle calculation unit is used for determining a virtual imaging distance and determining a viewing angle according to the virtual imaging distance and the display area;
the displacement determining unit is used for determining first target displacement according to the field angle when the field angle is larger than a preset threshold value and the virtual display screen is in a plane display state currently;
the control unit is used for controlling the edge of the optical waveguide to move according to the first target displacement so as to adjust the virtual display screen from a planar display state to a curved display state;
the control unit is further configured to: determining a display direction of the display area; when the display direction is the horizontal direction, controlling an optical waveguide driving module to drive a first edge of the optical waveguide to move according to the first target displacement so as to adjust the virtual display screen from a planar display state to a curved display state in the horizontal direction; and when the display direction is the vertical direction, controlling the optical waveguide driving module to drive the second edge of the optical waveguide to move according to the first target displacement so as to adjust the virtual display screen from a planar display state to a curved display state in the vertical direction.
9. A storage medium having stored thereon a computer program, characterized in that, when the computer program runs on a computer, causes the computer to execute the control method of smart glasses according to claim 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010879364.7A CN111965826B (en) | 2020-08-27 | 2020-08-27 | Control method and device of intelligent glasses, storage medium and intelligent glasses |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010879364.7A CN111965826B (en) | 2020-08-27 | 2020-08-27 | Control method and device of intelligent glasses, storage medium and intelligent glasses |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111965826A CN111965826A (en) | 2020-11-20 |
| CN111965826B true CN111965826B (en) | 2022-11-15 |
Family
ID=73400530
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010879364.7A Active CN111965826B (en) | 2020-08-27 | 2020-08-27 | Control method and device of intelligent glasses, storage medium and intelligent glasses |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111965826B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113064280A (en) * | 2021-04-08 | 2021-07-02 | 恒玄科技(上海)股份有限公司 | Intelligent display device |
| CN114578571A (en) * | 2022-04-22 | 2022-06-03 | Oppo广东移动通信有限公司 | Zoom lens and wearable device |
Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1813213A (en) * | 2003-04-25 | 2006-08-02 | 微型光学公司 | Binocular viewing system |
| JP2014142228A (en) * | 2013-01-23 | 2014-08-07 | Olympus Corp | Shape sensor |
| CN104656258A (en) * | 2015-02-05 | 2015-05-27 | 上海理湃光晶技术有限公司 | Diopter-adjustable curved surface waveguide near-to-eye optical display device |
| CN105899983A (en) * | 2013-12-23 | 2016-08-24 | 瑞士Csem电子显微技术研发中心 | Guided mode resonance device |
| CN106461871A (en) * | 2014-03-31 | 2017-02-22 | 华为技术有限公司 | Apparatus and method for waveguide polarizer comprising series of bends |
| US9733475B1 (en) * | 2014-09-08 | 2017-08-15 | Rockwell Collins, Inc. | Curved waveguide combiner for head-mounted and helmet-mounted displays (HMDS), a collimated virtual window, or a head up display (HUD) |
| CN107422475A (en) * | 2016-05-24 | 2017-12-01 | 华为终端（东莞）有限公司 | A kind of intelligent glasses curvature adjusting method and device |
| WO2017219433A1 (en) * | 2016-06-20 | 2017-12-28 | 东莞市长资实业有限公司 | Optical device for waveguide headset display |
| CN108803028A (en) * | 2017-05-03 | 2018-11-13 | 英特尔公司 | Beam direction equipment |
| US10228565B1 (en) * | 2016-05-27 | 2019-03-12 | Facebook Technologies, Llc | Variable focus waveguide display |
| CN110082857A (en) * | 2019-04-28 | 2019-08-02 | 浙江大学 | A kind of bending micro-nano optical waveguide based on metal nanoparticle coupled structure |
| CN110211496A (en) * | 2019-05-31 | 2019-09-06 | 京东方科技集团股份有限公司 | Flexible displays and its curvature adjusting method |
| CN110291442A (en) * | 2017-02-13 | 2019-09-27 | 视瑞尔技术公司 | Light guide and display device for indicating scene |
| CN110806645A (en) * | 2019-11-20 | 2020-02-18 | 深圳惠牛科技有限公司 | Grating waveguide for augmented reality |
| CN111065951A (en) * | 2017-07-13 | 2020-04-24 | 视瑞尔技术公司 | Display device for enlarging field of view |
| CN111381377A (en) * | 2020-04-24 | 2020-07-07 | 深圳珑璟光电技术有限公司 | Near-to-eye display equipment |
| CN111458880A (en) * | 2020-05-09 | 2020-07-28 | 三生万物(北京)人工智能技术有限公司 | Waveguide light field display device and head-mounted augmented reality glasses |
Family Cites Families (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1158332A1 (en) * | 1999-12-27 | 2001-11-28 | Ngk Insulators, Ltd. | Display and method for manufacturing the same |
| CN1512261A (en) * | 2002-12-30 | 2004-07-14 | 中强光电股份有限公司 | Regulator |
| WO2008053888A1 (en) * | 2006-10-31 | 2008-05-08 | Nippon Shokubai Co., Ltd. | Flexible optical waveguide, method for producing the same, and epoxy resin composition for flexible optical waveguide |
| JP5232126B2 (en) * | 2009-11-09 | 2013-07-10 | シャープ株式会社 | Display device and image forming apparatus |
| JP2015118055A (en) * | 2013-12-19 | 2015-06-25 | 株式会社東芝 | Optical waveguide type measurement system |
| CN103941456B (en) * | 2014-05-14 | 2016-06-08 | 深圳市华星光电技术有限公司 | The curvature of Curved LCD adjusts structure |
| US9759919B2 (en) * | 2015-01-05 | 2017-09-12 | Microsoft Technology Licensing, Llc | Virtual image display with curved light path |
| CN105866949B (en) * | 2015-01-21 | 2018-08-17 | 成都理想境界科技有限公司 | The binocular AR helmets and depth of field adjusting method of the depth of field can be automatically adjusted |
| CN104848798B (en) * | 2015-06-08 | 2018-09-11 | 京东方科技集团股份有限公司 | A kind of flexuosity detection method of flexible display and flexible display screen |
| GB201517607D0 (en) * | 2015-10-06 | 2015-11-18 | Silver Joshua D | Novel optical waveguide display |
| CN105629378B (en) * | 2016-01-04 | 2018-03-16 | 京东方科技集团股份有限公司 | Display base plate and display device |
| DE102016201567A1 (en) * | 2016-02-02 | 2017-08-03 | Robert Bosch Gmbh | Projection device for a data glasses, method for displaying image information by means of a projection device and control device |
| CN107305465A (en) * | 2016-04-17 | 2017-10-31 | 上海凌先电子科技有限公司 | The display operating device and method of a kind of virtual key |
| DE102016124538A1 (en) * | 2016-12-15 | 2018-06-21 | tooz technologies GmbH | Data glasses, spectacle glass for data glasses and methods of generating an image on the retina |
| US20180172981A1 (en) * | 2016-12-16 | 2018-06-21 | Fusao Ishii | Wearable display |
| US10983346B2 (en) * | 2017-09-07 | 2021-04-20 | Microsoft Technology Licensing, Llc | Display apparatuses, systems and methods including curved waveguides |
| CN107748656B (en) * | 2017-10-19 | 2021-07-09 | Oppo广东移动通信有限公司 | Picture display method, device, terminal and storage medium |
| CN108089332B (en) * | 2017-12-15 | 2021-04-20 | 歌尔光学科技有限公司 | VR head-mounted display equipment and display method |
| CN108228032A (en) * | 2018-01-26 | 2018-06-29 | 维沃移动通信有限公司 | The control method and mobile terminal of a kind of display screen |
| CN108646413A (en) * | 2018-05-13 | 2018-10-12 | 深圳纬目信息技术有限公司 | A kind of headset equipment of the eyeball tracking device of the optical waveguide of free form surface containing multilayer |
| CN110275303A (en) * | 2019-06-13 | 2019-09-24 | 句容福芯电子有限公司 | Near-eye display based on holographical wave guide |
| CN211086805U (en) * | 2019-10-14 | 2020-07-24 | 深圳市思坦科技有限公司 | Micro-L ED virtual imaging system, VR glasses and AR glasses |
| CN211086808U (en) * | 2019-12-18 | 2020-07-24 | 深圳奥比中光科技有限公司 | Optical waveguide near-to-eye display device and electronic equipment |
-
2020
- 2020-08-27 CN CN202010879364.7A patent/CN111965826B/en active Active
Patent Citations (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1813213A (en) * | 2003-04-25 | 2006-08-02 | 微型光学公司 | Binocular viewing system |
| JP2014142228A (en) * | 2013-01-23 | 2014-08-07 | Olympus Corp | Shape sensor |
| CN105899983A (en) * | 2013-12-23 | 2016-08-24 | 瑞士Csem电子显微技术研发中心 | Guided mode resonance device |
| CN106461871A (en) * | 2014-03-31 | 2017-02-22 | 华为技术有限公司 | Apparatus and method for waveguide polarizer comprising series of bends |
| US9733475B1 (en) * | 2014-09-08 | 2017-08-15 | Rockwell Collins, Inc. | Curved waveguide combiner for head-mounted and helmet-mounted displays (HMDS), a collimated virtual window, or a head up display (HUD) |
| CN104656258A (en) * | 2015-02-05 | 2015-05-27 | 上海理湃光晶技术有限公司 | Diopter-adjustable curved surface waveguide near-to-eye optical display device |
| CN107422475A (en) * | 2016-05-24 | 2017-12-01 | 华为终端（东莞）有限公司 | A kind of intelligent glasses curvature adjusting method and device |
| US10228565B1 (en) * | 2016-05-27 | 2019-03-12 | Facebook Technologies, Llc | Variable focus waveguide display |
| WO2017219433A1 (en) * | 2016-06-20 | 2017-12-28 | 东莞市长资实业有限公司 | Optical device for waveguide headset display |
| CN110291442A (en) * | 2017-02-13 | 2019-09-27 | 视瑞尔技术公司 | Light guide and display device for indicating scene |
| CN108803028A (en) * | 2017-05-03 | 2018-11-13 | 英特尔公司 | Beam direction equipment |
| CN111065951A (en) * | 2017-07-13 | 2020-04-24 | 视瑞尔技术公司 | Display device for enlarging field of view |
| CN110082857A (en) * | 2019-04-28 | 2019-08-02 | 浙江大学 | A kind of bending micro-nano optical waveguide based on metal nanoparticle coupled structure |
| CN110211496A (en) * | 2019-05-31 | 2019-09-06 | 京东方科技集团股份有限公司 | Flexible displays and its curvature adjusting method |
| CN110806645A (en) * | 2019-11-20 | 2020-02-18 | 深圳惠牛科技有限公司 | Grating waveguide for augmented reality |
| CN111381377A (en) * | 2020-04-24 | 2020-07-07 | 深圳珑璟光电技术有限公司 | Near-to-eye display equipment |
| CN111458880A (en) * | 2020-05-09 | 2020-07-28 | 三生万物(北京)人工智能技术有限公司 | Waveguide light field display device and head-mounted augmented reality glasses |
Non-Patent Citations (1)
| Title |
|---|
| 彭玉颜等.用于集成成像3D显示的曲面微透镜阵列设计与仿真.《光子学报》.2016,(第03期), * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111965826A (en) | 2020-11-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI681663B (en) | Near-eye display with extended effective eyebox via eye tracking | |
| EP3000020B1 (en) | Hologram anchoring and dynamic positioning | |
| US8780014B2 (en) | Switchable head-mounted display | |
| KR101789357B1 (en) | Automatic focus improvement for augmented reality displays | |
| KR101912958B1 (en) | Automatic variable virtual focus for augmented reality displays | |
| US9111498B2 (en) | Head-mounted display with environmental state detection | |
| CA2820950C (en) | Optimized focal area for augmented reality displays | |
| US8619005B2 (en) | Switchable head-mounted display transition | |
| US8599246B2 (en) | Storage medium storing display controlling program, display controlling apparatus, display controlling method and display controlling system | |
| US20130342572A1 (en) | Control of displayed content in virtual environments | |
| US20130326364A1 (en) | Position relative hologram interactions | |
| US20120050140A1 (en) | Head-mounted display control | |
| EP3714318B1 (en) | Position tracking system for head-mounted displays that includes sensor integrated circuits | |
| US20120050142A1 (en) | Head-mounted display with eye state detection | |
| US20190020869A1 (en) | Non-planar computational displays | |
| US20120050044A1 (en) | Head-mounted display with biological state detection | |
| CN111965826B (en) | Control method and device of intelligent glasses, storage medium and intelligent glasses | |
| CN112515624A (en) | Tracking eyes using low resolution images | |
| CN111684496B (en) | Apparatus and method for tracking focus in a head-mounted display system | |
| CN112655202B (en) | Reduced bandwidth stereoscopic distortion correction for fisheye lenses of head-mounted displays | |
| CN110879469A (en) | Head-mounted display equipment | |
| CN112346558A (en) | Eye tracking system | |
| CN110895433B (en) | Method and apparatus for user interaction in augmented reality | |
| WO2019051228A1 (en) | Camera-based transparent display | |
| US20210392318A1 (en) | Gaze tracking apparatus and systems |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |