WO2025103267A1 - Display module control method, display module control device and near-eye display device - Google Patents

Abstract

The present application provides a display module control method and control device and a near-eye display device. The display module control method comprises: monitoring the motion state of a display module on a lens to which the display module is currently connected; and when a target motion state is detected, controlling the display module to image a graphical interface of a target logic function on the lens, wherein the target motion state is preset to trigger a trigger condition for the target logic function. A user can control a display module to make a motion, capable of triggering a logic function to be triggered, on a lens to which the display module is connected, so as to trigger said logic function to start to operate, and then control the display module to image a graphical interface of the triggered logic function on the lens to which the display module is connected, so that the user can quickly interact with virtual information presented by the display module.

Description

Display module control method, display module control device and near-eye display device

This application claims the priority of the patent application filed with the China Patent Office on November 17, 2023, with application number 2023115480693 and application name “Near-eye display module and device”; the priority of the patent application filed with the China Patent Office on November 22, 2023, with application number 2023115809662 and application name “Optical module, near-eye display device and optical module processing method”; the priority of the patent application filed with the China Patent Office on December 15, 2023, with application number 2023117335355 and application name “Control method of display module, near-eye display device, electronic device and medium”; the priority of the patent application filed with the China Patent Office on December 29, 2023, with application number 2023118680668 , the priority right of the patent application with the application name “Control method of display module, near-eye display device”; the priority right of the patent application with application number 2023118679567, submitted to the China Patent Office on December 29, 2023, and the application name “Control method of display module and near-eye display device”; the priority right of the patent application with application number 2024201197317, submitted to the China Patent Office on January 17, 2024, and the application name “Near-eye display device and charging box”; the priority right of the patent application with application number 2024105440675, submitted to the China Patent Office on April 30, 2024, and the application name “Near-eye display device and control method, near-eye display system”; all of the above contents are incorporated by reference in this application.

Technical Field

The present application belongs to the field of near-eye display technology, and more specifically, to a display module control method, a display module control device, and a near-eye display device.

Background Art

Near-eye display refers to imaging at a shorter imaging distance from the eyes for sensory perception. For example, virtual reality (VR) glasses and augmented reality (AR) glasses both image at a shorter distance from the eyes. In other words, near-eye display is a relative concept, relative to traditional televisions, monitors, etc. Obviously, the imaging distance from the display panel of televisions, monitors and other devices to the eyes is usually much greater than the imaging distance of near-eye display devices such as VR glasses or AR glasses.

At present, near-eye display can generally be divided into VR, AR, mixed reality (MR) and extended reality (XR).

VR, also known as computer-simulated reality, is an experience created through human-computer interaction and computer-generated three-dimensional simulation. We can interact in the environment by using virtual reality equipment, such as headphones and controllers. In other words, VR is a computer simulation system that can create and experience a virtual world. It uses computers to generate a simulated environment and immerse us in it.

AR is a real-time, direct or indirect observation of the physical environment of the real world. It combines what we see in the real environment with digital content generated by computer software to enhance the real environment we are in in some way. The AR system transmits virtual information to headphones or smart glasses or mobile devices in real time through the camera, allowing us to clearly view 3D images.

MR is the fusion of the real world and the virtual world to produce new environments and visualizations, in which physical objects and digital objects coexist and interact in real time. This means that if a new image is placed in the real space, to a certain extent, this new image will interact with the real objects in our real environment.

XR refers to the combination of all real and virtual environments and human-computer interactions generated by computer technology and wearable devices. XR integrates the world by digitally enhancing our senses. In addition, it provides a large number of different levels of virtual sensor input for immersive virtual experience. XR includes the three emerging technologies mentioned above, namely VR, AR and MR.

Summary of the invention

In the related art, users have a need to interact quickly with virtual information. The purpose of the embodiments of the present application is to provide a control method for a display module, an electronic device, a near-eye display device, a medium, a chip, and a computer program product, so as to independently or semi-independently solve the technical problem that users cannot quickly interact with virtual information in near-eye display technology to a certain extent. The independent solution refers to providing a hardware construction scheme that can work independently without the cooperation of software, so as to achieve the effect that users can quickly interact with virtual information in near-eye display technology. The semi-independent solution refers to providing a hardware construction scheme that can achieve the effect that users can quickly interact with virtual information in near-eye display technology when working in conjunction with near-eye display, such as software for users to interact with virtual information.

A first aspect of an embodiment of the present application provides a method for controlling a display module, wherein the display module is used to be connected to an optical lens, and the display module is configured to output image content, the method comprising:

Monitoring the motion state of the display module on the lens currently connected;

When the target motion state is detected, the display module is controlled to form a graphic interface of the target logic function on the lens; the target motion state is preset as a trigger condition for triggering the target logic function.

A second aspect of an embodiment of the present application provides a control device for a display module, wherein the display module is used to be connected to a lens of glasses and to form an image on the connected lens, and the device comprises:

A first monitoring module, used for monitoring the motion state of the display module on the lens currently connected;

The first execution module is used to control the display module to image a graphical interface of a target logic function on the lens when a target motion state is detected; the target motion state is preset as a trigger condition for triggering the target logic function.

A third aspect of an embodiment of the present application provides a near-eye display device, the near-eye display device comprising: a processor and a memory, the memory storing a program or instruction that can be run on the processor, the program or instruction being executed by the processor to implement a method for controlling a display module, the method comprising:

Monitoring the motion state of the display module on the lens currently connected;

When the target motion state is detected, the display module is controlled to form a graphic interface of the target logic function on the lens; the target motion state is preset as a trigger condition for triggering the target logic function.

In the embodiment of the present application, the display module used for augmented reality display imaging on the lens of the glasses can make some movements on the lens to which it is connected, instead of fixing the display module on the lens, and the motion states of some movements that the display module can make are preset as triggering conditions for triggering some logical functions. When it is detected that the motion state of the display module on the lens to which it is connected meets the triggering conditions of a certain logical function, the display module is controlled to image a graphical interface of the triggered logical function on the lens to which it is connected. Compared with the solution of fixing the display module on the lens in the related art, the user can control the display module to make a movement on the lens to which it is connected that can trigger the logical function to be triggered, thereby triggering the logical function to be triggered to start running, and then controlling the display module to image a graphical interface of the triggered logical function on the lens to which it is connected, so that the user can quickly interact with the virtual information presented by the display module.

More relevant beneficial technical effects of the present application will be described in the following embodiments.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the implementation will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

FIG1 is a schematic diagram of a connection between a display module and a lens provided in an embodiment of the present application;

2-3 are schematic diagrams of various application scenarios of a display module provided in an embodiment of the present application;

FIG4 is a schematic diagram of a connection relationship between a display module and a smart terminal provided in an embodiment of the present application;

FIG5 is a schematic diagram of a display module imaging main interface provided by an embodiment of the present application;

FIG6 is a schematic diagram of a step flow of a method for controlling a display module provided in an embodiment of the present application;

7-14 are schematic diagrams of various application scenarios of a display module provided in an embodiment of the present application;

FIG15 is a schematic diagram of a step flow of a method for controlling a display module provided in an embodiment of the present application;

FIG16 is a schematic diagram of a step flow of a method for controlling a display module provided in an embodiment of the present application;

FIG17 is a schematic diagram of an application scenario of a display module provided in an embodiment of the present application;

FIG18 is a schematic diagram of the structure of a control device for a display module provided in an embodiment of the present application;

FIG19 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

FIG20 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application;

FIG21 is a schematic diagram of the structure of a near-eye display device provided in an embodiment of the present application;

22-23 are schematic diagrams of various application scenarios of a display module provided in an embodiment of the present application;

FIG24 is a schematic diagram of a step flow of a method for controlling a display module provided in an embodiment of the present application;

25-30 are schematic diagrams of various application scenarios of a display module provided in an embodiment of the present application;

FIG31 is a schematic diagram of a step flow of a method for controlling a display module provided in an embodiment of the present application;

32-33 are schematic diagrams of various application scenarios of a display module provided in an embodiment of the present application;

34-39 are schematic diagrams of the step flow of each control method of the display module provided in the embodiments of the present application;

FIG40 is a schematic diagram of a display module imaging main interface provided by an embodiment of the present application;

FIG41 is a schematic diagram of a step flow of a method for controlling a display module provided in an embodiment of the present application;

42-48 are schematic diagrams of different application scenarios of a display module provided by an embodiment of the present application;

FIG49 is a schematic diagram of the structure of the glasses of the present application;

FIG50 is a schematic structural diagram of an example of a near-eye display module of the present application;

FIG51 is an exploded view of FIG50;

FIG52 is a schematic structural diagram of an example of an assembled state of the first connecting portion and the mounting seat in FIG50;

FIG53 is a top view of FIG50;

Fig. 54 is a cross-sectional view taken along line A-A in Fig. 53;

FIG55 is a schematic structural diagram of a first cover body in an example of the present application;

FIG56 is a schematic diagram of the structure of the second cover body in an example of the present application;

FIG57 is a schematic structural diagram of another example of a near-eye display module of the present application;

FIG58 is a partial exploded view of FIG57;

FIG59 is a schematic structural diagram of an example of a second connecting portion of the present application;

FIG60 is a schematic structural diagram of an optical module according to an embodiment of the present application;

FIG61 is a schematic structural diagram of another embodiment of an optical module provided in an embodiment of the present application;

FIG62 is a schematic diagram of an embodiment of the profiles of various relevant surfaces of an optical module provided in an embodiment of the present application;

FIG63 is a schematic diagram of the three-dimensional structure of an optical module according to an embodiment of the present application;

FIG64 is a schematic diagram of a three-dimensional structure of another embodiment of an optical module provided in an embodiment of the present application;

FIG65 is a schematic diagram of a three-dimensional structure of another embodiment of an optical module provided in an embodiment of the present application;

FIG66 is a schematic diagram of the three-dimensional structure of another embodiment of an optical module provided in an embodiment of the present application;

FIG67 is a schematic structural diagram of an optical module with an optical path according to an embodiment of the present application;

FIG68 is a schematic structural diagram of another embodiment of an optical module provided in an embodiment of the present application;

FIG69 is a schematic structural diagram of another embodiment of an optical module with an optical path provided in an embodiment of the present application;

FIG70 is a schematic structural diagram of another embodiment of an optical module provided in an embodiment of the present application;

FIG71 is a schematic diagram of the three-dimensional structure of another embodiment of an optical module provided in an embodiment of the present application;

FIG72 is a schematic structural diagram of another embodiment of an optical module provided in an embodiment of the present application;

FIG73 is a schematic diagram of the structure of an optical module provided by an embodiment of the present application in an application scenario of an eyeball;

FIG74 is a schematic diagram of a process flow of an optical module processing method according to an embodiment of the present application;

FIG75 is a schematic diagram of the overall structure of an embodiment of a near-eye display device of the present application;

FIG76 is a schematic diagram of the overall structure of an embodiment of a near-eye display device of the present application without temples;

FIG77 is a schematic diagram of the embodiment of FIG75 from another viewing angle;

FIG78 is a schematic diagram showing the overall structure of a plurality of display modules and a plurality of first coils;

FIG79 is a schematic cross-sectional view of a structure of an embodiment of a display module provided with a coil support;

FIG80 is a schematic diagram showing that the display module is provided with a second battery in the embodiment of FIG79;

FIG81 is a schematic diagram of the structural disassembly of the display module in the embodiment of FIG79;

FIG82 is a schematic cross-sectional view of the structure of another embodiment of a display module;

FIG83 is a schematic diagram showing that the display module is provided with a second battery in the embodiment of FIG82;

FIG84 is a schematic diagram of the structural disassembly of the display module in the embodiment of FIG83;

FIG85 is a schematic diagram of the overall structure of an embodiment of a charging box of the present application;

FIG86 is a schematic structural diagram of an embodiment of a near-eye display device provided by the present application;

FIG87 is a schematic diagram of the configuration structure of the moving area of a lens according to an embodiment of the present application;

FIG88 is a schematic diagram of the configuration structure of the moving area of another embodiment of the lens provided by the present application;

FIG89 is a schematic diagram of the configuration structure of the moving area of another embodiment of the lens provided by the present application;

FIG90 is a schematic diagram of display contents when a display component according to an embodiment of the present application is located in different moving areas;

FIG91 is a schematic block diagram of the structure of an embodiment of a display assembly provided by the present application;

FIG92 is a schematic block diagram of the structure of an output unit according to an embodiment of the present application;

FIG93 is a schematic block diagram of the structure of a sensing unit according to an embodiment of the present application;

FIG94 is a schematic diagram of an exploded structure of an embodiment of a display assembly provided by the present application;

FIG95 is a schematic block diagram of the structure of a terminal according to an embodiment of the present application;

FIG96 is a flowchart of an embodiment of a method for controlling a near-eye display device provided by the present application;

Figure 97 is a structural schematic diagram of an embodiment of a near-eye display system provided in the present application.

DETAILED DESCRIPTION

In order to make the technical problems, technical solutions and beneficial effects to be solved by the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not intended to limit the present application. Finalize the application.

It should be noted that when an element is referred to as being "fixed to" or "disposed on" another element, it can be directly on the other element or indirectly on the other element. When an element is referred to as being "connected to" another element, it can be directly connected to the other element or indirectly connected to the other element.

It should be understood that the terms "length", "width", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", etc., indicating the orientation or position relationship, are based on the orientation or position relationship shown in the drawings, and are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present application.

In addition, the terms "first" and "second" are used only for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the present application, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined. The term "and/or" is used to describe the association relationship of associated objects, indicating that three relationships may exist; for example, A and/or B may represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B may be singular or plural. The character "/" generally indicates that the associated objects before and after are in an "or" relationship. The reference to "one embodiment" or "some embodiments" described in the present application means that one or more embodiments of the present application include specific features, structures or characteristics described in combination with the embodiment. Thus, the statements "one embodiment", "some embodiments", "another embodiment", "some other embodiments", etc. that appear in different places in the present specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "include", "comprising", "having" and variations thereof mean "including but not limited to", unless specifically emphasized otherwise.

The embodiments of the present application provide a control method, device, equipment, near-eye display device, storage medium, chip and computer program product of a display module, which can effectively solve the technical problem that users cannot quickly interact with virtual information in AR or near-eye display technology. The following is an explanation with reference to the accompanying drawings. In order to facilitate (correct) understanding of the embodiments of the present application, the technical terms that may be involved in the embodiments of the present application are first defined and explained below. Unless otherwise specified in the following text, the semantics of the corresponding technical terms follow the definitions here:

Computer or computing device: refers to all electronic devices based on Turing computability theory, von Neumann structure or Harvard structure. For example, mobile phones, smart watches, single-chip computer systems, etc. are all computers, not just limited to the narrow sense of computers such as personal computers (PC) in daily life.

Application: Computer program or application software, which is written in some programming language and runs on a certain target structure computer system. Computer application refers to a coded instruction sequence that can be executed by a computer or other device with information processing capabilities in order to obtain a certain result, or a symbolic instruction sequence or symbolic statement sequence that can be automatically converted into a coded instruction sequence.

Logical functions: refers to various functions provided by various electronic devices such as near-eye display devices (with independent computing capabilities), computers or computing devices. These functions can be user-oriented functions or system (or device)-oriented functions. For example, user-oriented logical functions can be: graphical user interface (GUI) output function, audio output function, main interface or desktop, program/application, sub-functions in program/application, etc. Among them, the main interface or desktop, application, etc. can provide GUI to users for users to interact with. System-oriented logical functions can be: defragmentation of fragmented files, system error diagnosis, etc.

Foreground operation and background operation: Foreground operation and background operation are two relative concepts. Both are used to describe the operation mode of an application/program or process in an operating system (generally speaking, an operating system refers to the software in a computer that enables the application to communicate with the underlying hardware of the computer). The following uses a traditional computer as an example to explain foreground operation and background operation. In AR technology, foreground operation and background operation are two different concepts. The characteristics of running in the foreground and in the background are similar to those of running in a traditional computer. In a traditional computer, when an application is running in the foreground, the GUI of the application is usually displayed on the display screen, and the user can see the GUI or window of the application. The user can directly interact or communicate with the application based on the GUI. At this time, the application usually occupies the input device (such as the mouse and keyboard); the application running in the foreground usually blocks the user interface, and the user needs to wait for the application running in the foreground to complete execution or interact according to the needs of the application running in the foreground; it is suitable for tasks that require real-time user feedback or user input. In a traditional computer, when an application is running in the background, the GUI is usually not output on the display screen, that is, it is invisible to the user, and the user usually cannot directly interact or communicate with the application; when the application is running in the background, the user can continue to use the computer to perform other tasks, and the application runs silently in a state invisible to the user, such as processing files, executing system services, etc.; the application running in the background usually does not occupy the input device, and does not require the user to directly participate in the execution of the task; allowing the user to continue other tasks while the application is executing, improving the multitasking capability of the system.

Display module: refers to a display component, display device or display equipment based on optical imaging technology. Therefore, the display module is a physical hardware module. In some optional embodiments, the display module can be connected to the lens and powered on for imaging through the display module. The lens can be, for example, common sunglasses in daily life, glasses for vision correction, goggles or masks with lenses, etc., or lenses of smart glasses with audio, sensing, etc. The display module can be connected to the lens by means of magnetism, clips, etc., so that the display module can move freely on the lens to which it is connected or move in a specified setting area. For example, the display module can move in a straight line or curve, rotate on an axis, etc. on the placed lens.

In the related art, users have a need to interact quickly with virtual information. The purpose of the embodiments of the present application is to provide a control method, an electronic device, a near-eye display device, a medium, a chip, and a computer program product of a display module, so as to independently or semi-independently solve the technical problem that users cannot quickly interact with virtual information in near-eye display technology to a certain extent. The independent solution refers to providing a hardware construction scheme that can work independently without the cooperation of software, so as to achieve the effect that users can quickly interact with virtual information in near-eye display technology. The semi-independent solution refers to providing a hardware construction scheme that can achieve the effect that users can quickly interact with virtual information in near-eye display technology when working in conjunction with near-eye display, such as software for users to interact with virtual information in AR technology.

Exemplarily, as shown in FIG1 , FIG1 is a schematic diagram of a connection between a display module and a lens provided in an embodiment of the present application. Referring to FIG1 , a lens of glasses is used as an example for explanation of an embodiment, but the present application is not limited to glasses, and may also be lenses on head-mounted devices such as helmets, eye protection, vision correction, sports, etc., wherein the glasses 1 may be ordinary glasses, or may be AR glasses, smart glasses, etc. The glasses 1 include a frame 11, a lens 12 embedded in the frame 11, and temples 13 movably connected to the frame 11. The lens 12 includes an environment side 24 and a glasses side 22. The user's eyes can see the physical environment of the environment side through the lens 12 from the eye side. Optionally, the display module 2 is provided with a first magnetic member at one end of the lens 12 facing the environment side 24, and the display module 2 is provided with a second magnetic member at the side 22 of the lens 12 facing the eye side 22. It can be understood that two mutually adsorbed magnetic members are provided on both sides of the lens 12 to realize the pre-fixation of the display module on the lens, wherein the first magnetic member and the second magnetic member can be magnets that attract each other, of course, one of them can be a magnet and the other can be a metal that can be attracted by a magnet, etc., so that the display module 2 is adsorbed on the lens 12 as a whole, and the display module 2 can also slide freely on the lens 12 or rotate on the axis without detaching from the lens 12. Of course, other solutions such as adsorption and movement are also feasible here.

Exemplarily, as shown in FIG. 2 and FIG. 3, FIG. 2 and FIG. 3 are schematic diagrams of an application scenario of a display module provided in an embodiment of the present application, and FIG. 3 may be a front view of the glasses 1 observed from the direction where the temples 13 of the glasses 1 are located (i.e., the glasses side). Please refer to FIG. 1, FIG. 2 and FIG. 3 in combination. The direction indicated by the straight arrow a in FIG. 1 is the direction in which the eye observes the virtual image imaged by the display module 2 on the lens 12. When the user observes the end face of the display module 2 from the direction indicated by the arrow a, he or she can see the virtual image or graphic interface formed on the lens 12 based on the AR technology. That is, the end face of the display module 2 seen when observing the display module 2 from the direction of the arrow a shown in FIG. 1 is the display area 21 of the display module 2. When the display module 2 is in operation, the display area 21 may be in a "lit" state, that is, it can The image content can be formed, for example, it may include text, interactive interface, video, image and other related display content. The area on the lens 12 not occupied by the display module still maintains the properties of the lens 12 itself, for example, the user can see the environment side through the lens 12 through the eye side, such as eye protection, vision correction, etc., which exists as the properties of the lens itself.

In some optional embodiments, the center position of the lens 12 is a calibration position, which is a reference position of the display module 2. When the display module 2 is stationary at the calibration position, a main interface or an interface of a preset logical function is imaged on the lens 12. The center position of the lens 12 is determined as the calibration position because the display module 2 can move in more directions and distances in the circumferential direction at the center position, so as to facilitate the user to operate the display module 2 and customize the preset imaging area.

After wearing the glasses 1, the user can press (or pinch) the touch portion of the display module 2 to drag the display module 2 to move on the lens 12 or rotate the display module 2 to make the display module 2 rotate on the axis. In some embodiments, the display module 2 can be located on the environment side, and the light of the display area 21 can pass through the lens to the user's eyes on the eye side to form an image. At this time, the touch portion can be located on the environment side, so the user can interact better; in other embodiments, the display module 2 can be located on the glasses side, and at this time, the light of the display area 21 can directly enter the user's eyes to form an image. At this time, the touch portion can be located on the eye side, so the user can interact better and more covertly.

As shown in FIG22 , FIG22 is a schematic diagram of an application scenario of a display module provided by an embodiment of the present application. Referring to FIG22 , the touch portion of the display module 2 is located on the environment side 24 , and the user can press (or pinch) the touch portion of the display module 2 to drag the display module 2 to move on the lens 12 or rotate the display module 2 to make the display module 2 rotate on the axis.

In some optional embodiments, the virtual image or graphic interface formed by the display area 21 of the display module 2 on the lens 12 may come from the display module 2 itself, or the glasses 1 that are connected to the display module 2 in communication. Of course, in other embodiments, it may also come from other electronic devices that are relatively independent of the glasses 1 and the display module 2, such as smart terminals such as mobile phones and tablet computers, or computers. If the glasses 1 are ordinary glasses, the virtual image or graphic interface formed by the display module 2 on the lens 12 may come from other electronic devices that are relatively independent of the glasses 1 and the display module 2, such as smart terminals such as mobile phones and tablet computers, or computers.

Exemplarily, as shown in FIG4 , FIG4 is a schematic diagram of a connection relationship between a display module and a smart terminal provided in an embodiment of the present application. Referring to FIG4 , the display module 2 is (physically) connected to a near-eye display device 10, and the near-eye display device 10 may be the aforementioned glasses 1, and the smart terminal 4 may be a PC, a laptop, a smart phone, a tablet computer, a smart speaker, a server, etc., and a wired or wireless communication connection is established between the display module 2 and the smart terminal 4. For example, the display module 2 and the smart terminal 4 communicate based on the Wifi protocol or the BlueTooth protocol; or, the display module 2 and the smart terminal 4 communicate based on the USB transmission protocol with the aid of a USB cable, and the display module 2 also obtains power from the smart terminal 4 with the aid of a USB cable. Of course, it is not limited to the aforementioned example, and the display module 2 and the smart terminal 4 can also establish a wired or wireless communication connection based on other communication protocols, such as an NFC communication protocol, a P2P (point-to-point) network, and the like. The display module 2 and the near-eye display device 10 together constitute the “display device” of the smart terminal 4 , and the GUI output by the smart terminal 4 is imaged on the near-eye display device 10 through the display module 2 .

In some optional embodiments, a touch sensor or a pressure or capacitance sensor may be provided on the touch portion of the display module 2 to detect whether the touch portion of the display module 2 is touched. In some optional embodiments, a micro camera is also provided on the touch portion of the display module 2 to collect image/video data from the environment. In some optional embodiments, a micro microphone is also provided on the touch portion of the display module 2 to collect ambient sound from the environment. In some optional embodiments, a micro camera is also provided on one side of the display area 21 of the display module 2 to collect eye images of the user wearing the glasses 1 to track the user's eyeballs.

Trigger condition: refers to the condition preset in advance for triggering the operation or execution of a logic function. In some optional implementations of the embodiments of the present application, certain motion states of the display module are preset as trigger conditions for certain logic functions. For example, the display module is preset to be stationary at a certain set position on the lens to which it is connected as a trigger output main interface function. Then, when the display module is subsequently monitored to be stationary at the set position, the display module will display the imaging main interface on the lens to which it is connected, and the user can observe the display area of the display module to thereby The main interface imaged on the lens can be observed. Optionally, there can be at least one icon (thumbnail) of an application (or file) in the main interface. The set position can be the center of the lens, or the four corners of the frame, etc., which are easier to remember and identify.

Preset imaging area: refers to an imaging area pre-set for the display module on the lens to which the display module is connected. In some optional embodiments, the preset imaging area may be a regular area on the lens to which the display module is connected, such as a rectangular area, a circular area, or an elliptical area. In some optional embodiments, the preset imaging area may also be an irregular area on the lens to which the display module is connected. In some optional embodiments, the preset imaging area may also be the entire lens area of the lens to which the display module is connected.

Exemplarily, as shown in FIG5 , FIG5 is a schematic diagram of a display module imaging main interface provided in an embodiment of the present application. Referring to FIG5 , after the user puts on the glasses 1, the user observes from the side of the temple 13 (please refer to FIG1 and FIG2 ) toward the lens 12 (i.e., the glasses side), and the user can observe the display area 21 of the display module 2, thereby observing the main interface imaged by the display module 2 on the lens 12. That is, in the example of FIG5 , when the display module 2 is stationary at the illustrated position on the lens 12 (the position is not limited to the position shown in FIG5 , and the user can set the display module 2 to be stationary at any position of the lens 12 to trigger the logic function of outputting the main interface), the logic function of outputting the main interface is triggered. In the example of FIG. 5 , the preset imaging area 121 is the entire lens area of the lens 12, and the preset imaging area 121 is divided into a plurality of sub-areas (e.g., 6 sub-areas shown in FIG. 5 ), and an icon (thumbnail) of an application or file mapped in the sub-area is imaged in each sub-area, for example, an icon of application F is imaged in sub-area 1211, and an icon of application E is imaged in sub-area 1212. In FIG. 5 , the icons of applications A-I are imaged in six sub-areas. In some other optional embodiments, at least one of the icons A-I may be a file icon (thumbnail) such as a video, picture, audio, or text. In some optional embodiments, when the display module 2 is first connected to the lens 12 and the display module 2 is turned on, the display module 2 images the main interface on the lens 12 by default.

It should be noted that in order to facilitate the description of the main interface in FIG. 5, multiple sub-areas are divided, and the grid lines (i.e., the dotted grids on the lens 12) indicating each sub-area are schematically shown in FIG. 5. The grid lines should not be understood as the main interface imaged by the display module 2 provided in the embodiment of the present application must have grid lines. Obviously, the grid lines are not necessary, that is, there may be no grid lines in the imaged main interface, that is, after the display module 2 is placed on the lens 12, the grid lines cannot be seen on the body of the lens 12, and the lens 12 still maintains the properties of the lens itself. Of course, if the lens itself adopts a holographic lens such as an optical waveguide, it can be combined with each other for simple prompts, etc. Of course, it is also possible to provide a setting option for the user to choose whether to image the grid lines when imaging the main interface. If the user sets the grid lines to be imaged when imaging the main interface, the display module will image the grid lines while imaging the main interface. If the user sets the grid lines not to be imaged when imaging the main interface, the display module will not image the grid lines when imaging the main interface. Of course, the grid lines may also correspond to a graphical interface on a smart terminal (such as a mobile phone app), so that the user can use the graphical interface of the terminal to divide or customize the grid lines of the preset imaging area 121. In addition, the line type of the grid lines is not limited to the dotted lines shown in FIG. 5, but may also be solid lines, center lines, etc.

An embodiment of the present application provides a method for controlling a display module, which is used to be connected to the lenses of glasses and to form an image on the connected lenses. The method for controlling the display module may be performed by at least one of the glasses 1, display module 2, near-eye display device 10 or smart terminal in Figures 1 to 5, which can realize the specific information of the GUI imaged by the display module 2 on the glasses 1 (or near-eye display device 10) to which it is connected. As shown in Figure 6, Figure 6 is a schematic diagram of the step flow of the method for controlling the display module provided in an embodiment of the present application. Please refer to Figure 6, the method for controlling the display module includes:

S11, monitoring the movement state of the display module on the lens currently connected;

The lens is the lens on the glasses to which the display module is currently connected, which may be as described in the above embodiment and will not be described again here.

In some optional embodiments, an inertial sensor or an acceleration sensor (or gyroscope) is built into the display module, and such a sensor can be used to collect the instantaneous velocity and acceleration of the display module, thereby determining the motion state of the display module based on the collected instantaneous velocity and acceleration in combination with parameters such as time.

S12, when the target motion state is detected, controlling the display module to form an image of a graphical interface of a target logic function on the lens; the target motion state is preset as a trigger condition for triggering the target logic function.

The target logical function may be at least one logical function determined from all (user-oriented and system-oriented) logical functions provided by the device or system.

Exemplarily, the target logic function may be a function of outputting a main interface, a function of outputting a chat interface of a social application, a function of outputting a search interface of a browser, and the like.

In the embodiment of the present application, the motion state of the display module on the lens can be roughly divided into the following two categories: 1. The display module is relatively still on the lens; 2. The display module is in relative motion on the lens. Among them, the display module in relative motion on the lens can be roughly divided into two categories: the display module can move on the lens (movement means moving from one point on the lens to another point) or rotate (around its own central axis - in the example shown in Figure 1, it is the axis that coincides with arrow a). The target motion state can be a motion state that can trigger the target logical function that is determined in advance from various possible motion states of the display module. In other embodiments, the motion can also include multi-segment motion, that is, a combination of multiple straight lines on the lens, or "pattern-like" motion, such as trajectory-like motion in the shape of broken line segments, L, Z letters, etc.

In some optional embodiments, when the motion state of the display module is determined to be the target motion state based on the collected instantaneous velocity and acceleration in combination with parameters such as time, a target logic function whose trigger condition is the target motion state will be triggered. After the target logic function is triggered, it will start to run or execute (if the triggered target logic function is an application that is already running in the background, the target logic function will be switched to the foreground to run). When the target logic function is executed or running, it will correspondingly control the display module to image the graphical interface of the target logic function on the lens.

For example, taking the implementation shown in FIGS. 1 to 3 as an example, the target motion state may be that the display module 2 moves linearly on the lens 12, the display module 2 is stationary at a set position on the lens 12 (the set position is a pre-selected fixed position), or the display module 2 moves along the diagonal line of the lens 12 (assuming that the lens has four corners, the line connecting any two non-adjacent corners is the diagonal line), etc. At the same time, the display module 2 moves linearly on the lens 12 is preset as a trigger condition for outputting the chat interface of the social application, the display module 2 is stationary at a set position on the lens 12 is preset as a trigger condition for outputting the main interface function, and the display module 2 moves along the diagonal line of the lens 12 on the lens 12 is preset as a trigger condition for outputting the search interface of the browser.

Exemplarily, when it is detected that the display module 2 makes a linear motion on the lens 12, the display module 2 is controlled to image a chat interface of a social application on the lens 12; when it is detected that the display module 2 is stationary at a set position on the lens 12, the set position may be a well-recognized position such as the center of the lens, or a position defined by the user according to his or her preferences, the display module 2 is controlled to image a main interface on the lens 12 at the set position (please refer to FIG. 5 and related implementation descriptions); when it is detected that the display module 2 moves diagonally on the lens 12, the display module 2 is controlled to image a search interface of a browser on the lens 12.

In the embodiment of the present application, the display module used for augmented reality display imaging on the lens of the glasses can make some movements on the lens to which it is connected, instead of fixing the display module on the lens, and the motion states of some movements that the display module can make are preset as triggering conditions for triggering some logical functions. When it is detected that the motion state of the display module on the lens to which it is connected meets the triggering conditions of a certain logical function, the display module is controlled to image a graphical interface of the triggered logical function on the lens to which it is connected. Compared with the solution of fixing the display module on the lens in the related art, the user can control the display module to make a movement on the lens to which it is connected that can trigger the logical function to be triggered, thereby triggering the logical function to be triggered to start running, and then controlling the display module to image a graphical interface of the triggered logical function on the lens to which it is connected, so that the user can quickly interact with the virtual information presented by the display module.

In some optional embodiments, the target motion state includes: the movement of the display module on the lens satisfies a first preset condition; the target logical function includes: a first logical function; the movement of the display module on the lens satisfies a first preset condition is preset as a trigger condition for triggering the first logical function; step S12, comprising:

When it is detected that the movement of the display module on the lens satisfies a first preset condition, the display module is controlled to image a first graphic interface of the first logical function on the lens.

In some optional implementations, the movement of the display module may be detected by detecting a process in which the instantaneous speed of the display module changes from 0 to a value other than 0 and then changes to 0 again (referred to as the first process, and the first process described hereinafter refers to the process in which the instantaneous speed of the display module changes from 0 to a value other than 0 and then changes to 0 again). If the detected sudden change process of the instantaneous speed satisfies the first preset condition, the display module is controlled to image the first graphical interface of the first logic function on the lens.

In some optional implementations, the first logical function may generally refer to at least one logical function determined from all (user-oriented and system-oriented) logical functions provided by a device or a system.

Exemplarily, the first logical function may be outputting a main interface, phone dialing, a smart assistant, a music player, a video player, a camera, a photo album, a social application, and the like.

In some optional implementations, the first preset condition may be any one or a combination of the following six conditions ① to ⑥:

Condition ①: The displacement distance ΔS of the movement is not less than a preset first threshold length S_1;

The displacements described in the embodiments of the present application all obey the definition in physics. That is, displacement refers to the movement of an object from an initial position to a final position within a period of time, and the directed line segment from the initial position to the final position is the displacement. The length of the directed line segment is the displacement distance, and the direction of the directed line segment is the displacement direction.

In some optional implementations, when it is detected that ΔS≥S_1 of the display module in the first process, the display module is controlled to image a first graphic interface of the first logical function on the lens.

Exemplarily, the first logic function is a telephone dialing function. As shown in FIG. 7 , FIG. 7 is a schematic diagram of an application scenario of a display module provided by an embodiment of the present application. Referring to FIG. 7 , when it is detected that the display module 2 has a first process on the lens 12 and ΔS ≥ S_1 of the display module 2 in the first process, the telephone dialing function is triggered, and the display module 2 is controlled to image a dialing interface of the telephone dialing function on the lens 12.

Condition ②: The displacement distance ΔS of the movement is not less than the preset first threshold length S_1, and the displacement direction of the movement Preset first direction

In some optional implementations, when it is detected that ΔS ≥ S_1 of the display module in the first process, and If the directions are the same, the display module is controlled to form a first graphic interface of the first logical function on the lens.

Exemplarily, the first logic function is an intelligent assistant function. Referring to FIG. 7 , after monitoring that the display module 2 has a first process on the lens 12 , and in the first process, ΔS of the display module 2 ≥ S_1 and the display module 2 If the directions are the same, the smart assistant function is triggered, and the display module 2 is controlled to image the (voice or text) command acquisition interface of the smart assistant function on the lens 12.

Condition ③: the displacement distance ΔS of the movement is not less than a preset first threshold length S_1, and the starting point (SP) of the movement is a preset first position (P1), and the first position (P1) is a fixed position selected on the lens;

In some optional embodiments, when it is monitored that ΔS≥S_1 of the display module in the first process, and at time point t when it is monitored that the instantaneous speed of the display module suddenly changes from 0 to not 0 in the first process, the display module is at position P1, that is, the starting point SP of the movement of the display module in the first process is the position P1 pre-selected on the lens, then the display module is controlled to image the first graphical interface of the first logical function on the lens.

For example, the first logic function is a music player function. Referring to FIG. 7 , when it is detected that the display module 2 has a first process on the lens 12 and the starting point SP of the movement of the display module 2 in the first process is a position P1 pre-selected on the lens 12 (for example, P1 is the center point on the lens 12), the music player function is triggered and the display module 2 is controlled to image the music player function on the lens 12. Song playing interface.

Condition ④: The displacement distance ΔS of the movement is not less than the preset first threshold length S1, and the displacement direction of the movement Preset first direction and the starting point (SP) of said movement is said first position;

In some optional implementations, when it is detected that ΔS ≥ S_1 of the display module in the first process, and In the same direction, and in the first process, when it is monitored that the instantaneous speed of the display module changes suddenly from 0 to a time point t that is not 0, the display module is at the position P1, that is, the starting point SP of the movement of the display module in the first process is the position P1 pre-selected on the lens, then the display module is controlled to image the first graphical interface of the first logic function on the lens.

For example, the first logic function is a video player function. Referring to FIG. 7 , after detecting that the display module 2 on the lens 12 has a first process, and the display module 2 in the first process In the same direction, and the starting point SP of the movement of the display module 2 in the first process is a position P1 pre-selected on the lens 12 (for example, P1 is the center point on the lens 12), the music player function is triggered, and the display module 2 is controlled to image the video playback interface of the video player function on the lens 12.

Condition ⑤: the end point (EP) of the movement is a preset second position (P2), and the second position (P2) is a fixed position selected on the lens;

In some optional implementations, when the instantaneous speed of the display module is monitored to suddenly change from 0 to non-0 and then suddenly change to 0 at time point t in the first process, the display module is at position P2, that is, the end point EP of the movement of the display module in the first process is the position P2 pre-selected on the lens, then the display module is controlled to image the first graphical interface of the first logic function on the lens. That is, no matter how the display module moves on the lens, as long as the display module moves to a certain position P2 pre-selected on the lens, the first logic function will be triggered.

Exemplarily, the first logic function is a camera function. As shown in FIG8 , FIG8 is a schematic diagram of an application scenario of a display module provided by an embodiment of the present application. Referring to FIG8 , when it is detected that the display module 2 has a first process on the lens 12 and the end point EP of the display module 2 in the first process is at the upper boundary of the lens 12 (or the preset imaging area), the camera function is triggered, and the display module 2 is controlled to image a camera function interface on the lens 12.

Exemplarily, the first logic function is an album function. As shown in FIG9 , FIG9 is a schematic diagram of an application scenario of a display module provided by an embodiment of the present application. Referring to FIG9 , when it is detected that the display module 2 has a first process on the lens 12 and the end point EP of the display module 2 in the first process is at the lower boundary of the lens 12 (or the preset imaging area), the album function is triggered, and the display module 2 is controlled to image the album function interface on the lens 12.

Exemplarily, the first logic function is a social application function. As shown in FIG10 , FIG10 is a schematic diagram of an application scenario of a display module provided in an embodiment of the present application. Referring to FIG10 , when it is detected that the display module 2 has a first process on the lens 12 and the end point EP of the display module 2 in the first process is at the left boundary of the lens 12 (or the preset imaging area), the social application function is triggered, and the display module 2 is controlled to image the functional interface of the social application on the lens 12.

Exemplarily, the first logic function is a navigation function. As shown in FIG11 , FIG11 is a schematic diagram of an application scenario of a display module provided by an embodiment of the present application. Referring to FIG11 , when it is detected that the display module 2 has a first process on the lens 12, and the end point EP of the display module 2 in the first process is at the right boundary of the lens 12 (or the preset imaging area), the navigation function is triggered, and the display module 2 is controlled to image the navigation function interface on the lens 12.

Exemplarily, the first logic function is the output main interface function. When it is detected that the display module 2 has a first process on the lens 12, and the end point EP of the display module 2 in the first process is the center point of the lens 12 (or the preset imaging area), the output main interface function is triggered, and the display module 2 is controlled to image the output main interface on the lens 12.

Condition ⑥: The shape similarity (Similarity, Sim) between the moving trajectory l and the preset trajectory l_1 is not less than a preset first threshold α.

In some optional implementations, if it is monitored in the first process that the shape similarity Sim between the moving trajectory l and the preset trajectory l_1 is not less than a preset first threshold α, the display module is controlled to image a first graphical interface of the first logical function on the lens.

For example, as shown in Figure 12, Figure 12 is a schematic diagram of an application scenario of a display module provided by an embodiment of the present application. Referring to Figure 12, when it is detected that the display module 2 has a first process on the lens 12, and the shape similarity Sim of the moving trajectory l and the preset trajectory l_1 detected in the first process is not less than a preset first threshold α, the first logic function is triggered, and the display module 2 is controlled to image the functional interface of the first logic function on the lens 12.

Among them, the shape similarity Sim between the trajectory l and the preset trajectory l_1 can be calculated by methods such as Euclidean distance, dynamic time warping, cosine similarity, Pearson correlation coefficient, Manhattan distance, dynamic kernel correlation, and mean absolute error.

In some optional implementations, different first preset conditions may correspond to the same first logical function, or may correspond to different first logical functions.

Exemplarily, still taking the scenes shown in FIG. 1 to FIG. 3 as an example, the movement of the display module 2 on the lens 12 that satisfies the above conditions ① to ⑥ can be preset as trigger conditions of different logical functions one by one (as described in the above examples). The movement of the display module 2 on the lens 12 that satisfies at least two of the above conditions ① to ⑥ can also be preset as trigger conditions of the same logical function. For example, the movement of the display module 2 on the lens 12 that satisfies the above condition ① can be preset as a trigger condition of the telephone dialing function, and the movement of the display module 2 on the lens 12 that satisfies the above condition ⑥ can be preset as a trigger condition of the camera function; the movement of the display module 2 on the lens 12 that satisfies the above condition ① can be preset as a trigger condition of the telephone dialing function, and the movement of the display module 2 on the lens 12 that satisfies the above condition ⑥ can be preset as a trigger condition of the telephone dialing function.

It should be noted that in the embodiment of the present application, the first preset condition is not limited to the six items listed above. Those skilled in the art can flexibly set the first preset condition according to actual needs. For example, the first preset condition can also be that the display module moves along a preset trajectory on the lens. Specifically, the first preset condition can be that the aforementioned display module moves along the diagonal of the lens.

In some optional embodiments, the target motion state includes: the display module is stationary at a third position on the lens, and the third position is a fixed position selected on the lens; the target logical function includes: a second logical function; the display module is stationary at the third position on the lens and is preset as a trigger condition for triggering the second logical function; step S12 includes:

In a case where it is detected that the display module is stationary at a third position on the lens, the display module is controlled to image a second graphic interface of the second logical function on the lens.

In some optional implementations, the second logical function may generally refer to at least one logical function determined from all (user-oriented and system-oriented) logical functions provided by the device or system. The second logical function may be different from or the same as the first logical function.

Exemplarily, the second logical function may be outputting a main interface, phone dialing, a smart assistant, a music player, a video player, a camera, a photo album, a social application, and the like.

The third position may be the same as or different from the second position.

Exemplarily, the third position is a center point on the lens, an upper boundary point of the lens (or a preset imaging area), a lower boundary point of the lens (or a preset imaging area), and the like.

Exemplarily, still taking Figures 1 to 12 of the aforementioned example as an example, when it is monitored that the display module 2 is stationary at the center point on the lens 12, the display module 2 is controlled to image the main interface on the lens 12; when it is monitored that the display module 2 is stationary at the upper boundary point on the lens 12, the display module 2 is controlled to image the functional interface of the navigation application on the lens 12.

In some optional implementations, the target motion state includes: the display module performs axis rotation; the target logical function includes: a third logical function, and the third logical function is a logical function currently running in the foreground; step S12 includes:

When the display module is detected to be rotating, the display module is controlled to display the third image currently formed on the lens. The target area in the graphical interface is updated; the third graphical interface is the graphical interface of the third logical function, and the target area is the graphical area corresponding to the sub-function in the third logical function; the axial rotation of the display module is preset as a trigger condition for triggering the sub-function in the third logical function.

In some optional implementations, the third logical function may generally refer to at least one logical function running in the foreground from among all (user-oriented and system-oriented) logical functions provided by the device or system.

Exemplarily, the third logical function may be outputting a main interface, phone dialing, a smart assistant, a music player, a video player, a camera, a photo album, a social application, and the like.

In some optional implementations, the sub-function in the third logic function may be a page turning function, a scrolling (forward/backward) operation, etc. in the logic function currently running in the foreground.

Exemplarily, as shown in FIG. 13 and FIG. 14, FIG. 13 and FIG. 14 are schematic diagrams of an application scenario of a display module provided by an embodiment of the present application. For example, if the third logic function is to output the main interface function, the display module 2 can be preset to rotate along the counterclockwise axis shown in FIG. 13 as a trigger condition for triggering the main interface to turn up (or down) pages, and the display module 2 can be preset to rotate along the clockwise axis shown in FIG. 14 as a trigger condition for triggering the main interface to turn down (or up) pages. When it is detected that the display module 2 rotates counterclockwise (or clockwise), the display module 2 is controlled to update the main interface currently imaged on the lens 12, that is, the display module 2 is controlled to image the previous page (or next page) of the main interface on the lens 12.

For another example, if the third logic function is a music player function, the counterclockwise rotation of the display module 2 as shown in FIG13 can be preset as a trigger condition for triggering a song switch to the previous song (or the next song), and the clockwise rotation of the display module 2 as shown in FIG14 can be preset as a trigger condition for triggering a song switch to the next song (or the previous song). When the counterclockwise (or clockwise) rotation of the display module 2 is detected, the song currently being played is switched, and the display module 2 is controlled to update the music player interface currently imaged on the lens 12, that is, the display module 2 is controlled to update the song information in the music player interface imaged on the lens 12 to the information of the previous song (or the next song).

In some optional implementations, when the display module is detected to be rotating, controlling the display module to update a target area in a third graphical interface currently imaged on the lens includes:

When it is detected that the rotation angle of the display module is not less than a preset first threshold angle β, the display module is controlled to update the target area in the third graphic interface currently imaged on the lens.

The first threshold angle β can be flexibly set by those skilled in the art or users according to actual needs, for example, it can be 15°, 20°, 25° or 30°.

For example, referring to FIG. 14 , when it is detected that the rotation angle of the display module 2 along the clockwise axis is not less than the first threshold angle β, the display module 2 is controlled to update the target area in the third graphic interface currently imaged on the lens 12. This can avoid the display module 2 being slightly driven to rotate the axis and triggering the sub-function of the third logic function, causing the display module 2 to start updating the third interface imaged on the lens 12. Therefore, the sub-function of the third logic function can be reduced to a certain extent.

In some other optional implementations, the third logic function may also be a logic function running in the background. For example, the imaging module in the display module is in standby mode, but the music playback function is always running in the background. At this time, the axis rotation of the display module can still be preset as a trigger condition for the song switching operation, so that the user can quickly switch songs, that is, it is convenient for the user to quickly interact with the device. However, at this time, it is not necessary to control the display module to update the graphical interface (because the logic function is running in the background and no graphical interface is output).

The present application provides a control method for a display module, wherein the display module is used to be connected to the lens of glasses and used to form an image on the connected lens. The control method for the display module may be performed by at least one of the glasses 1, the display module 2, the near-eye display device 10 or the smart terminal in FIG. 1 to FIG. 5, which can realize the control of the display module 2 on the glasses 1 (or the near-eye display device 10) to which it is connected. 10) Specific information of the GUI imaged on the display module. As shown in FIG15, FIG15 is a schematic diagram of the step flow of the control method of the display module provided in an embodiment of the present application. Referring to FIG15, the control method of the display module includes:

S11, monitoring the movement state of the display module on the lens currently connected;

Please refer to the description of S11 in the previous article, which will not be repeated here.

S13, detecting contact of a touch portion of the display module;

For step S13 , please refer to the above description of the display module 2 in the embodiments of FIGS. 1 to 3 , which will not be described in detail here.

It should be noted that there is no sequential relationship between S11 and S13, that is, S11 and S13 can be executed in parallel.

S14, when it is detected that the touch portion is touched for a duration ΔT that is not less than a preset first threshold duration T_1 and a target motion state is detected, controlling the display module to image a graphic interface of the target logical function on the lens.

Comparing step S14 with step S12, in step S14, the conditions for triggering the target logic function to control the display module to image the graphical interface of the target logic function on the lens are increased, not only the motion state of the display module is detected to be the target motion state, but also the duration ΔT of the touch portion of the display module being touched is detected to be not less than the preset first threshold duration T_1. That is, not only the display module is detected to have motion on the lens, but also the display module is detected to be touched to trigger the target logic function to control the display module to image the graphical interface of the target logic function on the lens. Thus, the possibility of false triggering can be avoided in some scenarios. For example, the user shown in FIG. 2 is wearing glasses 1 during exercise, and the display module 2 may shake with the user's movement, which may be consistent with the target motion state, but if the user is not detected to touch the touch portion of the display module or the touch is detected but the touch duration ΔT is less than the preset first threshold duration T_1, the target logic function will not be triggered, nor will the display module be controlled to image the graphical interface of the target logic function on the lens. Thus, false triggering can be effectively avoided.

An embodiment of the present application provides a control method for a display module, which is used to be connected to the lenses of glasses and to form an image on the connected lenses. The control method of the display module may be performed by at least one of the glasses 1, display module 2, near-eye display device 10 or smart terminal in Figures 1 to 5, which can realize the specific information of the GUI imaged by the display module 2 on the glasses 1 (or near-eye display device 10) to which it is connected. As shown in Figure 16, Figure 16 is a schematic diagram of the step flow of the control method of the display module provided in an embodiment of the present application. Please refer to Figure 16, the control method of the display module includes:

S11, monitoring the movement state of the display module on the lens currently connected;

S13, detecting contact of a touch portion of the display module;

S14, when it is detected that the touch portion is touched for a duration ΔT that is not less than a preset first threshold duration T_1 and a target motion state is detected, controlling the display module to image a graphic interface of the target logic function on the lens;

Please refer to the above description for steps S11-S14, which will not be repeated here.

S15, when it is detected that the touch portion is touched for a duration ΔT that is not less than a preset second threshold duration T_2 and it is monitored that the display module is always stationary on the lens, or when it is not detected that the touch portion is touched for a duration that is not less than a third threshold duration T_3, the anti-mistouch mode is started.

The anti-mistouch mode refers to a mode in which the display module is controlled to maintain imaging of a graphical interface of a logic function currently running in the foreground on the lens.

When it is detected that the duration ΔT of the touch portion being touched is not less than the preset second threshold duration T_2 and it is monitored that the display module is always stationary on the lens, the anti-mistouch mode is started. That is, in the embodiment of the present application, the user is provided with a functional option of actively starting the anti-mistouch mode. The user only needs to touch the touch portion of the display module for at least T_2 time and do not move the display module during this process to enter the anti-mistouch mode, so that the user can switch the graphical interface presented by the display module on the lens to the interface required by the user before wearing glasses for exercise (please refer to Figure 2). For example, before the user rides, the graphical interface presented by the display module on the lens Switch to the navigation interface and activate the anti-mistouch mode so that users can use the navigation function while riding.

In the case where the duration of the touch portion being touched is not less than the third threshold duration T_3, the anti-false touch mode is started. That is, in the embodiment of the present application, a function option of passively starting the anti-false touch mode is also provided. When the user does not interact with the display module for a long time (i.e., T_3 duration), that is, does not touch the display module, it can be assumed that the user does not need to interact with the device temporarily, and the anti-false touch mode can be passively started, and the motion state of the display module can be stopped from being monitored. After the anti-false touch mode is released, the motion state of the display module can be continued to be monitored to save the power of the device.

In some optional embodiments, the first threshold duration is less than the second threshold duration. Assuming that the first threshold duration is 1 second and the second threshold duration is 0.5 seconds, that is, the first threshold duration is greater than the second threshold duration, a situation will occur: the user has not figured out how to move the display module within the first 0.6 seconds of touching the display module, and the anti-mistouch mode has been activated at this time. Even if the user moves the display module in the last 0.4 seconds, and the movement of the display module is a target motion state, but because the device enters the anti-mistouch mode when touching the display module 0.5, it will not trigger the target logic function corresponding to the target motion state (that is, the trigger condition is the target logic function of the target motion state), and accordingly, the display module will not image the graphical interface of the target logic function on the lens. And it is difficult for the user to accurately perceive the touch duration, so this will cause inconvenience to the user. However, if the first threshold duration is less than the second threshold duration, the aforementioned possible "embarrassment" phenomenon can be avoided, thereby facilitating the user to interact with the display module.

In some optional implementations, when the anti-accidental touch mode is activated, a prompt is output to remind the user that the anti-accidental touch mode has been activated. The prompt may be a prompt such as text, image, or video animation imaged by the display module on the lens, so that the user knows that the device has activated the anti-accidental touch mode.

S16: when it is detected again in the false touch prevention mode that the touch portion is touched for a duration not less than a fourth threshold duration T_4, cancel the false touch prevention mode.

After the device enters the false touch prevention mode, if it is detected again that the touch portion of the display module is touched and the touch duration reaches the fourth threshold duration T_4, the false touch prevention mode is released, so that the user can interact with the display module again.

In some optional implementations, the fourth threshold duration is less than or equal to the first threshold duration.

If the first threshold duration is less than the fourth threshold duration, after entering the false touch prevention mode, the user must first touch the display module for the fourth threshold duration to release the false touch prevention mode before interacting with the display module, which causes inconvenience to the user. If the fourth threshold duration is less than or equal to the first threshold duration, the user can quickly release the false touch prevention mode so that the user can interact with the display module again.

In some optional implementations, when the anti-accidental touch mode is released, a prompt is output to prompt the user that the anti-accidental touch mode has been released. The prompt may be a prompt such as text, image, or video animation imaged by the display module on the lens, so that the user knows that the device has released the anti-accidental touch mode.

In some optional embodiments, when the anti-mistouch mode is released, when it is monitored that the display module is stationary on the lens and the touch portion is detected to be touched, the display module is controlled to image moving prompt content around the display module on the lens.

For example, as shown in Figure 17, Figure 17 is a schematic diagram of an application scenario of a display module provided by an embodiment of the present application. Referring to Figure 17, when it is detected that the display module 2 is stationary on the lens 12 and the touch portion of the display module 2 is touched, the display module 2 is controlled to form a motion prompting content shown in Figure 17 on the lens 12 around the display module 2 for prompting the user to move the display module 2 in multiple directions.

In some optional implementations, the control method of the display module provided in the embodiment of the present application further provides some other methods for the user to interact with the glasses (or near-eye display device) or device connected to the display module on the basis of the aforementioned implementations, mainly to enable the user to interact with the glasses (or near-eye display device) or device connected to the display module when the display module is not in motion but in a stationary state. Various ways to interact. Specifically include the following steps:

Acquire multimedia data and eye tracking data;

When it is detected that the display module is stationary on the lens and the touch portion is touched according to the target touch pattern, or when it is detected that the display module is stationary on the lens and a target instruction is identified from the multimedia data, or when it is detected that the display module is stationary on the lens and a target eye movement pattern is identified from the eye tracking data, the display module is controlled to image a graphical interface of the target logical function on the lens, or the display module is controlled to update the target area in a third graphical interface currently imaged on the lens; the third graphical interface is a graphical interface of a third logical function, the third logical function is a logical function currently running in the foreground, and the target area is a graphical area corresponding to a sub-function in the third logical function; the target touch pattern, the target instruction and the target eye movement pattern are preset as trigger conditions for triggering the target logical function or are preset as trigger conditions for a sub-function of the third logical function.

Among them, the multimedia data can be image/video data collected by the built-in micro camera on the display module or voice data collected by the micro microphone, and the eye tracking data is the user's eye image data collected by the built-in micro camera on the display module.

The target touch mode may be a single click, a double click, a triple click, etc. The target instruction may be a preset target gesture, a target voice, etc. The target eye movement mode may be an eye movement according to a preset rule. Similarly, the target touch mode, the target instruction and the target eye movement mode are similar to the aforementioned target motion state, and they may also be preset as trigger conditions for triggering the target logical function or as trigger conditions for sub-functions of the third logical function. When the display module is detected to be stationary on the lens and the touch portion is detected to be touched according to the target touch mode, or when the display module is detected to be stationary on the lens and the target instruction is identified from the multimedia data, or when the display module is detected to be stationary on the lens and the target eye movement mode is identified from the eye tracking data, the triggering (preset) triggering condition is the target touch mode, the target instruction and the target eye movement mode The target logical function (or the sub-function of the third logical function), thereby controlling the display module to image the triggered graphical interface of the target logical function on the lens (or controlling the display module to update the target area in the third graphical interface currently imaged on the lens). The principle is similar to the principle that the target motion state triggers the target logic function (or a sub-function of the third logic function) mentioned above, thereby controlling the display module to image the graphical interface of the triggered target logic function on the lens (or controlling the display module to update the target area in the third graphical interface currently imaged on the lens). It will not be repeated here, and those skilled in the art can understand it by referring to the above text.

In some optional implementations, a preset imaging area is pre-set on the lens to which the display module is connected, and the display module will only image in the preset imaging area, and will not image on the entire lens. Therefore, only when the target motion state is detected in the preset imaging area on the lens, the display module is controlled to image the graphical interface of the target logic function on the lens; and when the display module is detected to move outside the preset imaging area, the low power consumption mode is activated. This saves the power of the device and extends the battery life and service life of the device.

It should be noted that although the above examples are all described using monocular (i.e., the display module provided by the embodiment of the present application is connected to only one lens of the glasses) as an example, it is obvious that all the implementation methods provided in the present application can also be applied to binocular (i.e., the display modules provided by the embodiment of the present application are connected to both lenses of the glasses) scenarios.

The connection method of the projection device provided in the embodiment of the present application can be executed by the control device of the display module. In the embodiment of the present application, the control device of the display module executing the control method of the display module is taken as an example to illustrate the control device of the display module provided in the embodiment of the present application.

As shown in FIG18 , a schematic diagram of the structure of a control device of a display module provided in an embodiment of the present application is shown. Referring to FIG18 , the control device 50 of the display module is used to be connected to the lens of the glasses and to form an image on the connected lens. The control device 50 includes:

A first monitoring module 501 is used to monitor the motion state of the display module on the lens currently connected;

The first control module 502 is used to control the display module to image a graphical interface of a target logic function on the lens when a target motion state is detected; the target motion state is preset as a trigger condition for triggering the target logic function.

In some optional embodiments, the target motion state includes: the movement of the display module on the lens satisfies a first preset condition; the target logical function includes: a first logical function; the movement of the display module on the lens satisfies the first preset condition and is preset as a trigger condition for triggering the first logical function; the first control module 502 includes:

The first control submodule is configured to control the display module to image a first graphic interface of the first logical function on the lens when it is detected that the movement of the display module on the lens satisfies a first preset condition.

In some optional implementations, the first preset condition is one of the following:

The displacement distance of the movement is not less than a preset first threshold length;

The displacement distance of the movement is not less than a preset first threshold length, and the displacement direction of the movement is a preset first direction;

The displacement distance of the movement is not less than a preset first threshold length, and the starting point of the movement is a preset first position, which is a fixed position selected on the lens;

The displacement distance of the movement is not less than a preset first threshold length, the displacement direction of the movement is a preset first direction, and the starting point of the movement is the first position;

The end point of the movement is a preset second position, and the second position is a fixed position selected on the lens;

The shape similarity between the moving trajectory and the preset trajectory is not less than a preset first threshold.

In some optional embodiments, the target motion state includes: the display module is stationary at a third position on the lens, and the third position is a fixed position selected on the lens; the target logical function includes: a second logical function; the display module is stationary at the third position on the lens and is preset as a trigger condition for triggering the second logical function; the first control module 502 includes:

The second control submodule is used for controlling the display module to image a second graphic interface of the second logic function on the lens when it is detected that the display module is stationary at a third position on the lens.

In some optional implementations, the target motion state includes: the display module performs axis rotation; the target logical function includes: a third logical function, the third logical function is the logical function currently running in the foreground; the first control module 502 includes:

The third control submodule is used to control the display module to update the target area in the third graphic interface currently imaged on the lens when the axial rotation of the display module is detected; the third graphic interface is the graphic interface of the third logical function, and the target area is the graphic area corresponding to the sub-function in the third logical function; the axial rotation of the display module is preset as a trigger condition for triggering the sub-function in the third logical function.

In some optional implementations, the third control submodule includes:

The first control unit is used to control the display module to update the target area in the third graphic interface currently imaged on the lens when monitoring that the rotation angle of the display module is not less than a preset first threshold angle.

In some optional implementations, the control device 50 further includes:

A first detection module, used to detect contact of a touch portion of the display module;

The first control module 502 includes:

The fourth control submodule is used to control the display module to image the graphical interface of the target logical function on the lens when it is detected that the touch portion is touched for a duration not less than a preset first threshold duration and the target motion state is monitored.

In some optional implementations, the control device 50 further includes:

The first startup module is used to start the anti-mistaken touch mode when it is detected that the touch portion is touched for a duration not less than a preset second threshold duration and it is monitored that the display module is always stationary on the lens, or when it is not detected that the touch portion is touched for a duration not less than a third threshold duration; the anti-mistaken touch mode refers to a mode in which the display module is controlled to maintain imaging of a graphical interface of a logical function currently running in the foreground on the lens.

In some optional implementations, the first threshold duration is shorter than the second threshold duration.

In some optional implementations, the control device 50 further includes:

The first release module is configured to release the false touch prevention mode when it is detected again in the false touch prevention mode that the touch portion is touched for a duration not less than a fourth threshold duration.

In some optional implementations, the fourth threshold duration is less than or equal to the first threshold duration.

In some optional implementations, the control device 50 further includes:

A first prompt module, configured to output a prompt for prompting a user that the accidental touch prevention mode has been started while starting the accidental touch prevention mode;

The second prompt module is used to output a prompt for prompting the user that the accidental touch prevention mode has been canceled when the accidental touch prevention mode is canceled.

In some optional implementations, the control device 50 further includes:

The second control module is used for controlling the display module to image moving prompt content around the display module on the lens when it is detected that the display module is stationary on the lens and the touch portion is touched.

In some optional implementations, the control device 50 further includes:

A third control module is used to control the display module to image the graphic interface of the target logical function on the lens, or control the display module to update the target area in the third graphic interface currently imaged on the lens, when it is detected that the display module is stationary on the lens and the touch portion is touched according to the target touch mode; the third graphic interface is the graphic interface of the third logical function, the third logical function is the logical function currently running in the foreground, and the target area is the graphic area corresponding to the sub-function in the third logical function; the target touch mode is preset as a trigger condition for triggering the target logical function or is preset as a trigger condition for a sub-function of the third logical function.

In some optional implementations, the control device 50 further includes:

A first acquisition module, used to acquire multimedia data;

The third control module is used to control the display module to image the graphic interface of the target logic function on the lens, or control the display module to update the target area in the third graphic interface currently imaged on the lens when it is detected that the display module is stationary on the lens and a target instruction is identified from the multimedia data; the third graphic interface is a graphic interface of a third logic function, the third logic function is a logic function currently running in the foreground, and the target area is a graphic area corresponding to a sub-function in the third logic function; the target instruction is preset as a trigger condition for triggering the target logic function or is preset as a trigger condition for a sub-function of the third logic function.

In some optional implementations, the control device 50 further includes:

A second acquisition module is used to acquire eye tracking data;

A fourth control module is used to control the display module to image the graphical interface of the target logical function on the lens, or to control the display module to update the target area in the third graphical interface currently imaged on the lens, when it is monitored that the display module is stationary on the lens and a target eye movement pattern is identified from the eye tracking data; the third graphical interface is a graphical interface of a third logical function, the third logical function is a logical function currently running in the foreground, and the target area is a graphical area corresponding to a sub-function in the third logical function; the target eye movement pattern is preset as a trigger condition for triggering the target logical function or is preset as a trigger condition for a sub-function of the third logical function.

In some optional embodiments, the control device 50 includes:

A second monitoring module is used to control the display module to image a graphical interface of the target logic function on the lens when a target motion state is detected in a preset imaging area on the lens;

The second starting module is used to start the low power consumption mode when it is detected that the display module moves out of the preset imaging area.

The control device 50 of the display module in the embodiment of the present application can be an electronic device or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR)/virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc. It can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., and the embodiment of the present application does not make specific limitations.

The control device 50 of the display module in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

The control device 50 of the display module provided in the embodiment of the present application can implement each process implemented in the embodiments of Figures 1 to 17, and will not be described again here to avoid repetition.

In some optional embodiments, as shown in FIG. 19 , the embodiment of the present application further provides an electronic device 130, including a processor 131 and a memory 132, wherein the memory 132 stores programs or instructions that can be executed on the processor 131, and when the program or instructions are executed by the processor 131, the various steps of the control method embodiment of the above-mentioned display module are implemented, and the same technical effect can be achieved. To avoid repetition, they are not described here.

It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

FIG. 20 is a schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application.

The electronic device 140 includes, but is not limited to, components such as a radio frequency unit 141, a network module 142, an audio output unit 143, an input unit 144, a sensor 145, a display unit 146, a user input unit 147, an interface unit 148, a memory 149, and a processor 1410. Those skilled in the art will appreciate that the electronic device 140 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1410 through a power management system, so that the power management system can realize functions such as managing charging, discharging, and power consumption management. The electronic device structure shown in FIG. 14 does not constitute a limitation on the electronic device, and the electronic device may include more or fewer components than shown, or combine certain components, or arrange components differently, which will not be described in detail here.

The processor 1410 is configured to:

Monitoring the motion state of the display module on the lens currently connected;

When the target motion state is detected, the display module is controlled to form a graphic interface of the target logic function on the lens; the target motion state is preset as a trigger condition for triggering the target logic function.

It should be understood that in the embodiment of the present application, the input unit 144 may include a graphics processor (GPU) 1441 and a microphone 1442, and the graphics processor 1441 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 146 may include a display panel 1461, and the display panel 1461 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 147 includes a touch panel 1471 and at least one of the other input devices 1472. The touch panel 1471 is also called a touch screen. The touch panel 1471 may include a touch detection device and a touch controller Other input devices 1472 may include, but are not limited to, a physical keyboard, function keys (such as a volume control key, a switch key, etc.), a trackball, a mouse, and a joystick, which will not be described in detail here.

The memory 149 can be used to store software programs and various data. The memory 149 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 149 may include a volatile memory or a non-volatile memory, or the memory 149 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 149 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

The processor 1410 may include one or more processing units; optionally, the processor 1410 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1410.

The control method of the display module provided in the embodiment of the present application can be executed by an AR glasses. In the embodiment of the present application, the control method of the display module executed by a near-eye display device is taken as an example to illustrate the electronic system provided in the embodiment of the present application.

In some optional embodiments, as shown in FIG. 21 , the embodiment of the present application further provides an AR glasses 150, including a processor 151 and a memory 152, wherein the memory 152 stores programs or instructions that can be run on the processor 151, and when the program or instructions are executed by the processor 131, the various steps of the control method embodiment of the above-mentioned display module are implemented, and the same technical effect can be achieved. To avoid repetition, they are not repeated here.

In the related art, the size of the lens of some glasses (such as goggles) may be much larger than the field of view of the human eye, so that the user wearing the glasses cannot see or see clearly some areas on the lens, that is, there may be some areas (i.e., blind spots) on the lens of the glasses that are outside the field of view of the user wearing the glasses; if the display module connected to the lens of the glasses is imaged in the blind spot on the lens, the user wearing the glasses will not be able to see or see clearly. The purpose of the embodiments of the present application is to provide a control method, device, electronic device, near-eye display device, medium, chip and computer program product of a display module, so as to independently or semi-independently solve the technical problem that if the display module connected to the lens of the glasses is imaged in the blind spot on the lens, the user wearing the glasses will not be able to see or see clearly. The independent solution refers to providing a hardware construction scheme that can work independently without the cooperation of software, so as to achieve the effect that the display module connected to the lens of the glasses in the near-eye display technology will not be imaged in the blind spot on the lens. The semi-independent solution refers to providing a hardware construction scheme, which, when working in conjunction with near-eye display software, such as software in AR technology that allows users to interact with virtual information, can achieve the effect that the display module connected to the lens of the glasses in the near-eye display technology will not form an image in the blind spot on the lens.

As shown in FIG. 23 , FIG. 23 is a schematic diagram of an application scenario of a display module provided by an embodiment of the present application, and a front view of a pair of goggles is schematically shown in the exemplary scenario. In order to enable the goggles to protect the wearer's eyes as much as possible, manufacturers usually make the lenses larger so that they can more comprehensively cover the eye area for protection without affecting the wearer's vision. Please refer to FIG. 7 , after the user wears the exemplary goggles 5, the edge area of the lens 52 closer to the frame 51 is less likely to be The user can see clearly or even cannot see clearly, that is, some edge areas on the lens 52 are blind areas of the user's field of vision.

For example, it is assumed that after user A wears the goggles 5, the area of the lens 52 that can be clearly seen is shown as the area 521 surrounded by the dotted line in the figure (this area is called the visible area of user A) (obviously, in practice, there is usually no dotted line ring on the goggles, and the dotted line ring is used to schematically illustrate the virtual boundary of the boundary between the blind area and the visible area), and the other areas on the lens 52 except the area 521 are the blind areas of user A; then the display module 2 is only located in the area 521 and the image is formed in the area 521 , user A can clearly see the display module 2 (the display area 21 thereof), and the user can also clearly see the image formed by the display module 2 in the area 521 through the display area 21 of the display module 2; if the display module 2 is in the blind spot on the lens 52 (for example, the position shown in FIG. 7 ), user A cannot even see the display module 2 clearly, and of course cannot clearly see the display area 21 of the display module 2, and naturally cannot see the image formed by the display module 2 on the lens 52 by viewing the display area 21 of the display module 2.

Therefore, in the related art, some glasses (such as the goggles shown in FIG. 23 ) may have lenses that are much larger than the field of view of the human eye for reasons of protection or styling, so that the user wearing the glasses cannot see or see clearly some areas on the lenses, that is, there may be some areas (i.e., blind spots) on the lenses of the glasses that are outside the field of view of the user wearing the glasses; if the display module connected to the lenses of the glasses forms an image within the blind spots on the lenses, the user wearing the glasses will not be able to see or see clearly.

The embodiments of the present application provide a control method, device, electronic device, near-eye display device, medium, chip and computer program product for a display module, which can independently or semi-independently solve to a certain extent the technical problem that if the display module connected to the lens of the glasses is imaged in the blind spot on the lens, it will cause the user wearing the glasses to be unable to see or see clearly.

On this basis, the embodiments of the present application are described in detail below.

The embodiment of the present application provides a control method of a display module, the display module is configured to be placed on an optical lens, and the display module is configured to output image content. Exemplarily, as shown in Figures 1 to 5 and Figure 22, the display module can be the display module 2 shown in Figures 1 to 5 and Figure 22, and the display module 2 can output image content on the lens 12 or the lens 52. The control method of the display module can be performed by at least one of the glasses 1 in Figures 1 to 5, the display module 2 in Figures 1 to 5, the near-eye display device 10 in Figure 4, or the smart terminal 4, which can realize the specific information of the GUI imaged by the control display module 2 on the glasses 1 (or near-eye display device 10 or goggles 5) to which it is connected. As shown in Figure 24, Figure 24 is a schematic diagram of the step flow of the control method of the display module provided in the embodiment of the present application. In order to facilitate the understanding of the control method of the display module provided in the embodiment of the present application, the step flow shown in Figure 24 will be described below by taking the goggles 5 illustrated in Figure 23 as an example. Referring to FIG. 24 , the control method of the display module includes:

S101, detecting the relative position of the display module on the currently connected lens and the contact of the touch portion of the display module.

The lens is the lens on the glasses to which the display module is currently connected. For example, it can be described in the above embodiment, which will not be repeated here.

In the embodiment of the present application, the display module for augmented reality display imaging on the lens of the glasses can make some movements on the lens to which it is connected, instead of fixing the display module on the lens. In some optional embodiments, an inertial sensor or an acceleration sensor (or a gyroscope) is built into the display module, and the instantaneous speed and acceleration of the display module can be collected by such a sensor, so as to determine the motion trajectory of the display module according to the collected instantaneous speed and acceleration and in combination with parameters such as time.

Optionally, a fixed reference point is selected as the origin in advance on the lens connected to the display module, and the display module moves from the origin and the motion trajectory of the display module is always monitored. The position of any point on the motion trajectory relative to the origin can be expressed as the relative position of the display module relative to the connected lens.

For example, as shown in FIG. 25, FIG. 25 is a schematic diagram of an application scenario of a display module provided by an embodiment of the present application. For example, point P0 on the lens 52 is a pre-selected origin, and the display module 2 moves from the origin along path l1 to point P1, then moves along path l2 to point P2, then moves along l3 to point P3, and finally moves along l4 to point P4. The motion trajectory l of the display module 2 at any time t in the motion process can be determined by monitoring the motion parameters (such as speed, acceleration, etc.) of the display module 2. The positional relationship of the end point of the motion trajectory at time t relative to the origin P0 can represent the relative position of the display module 2 on the lens 52. For example, at time t1, the display module 2 moves to point P1. According to the determined path l1, the positional relationship of point P1 relative to the origin P0, that is, the relative position of the display module 2 on the lens 52, can be determined, which is exemplarily represented as Indicates that point P1 is located at the vector At the end point, the vector The starting point is P0.

Similarly, when the motion trajectory of the display module 2 from point P1 to point P2 is l2, it is obvious that the position relationship of P2 relative to P1 can be expressed as Indicates that point P2 is located at the vector At the end point, the vector The starting point is P1. Based on the mathematical vector relationship, Therefore, there is Accordingly, Obviously, the above vector actually shows the displacement of module 2 during this process.

It should be noted that in the above examples, a straight line trajectory (path) is used as an example to describe the path and movement trajectory of the display module 2. Obviously, the display module 2 can be moved arbitrarily and is not limited to the form of the straight line trajectory in the above examples, such as a curved trajectory.

Regarding the detection of contact of the touch portion of the display module, please refer to the relevant description in the previous text, which will not be repeated here.

S102, in the imaging area setting mode, when it is detected that the display module is stationary at a first relative position on the lens and the touch portion is touched according to a first touch pattern, the first relative position is marked as a first fitting point. The first relative position is an arbitrary position of the display module on the lens. In the imaging area setting mode, the first touch pattern is a touch pattern used to indicate that the user confirms that the display area of the display module can be clearly seen.

The imaging area setting mode is a logical function provided for the user to set a preset imaging area on the lens connected to the display module. In some optional embodiments, the imaging area setting mode is automatically entered when the display module is connected to the lens for the first time and turned on. In some optional embodiments, an APP for controlling the display module is provided on the smart terminal connected to the display module, and the user can start the imaging area setting mode through the imaging area setting function option in the APP. After entering this mode, the display module will enter the preset imaging area setting process.

Exemplarily, the near-eye display device 10 shown in FIG. 23 is the goggles 5 shown in FIG. 25 , which automatically enters the imaging area setting mode when the display module 2 is first connected to the lens 52 and turned on. The user can also start the imaging area setting mode of the display module 2 through the imaging area setting function option in the APP that controls the display module on the smart terminal 4.

When the instantaneous speed of the display module is monitored to be 0, it can be confirmed that the display module is stationary on the lens.

For example, in the example in FIG25 , it is initially detected that the display module 2 is stationary at point P0, and then it is again detected that the display module 2 is stationary at point P1. Then, it is sequentially detected that the display module is stationary at points P2, P3, and P4. That is, P1, P2, P3, and P4 are all first relative positions.

The first touch mode may be a preset touch mode, such as a single click, double click, or triple click on the touch portion of the display module. When it is detected that the display module is stationary at a certain position on the lens and the touch portion is touched according to the first touch mode, the position where the display module is located is marked as a first fitting point. The fitting point is used to fit the boundary point of the preset imaging area.

Exemplarily, in the example in Figure 25, when it is detected that the display module 2 moves from point P0 to points P1, P2, P3 and P4, and remains stationary at points P1, P2, P3 and P4, it is also detected that the touch portion is touched according to the first touch mode (for example, a single click), therefore, points P1, P2, P3 and P4 are all marked as first fitting points.

S103: When at least three first fitting points are marked, fit the at least three first fitting points into a closed area.

S104, setting the closed area as a preset imaging area of the display module on the lens.

Based on mathematical common sense, it is known that at least three points are needed in space to enclose a closed area. Therefore, after marking at least three first fitting points, all the marked first fitting points can be fitted into a closed area. The closed area is set as a preset imaging area for the display module to form an image on the lens currently connected.

Fitting means enclosing a plurality of points into a closed area, and the line between any two points does not intersect the line between any other two points. In some optional embodiments, at least three first fitting points can be fitted into a closed area of a preset shape. For example, the preset shape can be an ellipse (a circle is a special ellipse), a rectangle, a triangle, etc. In some optional embodiments, when performing region fitting, any two first fitting points with the shortest straight-line distance can be connected by a curve or a straight line. When connecting by a curve, a smooth curve is preferably used.

For example, as shown in FIG26 and FIG27, FIG26 and FIG27 are schematic diagrams of an application scenario of a display module provided by an embodiment of the present application. Referring to FIG26, the four first fitting points Fitting into an elliptical area, the elliptical area is set as the preset imaging area 522 of the display module 2 on the lens 52. Referring to FIG. 27, the four first fitting points P1, P2, P3 and P4 are fitted into a quadrilateral area, the quadrilateral area is set as the preset imaging area 522 of the display module 2 on the lens 52.

In some optional implementations, in order to facilitate the user to set the preset imaging area, the above steps S101-S104 can be assisted by a smart terminal (see FIG. 4 ) that is communicatively connected to the display module, which is exemplarily described below.

As shown in Figures 28 to 29, Figures 28 to 29 are schematic diagrams of an application scenario of a display module provided by an embodiment of the present application. Referring to Figures 28 to 29, the display module 2 maintains a communication connection with the smart terminal 6, and the smart terminal 6 pre-acquires the virtual contour model of the goggles 5. The virtual contour model can be obtained by scanning the goggles 5 with a 3D scanner, or it can be obtained from the manufacturer of the goggles 5. After the display module 2 is connected (placed) on the lens 52, when the display module 2 starts the imaging area setting mode, the virtual contour model of the goggles 5 is output on the screen of the smart terminal 6 accordingly, and the relative position of the display module 2 on the goggles 5 is traced on the virtual contour model of the goggles 5. The display module 2 can be moved to different positions on the connected lens 52 for positioning, and each positioning point (i.e., fitting point) is subject to the user wearing the glasses 5 confirming that it can be seen clearly. That is, the user places the display module 2 at different positions on the lens 52 to perform “aiming point” positioning, displays these positioning points on the smart terminal 6, and then fits all the positioning points into a preset imaging area.

Please refer to FIG28. When the display module 2 just enters the imaging area setting mode, the initial position P0 of the display module 2 is shown on the virtual contour model of the goggles 5 on the screen of the smart terminal 6. When the display module 2 moves from P0 to P1, the position P1 is shown on the virtual contour model of the goggles 5 on the screen of the smart terminal 6. If the user confirms that the display module 2 can be seen clearly at the point P1, the position of P1 relative to the origin P0 is recorded. Please refer to FIG29. After completing the "aim point" positioning, all the positioning points found are shown on the virtual contour model of the goggles 5 on the screen of the smart terminal 6, such as P1, P2, P3 and P4 in the example of FIG29. Please refer to FIG30. The fitted elliptical closed area is shown on the virtual contour model of the goggles 5 on the screen of the smart terminal 6, and the closed area is set as the preset imaging area 522 for the display module 2 to be imaged on the lens 52.

In some optional embodiments, when selecting the first relative position, the extreme position points on the lens close to the frame are preferentially selected, such as the position points on the lens close to the edge area of the frame. If the user confirms that the display module cannot be seen clearly at these position points, the user is prompted to gradually move the display module closer to the center position point of the lens, so that the final fitted preset imaging area is as large as possible to increase the area of the preset imaging area. Obviously, the more data of the calibrated first fitting points, the closer the fitted preset imaging area can be to the user's visual area. Therefore, the number of first fitting points for fitting the preset imaging area can be flexibly set.

In the embodiment of the present application, in the imaging area setting mode, by detecting the relative position of the display module on the lens currently connected and the contact of the touch portion of the display module, at least three first fitting points that are confirmed by the user and can be clearly seen are found on the lens currently connected to the display module, and then the at least three fitting points found are fitted into a closed area. Since the boundary points on the closed area (obviously these boundary points include the first fitting points) can be clearly seen by the user, the user can naturally also see the closed area, and the closed area is set as the display module. Afterwards, the display module will form an image in the preset imaging area on the lens, and will not form an image in the blind area on the lens, thereby effectively solving the technical problem that the display module connected to the lens of the glasses forms an image in the blind area on the lens, which will cause the user wearing the glasses to be unable to see or clearly see the virtual information in the blind area.

The embodiment of the present application provides a control method of a display module, the display module is configured to be placed on an optical lens, and the display module is configured to output image content. Exemplarily, as shown in Figures 1 to 5 and Figures 22-23, the display module may be the display module 2 shown in Figures 1 to 5, and the display module 2 may output image content on the lens 12 or the lens 52. The control method of the display module may be performed by at least one of the glasses 1 in Figures 1 to 5, the display module 2 in Figures 1 to 5, the near-eye display device 10 in Figure 4, or the smart terminal 4, which can realize the specific information of the GUI imaged by the control display module 2 on the glasses 1 (or near-eye display device 10 or goggles 5) to which it is connected. As shown in Figure 25, Figure 25 is a schematic diagram of the step flow of the control method of the display module provided in the embodiment of the present application. In order to facilitate the understanding of the control method of the display module provided in the embodiment of the present application, the step flow shown in Figure 25 will be described below by taking the goggles 5 illustrated in Figure 23 and the scene shown in Figure 32 as an example. Referring to FIG. 25 , the control method of the display module includes:

S21, acquiring a first virtual contour model of the lens and a second virtual contour model of the user's eye;

S22, scanning a contour area that is the same as or similar to the second virtual contour model on the first virtual contour model, and setting the contour area as a preset imaging area of the display module on the lens.

Please refer to Figure 32. Please refer to the previous text for the relevant instructions on how the smart terminal 6 obtains the first virtual contour model 5' of the lens, which will not be repeated here. Similarly, a second virtual contour model of the eye of user A wearing goggles 5 can also be obtained by a 3D scanner, and the smart terminal 6 obtains the second virtual contour model from the 3D scanner. The smart terminal 6 presents the second virtual contour model overlapping with the first virtual contour model 5', and scans a contour area 522' that is the same or similar to the second virtual contour model on the first virtual contour model 5', and sets the contour area 522' as the preset imaging area 522 of the display module 2 on the lens 52.

Compared with the aforementioned method of setting the preset imaging area, this method of setting the preset imaging area is faster in setting process, but the difficulty lies in that for each pair of glasses, each user wearing the glasses needs to obtain the virtual contour of the glasses lens and the virtual contour of the user's eye at the same time. Therefore, in practice, the user can flexibly select the setting method of the preset imaging area according to the actual situation.

After the preset imaging area is set, the display module can form an image in the preset imaging area on the connected lens when it is located in the preset imaging area on the connected lens. However, the display module will not form an image on the connected lens when it is located outside the preset imaging area on the connected lens. Therefore, in some optional implementations, when it is detected that the display module is outside the preset imaging area, the low power consumption mode is started.

Exemplarily, in FIG27, after completing the setting of the preset imaging area, when the display module 2 moves outside the area 522 on the lens 52, the display module 2 starts the low power consumption mode. Thereby saving the electric energy of the device and extending the battery life and service life of the device. In the low power consumption mode, the display module 2 may be in a completely non-operating state or a standby state or a state where some modules are working, and when the display module 2 moves back into the area 522, the display module 2 turns off the low power consumption mode and resumes working. In some optional embodiments, the user can also set the specific state corresponding to the low power consumption mode of different time periods in the non-preset imaging area (i.e., in the example in FIG27, the area outside the area 522 on the lens 52), for example, setting the low power consumption mode from 11 pm to 7 am the next day to a completely non-operating state, setting the low power consumption mode from 7 am to 9 am, from 12 pm to 2 pm, and from 5 pm to 8 pm to a standby state, and setting the remaining time periods to a state where some modules are working (e.g., the hardware for monitoring the motion state of the display module is working).

In some optional implementations, based on the foregoing implementations, the control method of the display module provided in the embodiment of the present application further includes:

In case of receiving a partitioning instruction, dividing the preset imaging area into at least two sub-imaging areas;

When a mapping instruction for imaging a first graphic interface in a first sub-imaging area is received, the display module is controlled to image the first graphic interface in the first sub-imaging area; the first sub-imaging area is any one of the at least two sub-imaging areas.

The user can divide the preset imaging area into multiple sub-imaging areas and present different images in different sub-imaging areas, and the image presented in each sub-area can also be set by the user. When the display module receives the partition instruction input by the user, the display module responds to the number of areas in the partition instruction and divides the preset imaging area into sub-imaging areas of the number of areas (for example, as shown in FIG. 33, the preset imaging area 522 is divided into 6 sub-imaging areas). When the display module receives a mapping instruction for a sub-imaging area, the display module images a graphical interface corresponding to the data mapped in the mapping instruction in the sub-imaging area according to the data mapped in the mapping instruction.

Exemplarily, as shown in FIG33, FIG33 is a schematic diagram of an application scenario of a display module provided by an embodiment of the present application. Referring to FIG33, the user sets a preset imaging area 522 for the display module 2 on the lens 52, and the preset imaging area 522 is divided into 6 sub-imaging areas, and a graphical interface of the data mapped in each sub-imaging area is imaged in each sub-imaging area. The icons A-I shown in FIG33 can be icons (thumbnails) of applications or files, or other content, such as a video being played, etc.

In an embodiment of the present application, in order to fully enable such traditional glasses to have an augmented reality display function and to achieve efficient interaction thereon, the user can customize the layout of specific preset imaging areas as needed. For example, the lenses of the glasses are generally round or square or other shapes, and have a lens area that is larger than the field of view of the human eye. At this time, the user can take a position with a better field of view as the preset imaging area. The preset imaging area can be divided into multiple sub-imaging areas, each of which can be configured to output a corresponding graphical interface, and multiple sub-areas can realize multi-channel output of multiple graphical interfaces.

Obviously, for a specific pair of glasses, the blind area and visible area will be different for each user due to the different users who wear them. And for a specific user, the blind area and visible area will be different for each pair of glasses due to the different glasses they wear. That is to say, the setting method of the preset imaging area provided in the aforementioned embodiment needs to vary from person to person and from glasses to glasses. In other words, the preset imaging area A set when user A wears glasses A may not be suitable for user B wearing glasses A. User B may not be able to see some areas within the preset imaging area A when wearing glasses A. User B may need to reset the preset imaging area B when wearing glasses A. Therefore, in some optional embodiments, for the lens currently connected to the display module, the identity information of the user who sets the preset imaging area can be associated with the preset imaging area set by the user, so that when different users wear glasses subsequently, the display module performs imaging based on the preset imaging area associated with the user. Therefore, in some optional embodiments, on the basis of the aforementioned embodiments, the control method of the display module provided in the embodiment of the present application also includes:

Obtaining identity information of the user;

A mapping rule is established between the identity information and the preset imaging area and saved.

The user here is the user who sets the preset imaging area on the lens currently connected to the display module, and may be the user who touches the touch portion of the display module according to the first touch mode in the aforementioned step S102, or the user corresponding to the second virtual contour model in the aforementioned step S21.

The user's identity information can be the user's account/password, voiceprint, fingerprint, iris, etc.

When a user completes the setting of a preset imaging area while wearing a pair of glasses, a mapping rule can be established between the user's identity information and the preset imaging area set by the user, and the mapping rule can be saved. The next time the user uses the glasses, the preset imaging area set by the user on the glasses can be directly obtained according to the mapping rule.

For example, for the display module 2, the preset imaging area A1 set by user A on the goggles 5 is mapped with the user A's identity information ID-A and the preset imaging area A1, and the preset imaging area A2 set by the user on the glasses 1 is mapped with the user A's identity information ID-A and the preset imaging area A2. For the display module 2, the preset imaging area B1 set by user B on the goggles 5 is mapped with the user B's identity information ID-B and the preset imaging area B1. These mapping rules are saved.

As shown in FIG34 , FIG34 is a schematic diagram of the step flow of the control method of the display module provided in the embodiment of the present application. Referring to FIG34 , the embodiment of the present application provides a control method of the display module, which, based on the above-mentioned embodiment, further includes:

S105, when the imaging area setting mode is started again after the imaging area setting mode is exited, when it is detected that the display module is stationary at a second relative position on the lens and the touch portion is touched according to the first touch mode, marking the second relative position as a second fitting point; the second relative position is an arbitrary position on the lens different from the first relative position;

S106, when at least one second fitting point is marked, fitting the at least three first fitting points and the at least one second fitting point into a first new closed area, and updating the first new closed area to be a preset imaging area of the display module on the lens; or

S107, when at least three second fitting points are marked, fitting the at least three second fitting points into a second new closed area, and updating the second new closed area to be a preset imaging area of the display module on the lens.

After setting the preset imaging area, the user may feel that the preset imaging area is not ideal and want to partially update or completely reset the preset imaging area. Therefore, after setting the preset imaging area, the user can re-enter the imaging area setting mode to update or reset the preset imaging area. That is, when the user re-enters the imaging area setting mode, the lens can be "aimed" again, and some positioning points different from the first fitting points (i.e., second fitting points) can be found, and the second fitting points can be added to the first fitting points to re-fit the preset imaging area (i.e., step S106) to update the preset imaging area, or at least three second fitting points can be found and a new preset imaging area can be re-fitted based on the at least three second fitting points (i.e., step S107) to reset the preset imaging area.

As shown in FIG35 , FIG35 is a schematic diagram of the step flow of the control method of the display module provided in the embodiment of the present application. Referring to FIG35 , the embodiment of the present application provides a control method of the display module, which, based on the above-mentioned embodiment, further includes:

S31, identifying a first identity of a first user wearing a first pair of glasses, where the first pair of glasses includes the lenses;

S32, searching a preset mapping set for a mapping rule that matches the first identity;

S33, when there is only one mapping rule searched from the mapping set, setting the preset imaging area in the searched mapping rule as the imaging area of the display module on the lens; each mapping rule in the mapping set is a pre-set mapping relationship between a user identity and a preset imaging area, and each mapping rule in the mapping set is different.

The first user may be any user.

In some optional embodiments, the user's login account/password and fingerprint information can be obtained through a smart terminal that is communicatively connected to the display module to identify the first identity of the first user wearing the first glasses, or the first user's iris information can be collected through a camera on the display module to identify the identity information of the first user.

The display module can be connected to any glasses, so the mapping set is associated with each pair of glasses. For example, mapping set A can be configured for glasses A, and at least one mapping rule of the preset imaging area set when each user wears glasses A is recorded in mapping set A. Mapping set B can be configured for glasses B, and at least one mapping rule of the preset imaging area set when each user wears glasses B is recorded in mapping set B.

After the first identity of the first user is identified, a mapping rule matching the first identity may be searched from the mapping set of the first glasses. When only one mapping rule is found from the mapping set of the first glasses, the preset imaging area in the searched mapping rule is set as the imaging area of the display module on the lens.

As shown in FIG36, FIG36 is a schematic diagram of the step flow of the control method of the display module provided in the embodiment of the present application. Referring to FIG36, the control method of the display module provided in the embodiment of the present application is based on the embodiment shown in FIG35, and further includes:

S34, in the case where at least two mapping rules are searched from the mapping set, detecting a selection instruction for each of the preset imaging areas in the at least two mapping rules, and setting the preset imaging area selected by the selection instruction as the imaging area for the display module to image on the lens, or setting the first preset imaging area in the at least two mapping rules as the imaging area for the display module to image on the lens. Imaging area, the first preset imaging area is the preset imaging area selected last time in the historical selection record of the first user selecting the preset imaging area.

If at least two mapping rules are searched from the mapping set of the first glasses, it means that the first user has set multiple preset imaging areas on the first glasses, and these preset imaging areas can be displayed on the smart terminal connected to the display module for selection by the first user, and the preset imaging area selected by the selection instruction input by the user is set as the imaging area formed by the display module on the glasses. Alternatively, the preset imaging area selected last in the historical selection record of the first user selecting the preset imaging area can be set as the imaging area formed by the display module on the glasses.

As shown in FIG37, FIG37 is a schematic diagram of the step flow of the control method of the display module provided in the embodiment of the present application. Referring to FIG37, the control method of the display module provided in the embodiment of the present application is based on the embodiment shown in FIG36, and further includes:

S35, when no mapping rule is found from the mapping set, starting the imaging area setting mode;

S36, in the case where it is detected in the imaging area setting mode that the display module is stationary at a third relative position on the lens and the touch portion is touched according to the first touch mode, marking the third relative position as a third fitting point; the third relative position is an arbitrary position of the display module on the lens;

S37, when at least three third fitting points are marked, fitting the at least three third fitting points into a third closed area;

S38, setting the third closed area as a third preset imaging area of the display module on the lens.

In the case where no mapping rule is searched from the mapping set, it means that the first user has not set the preset imaging area on the first glasses, so the imaging area setting mode is started so that the first user can set the preset imaging area for the display module on the first glasses. The specific process of the first user finding the third fitting point on the first lens and fitting the found third fitting point into the third preset imaging area can refer to the description of setting the preset imaging area in the previous text, which will not be repeated here.

In some optional embodiments, based on the embodiment shown in FIG. 20 above, the control method of the display module further includes: establishing a third mapping rule between the first identity and the third preset imaging area, and incorporating the third mapping rule into the mapping set.

A third mapping rule is established between the first identity of the first user and the third preset imaging area, and is included in the mapping set of the first glasses, so that the first user can quickly determine the preset imaging area corresponding to the first glasses when using the first glasses next time.

As shown in FIG38 , FIG38 is a schematic diagram of the step flow of the control method of the display module provided in an embodiment of the present application. Referring to FIG38 , an embodiment of the present application provides a control method of the display module, which, based on the aforementioned embodiment, further includes:

S41, when the imaging area setting mode is started again after the imaging area setting mode is exited, when it is detected that the display module is stationary at a fourth relative position on the lens and the touch portion is touched according to the first touch mode, marking the fourth relative position as a fourth fitting point; the fourth relative position is an arbitrary position of the display module on the lens;

S42, when at least three fourth fitting points are marked, determining a repetition rate between the at least three fourth fitting points and the at least three first fitting points;

S43, when it is determined that the repetition rate is not less than the preset threshold, setting the preset imaging area as the current imaging area of the display module on the lens.

In some optional embodiments, the user may have forgotten that he or she has ever set a preset imaging area for the glasses currently worn. When the display module detects that the preset imaging area setting mode is entered again, and the repetition rate of the relative positions of the detected fourth fitting point and the first fitting point on the lens reaches a preset threshold (for example, 90%), the setting of the preset imaging area is abandoned, and the preset imaging area fitted according to the first fitting point is directly configured as the current imaging area of the display module on the lens.

In some optional embodiments, based on the embodiment shown in Figure 37 above, the control method of the display module also includes: when it is determined that the repetition rate is less than a preset threshold, fitting the at least three fourth fitting points into a fourth closed area, and setting the fourth closed area as the current imaging area of the display module on the lens.

It should be noted that although the above examples are all described using monocular (i.e., the display module provided by the embodiment of the present application is connected to only one lens of the glasses) as an example, it is obvious that all the implementation methods provided in the present application can also be applied to binocular (i.e., the display modules provided by the embodiment of the present application are connected to both lenses of the glasses) scenarios.

The control method of the display module provided in the embodiment of the present application can be executed by a control device of the display module. In the embodiment of the present application, the control device of the display module executing the control method of the display module is taken as an example to illustrate the control device of the display module provided in the embodiment of the present application.

As shown in FIG39 , a schematic diagram of the structure of a control device of a display module provided in an embodiment of the present application is shown. Referring to FIG39 , the control device 7 of the display module, the display module is configured to be placed on an optical lens, and the display module is configured to output image content, and the control device 7 includes:

A first detection module 71 is used to detect the relative position of the display module on the currently connected lens and the contact of the touch portion of the display module;

A first marking module 72 is configured to mark the first relative position as a first fitting point when it is detected that the display module is stationary at a first relative position on the lens and the touch portion is touched according to a first touch pattern in an imaging area setting mode; the first relative position is an arbitrary position of the display module on the lens, and the first touch pattern is a touch pattern used to indicate that the user confirms that the display area of the display module can be clearly seen in the imaging area setting mode;

A first fitting module 73, configured to fit the at least three first fitting points into a closed area when at least three first fitting points are marked;

The first setting module 74 is used to set the closed area as a preset imaging area of the display module on the lens.

In some optional implementations, the control device 7 further includes:

When it is detected that the display module is outside the preset imaging area, a low power consumption mode is started.

In some optional implementations, the control device 7 further includes:

A first division module, configured to divide the preset imaging area into at least two sub-imaging areas when receiving a partition instruction;

The first imaging module is used to control the display module to image the first graphic interface in the first sub-imaging area when receiving a mapping instruction to image the first graphic interface in the first sub-imaging area; the first sub-imaging area is any one of the at least two sub-imaging areas.

In some optional implementations, the control device 7 further includes:

a second marking module, for, when the imaging area setting mode is started again after the imaging area setting mode is exited, and when it is detected that the display module is stationary at a second relative position on the lens and the touch portion is touched according to the first touch mode, marking the second relative position as a second fitting point; the second relative position is an arbitrary position on the lens different from the first relative position;

A second fitting module is used to fit the at least three first fitting points and the at least one second fitting point into a first new closed area when at least one second fitting point is marked, and update the first new closed area to be the preset imaging area of the display module on the lens; or to fit the at least three second fitting points into a second new closed area when at least three second fitting points are marked, and update the second new closed area to be the preset imaging area of the display module on the lens.

In some optional implementations, the control device 7 further includes:

a first identification module, configured to identify a first identity of a first user wearing a first pair of glasses, wherein the first pair of glasses includes the lenses;

A first search module, configured to search a mapping rule matching the first identity in a preset mapping set;

The second setting module is used to set the preset imaging area in the searched mapping rule as the imaging area of the display module on the lens when there is only one mapping rule searched from the mapping set; each mapping rule in the mapping set is a pre-set mapping relationship between a user identity and a preset imaging area, and each mapping rule in the mapping set is different.

In some optional implementations, the control device 7 further includes:

A third setting module is used to detect, when at least two mapping rules are searched from the mapping set, a selection instruction for each preset imaging area in the at least two mapping rules, and set the preset imaging area selected by the selection instruction as the imaging area for the display module to image on the lens, or set the first preset imaging area in the at least two mapping rules as the imaging area for the display module to image on the lens, wherein the first preset imaging area is the preset imaging area selected last time in the historical selection record of the first user selecting the preset imaging area.

In some optional implementations, the control device 7 further includes:

A first starting module, configured to start the imaging area setting mode when no mapping rule is found from the mapping set;

a third marking module, configured to mark the third relative position as a third fitting point when it is detected in the imaging area setting mode that the display module is stationary at a third relative position on the lens and the touch portion is touched according to the first touch mode; the third relative position is an arbitrary position of the display module on the lens;

A third fitting module, configured to fit the at least three third fitting points into a third closed area when at least three third fitting points are marked;

The fourth setting module is used to set the third closed area as a third preset imaging area of the display module on the lens.

In some optional implementations, the control device 7 further includes:

The first establishing module is used to establish a third mapping rule between the first identity and the third preset imaging area, and classify the third mapping rule into the mapping set.

In some optional implementations, the control device 7 further includes:

a fourth marking module, for, when the imaging area setting mode is started again after the imaging area setting mode is exited, and when it is detected that the display module is stationary at a fourth relative position on the lens and the touch portion is touched according to the first touch mode, marking the fourth relative position as a fourth fitting point; the fourth relative position is an arbitrary position of the display module on the lens;

a fourth fitting module, configured to determine, when at least three fourth fitting points are marked, a repetition rate between the at least three fourth fitting points and the at least three first fitting points;

The fifth setting module is used to set the preset imaging area as the current imaging area of the display module on the lens when it is determined that the repetition rate is not less than a preset threshold.

In some optional implementations, the control device 7 further includes:

The sixth setting module is used to fit the at least three fourth fitting points into a fourth closed area when it is determined that the repetition rate is less than a preset threshold, and set the fourth closed area as the current imaging area of the display module on the lens.

In some optional implementations, the control device 7 further includes:

A first acquisition module, used for acquiring a first virtual contour model of the lens and a second virtual contour model of the user's eye;

The seventh setting module is used to scan a contour area that is the same as or similar to the second virtual contour model on the first virtual contour model, and set the contour area as a preset imaging area of the display module on the lens.

In some optional implementations, the control device 7 further includes:

A second acquisition module, used to acquire the identity information of the user;

The second establishing module is used to establish and save a mapping rule between the identity information and the preset imaging area.

The control device 7 of the display module in the embodiment of the present application can be an electronic device or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR)/virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc. It can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., and the embodiment of the present application does not make specific limitations.

The control device 7 of the display module in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

The control device 7 of the display module provided in the embodiment of the present application can implement the various processes implemented in the embodiments of Figures 1 to 5 and Figures 22 to 38. To avoid repetition, they will not be repeated here.

The embodiment of the present application also provides an electronic device 130. As shown in FIG19 , the electronic device 130 may include a processor 131 and a memory 132. The memory 132 stores programs or instructions that can be run on the processor 131. When the program or instructions are executed by the processor 131, the various steps of the control method embodiment of the above-mentioned display module are implemented, and the same technical effect can be achieved. To avoid repetition, they are not repeated here.

An embodiment of the present application also provides an electronic device, the hardware structure of which is a schematic diagram as shown in Figure 20, and components with the same functions are not repeated here, wherein the processor 1410 is used to: detect the relative position of the display module on the currently connected lens and the contact of the touch portion of the display module; in the imaging area setting mode, when it is detected that the display module is stationary at a first relative position on the lens and the touch portion is touched according to a first touch pattern, mark the first relative position as a first fitting point; the first relative position is an arbitrary position of the display module on the lens, and in the imaging area setting mode, the first touch pattern is a touch pattern used to indicate that the user confirms that the display area of the display module can be clearly seen; when at least three first fitting points are marked, fit the at least three first fitting points into a closed area; and set the closed area as a preset imaging area of the display module on the lens.

In some optional embodiments, the embodiments of the present application also provide a near-eye display device 150. The near-eye display device 150 can be as shown in Figure 21 above. The display device 150 may include a processor 151 and a memory 152. The memory 152 stores programs or instructions that can be run on the processor 151. When the program or instructions are executed by the processor 131, the various steps of the control method embodiment of the above-mentioned display module are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

Please continue to refer to FIG. 40 . Two thumbnails [A] and [B] are simultaneously imaged in the central area of the preset imaging area, and three thumbnails [D1], [D2] and [D3] are simultaneously imaged in the area near the edge of the frame 11. It is necessary to provide corresponding interactive means so that the user can select the thumbnail to be selected from these (icon) thumbnails, thereby realizing the interaction between the user and the display module. At the same time, it is necessary to ensure that the user can select the thumbnail to be selected relatively quickly and accurately without making a wrong selection or confusion.

In the related art, a display module may simultaneously image multiple thumbnails of applications or files (icons) in a certain area on a near-eye display device. How to enable users to accurately interact with these thumbnails without confusion or errors is a technical problem that needs to be solved urgently. The purpose of the embodiments of the present application is to provide a control method, device, electronic device, near-eye display device, medium, chip and computer program product of a display module, so as to independently or semi-independently solve the problem of a display module connected to a near-eye display device being in a state of ... A technical problem that multiple thumbnails of applications or files (icons) are simultaneously imaged in a certain area of a near-eye display device, and it is easy for users to interact with these thumbnails and cause confusion or errors. The independent solution refers to providing a hardware construction scheme that can work independently without the cooperation of software, so that the display module connected to the near-eye display device in the near-eye display technology can simultaneously image multiple thumbnails of applications or files (icons) in a certain area of the near-eye display device, and the user can accurately interact with these thumbnails without easily causing confusion or errors. The semi-independent solution refers to providing a hardware construction scheme that can achieve the effect that the display module connected to the near-eye display device in the near-eye display technology simultaneously images multiple thumbnails of applications or files (icons) in a certain area of the near-eye display device when working in conjunction with near-eye display software, such as software for users to interact with virtual information in AR technology, and can accurately interact with these thumbnails without easily causing confusion or errors.

The embodiments of the present application provide a control method, device, electronic device, near-eye display device, medium, chip and computer program product for a display module, which can independently or semi-independently solve to a certain extent the technical problem that if a display module connected to the near-eye display device simultaneously images thumbnails of multiple applications or files (icons) in a certain area of the near-eye display device, it is easy for confusion or errors to occur when a user interacts with these thumbnails.

On this basis, the embodiments of the present application are described in detail below.

An embodiment of the present application provides a control method for a display module, wherein the display module is configured to be placed on an optical lens, and the display module is configured to output image content. Exemplarily, as shown in Figures 1 to 48, the display module may be the display module 2 shown in Figures 1 to 48, and the display module 2 may output image content on the lens 12. The control method for the display module may be executed by at least one of the glasses 1, the display module 2, the near-eye display device 10 or the smart terminal 4 in Figures 1 to 48, which can realize the control of the specific information of the GUI imaged by the display module 2 on the glasses 1 (or near-eye display device 10) to which it is connected. As shown in Figure 41, Figure 41 is a schematic diagram of the step flow of the control method for the display module provided in an embodiment of the present application. The control method for the display module includes:

S111, when the image formed by the display module in the preset imaging area on the lens is a main interface, detecting the relative position between the display module and each thumbnail on the main interface;

S112: When it is detected that the display module is placed on a thumbnail, run an application associated with the thumbnail, and enlarge and display the thumbnail on the display module.

The lens is the lens on the glasses to which the display module is currently connected. For example, it can be described in the above embodiment, which will not be repeated here.

In the embodiment of the present application, the display module for augmented reality display imaging on the lens of the glasses can make some movements on the lens to which it is connected, instead of fixing the display module on the lens. In some optional embodiments, an inertial sensor or an acceleration sensor (or a gyroscope) is built into the display module, and the instantaneous speed and acceleration of the display module can be collected by such a sensor, so as to determine the motion trajectory of the display module according to the collected instantaneous speed and acceleration and in combination with parameters such as time.

The operating system usually provides a desktop or main interface function for the user, and the user can customize some files and application or program icons (thumbnails) on the desktop or main interface. For example, in the example shown in FIG40 , the display module 2 images the main interface function provided by the display module 2 for the user on the lens 12, and the user can define some files and application or program icons (thumbnails) in the main interface.

Optionally, a fixed reference point is selected as the origin in advance on the lens connected to the display module, and the display module moves from the origin and the motion trajectory of the display module is always monitored. The position of any point on the motion trajectory relative to the origin can be expressed as the relative position of the display module relative to the connected lens. The relative positions of the thumbnails on the lens on the main interface are determined when the display module is imaged and output, that is, the relative positions of the thumbnails on the lens are known.

For example, as shown in FIG42, FIG42 is a schematic diagram of an application scenario of a display module provided by an embodiment of the present application. For example, point P0 on the lens 12 is a pre-selected origin, and the display module 2 moves from the origin along the path l1 to point P1, and then moves along the path l2 to point P2. The motion parameters (such as speed, acceleration, etc.) of the display module 2 can be monitored to determine the display module 2 in the application scenario. The motion trajectory l of the motion process at any time t, and the position relationship of the end point of the motion trajectory at any time t relative to the origin P0 can represent the relative position of the display module 2 on the lens 12. For example, at time t1, the display module 2 moves to point P1, and the position relationship of point P1 relative to the origin P0 can be determined according to the determined path l1, that is, the relative position of the display module 2 on the lens 12, which is exemplarily represented as Indicates that point P1 is located at the vector At the end point, the vector The starting point is P0.

Similarly, when the motion trajectory of the display module 2 from point P1 to point P2 is l2, it is obvious that the position relationship of P2 relative to P1 can be expressed as Indicates that point P2 is located at the vector At the end point, the vector The starting point is P1. Based on the mathematical vector relationship, Therefore, there is Obviously, the above vector actually shows the displacement of module 2 during this process.

It should be noted that in the above examples, a straight line trajectory (path) is used as an example to describe the path and movement trajectory of the display module 2. Obviously, the display module 2 can be moved arbitrarily and is not limited to the form of the straight line trajectory in the above examples, such as a curved trajectory.

When the display module 2 forms an image of the main interface on the lens 12, the relative positions of the thumbnails on the main interface on the lens 12 are known. Based on the known relative positions of the thumbnails on the lens 12 and the monitored relative position of the display module 2 on the lens 12, the relative position relationship between the display module 2 and the thumbnails on the main interface can be determined.

When it is detected that the display module is placed on a thumbnail, the thumbnail is enlarged and displayed on the display module.

Exemplarily, in FIG. 40 , the user moves the display module 2 onto the thumbnail [A], and the thumbnail [A] is displayed in an enlarged manner in the display area 21 of the display module 2 .

In the embodiment of the present application, when the display module images the main interface on the connected lens, the relative position between the display module and each thumbnail on the main interface is detected, and when it is detected that the display module is placed on a thumbnail, the thumbnail is enlarged, so that the user can confirm whether to select the thumbnail. In this way, the user can interact with these thumbnails accurately to a certain extent without confusion or error.

In some optional embodiments, the control method of the display module provided in the embodiment of the present application also includes: when it is detected that the display module is placed on at least one thumbnail, enlarging and displaying the thumbnail of the at least one thumbnail closest to the display module on the display module.

Exemplarily, in FIG. 43 , the display module 2 is moved and placed above the thumbnails [D1], [D2], and [D3]. When determining the distance between the display module 2 and the thumbnails, the distance between the center point of the thumbnail and the center point of the display area of the display module 2 is used as a basis. Obviously, the thumbnail [D1] is closer to the display module 2, so the thumbnail [D1] is enlarged and displayed in the display area 21 of the display module 2.

In some optional implementations, the control method of the display module provided in the embodiment of the present application further includes:

In the case where the thumbnail is enlarged, detecting contact of a touch portion on the display module;

When it is detected that the touch portion is touched according to the first touch mode, the display module is controlled to image a graphical interface of an application associated with the enlarged thumbnail in a preset imaging area on the lens; the first touch mode is preset as a trigger condition for the application associated with the enlarged thumbnail

The first touch mode may be a single tap, a double tap, a triple tap, and the like.

When a certain thumbnail is enlarged and displayed on the display module, and the user touches the touch portion of the display module according to the first touch mode, it is determined that the user wants to start (or enter) the application associated with the enlarged thumbnail. Therefore, when a certain thumbnail is enlarged and displayed on the display module, and it is detected that the touch portion of the display module is touched according to the first touch mode, the application associated with the thumbnail is run in the foreground, and the display module is controlled to image the graphical interface of the application associated with the enlarged thumbnail in the preset imaging area on the lens. When the thumbnail is closed, If the associated application is already running in the background, it will be switched to the foreground. That is, the user is assisted in selecting a thumbnail in the main interface to enter the application associated with the thumbnail and use related functions.

Exemplarily, in the aforementioned example where the thumbnail [A] is magnified and displayed, when the thumbnail [A] is magnified and displayed, it is detected that the touch portion of the display module 2 is touched according to the first touch mode, then the application associated with the thumbnail [A] is run in the foreground, and the display module 2 is controlled to image the graphical interface of the application associated with the magnified thumbnail [A] in the preset imaging area 121 on the lens. Exemplarily, in the aforementioned example where the thumbnail [D1] is magnified and displayed, the application associated with the thumbnail [D1] is run in the foreground, and the display module 2 is controlled to image the graphical interface of the application associated with the magnified thumbnail [D1] in the preset imaging area 121 on the lens.

In an embodiment of the present application, when the display module images the main interface on the connected lens, the relative position between the display module and each thumbnail on the main interface is detected, and when it is detected that the display module is placed on a thumbnail, the thumbnail is enlarged. So that the user can confirm whether the thumbnail needs to be selected. When the user touches the touch portion of the display module according to the first touch mode again, it is determined that the user wants to start (or enter) the application associated with the enlarged thumbnail, and enter the application and image its graphical interface. It is achieved to assist the user in selecting the thumbnail in the main interface, so as to enter the application associated with the thumbnail and use the related functions, so as to enable the user to interact with these thumbnails accurately to a certain extent without confusion or errors.

In some optional implementations, the control method of the display module provided in the embodiment of the present application further includes:

When the display module images the main interface in the preset imaging area on the lens, monitoring the movement state of the display module, detecting the contact of the touch part on the display module and acquiring multimedia data;

When the display module is monitored to be rotating along its axis, or when it is detected that the touch portion is touched in accordance with a second touch mode, or when a page turning instruction is recognized in the multimedia data, the display module is controlled to switch the current page of the main interface imaged in a preset imaging area on the lens to the previous page or next page of the main interface imaged; the display module is rotating along its axis, the second touch mode and the page turning instruction are preset as trigger conditions for triggering a page turning function.

When the display module images the main interface in the preset imaging area on the lens, the motion state of the display module is monitored, the contact of the touch portion on the display module is detected, and multimedia data is obtained. For the description of monitoring the motion state of the display module and detecting the touch portion on the display module, please refer to the previous text and will not be repeated here. The display module can obtain multimedia data through its own camera, microphone, etc., or it can obtain multimedia data from the network or a smart terminal or near-eye display device that is connected to it for communication.

Exemplarily, as shown in FIG. 44 and FIG. 45, FIG. 44 and FIG. 45 are schematic diagrams of an application scenario of a display module provided in an embodiment of the present application. The display module 2 can be preset to rotate along the counterclockwise axis shown in FIG. 47 as a trigger condition for triggering the main interface to turn up (or down) pages, and the display module 2 can be preset to rotate along the clockwise axis shown in FIG. 45 as a trigger condition for triggering the main interface to turn down (or up) pages. When the display module 2 is detected to rotate counterclockwise (or clockwise), the display module 2 is controlled to update the main interface currently imaged on the lens 12, that is, the display module 2 is controlled to image the previous page (or next page) of the main interface on the lens 12.

Exemplarily, the second touch mode may include two different touch modes, such as single click and double click, or double click and triple click. Among them, one of the two different touch modes is a trigger condition for turning the page up, and the other touch mode is a trigger condition for turning the page down. For example, when a single click is detected, the main interface turns up, that is, the display module 2 is controlled to image the previous page of the main interface on the lens 12; when a triple click is detected, the main interface turns down, that is, the display module 2 is controlled to image the next page of the main interface on the lens 12.

It should be noted that the first touch mode and the second touch mode should be two completely different touch modes to ensure that the application can be started from the main interface and the page turning function of the main interface can be carried out in an orderly manner without any error.

Exemplarily, the multimedia data is voice data or gesture data, and when a voice command or target gesture for turning a page is recognized therefrom, the main interface turns a page, that is, the display module 2 is controlled to image the previous page (or next page) of the main interface on the lens 12 .

In some optional implementations, the detection of the display module being placed on the thumbnail and rotating the axis is preset as a trigger bar for the main interface zoom function. Preset the display module clockwise (or counterclockwise) axis rotation as the trigger condition for enlarging the thumbnail under the display module; preset the display module counterclockwise (or clockwise) axis rotation as the trigger condition for zooming the main interface.

Exemplarily, as shown in FIG. 46 , in the scene shown in FIG. 45 , when the display module 2 rotates clockwise, the thumbnail is enlarged [J]; as shown in FIG. 46 , in the scene shown in FIG. 45 , when the display module 2 rotates counterclockwise, the current page of the main interface is scaled.

In some optional implementations, the control method of the display module provided in the embodiment of the present application further includes:

In the case where the image formed by the display module in the preset imaging area on the lens is a graphical interface of an application, monitoring the movement state of the display module, detecting the contact of a touch portion on the display module, and acquiring multimedia data;

When it is detected that the motion state is an axial rotation of the display module, or when it is detected that the touch portion is touched according to a target touch pattern, or when a target instruction is recognized in the multimedia data, the display module is controlled to update a first target area of the graphical interface of the application imaged in a preset imaging area on the lens; the first target area is a graphic area corresponding to a sub-function in the application, and the axial rotation of the display module, the target touch pattern and the target instruction are preset as trigger conditions for triggering the sub-function of the application.

For example, if the current image is a graphical interface of a music player function, the counterclockwise rotation of the display module 2 can be preset as a trigger condition for triggering a song switch to the previous song (or the next song), and the clockwise rotation of the display module 2 can be preset as a trigger condition for triggering a song switch to the next song (or the previous song). When the counterclockwise (or clockwise) rotation of the display module 2 is detected, the song currently being played is switched, and the display module 2 is controlled to update the music player interface currently imaged on the lens 12, that is, the display module 2 is controlled to update the song information in the music player interface imaged on the lens 12 to the information of the previous song (or the next song).

Among them, the multimedia data can be image/video data collected by the built-in micro camera on the display module or voice data collected by the micro microphone, and the eye tracking data is the user's eye image data collected by the built-in micro camera on the display module.

The target touch mode may be a single click, a double click, a triple click, and the like. The target instruction may be a preset target gesture, a target voice, and the like. The target eye movement pattern may be an eye movement according to a preset rule. Similarly, the target touch mode and the target instruction are similar to the aforementioned display module axis rotation, and they may also be preset as trigger conditions for the sub-functions of the application. In the case where it is detected that the touch portion of the display module is touched according to the target touch mode, or in the case where a target instruction is identified from multimedia data, the trigger (preset) trigger condition is the target touch mode, the target instruction, and the sub-function of the application of the display module axis rotation, thereby controlling the display module to update the area in the graphical interface currently imaged on the lens. The principle is similar to the principle that the aforementioned display module axis rotation triggers the sub-function of the application, thereby controlling the display module to update the area in the graphical interface currently imaged on the lens, and will not be repeated here. Those skilled in the art can refer to the foregoing to understand.

In some optional implementations, the control method of the display module further includes:

When it is detected that the rotation angle of the display module during the axial rotation is not less than a preset first threshold angle β, the display module is controlled to update the graphic interface imaged in the preset imaging area on the lens.

The first threshold angle β can be flexibly set by those skilled in the art or users according to actual needs, for example, it can be 15°, 20°, 25° or 30°.

This can prevent the display module 2 from updating the graphic interface imaged on the lens 12 when the display module 2 is slightly driven to rotate its axis. Therefore, the sub-functions of the third logic function can be reduced by mistake to a certain extent.

It should be noted that although the above examples are all described using monocular (i.e., the display module provided by the embodiment of the present application is connected to only one lens of the glasses) as an example, it is obvious that all the implementation methods provided in the present application can also be applied to binocular (i.e., the display modules provided by the embodiment of the present application are connected to both lenses of the glasses) scenarios.

The connection method of the projection device provided in the embodiment of the present application can be executed by the control device of the display module. In the embodiment of the present application, the control device of the display module executing the control method of the display module is taken as an example to illustrate the control device of the display module provided in the embodiment of the present application.

As shown in FIG48 , a schematic diagram of the structure of a control device of a display module provided in an embodiment of the present application is shown. Referring to FIG48 , the control device 500 of the display module is configured to be placed on an optical lens, and the display module is configured to output image content, and the control device 500 includes:

A first detection module 510 is used to detect the relative position between the display module and each thumbnail on the main interface when the image formed by the display module in the preset imaging area on the lens is the main interface;

The first magnifying module 520 is configured to magnify and display a thumbnail on the display module when it is detected that the display module is placed on a thumbnail.

In some optional implementations, the device 500 further includes:

The second magnifying module is used for magnifying and displaying the thumbnail of the at least one thumbnail closest to the display module on the display module when it is detected that the display module is placed on the at least one thumbnail.

In some optional implementations, the device 500 further includes:

A second detection module is used to detect contact of a touch portion on the display module when the thumbnail is enlarged;

The first control module is used to control the display module to image a graphical interface of an application associated with the enlarged thumbnail in a preset imaging area on the lens when detecting that the touch portion is touched according to a first touch mode; the first touch mode is preset as a trigger condition for the application associated with the enlarged thumbnail.

In some optional embodiments, the device 5 further comprises:

A first monitoring module, configured to monitor the motion state of the display module when the image formed by the display module in the preset imaging area on the lens is a main interface;

The second control module is used to control the display module to switch the current page of the main interface imaged in the preset imaging area on the lens to the previous page or next page of the main interface imaged when the display module is detected to be rotating along its axis; the rotation of the display module along its axis is preset as a trigger condition for triggering a page turning function.

In some optional embodiments, the device 5 further comprises:

A third detection module is used to detect contact of a touch portion on the display module when the image formed by the display module in the preset imaging area on the lens is a main interface;

The third control module is used to control the display module to switch the current page of the main interface imaged in the preset imaging area on the lens to the previous page or next page of the main interface when it is detected that the touch portion is touched according to the second touch mode; the second touch mode is preset as a trigger condition for triggering a page turning function.

In some optional implementations, the device 500 further includes:

A first acquisition module, configured to acquire multimedia data when the image formed by the display module in the preset imaging area on the lens is a main interface;

The fourth control module is used to control the display module to switch the current page of the main interface imaged in the preset imaging area on the lens to the previous page or next page of the main interface when a page turning instruction is recognized in the multimedia data; the page turning instruction is preset as a trigger condition for triggering the page turning function.

In some optional implementations, the device 500 further includes:

A second monitoring module is used to monitor the movement state of the display module when the image formed by the display module in the preset imaging area on the lens is a graphical interface of an application;

The fifth control module is used to control the display module to update the first target area of the graphical interface of the application imaged in the preset imaging area on the lens when it is detected that the movement state is the axial rotation of the display module; the first target area is the graphic area corresponding to the sub-function in the application, and the axial rotation of the display module is preset as a trigger condition for triggering the sub-function of the application.

In some optional implementations, the device 500 further includes:

A fourth control module, configured to detect contact of a touch portion on the display module when the image formed by the display module in the preset imaging area on the lens is a graphical interface of an application;

The sixth control module is used to control the display module to update the first target area of the graphical interface of the application imaged in the preset imaging area on the lens when detecting that the touch portion is touched according to the target touch mode; the first target area is the graphic area corresponding to the sub-function in the application, and the target touch mode is preset as a trigger condition for triggering the sub-function of the application.

In some optional implementations, the device 500 further includes:

A second acquisition module, configured to acquire multimedia data when the image formed by the display module in the preset imaging area on the lens is a graphical interface of an application;

The seventh control module is used to control the display module to update the first target area of the graphical interface of the application imaged in the preset imaging area on the lens when a target instruction is recognized in the multimedia data; the first target area is a graphic area corresponding to a sub-function in the application, and the target instruction is preset as a trigger condition for triggering the sub-function of the application.

The control device 5 of the display module in the embodiment of the present application can be an electronic device or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR)/virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc. It can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., and the embodiment of the present application does not make specific limitations.

The control device 5 of the display module in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

The control device 500 of the display module provided in the embodiment of the present application can implement each process implemented in the embodiments of Figures 1 to 46, and will not be described again here to avoid repetition.

In some optional embodiments, as shown in FIG. 19 , the embodiment of the present application further provides an electronic device 130, including a processor 131 and a memory 132, wherein the memory 132 stores programs or instructions that can be executed on the processor 131, and when the program or instructions are executed by the processor 131, the various steps of the control method embodiment of the above-mentioned display module are implemented, and the same technical effect can be achieved. To avoid repetition, they are not described here.

It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

FIG. 20 is a schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application.

The electronic device 140 includes, but is not limited to, a radio frequency unit 141, a network module 142, an audio output unit 143, an input unit 144, a sensor 145, a display unit 146, a user input unit 147, an interface unit 148, a memory 149, and a processor 1410. It will be appreciated by those skilled in the art that the electronic device 140 may also include a power source (such as a battery) for supplying power to each component. The power source may be connected to a power supply unit 1411 through a power supply unit 142. The power management system is logically connected to the processor 1410, so that the power management system can realize functions such as managing charging, discharging, and power consumption management. The electronic device structure shown in FIG48 does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange components differently, which will not be described in detail here.

The processor 1410 is configured to:

In the case where the image formed by the display module in the preset imaging area on the lens is a main interface, detecting the relative position between the display module and each thumbnail on the main interface;

When it is detected that the display module is placed on a thumbnail, an application associated with the thumbnail is run, and the display module is controlled to image a graphic interface of the application in a preset imaging area on the lens.

It should be understood that in the embodiment of the present application, the input unit 144 may include a graphics processing unit (GPU) 1441 and a microphone 1442, and the graphics processor 1441 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 146 may include a display panel 1461, and the display panel 1461 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 147 includes a touch panel 1471 and at least one of other input devices 1472. The touch panel 1471 is also called a touch screen. The touch panel 1471 may include two parts: a touch detection device and a touch controller. Other input devices 1472 may include, but are not limited to, a physical keyboard, function keys (such as a volume control key, a switch key, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

The memory 149 can be used to store software programs and various data. The memory 149 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 149 may include a volatile memory or a non-volatile memory, or the memory 149 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 149 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

The processor 1410 may include one or more processing units; optionally, the processor 1410 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1410.

The control method of the display module provided in the embodiment of the present application can be executed by a near-eye display device. In the embodiment of the present application, the near-eye display device executing the control method of the display module is taken as an example to illustrate the near-eye display device provided in the embodiment of the present application.

In some optional embodiments, as shown in FIG. 21 , the embodiment of the present application further provides a near-eye display device 150, including a processor 151 and a memory 152, wherein the memory 152 stores programs or instructions that can be executed on the processor 151, and when the program or instructions are executed by the processor 131, the various steps of the control method embodiment of the above-mentioned display module are implemented, and the same technical effect can be achieved. To avoid repetition, they are not repeated here.

Any of the above-mentioned product embodiments can implement the various processes of the above-mentioned display module control method embodiment through its own processor operation, and can achieve the same technical effect. In order to avoid repetition, they will not be described one by one.

Any of the above-mentioned product embodiments can implement the various processes of the above-mentioned display module control method embodiment through its own processor operation, and can achieve the same technical effect. In order to avoid repetition, they will not be described one by one.

The embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the control method embodiment of the display module is implemented, and the same technical effect can be achieved. To avoid repetition, it is not repeated here. Among them, the processor is the processor in the electronic device or electronic system described in the above embodiment. The readable storage medium includes a computer-readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a disk or an optical disk, etc.

An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned display module control method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the control method embodiment of the display module as described above, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

In the implementation methods provided in the embodiments of the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device implementation methods described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

In addition, each functional unit in each implementation of the embodiment of the present application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of software functional units.

If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) or a processor (processor) to perform all or part of the steps of the method described in each implementation method of the embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program code.

Near-eye display devices are also called head-mounted displays or wearable displays, and are applied to optical lenses. In some cases, at the technical level, augmented reality AR (Augmented Reality), virtual reality VR (Virtual Reality), mixed reality MR (Mixed Reality) and extended reality XR (Extended Reality) can all be called near-eye displays. The optical lenses in the examples of this application can be goggles, smart glasses, myopia glasses, hyperopia glasses, sports glasses or other near-eye or head-mounted optical lenses, etc. The user's optical lenses can be facing the human eye. The near-eye display device has an optical machine, which may include a micro display, such as Micro-LED (Micro Light-Emitting Diode), uLED (micro light-emitting diode), Micro-oled (Micro Organic Light-Emitting Diode), LCoS (Liquid Crystal On Silicon), LCD (Liquid Crystal Display), DMD (Digital Micromirror Device)/DLP (Digital Light Processing) or LBS (Laser Beam Scanning), etc., or any combination of these technologies. It can be understood that the optical machine may also include micro-optics Modules, etc., the micro-optical module is arranged in front of the micro-display, and the light of the display is emitted after passing through the micro-optical module. The description of the micro-display in other embodiments of the present application can refer to this related description.

The near-eye display device may also include a circuit board, a battery for supplying power to the optical engine and the circuit board, and an electrical component for realizing electrical connection between each component and the battery. Taking AR glasses as an example, in general, the circuit board and electrical components such as batteries are installed on the temples of the AR glasses, the optical engine is installed on the optical lens, and a channel for wiring is provided on the outside of the optical engine to facilitate power supply to the optical engine. Because in some cases, the temples of AR glasses have the need to rotate relative to the frame, the connection between the optical engine and electrical components such as batteries is affected by the relative movement of the temples, resulting in relative misalignment and short circuit in the wiring of the optical engine and electrical components such as batteries; with the relative movement of the temples, the wiring parts of the optical engine and electrical components such as batteries are also prone to water ingress and other problems, affecting the use of AR glasses. In general, the near-eye display device is usually a head-mounted display or other wearable display, which is set in front of the human eye's vision. The structure is relatively complex, which increases the difficulty of fixing the product and affects the production efficiency of the product.

In view of the above problems, the present application proposes a near-eye display module for optical lenses, which can be directly installed on a frame or an optical lens. The near-eye display module includes a first connecting portion for connecting the optical lens and a mounting seat for installing an optical machine; a first electrical compartment for installing electrical components is provided on the first connecting portion, and a mounting seat is formed with a mounting groove for installing the optical machine, and the mounting seat is located on one side of the first connecting portion along the first direction, and the first direction is arranged at an angle with the axial direction of the mounting groove. In the example of the present application, a first electrical compartment is arranged in the first connecting portion, which can facilitate the installation of electrical components such as batteries on the first connecting portion, reduce the need for a wiring structure for connecting batteries and optical machines to be separately arranged outside the optical lens, and further reduce the problem of water ingress and other problems caused by the relative movement of the temples to the frame; since the axial direction of the mounting groove is arranged at an angle with the first direction, the mounting seat and the first electrical compartment are arranged along the first direction, which can facilitate the reduction of the thickness of the near-eye display device, and after being installed on the optical lens, the visual pressure on the human eye can be reduced, and the comfort of the product can be improved.

Please refer to Figure 49. For the convenience of description, the following is an example of the near-eye display module 2 used for glasses in the example of the present application. The glasses may include a frame 11, an optical lens 12 and a temple 13. The optical lens 12 may be mounted on the frame 11, and the temple is connected to the frame 11. The near-eye display module 2 may be mounted on the frame 11 and/or the optical lens 12, which may reduce the need for overly large power supply modules such as batteries on the temples, or reduce the need for wiring parts between the temples and the optical lens 12 for connecting power supply modules such as batteries and the near-eye display module 2. The problems of water ingress, disconnection, short circuit, etc. in the wiring parts caused by the relative movement of the temples and the lenses may be reduced. The display component 1 may be combined with existing ordinary glasses such as myopia, hyperopia, eye protection, sports glasses, etc. to realize the function of enhanced display, so that ordinary glasses have the function of augmented reality of smart glasses.

Please refer to Figures 50, 51 and 52, the present application discloses an example of a near-eye display module 2. Each of them will be described in detail below.

The near-eye display module 2 includes a first connecting portion 101 and a mounting seat 105. The first connecting portion 101 is used to connect to the optical lens 12 and/or the frame. The first connecting portion 101 is provided with a first electrical compartment 1110 for installing electrical components. The mounting seat 105 is connected to one side of the first connecting portion 101 along the first direction 2a. The mounting seat 105 is formed with a mounting groove 1401 for installing the optical machine 400. The first direction 2a is set at an angle to the axial direction of the mounting groove 1401.

Please refer to Figures 51 and 52 in combination. The first connecting portion 101 can be used as the main structure of the near-eye display module 2, and is used to connect to the optical lens 12. In this example, a fixing surface 1203 can be set on the first connecting portion 101, and the fixing surface 1203 can be made of plastic or other materials. The fixing surface 1203 is used to connect to the optical lens 12, or to connect to the frame. The first connecting portion 101 in this example can be directly connected to the optical lens 12, or it can be connected to the optical lens 12 through other intermediate connecting parts such as magnetic attraction and hanging buckles. The first connecting portion 101 in this example can be fixedly connected to the optical lens 12, for example, the first connecting portion 101 can be bonded to the optical lens 12 so that the first connecting portion 101 maintains a relatively fixed position on the optical lens 12. The first connecting portion 101 in this example can be movably mounted on the optical lens 12, for example, the first connecting portion 101 can be relatively slidably connected to the optical lens 12 or relatively rotatably connected. The first connecting portion 101 in this example can also be detachably mounted on the optical lens 12. For example, the first connecting portion 101 can be snapped or adsorbed on the optical lens 12. The fixing surface 1203 may also be provided with a buffer layer to reduce the wear on the optical lens 12.

Please refer to FIG. 51, FIG. 5 and FIG. 54, the first connection part 101 is at least partially a hollow structure, and the first electrical compartment 1110 is a hollow cavity opened in the first connection part 101. The first electrical compartment 1110 is used to install electrical components. The electrical components in the example of this application include but are not limited to batteries 8, circuit boards, etc. For the convenience of description, the following description is based on the assumption that the first electrical compartment 1110 is installed with batteries 8.

The mounting seat 105 is used to mount the optical machine 400 . A mounting groove 1401 is formed on the mounting seat 105 . The mounting groove 1401 may be a through groove penetrating the mounting seat 105 or a recessed groove formed on the mounting seat 105 .

The mounting groove 1401 has an axial direction, and the optical machine 400 has a light emitting surface and an optical axis perpendicular to the light emitting surface. In some examples, the light emitting surface of the optical machine 400 is located on one side of the axial direction of the mounting groove 1401. The light emitting surface of the optical machine 400 in this example can be perpendicular to the axial direction of the mounting groove 1401, and the corresponding optical axis of the optical machine 400 can be parallel to the axis of the mounting groove 1401; or, the light emitting surface of the optical machine 400 is not perpendicular to the axis of the mounting groove 1401, and the optical axis of the optical machine 400 is set at an angle to the first direction, and the optical axis of the optical machine 400 can be neither parallel nor coincident with the first direction. As shown in Figure 50, the 2b direction can be the axial direction of the mounting groove 1401, and the optical axis of the optical machine 400 can be set along the 2b direction. The mounting seat 105 in this example can be separately set with the first connecting portion 101 and connected to each other, and the mounting seat 105 can also be set integrally with the first connecting portion 101.

The mounting seat 105 is connected to one side of the first connection part 101 along the first direction 2a, so that the mounting seat 105 and the first connection part 101 are arranged along the first direction 2a. The first direction 2a is set at an angle with the axial direction of the mounting groove 1401, which means that the first direction 2a is not parallel to the axial direction of the mounting groove 1401 and does not overlap. As shown in Figures 50 and 54, the axial direction of the mounting groove 1401 can be perpendicular to the first direction 2a. In this example, since the first connection part 101 is provided with the first electrical appliance compartment 1110, the mounting seat 105 is provided with the mounting groove 1401. When the mounting seat 105 and the first connection part 101 are arranged along the first direction 2a, the first electrical appliance compartment 1110 and the mounting groove 1401 can be arranged substantially along the first direction 2a, so that the first electrical appliance compartment 1110 and the mounting groove 1401 can be staggered with each other along the first direction 2a. It is understandable that the axial direction of the installation groove 1401 may not be perpendicular to the first direction 2a. When the installation groove 1401 and the first electrical compartment 1110 are arranged along the first direction 2a, the thickness of the near-eye display module 2 in the axial direction of the installation groove 1401 can also be reduced to a certain extent. After the optical engine 400 is installed in the installation groove 1401 and the battery 8 is installed in the first electrical compartment 1110, since the battery 8 and the optical engine 400 can be roughly distributed along the first direction 2a, the axial side of the installation groove 1401 can be used as the light output side of the optical engine 400. When the near-eye display module 2 is installed on the outer side of the optical lens 12 and the light passes through the optical lens 12 to enter the human eye, the overall thickness of the near-eye display module 2 on the optical lens 12 is relatively small, and the optical engine 400 can be powered without increasing the overall thickness of the AR device; when the near-eye display module 2 is installed on the inner side of the optical lens 12, the light does not pass through the lens, and the light can directly enter the human eye. Since the overall thickness of the near-eye display module 2 does not need to be increased, the intrusion of the near-eye display module 2 on the human eyeball can be reduced, thereby reducing the sense of oppression brought to the user by the near-eye display module 2, thereby improving the comfort of the product. In the example of the present application, the first electrical compartment 1110 and the mounting groove 1401 are arranged along the first direction 2a, so that the electrical structures such as the battery 8 in the first electrical compartment 1110 and the optical machine 400 in the mounting groove 1401 can maintain relative balance on the near-eye display module 2 to balance the weight of the near-eye display module 2, which helps to improve the stability of the near-eye display module 2 on the optical lens 12.

In this example, since the battery 8 or the related circuit board can be directly installed in the first electrical compartment 3, the additional electrical components for connecting the optical machine 400 and the battery 8 at the connection between the temple 13 and the frame 11 of the AR device can be reduced. On the one hand, the problem of water ingress or wear of the electrical components caused by the relative movement of the temple and the frame 11 can be reduced; on the other hand, the complexity of the connection between the temple and the frame 11 can be reduced, and the structure of the AR device can be simplified. In some application scenarios, the near-eye display module 2 can work independently (for example, displaying image content, etc.) without being connected to the electrical components of the temple, which greatly improves the portability and mobility of the display component 1, and is compatible with other traditional head-mounted devices such as myopia and hyperopia, eye protection, and helmets, and the application scenarios are more diverse.

In this example, a first wire hole 15 directly connected to the first electrical compartment 1110 and the mounting groove 1401 can be opened on the first connecting portion 101 to connect the battery 8 and the optical machine 400 from the inside of the near-eye display module 2 through an electrical component; by installing the battery 8 in the first connecting portion 101 The wiring structure can be reduced by installing the first connection part 101 or the mounting seat 105 outside, and the packaging steps can be simplified when the near-eye display module 2 is packaged, thereby improving the production efficiency of the product. In this example, a first wire hole 15 connecting the first electrical compartment 1110 and the outer wall of the first connection part 101 can also be opened on the first connection part 101, and the battery 8 and the optical machine 400 in the first electrical compartment 1110 are connected by the electrical structure passing through the first wire hole 15.

The optical machine 400 in the example of the present application may include an optical module 42 and a micro display 41 . The optical module 42 and the micro display 41 may be connected and fixed to each other, or the optical module 42 and the micro display 41 may be connected and fixed to the mounting seat 105 separately.

Please refer to Figures 50, 51 and 55 to 58. In some examples, the first connecting portion 101 includes a first cover body 102 and a second cover body 103; the first cover body 102 is provided with a first electrical appliance compartment 1110; the second cover body 103 covers the first cover body 102, and the second cover body 103 is used to close the first electrical appliance compartment 1110; at least one of the first cover body 102 and the second cover body 103 is connected to the mounting base 105.

The first electrical appliance compartment 1110 may be a groove opened on the first cover body 102 . The first electrical appliance compartment 1110 may have an opening, and the battery 8 may be placed in the first electrical appliance compartment 1110 through the opening.

The second cover 103 is connected to the first cover 102 and can be used to close the opening of the first electrical appliance compartment 1110 .

Please refer to Figures 50, 51, 55 and 56. In this example, the opening of the first electrical compartment 1110 can be opened on one side of the first cover body 102 along the second direction 2b, and the second cover body 103 can cover the first cover body 102 along the second direction 2b. The second direction 2b can be parallel to the axial direction of the installation groove 1401. In this example, the end surface of the first cover body 102 facing away from the second cover body 103 can be used as the fixing surface 1203 of the first connecting part 101, or the end surface of the second cover body 103 facing away from the first cover body 102 can be used as the fixing surface 1203 of the first connecting part 101.

Please refer to Figures 57 and 58. In this example, the opening of the first electrical appliance compartment 1110 can be opened on one side of the first cover body 102 along the first direction 2a, and the opening of the first electrical appliance compartment 1110 can be set away from the mounting seat, and the second cover body 103 can cover the first connecting part 101 along the first direction 2a.

In this example, by using the first cover 102 and the second cover to form the first connecting portion 101, it is convenient to open the first electrical compartment 1110 on the first cover 102, and when the first cover 102 is processed, it is convenient to perform molding and mold opening. In this example, the first cover 102 and the second cover 103 can be fixedly connected to each other, for example, the first cover 102 and the second cover 103 can be bonded and fixed to each other. In this example, the first cover 102 and the second cover 103 can also be detachably connected, for example, the first cover 102 and the second cover 103 can be mutually clamped or threaded. In some examples, one of the first cover 102 and the second cover 103 is convexly provided with a positioning column 1204, and the other is provided with a positioning hole 117, and the positioning column 1204 can be embedded in the positioning hole 117, so as to facilitate the mutual positioning and installation of the first cover 102 and the second cover 103.

In this example, at least one of the first cover 102 and the second cover 103 is connected to the mounting seat 105, which means that the mounting seat 105 is connected to one of the first cover 102 or the second cover 103, or the mounting seat 105 is simultaneously connected to the first cover 102 and the second cover 103. Taking the mounting seat 105 and the first connecting portion 101 in this example as an example, the mounting seat 105 can be mutually engaged with one of the first cover 102 or the second cover 103, or the mounting seat 105 can be simultaneously engaged with the first cover 102 and the second cover 103.

Please refer to Figures 52, 54 and 55. In some examples, the first cover body 102 is provided with a first wiring groove 113 connecting the installation groove 1401 and the first electrical compartment 1110. The first wiring groove 113 is used for the conductive module of the optical machine 400 to pass through and connect to the electrical device.

For the convenience of explanation, in this example, the electrical device is taken as a battery 8, and the conductive module can be connected to the corresponding electrode of the battery 8. The first wiring groove 113 connects the installation groove 1401 and the first electrical compartment 1110, so that the conductive module of the optical machine 400 can enter the first electrical compartment 1110 through the first wiring groove 113. The conductive module of the optical machine 400 in the example of the present application can be a wire, a metal sheet, a flexible circuit board or a copper-plated layer, etc. By providing a first wiring groove 113 for arranging the conductive module on the first cover body 102, it is convenient to arrange the conductive module inside the first connecting part 101, and the conductive module of the optical machine 400 is not exposed to the outside of the first connecting part 101, so as to reduce the problem of water ingress and short circuit in the wiring part. The wiring groove in this example can be a through groove that passes through the first cover 102 near one end of the mounting seat 105. The first wiring groove 113 in this example can be used for the conductive module of the optical machine 400 to pass through and connect to the positive electrode of the battery 8, the first wiring groove 113 can also be used for the conductive module of the optical machine 400 to pass through and connect to the negative electrode of the battery 8, and the first wiring groove 113 can also be used for the conductive module of the optical machine 400 to pass through and connect to the positive and negative electrodes of the battery 8 respectively. In some examples, the second cover 103 is covered on the first cover 102 along the second direction 2b described in the above examples, the first wiring groove 113 can have an opening toward the second cover 103, and the second cover 103 can be covered on the opening of the first wiring groove 113, so that one end of the first wiring groove 113 is connected to the mounting groove 1401, and the other end is connected to the first electrical compartment 1110.

In some examples, a first wire passing hole 15 is opened on the first cover body 102, one end of the first wire passing hole 15 is connected to the first wiring groove 113, and the other end is connected to the installation groove 1401. The first wire passing hole 15 is used to accommodate the conductive module of the optical machine 400. The conductive module of the optical machine 400 passes through the first wire passing hole 15 and is connected to the electrical device via the first wiring groove 113.

Please refer to Figure 55. In some examples, the first cover body 102 is provided with a first recess 112 for accommodating the electrode. The first recess 112 is connected to the first wiring groove 113 and the first electrical compartment 1110. The electrode can be used to connect the conductive module and the electrical device. For example, the electrode can be used to connect the corresponding electrode of the battery 8.

The first sink 112 is connected to the first wiring groove 113 and the first electrical compartment 1110, which means that the first sink 112 has at least an opening that is connected to the first wiring groove 113 and the first electrical compartment 1110, so that the pole piece in the first sink 112 can be used to connect the electrical device and the conductive module in the first wiring groove 113. The pole piece described in this example can be a metal sheet or other structure that can be used for conduction. The first sink 112 in this example can be used as an intermediate connector between the electrical device and the conductive module to facilitate the connection between the conductive module and the electrical device. Taking the electrical device as a battery 8 as an example, since the pole piece can be installed in the first wiring groove 113, the pole piece does not occupy the space of the first electrical compartment 1110, which can reduce the interference of the pole piece with the battery 8, improve the convenience of installing the battery 8, and also help to improve the stability of the battery 8.

Please refer to FIG. 51, FIG. 52 and FIG. 55. In some examples, taking the electrical device as a battery 8, the first electrical compartment 1110 has an opening facing the second cover 103 and a bottom wall arranged opposite to the opening, and the first sink 112 is opened on the bottom wall of the first electrical compartment 1110. The opening of the first electrical compartment 1110 is used for the battery 8 to enter the first electrical compartment 1110. The bottom wall of the first electrical compartment 1110 is arranged opposite to the opening of the first electrical compartment 1110. The bottom wall of the first electrical compartment 1110 is located at the deepest installation position of the battery 8 in the first electrical compartment 1110. The first sink 112 is opened on the bottom wall of the first electrical compartment 1110, so that after the electrode is installed in the first sink 112, the electrode does not occupy the internal space of the first electrical compartment 1110. In some examples, the opening of the first electrical compartment 1110 may be located on a side of the first cover 102 away from the mounting seat 105 along the first direction 2a, the second cover 103 may cover the opening of the first electrical compartment 1110 along the first direction 2a, the bottom wall of the first electrical compartment 1110 may be located on a side of the first electrical compartment 1110 close to the mounting seat 105 along the first direction 2a, and the first wiring groove 113 may connect the mounting groove 1401 and the first sink 112 nearby. In some examples, the second cover 103 covers the opening of the first electrical compartment 1110 along the second direction 2b, the bottom wall of the first electrical compartment 1110 may be located on an end surface of the first electrical compartment 1110 along the second direction 2b, the first wiring groove 113 may be partially located on the bottom wall of the first electrical compartment 1110, partially located on the side wall of the first electrical compartment 1110, and connected to the mounting groove 1401.

In some examples, the first cover 102 is further provided with a second wiring groove 116 connecting the mounting groove 1401 and the first electrical compartment 1110, and the second wiring groove 116 is used for the conductive module of the optical machine 400 to pass through and connect to the electrical device. Taking the electrical device in this example as a battery, the second wiring groove 116 in this example cooperates with the first wiring groove 113 so that the conductive module of the optical machine 400 can be connected to the positive and negative electrodes of the battery 8 respectively. Taking the conductive module of the optical machine 400 passing through the first wiring groove 113 and connecting the positive electrode of the battery 8 as an example, the second wiring groove 116 is used for the conductive module of the optical machine 400 to pass through and connect to the negative electrode of the battery 8. The electrical device in this example is also a combination of a battery 8 and a circuit board, and the second wiring groove 116 can be used for the conductive module of the optical machine to pass through and connect the circuit board and the optical machine 400. In this example, the first wiring groove 113 can be connected to the second wiring groove 116, and the first wiring groove 113 can also be set independently of the second wiring groove 116. In some examples, the first wire hole 15 described in any of the above examples is opened at one end of the first cover body 102 close to the installation groove 1401 , and the first wiring groove 113 and the second wiring groove 116 can be connected to the first wire hole 15 respectively.

Please refer to Figures 54 and 56. In some examples, the second cover 103 is provided with a second sink 1201 on one side facing the first cover 102. The second sink 1201 is used to accommodate at least one of the battery 8, the circuit board, the magnet 53, and the counterweight. After the first cover 102 and the second cover 103 are covered with each other, the first cover 102 can close the second sink 1201 of the second cover 103 so that the battery 8, the circuit board, the magnet 53, or the counterweight in the second sink 1201 will not be exposed outside the first connecting portion 101. In this example, by providing the second sink 1201, it is convenient to add structures such as the battery 8 inside the first connecting portion 101 to extend the battery life of the near-eye display module 2. The circuit board structure of the near-eye display module 2 can be installed in the second sink 1201. While the counterweight of the near-eye display module 2 is balanced by the circuit board, the circuit board and other structures are stored inside the first connecting portion 101, reducing the laying of the circuit board outside the near-eye display module 2, which helps to simplify the structure of the near-eye display module 2 and improve its assembly performance. The second sink 1201 can also be used to install magnets 53 and/or counterweights. The near-eye display module 2 can be adsorbed to a preset position on the optical lens 12 by the magnet 53, so that the position of the near-eye display module 2 on the optical lens 12 can be adjusted as needed to accommodate users with different pupil distances. The second sink 1201 in this example can also be used to install other functional modules.

Please continue to refer to Figures 54 and 56. In some examples, the second cover 103 covers the first cover 102 along the second direction 2b, the second direction 2b is set at an angle with the first direction 2a, and the second cover 103 is provided with a third wiring groove 1202, which is connected to the installation groove 1401 and the second sink groove 1201. The third wiring groove 1202 in this example has at least an opening connecting the installation groove 1401 and the second sink groove 1201, so as to electrically connect the electrical components in the second sink groove 1201 with the optical machine 400. The second cover 103 in this example covers the first cover 102 along the second direction 2b, and the second direction 2b can be parallel to the axial direction of the installation groove 1401. The depth of the second sink groove 1201 in this example can be determined according to the number, shape and volume of the batteries 8 and/or circuit boards and/or magnets 53 and/or counterweights to be installed. Optionally, the second sink groove 1201 and the first sink groove 112 are arranged relative to each other to save space inside the first connecting part 101. The second sink groove 1201 in this example can provide sufficient space inside the near-eye display module 2 to facilitate the expansion of functional components of the near-eye display module 2 when necessary. In some application scenarios, for example, the adsorption force of a single magnetic suction on the battery may not be sufficient to support the near-eye display module 2 on the optical lens 12. In order to achieve greater suction clamping, a metal block or magnet can be added to the second sink groove 1201 to achieve a more stable magnetic clamping between the first connecting part 101 and the external magnet.

Please refer to FIG. 50, FIG. 51 and FIG. 55. In some examples, a through hole 114 is provided on the first connection part 101. One end of the through hole 114 is connected to the first electrical compartment 1110, and the other end is passed through the outer wall of the first connection part 101. The through hole 114 is used to allow the power supply device to move inside and outside the first connection part 101. The near-eye display module 2 also includes a sealing compartment cover 115, which is used to close the through hole 114. The through hole 114 in this example passes through the side wall of the first connection part 101 and is connected to the first electrical compartment 1110, so that the electrical device in the first electrical compartment 1110 can move to the outside of the first connection part 101 through the through hole 114. Taking the battery 8 as an example, the battery 8 can enter the first electrical compartment 1110 through the through hole 114 to facilitate the installation of the battery 8. The sealing compartment cover 115 is used to be installed on the first connection part 101 so as to close the through hole 114 when necessary. The sealed compartment cover 115 may be annular or have a mounting groove, and the battery 8 may be installed in the sealed compartment cover 115. Since the sealed compartment cover 115 surrounds the battery 8 in the entire circumference, the battery 8 can be put in and taken out. The sealed compartment cover 115 may also be provided with a gripping position so that it can be leaked relative to the first cover body 102, which is convenient for user operation. When the battery 8 is installed in the first electrical compartment 1110, the battery 8 can be embedded in the first electrical compartment 1110 through the through hole 114, and the through hole 114 is closed by the sealed compartment cover. The sealed compartment cover in this example may be consistent with the shape and size of the through hole 114, so that the sealed compartment cover can completely close the through hole 114; the sealed compartment cover in this example may also cover the outer surface of the first connecting portion 101 to cover the through hole 114 from the outer surface of the first connecting portion 101; the sealed compartment cover in this example may also be partially embedded in the through hole 114 and partially covered on the outer surface of the first connecting portion 101, so as to facilitate the fixing of the sealed compartment cover. Optionally, the first connecting portion 101 includes the first cover 102 and the second cover 103 described in any of the above examples, and the through hole 114 can be provided on the first cover 102 or the second cover 103. For the convenience of description, the following description is made by taking the through hole 114 provided on the first cover 102 as an example. In some examples, the first sinking groove 112 described in any of the above examples is provided on the first cover 102, and the first sinking groove 112 is used to install the pole piece, and the first sinking groove 112 and the through hole 114 can be staggered.

Please refer to Figures 51 and 54. In some examples, the near-eye display module 2 also includes an annular fixing portion 1151 connected to the sealing chamber cover 115. The annular fixing portion 1151 is used to be sleeved on the periphery of the electrical device, and the through hole 114 is also used for the annular fixing portion 1151 to move toward the outside of the first connecting portion 101. The annular fixing portion 1151 in this example is used to be sleeved on the periphery of the electrical device. When the sealing chamber cover 115 moves toward the outside of the first connecting portion 101 through the through hole 114, the annular fixing portion 1151 can drive the electrical device to move synchronously, thereby facilitating the disassembly and assembly of the electrical device. The annular fixing portion 1151 in this example can be integrally provided with the sealing chamber cover 115, or the annular fixing portion 1151 can be separately provided with the sealing chamber cover 115 and connected to each other. The annular fixing portion 1151 in this example can be a complete annular structure or a partially disconnected annular structure.

Please refer to Figures 50 and 51. In some examples, the through hole 114 is provided at one end of the first connection portion 101 away from the mounting seat 105, and the through hole 114 is used to allow the power device to move along the first direction 2a. In this example, since the mounting seat 105 is provided on one side of the first connection portion 101 along the first direction 2a, by allowing the electrical device to move along the first direction 2a via the through hole 114, the interference of the mounting seat 105 on the electrical device during assembly and disassembly of the electrical device can be reduced.

Please refer to FIG. 57 and FIG. 58 . In some examples, the first connection part 101 includes a first cover 102 and a second cover 103. The first cover 102 is connected to the mounting seat 105. The first cover 102 is provided with a first electrical compartment 1110. The first cover 102 has an opening connected to the first electrical compartment 1110 on one side away from the mounting seat 105. The second cover 103 covers the first cover 102. The second cover 103 covers the opening of the first cover 102 along the first direction 2a. The second cover 103 covers the side of the first cover 102 away from the mounting seat 105 to close the first electrical compartment 1110. The opening is used for electrical components such as the battery 8 to enter the first electrical compartment 1110. In this example, by covering the second cover 103 with the first cover 102 along the first direction 2a, the interference of the mounting seat 105 on the second cover 103 can be reduced, and the installation performance of the first cover 102 and the second cover 103 can be improved. In some examples, a second sink 1201 can be opened at a position corresponding to the first electrical compartment 1110 on the second cover 103, and when the first cover 102 and the second cover 103 cover each other to form the first connecting portion 101, the electrical device can be partially located in the second sink 1201. Optionally, the second sink 1201 can also be used to install other functional modules such as circuit boards and magnets. In some examples, the first wiring groove 113 described in any of the above examples is opened on the first cover 102 to facilitate the connection between the conductive module of the optical machine 400 and the electrical device; the first wiring groove 113 can be located on the side of the first cover 102 away from the second cover 103. In some examples, the first sinking groove 112 described in any of the above examples may also be provided on the first cover body 102 , and the first sinking groove 112 may be connected to the first wiring groove 113 .

Please refer to FIG. 52 and FIG. 58 . In some examples, a protrusion 104 is provided on one side of the first connection portion 101 close to the mounting seat 105. There are two protrusions 104, which are arranged at intervals. The mounting seat 105 is connected to the two protrusions 104, respectively. The two protrusions 104 and the mounting seat 105 enclose a mounting groove 1401. In this example, the two protrusions 104 are arranged at intervals so that the optical machine 400 can be partially located between the two protrusions 104. The mounting seat 105 is connected to the two protrusions 104, respectively, and encloses the two protrusions 104 to form the mounting groove 1401. In some examples, a groove is provided on one side of the mounting seat 105 facing the first connection portion 101, and the groove of the mounting seat 105 and the gap between the two protrusions 104 enclose the mounting groove 1401. The protrusion 104 in this example can be used as a connection part between the first connection part 101 and the mounting seat 105 to improve the firmness of the connection part between the first connection part 101 and the mounting seat 105. When wiring the optical machine 400, optionally, a first wire hole 15 connecting the mounting groove 1401 and the first electrical compartment 1110 is opened on the first connection part 101, and the first wire hole 15 is used to accommodate the conductive module of the optical machine 400; the end of the first wire hole 15 away from the first electrical compartment 1110 is located between the two protrusions 104. Since the two protrusions 104 are arranged at intervals from each other, the first wire hole 15 can be hidden between the two protrusions 104 to reduce the exposure of the conductive module of the optical machine 400 component, thereby reducing the problem of water ingress into the near-eye display module 2.

In some examples, one of the mounting seat 105 and the protrusion 104 is provided with a clamping member 1402, and the other is provided with a slot 1301, and the clamping member 1402 is clamped in the slot 1301. The clamping member 1402 and the slot 1301 in this example are adapted to each other so that the mounting seat 105 is mounted on the protrusion 104. For the convenience of description, the following is an example of the protrusion 104 being provided with the slot 1301 and the mounting seat 105 being provided with the clamping member 1402. Optionally, the slot 1301 in this example can be a straight slot, a T-slot, or a slot structure of other shapes. Optionally, the clamping member 1402 in this example can be provided integrally with the mounting seat 105, or can be provided separately from the mounting seat 105 and connected to the mounting seat 105.

57 and 58, in some examples, the first connection portion 101 includes the first cover 102 and the second cover 103 described in any of the above examples, and the second cover 103 covers the first cover 102 along the first direction 2a. The protrusion 104 is provided on one side of the first cover 102 away from the second cover 103.

Please refer to Figures 50 to 56. In some examples, the first connection portion 101 includes the first cover 102 and the second cover 103 described in any of the above examples, and the second cover 103 covers the first cover 102 along the second direction 2b. The protrusion 104 is provided at one end of the first cover 102 or the second cover 103 close to the mounting seat 105.

Please refer to Figures 50 to 56. In some examples, the first connection portion 101 includes the first cover 102 and the second cover 103 described in any of the above examples, and the second cover 103 covers the first cover 102 along the second direction 2b. The first cover 102 and the second cover 103 are respectively provided with the above-mentioned protrusions 104 at one end close to the mounting seat 105, and the clamping member 1402 on the mounting seat 105 is clamped on the protrusions 104 of the first cover 102 and the second cover 103 at the same time. Optionally, the clamping member 1402 can be in a T-shaped structure, and the protrusions 104 on the first cover body 102 and the second cover body 103 are respectively provided with clamping grooves 1301. When the second cover body 103 is covered on the first cover body 102, the clamping grooves 1301 on the first cover body 102 and the second cover body 103 are enclosed to form a T-shaped groove, and the clamping member 1402 is clamped in the T-shaped groove to block the movement of the mounting seat relative to the first connecting portion 101 along the first direction 2a.

Please refer to Figures 50 to 54. In some examples, the near-eye display module 2 also includes a fixed base 600, which is installed in the installation groove 1401. The fixed base 600 is provided with a fixed groove 610 for installing the optical machine 400; the fixed base 600 is provided with a second wire hole 620, and the second wire hole 620 is used to accommodate the conductive module of the optical machine 400; one end of the second wire hole 620 is connected to the fixed groove 610, and the other end passes through the outer wall of the fixed base 600.

The fixing seat 600 is used to install the optical machine 400 on the mounting seat 105, and the fixing seat 600 can also protect the optical machine 400. The fixing groove 610 can be a through groove or a sunken groove opened on the fixing seat 600. The fixing seat 600 in this example can be fixedly connected to the mounting seat 105, and the fixing seat 600 can also be movably installed on the mounting seat 105. The second wire hole 620 serves as a channel for accommodating the conductive module of the optical machine 400 to facilitate the wiring of the optical machine 400.

In some examples, the first connection portion 101 is provided with a first wire passing hole 15 as described in any of the above examples, and the second wire passing hole 620 can be connected to the first wire passing hole 15 .

In some examples, the axial direction of the second wire-passing hole 620 is set at an angle to the axial direction of the fixing groove 610. The second wire-passing hole 620 in this example is used for the conductive module of the optical machine 400 to pass through, so as to facilitate the connection of the conductive module of the optical machine 400 with the electrical components in the first electrical compartment 1110. The shape of the fixing groove 610 in this example can be adapted to the shape of the optical machine 400, and the fixing groove 610 has an opening. The opening of the fixing groove 610 can be set on the same side as the light-emitting side of the optical machine 400, and the axial direction of the fixing groove 610 is set at an angle to the first direction 2a. Optionally, the axial direction of the fixing groove 610 can be perpendicular to the plane where the opening of the fixing groove 610 is located. The axial direction of the second wire-passing hole 620 is set at an angle to the axial direction of the fixing groove 610, which means that the axial direction of the second wire-passing hole 620 is not parallel to nor coincident with the axial direction of the fixing groove 610. In this example, by adopting the above arrangement, the conductive module of the optical engine 400 can be led out from the side of the fixing seat 600 to shorten the distance between the conductive module of the optical engine 400 and the first electrical compartment 1110. Since the conductive module can be led out from the side of the fixing seat 600, the fixing groove 610 can be set as a sink structure in this example to facilitate sealing between the optical engine 400 and the inner wall surface of the fixing groove 610.

In some examples, the fixing base 600 is provided with a second electrical compartment 630, and the second wire hole 620 is connected to the fixing groove 610 through the second electrical compartment 630. The second electrical compartment 630 in this example can be used to accommodate structures such as an optical machine and a circuit board, so that the circuit module of the optical machine 400 can be built into the fixing base 600, thereby simplifying the structure of the near-eye display module 2, improving the compactness of the product, facilitating the packaging of the product, and facilitating the functional expansion of the near-eye display module 2. The second electrical compartment 630 in this example is connected to the second wire hole 620, which can facilitate the conductive module and circuit board of the optical machine 400 to be led out through the second wire hole 620 for easy wiring.

Please refer to FIG. 52 and FIG. 54. In some examples, one of the outer wall surface of the fixing seat 600 and the inner wall surface of the mounting groove 1401 is a convex arc. The mounting groove 1401 is used to allow the fixed seat 600 to rotate inside to adjust the light output angle of the optical machine 400. The convex curved surface and the concave curved surface in this example are adapted to each other, which means that the convex curved surface can fit the concave curved surface so that the fixed seat 600 can rotate relatively in the mounting groove 1401. When the fixed seat 600 rotates relative to the mounting seat 105, the optical machine 400 on the fixed seat 600 can also rotate synchronously, so that the light output angle of the optical machine 400 can change synchronously. In this example, the position of the optical machine 400 relative to the field of view of the human eye is adjusted so as to accurately adjust the position of the optical machine 400, so as to meet the needs of different people with different pupil distances or field of view ranges, and to meet the viewing needs and preferences of different users. On the other hand, flexible position testing can also be provided in the early research and development to achieve the expected design effect.

The outer surface of the fixing seat 600 in this example may be at least partially spherical, and the inner wall surface of the mounting groove 1401 may be a concave arc surface, so that the fixing seat 600 can rotate relative to the mounting seat 105 in the mounting groove 1401. Optionally, the outer surface of the fixing seat 600 in this example may also be a concave arc surface, and the inner wall surface of the mounting groove 1401 may be a convex arc surface, so that the fixing seat 600 can rotate relative to the mounting seat 105 in the mounting groove 1401.

Based on the above-mentioned near-eye display module 2, the present application further proposes an example of a near-eye display device, which is used for an optical lens 12, and includes a near-eye display module 2 as in any of the above-mentioned examples, and a first connection portion 101 of the near-eye display module 2 is connected to the optical lens 12. The first connection portion 101 in this example can be fixedly connected to the optical lens 12, or can be detachably connected to the optical lens 12.

It can be understood that the examples of the near-eye display device of the present application include the near-eye display device in any of the above examples, and also include the technical effects in any of the above examples, so they will not be repeated here.

Please refer to Figures 49 and 59. In some examples, the first connecting portion 101 of the near-eye display module 2 is connected to the first side of the optical lens 12; the near-eye display device also includes a second connecting portion 500, which is arranged opposite to the first connecting portion 101 and is used to connect to the second side of the optical lens 12, and the first side and the second side of the optical lens 12 are two sides arranged oppositely; the first connecting portion 101 and the second connecting portion 500 are used to clamp the lenses to each other and allow the mounting seat 105 to move on the lens to adjust the position of the optical machine 400 relative to the lens.

In some examples, the second connection part 500 may be a component connected and fixed to the first connection part, for example, the first connection part 101 may be fixed to the second connection part 500 by bonding, clamping, threading, etc., and the first connection part 101 may also be connected to the second connection part 500 through an intermediate connection member. In some examples, the first connection part 101 and the second connection part 500 may be independent components, and the first connection part 101 may cooperate with the second connection part 500 to act as a clamping or adsorption element.

Please refer to Figure 59. In some examples, the second connecting part 500 is at least partially made of magnetic material. The second connecting part 500 in this example can be made of magnetic material as a whole or partially. As shown in Figures 49 to 59, the second connecting part 500 includes a sleeve 510 and a magnet 53 embedded in the sleeve 510. Since structures such as the battery 8 can be adsorbed by the magnet 53, when the first connecting part 101 and the second connecting part 500 are respectively arranged on both sides of the optical lens 12, the second connecting part 500 can adsorb the first connecting part 101 to a preset position on the optical lens 12. In some examples, the first connecting part 101 includes the first cover body and the second cover body in any of the above examples, and a second sink groove is provided on the second cover body, and the second sink groove can be used to install a magnet to improve the adsorption performance of the first connecting part and the second connecting part.

In some examples, a protective member 520 is provided on the second connection portion 500, and the protective member 520 may be a protective film or a protective cover, and the protective member 520 is used to block between the magnet 53 and the optical lens 12 to reduce the wear on the optical lens 12. Optionally, an opening is provided at one end of the sleeve 510 for the magnet 53 to pass through and be embedded in the sleeve 510, and the protective member 520 includes a protective layer 523 and a fixing layer 525 connected to the protective layer 523, and the protective layer 523 covers the opening of the sleeve 510 to block between the magnet 53 and the optical lens 12, and the fixing layer 525 is disposed inside and outside the sleeve 510 to improve the sealing performance of the second connection portion 500.

Please refer to FIG. 49 . In some examples, the first connection part 101 has a fixing surface 1203, and the fixing surface 1203 is arranged opposite to the second connection part 500; the fixing surface 1203 is arranged on the same side as the light-emitting side of the optical machine 400; the fixing surface 1203 in this example can be a surface on the first connection part 101. The fixing surface 1203 is arranged on the same side as the light-emitting side of the optical machine 400. When the near-eye display device is installed, the near-eye display module 2 is located on the outside of the optical lens 12, and the second connection part 500 can be located on the inside of the optical lens 12 to reduce the visual intrusion of the near-eye display device to the user and improve the comfort of the product.

In some examples, the difference from the previous example is that the fixing surface 1203 is arranged away from the light-emitting side of the optical engine 400. The fixing surface 1203 in this example can be a surface on the first connecting portion 101. The fixing surface 1203 is arranged on the opposite side of the light-emitting side of the optical engine 400. When the near-eye display device is installed, the near-eye display module 2 is located on the inner side of the optical lens 12, and the second connecting portion 500 can be located on the outer side of the optical lens 12.

Based on the above-mentioned examples of near-eye display devices, the present application also proposes an example of a wearable device, which may be glasses for myopia or hyperopia, sports, eye protection, or a helmet or smart glasses, etc., including a near-eye display module or device as in any of the above-mentioned examples.

Since head-mounted devices are often worn for a long time, smaller and lighter head-mounted devices are the goals that major manufacturers are constantly pursuing. Existing modules such as prism technology are often relatively heavy and large in size, while the optical efficiency of optical waveguide technology is low. The above-mentioned existing technologies will greatly change the appearance, structural form, etc. of the original traditional ordinary glasses or helmets such as myopia, hyperopia, eye protection, sunglasses, etc. The existing technology solutions are extremely difficult to combine with existing traditional glasses, helmets and other head-mounted devices. In addition, as a device that needs to be transmitted to the retina of the human eye, taking the head-mounted device as an example, it is very important that the content in the visual field of the retina of the human eye can be presented clearly and completely. In the case of combining virtual and real situations, obtaining relatively more virtual information content in the visual field has become an increasingly important functional requirement. Better quality images and higher light efficiency are also very important. More light, small size, and compatibility with various head-mounted devices have become problems that need to be solved urgently. The embodiment of the present application provides an optical module 100', which can be applied to various related embodiments, and the following are detailed descriptions.

The optical module 100' can be applied to a near-eye display device 200', for example, it can be applied to augmented reality AR (Augmented Reality), virtual reality VR (Virtual Reality), mixed reality MR (Mixed Reality) and extended reality XR (Extended Reality), goggles, smart glasses, myopia glasses, hyperopia glasses, sports glasses, contact lenses, helmets or other related near-eye display devices. Referring to Figures 60-74, the optical module 100' includes a substrate 10', including a first end 12' and a second end 14' opposite to each other, wherein the substrate 10' can be solid, for example, the material used can be a transparent or light-transmitting hard cuttable material, for example, PMMA (polymethyl methacrylate), PC (polycarbonate) plastic, resin, glass, etc.; for example, it can be a regular shape such as a cylindrical, prism or truncated cone, and of course, it can also be an irregular shape. In other embodiments, the substrate 10' may also have a hollow structure. For example, it may be formed by at least two groups of thin walls bonded together with optical glue. The center may be hollow, and the first reflection surface 20', the second reflection surface 30, the incident surface 40, the exit surface 50, etc. may be formed on the thin walls.

A first reflective surface 20', disposed at the first end 12' of the base 10', and configured to allow reflection of light;

The second reflective surface 30 is disposed at the second end 14' of the substrate 10' and is configured to receive the light reflected from the first reflective surface 20' and reflect it again; it can be understood that the first end 12' and the second end 14' can be opposite ends. The first reflective surface 20' and the second reflective surface 30 can be provided with a reflective material, which can be a reflective material such as a metal or a metal alloy, such as aluminum, silver, or a mixture of aluminum and silver.

An incident surface 40 is disposed at the second end 14' of the substrate 10' and is surrounded by the second reflecting surface 30;

An exit surface 50 is disposed at the first end 12' of the base 10' and surrounds the first reflection surface 20'; the size of the exit surface 50 may be the same as the size of the second reflection window 1312, and in other embodiments, the size of the exit surface 50 may be different from the size of the second reflection window 1312;

The annular side surface 60 has one end connected to the second reflection surface 30 and the other end connected to the emission surface 50 .

Among them, the incident surface 40 and the exit surface 50 are aspherical surfaces, spherical surfaces, free-form surfaces, or a combination thereof. The incident surface 40 is configured to receive light L from the image of the microdisplay 80. The light enters the substrate 10' through the non-planar (but non-spherical, spherical, free-form surfaces, or a combination thereof) incident surface 40, is reflected by the first reflection surface 20', then reflected by the second reflection surface 3, and leaves the substrate 10' through the non-planar exit surface 50. The microdisplay 80, for example, can be the technology or combination described in the above-mentioned related embodiments, which will not be repeated here. In some embodiments, the optical module can be combined with existing ordinary glasses such as myopia, hyperopia, eye protection, sports glasses, etc. to achieve the function of enhanced display, so that It is understood that the black or shaded areas of the reflective surfaces (such as the first reflective surface 20', the second reflective surface 30) in the relevant drawings (such as 1-2, 8-11, etc.) of the present application only illustrate that they have a reflective layer, and do not represent the actual thickness design.

It can be understood that in the prior art, in order to better enable the microdisplay 80 to fit with the incident surface 40 (for example, bonding with optical glue, etc.), the incident surface 40 is generally a plane, and the integrity of the entire module is ensured during subsequent packaging (for example, an overall regular cylinder, etc.), and the exit surface 50 is also often designed to be a plane. However, the research of the present application found that based on the size requirements in product design, such as miniaturization, lightweight, and combination with existing glasses, the sizes of the incident surface, the first and second reflecting surfaces, and the exit surface cannot be increased arbitrarily. At this time, the optical module is limited to a small size within a fixed range, such as less than 5mm*5mm*5mm or even smaller. The present application changes the original incident surface and the exit surface from a plane to a non-spherical surface, a spherical surface, a free-form surface, or a combination thereof, and fully redesigns the shape structure of each surface, so that the image light L of the microdisplay 80 enters from the non-planar incident surface 40, wherein the incident surface 40 is a non-spherical surface, a spherical surface, a free-form surface, or a combination thereof, and then enters the substrate. 10' to the first reflection surface 20', then reflected to the second reflection surface 30, and finally leave the substrate 10' through the non-planar exit surface 50. The exit surface 50 can be one or a combination of a non-spherical surface, a spherical surface, and a free-form surface. The light L (Figure 67) from the edge of the microdisplay 80 or near the edge position is more likely to move toward the optical axis, while the light L from the edge of the microdisplay 80 or near the edge position of the existing planar incident surface and exit surface cannot move toward the direction close to the optical axis, thereby effectively improving the utilization rate of the light from the edge of the microdisplay 80 or near the edge position, effectively reducing light loss, and effectively improving the light effect. In addition, the light in the prior art is not easy to move toward the optical axis, resulting in a small field of view angle, while the present application makes full use of the light L at the center and the edge, so that the field of view angle is effectively improved. On the other hand, the folded optical path effectively reduces the size of the entire optical system, making the entire module more portable, and the shorter reflection path reduces light loss and effectively improves the light effect, and the overall imaging quality is better.

In some embodiments, the lateral dimension of the annular side surface 60 tends to decrease along the line direction from the second reflective surface 30 to the exit surface 50, that is, the maximum outer contour dimension of the exit surface 50 can be smaller than the maximum outer contour dimension of the second reflective surface 30, thereby ensuring that the light L entering from the edge of the incident surface 40 from the micro display 80 is effectively contracted to the position of the central optical axis Z, further effectively improving the field of view angle and improving the image quality.

In some embodiments, referring to FIG. 62 , the first reflection surface 20 ′ and the second reflection surface 30 are one or a combination of total internal reflection surfaces of aspherical, spherical, and free-form surfaces. It can be understood that such reflection can effectively reduce optical loss and improve light efficiency and imaging quality. Among them, the incident surface 40 includes a first section and a second section from the center to the periphery, the first section is bent toward the first direction of the optical axis Z, the first direction can be the positive direction of the optical axis Z (light emitting direction), the second section is bent toward the second direction of the optical axis Z opposite to the first direction, the second direction can be the negative direction of the optical axis Z (away from the light emitting direction), the first reflection surface 20 ′, the second reflection surface 30, and the exit surface 50 are bent toward the first direction of the optical axis Z, that is, bent toward the positive direction of the optical axis Z. It can be understood that the first section of the incident surface 40 corresponds to an area of the microdisplay 80 that is the center or close to the center of the microdisplay 80, and the second section corresponds to an area of the microdisplay 80 that is the edge or close to the edge (relatively far from the center) of the microdisplay 80. Therefore, the light at the edge or close to the edge of the microdisplay 80 can be reflected as much as possible to the edge or close to the edge of the first reflecting surface 20', and then further reflected by the first reflecting surface 20' to the edge or close to the edge of the second reflecting surface 30. Finally, the non-planar exit surface 50 makes the light move closer to the center of the optical axis Z, thereby effectively improving the utilization rate of the light at the edge or close to the edge of the microdisplay 80, and improving the lighting effect and imaging quality. The first reflecting surface 20', the second reflecting surface 30, the exit surface 50 and the incident surface 40 may all adopt a non-planar design, for example, they may be a non-spherical surface, a spherical surface, a free-form surface or a combination thereof, but their bending directions may be different, wherein the first reflecting surface 20', the second reflecting surface 30 and the exit surface 50 may be the same, as described in Table 1 below, the sagittal values of the first reflecting surface 20', the second reflecting surface 30 and the exit surface 50 are positive values, the sagittal value of the incident surface 40 is positive in the range of 0-0.6mm, and is negative in the range of 0.65-0.85mm, it can be seen that the incident surface 40 is first bent toward the positive direction of the optical axis and then toward the negative direction of the optical axis, and the design of other surfaces can effectively increase the field of view of the exiting light, improve the light effect, and achieve better image quality.

In some embodiments, the second reflecting surface 30, the exit surface 50, the incident surface 40 and the first reflecting surface 20' have a projected contour shape on the plane where the vertical optical axis Z is located. The contour shape can be a circle, an ellipse, a polygon, a rounded rectangle, a trapezoid, or other geometric figures. The plane where the vertical optical axis Z is located can be, for example, a cross section, or it can be a plane viewed from the first end 12' or the second end 14' or a corresponding top view or bottom view. Among them, the contour shapes of the incident surface 40 and the first reflecting surface 20' can be similar to each other, and the contour shapes of the second reflecting surface 30 and the exit surface 50 can be similar to each other. In other embodiments, as shown in Figure 68, the contour shape of the incident surface 40 can also be similar to the contour shape of the second reflecting surface 30; the contour shape of the exit surface 50 can also be similar to the contour shape of the first reflecting surface 20', for example, both are regular polygons, etc. It can be understood that the geometric shape of the outer contour of the relevant surface can be flexibly designed according to the outer contour of the microdisplay 80 or the whole to meet the assembly requirements of different sizes and shapes and fully obtain the light from the microdisplay 80. On the other hand, the second reflection surface 30, the exit surface 50, the incident surface 40 and the first reflection surface 20' can all be the same, for example, they are all one of the circular, elliptical or regular polygonal contours, so that the light of the microdisplay 80 can be fully reflected and utilized, achieving better imaging quality and light extraction efficiency.

In some embodiments, referring to Figures 60, 62-64, the first reflecting surface 20' includes a first vertex O2, the second reflecting surface 30 includes a second vertex O3, the incident surface 40 includes a third vertex O4, and the exit surface 50 includes a fourth vertex O5; the first vertex O2, the second vertex O3, the third vertex O4 and the fourth vertex O5 are located on the optical axis Z, and the incident surface 40, the first reflecting surface 20', the second reflecting surface 30 and the exit surface 50 are symmetrically designed relative to the cross-section where the optical axis is located to ensure that the optical module 100' is not eccentric, that is, the optical path area on one side will not be too large or too small than the optical path area on the other side. It can be understood that the second vertex Q3 can be the point formed by the final intersection of the curved surface of the second reflecting surface 30 extended relative to the center of the incident surface 40. The dotted line in Figure 62(b) indicates that the extension toward the center intersects to form the second vertex Q3. Similarly, the fourth vertex Q5 can be the point formed by the final intersection of the curved surface of the exit surface 50 extended relative to the center of the first reflecting surface 20'. The dotted line in Figure 62(d) indicates that the extension toward the center intersects to form the fourth vertex Q5. It can be understood that the vertices of the second reflection surface 30, the exit surface 50, the incident surface 40 and the first reflection surface 20' are all located on the same optical axis Z, which can ensure the symmetry of the overall light path. The second reflection surface 30, the exit surface 50, the incident surface 40 and the first reflection surface 20' can be designed symmetrically relative to the optical axis Z, or the above-mentioned surfaces can be designed symmetrically relative to the plane passing through the optical axis Z. The second reflection surface 30, the exit surface 50, the incident surface 40 and the first reflection surface 20' are coaxially designed, which can ensure that the entire light path is not eccentric (deviating from the optical axis Z, etc.), ensuring clearer imaging and higher imaging quality.

In some embodiments, referring to Figures 60, 63 and 64, the incident surface 40 and the second reflective surface 30 intersect at a first intersection line 122', and the exit surface 50 and the first reflective surface 20' intersect at a second intersection line 124'. The first intersection line 122' and the second intersection line 124' here can be understood as the intersection of different surfaces. For ease of understanding, the figure uses dotted lines to indicate the shape of the intersection line. The shape of the intersection line can be determined by the outer contour shape of the incident surface 40 and the first reflective surface 20', or the shape of the intersection line can be determined by the inner contour shape of the second reflective surface 30 or the inner contour shape of the exit surface 50. For example, the intersection lines 122' and 124' can be circles, ellipses, polygons, etc. The shapes of the incident surface 40 and the first reflective surface 20' can be circles, ellipses, polygons, etc. In some embodiments, the distance between the first vertex O2 and the third vertex O4 is not greater than 2.8 mm, that is, the central thickness of the optical module 100', for example, the central thickness along the optical axis Z is not greater than 2.8 mm, for example, it can be 2.8 mm, 2.5 mm, 2 mm, 1.8 mm, 1.6 mm, etc. In other embodiments, this thickness can also be understood as the average thickness between the exit surface 50 and the incident surface 40, or the average thickness of the entire substrate 10', etc.; the first intersection line 122' is relative to the second vertex The distance between O3 and the line connecting the third vertex O4 is not greater than 1.35 mm, that is, the radius of the incident surface 40 is not greater than 1.35 mm, for example, it can be 1.35 mm, 1.2 mm, 1 mm, 0.8 mm, 0.6 mm, etc. The distance between the second intersection line 124' and the line connecting the first vertex O2 and the fourth vertex O5 is not greater than 1.5 mm, that is, the radius of the first reflecting surface 20' is not greater than 1.5 mm, for example, it can be 1.5 mm, 1.3 mm, 1 mm, 0.85 mm, 0.75 mm, etc. In some embodiments, the radius (vertical distance from the outer contour to the vertex) corresponding to the annular side surface 60, the light emitting surface 50, and the second reflecting surface 30 may be no greater than 3 mm, that is, the radius of the annular side surface 60 is no greater than 3 mm, the radius of the light emitting surface 50 is no greater than 3 mm, and the radius of the second reflecting surface 30 is no greater than 3 mm, for example, it can be 3 mm, 2.8 mm, 2.5 mm, 2 mm, etc.; the distance from the second intersection line 124' to the edge of the emission surface 50 can have the same value in a circumferential direction, for example, the width value of the emission surface 50 is consistent along the circumference of the first reflecting surface 20'; wherein, the distance from the second intersection line 124' to the edge of the emission surface 50 The distance is greater than 0 and less than or equal to 1.6mm, for example, it can be 1mm, 1.5mm, 0.8, 0.7mm, etc. It can be understood that the above parameters should not contradict each other when combined with each other. The above radius can be the radius parameter of the projection shape of each face on a plane that is a circle, etc. In other embodiments, if the projection shape of the above-mentioned related faces on a plane is not a circle, such as a regular polygon, an ellipse or other regular figures, etc., the above radius can also be described as the maximum radius it has. For example, taking an ellipse as an example, its long side can be understood as the radius described above. The size design of the embodiment of the present application can make the entire optical module have a smaller volume and weight, and does not affect the light path transmission efficiency, which is conducive to mutual adaptation with the frame or lens of the existing near-eye display device (such as near and far vision, eye protection, sports, smart glasses, helmets), and there is no need to significantly change the structural design of the existing display device, etc., which can achieve the compatibility of enhanced display and traditional display devices, improve the portability of the optical module and enrich the application scenarios.

In some embodiments, as shown in FIG. 73 , light from the microdisplay passes through the optical module from the pupil of the eyeball 300 to the retina to form an image 310. The positional structural relationship of the relevant components (e.g., the eyeball 300, the image 310, etc.) in FIG. 73 is only an exemplary description diagram for convenience of calculation and understanding. The following calculation process can be performed in one dimension, and some approximations such as small angles are performed to illustrate various principles, wherein the small angle approximation is: θ≈sinθ≈tanθ. The above calculation can be directly extended to two dimensions, and more accurate calculations can be performed. The field of view FOV (Field Of View) can be finally imaged by the optical module, from the retinal end, according to the optical extension E _eye calculation formula:

In some embodiments, the lower limit of the field of view FOV can be obtained according to the derivation of the above formula {1}: in,

Among them, from the optical module side, according to the optical extension E _eye calculation formula:

In some embodiments, the upper limit of the field of view FOV can be obtained according to the derivation of the above formula {3}:

In the above formula, FOV is the field of view, n _eye is the refractive index of the eyeball, D _p is the diameter of the pupil, θ _eye is the angle at which a point on the retina receives light, I _eye is the size of the retinal image 310, D _eye is the diameter of the eyeball, f _eye is the focal length of the eyeball, θ _m is the effective emission angle of the micro display, Dm is the maximum outer diameter of the optical module (i.e., the maximum outer diameter of one of the annular side surface 60, the light emitting surface 50, and the second reflecting surface 30), S ₁ is the diameter of the incident surface 40 (i.e., the distance between the first intersection line 122' and the line connecting the second vertex O3 and the third vertex O4). twice), _S2 is the diameter of the first reflective surface 20' (i.e., twice the distance of the second intersection line 124' relative to the line connecting the first vertex O2 and the fourth vertex O5), _Lm is the thickness of the substrate 10', and can also be the center thickness of the optical axis or the average thickness of the substrate 10', or the average thickness from the micro display to the first reflective surface 20', etc.

It can be understood that the upper limit of the field of view angle is often more determined by the optical module parameters, and in actual design, the size of the optical module is generally restricted more strictly (or fixed), such as having a small size and being compatible with traditional head-mounted devices. Therefore, the lower limit of the field of view angle that can be met is often more important and can be designed according to actual needs. In the formula for the lower limit of the field of view angle FOV, the first term is the double integral of the angle over the image size, which exists as an implicit expression in the design of the optical module as a whole, and the incident surface 40 and the exit surface 50 are designed as non-planar surfaces, wherein the non-planar surface can be one or a combination of a non-spherical surface, a spherical surface, and a free-form surface. The non-planar surface can increase the double integral value, thereby increasing the lower limit (i.e., the minimum value) of the field of view angle of the optical module. It can be seen that when the existing size and related parameters such as the eyeball are limited, the field of view angle is difficult to change within the limited size. Therefore, the present application changes the original planar design to a non-planar design by changing the shapes of the incident surface 40 and the exit surface 50, so that the light from the relative edge of the micro display can enter the first reflection surface 20' and be projected to the outside of the substrate 10' through the exit surface 50. In terms of effect, the light from the edge of the micro display is more fully utilized, and a projection light with a larger angle relative to the optical axis Z can be formed, thereby forming a larger field of view angle, better lighting effect, and better imaging quality.

In some embodiments, the aspherical surface, spherical surface, and free-form surface of the incident surface 40, the first reflecting surface 20', the second reflecting surface 30, and the exit surface 50 can be described by a polynomial vector height equation, for example, calculated using Zernike polynomials, and the polynomial vector height equation can be:

in,

Z is the surface height, that is, the distance from the vertex (such as s2' in Figure 62c), h is the radial distance (the distance from the curved surface to the optical axis, such as h2' in 3c), c is the curvature of the curved surface, k is the coefficient, and A, B, C, and D are the corresponding multi-order coefficients respectively; among them, when k, A, B, C, and D are zero, it can be the calculation formula of the height of the sphere; as a free-form surface, multiple reference points can be taken as analytical expressions to obtain; Figure 62 shows the contour schematic diagrams of each related surface, among which Figure 62(a) is the contour schematic diagram of the incident surface 40, Figure 62(b) is the contour schematic diagram of the second reflecting surface 30, Figure 62(c) is the contour schematic diagram of the first reflecting surface 20', and Figure 62(d) is the contour schematic diagram of the exit surface 50. Outline schematic diagram; taking the outline schematic diagram of the first reflecting surface 20' in Figure 62 (c) as an example, the first reflecting surface 20' has a vertex O2 and is bent about two orthogonal axes (for example, the h-Z axis in the figure), the first reflecting surface 20' has at least one first position 212' having a radial distance h1 from the Z axis (optical axis) passing through the vertex O2, and having a displacement s2' relative to the h axis at the vertex O2. The following Table 1 exemplarily describes the relevant parameters of some surfaces (part of them are selected for example), where h4-Z4 correspond to the parameters of the incident surface 40, h2-Z2 correspond to the parameters of the first reflecting surface 20', h3-Z3 correspond to the parameters of the second reflecting surface 30, and h5-Z5 correspond to the parameters of the exit surface 50.

Table 1

In some embodiments, in combination with reference to Figures 65-66, the optical module also includes an outer edge 70, which is arranged on the annular side surface 60. The height of the outer edge 70 can be higher than the annular side surface 60, wherein the circumference of the outer edge 70 can be a full circle, or can be spaced, etc. The extension of the outer edge 70 in the optical axis Z direction may not exceed the annular side surface 60, that is, the thickness of the outer edge 70 may not exceed the height of the annular side surface 69, so the outer edge 70 can be a relatively thin protrusion, or the outer edge 70 can also be a thread or other clip-on structure, etc. In some embodiments, the outer edge 70 can be located at one end close to the exit surface 50, and the outer edge 70 is configured to be assembled with an external mechanism. The external mechanism can be, for example, a clamp, a jig, etc., so that the optical module can be easily clamped or transported to avoid damage to the substrate 10' or other surfaces, or the external mechanism can also be a related shell to which the optical module needs to be assembled. For example, the corresponding assembly shell is provided with a fixing groove, etc., and the entire optical module can be positioned or fixed by the outer edge 70.

In some embodiments, referring to Figures 65-66, the outer edge 70 is also provided with at least one straight edge 72. For example, if the outer edge 70 is circular, the straight edge 72 may be tangent to the outer edge 70. In other embodiments, the outer edge 70 may also be provided with two straight edges 72 that are parallel to each other, or more straight edges, etc. Of course, if the outer edge itself can be a polygon, the straight edge of the polygon can be a straight edge 72, and the straight edge 72 is configured to cooperate with an external mechanism to position the base 10' for rotation adjustment. It can be understood that the external mechanism can be, for example, a clamp, a jig, etc., and the parallel straight edges can better position or clamp the base 10'. In other embodiments, the external mechanism can be, for example, an assembly shell. Sometimes, it is necessary to rotate the optical module as a whole in the assembly shell, for example, to adjust the light output angle of the optical module, etc. At this time, the straight edge 72 can play a role in foolproofing and positioning.

In some embodiments, as shown in FIG61 , the optical module may further include a shielding layer 66, which covers the annular side surface 60 and is configured to block the light of the micro display 80 from being transmitted from the annular side surface 60 to the outside of the substrate 10 '. The shielding layer 66 may be a coating or material such as black epoxy resin, black silicone rubber, carbon black, nickel black, black chrome or Vanta black, and may also be a light-proof sealing sleeve, etc. The shielding layer 66 can ensure that the light is emitted from the exit surface 50 and leaves the substrate 10 ', but not from the annular side surface 60, thereby effectively improving the optical efficiency.

In some embodiments, referring to FIGS. 68-71 , the annular side surface 60 further includes a first annular surface 62 and a second annular surface 64. The circumferential dimension of the first annular surface 62 is smaller than that of the second annular surface 64. The first end of the first annular surface 62 is connected to the first reflection surface 20 ′, the second end of the first annular surface 62 is connected to the first end of the exit surface 50, the second end of the exit surface 50 is connected to the first end of the second annular surface 64, and the second end of the second annular surface 64 is connected to the second reflection surface 30. The first end and the second end of the first annular surface 62 are opposite ends, and the first end and the second end of the second annular surface 64 are opposite ends. It can be understood that the exit surface 50 is located between the first annular surface 62 and the second annular surface 64 of different sizes. In some embodiments, the first annular surface 62 and the second annular surface 64 may have a tendency to gradually shrink along the positive direction of the optical axis Z, so as to effectively collect light. It can be understood that since the first annular surface 62 and the second annular surface 64 have a large difference in transverse dimensions to form a stepped structure, the overall size and weight can be further reduced.

In some embodiments, in combination with Figure 70, the shielding layer 66 located on the second annular surface 64 extends from the edge of the exit surface 50 along the direction of the principle exit surface 50, and the end surface of the shielding layer 66 located on the second annular surface 64 is not higher than the end surface of the first reflection surface 20'. The shielding layer 66 located on the second annular surface 64 is long enough to block the light from entering the outside from the edge of the exit surface 50 too early, and can also reduce the formation of stray light.

In some embodiments, as shown in FIG. 72 , the optical module further includes a matte wall 90, which may be made of a light-impermeable material (e.g., the same material as the shielding layer 66 described above) or a material capable of blocking specific wavelengths, etc. The substrate 10', the first reflection surface 20', the second reflection surface 30, and the exit surface 50 each include at least two groups, and the matte wall 90 is connected between two adjacent substrates 10', for example, between the annular side surfaces 60 of two adjacent optical modules, and the matte wall 90 is configured to block the light of one substrate 10' from entering the other adjacent substrate 10'. It can be understood that in the two groups of optical modules, the substrates 10' and the substrates 10' are connected as a whole, wherein each optical module is provided with a corresponding microdisplay 80, that is, a microdisplay is provided for a single incident surface, and in other embodiments, a microdisplay may correspond to multiple incident surfaces 40, wherein the height of the matte wall 90 may be greater than or equal to the distance from the second reflection surface 30 to the exit surface 50, that is, to ensure the relative Light from two adjacent substrates 10 ′ will not interfere with each other, thus effectively reducing the generation of stray light.

The present application also provides a near-eye display device 200', referring to Figures 67 and 69, which includes:

microdisplay 80, and

In the optical module described in the above embodiment, the micro display 80 is installed on the incident surface 40 .

In specific implementation, the above units or structures can be implemented as independent entities, or can be arbitrarily combined and implemented as the same or several entities. The specific implementation of the above units or structures can refer to the previous embodiments, which will not be repeated here. It can be understood that the near-eye display device 200' can also include, for example, a frame, a lens, a circuit board, a power supply, an infrared sensor, a gyroscope, a temperature sensor, etc., and the above components for installing or driving its work will not be described in detail here.

Referring to FIG. 74 , the present application further provides a method for processing an optical module, wherein the optical module is the optical module described in the above embodiment, and the processing method comprises the following steps:

S111, forming a substrate 10'; the substrate 10' can be formed by cutting, injection molding, or compression molding.

S112, forming an emission surface 50 and a first reflection surface 20' located at the center of the emission surface 50 on the first end 12' of the substrate 10'; wherein the emission surface 50 and the first reflection surface 20' are one or a combination of a spherical surface, an aspherical surface, and a free-form surface;

S113. An incident surface 40 and a second reflecting surface 30 surrounding the incident surface 40 are formed on the second end 14' of the substrate; the incident surface 40 and the second reflecting film 30 are one or a combination of spherical surfaces, aspherical surfaces and free-form surfaces; the first end and the second end can be opposite ends; it can be understood that the formation of the corresponding spherical surface, aspherical surface and free-form surface can also be achieved by, for example, cutting, injection molding or compression molding, etc.

S114, coating the first reflective surface 20' and the second reflective surface 30 with a reflective film, the coating film can be formed by, for example, evaporation, sputtering, etc., wherein the incident surface 40 is configured to receive light from the image of the micro display 80, the light enters the substrate 10' through the aspherical incident surface 40, is reflected by the first reflective surface 20', then is reflected by the second reflective surface 30, and leaves the substrate 10' through the aspherical exit surface 50. For other descriptions of the optical module, please refer to the description of the above embodiment, which will not be repeated here.

Near-eye display devices generally adopt optical solutions such as optical waveguides or prisms. The light source (or image source) or part of the optics of such solutions are mostly set on the wearer's temples. In addition, optical solutions such as optical waveguides have special requirements for lenses. The size and weight of such devices are relatively large, and the user experience is not good for a long time. On the other hand, the display area of the display module of such devices is fixed in position. If the display device needs to move freely or to a specific position in the display state, there will often be problems with power supply, because the wired electrical connection will often interfere with the movement of the display module due to the physical existence of the wires.

Please refer to Figure 75, which is a schematic diagram of the overall structure of an embodiment of a near-eye display device of the present application. It should be noted that the electronic device (near-eye display device) in the present application can be a smart glasses structure and form including AR, VR, XR, MR, etc. Among them, the near-eye display device 100 includes a frame 110, temples 120 and lenses 130, the temples 120 are connected to the frame 110, and the frame 110 is used to fix the lenses 130. The lenses can be used for myopia glasses, hyperopia glasses, goggles, sunglasses, smart glasses and helmets, etc. The features of this part are within the understanding of those skilled in the art and will not be repeated here.

Optionally, please refer to Figures 76 to 79 together, Figure 76 is a schematic diagram of the overall structure of an embodiment of the near-eye display device of the present application without temples, Figure 77 is a schematic diagram of another viewing angle of the embodiment of Figure 75, Figure 78 is a schematic diagram of the overall structure of a display module and a first coil having multiple, and Figure 79 is a schematic diagram of a cross-sectional structure of an embodiment of a display module provided with a coil bracket; the near-eye display device 100 includes a lens 130 and a display module 1400; the lens 130 includes an eye side 1320 and an environment side 1310; the display module 1400 is configured to generate light and project it onto the eye side 1320 , the first battery 123 and the display module 1400 are arranged at intervals; a first coil 1500 is arranged around the lens 130, the first coil 1500 surrounds the lens 130 and is electrically connected to the first battery 123, the first coil 1500 forms at least one loop, and this loop is used for mutual electromagnetic induction with the second coil 1401' in the following embodiment; the display module 1400 can be detachably installed at any position on the surface of the lens 130, and the display module 1400 is configured to be movable at any position on the surface of the lens 130, and the user can move the display module 1400 to the surface of the lens 130 as needed The display module 1400 is used to display information at any position of the display module 1400. The display module 1400 is provided with a second coil 1401'; the second coil 1401' can be mutually induced with the first coil 1500. For example, the first coil 1500 is used as a transmitting end to convert an electric field into a magnetic field, and the second coil 1401' is used as a receiving end to convert a magnetic field into an electric field. The loop size formed by the second coil 1401' is smaller than the loop size formed by the first coil 1500. It can be understood that the above-mentioned induction is configured as wireless induction of the first coil 1500 and the second coil 1401' to realize the display module 1 400 supplies power to the display module 1400 through the first battery 123 during the movement of the lens 130 or when the display module 1400 is at any fixed position in the preset area of the lens 130. It can be understood that since the first coil 1500 is arranged around the lens 130, the display module can move freely on the surface of the lens 130, and when the user moves to a viewing position suitable for himself, it can be kept at a fixed position. Whether in the movement process or the fixed position, the display module 1400 can be powered by wireless induction between the first coil 1500 and the second coil 1401'. In some embodiments, the preset area can be an inner ring area surrounded by the first coil 1500 on the lens 130. In other embodiments, the preset area can also be an outer ring area surrounded by the first coil 1500 on the lens 130. The user can freely move and select the position of the preset area as needed, wherein the any fixed position can be a certain or any fixed position where the user stays after moving the display module, and this position can depend on the user's operation needs or visual field viewing needs. For example, aligning the lens with the center of the eye's field of view is often the best position. Of course, if the user wants to see the real physical world of the environment side 1310 at this time, the display module 1400 can be moved to a position deviating from the center of the field of view. The user can even move the display module 1400 to the position of the lens 130 corresponding to the blind spot of the eye's field of view. At this time, the display module 1400 can be located on the first coil 1500 or on the outer circle of the first coil 1500, etc.

Optionally, in some embodiments, the display module 1400 can be placed on the lens 130 by clamping, adsorption, etc., and the display module 1400 can move relative to the lens 130. In other embodiments, the display module 1400 can be fixed on the lens 130 by other methods. As long as the display module 1400 can be installed, fixed, detachable and movable at any position of the lens 130, it is an embodiment included in the present application and is not specifically limited here.

Optionally, please continue to refer to Figures 75 to 77, the first coil 1500 surrounds the lens 130; in some embodiments, optionally, the first coil 1500 can be embedded in the outer edge of the lens 130, optionally, the first coil 1500 can be wound around the outer edge of the lens 130, optionally, the first coil 1500 can be provided in the frame 110 and surround the lens 130, in other embodiments, the first coil 1500 can surround the lens 130 in other ways; optionally, the first coil 1500 can be located on the side facing the environment side 1310, for example, located in a groove or a groove on the side of the frame 110 facing the environment. Surface, etc., optionally, the first coil 1500 can be located on the side facing the eye side 1320, for example, located in a groove or surface of the frame 110 facing the eye side 1320, etc.; the accompanying drawings only give some examples. In other embodiments, those skilled in the art can adjust the position of the first coil 1500 as needed. As long as the induced current of the first coil 1500 surrounds the lens 130 to form a loop, and then mutually induces the second coil 1401', and ensures that the display module 1400 can be electrically operated at any position on the surface of the lens 130, they are all embodiments included in the present application and are not specifically limited here.

Please continue to refer to Figure 75. The near-eye display device 100 is also provided with a first electrical input interface 122. At least one of the first coil 1500 and the first battery 123 is electrically connected to the first electrical input interface 122. The first electrical input interface 122 can directly supply power to the first coil 1500 and the first battery 123. Optionally, the first coil 1500 is electrically connected to the first electrical input interface 122. Optionally, the first battery 123 is electrically connected to the first electrical input interface 122. Optionally, the first coil 1500 and the first battery 123 are both electrically connected to the first electrical input interface 122; optionally, the first electrical input interface 122 can be a micro-USB interface. Optionally, the first electrical input interface 122 can be a lightning interface. Optionally, the first electrical input interface 122 can be a type-c interface.

Optionally, please refer to Figures 79 to 81 together, Figure 80 is a schematic diagram of the display module in the embodiment of Figure 79 provided with a second battery, and Figure 81 is a schematic diagram of the structural disassembly of the display module in the embodiment of Figure 79; Optionally, the display module 1400 also includes a housing 1403, an optical component 1406 and a display unit 1407, the optical component 1406 is located at the light-emitting end of the display unit 1407, and the second coil 1401' is electrically connected to the display unit 1407; the housing 1403 is formed with a receiving cavity 1405, and the optical component 1406, the display unit 1407 and the second coil 1401' are arranged in the receiving cavity inside cavity 1405.

Optionally, in some embodiments, the shape of the display module 1400 may be columnar, such as a cylinder or a prism. In other embodiments, the shape of the display module 1400 may be other irregular shapes, which are not specifically limited here. The accompanying drawings only provide an example of a cylindrical display module. In other embodiments, those skilled in the art may make adjustments as needed, which are not specifically limited here. The cross-sectional dimensions of the display module 1400 are much smaller than the dimensions of the surface of the lens 130. Optionally, the maximum cross-sectional dimensions of the housing 1403 do not exceed 12 mm, and the maximum cross-sectional dimensions of the second coil 1401' do not exceed 11 mm. Specifically, the maximum cross-sectional dimensions of the display module 1400 do not exceed 12 mm. Optionally, the cross-sectional dimensions can be 10 mm, 9 mm, 8 mm, 6 mm, 5 mm, or 3 mm. The specific meaning of the cross-sectional dimensions is related to the shape of the cross-sectional dimensions. For example, when the cross-sectional dimensions are circular, the cross-sectional dimensions refer to the diameter of the cross-sectional dimensions. When the cross-sectional dimensions are square, the cross-sectional dimensions refer to the side length of the square. When the cross-sectional dimensions are rectangular, the cross-sectional dimensions refer to the length of the long side. The cross-sectional dimensions of the display module 1400 are much smaller than the dimensions of the surface of the lens 130, so that the display module 1400 occupies a small proportion of the surface of the lens 130, does not obstruct the user's line of sight, hinders the user's viewing, and improves the user experience.

The display module 1400 is provided with a second coil 1401', and the second coil 1401' may be around the circumference of the display module 1400. Optionally, in some embodiments, the first coil 1500 is a power transmitting end, the second coil 1401' is a power receiving end, and the second coil 1401' may be mutually inductive with the first coil 1500, so as to realize power supply to the display module 1400 through wireless induction between the first coil 1500 and the second coil 1401', and the display module 1400 has electricity to work at any position on the surface of the lens 130. Optionally, in some embodiments, the temple 120 may also be provided with a control circuit electrically connected to the first battery 123, the control circuit converts the direct current of the first battery 123 into alternating current and transmits it to the first coil 1500 to generate magnetic induction, and the second coil 1401' generates alternating current after receiving the magnetic induction. Optionally, the display module 1400 may also include a rectifier circuit, which converts alternating current into direct current. The display module 1400 may also include a conversion circuit, which converts direct current into a suitable voltage or current for the display module 1400 to operate. The features of this part are within the understanding of those skilled in the art and will not be elaborated here.

Please continue to refer to Figures 79 to 84, Figure 82 is a schematic diagram of a structural cross-section of another embodiment of a display module, Figure 83 is a schematic diagram of a display module provided with a second battery in the embodiment of Figure 82, and Figure 84 is a schematic diagram of a structural disassembly of the display module in the embodiment of Figure 83; Optionally, the display unit 1407 includes a display panel 1473 and a circuit board 1474, and the display panel 1473 and the circuit board 1474 are electrically connected. In some embodiments, optionally, the display panel 1473 and the circuit board 1474 are connected in a plug-in manner, optionally, the display panel 1473 and the circuit board 1474 are connected in an electrical wire manner, optionally, the display panel 1473 and the circuit board 1474 are connected in a contact manner, and optionally, the circuit board 1474 may be an independent circuit board or a peripheral circuit board integrated around the display unit 1407, such as the circuit board 14 74 may include a plug board, a drive board, a power board, etc. Only some embodiments are listed here. In other embodiments, those skilled in the art may make adjustments as needed, which are not specifically limited here; the second coil 1401' is electrically connected to the circuit board 1474; the display board 1473 is provided with a display 14711 for generating light, and optionally, the display 14711 may be located in the middle of the display board 1473; the optical assembly 1406 includes an optical module 1463 and a bracket 1462, the bracket 1462 is used to support and fix the optical module 1463, the optical module 1463 is located at the light emitting end of the display 14711, the bracket 1462 and the optical module 1463 are located on the side of the display board 1473 away from the circuit board 1474, and the bracket 1462 ensures that the light emitting ends of the optical module 1463 and the display 14711 correspond.

Optionally, please continue to refer to Figures 75 to 78. Optionally, there is at least one first battery 123; Optionally, please continue to refer to Figures 75 and 78, there can be one first battery 123 and it can be installed on any one of the temples 120; Optionally, please continue to refer to Figure 77, there can be two first batteries 123, and the two first batteries 123 are respectively installed on the two temples 120; Optionally, please continue to refer to Figure 76, two first batteries 123 can be installed on the frame 110; Optionally, one first battery 123 can be installed on one temple 120, and the other first battery 123 can be installed on the frame 110; Optionally, one first battery 123 can be installed on the frame 110; The accompanying drawings only show Some examples of the installation position of the first battery 123 are shown above. In other embodiments, those skilled in the art can select and adjust according to needs, and no specific limitation is made here.

Optionally, in some embodiments, the first battery 123 may be a rechargeable battery, optionally, interface charging, wireless charging, etc. may be adopted; optionally, in other embodiments, the first battery 123 may be a disposable replaceable battery, etc.; optionally, the first battery 123 may be of a size adapted to the shape of the frame 110 or the temple 120, optionally, the first battery 123 may include a single-core, multi-core, lithium battery, etc.; those skilled in the art may make selections and adjustments according to needs, and no specific limitations are made here.

Optionally, please continue to refer to Figures 75 to 78. Optionally, the number of display modules 1400 can be one. In the embodiment where the number of display modules 1400 is one, the display module 1400 can be installed in any one lens 130. Optionally, the first coil 1500 can only surround the lens 130 where the display module 1400 is located. In the embodiment where the number of display modules 1400 is multiple, the multiple display modules 1400 are configured to move within the first coil (150) of the lens 130, and the multiple display modules 1400 are detachably installed on at least one lens 130. The multiple display modules 1400 can work independently. "Multiple" means at least two, such as two, three, four, etc. Optionally, the multiple display modules 1400 can all be installed in any one lens 130. Optionally, the multiple display modules 1400 can be installed in two lenses 130 respectively. The accompanying drawings only give some examples of display modules on the surface of the lens. In other embodiments, those skilled in the art can make selections and adjustments according to needs, and no specific limitations are made here. Optionally, when the power required by multiple display modules 1400 is the same, the number of turns of the second coils 1401' of the multiple display modules 1400 may be the same. Optionally, when the power required by multiple display modules 1400 is different, the number of turns of the second coils 1401' of the multiple display modules 1400 may be different. The number of turns of the second coil 1401' may be set according to the different power consumption of different display modules to adapt to different display modules.

Optionally, the near-eye display device 100 may include two lenses 130, each lens 130 corresponds to an eye field of view, the first coil 1500 may surround the two lenses 130 at the same time, and the display module 1400 is configured to move in the inner circle of the first coil 1500; optionally, the lenses can be used for myopia glasses, hyperopia glasses, sunglasses, smart glasses, etc. The features of this part are within the understanding of those skilled in the art and will not be repeated here.

Optionally, the near-eye display device 100 may include only one lens 130, the lens 130 spans the field of view of two eyes, the first coil 1500 surrounds the lens 130 and spans the field of view of two eyes, and the display module 1400 is configured to be able to move within the inner circle of the first coil 1500 or the outer circle of the first coil 1500; optionally, the lens can be used for goggles and helmets, etc. The features of this part are within the understanding of those skilled in the art and will not be repeated here.

Optionally, the first coil 1500 surrounds at least one lens 130 . Optionally, please continue to refer to FIG. 75 , the first coil 1500 only surrounds one lens 130 equipped with the display module 1400 . Optionally, please continue to refer to FIG. 76 , the first coil 1500 surrounds two lenses 130 .

Optionally, the first coil 1500 surrounds at least one lens 130. Optionally, please continue to refer to Figures 77 and 78. The first coil 1500 includes a first sub-coil 1510 and a second sub-coil 1520. The first sub-coil 1510 and the second sub-coil 1520 respectively surround one of the lenses 130 to form a loop. In some embodiments, the number of turns of the first sub-coil 1510 and the second sub-coil 1520 may be the same or different; in some embodiments, the first sub-coil 1510 and the second sub-coil 1520 are electrically isolated to avoid cross interference; in other embodiments, the first sub-coil 1510 and the second sub-coil 1520 may be electrically connected, and the first sub-coil 1510 and the second sub-coil 1520 may be connected in series or in parallel. Optionally, the first sub-coil 1510 and the second sub-coil 1520 can be electrically connected to the first batteries 123 installed on the two temples 120, respectively; optionally, the first sub-coil 1510 and the second sub-coil 1520 can be electrically connected to the two first batteries 123 installed on the frame 110, respectively; optionally, the first sub-coil 1510 is electrically connected to the first battery 123 installed on the temple 120, and the second sub-coil 1520 is electrically connected to the first battery 123 installed on the frame 110; optionally, the second sub-coil 1520 is electrically connected to the first battery 123 installed on the temple 120, and the first sub-coil 1510 is electrically connected to the first battery 123 installed on the frame 110; optionally, the first sub-coil 1510 and the second sub-coil 1520 can also be electrically connected and electrically connected to the same first battery 123 installed on one temple 120 Optionally, the first sub-coil 1510 and the second sub-coil 1520 may also be electrically connected and electrically connected to the same first battery 123 mounted on the frame 110.

Optionally, the number of turns of the first coil 1500 can be one turn or multiple turns. Optionally, the number of turns of the second coil 1401' can be one turn or multiple turns. The number of turns of the coil can be determined according to the power required by the display module 1400. The features of this part are within the scope of understanding of those skilled in the art and will not be elaborated here.

Optionally, the number of turns of the first sub-coil 1510 and the second sub-coil 1520 may be the same, in which case the first sub-coil 1510 and the second sub-coil 1520 have the same power output; optionally, the number of turns of the first sub-coil 1510 and the second sub-coil 1520 may be different, in which case the first sub-coil 1510 and the second sub-coil 1520 have different power outputs. The number of turns of the coil can be selected according to the power required by the display module 1400 and the number of display modules 1400. The features of this part are within the understanding of those skilled in the art and will not be elaborated here.

Optionally, please refer to Figures 79 to 81. Optionally, the display module 1400 further includes a coil support 1408; the housing 1403 is formed with a housing cavity 1405, and the optical component 1406, the display unit 1407, the coil support 1408 and the second coil 1401' are arranged in the housing cavity 1405; the second coil 1401' is electrically connected to the display unit 1407; the second coil 1401' is arranged on the periphery of the coil support 1408, and the second coil 1401' surrounds in the height direction from the display unit 1407 to the optical component 1406. Specifically, the second coil 1401' can be arranged in the thickness direction of the display module 1400; Optionally, The height of the coil support 1408 at least partially overlaps with the sum of the heights of the support 1462, the display panel 1473 and the circuit board 1474. The surrounding height of the second coil 1401' is greater than the display panel 1473, the circuit board 1474 and the distance between the two, so that the second coil 1401' has more turns and can provide more power. Optionally, the number of turns of the coil can be determined according to the power required by the display module 1400. The number of turns of the coil determines the height of the second coil 1401' and the coil support 1408 in the thickness direction of the display module 1400: when the power required by the display module 1400 is large, that is, the number of turns of the second coil 1401' is large, the coil support 140 8 can completely surround the display unit 1407 and the optical component 1406. When the power required by the display module 1400 is small, that is, the number of turns of the second coil 1401' is small, the coil bracket 1408 completely surrounds the display unit 1407 and partially surrounds the optical component 1406, or only completely surrounds the display unit 1407. When the power required by the display module 1400 is even smaller, that is, the number of turns of the second coil 1401' is even smaller, the coil bracket 1408 only partially surrounds the display unit 1407. Optionally, the coil bracket 1408 can also partially surround the optical component 1406, or completely surround the optical component 1406, or completely surround the optical component 1406 and partially surround the display unit 1407. The display unit 1407, or completely surrounds the optical component 1406 and the display unit 1407. The structure surrounded by the coil bracket 1408 and whether it completely surrounds or partially surrounds can be determined according to the number of turns of the second coil 1401'. The number of turns of the second coil 1401' can be determined according to the power required by the display module 1400. The features of this part are within the scope of understanding of those skilled in the art and will not be described here. Only some embodiments are listed here. The accompanying drawings only show an example of the second coil partially surrounding the display unit 1407 and completely surrounding the optical component 1406. In other embodiments, those skilled in the art can make selections and adjustments according to needs, and no specific limitations are made here.

The coil bracket 1408 and the second coil 1401' are arranged around the display unit 1407 and/or the optical component 1406, making full use of the circumferential space so that the height of the display module 1400 in the thickness direction is relatively small; at the same time, the circumferential setting can adjust the number of coil turns according to the power required by the display module 1400, providing a variety of options for the power of the display module 1400.

Please continue to refer to FIG. 80. Optionally, the display module 1400 may further include a second battery 1402'; the second coil 1401' is electrically connected to the second battery 1402', so as to realize charging of the second battery 1402', and then realize charging of the display module 1400, ensuring that the display module 1400 can be powered by the second battery 1402' without the coil power supply. Optionally, the second battery 1402' is disposed in the accommodating cavity 1405 and is located at one end of the display unit 1407 close to the housing 1403 in the thickness direction.

Optionally, please continue to refer to FIGS. 82 to 84 . Optionally, the display module 1400 further includes a housing 1403, an optical component 1406, a display unit 1407, and a cover plate 1409. In some embodiments, the housing 1403 and the cover plate 1409 together form a receiving cavity 1405. In other embodiments, the housing 1403 and the cover plate 1409 together form a receiving cavity 1405. In the embodiment, it can be understood that the cover plate 1409 can be an integrally formed part of the housing 1403 or two separate parts are finally connected to form a whole. Optionally, the cover plate can be located on the environment side 1310, and optionally, the cover plate can be located on the eye side 1320. The optical component 1406, the display unit 1407 and the second coil 1401' are arranged in the accommodating cavity 1405; the second coil 1401' is arranged in a flat shape as a whole, and the second coil 1401' is arranged on the side of the circuit board 1474 away from the display board 1473, the second coil 1401' is parallel to the circuit board 1474, and the second coil 1401' is electrically connected to the display unit 1407.

The second coil 1401' is flatly arranged on the side of the circuit board 1474 away from the display panel 1473, which reduces the height of the display module 1400 in the thickness direction, so that the display module 1400 can be made thinner; at the same time, the cross-sectional size of the display module 1400 is reduced, so that the proportion of the display module 1400 occupying the surface of the lens 130 is small, which will not block the user's line of sight and hinder the user's viewing, thereby improving the user experience.

Please continue to refer to Figure 83. Optionally, the display module 1400 may also be provided with a second battery 1402'; the second coil 1401' is electrically connected to the second battery 1402', so as to charge the second battery 1402', and then charge the display module 1400, ensuring that the display module 1400 can be powered by the second battery 1402' without the coil power supply; the second battery 1402' is arranged in the accommodating cavity 1405, for example, it can be located on one side of the display unit 1407, or on one side of the optical component 1406, or on one side of the optical component 1406 and the display unit 1407 at the same time, the height of the second battery 1402' in the thickness direction of the display module 1400 can at least partially overlap with the thickness of the display module 1400, and Figures 83-84 only give a simple example of the second battery 1402' part. The basic components such as the electrical connection part and other related structures are within the scope that can be understood by those skilled in the art, and will not be described in detail here. In other embodiments, the shape and position of the second battery can be selected and adjusted according to needs.

The second battery 1402' can be arranged on the side of the display unit 1407 and/or the optical component 1406, or the second battery 1402' can be arranged on one end of the display unit 1407 in the thickness direction close to the housing 1403. When arranged on the side, the circumferential space can be fully utilized, so that the height of the display module 1400 in the thickness direction is relatively small. Arranging on the end surface can reduce the circumferential width.

Optionally, a rectifier circuit may be provided on the circuit board 1474 to convert alternating current into direct current. A conversion circuit may also be provided on the circuit board 1474 to convert direct current into a suitable voltage or current for the display 14711 to operate. The features of this part are within the scope of understanding of those skilled in the art and will not be elaborated here.

Optionally, the display 14711 can be including but not limited to Micro-LED (Micro Light-Emitting Diode), Micro OLED (Micro Organic Light-Emitting Diode), LCOS (Liquid Crystal On Silicon), LCD (Liquid Crystal Display), DMD (Digital Micromirror Device)/DLP (Digital Light Processing) or LBS (Laser Beam Scanning), etc., or any combination of these.

Optionally, in some embodiments, the light output end of the shell 1403 can be made of light-transmitting material, and in other embodiments, the light output end of the shell 1403 can be dug with a hole for light transmission. Only some embodiments are listed here. In other embodiments, technical personnel in this field can make adjustments according to needs, and no specific limitations are made here.

Optionally, at least one of the first coil 1500 and the second coil 1401' is a transparent conductive material, optionally, the first coil 1500 is a transparent conductive material, optionally, the second coil 1401' is a transparent conductive material, optionally, the first coil 1500 and the second coil 1401' are both transparent conductive materials. Optionally, the transparent conductive material can be an oxide transparent conductive material, specifically zinc oxide, tin oxide, indium tin oxide, etc. Oxide transparent conductive material is the most widely used transparent conductive material at present, and has the characteristics of high transparency and conductivity; Optionally, the transparent conductive material can be a carbon nanotube transparent conductive material, specifically carbon nanotube, carbon nanotube transparent conductive material is a new type of material, with the characteristics of high conductivity, high transparency, high strength, excellent flexibility, etc.; Optionally, the transparent conductive material can be a conductive polymer material, and the conductive polymer is a material composed of conductive polymers, which has good conductivity and flexibility. The coil uses a transparent conductive material, which not only meets the needs of the first coil 1500 and the second coil 1401' to wirelessly sense and power the display module 1400, but also The coil can also be integrated with the transparent lens 130 , thereby improving the appearance of the near-eye display device 100 .

In the near-eye display device provided in the embodiment of the present application, the display module can generate light and project it to the user's eye side, the display module can move freely on the lens, and at the same time, a first coil is provided in the circumference of the lens and a second coil is provided on the display module, the two are electromagnetically induced with each other, and the loop size formed by the second coil is smaller than the loop size formed by the first coil, thereby effectively reducing the influence of the coil on the field of view of the lens. The display module is powered by the first battery during the movement of the display module on the lens or at a fixed position in a preset area of the lens, which can ensure that the display module can be powered to work whether it is dynamic or static on the lens, effectively avoiding the interference between the use of wired power supply and the free movement of the display module.

Please refer to Figure 85, which is a schematic diagram of the overall structure of an embodiment of a charging box of the present application. The charging box 2000 provided in the embodiment of the present application is used to charge the first battery 123 of the near-eye display device 100 of any of the above-mentioned embodiments; the charging box 2000 includes a box body 200 and the near-eye display device 100 of any of the above-mentioned embodiments, the box body 200 includes a third coil 210 and a second electrical input interface 230, the second electrical input interface 230 and the third coil 210 are electrically connected, optionally, the first coil 1500 can also be used as a power receiving end, and the third coil 210 as a power sending end, the first coil 1500 and the third coil 210 are configured to wirelessly induct each other to charge the first battery 123 through the second electrical input interface 230; optionally, the second electrical input interface 230 can be a micro-USB interface, optionally, the second electrical input interface 230 can be a lightning interface, optionally, the second electrical input interface 230 can be a type-c interface.

In the charging box provided in the embodiment of the present application, the first coil acts as a power receiving end and wirelessly inducts with the third coil to charge the first battery, thereby improving the flexibility, convenience, and versatility of the charging box, thereby improving the user experience; at the same time, it avoids damage to the charging port of the near-eye display device caused by frequent plugging and unplugging of the charging cable, protects the interface of the near-eye display device, and extends the service life of the near-eye display device.

The near-eye display device can convert display information into images and project them into the eyes of the viewer, thereby achieving an immersive display experience, wherein the display information can be transmitted to the near-eye display device through an external terminal. In the related art, when the near-eye display device communicates with the external terminal to transmit display information, due to the limitation of the transmission bandwidth, the transmission data flow is small, resulting in the near-eye display device not displaying smoothly and displaying delays.

The present application provides a near-eye display system. Referring to FIG. 97 , the near-eye display system 1000 may include a near-eye display device 10 and a terminal 6, and the near-eye display device 10 is communicatively connected to the terminal 6. The terminal 6 is used to transmit display information to the near-eye display device 10. The display information may include information such as video, image or text. Exemplarily, the terminal 6 may be a device such as a mobile phone, a watch or a computer. The near-eye display device 10 is used to convert the display information into an optical output and project it to the user side for the user to watch. Among them, the optical output may be light. The communication connection between the near-eye display device 10 and the terminal 6 may be a wired connection using a data cable, or a wireless connection without a data cable. Relatively speaking, since the wireless connection does not require the use of a data cable, the use of the near-eye display system 1000 is not restricted by the data cable, which can improve the convenience of use of the near-eye display system 1000.

Optionally, the communication connection mode between the near-eye display device 10 and the terminal 6 is a WiFi connection. The bandwidth of the WiFi connection is relatively large, and the data transmission speed is fast, which can make the display of the near-eye display device 10 smoother. Although the WiFi connection can ensure the data transmission speed, the WiFi connection between the near-eye display device 10 and the terminal 6 needs to be assisted by an external wireless network, and some usage scenarios of the near-eye display system 1000 may not have wireless network coverage, such as using the near-eye display system 1000 during outdoor sports. In order to ensure that the near-eye display system 1000 can still be used normally in scenes without wireless network coverage, the communication connection mode between the near-eye display device 10 and the terminal 6 can also be provided with other short-range wireless connection modes other than WiFi connection, such as one or more of Bluetooth, ZigBee or 2.4g. In the above-mentioned short-range wireless connection mode, the bandwidth is relatively small, and the data transmission speed is limited, which may cause the near-eye display device 10 to have problems such as display freeze, insufficient display smoothness, and display delay. Therefore, providing a near-eye display device with smooth display and reduced display delay has become a technical problem to be solved.

Please refer to FIG86 , the near-eye display device 10 may include a wearing component 1 and a display component 20. The wearing component 1 can be worn by a user. If worn on the head, the wearing component 1 can be glasses or a helmet, for example. The wearing component 1 includes a frame 11, on which a lens 12 is mounted. When the wearing component 1 is glasses, the frame 11 can be a frame; when the wearing component 1 is a helmet, the frame 11 can be a helmet shell. The lens 12 can be a lens for myopia, hyperopia, eye protection, sunglasses or fashion glasses, or a lens for a head-mounted device such as a helmet. The user's eyes can observe the external environment from the eye side through the lens 12.

The display assembly 20 is configured to be movably arranged on the lens 12. Optionally, the display assembly 20 is rotatably connected to the frame 11 through a bracket (not shown in the figure), and the bracket can be a component such as a temple. The display assembly 20 can be moved on the lens 12 by the user's finger 40 directly moving the display assembly 20; or, the display assembly 20 is magnetically connected to the lens 12, which can facilitate the movement of the display assembly 20 on the lens 12 and prevent the display assembly 20 from falling off the lens 12; in other embodiments, the display assembly 20 can be clamped on the lens 12 by clamping. Exemplarily, as shown in Figure 17, the display assembly 20 can move on the lens 12 along any direction shown by D1-D4. In some embodiments, when the user's finger touches the display assembly 20, the display assembly 20 can display an interface reminder with a moving direction such as D1-D4 to facilitate user operation.

In one embodiment, as shown in Figures 87-89, the lens 12 includes a plurality of mobile areas 121, each of which corresponds to the display content of the external terminal 6 itself. Exemplarily, as shown in Figure 87, the plurality of mobile areas 121 are distributed along the lateral direction of the lens 12; or, as shown in Figure 88, the plurality of mobile areas 121 are distributed along the longitudinal direction of the lens 12; or, as shown in Figure 89, the plurality of mobile areas 121 are distributed along the lateral and longitudinal directions of the lens 12; in other embodiments, the mobile areas 121 may be arranged in a square or circular array or in a regular pattern. The above embodiments are only some optional settings of the mobile areas 121, and the number and position arrangement of the mobile areas 121 may also have other ways, which are not specifically limited here. Specifically, as shown in Figure 88, the lens 12 includes a first mobile area 121A, a second mobile area 121B and a third mobile area 121C, wherein the first mobile area 121A, the second mobile area 121B and the third mobile area 121C correspond to the display content of the navigation, translation and video applications of the external terminal 6, respectively. Each moving area 121 is set to correspond to the display content of the external terminal 6 itself, so that the moving area 121 corresponds to the display content of the external terminal 6 itself, so that the position of the display component 20 on the lens 12 can be changed by a moving operation, so that it is moved to the target moving area 121, so as to switch the display content of the display component 20 to the target display content of the external terminal 6, and the user does not need to operate at the external terminal 6 end, so that the switching operation of the display content is convenient and fast, which can improve the ease of use of the near-eye display device 10.

In some embodiments, please refer to FIG. 90 , the lens 12 has a plurality of movable areas 121. In the working state, the display component 20 can display the corresponding image content when it is located in the movable area 121. Among them, the display component 20 can display different functions or applications when it is located in different movable areas 121. Exemplarily, when the display component 20 is located in the movable area 121 in the middle of the lens 12, the displayed function or application can be the main interface 1114, the upper position can be the setting 1112, the left and right positions of the setting 1112 can be information 1111 and navigation 1113 respectively, the left and right positions of the main interface 1114 can be music 1119 and smart assistant 1115, the lower part of the main interface 1114 can be a picture 1117, and the left and right sides of the picture 1117 can be translation 1118 and dialing 1116 respectively. Of course, the user can reorder and customize the above-mentioned functional interfaces on the terminal as needed, for example, customize the arrangement according to the frequency of use or interests. It can be understood that the storage unit 204 inside the display component 20 stores the first display information including the above-mentioned functions or applications, and the first display information includes the underlying image content of the above-mentioned functions or applications, such as the base map, background color, font color, etc. of the corresponding functional application. Considering that the display component 20 is prone to generate large power consumption when displayed in full color, and has high requirements on the size and design of the optical module, in some embodiments, the display component 20 can only display a single color, such as green, etc., and accordingly, the storage unit 204 stores font or base map information with a single color, etc. In some embodiments, the user's eyes can see the content on the environment side from the eye side through the moving area 121 of the lens 12, that is, the moving area 121 of the lens 12 does not contain content that interferes with the user's viewing, and Figure 90 is only for the convenience of display and understanding. When the display component 20 moves to different positions of the lens 12, the display component 20 itself can display the content to be displayed, instead of displaying the content on the moving area 121 of the lens 12. For example, when the display component 20 moves to the moving area 121 in the middle position, the display component 20 can display the main interface 1114, The main interface may include information such as time or weather, and of course the main interface may also be customized according to the user's settings. When the display component 20 is located at the position of the mobile area 121 corresponding to the display main interface, the areas outside the mobile area 121, such as information 1111, settings 1112, navigation 1113, smart assistant 1115, dialing 1116, pictures 1117, and translation 1118, corresponding to the mobile area 121 are not displayed, and the user's eyes cannot see the corresponding static or dynamic content on the lens 12. That is, when the display component 20 does not move to the corresponding mobile area 121, the functions or application images of other mobile areas 121 will not be reflected on the lens 12; only when the user moves the display component 20 to the corresponding mobile area 121 position, can the image content of the function or application corresponding to the corresponding mobile area 121 be displayed on the display component 20.

Please refer to FIG. 87 , in one embodiment, the size of the display component 20 is smaller than the size of the lens 12. Optionally, the orthographic projection area of the display component 20 on the lens 12 is much smaller than the area of the lens 12, for example, the maximum orthographic projection area of the display component 20 on the lens 12 is not greater than 6 mm2, in some embodiments, the maximum outer diameter of the display component 20 may not exceed 15 mm, that is, the maximum outer diameter of the housing 211 described below does not exceed 15 mm, for example, it may be 15 mm, 12 mm, 10 mm, 8.5 mm, 5 mm, etc., thereby reducing the volume of the display component 20, which is convenient for the display component 20 to be adapted to the wearing component 1, and can reduce the influence of the display component 20 on the field of view of the lens 12.

In one embodiment, as shown in FIG. 86 , FIG. 91 , and FIG. 94 , the display assembly 20 includes a housing 211, and a processor 202, a communication unit 203, a storage unit 204, an output unit 205, and a sensor unit 206 disposed in the housing 211, and the communication unit 203, the storage unit 204, the output unit 205, and the sensor unit 206 are electrically connected to the processor 202, respectively. The processor 202, the communication unit 203, and the storage unit 204 can be disposed on a circuit board module 220. For example, the circuit board module 220 can include a first circuit board 221 and a second circuit board 222, the processor 202 and the communication unit 203 can be located on the first circuit board 221, and the storage unit 204 can be located on the second circuit board 222. In some embodiments, the first circuit board 221 and the second circuit board 222 can be disposed in parallel with each other. The housing 211 has an inner space for accommodating components, and the height of the housing 211 is not higher than 20 mm. As shown in FIG. 94 , the distance between the top of the housing 211 and the cover 212 may be no greater than 20 mm, such as 18 mm, 15 mm, 12 mm, 10 mm, etc., and the maximum outer diameter of the housing 211 may not exceed 15 mm. Optionally, the processor 202, the communication unit 203, the storage unit 204, the output unit 205, and the sensor unit 206 are at least partially arranged in the housing 211, so that the housing 211 can provide protection for each component and reduce the risk of damage to the components. The display assembly 20 may also include a power supply unit 207, which is used to provide working power for the display assembly 20. The power supply unit 207 may include a rechargeable battery, and the power supply unit 207 can be reused after being charged multiple times. Compared with a disposable power supply, the power supply unit 207 is more energy-saving and environmentally friendly.

Processor 202 may be an integrated circuit chip having signal processing capability. Processor 202 may be implemented by a plurality of integrated circuit chips. Exemplarily, processor 202 may be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. Among them, the general-purpose processor may be a microprocessor.

The communication unit 203 includes one or more of a Bluetooth communication module, a ZigBee communication module, and a 2.4g communication module. The short-range wireless communication module does not require the use of an external wireless network, so that the near-eye display system 1000 can still be used normally in a scene without wireless network coverage, thereby improving the applicability of the near-eye display system 1000.

The storage unit 204 includes a readable storage medium. The readable storage medium can be a medium that can store data, such as a hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, an optical disk, a mobile hard disk, or a USB flash drive. Optionally, the readable storage medium is built into the housing 211, so that the storage unit 204 and the housing 211 form a whole, which is convenient to carry, thereby improving the convenience of use of the near-eye display device 10. Or the readable storage medium can be detachably arranged in the housing 211, so that the volume of the storage unit 204 is not limited by the housing 211, and the storage capacity of the storage unit 204 can be improved.

Please refer to FIG. 92 and FIG. 94. In one embodiment, the output unit 205 includes a micro display 251 and an optical module 252. Exemplarily, the micro display 251 and the optical module 252 are fixed by a fixing bracket 208. The fixing bracket 208 may include a first connecting portion (not shown in the figure). and a second connecting portion (not shown in the figure), the first connecting portion is provided with a first mounting portion, and the second connecting portion is provided with a second mounting portion. The first mounting portion is a hole structure or a slot structure, and the second mounting portion is a hole structure or a slot structure. Among them, the first mounting portion and the second mounting portion are interconnected. In this embodiment, the first mounting portion adopts a slot structure, and the second mounting portion adopts a hole structure. The microdisplay 251 is installed in the first mounting portion, and the optical module 252 is partially installed in the second mounting portion. The microdisplay 251 and the processor 202 are electrically connected, and the optical module 252 is located on the light emitting side of the microdisplay 251. The microdisplay 251 receives information from the processor 202 and converts it into optical output. The optical module 252 receives the optical output and transmits it to the user side for the user to watch.

The micro display 251 may be, for example, Micro-LED (Micro Light-Emitting Diode), Micro-oled (Micro Organic Light-Emitting Diode), LCoS (Liquid Crystal On Silicon), LCD (Liquid Crystal Display), DMD (Digital Micromirror Device)/DLP (Digital Light Processing) or LBS (Laser Beam Scanning), or any combination of these technologies. The optical module 252 may be made of resin or glass. The first circuit board 221, the second circuit board 222 and the micro display 251 may be parallel to each other. The sensor unit 206 may be electrically connected to the circuit board module 220 and arranged around the periphery of the micro display 251 and the optical module 252. The display component 20 may further include a sleeve 214, wherein the microdisplay 251 and the optical module 252 are located inside the sleeve 214. The sleeve 214 may be made of opaque resin or metal or other materials to prevent external light from interfering with the optical signal emitted by the microdisplay 251, and to prevent light leakage of the optical signal emitted by the microdisplay 251.

In some embodiments, as shown in FIG. 94 , the display assembly 20 further includes a cover 212, which is used to close the opening structure of the housing 211. The cover 212 can be installed in the opening structure by means of threaded connection, snap-fit, interference fit, etc. A groove 2121 is provided on the cover 212, and an attracting member 213 that can be attracted by a magnet is installed in the groove 2121, and the attracting member 213 can be magnetized or has magnetism. The attracting member 213 can be made of magnetizable ferrite stainless steel, etc., or the attracting member 213 is directly made of a magnet. The attracting member 213 can be a sheet structure, and the attracting member 213 can be fixed in the groove 2121 by means of bonding, etc. Among them, the attracting member 213 is configured to be magnetically attracted to each other with an external attracting member, so as to assemble the display assembly 20 to the wearing assembly 1, wherein the material of the external attracting member can be the same as that of the attracting member 213, and the two can be magnetically attracted to each other, so as to be clamped and fixed on the wearing assembly 1, such as the lens 12 or the frame 11.

In some embodiments, as shown in FIG94 , the power supply unit 207 includes a battery, which may be arc-shaped or annular, and the power supply unit 207 may be formed with a central accommodating cavity 271, the output unit 205 and the circuit board module 220 are located at the center of the central accommodating cavity 271, and the battery surrounds the periphery of the micro display 251 and the circuit board module 220, and the axis direction of the micro display 251 and the optical module 252 is substantially parallel to the height direction of the power supply unit 207, thereby achieving center alignment and facilitating assembly. Among them, the cross-sectional shape of the outer contour of the central accommodating cavity 271 includes an arc or annular shape, and the cross-sectional shape of the power supply unit 207 is perpendicular to the height direction of the power supply unit 207. The output unit 205 and the circuit board module 220 are sequentially arranged along the height direction of the power supply unit 207. In other embodiments, the power supply unit 207 may be a button battery, which may be arranged in parallel with the circuit board module 220, or in parallel with the attraction member 213. In other embodiments, if a button battery is used, the attracting member 213 may be eliminated, and the button battery can be directly used as the power supply unit 207 and an external magnet or other attracting member to attract each other.

In one embodiment, as shown in FIG. 93 , the sensing unit 206 includes an inertial measurement module 261, which is electrically connected to the processor 202, and the inertial measurement module 261 may be located on the first circuit board 221. The inertial measurement module 261 is configured to obtain the movement information of the display component 20 relative to the lens 12, and the processor 202 obtains the movement information from the inertial measurement module 261, and sends the movement information to the external terminal 6 through the communication unit 203. The movement information may be one of the movement parameters such as the movement speed, acceleration, displacement, displacement component of the displacement in a preset direction, or rotation angle of the display component 20 relative to the lens 12, or a combination of some of the above movement parameters. After obtaining the movement information sent by the communication unit 203, the external terminal 6 may determine the position of the moving area 121 of the display component 20 on the lens 12 through the movement information, so as to send the display content of the external terminal 6 corresponding to the moving area 121 to the near-eye display device 10. For example, in FIG. 88 , the external terminal 6 determines the second moving area of the display component 20 on the lens 12 through the movement information. 121B, the display content of the translation application of the external terminal 6 corresponding to the second moving area 121B is sent to the near-eye display device 10.

When the display component 20 is magnetically connected to the lens 12, the position of the display component 20 on the lens 12 can be moved by manual operation, and the inertial measurement module 261 obtains the movement information of the display component 20 relative to the lens 12. The external terminal 6 determines the position of the moving area 121 of the display component 20 on the lens 12 through the movement information to realize the display of different contents of the external terminal 6. In some usage scenarios, for example, the shaking of the user's head may cause the movement of the display component 20 relative to the lens 12. At this time, the user does not expect to switch the display content, but the inertial measurement module 261 can still obtain the movement information of the display component 20 relative to the lens 12, which may cause the external terminal 6 to misjudge the position of the moving area 121 of the display component 20 on the lens 12 and switch the display content, causing inconvenience to the user.

In one embodiment, as shown in FIG. 93 , the sensing unit 206 further includes a touch detection module 262, and the touch detection module 262 is electrically connected to the processor 202. The touch detection module 262 is configured to obtain the user's touch operation information on the display component 20, and send the touch operation information to the processor 202. Specifically, when the user holds the display component 20 and manually moves the display component 20, the touch detection module 262 can be triggered, so that the touch detection module 262 detects the user's touch operation information on the display component 20. When the preset conditions are met, for example, when the processor 202 confirms that the user manually moves the display component 20 through the received touch operation information, the processor 202 sends a detection instruction to the inertial measurement module 261, and the inertial measurement module 261 obtains the movement information of the display component 20 relative to the lens 12 in response to the detection instruction. With such an arrangement, the inertial measurement module 261 detects the movement information of the display component 20 relative to the lens 12 only when it is detected that the user has manually moved the display component 20, thereby reducing the probability of misjudgment of the position movement of the display component 20 and ensuring that the switching operation of the display content is consistent with the user's expectations.

Optionally, the touch detection module 262 includes one or both of a touch panel and a light sensor. The touch panel can be installed on the housing 211, and at least a part of the area is located on the outer surface of the housing 211, so that the user can touch the touch panel when holding the display component 20 and manually operating the mobile display component 20, so that the touch panel detects the user's touch operation information on the display component 20. The light sensor can be a sensor based on the photoelectric effect, which converts the change of the light signal into the change of the electrical signal, thereby realizing the detection of the touch operation information. Specifically, the light sensor can be a reflective photoelectric sensor, including a light source and a photoelectric element, the light source is installed in the housing 211, and a part of the area of the housing 211 is a light-transmitting area, which is set at a position that can be touched by the user when holding the display component 20 and manually operating the mobile display component 20, and the light emitted by the light source is irradiated on the light-transmitting area. When the user holds in the light-transmitting area, the light emitted by the light source is reflected back to the photoelectric element due to shielding, and the photoelectric element detects the change of light intensity to realize the detection of touch operation information. Compared with other sensors, touch panels and optical sensors have the advantages of mature technology, good reliability and relatively low cost.

In order to solve the problem that the display of the near-eye display device 10 is not smooth enough and the display is delayed, in one embodiment, the storage unit 204 is configured to store the first display information, the communication unit 203 is configured to establish a first communication with the external terminal 6, the first communication includes the second display information from the external terminal 6, the processor 202 is configured to merge the first display information and the second display information to obtain the third display information, and the output unit 205 is configured to convert the third display information into an optical output and project it to the user side. Specifically, the first display information can be stored in a readable storage medium. The micro display 251 receives the third display information from the processor 202 and converts it into an optical output, wherein the optical output can be light, and the optical module 252 receives the optical output and transmits it to the user side for viewing by the user.

The near-eye display device 10 provided in the present application, the display component 20 includes a processor 202, a communication unit 203, a storage unit 204 and an output unit 205, the output unit 205 converts the third display information into an optical output and projects it to the user side, the third display information is obtained by the processor 202 by merging the first display information and the second display information, that is, the third display information is split into the first display information and the second display information, wherein the first display information can be pre-stored in the storage unit 204, and the second display information comes from the external terminal 6, so that when the near-eye display device 10 is displaying, only the second display information needs to be transmitted between the communication unit 203 and the external terminal 6, thereby reducing the amount of data transmission between the communication unit 203 and the external terminal 6. Under the same bandwidth conditions, the communication unit 203 can receive data from the external terminal 6 faster, thereby making the display of the near-eye display device 10 smoother and reducing the display delay.

In one embodiment, the first display information includes data displayed first, and the second display information includes data displayed later. Specifically, taking the display content of a video application as an example, the first display information includes video data with an earlier playback time, and the second display information includes video data with a later playback time. The video data with an earlier playback time is pre-stored in the storage unit 204. When the near-eye display device 10 is displaying, only the video data with a later playback time needs to be transmitted between the communication unit 203 and the external terminal 6, which reduces the amount of data transmission between the communication unit 203 and the external terminal 6, thereby making the display of the near-eye display device 10 smoother and reducing the display delay.

In one embodiment, the first display information includes an image or text data that does not change with the display time, and the second display information includes an image or text data that changes with the display time during the display process. For example, when it is necessary to display the information of the navigation application of the external terminal 6, the first display information may include a navigation icon that does not change with the display time, and the second display information includes the navigation content that changes with the display time during the display process; for another example, when it is necessary to display the information of the translation application of the external terminal 6, the first display information may include a common menu icon of the translation application that does not change with the display time, and the second display information includes the specific content of the translation that changes with the display time during the display process. In this way, the image or text data that does not change with the display time is pre-stored in the storage unit 204. When the near-eye display device 10 is displayed, only the image or text data that changes with the display time during the display process needs to be transmitted between the communication unit 203 and the external terminal 6, which reduces the amount of data transmission between the communication unit 203 and the external terminal 6, thereby making the display of the near-eye display device 10 smoother and reducing the display delay.

In one embodiment, the third display information includes an application graphical interface on the external terminal 6, the first display information includes static display information, and the second display information includes dynamic display information. The third display information is set to include an application graphical interface on the external terminal 6, so that when the display component 20 changes between each mobile area 121, the output unit 205 can display the application graphical interface corresponding to the mobile area 121, so as to facilitate the user to quickly select the application to be displayed, thereby improving the usability of the near-eye display device 10. The static display information can be data such as the base map and background color when the application is displayed, and correspondingly, the dynamic display information can be data such as changing text or color. The static display information is pre-stored in the storage unit 204. When the near-eye display device 10 is displayed, only the dynamic display information needs to be transmitted between the communication unit 203 and the external terminal 6, which reduces the amount of data transmission between the communication unit 203 and the external terminal 6, thereby making the display of the near-eye display device 10 smoother and reducing the display delay.

In order to improve the user experience, applications are usually upgraded iteratively, and the display information such as the graphical interface or menu icon of the application may change during the upgrade. If the first display information stored in the storage unit 204 does not match the second display information, it may cause the first display information and the second display information to be difficult to merge to obtain the third display information, and the near-eye display device 10 may display an error. In one embodiment, the communication unit 203 is configured to establish a second communication with the external terminal 6, and the second communication includes updated display information from the external terminal 6. The updated display information is used to replace at least part of the first display information, and the storage unit 204 is configured to store the updated display information. By replacing at least part of the first display information with the updated display information, the first display information stored in the storage unit 204 can be matched with the second display information. Even if the application is upgraded iteratively, the first display information can still be merged with the second display information to obtain the third display information, ensuring that the near-eye display device 10 can display correctly.

Optionally, in one embodiment, the second display information includes the display content of the external terminal 6 generated based on the movement of the display component 20 relative to the moving area 121. For example, as shown in FIG88, the first moving area 121A, the second moving area 121B and the third moving area 121C correspond to the display content of the navigation, translation and video applications of the external terminal 6 respectively. Before the display component 20 moves, the display component 20 is located in the first moving area 121A. At this time, the external terminal 6 sends the display content of the navigation application of the external terminal 6 corresponding to the first moving area 121A to the near-eye display device 10; when the display component 20 moves from the first moving area 121A to the second moving area 121B, the external terminal 6 sends the display content of the translation application of the external terminal 6 corresponding to the second moving area 121B to the near-eye display device 10, thereby switching the display content of the near-eye display device 10 from the navigation application to the translation application. In this way, when the display component 20 changes between each moving area 121, the display component 20 can display the external terminal corresponding to the moving area 121. The user does not need to operate the display content of the external terminal 6 at one end, and can switch the display content of the external terminal 6 at one end of the near-eye display device 10, which can improve the convenience of use of the near-eye display device 10.

Optionally, in one embodiment, the second display information also includes display content generated based on the movement information and the change of the movement area 121. For example, as shown in FIG88, the first movement area 121A, the second movement area 121B and the third movement area 121C correspond to the display content of the navigation, translation and video applications of the external terminal 6 respectively. When the display component 20 moves from the first movement area 121A to the second movement area 121B, the external terminal 6 can send information that the navigation application is switched to the translation application to the near-eye display device 10. For example, the second display information may include text information "Switch from the navigation application to the translation application", or include icons of the navigation application and the translation application, so that the user can know in time that the movement operation will cause the display content of the near-eye display device 10 to switch from the navigation application to the translation application. In this way, the display component 20 can display the movement operation process of the display component 20 on the lens 12, and the movement operation process is visualized, which is convenient for the user to obtain feedback on the operation in time, and the user experience can be improved.

In order to solve the problem that the display of the near-eye display device 10 is not smooth enough and the display is delayed, as shown in Figures 97 and 91, the near-eye display system 1000 provided by the present application includes the near-eye display device 10 and the terminal 6 as described above, and the near-eye display device 10 is connected to the terminal 6 for communication, and the terminal 6 is configured to establish a first communication with the communication unit 203 of the near-eye display device 10, and the first communication includes the second display information from the terminal 6. The near-eye display device 10 is configured to merge the first display information and the second display information stored in itself to obtain the third display information, and convert the third display information into an optical output and project it to the user side.

The near-eye display system 1000 provided in the present application includes a near-eye display device 10 and a terminal 6. The near-eye display device 10 is communicatively connected to the terminal 6 to split the third display information into first display information and second display information, wherein the first display information can be pre-stored at one end of the near-eye display device 10, and the second display information comes from the terminal 6, so that when the near-eye display device 10 is displaying, only the second display information needs to be transmitted between the communication unit 203 and the terminal 6, thereby reducing the amount of data transmission between the communication unit 203 and the terminal 6. Under the same bandwidth conditions, the communication unit 203 can receive data from the terminal 6 faster, thereby making the display of the near-eye display device 10 smoother and reducing the display delay.

Please refer to FIG. 15 . In one embodiment, the terminal 6 may include an RF circuit 91, a memory 92, an input unit 93, a display unit 94, a sensor 95, an audio circuit 96, a wireless communication module 97, a processor 98, and a power supply 99. The RF circuit 91, the memory 92, the input unit 93, the display unit 94, the sensor 95, the audio circuit 96, and the wireless communication module 97 are respectively connected to the processor 98; the power supply 99 is used to provide power to the terminal 6.

Specifically, the RF circuit 91 is used to receive and send signals; the memory 92 is used to store data instruction information; the input unit 93 is used to input information, which may specifically include a touch panel 931 and other input devices 932 such as operation buttons; the display unit 94 may include a display panel 941, etc.; the sensor 95 includes an infrared sensor, a laser sensor, etc., for detecting user proximity signals, distance signals, etc.; the speaker 961 and the microphone (or microphone) 962 are connected to the processor 98 through the audio circuit 96 for receiving and sending sound signals; the wireless communication module 97 is used to receive and transmit wireless communication signals, so that the terminal 6 can communicate with the near-eye display device 10; the processor 98 is used to process the data information of the terminal. The above terminal is only one embodiment of the present application, and other terminals with wireless communication signal transmission are also within the protection scope of the present application, and the specific internal structure of the terminal is not repeated.

The present application provides a control method for a near-eye display device. The control method 300 is used to control a near-eye display device 10, which includes a lens 12 and a display component 20, wherein the display component 20 is configured to be movably disposed on the lens 12, and the display component 20 includes a housing 211, and a processor 202, a communication unit 203, a storage unit 204, and an output unit 205 disposed in the housing 211, and the communication unit 203, the storage unit 204, and the output unit 205 are electrically connected to the processor 202, respectively. The communication unit 203 is communicatively connected to an external terminal 6, wherein the communication connection mode between the communication unit 203 and the external terminal 6 may be one or more of Bluetooth, ZigBee, or 2.4g. The control method 300 is executed by the processor 202. Referring to FIG. 96, the control method 300 may include steps S310-S340:

S310 , receiving second display information from the external terminal 6 through the communication unit 203 .

Optionally, the second display information may include image or text data that changes with display time during the display process.

S320 , obtaining first display information from the storage unit 204 .

Optionally, the first display information includes image or text data that does not change with display time, or the first display information includes static display information.

S330, combining the first display information and the second display information to obtain third display information;

S340, sending the third display information to the output unit 205, the output unit 205 is used to convert the third display information into an optical output and project it to the user side.

The control method 300 provided in the present application splits the third display information into the first display information and the second display information, wherein the first display information can be pre-stored in the storage unit 204, and the second display information is received through the communication unit 203, so that when the near-eye display device 10 is displaying, only the second display information needs to be transmitted between the communication unit 203 and the external terminal 6, thereby reducing the amount of data transmission between the communication unit 203 and the external terminal 6. Under the same bandwidth conditions, the communication unit 203 can receive data from the terminal 6 faster, thereby making the display of the near-eye display device 10 smoother and reducing the display delay.

The above description is only an implementation method of the embodiment of the present application, and does not limit the patent scope of the embodiment of the present application. The above specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can make many forms of equivalent structures or equivalent process changes made by using the description and drawings of the embodiment of the present application, or directly or indirectly apply them in other related technical fields without departing from the scope of protection of the purpose of the present application and the claims, which are also included in the patent protection scope of the embodiment of the present application.

Claims (20)

A method for controlling a display module, wherein the display module is configured to be placed on an optical lens, and the display module is configured to output image content, the method comprising: Monitoring the motion state of the display module on the lens currently connected; When the target motion state is detected, the display module is controlled to form a graphic interface of the target logic function on the lens; the target motion state is preset as a trigger condition for triggering the target logic function. The method according to claim 1, wherein the target motion state includes: the movement of the display module on the lens satisfies a first preset condition; the target logical function includes: a first logical function; the movement of the display module on the lens satisfies the first preset condition and is preset as a trigger condition for triggering the first logical function; and when the target motion state is detected, controlling the display module to image a graphical interface of the target logical function on the lens comprises: When it is detected that the movement of the display module on the lens satisfies a first preset condition, the display module is controlled to image a first graphic interface of the first logical function on the lens. The method according to claim 2, wherein the first preset condition includes one or a combination of the following: The displacement distance of the movement is not less than a preset first threshold length; The displacement distance of the movement is not less than a preset first threshold length, and the displacement direction of the movement is a preset first direction; The displacement distance of the movement is not less than a preset first threshold length, and the starting point of the movement is a preset first position, which is a fixed position selected on the lens; The displacement distance of the movement is not less than a preset first threshold length, the displacement direction of the movement is a preset first direction, and the starting point of the movement is the first position; The end point of the movement is a preset second position, and the second position is a fixed position selected on the lens; The shape similarity between the moving trajectory and the preset trajectory is not less than a preset first threshold. The method according to claim 1, wherein the target motion state comprises: the display module is stationary at a third position on the lens, the third position is a fixed position selected on the lens; the target logic function comprises: a second logic function; the display module is stationary at the third position on the lens and is preset as a trigger condition for triggering the second logic function; and when the target motion state is detected, controlling the display module to image a graphical interface of the target logic function on the lens comprises: In a case where it is detected that the display module is stationary at a third position on the lens, the display module is controlled to image a second graphic interface of the second logical function on the lens. The method according to claim 1, wherein the target motion state includes: the display module performs axial rotation; the target logical function includes: a third logical function, and the third logical function is a logical function currently running in the foreground; when the target motion state is detected, controlling the display module to image a graphical interface of the target logical function on the lens comprises: When the axial rotation of the display module is detected, the display module is controlled to update the target area in the third graphic interface currently imaged on the lens; the third graphic interface is the graphic interface of the third logical function, and the target area is the graphic area corresponding to the sub-function in the third logical function; the axial rotation of the display module is preset as a trigger condition for triggering the sub-function in the third logical function. The method according to claim 5, wherein, when the display module is detected to be rotating about an axis, controlling the display module to update a target area in a third graphical interface currently imaged on the lens comprises: When it is detected that the rotation angle of the display module during the axial rotation is not less than a preset first threshold angle, the display module is controlled to update the target area in the third graphic interface currently imaged on the lens. The method according to claim 1, wherein the method further comprises: detecting contact of a touch portion of the display module; The graphical interface of controlling the display module to image the target logic function on the lens when the target motion state is detected includes: When it is detected that the duration of the touch portion being touched is not less than a preset first threshold duration and the target motion state is monitored, the display module is controlled to image a graphic interface of the target logical function on the lens. The method according to claim 7, wherein the method further comprises: When it is detected that the touch portion is touched for a duration not less than a preset second threshold duration and it is monitored that the display module is always stationary on the lens, or when it is not detected that the touch portion is touched for a duration not less than a third threshold duration, the anti-false touch mode is started; the anti-false touch mode refers to a mode in which the display module is controlled to keep imaging a graphical interface of a logic function currently running in the foreground on the lens; The first threshold duration is shorter than the second threshold duration. The method according to claim 8, wherein the method further comprises: When it is detected again in the false touch prevention mode that the touch portion is touched for a duration not less than a fourth threshold duration, the false touch prevention mode is released; and the fourth threshold duration is less than or equal to the first threshold duration. The method according to claim 9, wherein the method further comprises: When the accidental touch prevention mode is activated, a prompt is outputted to prompt the user that the accidental touch prevention mode has been activated; When the accidental touch prevention mode is canceled, a prompt is outputted to prompt the user that the accidental touch prevention mode has been canceled. The method according to claim 7, wherein the method further comprises: When it is detected that the display module is stationary on the lens and the touch portion is touched, the display module is controlled to form an image of moving prompt content around the display module on the lens. The method according to claim 7, wherein the method further comprises: When it is monitored that the display module is stationary on the lens and the touch portion is detected to be touched according to the target touch mode, the display module is controlled to image the graphic interface of the target logical function on the lens, or the display module is controlled to update the target area in the third graphic interface currently imaged on the lens; the third graphic interface is the graphic interface of the third logical function, the third logical function is the logical function currently running in the foreground, and the target area is the graphic area corresponding to the sub-function in the third logical function; the target touch mode is preset as a trigger condition for triggering the target logical function or is preset as a trigger condition for a sub-function of the third logical function. The method according to claim 1, wherein the method further comprises: Acquiring multimedia data; When it is monitored that the display module is stationary on the lens and a target instruction is identified from the multimedia data, the display module is controlled to image a graphical interface of the target logical function on the lens, or the display module is controlled to update a target area in a third graphical interface currently imaged on the lens; the third graphical interface is a graphical interface of a third logical function, the third logical function is a logical function currently running in the foreground, and the target area is a graphical area corresponding to a sub-function in the third logical function; the target instruction is preset as a trigger condition for triggering the target logical function or is preset as a trigger condition for a sub-function of the third logical function. The method according to claim 1, wherein the method further comprises: Obtain eye tracking data; When it is monitored that the display module is stationary on the lens and a target eye movement pattern is identified from the eye tracking data, the display module is controlled to image a graphical interface of the target logical function on the lens, or the display module is controlled to update a target area in a third graphical interface currently imaged on the lens; the third graphical interface is a graphical interface of a third logical function, the third logical function is a logical function currently running in the foreground, and the target area is a graphical area corresponding to a sub-function in the third logical function; the target eye movement pattern is preset as a trigger condition for triggering the target logical function or is preset as a trigger condition for a sub-function of the third logical function. According to claim 1, when the target motion state is detected, controlling the display module to image the graphical interface of the target logic function on the lens comprises: When a target motion state is detected in a preset imaging area on the lens, controlling the display module to image a graphical interface of the target logic function on the lens; The method further comprises: When it is detected that the display module moves out of the preset imaging area, a low power consumption mode is started. A display module control device, wherein the display module is used to be connected to the lens of glasses and used to form an image on the connected lens, and the control device comprises: A first monitoring module, used for monitoring the motion state of the display module on the lens currently connected; The first control module is used to control the display module to image a graphical interface of a target logic function on the lens when a target motion state is detected; the target motion state is preset as a trigger condition for triggering the target logic function. The control device according to claim 16, wherein the target motion state comprises: the movement of the display module on the lens satisfies a first preset condition; the target logical function comprises: a first logical function; the movement of the display module on the lens satisfies the first preset condition and is preset as a trigger condition for triggering the first logical function; the first control module comprises: The first control submodule is configured to control the display module to image a first graphic interface of the first logical function on the lens when it is detected that the movement of the display module on the lens satisfies a first preset condition. The control device according to claim 17, wherein the first preset condition is one of the following: The displacement distance of the movement is not less than a preset first threshold length; The displacement distance of the movement is not less than a preset first threshold length, and the displacement direction of the movement is a preset first direction; The displacement distance of the movement is not less than a preset first threshold length, and the starting point of the movement is a preset first position, which is a fixed position selected on the lens; The displacement distance of the movement is not less than a preset first threshold length, the displacement direction of the movement is a preset first direction, and the starting point of the movement is the first position; The end point of the movement is a preset second position, and the second position is a fixed position selected on the lens; The shape similarity between the moving trajectory and the preset trajectory is not less than a preset first threshold. The control device according to claim 16, wherein the display module is stationary at a third position on the lens, and the third position is a fixed position selected on the lens; the target logical function includes: a second logical function; the display module is stationary at the third position on the lens and is preset as a trigger condition for triggering the second logical function; the first control module 52 includes: The second control submodule is used for controlling the display module to image a second graphic interface of the second logic function on the lens when it is detected that the display module is stationary at a third position on the lens. A near-eye display device, wherein the near-eye display device comprises: a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, a control method of a display module is implemented. The methods include: Monitoring the motion state of the display module on the lens currently connected; When the target motion state is detected, the display module is controlled to form a graphic interface of the target logic function on the lens; the target motion state is preset as a trigger condition for triggering the target logic function.