CN120196200A - Display module control method, near-eye display device, electronic device and medium - Google Patents

Display module control method, near-eye display device, electronic device and medium Download PDF

Info

Publication number
CN120196200A
CN120196200A CN202311733535.5A CN202311733535A CN120196200A CN 120196200 A CN120196200 A CN 120196200A CN 202311733535 A CN202311733535 A CN 202311733535A CN 120196200 A CN120196200 A CN 120196200A
Authority
CN
China
Prior art keywords
display module
lens
logic function
target
preset
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311733535.5A
Other languages
Chinese (zh)
Inventor
郑雄雄
邱实文
贾捷阳
邓旭东
陈小莎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Gages Laboratory Private Ltd
Original Assignee
Gages Laboratory Private Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Gages Laboratory Private Ltd filed Critical Gages Laboratory Private Ltd
Priority to CN202311733535.5A priority Critical patent/CN120196200A/en
Priority to PCT/CN2024/131310 priority patent/WO2025103267A1/en
Publication of CN120196200A publication Critical patent/CN120196200A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the application provides a control method of a display module, a near-eye display device, electronic equipment and a medium. The control method of the display module comprises the steps of monitoring the motion state of the display module on a currently connected lens, controlling the display module to image a graphical interface of a target logic function on the lens under the condition that the target motion state is monitored, and presetting the target motion state as a triggering condition for triggering the target logic function.

Description

Control method of display module, near-eye display device, electronic equipment and medium
Technical Field
The present application relates to the field of near-eye display, and in particular, to a control method of a display module, an electronic device, a near-eye display device, and a medium.
Background
Near-eye display refers to imaging at a short imaging distance from the eye for sensory perception, e.g., virtual Reality (VR) glasses and augmented Reality (Augmented Reality, AR) glasses are both imaged at a short distance from the eye. That is, near-eye display is a relative concept with respect to conventional televisions, displays, and the like. Obviously, the imaging distance from the imaging display panel of the television, the display and other devices to eyes is far longer than that of the VR glasses or the AR glasses and other near-eye display devices.
Currently, near-eye displays can be generally classified into VR, AR, mixed Reality (MR), and Extended Reality (XR).
VR, also known as computer simulated reality. It is an experience created by man-machine interaction and computer-generated three-dimensional simulation. We can interact in the environment by using virtual reality devices, e.g. headphones, controllers. That is, VR is a computer simulation system that can create and experience a virtual world, which uses a computer to create a simulated environment and immerse us in this environment.
AR, a real-time, direct or indirect observation of a real-world physical environment. It merges what we see in the real environment with the computer software generated digital content in some way enhancing the real environment in which we are located. The AR system transmits virtual information to the earphone or the intelligent glasses in real time through the camera, or the virtual information is clearly viewed through the mobile device, so that a user can clearly view the 3D image.
MR is a fusion of the real world and the virtual world to create new environments and visualizations. Wherein the physical object and the digital object coexist and interact in real time. This means that if a new image is placed in real space, this new image will interact to some extent with real objects in our real environment.
XR refers to the combination of all real and virtual environments and man-machine interactions generated by computer technology and wearable devices. XR fuses the world by digitally enhancing our sense. In addition, it provides a number of different levels of virtual sensor input levels for an immersive virtual experience. XR includes the three emerging technologies described above, VR, AR and MR.
Disclosure of Invention
In the related art AR, a user has a need to quickly interact with virtual information. The embodiment of the application aims to provide a control method of a display module, electronic equipment, a near-eye display device, a medium, a chip and a computer program product, so as to solve the technical problem that a user cannot interact with virtual information rapidly in a near-eye display technology independently or semi-independently to a certain extent. The independent solution is to provide a hardware construction scheme, which can work independently without software cooperation, and can achieve the effect that a user can interact with virtual information quickly in the near-to-eye display technology. The semi-independent solution is to provide a hardware construction scheme, and the hardware construction scheme can achieve the effect that a user can interact with virtual information quickly in near-eye display technology when the hardware construction scheme cooperates with software for the user to interact with the virtual information in near-eye display technology, such as AR technology.
A first aspect of an embodiment of the present application provides a control method of a display module configured to be placed on an optical lens, and configured to output image content, the method comprising:
monitoring the motion state of the display module on the currently connected lens;
and under the condition that the target motion state is monitored, controlling the display module to image a graphical interface of a target logic function on the lens, wherein the target motion state is preset as a triggering condition for triggering the target logic function.
A second aspect of an embodiment of the present application provides a control device of a display module configured to be placed on an optical lens, and configured to output image content, the device comprising:
The first monitoring module is used for monitoring the motion state of the display module on the currently connected lens;
The first execution module is used for controlling the display module to image a graphical interface of a target logic function on the lens under the condition that a target motion state is monitored, and the target motion state is preset as a triggering condition for triggering the target logic function.
A third aspect of an embodiment of the present application provides an electronic device, including a processor and a memory, where the memory stores a program or instructions executable on the processor, and the program or instructions implement the steps of the control method of the display module set according to the first aspect when executed by the processor.
A fourth aspect of the embodiments of the present application provides a near-eye display device, including a processor and a memory, where the memory stores a program or instructions executable on the processor, and the program or instructions implement the steps of the control method of the display module set according to the first aspect when executed by the processor.
A fifth aspect of the embodiments of the present application provides a readable storage medium having stored thereon a program or instructions which, when executed by a processor, implement the steps of the control method of a display module according to the first aspect.
A sixth aspect of the embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the steps of the control method of the display module set according to the first aspect.
A seventh aspect of the embodiments of the present application provides a computer program product stored in a storage medium, the program product being executed by at least one processor to implement the steps of the control method of a display module according to the first aspect.
In the embodiment of the application, the display module for augmented reality display imaging on the lenses of the glasses can do some movements on the lenses connected with the display module instead of fixing the display module on the lenses, the movement state of some movements which the display module can do is preset as a triggering condition for triggering some logic functions, and the display module is controlled to image the graphic interface of the triggered logic functions on the lenses connected with the display module under the condition that the movement state of the display module on the lenses connected with the display module is monitored to meet the triggering condition of some logic functions. Compared with the scheme of fixing the display module on the lens in the related art, the user can control the display module to make a motion capable of triggering the logic function to be triggered on the lens connected with the display module, so that the logic function to be triggered is triggered to start to operate, and further the display module is controlled to image a graphical interface of the triggered logic function on the lens connected with the display module, so that the user can interact with virtual information presented by the display module quickly.
Other technical effects of the present application are described in detail in the following examples.
Drawings
Fig. 1 is a schematic diagram of connection between a display module and a lens according to an embodiment of the present application;
Fig. 2 is a schematic diagram of an application scenario of a display module according to an embodiment of the present application;
fig. 3 is a schematic diagram of an application scenario of a display module according to an embodiment of the present application;
fig. 4 is a schematic diagram of a connection relationship between a display module and an intelligent terminal according to an embodiment of the present application;
FIG. 5 is a schematic diagram of an imaging main interface of a display module according to an embodiment of the present application;
Fig. 6 is a schematic diagram of a step flow of a control method of a display module according to an embodiment of the present application;
fig. 7 is a schematic diagram of an application scenario of a display module according to an embodiment of the present application;
Fig. 8 is a schematic diagram of an application scenario of a display module according to an embodiment of the present application;
Fig. 9 is a schematic diagram of an application scenario of a display module according to an embodiment of the present application;
Fig. 10 is a schematic diagram of an application scenario of a display module according to an embodiment of the present application;
FIG. 11 is a schematic diagram of an application scenario of a display module according to an embodiment of the present application;
Fig. 12 is a schematic diagram of an application scenario of a display module according to an embodiment of the present application;
fig. 13 is a schematic diagram of an application scenario of a display module according to an embodiment of the present application;
Fig. 14 is a schematic diagram of an application scenario of a display module according to an embodiment of the present application;
fig. 15 is a schematic diagram of a step flow of a control method of a display module according to an embodiment of the present application;
Fig. 16 is a schematic diagram of a step flow of a control method of a display module according to an embodiment of the present application;
FIG. 17 is a schematic diagram of an application scenario of a display module according to an embodiment of the present application;
Fig. 18 is a schematic structural diagram of a control device of a display module according to an embodiment of the present application;
Fig. 19 is a schematic structural diagram of an electronic device according to an embodiment of the present application;
fig. 20 is a schematic structural diagram of an electronic device according to an embodiment of the present application;
Fig. 21 is a schematic structural diagram of a near-eye display device according to an embodiment of the application.
Detailed Description
The technical solutions of the embodiments of the present application will be clearly described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments, which are obtained by a person skilled in the art based on the embodiments of the present application, fall within the scope of protection of the present application.
The terms first, second and the like in the description and in the claims, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged, as appropriate, such that embodiments of the present application may be implemented in sequences other than those illustrated or described herein, and that the objects identified by "first," "second," etc. are generally of a type, and are not limited to the number of objects, such as the first object may be one or more. Furthermore, in the description and claims, "and/or" means at least one of the connected objects, and the character "/", generally means that the associated object is an "or" relationship.
The embodiment of the application provides a control method, a device, equipment, a near-to-eye display device, a storage medium, a chip and a computer program product of a display module, which can effectively solve the technical problem that a user cannot interact with virtual information rapidly in an AR or near-to-eye display technology. The following description refers to the accompanying drawings. In order to facilitate (correctly) understanding the embodiments of the present application, technical terms that may be related to the embodiments of the present application are defined and explained below, and unless otherwise specified hereinafter, the semantics of the corresponding technical terms follow the definitions herein:
Computer or computing device refers to all electronic devices based on the Turn-on-computer theory, von Neumann composition, or Harvard composition. For example, mobile phones, smart watches, single chip systems, etc. are computers, not just limited to the narrow-sense computers such as personal computers (PCs, personal Computer) described in daily life.
An application, i.e., a Computer application Program (Computer Program or Application Software), written in some programming language, runs on some target architecture Computer system. A computer application refers to a coded instruction sequence that can be executed by a device having information processing capability such as a computer to obtain a certain result, or a symbolized instruction sequence or symbolized sentence sequence that can be automatically converted into a coded instruction sequence.
Logic functions refer to various functions provided by various electronic devices such as near-eye display devices, computers, and computing devices (having independent computing capabilities). These functions may be user-oriented functions or system (or device) oriented functions. For example, the user-oriented logic functions may be graphical user interface (GRAPHICAL USER INTERFACE, GUI) output functions, audio output functions, a main interface or desktop, programs/applications, sub-functions in programs/applications, and so forth. Wherein the main interface or desktop, application, etc. may provide the user with a GUI for the user to interact with. The system-oriented logic functions may be defragmentation, system error diagnosis, etc.
Foreground operation and background operation, namely, foreground operation and background operation are two opposite concepts. Both of which are intended to describe how an application/program or process runs in an operating system (operating system refers to software in a computer that enables the application to communicate with the underlying hardware of the computer). In the following, a foreground operation and a background operation are described by taking a conventional computer as an example, and features of the foreground operation and the background operation in the AR technology are similar to those of the conventional computer. In a conventional computer, when an application is running in the foreground, a GUI of the application is typically displayed on a display screen, a user can see the GUI or window of the application, and can directly interact or communicate with the application based on the GUI, where the application typically occupies an input device (such as a mouse and a keyboard), the application running in the foreground typically blocks a user interface, and the user needs to wait for the execution of the application running in the foreground to complete or interact according to the requirements of the application running in the foreground, and is suitable for tasks that require real-time feedback from the user or input from the user. In a traditional computer, when an application runs in the background, GUI is not output on a display screen, namely is invisible to a user, the user cannot interact or communicate with the application directly, when the application runs in the background, the user can continue to use the computer to execute other tasks, and the application runs silently in a state of being invisible to the user, such as file processing, system service execution and the like, the application running in the background usually does not occupy input equipment, the user does not need to directly participate in task execution, the user is allowed to continue to carry out other tasks while the application executes, and the multitasking capability of the system is improved.
The display module refers to a display component, a display device or a display device based on optical technology imaging. Thus, the display module is a physical hardware module. In some alternative embodiments, the display module may be attached to the lens and powered up for imaging through the display module. The lenses may be, for example, sunglasses, glasses for vision correction, goggles or masks with lenses, etc. which are common in daily life, and may also be lenses of smart glasses with audio, sensing, etc. The display module can be connected to the lens by means of magnetic force, clips and the like, so that the display module can move freely on the lens connected with the display module or move in a formulated setting area, for example, the display module can move linearly or curvilinearly on the placed lens, rotate on an axis and the like.
Exemplary, as shown in fig. 1, fig. 1 is a schematic diagram illustrating connection between a display module and a lens according to an embodiment of the present application. Referring to fig. 1, lenses of glasses are used as an example, but the application is not limited to glasses, and may also be lenses of a head-mounted device such as a helmet, eye protection, vision correction, sports, etc., wherein the glasses 1 may be ordinary glasses, AR glasses, smart glasses, etc. The glasses 1 comprise a glasses frame 11, lenses 12 embedded in the glasses frame 11 and glasses legs 13 movably connected to the glasses frame 11. The lens 12 includes an ambient side 24 and an eye side 22, and the eyes of the user can see the physical environment of the ambient side 24 through the lens 12 from the eye side 22, optionally, the display module 2 is provided with a first magnetic attraction member at one end of the lens 12 facing the ambient side 24, and the display module 2 is provided with a second magnetic attraction member at the other end of the lens 12 facing the eye side 22, and it is understood that two magnetic attraction members that are attracted to each other are provided at two sides of the lens 12, so as to realize pre-fixing of the display module on the lens, where the first magnetic attraction member and the second magnetic attraction member may be magnets that are attracted to each other, or one of them may be a magnet, or the other may be a metal that is attracted by the magnet, so as to enable the display module 2 to be integrally attracted to the lens 12, and at this time the display module 2 can also slide freely or rotate axially on the lens 12 without being detached from the lens 12. Of course, other embodiments, such as adsorption movements, are also possible here.
As shown in fig. 2 and fig. 3, fig. 2 and fig. 3 are schematic diagrams of an application scenario of a display module provided by an embodiment of the present application, and fig. 3 may be a front view of the glasses 1 when the directions of the temples 13 of the glasses 1 are observed (i.e. the eye sides 22). Referring to fig. 1, fig. 2 and fig. 3 in combination, in fig. 1, the direction indicated by the straight arrow a, that is, the direction of the virtual image imaged by the display module 2 on the lens 12 is observed by the eye line, and the user views the end face of the display module 2 from the direction indicated by the arrow a, so that the virtual image or the graphical interface formed on the lens 12 based on the AR technology can be seen. I.e. the end face of the display module 2 seen from the direction of arrow a shown in fig. 1 is the display area 21 of the display module 2, and the display area 21 may be in a "lit" state when the display module 2 is in operation, i.e. capable of forming image content, e.g. related display content which may comprise text, interactive interfaces, video, images, etc. The area of the lens 12 not occupied by the display module 2 still maintains the properties of the lens 12 itself, for example as a property of the lens itself where the user can see through the lens 12 through the eye side to the environment side, for example for eye protection, vision correction, etc.
In some alternative embodiments, the center position of the lens 12 is a calibration position, which is a reference position of the display module 2, at which the display module 2 images a main interface or an interface of a preset logic function on the lens 12 when it is stationary. The center position of the lens 12 is determined as the calibration position because the display module 2 can be moved in more circumferential directions and distances at the center position, so that the user can conveniently operate the display module 2 and customize the preset imaging area.
After wearing the glasses 1, the user can press (or pinch) the touch portion of the display module 2 by hand to drag the display module 2 to move on the lens 12 or rotate the display module 2 to rotate the display module 2 around the axis. In some embodiments, the display module 2 may be located on the ambient side 24, and the light of the display area 21 may reach the eye of the user on the eye side 22 through the lens to form an image, and the touch portion may be located on the ambient side 24, so that the user may interact better, while in other embodiments, the display module 2 may be located on the eye side 22, and the light of the display area 21 may directly enter the eye of the user to form an image, and the touch portion may be located on the eye side 22, so that the user may interact better and more hidden.
In some alternative embodiments, the virtual image or the graphical interface imaged by the display area 21 of the display module 2 on the lens 12 may be derived from the display module 2 itself or the glasses 1 communicatively connected to the display module 2, but in other embodiments, the virtual image or the graphical interface may also be derived from other electronic devices that are relatively independent from both the glasses 1 and the display module 2, such as a smart terminal or a computer, such as a mobile phone, a tablet computer, and the like. If the glasses 1 are ordinary glasses, the virtual image or the graphical interface imaged by the display module 2 on the lens 12 may be derived from other electronic devices that are relatively independent from both the glasses 1 and the display module 2, such as smart terminals or computers, such as mobile phones, tablet computers, and the like.
Exemplary, as shown in fig. 4, fig. 4 is a schematic diagram of a connection relationship between a display module and an intelligent terminal according to an embodiment of the present application. Referring to fig. 4, the display module 2 is (physically) connected to the near-eye display device 10, where the near-eye display device 10 may be the glasses 1, and the smart terminal 4 may be a PC, a laptop, a smart phone, a tablet computer, a smart speaker, a server, etc., and a wired or wireless communication connection is established between the display module 2 and the smart terminal 4. For example, the display module 2 and the intelligent terminal 4 communicate based on Wifi protocol or BlueTooth protocol, or the display module 2 and the intelligent terminal 4 communicate based on USB transmission protocol by means of USB cable, and the display module 2 also obtains electric power from the intelligent terminal 4 by means of USB cable. Of course, not limited to the foregoing examples, the display module 2 and the smart terminal 4 may also establish wired or wireless communication connection based on other communication protocols, such as NFC communication protocol, P2P (peer-to-peer) network, and so on. The display module 2 and the near-eye display device 10 together form a display device of the intelligent terminal 4, and the GUI output by the intelligent terminal 4 is imaged on the near-eye display device 10 through the display module 2.
In some alternative embodiments, a touch sensor or pressure, a capacitance sensor, etc. may be provided on the touch portion of the display module 2 to detect whether the touch portion of the display module 2 is touched. In some alternative embodiments, a miniature camera is also provided on the touch portion of the display module 2 to collect image/video data from the environment. In some alternative embodiments, a miniature microphone is also provided on the touch portion of the display module 2 to collect ambient sounds from the environment. In some alternative embodiments, a miniature camera is also provided on one side of the display area 21 of the display module 2 to capture an eye image of the user wearing the glasses 1 to track the eyeballs of the user.
The trigger condition refers to a condition which is preset in advance and triggers the running or executing of the logic function. In some optional implementations of the embodiments of the present application, certain motion states of the display module are preset as trigger conditions for certain logic functions. For example, when the display module is preset to trigger the output main interface function at a certain set position on the lens connected with the display module, if the display module is monitored to be at the set position subsequently, the display module will form an imaging main interface on the lens connected with the display module, and the user can observe the main interface formed on the lens by observing the display area of the display module. Optionally, there may be (thumbnails of) icons of at least one application (or file) in the main interface. The certain set position can be the center position of the lens, and can be the position which is easy to memorize and recognize, such as four corners of the frame.
The preset imaging area refers to an imaging area preset for the display module on a lens connected with the display module in advance. In some alternative embodiments, the predetermined imaging area may be a regular area on the lens to which the display module is connected, such as a rectangular area, a circular area, or an elliptical area. In some alternative embodiments, the predetermined imaging area may also be an irregular area on the lens to which the display module is connected. In some alternative embodiments, the preset imaging area may also be the entire lens area of the lens to which the display module is connected. In some alternative embodiments, the preset imaging area may also be a partial area of the lens to which the display module is connected.
Exemplary, as shown in fig. 5, fig. 5 is a schematic diagram of an imaging main interface of a display module according to an embodiment of the present application. Referring to fig. 5, in this example, the predetermined imaging area of the display module 2 is the entire lens area of the lens 12. After the user wears the glasses 1, the user views (i.e., eyes) the lens 12 from the side of the temple 13 (please refer to fig. 1 and 2), and the user can observe the main interface imaged by the display module 2 on the lens 12 by observing the display area 21 of the display module 2. That is, in the example of fig. 5, when the display module 2 is resting at the illustrated position on the lens 12 (the position is not limited to the position shown in fig. 5, and the user may set the logic function of the output main interface by himself or herself when the display module 2 is resting at any position of the lens 12). In the example of fig. 5, the preset imaging zone 121, i.e. the entire lens area of the lens 12, the preset imaging zone 121 is divided into a plurality of sub-areas (e.g. 6 sub-areas as shown in fig. 5), in each of which (a thumbnail of) an icon of an application or file to which the sub-area maps is imaged, e.g. an icon of application F is imaged in sub-area 1211 and an icon of application E is imaged in sub-area 1212. In FIG. 5, a common example illustrates the imaging of icons of applications A-I in six sub-areas. In other alternative embodiments, at least one of the icons a-I may be (a thumbnail of) a file icon of video, picture, audio, text, etc.
In some alternative embodiments, the display module 2 defaults to imaging the main interface on the lens 12 when the display module 2 is first attached to the lens 12 and the display module 2 is turned on.
It should be noted that, in fig. 5, in order to facilitate the description of the main interface by dividing a plurality of sub-areas, grid lines (i.e., the dotted grid on the lens 12) indicating each sub-area are illustrated in fig. 5, and should not be understood as having to be a grid line in the main interface imaged by the display module 2 provided by the embodiment of the present application, it is obviously not necessary, that is, the grid line may not be present in the imaged main interface, that is, after the display module 2 is placed on the lens 12, the body of the lens 12 is not able to see the grid line, and the lens 12 still maintains the attribute of the lens itself. Of course, if the lenses themselves are holographic-type lenses employing, for example, optical waveguides, they may be combined with one another for simple cues and the like. Of course, the user may also be provided with a setup option for the user to select whether the grid lines are also imaged while imaging the main interface. If the user sets the main imaging interface and images the grid lines, the display module images the grid lines while imaging the main imaging interface. If the grid line is not imaged when the user sets the imaging main interface, the display module does not image the grid line on the imaging main interface. Of course, the network line may also be a network line corresponding to a graphical interface on the intelligent terminal (e.g., mobile app), so that the user can conveniently divide or customize the preset imaging area 121 through the graphical interface of the terminal. Further, the line shape of the grid lines is not limited to the broken line shown in fig. 5, and may be a solid line, a center line, or the like.
The embodiment of the application provides a control method of a display module, which is used for being connected to lenses of glasses and imaging on the connected lenses. The control method of the display module may be at least one of the glasses 1, the display module 2, the near-eye display device 10 or the intelligent terminal of fig. 1 to 5, which can realize specific information for controlling the GUI imaged by the display module 2 on the glasses 1 (or the near-eye display device 10) to which it is connected. Fig. 6 is a schematic diagram of a step flow of a control method of a display module according to an embodiment of the application, as shown in fig. 6. Referring to fig. 6, the control method of the display module includes:
s11, monitoring the motion state of the display module on the currently connected lens;
The lenses are lenses on the glasses to which the display module is currently connected, and may be described in the above embodiments, which are not described herein.
In some alternative embodiments, an inertial sensor or an acceleration sensor (or a gyroscope) is built in the display module, and the instantaneous speed and the acceleration of the display module can be acquired through the sensor, so that the motion state of the display module is determined according to the acquired instantaneous speed and acceleration and the parameters such as time.
And S12, controlling the display module to image a graphical interface of a target logic function on the lens under the condition that a target motion state is monitored, wherein the target motion state is preset as a triggering condition for triggering the target logic function.
The target logical function may be at least one logical function determined from all (user-oriented and system-oriented) logical functions provided by the device or system.
By way of example, the target logical function may be an output home interface function, a function of outputting a chat interface of a social application, outputting a search interface of a browser, and so forth.
In the embodiment of the application, the motion state of the display module on the lens can be roughly divided into two types, namely, one in which the display module is in relative rest on the lens and the other in which the display module is in relative motion on the lens. The display modules are in relative motion on the lens and can be generally divided into two types, namely, the display modules can move on the lens (movement means from one point to another point on the lens) or rotate (around the central axis of the display modules, in the example shown in fig. 1, the axis coincident with arrow a) on the lens. The target motion state can be a motion state which is determined in advance from various possible motion states of the display module and can trigger a target logic function. In other embodiments, the motion may also include a multi-segment motion, i.e., a combination of multiple segments of straight lines on the lens, or a "pattern-like" motion, such as a trace-like motion of a fold segment, L, Z letter, or the like.
In some optional embodiments, when the motion state of the display module is determined to be the target motion state according to the acquired parameters such as the instantaneous speed and the acceleration and the combination time, the target logic function whose trigger condition is the target motion state is triggered, the target logic function starts to run or execute after being triggered (if the triggered target logic function is an application running in the background, the target logic function is switched to the foreground to run), and when the target logic function executes or runs, the target logic function correspondingly controls the display module to image the graphical interface of the target logic function on the lens.
Illustratively, taking the embodiment shown in fig. 1-3 as an example, the target motion state may be a linear motion of the display module 2 on the lens 12, a resting of the display module 2 on the lens 12 at a set position (the set position is a preselected fixed position), or a movement of the display module 2 on the lens 12 along a diagonal of the lens 12 (assuming that the lens has four corners, a line between any two non-adjacent corners, i.e., a diagonal), or the like. Meanwhile, the display module 2 performs linear motion on the lens 12 and is preset as a trigger condition for outputting the function of the chat interface of the social application, the display module 2 is still at a set position on the lens 12 and is preset as a trigger condition for outputting the function of the main interface, and the display module 2 moves on the lens 12 along the diagonal line of the lens 12 and is preset as a trigger condition for outputting the search interface of the browser.
For example, when the display module 2 is monitored to do a linear motion on the lens 12, the display module 2 is controlled to image a chat interface of a social application on the lens 12, when the display module 2 is monitored to be static at a set position on the lens 12, the set position can be a position which is better identified by the center of the lens or the like, or a position defined by a user according to own preference, the set position is controlled to image a main interface of the display module 2 on the lens 12 (please refer to fig. 5 and related embodiments), when the display module 2 is monitored to move along a diagonal on the lens 12, the display module 2 is controlled to image a search interface of a browser on the lens 12.
In the embodiment of the application, the display module for augmented reality display imaging on the lenses of the glasses can do some movements on the lenses connected with the display module instead of fixing the display module on the lenses, the movement state of some movements which the display module can do is preset as a triggering condition for triggering some logic functions, and the display module is controlled to image the graphic interface of the triggered logic functions on the lenses connected with the display module under the condition that the movement state of the display module on the lenses connected with the display module is monitored to meet the triggering condition of some logic functions. Compared with the scheme of fixing the display module on the lens in the related art, the user can control the display module to make a motion capable of triggering the logic function to be triggered on the lens connected with the display module, so that the logic function to be triggered is triggered to start to operate, and further the display module is controlled to image a graphical interface of the triggered logic function on the lens connected with the display module, so that the user can interact with virtual information presented by the display module quickly.
In some optional embodiments, the target motion state includes that the movement of the display module on the lens meets a first preset condition, the target logic function includes a first logic function, that the movement of the display module on the lens meets a first preset condition is preset as a trigger condition for triggering the first logic function, and step S12 includes:
And controlling the display module to image a first graphical interface of the first logic function on the lens under the condition that the movement of the display module on the lens is monitored to meet a first preset condition.
In some alternative embodiments, the detection of the movement of the display module may be a process of detecting that the instantaneous speed of the display module changes from 0 to 0 again (referred to as a first process, which will be hereinafter referred to as a first process, and all the first processes refer to a process of detecting that the instantaneous speed of the display module changes from 0 to 0 again). And if the monitored abrupt change process of the instantaneous speed meets a first preset condition, controlling the display module to image a first graphical interface of the first logic function on the lens.
In some alternative embodiments, the first logic function may refer broadly to at least one logic function determined from all (user-oriented and system-oriented) logic functions provided by the device or system.
Illustratively, the first logical function may be an output main interface, a telephone dial-up, a smart assistant, a music player, a video player, a camera, an album, a social application, and so forth.
In some optional embodiments, the first preset condition may be any one or a combination of the following conditions ① to ⑥, which are examples:
Conditional ①, the displacement distance Δs of the movement is not less than a preset first threshold length S 1;
The displacements described in the embodiments of the present application are all subject to physical definition. That is, displacement refers to movement of an object from an initial position to a final position over a period of time, and a directional line segment from the initial position to the final position is a displacement. The length of the directional line segment is referred to as a displacement distance, and the direction of the directional line segment is referred to as a displacement direction.
In some alternative embodiments, if ΔS of the display module is greater than or equal to S 1 during the first process, the display module is controlled to image a first graphical interface of a first logic function on the lens.
Illustratively, the first logical function is a telephone dialing function. Fig. 7 is a schematic diagram of an application scenario of a display module according to an embodiment of the present application, as shown in fig. 7. Referring to fig. 7, when the first process of the display module 2 on the lens 12 is monitored, and Δs of the display module 2 is greater than or equal to S 1 in the first process, a phone dialing function is triggered, and the display module 2 is controlled to image a dialing interface of the phone dialing function on the lens 12.
Condition ② that the displacement distance DeltaS of the movement is not less than a preset first threshold length S 1, and the displacement direction of the movementIs a preset first direction
In some alternative embodiments, ΔS of the display module is greater than or equal to S 1 during the first process of monitoring, and the display module is in the first process of monitoringAnd (3) withIf the directions of the first logic function are the same, controlling the display module to image a first graphical interface of the first logic function on the lens.
Illustratively, the first logic function is a smart assistant function. Referring to FIG. 7, after a first process of the display module 2 on the lens 12 is detected, ΔS of the display module 2 is greater than or equal to S 1 and the display module 2 is displayedAnd (3) withIf the directions are the same, the intelligent assistant function is triggered, and the display module 2 is controlled to image a (voice or text) instruction acquisition interface of the intelligent assistant function on the lens 12.
Condition ③, the displacement distance Δs of the movement is not less than a preset first threshold length S 1, and the Start Point (SP) of the movement is a preset first position (P1), the first position (P1) being a selected fixed position on the lens;
In some alternative embodiments, when Δs of the display module is greater than or equal to S 1 in the first process and when it is detected that the instantaneous speed of the display module is suddenly changed from 0 to a point t other than 0 in the first process, the display module is at the position P1, that is, the starting point SP of the movement of the display module in the first process is the position P1 selected in advance on the lens, the display module is controlled to image the first graphical interface of the first logic function on the lens.
Illustratively, the first logic function is a music player function. Referring to fig. 7, when the first process of the display module 2 on the lens 12 is detected, and the starting point SP of the movement of the display module 2 in the first process is the position P1 selected in advance on the lens 12 (for example, P1 is the center point on the lens 12), the music player function is triggered, and the display module 2 is controlled to image the song playing interface of the music player function on the lens 12.
Condition ④ that the displacement distance DeltaS of the movement is not less than a preset first threshold length S1, and the displacement direction of the movementIs a preset first directionAnd the Start Point (SP) of the movement is the first position;
In some alternative embodiments, ΔS of the display module is greater than or equal to S 1 during the first process of monitoring, and the display module is in the first process of monitoring And (3) withWhen the instant speed of the display module is monitored to be suddenly changed from 0 to a point t which is not 0 in the first process, the display module is at the position P1, namely the starting point SP of the movement of the display module in the first process is the position P1 selected on the lens in advance, and then the display module is controlled to image a first graphical interface of a first logic function on the lens.
Illustratively, the first logic function is a video player function. Referring to fig. 7, after a first process of the display module 2 on the lens 12 is detected, the display module 2 is displayed in the first processAnd (3) withThe direction of the display module 2 is the same, and the starting point SP of the movement of the display module 2 in the first process is the position P1 selected on the lens 12 in advance (for example, P1 is the center point on the lens 12), so as to trigger the music player function and control the display module 2 to image the video playing interface of the video player function on the lens 12.
Condition ⑤, the end point of movement (EP) is a preset second position (P2), the second position (P2) being a selected fixed position on the lens;
In some alternative embodiments, when the instant speed of the display module is monitored to be changed from 0 to 0 again in the first process, at the point t, the display module is at the position P2, that is, the end point EP of the movement of the display module in the first process is the position P2 selected in advance on the lens, then the display module is controlled to image the first graphical interface of the first logic function on the lens. That is, no matter how the display module moves on the lens, the first logic function is triggered whenever the display module moves to a preselected position P2 on the lens.
Illustratively, the first logic function is a camera function. Fig. 8 is a schematic diagram of an application scenario of a display module according to an embodiment of the present application, as shown in fig. 8. Referring to fig. 8, when the first process of the display module 2 on the lens 12 is detected, and the end point EP of the display module 2 is the upper boundary of the lens 12 (or the preset imaging area) in the first process, the camera function is triggered, and the display module 2 is controlled to image the functional interface of the camera on the lens 12.
Illustratively, the first logical function is an album function. Fig. 9 is a schematic diagram of an application scenario of a display module according to an embodiment of the present application, as shown in fig. 9. Referring to fig. 9, when the first process of the display module 2 on the lens 12 is detected, and the end point EP of the display module 2 in the first process is the lower boundary of the lens 12 (or the preset imaging area), the album function is triggered, and the display module 2 is controlled to image the functional interface of the album on the lens 12.
Illustratively, the first logical function is a social application function. Fig. 10 is a schematic diagram of an application scenario of a display module according to an embodiment of the present application, as shown in fig. 10. Referring to fig. 10, when the first process of the display module 2 on the lens 12 is detected, and the end point EP of the display module 2 in the first process is at the left boundary of the lens 12 (or the preset imaging area), the social application function is triggered, and the display module 2 is controlled to image the functional interface of the social application on the lens 12.
Illustratively, the first logic function is a navigation function. Fig. 11 is a schematic diagram of an application scenario of a display module according to an embodiment of the present application, as shown in fig. 11. Referring to fig. 11, when the first process of the display module 2 on the lens 12 is detected, and the end point EP of the display module 2 in the first process is the right boundary of the lens 12 (or the preset imaging area), the navigation function is triggered, and the display module 2 is controlled to image the functional interface of navigation on the lens 12.
Illustratively, the first logical function is an output main interface function. When the first process of the display module 2 on the lens 12 is detected, and the end point EP of the display module 2 in the first process is the center point of the lens 12 (or the preset imaging area), the output main interface function is triggered, and the display module 2 is controlled to image the output main interface on the lens 12.
The shape Similarity (Sim) between the moving track l and the preset track l 1 is not smaller than the preset first threshold α under the condition ⑥.
In some alternative embodiments, if the shape similarity Sim between the moving track l and the preset track l 1 is not smaller than the preset first threshold α, the display module is controlled to image a first graphical interface of the first logic function on the lens.
Fig. 12 is a schematic diagram illustrating an application scenario of a display module according to an embodiment of the present application, as shown in fig. 12. Referring to fig. 12, when a first process of the display module 2 on the lens 12 is detected, and the shape similarity Sim between the moving track l and the preset track l 1 is not smaller than the preset first threshold α, the first logic function is triggered, and the display module 2 is controlled to image a functional interface of the first logic function on the lens 12.
The shape similarity Sim between the track l and the preset track l 1 can be calculated by methods such as euclidean distance, dynamic time warping, cosine similarity, pearson correlation coefficient, manhattan distance, dynamic kernel correlation, average absolute error and the like.
In some alternative embodiments, the different first preset conditions may respectively correspond to the same first logic function, or may respectively correspond to different first logic functions.
For example, taking the scenario shown in fig. 1 to 3 as an example, the movement of the display module 2 on the lens 12 may be satisfied with the above conditions ① to ⑥, which are preset as trigger conditions of different logic functions, respectively (as in the foregoing exemplary description). It is also possible to preset the movement of the display module 2 on the lens 12 to the triggering condition of the same logic function for at least two of the above-mentioned conditions ① to ⑥. For example, the movement of the display module 2 on the lens 12 may satisfy the above condition ① as a trigger condition of a telephone dialing function, the movement of the display module 2 on the lens 12 may satisfy the above condition ⑥ as a trigger condition of a camera function, the movement of the display module 2 on the lens 12 may satisfy the above condition ① as a trigger condition of a telephone dialing function, or the movement of the display module 2 on the lens 12 may satisfy the above condition ⑥ as a trigger condition of a telephone dialing function.
It should be noted that, in the embodiment of the present application, the first preset condition is not limited to the above six items, and a person skilled in the art may flexibly set the first preset condition according to actual needs, for example, the first preset condition may also be that the display module moves on the lens along a preset track, and specifically, the first preset condition may be that the aforementioned display module moves along a diagonal line of the lens.
In some alternative embodiments, the target motion state comprises a third position of the display module resting on the lens, the third position being a selected fixed position on the lens, the target logic function comprising a second logic function, a trigger condition of the display module resting on the lens at the third position being preset to trigger the second logic function, step S12 comprising:
and controlling the display module to image a second graphical interface of the second logic function on the lens under the condition that the display module is monitored to be static at a third position on the lens.
In some alternative embodiments, the second logic function may refer broadly to at least one logic function determined from all (user-oriented and system-oriented) logic functions provided by the device or system. The second logic function may be different from the first logic function or the same as the first logic function.
By way of example, the second logical function may be an output main interface, telephone dialing, a smart assistant, a music player, a video player, a camera, an album, a social application, and so forth.
The third position may be the same as the second position or may be different.
Illustratively, the third location is a center point on the lens, an upper boundary point of the lens (or preset imaging zone), a lower boundary point of the lens (or preset imaging zone), and so on.
By way of example, taking fig. 1 to 12 of the previous examples as an example, in case that the display module 2 is monitored to be stationary at the center point on the lens 12, the display module 2 is controlled to image a main interface on the lens 12, optionally, the outer contour of the main interface is the same as the outer contour of the display area of the display module 2, for example, the main interface is round, optionally, the main interface provides the user with a custom option, i.e. the user can add (thumbnail images of) commonly used files, applications, etc. to the main interface according to his own demand preference and usage habits, etc., and in case that the display module 2 is monitored to be stationary at the upper boundary point on the lens 12, the display module 2 is controlled to image a functional interface of the navigation application on the lens 12.
In some alternative embodiments, the target motion state includes the display module rotating an axis, the target logic function includes a third logic function, the third logic function being a logic function currently running in the foreground, and step S12 includes:
And under the condition that the display module is monitored to perform axial rotation, controlling the display module to update a target area in a third graphical interface which is imaged on the lens currently, wherein the third graphical interface is a graphical interface of a third logic function, the target area is a graphical area corresponding to a sub-function in the third logic function, and the display module performs axial rotation and is preset as a triggering condition for triggering the sub-function in the third logic function.
In some alternative embodiments, the third logical function may refer broadly to at least one logical function running in the foreground out of all (user-oriented and system-oriented) logical functions provided from a device or system.
By way of example, the third logical function may be output home interface, phone dialing, smart assistant, music player, video player, camera, album, social application, and so forth.
In some alternative embodiments, the sub-function in the third logical function may be a page-turning function, a scroll (forward/backward) operation, a zoom, etc. in the logical functions currently running in the foreground.
Fig. 13 and fig. 14 are schematic diagrams of an application scenario of a display module according to an embodiment of the present application, as shown in fig. 13 and fig. 14. For example, the third logic function is an output main interface function, and rotation of the display module 2 along the counterclockwise direction axis shown in fig. 13 may be preset as a trigger condition for triggering page turning up (or down) of the main interface, and rotation of the display module 2 along the clockwise direction axis shown in fig. 14 may be preset as a trigger condition for triggering page turning down (or up) of the main interface. In case that the display module 2 is monitored to rotate along the counterclockwise (or clockwise) axis, the display module 2 is controlled to update the main interface currently imaged on the lens 12, i.e. the display module 2 is controlled to image the last page (or the next page) of the main interface on the lens 12.
For another example, the third logic function is a music player function, and the rotation of the display module 2 along the counterclockwise direction shown in fig. 13 may be preset as a trigger condition for triggering the cutting of songs to the previous (or next) and the rotation of the display module 2 along the clockwise direction shown in fig. 14 may be preset as a trigger condition for triggering the cutting of songs to the next (or previous) respectively. Under the condition that the display module 2 is monitored to rotate along the anticlockwise (or clockwise) axis, the song cutting operation is carried out on the song currently being played, and the display module 2 is controlled to update the interface of the music player imaged on the lens 12 currently, namely, the display module 2 is controlled to update the song information imaged on the interface of the music player on the lens 12 to the information of the previous (or next) song.
In some optional embodiments, the controlling the display module to update the target area in the third graphical interface currently imaged on the lens when the display module is monitored to perform the axial rotation includes:
And under the condition that the rotation angle of the display module for shaft rotation is not smaller than a preset first threshold angle beta, controlling the display module to update a target area in a third graphical interface imaged on the lens currently.
The first threshold angle β may be flexibly set by a person skilled in the art or a user according to actual needs. For example, 15 °, 20 °,25 °,30 °, or the like may be used.
For example, referring to fig. 14, in the case that the rotation angle of the display module 2 along the clockwise axis is not less than the first threshold angle β, the display module 2 is controlled to update the target area in the third graphical interface currently imaged on the lens 12. Therefore, the sub-function of triggering the third logic function when the display module 2 is slightly driven to rotate, and the display module 2 starts to update the third interface imaged on the lens 12 can be avoided. Therefore, the sub-functions of the third logic function can be reduced to some extent.
In other alternative embodiments, the third logic function may also be a background-running logic function. For example, the imaging module in the display module is in a standby state, but the music playing function is always operated in the background, and at the moment, the display module can be still subjected to shaft rotation to preset the triggering condition of the song cutting operation, so that a user can cut songs quickly, and the user can interact with the device quickly conveniently. Only then, the display module is not required to be controlled to update the graphical interface (because the logic function operates in the background, and no graphical interface is output).
The embodiment of the application provides a control method of a display module, which is used for being connected to lenses of glasses and imaging on the connected lenses. The control method of the display module may be at least one of the glasses 1, the display module 2, the near-eye display device 10 or the intelligent terminal of fig. 1 to 5, which can realize specific information for controlling the GUI imaged by the display module 2 on the glasses 1 (or the near-eye display device 10) to which it is connected. Fig. 15 is a schematic diagram of a step flow of a control method of a display module according to an embodiment of the application, as shown in fig. 15. Referring to fig. 15, the control method of the display module includes:
s11, monitoring the motion state of the display module on the currently connected lens;
Please refer to the description of S11, and the description thereof is omitted herein.
S13, detecting contact of a touch part of the display module;
for the step S13, please refer to the description of the display module 2 in the embodiment of fig. 1 to 3, and the description is omitted here.
It should be noted that S11 and S13 are not sequentially related to each other, that is, S11 and S13 may be executed in parallel.
And S14, controlling the display module to image a graphical interface of the target logic function on the lens under the condition that the duration delta T of the touch part is not less than the preset first threshold duration T 1 and the target motion state is monitored.
In contrast to step S14 and step S12, in step S14, the condition of triggering the target logic function to control the display module to image the graphical interface of the target logic function on the lens is increased, and not only the movement state of the display module is monitored to be the target movement state, but also the duration Δt of detecting that the touch portion of the display module is touched is not less than the preset first threshold duration T 1. That is, not only is the movement of the display module on the lens monitored, but also the graphical interface of the target logic function is triggered by the touch of the display module so as to control the display module to image the target logic function on the lens. So that the possibility of false triggers can be avoided in certain scenarios. For example, the user shown in fig. 2 wears the glasses 1 in motion, and the display module 2 may shake along with the motion of the user, where the shake may conform to the target motion state, but if the user is not detected to touch the touch portion of the display module or the touch is detected but the touch duration Δt is less than the preset first threshold duration T 1, the target logic function is not triggered, and the display module is not controlled to image the graphical interface of the target logic function on the lens. Thereby realizing the effective avoidance of false triggering.
The embodiment of the application provides a control method of a display module, which is used for being connected to lenses of glasses and imaging on the connected lenses. The control method of the display module may be at least one of the glasses 1, the display module 2, the near-eye display device 10 or the intelligent terminal of fig. 1 to 5, which can realize specific information for controlling the GUI imaged by the display module 2 on the glasses 1 (or the near-eye display device 10) to which it is connected. Fig. 16 is a schematic diagram of a step flow of a control method of a display module according to an embodiment of the application, as shown in fig. 16. Referring to fig. 16, the control method of the display module includes:
s11, monitoring the motion state of the display module on the currently connected lens;
s13, detecting contact of a touch part of the display module;
S14, controlling the display module to image a graphical interface of the target logic function on the lens when the duration delta T of the touch part is not less than the preset first threshold duration T 1 and the target motion state is detected;
the steps S11-S14 are described in the foregoing, and are not repeated here.
And S15, when the duration delta T of the touch part is detected to be not smaller than a preset second threshold duration T 2 and the display module is detected to be still on the lens all the time, or when the duration delta T of the touch part is not detected to be not smaller than a third threshold duration T 3, starting an anti-false touch mode.
The anti-false touch mode is a graphical interface for controlling the display module to keep imaging a logic function currently running in the foreground on the lens in the mode.
And starting an anti-false touch mode under the condition that the duration delta T of the touch part is not smaller than the preset second threshold duration T 2 and the fact that the display module is always static on the lens is detected. In the embodiment of the application, the functional option of actively starting the anti-false touch mode is provided for the user, and the user can enter the anti-false touch mode only by touching the touch part of the display module for at least T 2 time without moving the display module in the process, so that the graphical interface presented by the display module on the lens is switched to the interface required by the user before the user wears the glasses to do exercises (please combine with fig. 2). For example, before the user rides, the graphical interface presented by the display module on the lens is switched to the navigation interface, and the anti-false touch mode is started, so that the user uses the navigation function in the riding process.
And starting an anti-false touch mode under the condition that the duration of the touch part which is not detected to be touched is not less than a third threshold duration T 3. Namely, the embodiment of the application also provides a functional option for passively starting the anti-false touch mode. The user does not interact with the display module for a long time (namely, the time length of T 3), namely, the display module is not touched, the user can default that the user does not need to interact with the equipment temporarily, the anti-false touch mode can be passively started, the movement state of the display module is stopped, the movement state of the display module is continuously monitored after the anti-false touch mode is released, and therefore the electric energy of the equipment is saved.
In some alternative embodiments, the first threshold duration is less than the second threshold duration. Assuming that the first threshold duration is 1 second and the second threshold duration is 0.5 second, that is, the first threshold duration is longer than the second threshold duration, a situation occurs in which the user does not want to move the display module within the first 0.6 seconds of touching the display module, the anti-false touch mode is started, even if the user moves the display module within the last 0.4 seconds, the movement of the display module is a target motion state, but because the device enters the anti-false touch mode when touching the display module 0.5, the target logic function corresponding to the target motion state (that is, the triggering condition is the target logic function of the target motion state) is not triggered, and accordingly, the display module does not image the graphical interface of the target logic function on the lens. And it is difficult for the user to accurately perceive the touch duration, which may cause inconvenience to the user in use. However, if the first threshold duration is less than the second threshold duration, the aforementioned possible "embarrassment" may be achieved, so as to facilitate the user's interaction with the display module.
In some alternative embodiments, a prompt for prompting the user that the anti-false touch mode has been activated is output at the same time that the anti-false touch mode is activated. The prompt can be a prompt such as text, an image or video animation imaged on the lens by the display module. So that the user knows that the device has initiated the anti-false touch mode.
And S16, under the condition that the duration of the touch part being touched is not smaller than the fourth threshold duration T 4, the false touch preventing mode is released.
After the device enters the anti-false touch mode, under the condition that the touch part of the display module is detected to be touched again and the touch duration reaches the fourth threshold duration T 4, the anti-false touch mode is released. So that the user again interacts with the display module.
In some alternative embodiments, the fourth threshold duration is less than or equal to the first threshold duration.
If the first threshold time is smaller than the fourth threshold time, after the anti-false touch mode is entered, the display module is touched first, the fourth threshold time is needed to be touched, the anti-false touch mode is released, interaction with the display module can be performed, and inconvenience is caused to use of a user. And under the condition that the fourth threshold time is less than or equal to the first threshold time, the user can quickly release the anti-false touch mode so as to interact with the display module again.
In some alternative embodiments, a prompt for prompting the user that the false touch prevention mode is released is output simultaneously with the release of the false touch prevention mode. The prompt can be a prompt such as text, an image or video animation imaged on the lens by the display module. So that the user knows that the device has released the anti-false touch mode.
In some alternative embodiments, when the anti-false touch mode is released, and when the touch portion is detected to be touched after the display module is detected to be stationary on the lens, the display module is controlled to image and move prompt contents on the lens around the display module.
Exemplary, as shown in fig. 17, fig. 17 is a schematic diagram of an application scenario of a display module according to an embodiment of the present application. Referring to fig. 17, when it is detected that the display module 2 is resting on the lens 12 and the touch portion of the display module 2 is touched, the display module 2 is controlled to image the movement prompting content for prompting the user to move the display module 2 in multiple directions on the lens 12 around the display module 2 as shown in fig. 17.
In some alternative embodiments, the control method of the display module provided by the embodiment of the present application further provides some other ways to enable the user to interact with the glasses (or near-eye display device) or the apparatus connected to the display module, mainly not to enable the user to interact with the glasses (or near-eye display device) or the apparatus connected to the display module when the display module is in a static state but when the lens moves. The method specifically comprises the following steps:
acquiring multimedia data and eyeball tracking data;
And controlling the display module to image a graphical interface of the target logic function on the lens or controlling the display module to update a target area in a third graphical interface which is imaged on the lens at present, wherein the third graphical interface is a graphical interface of a third logic function which is currently operated in the foreground, and the target area is a graphical area corresponding to a sub-function in the third logic function, or the target touch mode, the target instruction and the target eye movement mode are preset as a trigger condition for triggering the target logic function or a condition preset as the sub-function of the third logic function.
The multimedia data can be image/video data collected by a miniature camera built in the display module or voice data collected by a miniature microphone, and the eyeball tracking data is eye image data of a user collected by the miniature camera built in the display module.
The target touch pattern may be a single click, a double click, a triple click, or the like. The target instruction may be a preset target gesture, target voice, etc. The target eye movement pattern may be an eye movement according to a preset rule. Similarly, the target touch pattern, the target command, and the target eye movement pattern are similar to the aforementioned target movement states, and they may be preset as a trigger condition for triggering the target logic function or as a trigger condition for a sub-function of the third logic function. In case it is detected that the display module is resting on the lens and the touch portion is touched according to a target touch mode, or in case it is detected that the display module is resting on the lens and a target command is identified from the multimedia data, or in case it is detected that the display module is resting on the lens and a target eye movement mode is identified from the eye tracking data, triggering (preset) triggering conditions are the target touch mode, the target command and a target logic function (or a sub-function of a third logic function) of the target eye movement mode, thereby controlling the display module to image a graphical interface of the triggered target logic function on the lens (or controlling the display module to update a target area in the third graphical interface currently imaged on the lens). The principle is similar to the principle that the target motion state triggers the target logic function (or the sub-function of the third logic function) so as to control the display module to image the triggered graphical interface of the target logic function on the lens (or control the display module to update the target area in the third graphical interface currently imaged on the lens), which is not described herein, and can be understood by those skilled in the art with reference to the foregoing.
In some alternative embodiments, a preset imaging area is preset on the lens to which the display module is connected, and the display module only images in the preset imaging area, but does not image on the whole lens. Therefore, the display module is controlled to image the graphical interface of the target logic function on the lens only when the target motion state is monitored in the preset imaging area on the lens, and the low-power consumption mode is started when the display module is monitored to move outside the preset imaging area. Thereby saving the electric energy of the equipment and prolonging the endurance time and the service life of the equipment.
It should be noted that, although the above examples are described by taking monocular (i.e. only one lens of the glasses is connected with the display module provided by the embodiment of the present application), it is obvious that all the embodiments provided by the present application can be applied to binocular (i.e. both lenses of the glasses are connected with the display module provided by the embodiment of the present application).
According to the connection method of the projection equipment provided by the embodiment of the application, the execution main body can be a control device of the display module. In the embodiment of the application, a control device of a display module executes a control method of the display module, which is taken as an example, and the control device of the display module provided by the embodiment of the application is described.
Fig. 18 is a schematic structural diagram of a control device for a display module according to an embodiment of the present application. Referring to fig. 18, the control device 5 of the display module, the display module is configured to be placed on an optical lens, and the display module is configured to output image content, the control device 5 includes:
a first monitoring module 51, configured to monitor a motion state of the display module on a currently connected lens;
The first control module 52 is configured to control the display module to image a graphical interface of a target logic function on the lens when a target motion state is detected, where the target motion state is preset as a trigger condition for triggering the target logic function.
In some alternative embodiments, the target motion state includes that the movement of the display module on the lens meets a first preset condition, the target logic function includes a first logic function, that the movement of the display module on the lens meets a first preset condition is preset as a trigger condition for triggering the first logic function, and the first control module 52 includes:
And the first control sub-module is used for controlling the display module to image a first graphical interface of the first logic function on the lens under the condition that the movement of the display module on the lens is monitored to meet a first preset condition.
In some alternative embodiments, the first preset condition is one of:
the displacement distance of the movement is not smaller than a preset first threshold length;
The displacement distance of the movement is not smaller than a preset first threshold length, and the displacement direction of the movement is a preset first direction;
The displacement distance of the movement is not smaller than a preset first threshold length, the starting point of the movement is a preset first position, and the first position is a fixed position selected on the lens;
the displacement distance of the movement is not smaller than a preset first threshold length, the displacement direction of the movement is a preset first direction, and the starting point of the movement is the first position;
the end point of the movement is a preset second position, which is a selected fixed position on the lens;
The shape similarity of the moving track and the preset track is not smaller than a preset first threshold value.
In some alternative embodiments, the target motion state includes the display module resting at a third location on the lens, the third location being a selected fixed location on the lens, the target logic function including a second logic function, the display module resting at the third location on the lens being preset as a trigger condition that triggers the second logic function, the first control module 52 comprising:
and the second control sub-module is used for controlling the display module to image a second graphical interface of the second logic function on the lens under the condition that the display module is monitored to be static at a third position on the lens.
In some alternative embodiments, the target motion state includes the display module rotating an axis, the target logic function includes a third logic function, the third logic function being a logic function currently running in the foreground, and the first control module 52 includes:
the display module is used for displaying a first image of a first logic function, a second image of a second logic function, a third control sub-module used for controlling the display module to update a target area in a third image interface which is imaged on the lens currently under the condition that the display module is monitored to rotate axially, wherein the third image interface is an image interface of the third logic function, the target area is an image area corresponding to a sub-function in the third logic function, and the display module is preset to trigger a triggering condition of the sub-function in the third logic function during rotation of the axis.
In some alternative embodiments, the third control sub-module includes:
and the first control unit is used for controlling the display module to update the target area in the third graphical interface imaged on the lens currently under the condition that the rotation angle of the display module for shaft rotation is not smaller than a preset first threshold angle.
In some alternative embodiments, the control device 5 further comprises:
the first detection module is used for detecting contact of a touch part of the display module;
The first control module 52 includes:
And the fourth control submodule is used for controlling the display module to image the graphical interface of the target logic function on the lens under the condition that the duration of the touch part is not less than the preset first threshold duration and the target motion state is monitored.
In some alternative embodiments, the control device 5 further comprises:
the first starting module is used for starting an anti-false touch mode when the duration of the touch part is detected to be not smaller than a preset second threshold duration and the display module is detected to be still on the lens all the time, or when the duration of the touch part is not detected to be not smaller than a third threshold duration, the anti-false touch mode is a graphical interface for controlling the display module to keep imaging a logic function currently running on the lens in the mode.
In some alternative embodiments, the first threshold duration is less than the second threshold duration.
In some alternative embodiments, the control device 5 further comprises:
and the first releasing module is used for releasing the false touch preventing mode when the duration of the touch part which is detected to be touched again in the false touch preventing mode is not less than the fourth threshold duration.
In some alternative embodiments, the fourth threshold duration is less than or equal to the first threshold duration.
In some alternative embodiments, the control device 5 further comprises:
the first prompting module is used for outputting a prompt for prompting a user that the anti-false touch mode is started while the anti-false touch mode is started;
and the second prompting module is used for outputting a prompt for prompting a user that the false touch prevention mode is released while the false touch prevention mode is released.
In some alternative embodiments, the control device 5 further comprises:
And the second control module is used for controlling the display module to image and move prompt contents on the lens around the display module under the condition that the touch part is touched under the condition that the display module is detected to be static on the lens.
In some alternative embodiments, the control device 5 further comprises:
and the third control module is used for controlling the display module to image a graphical interface of the target logic function on the lens or controlling the display module to update a target area in a third graphical interface which is currently imaged on the lens when the display module is detected to be static on the lens and the touch part is detected to be touched according to a target touch mode, wherein the third graphical interface is a graphical interface of a third logic function, the third logic function is a logic function which is currently operated in the foreground, the target area is a graphical area corresponding to a sub-function in the third logic function, and the target touch mode is preset as a triggering condition for triggering the target logic function or as a triggering condition for the sub-function of the third logic function.
In some alternative embodiments, the control device 5 further comprises:
the first acquisition module is used for acquiring the multimedia data;
And the third control module is used for controlling the display module to image a graphical interface of the target logic function on the lens or controlling the display module to update a target area in a third graphical interface which is currently imaged on the lens under the condition that the display module is detected to be static on the lens and a target instruction is identified from the multimedia data, wherein the third graphical interface is a graphical interface of a third logic function, the third logic function is a logic function which is currently operated in the foreground, the target area is a graphical area corresponding to a sub-function in the third logic function, and the target instruction is preset as a triggering condition for triggering the target logic function or as a triggering condition for the sub-function of the third logic function.
In some alternative embodiments, the control device 5 further comprises:
The second acquisition module is used for acquiring eyeball tracking data;
And the fourth control module is used for controlling the display module to image a graphical interface of the target logic function on the lens or controlling the display module to update a target area in a third graphical interface currently imaged on the lens under the condition that the display module is detected to be static on the lens and a target eye movement mode is identified from the eyeball tracking data, wherein the third graphical interface is a graphical interface of a third logic function, the third logic function is a logic function currently operated in the foreground, the target area is a graphical area corresponding to a sub-function in the third logic function, and the target eye movement mode is preset as a triggering condition for triggering the target logic function or as a triggering condition for the sub-function of the third logic function.
In some alternative embodiments, the control device 5 comprises:
The second monitoring module is used for controlling the display module to image the graphical interface of the target logic function on the lens under the condition that the target motion state is monitored in a preset imaging area on the lens;
And the second starting module is used for starting a low-power consumption mode under the condition that the display module is monitored to move outside the preset imaging area.
The control device 5 of the display module in the embodiment of the application may be an electronic device, or may be a component in the electronic device, such as an integrated circuit or a chip. The electronic device may be a terminal, or may be other devices than a terminal. The electronic device may be a Mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted electronic device, a Mobile internet appliance (Mobile INTERNET DEVICE, MID), an augmented reality (augmented reality, AR)/Virtual Reality (VR) device, a robot, a wearable device, an ultra-Mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), etc., and may also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a Television (TV), a teller machine, a self-service machine, etc., which are not particularly limited in the embodiments of the present application.
The control device 5 of the display module in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an ios operating system, or other possible operating systems, and the embodiment of the present application is not limited specifically.
The control device 5 of the display module provided in the embodiment of the present application can implement each process implemented in the embodiments of fig. 1 to 17, and in order to avoid repetition, a detailed description is omitted here.
In some optional embodiments, as shown in fig. 19, the embodiment of the present application further provides an electronic device 130, which includes a processor 131 and a memory 132, where the memory 132 stores a program or an instruction that can be executed on the processor 131, and the program or the instruction implements each step of the control method embodiment of the display module when executed by the processor 131, and can achieve the same technical effect, so that repetition is avoided and no further description is given here.
The electronic device in the embodiment of the application includes the mobile electronic device and the non-mobile electronic device.
Fig. 20 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.
The electronic device 140 includes, but is not limited to, a radio frequency unit 141, a network module 142, an audio output unit 143, an input unit 144, a sensor 145, a display unit 146, a user input unit 147, an interface unit 148, a memory 149, and a processor 1410. Those skilled in the art will appreciate that the electronic device 140 may further include a power source (e.g., a battery) for powering the various components, which may be logically connected to the processor 1410 by a power management system to perform functions such as managing charging, discharging, and power consumption by the power management system. The electronic device structure shown in fig. 14 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than shown, or may combine certain components, or may be arranged in different components, which are not described in detail herein.
Wherein the processor 1410 is configured to:
monitoring the motion state of the display module on the currently connected lens;
and under the condition that the target motion state is monitored, controlling the display module to image a graphical interface of a target logic function on the lens, wherein the target motion state is preset as a triggering condition for triggering the target logic function.
It should be appreciated that in embodiments of the present application, input unit 144 may include a graphics processor (Graphics Processing Unit, GPU) 1441 and a microphone 1442, graphics processor 1441 processing image data of still pictures or video obtained by an image capture device (e.g., a camera) in a video capture mode or an image capture mode. The display unit 146 may include a display panel 1461, and the display panel 1461 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 147 includes at least one of a touch panel 1471 and other input devices 1472. Touch panel 1471, also known as a touch screen. The touch panel 1471 may include two parts, a touch detection device and a touch controller. Other input devices 1472 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein.
Memory 149 may be used to store software programs as well as various data. The memory 149 may mainly include a first memory area storing programs or instructions and a second memory area storing data, wherein the first memory area may store an operating system, application programs or instructions (such as a sound playing function, an image playing function, etc.) required for at least one function, and the like. Further, the memory 149 may include volatile memory or nonvolatile memory, or the memory 149 may include both volatile and nonvolatile memory. The nonvolatile Memory may be Read-Only Memory (ROM), programmable ROM (PROM), erasable Programmable EPROM (EPROM), electrically Erasable EPROM (EEPROM), or flash Memory. The volatile memory may be random access memory (Random Access Memory, RAM), static random access memory (STATIC RAM, SRAM), dynamic random access memory (DYNAMIC RAM, DRAM), synchronous Dynamic Random Access Memory (SDRAM), double data rate Synchronous dynamic random access memory (Double DATA RATE SDRAM, DDRSDRAM), enhanced Synchronous dynamic random access memory (ENHANCED SDRAM, ESDRAM), synchronous link dynamic random access memory (SYNCH LINK DRAM, SLDRAM), and Direct random access memory (DRRAM). Memory 149 in embodiments of the application includes, but is not limited to, these and any other suitable types of memory.
Processor 1410 may include one or more processing units, and optionally, processor 1410 integrates an application processor that primarily processes operations involving an operating system, user interface, application programs, etc., and a modem processor that primarily processes wireless communication signals, such as a baseband processor. It will be appreciated that the modem processor described above may not be integrated into the processor 1410.
According to the control method of the display module provided by the embodiment of the application, the execution main body can be AR glasses. In the embodiment of the application, a control method of a near-eye display device executing a display module is taken as an example, and the electronic system provided by the embodiment of the application is described.
In some optional embodiments, as shown in fig. 21, the embodiment of the present application further provides AR glasses 150, including a processor 151 and a memory 152, where the memory 152 stores a program or an instruction that can be executed on the processor 151, and the program or the instruction implements each step of the control method embodiment of the display module when executed by the processor 131, and the steps can achieve the same technical effect, so that repetition is avoided and no further description is given here.
Any of the product embodiments can realize the processes of the control method embodiments of the display module through the operation of the processor of the product embodiment, can achieve the same technical effects, and is not repeated.
The embodiment of the application also provides a readable storage medium, wherein the readable storage medium stores a program or an instruction, and the program or the instruction realizes each process of the control method embodiment of the display module when being executed by a processor, and can achieve the same technical effect, so that repetition is avoided and redundant description is omitted. Wherein the processor is a processor in the electronic device or the electronic system described in the above embodiment. The readable storage medium includes computer readable storage medium such as computer readable memory ROM, random access memory RAM, magnetic or optical disk, etc.
The embodiment of the application further provides a chip, the chip comprises a processor and a communication interface, the communication interface is coupled with the processor, the processor is used for running programs or instructions, the processes of the control method embodiment of the display module can be realized, the same technical effects can be achieved, and the repetition is avoided, and the description is omitted here.
It should be understood that the chips referred to in the embodiments of the present application may also be referred to as system-on-chip chips, chip systems, or system-on-chip chips, etc.
An embodiment of the present application provides a computer program product, which is stored in a storage medium, and the program product is executed by at least one processor to implement each process of the control method embodiment of the display module, and achieve the same technical effects, and is not repeated herein.
In the embodiments of the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the modules or units is merely a logical functional division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.
In addition, each functional unit in each implementation manner of the embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the embodiment of the present application may be essentially or a part contributing to the prior art or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium, including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) or a processor (processor) to execute all or part of the steps of the method described in the embodiments of the present application. The storage medium includes a U disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, an optical disk, or other various media capable of storing program codes.
The foregoing description is merely illustrative of the embodiments of the present application and is not intended to limit the scope of the embodiments of the present application, and the specific embodiments are merely illustrative, not restrictive, of the application, and all equivalent structures or equivalent arrangements shown in the specification and drawings may be modified or applied directly or indirectly to other related art without departing from the spirit of the application and the scope of the claims, which are equally encompassed by the scope of the embodiments of the present application.

Claims (18)

1. A control method of a display module, wherein the display module is configured to be placed on an optical lens, and the display module is configured to output image content, the method comprising:
monitoring the motion state of the display module on the currently connected lens;
and under the condition that the target motion state is monitored, controlling the display module to image a graphical interface of a target logic function on the lens, wherein the target motion state is preset as a triggering condition for triggering the target logic function.
2. The method of claim 1, wherein the target motion state comprises a movement of the display module on the lens meeting a first preset condition, the target logic function comprises a first logic function, the movement of the display module on the lens meeting the first preset condition is preset as a trigger condition for triggering the first logic function, and the controlling the display module to image a graphical interface of the target logic function on the lens if the target motion state is monitored comprises:
And controlling the display module to image a first graphical interface of the first logic function on the lens under the condition that the movement of the display module on the lens is monitored to meet a first preset condition.
3. The method of claim 2, wherein the first preset condition comprises one or a combination of:
the displacement distance of the movement is not smaller than a preset first threshold length;
The displacement distance of the movement is not smaller than a preset first threshold length, and the displacement direction of the movement is a preset first direction;
The displacement distance of the movement is not smaller than a preset first threshold length, the starting point of the movement is a preset first position, and the first position is a fixed position selected on the lens;
the displacement distance of the movement is not smaller than a preset first threshold length, the displacement direction of the movement is a preset first direction, and the starting point of the movement is the first position;
the end point of the movement is a preset second position, which is a selected fixed position on the lens;
The shape similarity of the moving track and the preset track is not smaller than a preset first threshold value.
4. The method of claim 1, wherein the target motion state comprises the display module resting at a third location on the lens, the third location being a selected fixed location on the lens, the target logic function comprising a second logic function, the display module resting at the third location on the lens being preset to a trigger condition that triggers the second logic function, the controlling the display module to image a graphical interface of the target logic function on the lens if a target motion state is detected comprising:
and controlling the display module to image a second graphical interface of the second logic function on the lens under the condition that the display module is monitored to be static at a third position on the lens.
5. The method of claim 1, wherein the target motion state comprises an axis rotation of the display module, wherein the target logic function comprises a third logic function that is currently running in the foreground, and wherein the controlling the display module to image the graphical interface of the target logic function on the lens if the target motion state is monitored comprises:
And under the condition that the display module is monitored to perform axial rotation, controlling the display module to update a target area in a third graphical interface which is imaged on the lens currently, wherein the third graphical interface is a graphical interface of a third logic function, the target area is a graphical area corresponding to a sub-function in the third logic function, and the display module performs axial rotation and is preset as a triggering condition for triggering the sub-function in the third logic function.
6. The method of claim 5, wherein controlling the display module to update the target area in the third graphical interface currently imaged on the lens if the display module is monitored to be rotated about the axis comprises:
And under the condition that the rotation angle of the display module for shaft rotation is not smaller than a preset first threshold angle, controlling the display module to update a target area in a third graphical interface imaged on the lens currently.
7. The method according to claim 1, wherein the method further comprises:
Detecting contact of a touch part of the display module;
And under the condition that the target motion state is monitored, controlling the display module to image the graphical interface of the target logic function on the lens, wherein the graphical interface comprises the following components:
and controlling the display module to image a graphical interface of the target logic function on the lens under the condition that the duration of the touch part is not less than the preset first threshold duration and the target motion state is monitored.
8. The method of claim 7, wherein the method further comprises:
Under the condition that the duration of the touch part is not less than a preset second threshold duration and the display module is always static on the lens, or under the condition that the duration of the touch part is not less than a third threshold duration, starting an anti-false touch mode, wherein the anti-false touch mode is a graphical interface for controlling the display module to keep imaging a logic function currently running in the foreground on the lens under the mode;
The first threshold duration is less than the second threshold duration.
9. The method of claim 8, wherein the method further comprises:
And under the condition that the duration of the touch part being touched is not smaller than a fourth threshold duration, the false touch prevention mode is released, and the fourth threshold duration is smaller than or equal to the first threshold duration.
10. The method according to claim 9, wherein the method further comprises:
Outputting a prompt for prompting a user that the anti-false touch mode is started while the anti-false touch mode is started;
and outputting a prompt for prompting a user that the false touch preventing mode is released while the false touch preventing mode is released.
11. The method of claim 7, wherein the method further comprises:
And under the condition that the display module is detected to be static on the lens and the touch part is detected to be touched, controlling the display module to image moving prompt contents on the lens around the display module.
12. The method of claim 7, wherein the method further comprises:
And under the condition that the display module is detected to be stationary on the lens and the touch part is detected to be touched according to a target touch mode, controlling the display module to image a graphical interface of the target logic function on the lens or controlling the display module to update a target area in a third graphical interface currently imaged on the lens, wherein the third graphical interface is a graphical interface of a third logic function, the third logic function is a logic function currently operated in the foreground, the target area is a graphical area corresponding to a sub-function in the third logic function, and the target touch mode is preset as a triggering condition for triggering the target logic function or as a triggering condition for the sub-function of the third logic function.
13. The method according to claim 1, wherein the method further comprises:
Acquiring multimedia data;
And under the condition that the display module is detected to be static on the lens and a target instruction is identified from the multimedia data, controlling the display module to image a graphical interface of the target logic function on the lens or controlling the display module to update a target area in a third graphical interface currently imaged on the lens, wherein the third graphical interface is a graphical interface of a third logic function, the third logic function is a logic function currently operated in the foreground, the target area is a graphical area corresponding to a sub-function in the third logic function, and the target instruction is preset as a triggering condition for triggering the target logic function or as a triggering condition for the sub-function of the third logic function.
14. The method according to claim 1, wherein the method further comprises:
acquiring eyeball tracking data;
And under the condition that the display module is detected to be static on the lens and a target eye movement mode is identified from the eyeball tracking data, controlling the display module to image a graphical interface of the target logic function on the lens or controlling the display module to update a target area in a third graphical interface currently imaged on the lens, wherein the third graphical interface is a graphical interface of a third logic function, the third logic function is a logic function currently operated in the foreground, the target area is a graphical area corresponding to a sub-function in the third logic function, and the target eye movement mode is preset as a triggering condition for triggering the target logic function or as a triggering condition for the sub-function of the third logic function.
15. The method of claim 1, wherein controlling the display module to image a graphical interface of the target logic function on the lens if a target motion state is detected comprises:
under the condition that a target motion state is monitored in a preset imaging area on the lens, controlling the display module to image a graphical interface of the target logic function on the lens;
The method further comprises the steps of:
and under the condition that the display module is monitored to move outside the preset imaging area, starting a low-power consumption mode.
16. An electronic device comprising a processor and a memory storing a program or instructions executable on the processor, which when executed by the processor, implement the steps of the method of controlling a display module according to any one of claims 1 to 15.
17. A near-eye display device comprising a processor and a memory storing a program or instructions executable on the processor, which when executed by the processor, implement the steps of the control method of a display module according to any one of claims 1 to 15.
18. A readable storage medium, wherein a program or instructions are stored on the readable storage medium, which when executed by a processor, implement the steps of the control method of a display module according to any one of claims 1 to 15.
CN202311733535.5A 2023-11-17 2023-12-15 Display module control method, near-eye display device, electronic device and medium Pending CN120196200A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202311733535.5A CN120196200A (en) 2023-12-15 2023-12-15 Display module control method, near-eye display device, electronic device and medium
PCT/CN2024/131310 WO2025103267A1 (en) 2023-11-17 2024-11-11 Display module control method, display module control device and near-eye display device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311733535.5A CN120196200A (en) 2023-12-15 2023-12-15 Display module control method, near-eye display device, electronic device and medium

Publications (1)

Publication Number Publication Date
CN120196200A true CN120196200A (en) 2025-06-24

Family

ID=96068465

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311733535.5A Pending CN120196200A (en) 2023-11-17 2023-12-15 Display module control method, near-eye display device, electronic device and medium

Country Status (1)

Country Link
CN (1) CN120196200A (en)

Similar Documents

Publication Publication Date Title
US11782571B2 (en) Device, method, and graphical user interface for manipulating 3D objects on a 2D screen
US12353672B2 (en) Methods for adjusting and/or controlling immersion associated with user interfaces
US20240103682A1 (en) Devices, Methods, and Graphical User Interfaces for Interacting with Window Controls in Three-Dimensional Environments
JP2025172725A (en) Device, method, and graphical user interface for capturing and displaying media
KR20240063979A (en) Attention tracking to enhance focus transitions
CN119620857A (en) Device and method for accessing system functions of a computer system while displaying a three-dimensional environment
CN114637376A (en) Apparatus, method and graphical user interface for interacting with a three-dimensional environment
US20240094819A1 (en) Devices, methods, and user interfaces for gesture-based interactions
JP2025533474A (en) DEVICE, METHOD, AND GRAPHICAL USER INTERFACE FOR INTERACTING WITH WINDOW CONTROLS IN A THREE-DIMENSIONAL ENVIRONMENT - Patent application
US20230333645A1 (en) Method and device for processing user input for multiple devices
US20220269398A1 (en) Method and device for assigning an operation set
WO2025240264A1 (en) Gaze-based text entry in a three-dimensional environment
CN112965773A (en) Method, apparatus, device and storage medium for information display
WO2023278138A1 (en) Methods and systems for changing a display based on user input and gaze
US12578836B2 (en) User interface for interacting with an affordance in an environment
US12468383B2 (en) Gaze and head pose interaction
CN118349138A (en) Human-computer interaction method, device, equipment and medium
CN120196200A (en) Display module control method, near-eye display device, electronic device and medium
CN108536279B (en) Method and system for interaction in virtual reality environment
WO2024064016A1 (en) Devices, methods, and user interfaces for gesture-based interactions
JP2025534284A (en) Device, method and graphical user interface for interacting with a three-dimensional environment
CN120276154A (en) Control method of display module and near-to-eye display device
WO2022192011A1 (en) Distributed content rendering
CN120276155A (en) Control method of display module and near-to-eye display device
KR102959016B1 (en) Methods for adjusting and/or controlling immersion associated with user interfaces

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination