CN117518480A - Adjustment method and device of wearable device, wearable device and medium - Google Patents

Adjustment method and device of wearable device, wearable device and medium Download PDF

Info

Publication number
CN117518480A
CN117518480A CN202311480245.4A CN202311480245A CN117518480A CN 117518480 A CN117518480 A CN 117518480A CN 202311480245 A CN202311480245 A CN 202311480245A CN 117518480 A CN117518480 A CN 117518480A
Authority
CN
China
Prior art keywords
display area
image display
data
wearable device
adjustment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311480245.4A
Other languages
Chinese (zh)
Inventor
段涛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Goertek Techology Co Ltd
Original Assignee
Goertek Techology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Goertek Techology Co Ltd filed Critical Goertek Techology Co Ltd
Priority to CN202311480245.4A priority Critical patent/CN117518480A/en
Publication of CN117518480A publication Critical patent/CN117518480A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0132—Head-up displays characterised by optical features comprising binocular systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0141—Head-up displays characterised by optical features characterised by the informative content of the display
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0147—Head-up displays characterised by optical features comprising a device modifying the resolution of the displayed image
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The application discloses a method and a device for adjusting a wearable device, the wearable device and a computer storage medium, and relates to the technical field of AR, the method for adjusting the wearable device is applied to the wearable device configured with a display module and can comprise the following steps: obtaining deformation data of the display module; and determining adjustment data of an image display area on the display module according to the deformation data, and adjusting the image display area according to the adjustment data. By adopting the method and the device, the design requirement of the front frame of the AR glasses can be reduced on the premise of ensuring the display effect of the AR glasses, so that the miniaturization and light-weight development of the AR glasses are facilitated.

Description

Adjustment method and device of wearable device, wearable device and medium
Technical Field
The application relates to the technical field of AR (Augmented Reality) and particularly relates to an adjusting method and device of wearable equipment, the wearable equipment and a computer storage medium.
Background
Nowadays, in order to enable a user of a wearable device to obtain an experience of portable, no-load sensing and even no-sense wearing for the device usage, more and more device designs and manufacturers are developing miniaturization and light weight of the wearable device. Among these, the miniaturization and weight saving of AR eyes are particularly remarkable.
However, with miniaturization and light weight of AR glasses, the rigidity of the front frame for carrying the display module is inevitably affected, which easily results in that when the user wears AR glasses, the front frame of the glasses generates a larger deformation amount due to insufficient rigidity, thereby affecting the binocular fusion effect of the display module, and even causing the picture observed by the user to become blurred when serious.
Therefore, how to ensure the display effect of the AR glasses display module on the basis of the normal miniaturization and light weight development of the AR glasses is a technical problem to be solved in the industry at present.
Disclosure of Invention
The main aim of the application is to provide a method and a device for adjusting wearable equipment, the wearable equipment and a computer storage medium, aiming at reducing the design requirement of the front frame of the AR glasses on the premise of ensuring the display effect of the AR glasses, thereby facilitating the miniaturization and light-weight development of the AR glasses.
In order to achieve the above objective, the present application provides an adjustment method of a wearable device, where the adjustment method of the wearable device is applied to a wearable device configured with a display module;
the adjustment method of the wearable device comprises the following steps:
Obtaining deformation data of the display module;
and determining adjustment data of an image display area on the display module according to the deformation data, and adjusting the image display area according to the adjustment data.
Optionally, the wearable device further includes a sensor, the display module includes a first display module and a second display module, and the deformation data includes position change data;
the step of obtaining deformation data of the display module comprises the following steps:
acquiring sensor data acquired by the sensor aiming at the first display module and/or the second display module;
and determining position change data of the first display module and the second display module according to the sensor data.
Optionally, the image display area includes: a first image display area on the first display module and a second image display area on the second display module;
the step of determining the adjustment data of the image display area on the display module according to the deformation data comprises the following steps:
and determining adjustment data of the first image display area and/or the second image display area according to the position change data.
Optionally, the step of adjusting the image display area according to the adjustment data includes:
adjusting the position and/or the size of the first image display area according to the adjustment data of the first image display area;
and/or that the number of the groups of groups,
and adjusting the position and/or the size of the second image display area according to the adjustment data of the second image display area.
Optionally, the wearable device further includes: a manual adjustment assembly;
the method further comprises the steps of:
and receiving an adjustment instruction triggered by the manual adjustment component, and determining adjustment data of an image display area on the display module according to the adjustment instruction.
Optionally, before the step of receiving the adjustment instruction triggered by the manual adjustment component, the method further includes:
outputting a preset auxiliary image through the image display area;
the step of receiving the adjustment command triggered by the manual adjustment component comprises the following steps:
and receiving an adjustment instruction of the manual adjustment component for adjusting the auxiliary image.
Optionally, the wearable device further comprises an image acquisition device;
after the step of adjusting the image display area in accordance with the adjustment data, the method further includes:
Acquiring image data output by the adjusted image display area through the image acquisition device;
when the adjusted image display area meets the preset binocular fusion condition according to the image data, ending adjusting the image display area;
and outputting prompt information for adjusting the pose of the wearable device when judging that the adjusted image display area still does not meet the preset binocular fusion condition according to the image data.
In addition, in order to achieve the above purpose, the present application further provides an adjusting device of a wearable device, where the adjusting device of the wearable device is applied to a wearable device configured with a display module;
the adjusting device of the wearable device comprises:
the data acquisition module is used for acquiring deformation data of the display module;
and the equipment adjusting module is used for determining the adjusting data of the image display area on the display module according to the deformation data and adjusting the image display area according to the adjusting data.
Optionally, each functional module of the adjusting device of the wearable device implements the steps of the adjusting method of each wearable device as described above at runtime.
In addition, to achieve the above object, the present application further provides a wearable device, including: the method comprises the steps of a memory, a processor and an adjusting program of the wearable device, wherein the adjusting program of the wearable device is stored in the memory and can run on the processor, and the steps of the adjusting method of the wearable device are realized when the adjusting program of the wearable device is executed by the processor.
In addition, in order to achieve the above object, the present application further provides a computer storage medium, on which an adjustment program of a wearable device is stored, where the adjustment program of the wearable device, when executed by a processor, implements the steps of the adjustment method of the wearable device as described above.
The adjustment method and device for the wearable device, the wearable device and the computer storage medium provided by the embodiment of the application, wherein the adjustment method for the wearable device is applied to the wearable device configured with the display module and can comprise the following steps: obtaining deformation data of the display module; and determining adjustment data of an image display area on the display module according to the deformation data, and adjusting the image display area according to the adjustment data.
In the embodiment of the application, the adjustment method of the wearable device obtains the deformation data of the display module configured on the wearable device, and then calculates and determines the adjustment data of the image display area used for outputting the display image on the display module according to the deformation data, so that the adjustment data is adapted to the image display area.
Therefore, even if the wearable device is miniaturized and light AR glasses deform due to insufficient rigidity, so that the display module arranged on the AR glasses also deform correspondingly, the AR glasses can adapt to the image display area on the display module, and the properties such as the definition of the image displayed in the area are corrected to ensure the overall display effect. That is, the embodiment of the application adjusts the image display area on the AR glasses display module through flexibility, and can reduce the design requirement of the front frame of the AR glasses on the premise of guaranteeing the display effect of the AR glasses, thereby facilitating the miniaturization and light-weight development of the AR glasses.
Drawings
Fig. 1 is a schematic structural diagram of a terminal device of a hardware running environment according to an embodiment of the present application;
Fig. 2 is a schematic diagram of a normal binocular fusion effect of an AR glasses display module according to an embodiment of an adjustment method of a wearable device of the present application;
fig. 3 is a schematic diagram of binocular fusion effect of a display module caused by deformation of a front frame of AR glasses according to an embodiment of an adjustment method of a wearable device of the present application;
fig. 4 is a flowchart illustrating steps of an embodiment of a method for adjusting a wearable device according to the present application;
fig. 5 is a schematic diagram illustrating an adjustment of an image display area of a display module to correct a binocular fusion effect according to an embodiment of an adjustment method of a wearable device of the present application;
fig. 6 is a flowchart illustrating steps of another embodiment of a method for adjusting a wearable device according to the present application;
fig. 7 is a schematic structural diagram of a functional module related to an embodiment of an adjusting device of a wearable device of the present application.
The realization, functional characteristics and advantages of the present application will be further described with reference to the embodiments, referring to the attached drawings.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application.
Referring to fig. 1, fig. 1 is a schematic structural diagram of a terminal device of a hardware running environment according to an embodiment of the present application.
It should be noted that fig. 1 may be a schematic structural diagram of a hardware operating environment of a terminal device. The terminal device of the embodiment of the application may be wearable devices such as AR glasses and split-type AR glasses for executing the adjustment method of the wearable device, and one or more display modules for outputting display image data are configured on the wearable devices. In addition, the terminal device in the embodiment of the present application may also be a PC, a smart phone, a tablet, and other computing units connected to the wearable devices.
It should be understood that, depending on the different design requirements of the practical application, the terminal device of the embodiment of the present application may of course also be other devices or apparatus modules, for example, the terminal device may specifically be a mobile or non-mobile terminal device such as a data storage control terminal or a portable computer.
As shown in fig. 1, the terminal device may include: a processor 1001, such as a central processing unit (Central Processing Unit, CPU), a communication bus 1002, a user interface 1003, a network interface 1004, a memory 1005. Wherein the communication bus 1002 is used to enable connected communication between these components. The user interface 1003 may include a Display, an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may further include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a WIreless interface (e.g., a WIreless-FIdelity (WI-FI) interface). The Memory 1005 may be a high-speed random access Memory (Random Access Memory, RAM) Memory or a stable nonvolatile Memory (NVM), such as a disk Memory. The memory 1005 may also optionally be a storage device separate from the processor 1001 described above.
It will be appreciated by those skilled in the art that the structure shown in fig. 1 does not constitute a limitation of the terminal device, and may include more or less components than illustrated, or may combine certain components, or may be arranged in different components.
As shown in fig. 1, an operating system, a data storage module, a network communication module, a user interface module, and an adjustment program of the wearable device may be included in the memory 1005 as one storage medium.
In the terminal device shown in fig. 1, the network interface 1004 is mainly used for data communication with other devices; the user interface 1003 is mainly used for data interaction with a user; in the embodiment of the present application, the processor 1001 and the memory 1005 may be provided in the terminal device.
Based on this, the terminal device invokes the adjustment program of the wearable device stored in the memory 1005 through the processor 1001, and performs the following operations:
obtaining deformation data of the display module;
and determining adjustment data of an image display area on the display module according to the deformation data, and adjusting the image display area according to the adjustment data.
Further, the wearable device further comprises a sensor, the display module comprises a first display module and a second display module, and the deformation data comprise position change data;
The processor 1001 invokes an adjustment program of the wearable device stored in the memory 1005, and also performs the following operations:
acquiring sensor data acquired by the sensor aiming at the first display module and/or the second display module;
and determining position change data of the first display module and the second display module according to the sensor data.
Further, the image display area includes: a first image display area on the first display module and a second image display area on the second display module;
the processor 1001 invokes an adjustment program of the wearable device stored in the memory 1005, and also performs the following operations:
and determining adjustment data of the first image display area and/or the second image display area according to the position change data.
Further, the processor 1001 invokes an adjustment program of the wearable device stored in the memory 1005, and further performs the following operations:
adjusting the position and/or the size of the first image display area according to the adjustment data of the first image display area;
and/or that the number of the groups of groups,
and adjusting the position and/or the size of the second image display area according to the adjustment data of the second image display area.
Further, the wearable device further includes: a manual adjustment assembly;
the processor 1001 invokes an adjustment program of the wearable device stored in the memory 1005, and also performs the following operations:
and receiving an adjustment instruction triggered by the manual adjustment component, and determining adjustment data of an image display area on the display module according to the adjustment instruction.
Further, the processor 1001 invokes an adjustment program of the wearable device stored in the memory 1005, and before executing the step of receiving an adjustment instruction triggered by the manual adjustment component, further performs the following operations:
outputting a preset auxiliary image through the image display area;
based on this, the processor 1001 invokes the adjustment program of the wearable device stored in the memory 1005, and also performs the following operations:
and receiving an adjustment instruction of the manual adjustment component for adjusting the auxiliary image.
Further, the wearable device further comprises an image acquisition device;
the processor 1001 invokes an adjustment program of the wearable device stored in the memory 1005, and after performing the step of adjusting the image display area according to the adjustment data, further performs the following operations:
Acquiring image data output by the adjusted image display area through the image acquisition device;
when the adjusted image display area meets the preset binocular fusion condition according to the image data, ending adjusting the image display area;
and outputting prompt information for adjusting the pose of the wearable device when judging that the adjusted image display area still does not meet the preset binocular fusion condition according to the image data.
Based on the terminal equipment, the overall conception of the adjusting method of the wearable equipment is provided.
In the embodiment of the present application, the AR glasses are glasses that can superimpose digital information on the real world, and the AR glasses are configured with a display module. The user can utilize its display module assembly to see the object and the digital information in the actual environment through wearing AR glasses. Nowadays, in order to enable a user of a wearable device to obtain an experience of portable, no-load sensing and even no-sense wearing for the device usage, more and more device designs and manufacturers are developing miniaturization and light weight of the wearable device. Among these, the miniaturization and weight saving of AR eyes are particularly remarkable.
However, as shown in fig. 2 and 3, with miniaturization and light weight of the AR glasses, the rigidity of the front frame for carrying the display module is inevitably affected, which easily causes a large deformation amount of the front frame of the glasses due to insufficient rigidity when the user wears the AR glasses, thereby affecting the binocular fusion effect of the display module, and even blurring the picture viewed by the user when serious.
Therefore, how to ensure the display effect of the AR glasses display module on the basis of the normal miniaturization and light weight development of the AR glasses is a technical problem to be solved in the industry at present.
Aiming at the technical problems, the embodiment of the application provides a method for adjusting wearable equipment. The adjustment method of the wearable device is applied to the wearable device provided with the display module, and the adjustment method can comprise the following steps: obtaining deformation data of the display module; and determining adjustment data of an image display area on the display module according to the deformation data, and adjusting the image display area according to the adjustment data.
That is, according to the adjustment method of the wearable device provided by the application, deformation data of the display module arranged on the wearable device is obtained, and then adjustment data of an image display area for outputting a display image on the display module is calculated and determined according to the deformation data, so that the image display area is adaptively adjusted according to the adjustment data.
Therefore, even if the wearable device is miniaturized and light AR glasses deform due to insufficient rigidity, so that the display module arranged on the AR glasses also deform correspondingly, the AR glasses can adapt to the image display area on the display module, and the properties such as the definition of the image displayed in the area are corrected to ensure the overall display effect. That is, the embodiment of the application adjusts the image display area on the AR glasses display module through flexibility, and can reduce the design requirement of the front frame of the AR glasses on the premise of guaranteeing the display effect of the AR glasses, thereby facilitating the miniaturization and light-weight development of the AR glasses.
Based on the overall conception of the terminal device and the adjustment method of the wearable device, various embodiments of the adjustment method of the wearable device are further provided.
Referring to fig. 4, fig. 4 is a flowchart illustrating a first embodiment of a method for adjusting a wearable device according to the present application.
It should be understood that although a logical order is illustrated in the flowchart, in some cases, the adjustment method of the wearable device of the present application may of course also perform the steps illustrated or described in an order different from that herein.
In addition, the first embodiment of the adjustment method of the wearable device is applied to the terminal device. For the sake of clearly explaining the adjustment method of the wearable device of the present application, the adjustment method of the wearable device of the present application is explained below by using one of the terminal devices, namely the wearable device of the AR glasses, as an execution body.
As shown in fig. 2, in a first embodiment of the adjustment method of the wearable device of the present application, the adjustment method of the wearable device of the present application may include the following steps:
step S10: obtaining deformation data of the display module;
in this embodiment, after the AR glasses detect that the AR glasses are worn by the user, the deformation data of the display module configured by the AR glasses are immediately obtained under the condition that the front frame of the glasses is deformed.
It should be noted that, in this embodiment and other possible embodiments described below, the display module disposed on the AR glasses may be deformed due to deformation of the front frame of the glasses. Alternatively, since the display module is generally configured and mounted on the front frame of the AR glasses, after the AR glasses are miniaturized and light-weighted, the front frame of the glasses is very easily deformed due to insufficient rigidity, thereby causing the deformation of the display module.
Alternatively, the display module configured by the AR glasses may be a hard screen or a soft screen. Even if a single display module cannot deform due to deformation of the front frame of the glasses under the condition that the display module is a hard screen, in this case, a change in position will occur between two display modules configured by the AR glasses, and in the embodiment of the present application, the change is defined as deformation data of the display module. In addition, in the case that the display module is a soft screen, the display module itself may be deformed due to deformation of the front frame of the glasses. Because the AR glasses are configured with more than two hard screens, the embodiment of the present application focuses on the case of performing device adjustment, so that the process of performing device adjustment when the display module is a soft screen will not be described in detail.
Optionally, in a possible embodiment, the wearable device is further configured with a sensor. In the case that the display module is more than two hard screens configured by AR glasses, the display module at least comprises: the first display module and the second display module. At this time, the deformation data of the display module is the position change data of the first display module and the second display module.
Based on this, the step S10 may include:
acquiring sensor data acquired by the sensor aiming at the first display module and/or the second display module;
and determining position change data of the first display module and the second display module according to the sensor data.
In this embodiment, the AR glasses may continuously monitor the respective positions of the first display module and the second display module through the sensors configured by the AR glasses, so as to immediately obtain sensor data obtained by performing position information acquisition on the first display module and/or the second display module by the sensors when it is monitored that the relative positions of the first display module and the second display module change due to deformation of the front frame of the glasses. Then, the AR glasses can analyze based on the obtained sensor data to determine the position change data of the first display module and the second display module.
Optionally, the AR glasses may specifically be configured and installed on the front frame of the glasses in a vicinity of a position where the first display module and the second display module are located, where the first sensor is fixed relative to the first display module, and the second sensor is also fixed relative to the second display module. Therefore, the AR glasses can continuously acquire the position data of the second display module through the first sensor to obtain the position change information of the second display module, and continuously acquire the position data of the first display module through the second sensor to obtain the position change information of the first display module. It should be understood that the position change information of the first display module and/or the second display module is sensor data obtained by the AR glasses.
Optionally, when the sensor data obtained by the AR glasses are only position change information obtained by continuously collecting the position data of the first sensor with respect to the second display module, the AR glasses may use the position of the first display module as a reference, and the position change information is directly used as the position change data of the first display module and the second display module. Similarly, when the sensor data obtained by the AR glasses are only the position change information obtained by continuously collecting the position data of the second sensor with respect to the first display module, the AR glasses can use the position of the second display module as a reference, and the position change information is directly used as the position change data of the first display module and the second display module. The sensor data obtained at the AR glasses are: when the first sensor continuously collects position data for the second display module to obtain position change information and the second sensor continuously collects position data for the first display module to obtain position change information, the AR glasses can calculate relative position change of the two position change information, and therefore a result obtained through calculation is used as position change data of the first display module and the second display module.
Step S20: and determining adjustment data of an image display area on the display module according to the deformation data, and adjusting the image display area according to the adjustment data.
In this embodiment, after obtaining deformation data of a display module configured by the AR glasses under the condition that a front frame of the glasses is deformed, the AR glasses immediately calculate according to the deformation data to determine adjustment data of an image display area on the display module, and then immediately adjust the image display area according to the adjustment data, thereby overcoming the influence of deformation of the front frame of the glasses on the display effect of the image data output by the image display area.
Optionally, in the case that the display module is more than two hard screens configured by the AR glasses, the deformation data of the display module obtained by the AR glasses may include position change data of the two hard screens. Based on the above, the AR glasses may convert the position and/or angle of the image display area to be adjusted according to the virtual image distance of the image display area and the resolution of the display image output by the image display area, so as to control the optical mechanical system for outputting the display image data according to the position and/or angle, and adjust the image display area, so that the image data displayed on the adjusted image display area still can obtain a good binocular fusion effect for the user. It should be understood that the position and/or angle of the image display area to be adjusted calculated by the AR glasses is the adjustment data of the image display area.
Optionally, in the case that the display module includes a first display module and a second display module, the image display area on the display module includes: a first image display area on the first display module and a second image display area on the second display module. Based on the above, the step of determining the adjustment data of the image display area on the display module according to the deformation data includes:
and determining adjustment data of the first image display area and/or the second image display area according to the position change data.
In this example, when the display module includes a first display module and a second display module, and the corresponding image display area includes a first image display area on the first display module and a second image display area on the second display module, the AR glasses only adjust the first image display area or only adjust the second image display area, or adjust the first image display area and the second image display area at the same time, based on different design requirements of practical applications, so that the image data output and displayed by the first image display area and the second image display area still have a good binocular fusion effect.
Based on the above, when the AR glasses determine the adjustment data of the image display area based on the conversion of the position change data of the first display module and the second display module, if the AR glasses obtain the position change data of the position change of the second display module due to the deformation of the front frame of the glasses based on the position of the first display module, the AR glasses convert the position and/or angle of the second image display area only to be adjusted according to the virtual image distance of each of the first image display area and the second image display area and the resolution of the image data output and displayed by each of the first image display area and the second image display area, and use the position and/or angle as the adjustment data of the second image display area. Or if the AR glasses obtain position change data of the first display module, which is based on the position of the second display module, and the first display module generates position change due to deformation of the front frame of the glasses, the AR glasses convert the position and/or angle of the first image display area into adjustment data of the first image display area according to the virtual image distance of each of the first image display area and the second image display area and the resolution of the image data output and displayed by each of the first image display area and the second image display area. Or if the AR glasses acquire the position change data of the relative position change of the first display module and the second display module due to the deformation of the front frame of the glasses, the AR glasses convert the positions and/or angles of the first image display area and the second image display area to be simultaneously adjusted according to the virtual image distance of each of the first image display area and the second image display area and the resolution of the image data output and displayed by each of the first image display area and the second image display area, and the positions and/or angles of the positions and/or angles for adjusting the first image display area are used as the adjustment data of the first image display area, and the positions and/or angles for adjusting the second image display area are used as the adjustment data of the second image display area.
Optionally, the step of adjusting the image display area according to the adjustment data in the step S20 may include:
adjusting the position and/or the size of the first image display area according to the adjustment data of the first image display area;
and/or that the number of the groups of groups,
and adjusting the position and/or the size of the second image display area according to the adjustment data of the second image display area.
In this embodiment, after the AR glasses calculate and determine the adjustment data for adjusting the first image display area of the first display module and/or the second image display area of the second display module, if the adjustment data is a position and/or an angle for adjusting only the first image display area, the AR glasses control the optical mechanical system for outputting and displaying the first image display area to adjust the position and/or the angle of the first image display area, and when it is detected that the first image display area and the second image display area cannot be aligned by adjusting only the position, so that the image data can obtain a good binocular fusion effect, the AR glasses further scale the size of the image data that is displayed by the first image display area and the second image display area, and then readjust the position of the first image display area until the image data that is displayed by the first image display area and the second image display area are aligned.
Or when the AR glasses calculate the determined adjustment data to be the position and/or angle for adjusting only the second image display area, the AR glasses control the optical mechanical system for outputting and displaying the second image display area to adjust the position and/or angle of the second image display area, and when detecting that the image data output and displayed by the first image display area and the second image display area cannot be aligned by adjusting the position only, so as to obtain a good binocular fusion effect of the image data, the AR glasses further scale the size of the image data output and displayed by the first image display area and the second image display area, and then further readjust the position of the second image display area until the image data output and displayed by the first image display area and the second image display area are aligned.
Still alternatively, as shown in fig. 5, when the determined adjustment data is calculated and the position and/or angle of the first image display area and the second image display area are adjusted at the same time, the AR glasses simultaneously control the optical mechanical system for outputting and displaying the first image display area to adjust the position and/or angle of the first image display area, and simultaneously control the optical mechanical system for outputting and displaying the second image display area to adjust the position and/or angle of the second image display area. And then, similarly, under the condition that the situation that the image data which are respectively output and displayed by the first image display area and the second image display area cannot be aligned by only adjusting the positions is detected, so that the image data obtain a good binocular fusion effect, the AR glasses further scale the sizes of the image data which are respectively output and displayed by the first image display area and the second image display area, and then further readjust the positions of the first image display area and the second image display area until the image data which are respectively output and displayed by the first image display area and the second image display area are aligned.
In this embodiment, in the adjustment method of the wearable device, deformation data of a display module configured on the wearable device is obtained, and then adjustment data of an image display area for outputting a display image on the display module is calculated and determined according to the deformation data, so that adaptive adjustment is performed on the image display area according to the adjustment data.
Therefore, even if the wearable device is miniaturized and light AR glasses deform due to insufficient rigidity, so that the display module arranged on the AR glasses also deform correspondingly, the AR glasses can adapt to the image display area on the display module, and the properties such as the definition of the image displayed in the area are corrected to ensure the overall display effect. That is, the embodiment of the application adjusts the image display area on the AR glasses display module through flexibility, and can reduce the design requirement of the front frame of the AR glasses on the premise of guaranteeing the display effect of the AR glasses, thereby facilitating the miniaturization and light-weight development of the AR glasses.
Further, based on the first embodiment of the adjustment method of the wearable device of the present application, a second embodiment of the adjustment method of the wearable device of the present application is provided.
Similarly, the second embodiment of the adjustment method of the wearable device is also applied to the terminal device. The adjustment method of the wearable device of the present application is also described for clarity, and the adjustment method of the wearable device of the present application is still described below by taking the wearable device, i.e. AR glasses, of the terminal device as an execution subject.
In a second embodiment of the method for adjusting a wearable device of the present application, the wearable device further comprises a manual adjustment component. Based on this, the adjustment method of the wearable device of the present application may further include the following steps:
and receiving an adjustment instruction triggered by the manual adjustment component, and determining adjustment data of an image display area on the display module according to the adjustment instruction.
In this embodiment, the AR glasses may monitor and collect deformation data of the first display module and/or the second display module by configuring and installing the sensor, so as to determine adjustment data based on conversion of the deformation data, and may synchronously or asynchronously receive an adjustment instruction triggered by autonomous operation of the manual adjustment assembly by a user, so as to determine adjustment data for adjusting the image display area on the first display module and/or the second display module according to the adjustment instruction.
Optionally, the manual adjustment component may be a roller, an entity/virtual key with a direction indication, or a knob, and the user may trigger, by operating the manual adjustment component, instruction data for adjusting the position of the image display area up, down, left, right, front and back, and performing angular rotation in a clockwise direction, a counterclockwise direction, or around the Z axis, and send the instruction data to a processor in the AR glasses, such as an SOC chip, so that the SOC chip in the AR glasses may determine adjustment data for adjusting the image display area on the first display module and/or the second display module by receiving the instruction data. It should be understood that the instruction data triggered by the user operating the manual adjustment assembly is the adjustment instruction.
Optionally, before the step of receiving the adjustment instruction triggered by the manual adjustment component, the adjustment method of the wearable device of the present application may further include:
and outputting a preset auxiliary image through the image display area.
In this embodiment, when the user triggers an instruction through the manual adjustment component to determine that the user will manually adjust the image display area, the AR glasses may further output and display a preset auxiliary image on the image display area of each of the first display module and the second display module through the first display module and the second display module, so that the user triggers corresponding adjustment data based on accurate operation of the manual adjustment component to observe the auxiliary image.
Alternatively, the auxiliary image may be image data including a special image element to facilitate the user's observation of whether the respective image display areas of the first display module and the second display module are aligned. It should be immediately noted that, based on different design requirements of practical applications, in different possible implementations, the auxiliary image output by the AR glasses through the image display area may of course be different, i.e. the adjustment method of the wearable device of the present application is not limited to the specific type of the auxiliary image.
Optionally, the step of receiving an adjustment instruction triggered by the manual adjustment component includes:
and receiving an adjustment instruction of the manual adjustment component for adjusting the auxiliary image.
In this embodiment, after the AR glasses output and display the above auxiliary image through the image display area on the display module, the user may operate the manual adjustment assembly by observing the auxiliary image, so as to trigger instruction data for directly adjusting the position, angle and/or size of the auxiliary image, and send the instruction data to the SOC chip in the AR glasses, and after receiving the adjustment data, the SOC chip further uses the instruction data as adjustment data for controlling the image display area to adjust the corresponding position, angle and/or size.
In this embodiment, the adjustment method of the wearable device of the present application may not only collect deformation data of the display module caused by deformation of the front frame of the glasses based on the sensor to automatically adjust the image display area on the display module, but also synchronously or asynchronously adjust the image display area on the display module based on an adjustment command triggered by a manual adjustment component configured on the user operation device, so as to respond to the command to allow the user to manually control the adjustment of the image display area on the display module. In this way, the flexibility of adjusting the image display area can be further improved.
In addition, according to the adjustment method of the wearable device, in the process of automatically and manually controlling the manual adjustment assembly to adjust the image display area by the user, the operation of automatically adjusting the image display area based on the deformation data of the sensor acquisition display module is synchronously executed, so that the user can provide assistance for the operation of automatically adjusting the image display area under the condition that the alignment of the image display area is difficult to accurately adjust by the manual operation of the user so as to obtain a good binocular fusion effect, and the accuracy of adjusting the image display area is further ensured.
Further, based on the first embodiment and/or the second embodiment of the adjustment method of the wearable device of the present application, a third embodiment of the adjustment method of the wearable device of the present application is provided.
Referring to fig. 6, fig. 6 is a flowchart illustrating a third embodiment of a method for adjusting a wearable device according to the present application.
Likewise, it should be understood that although a logical sequence is illustrated in the flowchart, in some cases, the adjustment method of the wearable device of the present application may of course also perform the steps illustrated or described in a different order than here.
In addition, the third embodiment of the adjustment method of the wearable device is also applied to the terminal device. The adjustment method of the wearable device of the present application is also described for clarity, and the adjustment method of the wearable device of the present application is still described below by taking the wearable device, i.e. AR glasses, of the terminal device as an execution subject.
As shown in fig. 6, in a third embodiment of the adjustment method of the wearable device of the present application, the wearable device further includes an image acquisition device. Based on this, the adjustment method of the wearable device of the present application may further include the following steps:
step S30: acquiring image data output by the adjusted image display area through the image acquisition device;
step S40: when the adjusted image display area meets the preset binocular fusion condition according to the image data, ending adjusting the image display area;
Step S50: and outputting prompt information for adjusting the pose of the wearable device when judging that the adjusted image display area still does not meet the preset binocular fusion condition according to the image data.
In this embodiment, after the AR glasses perform corresponding adjustment on the image display area on the display module automatically and/or based on manual control of the user, in order to ensure that the image display area is adjusted in place and thus the image data displayed in the image display area has a good binocular fusion effect, the AR glasses further perform image acquisition on the adjusted image display area through the image acquisition device configured and installed by themselves, so as to at least acquire the image data output by the adjusted image display area.
Then, the AR glasses determine whether the adjusted first image display area and the adjusted second image display area meet preset binocular fusion conditions or not by means of an image processing algorithm on the image data displayed by the adjusted first image display area and the image data displayed by the adjusted second image display area. Therefore, when the adjusted first image display area and the adjusted second image display area are determined to meet the preset binocular fusion condition, the adjustment of the position, the angle and/or the size of the image display area is immediately finished.
On the contrary, when the adjusted first image display area and the second image display area still do not meet the preset binocular fusion condition, the AR glasses can judge that the image data displayed in the image display area cannot have a good binocular fusion effect by adjusting the positions, angles and/or sizes of the first image display area and the second image display area, so that prompt information for adjusting the pose of the wearable device is output to a user in a voice or image mode, and the pose of wearing the AR glasses is adjusted by the user. The AR glasses may then further determine whether to continue to automatically and/or make corresponding adjustments to the image display area on the display module based on user needs and/or based on user manual control.
Alternatively, the image capturing device may be configured by AR glasses at a position where the AR glasses can capture image data output from each of the first image display area and the second image display area. Or, the image acquisition device may also be a terminal device externally connected to the AR glasses or an image acquisition device on the terminal device, where the terminal device may perform the operation on the image data output by the adjusted first image display area and the second image display area by the user, and transmit the data to the AR glasses to determine whether the adjusted first image display area and second image display area conform to a preset binocular fusion condition, or the terminal device may also directly perform the determination locally and transmit the result of the determination to the AR glasses.
Alternatively, the preset binocular fusion condition may be whether the adjusted image data output by the first image display area and the second image display area are aligned (the central area is aligned or the edge area is aligned), that is, in the case that the two image data central areas are aligned, as shown in fig. 2, that is, it is determined that the adjusted first image display area and the adjusted second image display area meet the binocular fusion condition, otherwise (the two image data are not aligned), it is determined that the adjusted first image display area and the adjusted second image display area do not meet the binocular fusion condition.
In this embodiment, after the image display area on the display module is adjusted correspondingly automatically and/or based on manual control of a user, the adjustment method of the wearable device performs image acquisition on the adjusted image display area through the image acquisition device, so that at least image data output by the adjusted image display area is obtained, and whether the adjusted image display area meets the binocular fusion condition is determined by comparing the image data. Therefore, the image display area can be further ensured to be adjusted in place, and the image data displayed by the image display area can have good binocular fusion effect.
Further, the application also provides an adjusting device of the wearable device. The adjusting device of the wearable device can be applied to the wearable device provided with the display module.
Referring to fig. 7, an adjusting device of a wearable device of the present application includes:
the data acquisition module 10 is used for acquiring deformation data of the display module;
and the device adjusting module 20 is configured to determine adjusting data of the image display area on the display module according to the deformation data, and adjust the image display area according to the adjusting data.
Optionally, the wearable device further includes a sensor, the display module includes a first display module and a second display module, and the deformation data includes position change data;
the data acquisition module 10 includes:
the first data acquisition unit is used for acquiring sensor data acquired by the sensor aiming at the first display module and/or the second display module;
and the second data acquisition unit is used for determining the position change data of the first display module and the second display module according to the sensor data.
Optionally, the image display area includes: a first image display area on the first display module and a second image display area on the second display module;
The device adjustment module 20 includes:
and the adjustment data determining unit is used for determining adjustment data of the first image display area and/or the second image display area according to the position change data.
Optionally, the device adjustment module 20 further includes:
the first adjusting unit is used for adjusting the position and/or the size of the first image display area according to the adjusting data of the first image display area;
and the second adjusting unit is used for adjusting the position and/or the size of the second image display area according to the adjusting data of the second image display area.
Optionally, the wearable device further includes: a manual adjustment assembly;
the device adjusting module 20 of the adjusting device of the wearable device is further configured to receive an adjusting instruction triggered by the manual adjusting component, and determine adjusting data of the image display area on the display module according to the adjusting instruction.
Optionally, the adjusting device of the wearable device of the present application further includes:
the auxiliary module is used for outputting a preset auxiliary image through the image display area;
the device adjustment module 20 is further configured to receive an adjustment instruction for the manual adjustment component to adjust the auxiliary image.
Optionally, the wearable device further comprises an image acquisition device;
the adjusting device of the wearable device of the application further comprises:
the adjustment verification module is used for acquiring the image data output by the adjusted image display area through the image acquisition device; when the adjusted image display area meets the preset binocular fusion condition according to the image data, ending adjusting the image display area; and outputting prompt information for adjusting the pose of the wearable device when judging that the adjusted image display area does not meet the preset binocular fusion condition according to the image data.
It should be noted that, the specific embodiments of the operation of each functional module of the adjusting device of the wearable device provided in the present application are substantially the same as the embodiments of the adjusting method of the wearable device described above, and are not described herein.
In addition, the application also provides a wearable device, the wearable device includes: the method comprises the steps of a method for adjusting the wearable device according to any one of the embodiments above, wherein the method comprises a memory, a processor and an adjusting program of the wearable device, wherein the adjusting program is stored on the memory and can run on the processor, and the steps of the method for adjusting the wearable device are realized when the processor of the wearable device executes the adjusting program of the wearable device.
It should be noted that, the specific embodiments of the wearable device in the present application are substantially the same as the embodiments of the adjustment method of the wearable device described above, and are not described herein.
In addition, the application further provides a computer storage medium, and the computer storage medium stores an adjustment program of the wearable device, and the adjustment program of the wearable device realizes the steps of the adjustment method of the wearable device according to any one of the embodiments above when being executed by a processor.
It should be noted that, the specific embodiments of the computer storage medium of the present invention are substantially the same as the embodiments of the adjustment method of the wearable device, and are not described herein.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The foregoing embodiment numbers of the present application are merely for describing, and do not represent advantages or disadvantages of the embodiments.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) as described above, including several instructions for causing a terminal device (which may be a device for performing the adjustment method of the wearable device of the present application, which may be a mobile terminal, a data storage control terminal, a PC or a portable computer, etc.) to perform the method described in the embodiments of the present application.
The foregoing description is only of the preferred embodiments of the present application, and is not intended to limit the scope of the claims, and all equivalent structures or equivalent processes using the descriptions and drawings of the present application, or direct or indirect application in other related technical fields are included in the scope of the claims of the present application.

Claims (10)

1. The method for adjusting the wearable device is characterized by being applied to the wearable device provided with the display module;
the adjustment method of the wearable device comprises the following steps:
obtaining deformation data of the display module;
and determining adjustment data of an image display area on the display module according to the deformation data, and adjusting the image display area according to the adjustment data.
2. The method for adjusting a wearable device according to claim 1, wherein the wearable device further comprises a sensor, the display module comprises a first display module and a second display module, and the deformation data comprises position change data;
the step of obtaining deformation data of the display module comprises the following steps:
acquiring sensor data acquired by the sensor aiming at the first display module and/or the second display module;
and determining position change data of the first display module and the second display module according to the sensor data.
3. The method for adjusting a wearable device according to claim 2, wherein the image display area includes: a first image display area on the first display module and a second image display area on the second display module;
The step of determining the adjustment data of the image display area on the display module according to the deformation data comprises the following steps:
and determining adjustment data of the first image display area and/or the second image display area according to the position change data.
4. The method for adjusting a wearable device according to claim 3, wherein the step of adjusting the image display area according to the adjustment data includes:
adjusting the position and/or the size of the first image display area according to the adjustment data of the first image display area;
and/or that the number of the groups of groups,
and adjusting the position and/or the size of the second image display area according to the adjustment data of the second image display area.
5. The method of adjusting a wearable device of claim 1, wherein the wearable device further comprises: a manual adjustment assembly;
the method further comprises the steps of:
and receiving an adjustment instruction triggered by the manual adjustment component, and determining adjustment data of an image display area on the display module according to the adjustment instruction.
6. The method of adjusting a wearable device of claim 5, wherein prior to the step of receiving the adjustment instruction triggered by the manual adjustment component, the method further comprises:
Outputting a preset auxiliary image through the image display area;
the step of receiving the adjustment command triggered by the manual adjustment component comprises the following steps:
and receiving an adjustment instruction of the manual adjustment component for adjusting the auxiliary image.
7. The adjustment method of a wearable device according to any one of claims 1 to 6, wherein the wearable device further comprises an image acquisition means;
after the step of adjusting the image display area in accordance with the adjustment data, the method further includes:
acquiring image data output by the adjusted image display area through the image acquisition device;
when the adjusted image display area meets the preset binocular fusion condition according to the image data, ending adjusting the image display area;
and outputting prompt information for adjusting the pose of the wearable device when judging that the adjusted image display area still does not meet the preset binocular fusion condition according to the image data.
8. An adjusting device of a wearable device is characterized in that the adjusting device of the wearable device is also applied to the wearable device;
the adjusting device of the wearable device comprises:
The data acquisition module is used for acquiring deformation data of the display module;
and the equipment adjusting module is used for determining the adjusting data of the image display area on the display module according to the deformation data and adjusting the image display area according to the adjusting data.
9. A wearable device, the wearable device comprising: memory, a processor and an adjustment program of a wearable device stored on the memory and executable on the processor, which when executed by the processor, implements the steps of the adjustment method of a wearable device according to any of claims 1 to 7.
10. A computer storage medium, wherein an adjustment program of a wearable device is stored on the computer storage medium, and the adjustment program of the wearable device, when executed by a processor, implements the steps of the adjustment method of the wearable device according to any one of claims 1 to 7.
CN202311480245.4A 2023-11-08 2023-11-08 Adjustment method and device of wearable device, wearable device and medium Pending CN117518480A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311480245.4A CN117518480A (en) 2023-11-08 2023-11-08 Adjustment method and device of wearable device, wearable device and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311480245.4A CN117518480A (en) 2023-11-08 2023-11-08 Adjustment method and device of wearable device, wearable device and medium

Publications (1)

Publication Number Publication Date
CN117518480A true CN117518480A (en) 2024-02-06

Family

ID=89765670

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311480245.4A Pending CN117518480A (en) 2023-11-08 2023-11-08 Adjustment method and device of wearable device, wearable device and medium

Country Status (1)

Country Link
CN (1) CN117518480A (en)

Similar Documents

Publication Publication Date Title
US10748021B2 (en) Method of analyzing objects in images recorded by a camera of a head mounted device
EP3490433B1 (en) Wearable device having a display, lens, illuminator, and image sensor
US11301677B2 (en) Deep learning for three dimensional (3D) gaze prediction
US9582881B2 (en) Machine vision image sensor calibration
US10013761B2 (en) Automatic orientation estimation of camera system relative to vehicle
US20170351327A1 (en) Information processing apparatus and method, and program
CN108875526B (en) Method, device and system for line-of-sight detection and computer storage medium
US20220236056A1 (en) Metering adjustment method, apparatus and device and storage medium
US9959841B2 (en) Image presentation control methods and image presentation control apparatuses
JP2019129410A (en) Monitoring camera, control method thereof, and program
JP6594170B2 (en) Image processing apparatus, image processing method, image projection system, and program
US20180218714A1 (en) Image display apparatus, image processing apparatus, image display method, image processing method, and storage medium
WO2019021601A1 (en) Information processing device, information processing method, and program
US20210124174A1 (en) Head mounted display, control method for head mounted display, information processor, display device, and program
JP2010217984A (en) Image detector and image detection method
CN117518480A (en) Adjustment method and device of wearable device, wearable device and medium
CN108886562A (en) Image processing system, image processing method and program
CN114518217B (en) Method for determining center distance between lenses, microscope control device, and storage medium
CN116222964A (en) Imaging performance testing method, device, equipment and storage medium
CN114201028B (en) Augmented reality system and method for anchoring display virtual object thereof
CN113432620A (en) Error estimation method, error estimation device, vehicle-mounted terminal and storage medium
US10895910B2 (en) Adaptive eye-tracking calibration method
CN114527866A (en) Electronic device and method for tracking gesture of electronic device
KR20190143287A (en) Method for estimating a distance between iris and imaging device, and terminal for executing the same
US20180074327A1 (en) Non-transitory computer-readable storage medium, information processing terminal, and information processing method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination