CN115357121A - Control method, system and device of head-mounted wearable equipment and storage medium - Google Patents

Control method, system and device of head-mounted wearable equipment and storage medium Download PDF

Info

Publication number
CN115357121A
CN115357121A CN202211042118.1A CN202211042118A CN115357121A CN 115357121 A CN115357121 A CN 115357121A CN 202211042118 A CN202211042118 A CN 202211042118A CN 115357121 A CN115357121 A CN 115357121A
Authority
CN
China
Prior art keywords
touch
head
wearable device
mounted wearable
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211042118.1A
Other languages
Chinese (zh)
Inventor
杨宗旭
杨岩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Goertek Techology Co Ltd
Original Assignee
Goertek Techology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Goertek Techology Co Ltd filed Critical Goertek Techology Co Ltd
Priority to CN202211042118.1A priority Critical patent/CN115357121A/en
Publication of CN115357121A publication Critical patent/CN115357121A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012Head tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)

Abstract

The invention discloses a control method, a system, a device and a storage medium of head-mounted wearable equipment, and relates to the technical field of intelligent equipment interaction.

Description

Control method, system and device of head-mounted wearable equipment and storage medium
Technical Field
The invention relates to the field of intelligent equipment interaction, in particular to a control method, a control system, a control device and a storage medium of head-mounted wearable equipment.
Background
With the development of virtual reality technology, the development of head-mounted wearable devices is also more and more rapid. Wearable equipment of wearable of speech control's mode control head-mounted is commonly used to prior art, but this kind of mode receives external environment's interference easily, uses inconveniently. The prior art can also interact by touching a touch mechanism arranged on the head-mounted wearable device, but is limited by the size of the head-mounted wearable device, the size of the touch mechanism arranged on the head-mounted wearable device in the prior art is generally very small, for example, the size of the touch mechanism arranged on the temple of the AR glasses is generally 1cm × 2cm, so that a user can only perform some simple operations through the touch mechanism, and the head-mounted wearable device cannot be precisely controlled.
Disclosure of Invention
The invention aims to provide a control method, a control system, a control device, a storage medium and related components of a head-mounted wearable device, which can provide a sufficient touch area for a user to control the head-mounted wearable device and ensure the accuracy of the control of the head-mounted wearable device.
In order to solve the technical problem, the invention provides a control method of a head-mounted wearable device, which comprises the following steps:
determining a matching ratio between a display module and a touch module of the head-mounted wearable device;
when the touch module is touched, acquiring an actual touch coordinate of a touch action on the touch module;
determining a target trigger coordinate mapped to the display module by the touch action based on the actual touch coordinate and the matching proportion;
and sending the target trigger coordinate to the head-mounted wearable device so that the head-mounted wearable device performs corresponding operation based on the target trigger coordinate.
Preferably, determining a matching ratio between the display module and the touch module of the head-mounted wearable device includes:
acquiring resolution information of the display module;
obtaining an effective touch range of the touch module;
dividing the transverse effective touch length of the effective touch range and the transverse resolution in the resolution information to obtain a transverse matching proportion;
dividing the longitudinal effective touch length of the effective touch range and the longitudinal resolution in the resolution information to obtain a longitudinal matching proportion;
and taking the transverse matching proportion and the longitudinal matching proportion as the matching proportion.
Preferably, if the touch module is disposed on the control terminal, before determining the matching ratio between the display module of the head wearable device and the touch module, the method further includes:
detecting whether a command for entering a control mode is received;
when the control mode entering instruction is received, the control terminal is controlled to establish communication connection with the head-mounted wearable equipment
Preferably, the detecting whether the command for entering the control mode is received includes:
detecting whether a control mode entering instruction generated when a user triggers a control module arranged on the control terminal is received or not, or detecting whether a control mode entering instruction sent by the head-mounted wearable device is received or not.
Preferably, the controlling the control terminal to establish a communication connection with the head-mounted wearable device includes:
and controlling a low-power-consumption Bluetooth module in the control terminal to output a communication connection signal so that the low-power-consumption Bluetooth module in the head wearable equipment establishes communication connection with the low-power-consumption Bluetooth module in the control terminal after receiving the communication connection signal.
Preferably, when acquiring the actual touch coordinates, the method further includes:
detecting a touched mode of the touch module, wherein the touched mode comprises any one or more combinations of single-finger non-coherent touch, multi-finger non-coherent touch, single-finger coherent touch and multi-finger coherent touch;
sending the touched mode to the head-mounted wearable device so that the head-mounted wearable device executes corresponding operation based on the touched mode.
In order to solve the above technical problem, the present invention further provides a control system of a head wearable device, including:
the matching proportion determining unit is used for determining the matching proportion between the display module and the touch module of the head-wearing wearable device;
the acquisition unit is used for acquiring the actual touch coordinate of the touch action on the touch module when the touch module is touched;
the determining unit is used for determining a target trigger coordinate mapped to the display module by the touch action based on the actual touch coordinate and the matching proportion;
a sending unit, configured to send the target trigger coordinate to the head-mounted wearable device, so that the head-mounted wearable device performs a corresponding operation based on the target trigger coordinate.
In order to solve the above technical problem, the present invention further provides a control device for a head wearable device, including:
a memory for storing a computer program;
a processor for implementing the steps of the control method of the head-mounted wearable device as described above when executing the computer program.
Preferably, the mobile terminal further comprises a control terminal with a touch module, wherein the touch module is used for acquiring touch actions when touched.
In order to solve the above technical problem, the present invention further provides a storage medium, where a computer program is stored, and the computer program, when executed by a processor, implements the steps of the control method for the head-mounted wearable device.
In summary, the invention discloses a control method, a system, a device and a storage value of a head-mounted wearable device, relating to the field of wearable devices, and the method comprises the steps of firstly determining a matching ratio between a display module and a touch module of the head-mounted wearable device; when the touch module is touched, acquiring an actual touch coordinate of a touch action on the touch module; determining a target trigger coordinate mapped to the display module by the touch action based on the actual touch coordinate and the matching proportion; and sending the target trigger coordinate to the head-mounted wearable device so that the head-mounted wearable device can perform corresponding operation based on the target trigger coordinate, intelligent interaction of the head-mounted wearable device is realized, and display control of the head-mounted wearable device is more accurate.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required in the prior art and the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
Fig. 1 is a flowchart of a method for controlling a head-mounted wearable device according to the present invention;
fig. 2 is a schematic structural diagram of a head-mounted wearable device and a control terminal according to the present invention;
fig. 3 is a schematic structural diagram of a control system of a head-mounted wearable device provided by the present invention;
fig. 4 is a schematic structural diagram of a control device of a head-mounted wearable device provided by the invention.
Detailed Description
The core of the invention is to provide a control method, a system, a device and a storage medium of a head-mounted wearable device, which can provide a sufficient touch area for a user to control the head-mounted wearable device and ensure the accuracy of the control of the head-mounted wearable device.
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be obtained by a person skilled in the art without making any creative effort based on the embodiments in the present invention, belong to the protection scope of the present invention.
Referring to fig. 1, fig. 1 is a flowchart of a method for controlling a head-mounted wearable device according to an embodiment of the present invention, the method for controlling the head-mounted wearable device includes:
s1, determining a matching ratio between a display module and a touch module of the head-mounted wearable device;
in this application, the user touches the operation at touch module, and then controls the display interface of the display module among the wearable equipment of wear-type, considers touch module's effective touch scope and display module's the size difference of display interface, consequently need confirm the matching proportion between touch module and the display module so that wearable equipment of wear-type carries out corresponding operation.
S2, when the touch module is touched, acquiring an actual touch coordinate of a touch action on the touch module;
in the application, a user performs a touch operation on the touch module, so that an actual touch coordinate of a touch action of the user on the touch module needs to be acquired before the head-mounted wearable device is controlled, so as to determine a target trigger coordinate of the touch action mapped on the head-mounted wearable device based on a matching ratio, and further achieve the purpose of controlling the head-mounted wearable device.
And, touch module's effective touch area generally is tens square centimeter to twenty square centimeters, has sufficient space to let the user carry out the touch operation, and then can be more accurate control wearable equipment of wear-type.
In addition, the touch action in this application may be in various forms, such as a single-finger non-coherent touch (e.g., a single-finger single click or a single-finger double click), a single-finger coherent touch (e.g., a single-finger straight line or a single-finger triangle), a multi-finger non-coherent touch (e.g., a double-finger single click or a three-finger single click), and a multi-finger coherent touch (e.g., a double finger slides from the center to the periphery or a double finger slides from the periphery to the center), which is not particularly limited in this application.
S3, determining a target trigger coordinate mapped to the display module by the touch action based on the actual touch coordinate and the matching proportion;
after the actual touch coordinate and the matching proportion are obtained, in order to perform a corresponding operation in an interface displayed by a display module of the head-mounted wearable device, a target trigger coordinate of the touch action mapped on the display module needs to be obtained based on the matching proportion and the actual touch coordinate, and then the head-mounted wearable device may perform a corresponding operation based on the target trigger coordinate, for example, selecting an option corresponding to the target trigger coordinate of the display interface of the display module, and the like.
In the application, if the touch module and the display module of the head-wearing wearable device are rectangular, the matching proportion can be directly determined according to the size of the touch module and the size of the display module; if the touch module is circular and the display module of the head-mounted wearable device is rectangular, a part of rectangular area in the circular touch module can be divided into effective touch areas, and then the matching proportion is determined based on the sizes of the effective touch areas and the display module.
And S4, sending the target trigger coordinate to the head-mounted wearable device so that the head-mounted wearable device can perform corresponding operation based on the target trigger coordinate.
And finally, the target trigger coordinate is sent to the head-mounted wearable device, the corresponding position of the display interface of the display module can be controlled to perform corresponding operation after the head-mounted wearable device receives the target trigger coordinate, the purpose of controlling the head-mounted wearable device by using the existing control terminal of the user is finally realized, the control precision and the control flexibility are improved, and no additional cost or obvious endurance influence is brought.
In summary, the invention discloses a control method of a head-mounted wearable device, which includes determining a matching ratio between a touch module and a display module of the head-mounted wearable device, so that a target trigger coordinate mapped on the display module by the touch action can be determined after an actual touch coordinate of the touch action on the touch module is obtained, and finally the target trigger coordinate is sent to the head-mounted wearable device, so that the head-mounted wearable device performs corresponding operation based on the target trigger coordinate, and intelligent interaction and accurate control of the head-mounted wearable device are realized. And the effective touch area of the touch module of the control terminal is usually between ten-odd square centimeters and twenty square centimeters, and sufficient space is provided for the user to execute control operation, so that the head-wearing wearable device can be accurately controlled.
On the basis of the above-described embodiment:
as a preferred embodiment, determining a matching ratio between a display module and a touch module of a head-mounted wearable device includes:
acquiring resolution information of a display module;
acquiring an effective touch range of the touch module;
dividing the transverse effective touch length of the effective touch range and the transverse resolution in the resolution information to obtain a transverse matching proportion;
dividing the longitudinal effective touch length of the effective touch range and the longitudinal resolution in the resolution information to obtain a longitudinal matching proportion;
and taking the transverse matching proportion and the longitudinal matching proportion as matching proportions.
In this embodiment, in order to obtain the matching ratio between the display module and the touch module, first resolution information of the display module, that is, resolution information of a display interface seen after the user wears the head-mounted wearable device, and also an effective touch range of the touch module needs to be obtained, for example, the resolution information of the display module is L × W, the effective touch range of the touch module is M × N, then a transverse effective touch length L in the effective touch range is divided by a transverse resolution in the resolution information to obtain a transverse matching ratio L \ M, a longitudinal effective touch length W in the effective touch range is divided by a longitudinal resolution N in the resolution information to obtain a longitudinal matching ratio W \ N, and then final matching ratios are L \ M and W \ N.
Taking the actual touch coordinates as (M, N) and the target trigger coordinates as (X, Y) as an example, X = M × L \ M, and Y = N × W \ N.
In conclusion, in this embodiment, based on the resolution information of the display module and the effective touch range of the touch module, the horizontal matching proportion and the vertical matching proportion are obtained, the purpose of mapping the touch action to the display module by the touch module is achieved, and a basis is provided for controlling the control terminal by using the head-mounted wearable device.
As a preferred embodiment, if the touch module is disposed on the control terminal, before determining the matching ratio between the display module and the touch module of the head wearable device, the method further includes:
detecting whether a command for entering a control mode is received;
and when receiving a command of entering a control mode, controlling the control terminal to establish communication connection with the head-mounted wearable device.
The touch mechanism arranged on the head wearable device is used for controlling the head wearable device in the prior art, but due to the limitation of the self volume of the head wearable device, the size of the touch mechanism in the prior art is small, so that the touch control operation of a user is limited, and the control on the head wearable device is not accurate enough.
Considering that the control terminal has the characteristic of being worn at all times on one hand, the control terminal can execute control operation at any time; on the other hand, the size of a touch module such as a touch screen of the control terminal is usually large, generally ranging from tens of square centimeters to twenty square centimeters, and therefore, the control terminal has a large enough operation space for a user to control the head-mounted wearable device.
The wearable device of wear-type in this application can be AR glasses, and control terminal can be wearable device of wrist-wear type (for example smart watch, remote controller, handle and cell-phone etc.), and control terminal can also be virtual touch control, and this does not do not restrict in this application in particular.
Considering that the head-mounted wearable device does not need to perform control operation all the time, for example, when the user watches a movie through the head-mounted wearable device, the display module does not need to be controlled, and if the head-mounted wearable device and the control terminal are always in the control mode, the display module may be controlled by mistake, so in this embodiment, the control terminal is controlled to establish communication connection with the head-mounted wearable device only when an instruction for entering the control mode is received, and stability and reliability of controlling the head-mounted wearable device are further ensured.
In addition, in the present application, the execution sequence of establishing the communication connection between the control terminal and the head-mounted wearable device and determining the matching ratio between the display module of the head-mounted wearable device and the touch module of the control terminal is not particularly limited, as long as both the above two steps are completed before the actual touch coordinates are obtained, for example, the control terminal may establish the communication connection with the head-mounted wearable device first, then the control terminal obtains the size information of the display module of the head-mounted wearable device, and then the matching ratio is determined based on the size information of the display module and the size information of the touch module of the control terminal; the size information of the display module of the head-mounted wearable device and the size information of the touch module of the control terminal can be respectively acquired by the additionally arranged processor so as to determine the matching proportion, and then the control terminal is controlled to establish communication connection with the head-mounted wearable device. The control method of the head-mounted wearable device provided by the invention can be realized by multiplexing the processor in the control terminal or by additionally arranging the processor, and the method is not particularly limited in this application.
In addition, the communication mode between the control terminal and the head-mounted wearable device is not particularly limited, and for example, the control terminal and the head-mounted wearable device can communicate through wifi or bluetooth.
As a preferred embodiment, detecting whether an instruction to enter a control mode is received includes:
whether a control mode entering instruction generated when a user triggers a control module arranged on the control terminal is received or not is detected, or whether a control mode entering instruction sent by the head-mounted wearable device is received or not is detected.
In this embodiment, the control mode entering instruction may be generated by the control terminal when the control module on the control terminal is triggered, for example, the control terminal actively generates when a key preset on the control terminal is pressed, or actively generates when the wearable device needs to be controlled, and both the foregoing two manners may ensure that the control terminal is controlled to establish communication connection with the wearable device when the control mode entering instruction is received, thereby further ensuring the stability and reliability of controlling the wearable device.
As a preferred embodiment, the control terminal establishes a communication connection with the head wearable device, and includes:
the low-power-consumption Bluetooth module in the control terminal outputs a communication connection signal so that the low-power-consumption Bluetooth module in the head wearable device establishes communication connection with the low-power-consumption Bluetooth module in the control terminal after receiving the communication connection signal.
In this embodiment, a communication connection is established between the control terminal and the head-mounted wearable device through the bluetooth low energy module, please refer to fig. 2, where fig. 2 is a schematic structural diagram of the head-mounted wearable device and the control terminal according to the present invention, a central controller of the control terminal generates a communication connection signal, then sends the communication connection signal to the bluetooth low energy module in the head-mounted wearable device through the bluetooth low energy module in the control terminal, and then establishes a communication connection with the control terminal after the central controller of the head-mounted wearable device receives the communication connection signal.
To sum up, control terminal and wearable device carry out data transmission through low-power consumption bluetooth module in this embodiment and can reduce the transmission energy consumption, save the resource.
As a preferred embodiment, when acquiring actual touch coordinates of a touch action on the touch module, the method further includes:
detecting a touched mode of the touch module, wherein the touched mode comprises any one or combination of more than one of single-finger non-coherent touch, multi-finger non-coherent touch, single-finger coherent touch and multi-finger coherent touch;
and sending the touched mode to the head-mounted wearable device so that the head-mounted wearable device executes corresponding operation based on the touched mode.
Because this application adopts the wearable equipment of control terminal control head-mounted, and control terminal's touch module's effective touch range is very big, consequently this application supports the user to have multiple touch mode, consequently when touch module is touched in this embodiment, still can detect touch module's the by touch mode, wherein by the arbitrary combination in touch mode including single finger non-coherence touch, multi-finger non-coherence touch, single finger coherence touch and the multi-finger coherence touch, including single finger single click, single finger double click, double finger single click, double finger double click, single finger slides, double finger slides to all around from central point gliding and double finger slides to the center from all around.
Therefore, the embodiment includes a plurality of touched modes, and thus supports a plurality of control operations of the user, for example, when a single finger clicks, the wearable device is controlled to cut songs or take photos, when the two fingers slide to the periphery from the central position, the display interface of the display module of the wearable device is controlled to be enlarged, and when the two fingers slide to the periphery, the display interface of the display module of the wearable device is controlled to be reduced, so that the flexibility and the diversity of the control of the wearable device are further improved.
Referring to fig. 3, fig. 3 is a schematic structural diagram of a control system of a head-mounted wearable device according to the present invention, the control system of the head-mounted wearable device includes:
the matching proportion determining unit 11 is used for determining the matching proportion between the display module and the touch module of the head-mounted wearable device;
the obtaining unit 12 is configured to obtain an actual touch coordinate of a touch action on the touch module when the touch module is touched;
the determining unit 13 is used for determining a target trigger coordinate mapped to the display module by the touch action based on the actual touch coordinate and the matching proportion;
and a sending unit 14, configured to send the target trigger coordinate to the head-mounted wearable device, so that the head-mounted wearable device performs a corresponding operation based on the target trigger coordinate.
For a related introduction of the control system of the head-mounted wearable device provided by the present invention, please refer to the above embodiment of the control method of the head-mounted wearable device, which is not described herein again.
On the basis of the above-described embodiment:
as a preferred embodiment, the matching ratio determining unit 11 includes:
the resolution information acquisition unit is used for acquiring the resolution information of the display module;
the effective touch range acquisition unit is used for acquiring an effective touch range of the touch module;
the transverse matching proportion determining unit is used for dividing the transverse effective touch length of the effective touch range and the transverse resolution in the resolution information to obtain a transverse matching proportion;
the longitudinal matching proportion determining unit is used for dividing the longitudinal effective touch length of the effective touch range and the longitudinal resolution in the resolution information to obtain a longitudinal matching proportion;
and the matching proportion determining subunit is used for taking the transverse matching proportion and the longitudinal matching proportion as the matching proportion.
As a preferred embodiment, further comprising:
the detection unit is used for detecting whether a control mode entering instruction is received or not before determining the matching proportion between the display module and the touch module of the head-mounted wearable device; if yes, the connection unit is triggered.
And the connection unit is used for controlling the control terminal to establish communication connection with the head-mounted wearable device.
As a preferred embodiment, the detection unit includes:
the wearable equipment comprises a first detection unit and a second detection unit, wherein the first detection unit is used for detecting whether a control mode entering instruction generated when a user presses a key arranged on the control terminal is received or not, or the second detection unit is used for detecting whether a control mode entering instruction sent by the wearable equipment is received or not.
As a preferred embodiment, the connection unit includes:
the first connecting unit is used for controlling the low-power-consumption Bluetooth module in the control terminal to output a communication connection signal, so that the low-power-consumption Bluetooth module in the head wearable device establishes communication connection with the low-power-consumption Bluetooth module in the control terminal after receiving the communication connection signal.
As a preferred embodiment, the method further comprises the following steps:
the touch detection unit is used for detecting the touched mode of the touch module, and the touched mode comprises any one or combination of more of single-finger non-coherent touch, multi-finger non-coherent touch, single-finger coherent touch and multi-finger coherent touch;
and the touched mode sending unit is used for sending the touched mode to the head-mounted wearable equipment so that the head-mounted wearable equipment executes corresponding operation based on the touched mode.
Referring to fig. 4, fig. 4 is a schematic structural diagram of a control device of a head-mounted wearable device according to the present invention, the control device of the head-mounted wearable device includes:
a memory 21 for storing a computer program;
a processor 22 for implementing the steps of the control method of the head-mounted wearable device as described above when executing the computer program.
For the related description of the control apparatus of the head-mounted wearable device provided by the present invention, please refer to the above embodiment of the control method of the head-mounted wearable device, which is not repeated herein.
On the basis of the above-described embodiment:
the touch module is used for acquiring touch action when being touched.
The invention further provides a storage medium, on which a computer program is stored, which, when executed by a processor, implements the steps of the control method of the head-mounted wearable device as described above.
For the related introduction of the storage medium provided by the present invention, please refer to the above embodiment of the control method of the head-mounted wearable device, which is not described herein again.
In the present specification, the embodiments are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed in the embodiment corresponds to the method disclosed in the embodiment, so that the description is simple, and the relevant points can be referred to the description of the method part.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (10)

1. A control method of a head-mounted wearable device, comprising:
determining a matching ratio between a display module and a touch module of the head-mounted wearable device;
when the touch module is touched, acquiring an actual touch coordinate of a touch action on the touch module;
determining a target trigger coordinate mapped to the display module by the touch action based on the actual touch coordinate and the matching proportion;
and sending the target trigger coordinate to the head-mounted wearable device so that the head-mounted wearable device performs corresponding operation based on the target trigger coordinate.
2. The method for controlling the head-mounted wearable device according to claim 1, wherein determining a matching ratio between the touch module and the display module of the head-mounted wearable device comprises:
acquiring resolution information of the display module;
obtaining an effective touch range of the touch module;
dividing the transverse effective touch length of the effective touch range and the transverse resolution in the resolution information to obtain a transverse matching proportion;
dividing the longitudinal effective touch length of the effective touch range and the longitudinal resolution in the resolution information to obtain a longitudinal matching proportion;
and taking the transverse matching proportion and the longitudinal matching proportion as the matching proportion.
3. The method for controlling a head-mounted wearable device according to claim 1, wherein if the touch module is disposed on a control terminal, before determining a matching ratio between a display module of the head-mounted wearable device and the touch module on the control terminal, the method further comprises:
detecting whether a command for entering a control mode is received;
and when the control mode entering instruction is received, controlling the control terminal to establish communication connection with the head-mounted wearable device.
4. The method for controlling the head-mounted wearable device according to claim 3, wherein detecting whether the control mode entering command is received comprises:
detecting whether the control mode entering instruction generated when a user triggers a control module arranged on the control terminal is received or not, or detecting whether the control mode entering instruction sent by the head-mounted wearable device is received or not.
5. The method for controlling the head-mounted wearable device according to claim 3, wherein controlling the control terminal to establish a communication connection with the head-mounted wearable device comprises:
and controlling a low-power-consumption Bluetooth module in the control terminal to output a communication connection signal so that the low-power-consumption Bluetooth module in the head wearable equipment establishes communication connection with the low-power-consumption Bluetooth module in the control terminal after receiving the communication connection signal.
6. The method for controlling the head-mounted wearable device according to any one of claims 1 to 5, further comprising, when obtaining actual touch coordinates of a touch action on the touch module:
detecting a touched mode of the touch module, wherein the touched mode comprises any one or more combinations of single-finger non-coherent touch, multi-finger non-coherent touch, single-finger coherent touch and multi-finger coherent touch;
and sending the touched mode to the head-mounted wearable device so that the head-mounted wearable device executes corresponding operation based on the touched mode.
7. A control system of a head-mounted wearable device, comprising:
the matching proportion determining unit is used for determining the matching proportion between the display module and the touch module of the head-wearing wearable device;
the acquisition unit is used for acquiring the actual touch coordinate of the touch action on the touch module when the touch module is touched;
the determining unit is used for determining a target trigger coordinate mapped to the display module by the touch action based on the actual touch coordinate and the matching proportion;
a sending unit, configured to send the target trigger coordinate to the head-mounted wearable device, so that the head-mounted wearable device performs a corresponding operation based on the target trigger coordinate.
8. A control device of a head-mounted wearable device, comprising:
a memory for storing a computer program;
a processor for implementing the steps of the method of controlling a head-mounted wearable device according to any of claims 1 to 7 when executing said computer program.
9. The control device of the head-mounted wearable device according to claim 8, further comprising a control terminal having a touch module, wherein the touch module is configured to obtain a touch action when touched.
10. A storage medium, characterized in that it has stored thereon a computer program which, when executed by a processor, implements the steps of a method for controlling a head-mounted wearable device according to any of claims 1 to 7.
CN202211042118.1A 2022-08-29 2022-08-29 Control method, system and device of head-mounted wearable equipment and storage medium Pending CN115357121A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211042118.1A CN115357121A (en) 2022-08-29 2022-08-29 Control method, system and device of head-mounted wearable equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211042118.1A CN115357121A (en) 2022-08-29 2022-08-29 Control method, system and device of head-mounted wearable equipment and storage medium

Publications (1)

Publication Number Publication Date
CN115357121A true CN115357121A (en) 2022-11-18

Family

ID=84005615

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211042118.1A Pending CN115357121A (en) 2022-08-29 2022-08-29 Control method, system and device of head-mounted wearable equipment and storage medium

Country Status (1)

Country Link
CN (1) CN115357121A (en)

Similar Documents

Publication Publication Date Title
CN112527431B (en) Widget processing method and related device
EP2708983B9 (en) Method for auto-switching user interface of handheld terminal device and handheld terminal device thereof
CN111149086B (en) Method for editing main screen, graphical user interface and electronic equipment
EP2743819A2 (en) Terminal and method for providing user interface using a pen
WO2013131327A1 (en) Method, device, and system for controlling computer terminal
KR20180109229A (en) Method and apparatus for providing augmented reality function in electornic device
CN104714731A (en) Display method and device for terminal interface
US10963011B2 (en) Touch input method and mobile terminal
US10890982B2 (en) System and method for multipurpose input device for two-dimensional and three-dimensional environments
US20140055395A1 (en) Method and apparatus for controlling scrolling
EP3441865B1 (en) Electronic device for storing user data, and method therefor
CN104238900B (en) A kind of page positioning method and device
EP2741208A1 (en) Method for providing application information and mobile terminal thereof
KR20140112911A (en) Mobile apparatus executing action in display unchecking mode and control method thereof
CN203761432U (en) Mobile phone with locking icon moving automatically
CN115357121A (en) Control method, system and device of head-mounted wearable equipment and storage medium
CN116088698A (en) Touch pen-based use method and device
CN111338494B (en) Touch display screen operation method and user equipment
JP7393359B2 (en) drawing system
US20180253213A1 (en) Intelligent Interaction Method, Device, and System
CN112732158B (en) Wearable device and control method of wearable device
CN112328154B (en) Equipment control method and device and electronic equipment
CN117251067A (en) Touch system and touch method
KR20200075800A (en) Method for managing live box and apparatus for the same
CN115951792A (en) Handwriting input method and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination