WO2023240447A1

WO2023240447A1 - Head movement detection method, apparatus, device, and storage medium

Info

Publication number: WO2023240447A1
Application number: PCT/CN2022/098686
Authority: WO
Inventors: 宋伟
Original assignee: 北京小米移动软件有限公司
Priority date: 2022-06-14
Filing date: 2022-06-14
Publication date: 2023-12-21
Also published as: CN117597656A

Abstract

The present disclosure relates to a head movement detection method, an apparatus, a device, and a storage medium. A head movement detection method is applied to an electronic device, and comprises: according to a head movement and an eyeball movement, determining a posture of the head movement; and, according to the posture of the head movement, determining an operation instruction for the electronic device.

Description

A head movement detection method, device, equipment and storage medium

Technical field

The present disclosure relates to the field of intelligent technology, and in particular to a head movement detection method, device, equipment and storage medium.

Background technique

In related technologies, a single sensor is usually provided in a head-mounted smart device to detect the user's head movements, thereby controlling the head-mounted smart device based on the user's head movements.

Contents of the invention

In order to overcome the problems existing in related technologies, the present disclosure provides a head movement detection method, device, equipment and storage medium.

According to a first aspect of an embodiment of the present disclosure, a method for detecting head movements is provided, which is applied to electronic devices, including:

Determine the posture of the head movement based on head movement and eye movement;

According to the posture of the head movement, an operation instruction for the electronic device is determined.

In an exemplary embodiment, determining the posture of the head movement based on the head movement and the eye movement includes:

Get the initial posture of the head movement;

Obtain the posture of eye movements;

After compensating the initial posture of the head movement based on the posture of the eyeball movement, the posture of the head movement is determined.

In an exemplary embodiment, the initial posture of the head movement includes a first parameter; the posture of the eye movement includes a second parameter;

Determining the posture of the head movement after compensating the initial posture of the head movement through the posture of the eye movement includes:

Determine the first weight of the first parameter and the second weight of the second parameter;

The posture of the head movement is determined according to the first parameter and the first weight, and the second parameter and the second weight.

In an exemplary embodiment, determining the posture of the head movement according to the first parameter and the first weight, and the second parameter and the second weight includes:

The difference or sum of the product of the first parameter and the first weight and the product of the second parameter and the second weight is used as the posture of the head movement.

In an exemplary embodiment, obtaining the initial posture of the head movement includes:

Get the first initial parameters related to the head movement;

If the first initial parameter is greater than the first preset threshold, the first initial parameter is used as the first parameter; otherwise, the first parameter is set to 0.

In an exemplary embodiment, obtaining the gesture of the eye movement includes:

Obtain the second initial parameters related to eye movement;

If the second initial parameter is greater than the second preset threshold, the second initial parameter is used as the second parameter; otherwise, the second parameter is set to 0.

In an exemplary embodiment, the first parameter includes at least one of the following: angular velocity and movement direction of head movement;

The second parameter includes the movement speed of the eyeball.

In an exemplary embodiment, the detection method further includes:

Determine whether the head movement belongs to a preset movement according to the movement direction;

If so, adjust the first weight and the second weight according to preset rules.

In an exemplary embodiment, determining whether the head movement belongs to a preset movement according to the movement direction includes:

If the head movement includes more than two movement directions within the preset time period, it is determined that the head movement is a preset movement.

According to a second aspect of the embodiment of the present disclosure, a head movement detection device is provided, which is applied to electronic equipment, including:

The first determination module is configured to determine the posture of the head movement based on the head movement and the eye movement;

The second determination module is configured to determine an operation instruction for the electronic device according to the posture of the head movement.

According to a third aspect of an embodiment of the present disclosure, an electronic device is provided, including:

processor;

Memory used to store instructions executable by the processor;

Wherein, the processor is configured to perform the method according to any one of the first aspects of the embodiments of the present disclosure.

According to a fourth aspect of an embodiment of the present disclosure, a non-transitory computer-readable storage medium is provided, which when instructions in the storage medium are executed by a processor of a device, enables the device to perform the first aspect of the embodiment of the present disclosure. any one of the methods.

The technical solution provided by the embodiments of the present disclosure can include the following beneficial effects: determine the posture of the head movement based on the head movement and eye movement, determine the operating instructions for the electronic device based on the posture of the head movement, and be able to comprehensively consider the head movement. Movement and eye movement, and accurately detect the current head movement posture to accurately determine the operating instructions for controlling the head-mounted smart device.

It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only, and do not limit the present disclosure.

Description of the drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure.

FIG. 1 is a flow chart of a method for detecting head movements according to an exemplary embodiment.

Figure 2 exemplarily shows a flowchart of the method for determining the posture of the head movement according to the head movement and the eye movement in step S101.

Figure 3 exemplarily shows the flow chart of the method for obtaining initial parameters of the head movement in step S201.

Figure 4 exemplarily shows a flowchart of the method for obtaining the posture of the eye movement in step S202.

FIG. 5 is a flowchart of a method for detecting head movements according to an exemplary embodiment.

Figure 6 is a block diagram of a head movement detection device according to an exemplary embodiment.

FIG. 7 is a block diagram of a head-mounted smart device for head motion detection according to an exemplary embodiment.

Detailed ways

Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with aspects of the disclosure as detailed in the appended claims.

In related technology, an IMU (Inertial Measurement Unit) sensor is separately provided in a smart head-mounted device to detect the movements of the head to determine the operating instructions for the smart head-mounted device, such as up and down, left and right, shaking and nodding movements. By controlling the input focus of the headset, perform up and down, left and right movements, as well as confirm and cancel operation instructions. Or a separate eye-tracking sensor is provided in the head-mounted smart device to control the input focus according to the left and right, up and down movements of the human eye to execute the operation instructions of left and right, up and down movements. However, the above two methods may have great deviations for different usage scenarios and different users, leading to many misoperations. For example, when the sensitivity is set very high, slight head movements may be judged as input movements of operating instructions; rapid head twisting will cause the input focus to move too large, resulting in excessive visual screen switching, which is easy to Causes wearing discomfort and affects user experience.

In an exemplary embodiment of the present disclosure, a method for detecting head movements is provided, which can be applied to electronic devices, such as head-mounted smart devices such as AR glasses, VR glasses, and head-mounted displays, or video capture devices such as cameras. Figure 1 is a flow chart of a method for detecting head movements according to an exemplary embodiment. As shown in Figure 1, the method for detecting head movements includes the following steps:

Step S101, determine the posture of the head movement based on the head movement and eye movement;

Step S102: Determine an operation instruction for the electronic device based on the posture of the head movement.

In an exemplary embodiment of the present disclosure, in order to overcome the problem of easy misjudgment of head movements in related technologies, a method for detecting head movements is provided. The electronic device determines the posture of the head movement based on the head movement and eye movement, and determines the operating instructions for the electronic device based on the posture of the head movement. Considering head movements and eye movements simultaneously can determine the head movements more accurately, thereby accurately determining the operating instructions for controlling the electronic device.

In step S101, the head movement and the eye movement are both parameters that can reflect the head movement. According to the head movement and the eye movement, the posture of the head movement is determined, and the head movement can be further determined through the eye movement while taking the head movement into consideration. The head movements are corrected to make the determined head movement posture more accurate. When determining the posture of the head movement, it can be determined through a machine learning algorithm. The data related to the head movement and the data related to the eye movement are used as input data of the machine learning algorithm to output the posture of the head movement.

In step S102, different head movement postures correspond to different operating instructions for the electronic device. After determining the head movement posture, the operating instructions for the electronic device are determined according to the corresponding relationship. For example, the posture of the head movement includes the left and right or up and down movement of the head, and the amplitude of the head movement, which respectively correspond to the left and right or up and down movements of the input focus of the electronic device, and the amplitude of the movement of the input focus. The position where the input focus stays is the position where the input focus stays. Operation instructions corresponding to the device.

In an exemplary embodiment of the present disclosure, the posture of the head movement is determined based on the head movement and the eye movement, so as to determine the operating instructions for the electronic device based on the posture of the head movement, and the head movement and the eye movement can be comprehensively considered, Accurately detect the current head movement posture to accurately determine the operating instructions for controlling the head-mounted smart device.

In an exemplary embodiment, Figure 2 schematically shows a flowchart of the method for determining the posture of the head movement according to the head movement and eye movement in step S101. As shown in Figure 2, it includes the following steps:

Step S201, obtain the initial posture of the head movement;

Step S202, obtain the posture of the eyeball movement;

Step S203: After compensating the initial posture of the head movement through the posture of the eyeball movement, the posture of the head movement is determined.

The initial posture of the head movement is the posture of the head movement directly obtained through the sensor. The initial posture of the head movement can be represented by any parameter that can reflect the head movement. In an example, the initial posture of the head movement includes a first parameter, and the first parameter may be the angular velocity of the head movement, the moving direction of the head movement, or the angular velocity and movement direction of the head movement. The movement direction of the head movement can reflect the direction of the head turning up and down or left and right, and the angular velocity of the head movement can reflect the speed of the head rotation. The initial posture of the head movement can be obtained through the IMU sensor set on the electronic device.

The posture of the eyeball movement is the posture of the eyeball movement, which can be represented by any parameter that can reflect the eyeball movement. In an example, the posture of the eyeball movement includes a second parameter, and the second parameter includes a movement speed of the eyeball. The movement speed of the eyeball can reflect the movement speed of the user's gaze and is also an important parameter for determining the head movement posture. Eye movements can be acquired through eye tracking sensors installed on electronic devices.

The initial posture of the head movement is compensated through the posture of the eye movement. For example, the head movement moves to the left too fast, resulting in a large left movement, causing the head movement to fail to select the corresponding operation command. The user needs to move his or her head to the right to accurately select the corresponding operation command. If the left movement of the eye movement is very small, the left movement of the head movement can be compensated by the eye movement. The posture of the head movement can be accurately determined without the user moving to the right to adjust the head movement, so as to accurately determine the corresponding operation instructions. .

In an exemplary embodiment of the present disclosure, the initial posture of the head movement is compensated by the posture of the eyeball movement, which can make the determined head movement posture more accurate.

In an exemplary embodiment, when the initial posture of the head movement includes the first parameter and the posture of the eye movement includes the second parameter, the head movement is determined after compensating the initial posture of the head movement with the posture of the eye movement. gestures, including:

Determine the first weight of the first parameter and the second weight of the second parameter; determine the posture of the head movement based on the first parameter and the first weight, and the second parameter and the second weight.

The first weight and the second weight are both preset values and can be set according to different application scenarios or different users. For example, the first weight and the second weight are set according to the user's different age, gender and other characteristics. One parameter and the corresponding first weight, the second parameter and the corresponding second weight determine the posture of the head movement.

In an exemplary embodiment, the difference or sum of the product of the first parameter and the first weight and the product of the second parameter and the second weight is used as the posture of the head movement.

The head posture calculation method is determined according to different user needs and usage habits.

The posture of the head movement is recorded as C _out , then C _out = W _E *E _out - W _A *A _out , where A _out represents the first parameter, W _A represents the first weight of the first parameter, and E _out represents the second Parameter, W _E represents the second weight of the second parameter. When using the difference value, it can be used when the user's head movement range is large and may exceed the range of the required movement range, so as to reduce the need for the user to adjust the range of movement. For example, if it is detected that the user turns his head to the left and simultaneously detects the left movement of the eyeballs, then the difference between the product of the first parameter and the first weight and the product of the second parameter and the second weight is used to determine the posture of the head movement, preventing the user from The head movement to the left is too large and needs to be adjusted to the right.

The posture of the head movement can also be calculated as C _out = W _E * E _out + W _A * A _out , where A _out represents the first parameter, W _A represents the first weight of the first parameter, and E _out represents the second parameter. , W _E represents the second weight of the second parameter. When using summation, it can be used when the user's head movement range is small and cannot reach the required range of movement. For example, if it is detected that the user turns his head to the left and simultaneously detects the left movement of the eyeballs, then the sum of the product of the first parameter and the first weight and the product of the second parameter and the second weight is used to determine the posture of the head movement, which can avoid the user's The head movement to the left is insufficient and needs to be further moved to the left.

In exemplary embodiments of the present disclosure, the weights of the first parameter and the second parameter can be set respectively according to different application scenarios and different users, and the calculation method of the head posture can be set according to different user characteristics, which fully Consider the user's needs and usage habits to improve the accuracy of head movement detection and enhance the user experience.

In an exemplary embodiment, Figure 3 schematically shows a flowchart of the method for obtaining the initial posture of the head movement in step S201. As shown in Figure 3, it includes the following steps:

Step S301, obtain the first initial parameters related to the head movement;

Step S302: If the first initial parameter is greater than the first preset threshold, use the first initial parameter as the first parameter; otherwise, set the first parameter to 0.

The first initial parameter related to the head movement is a parameter directly obtained through the sensor. The first preset threshold is a preset value, which can be set according to different application scenarios or different users, for example, according to the user's different age and gender. and other characteristics to set a first preset threshold. The first preset threshold is used to determine whether the user's current action is a slight action without operating instructions, such as a slight shaking of the head, and is not intended to input the device. When the first initial parameter is greater than the first preset threshold, it means that the currently detected head movement is an action that the user wants to operate the device for input, so the first initial parameter is used as the first parameter; when the first initial parameter is less than the first A preset threshold value indicates that the currently detected head movement is an inadvertent slight shaking of the user and is not an input movement to the device. This movement needs to be ignored at this time, so the first parameter is set to 0.

In an example, the first parameter is recorded as A _out , the first initial parameter is A ₁ , and the first preset threshold is A _t . When A ₁ >A _t , A _out =A ₁ . When A ₁ <A _t When, A _out =0.

In an exemplary embodiment of the present disclosure, some slight head movements of the user can be filtered out through the first preset threshold to avoid some misoperations.

In an exemplary embodiment, Figure 4 schematically shows a flowchart of the method for obtaining the posture of the eye movement in step S202. As shown in Figure 4, it includes the following steps:

Step S401, obtain second initial parameters related to eye movement;

Step S402: If the second initial parameter is greater than the second preset threshold, use the second initial parameter as the second parameter; otherwise, set the second parameter to 0.

The second initial parameter related to the eye movement is a parameter directly obtained through the sensor. The second preset threshold is a preset value, which can be set according to different application scenarios or different users, such as according to the user's different age, gender, etc. The feature sets a second preset threshold. The second preset threshold is used to determine whether the user's current action is a slight eye movement, such as an involuntary slight eye movement, and is not for input to the device. When the second initial parameter is greater than the second preset threshold, it means that the currently detected eye movement is an action that the user wants to operate the device for input, so the second initial parameter is used as the second parameter; when the second initial parameter is less than the second When the threshold is preset, it means that the currently detected eye movement is an inadvertent slight rotation of the user and is not an input action to the device. This action needs to be ignored at this time, so the second parameter is set to 0.

In an example, the second parameter is recorded as E _out , the second initial parameter is E ₁ , and the second preset threshold is E _t . When E ₁ >E _t , E _out =E ₁ . When E ₁ <E _t When, E _out =0.

In an exemplary embodiment of the present disclosure, some slight eye movements of the user can be filtered out through the second preset threshold to avoid some misoperations.

In an exemplary embodiment, FIG. 5 is a flow chart of a method for detecting head movements according to an exemplary embodiment. As shown in FIG. 5 , the method for detecting head movements further includes the following steps:

Step S501, determine whether the head movement is a preset movement according to the movement direction;

Step S502: If yes, adjust the first weight and the second weight according to the preset rules.

Since the first weight and the second weight are preset values set according to user characteristics, but may not necessarily conform to the current user's usage habits, the first weight and the second weight need to be adjusted according to the current user's head movements during use. According to the movement method of the user's head movement, determine whether the head movement belongs to the preset movement. The preset movement includes the head movement including more than two movement directions within the preset time period. For example, when the movement method of the head movement is left movement. , but within the preset time period, the head moves first to the left and then to the right before completing the input to the device. This indicates that the first left movement is too large and the right movement needs to be adjusted. When the head movement is a preset movement, it means that the detection of the head movement is not accurate enough and the user needs to make further adjustments. Therefore, the first weight and the second weight need to be adjusted according to the preset rules to obtain more accurate head movements. attitude.

When adjusting the weight according to the preset rules, adjust the weight of the head movement and eye movement according to the actual situation of the user. For example, when the movement method of the head movement is left, if it moves first to the left and then to the right, it means that the range of the head movement is large and exceeds the preset range, so that the head-mounted smart device cannot accurately detect the movement. For corresponding instructions, at this time, the first weight can be reduced and the second weight can be increased to weaken the impact of the head movement being too large to accurately detect the corresponding instructions, so that the head-mounted smart device can accurately detect the corresponding movements. command without requiring the user to move to the right to adjust the head movement. If it moves to the left first and then to the left, it means that the head movement range is small and cannot reach the preset range, so that the head-mounted smart device cannot accurately detect the corresponding instructions of the movement. At this time, the first weight can be increased , reduce the second weight, weaken the impact of the head movement being too small to accurately detect the corresponding instructions, so that the head-mounted smart device can accurately detect the instructions corresponding to the movements without the user having to move left to adjust the head. action.

It should be noted that the first preset threshold and the second preset threshold can also be adjusted according to the adjusted first weight and the second weight, so that the obtained first parameter and the second parameter are more accurate. When the number of adjustments to the first preset threshold and the second preset threshold exceeds the preset number, the adjustment of the first weight and the second weight may also be triggered, so that the first weight, the second weight and the first preset The setting of the threshold and the second preset threshold can more accurately determine the instructions corresponding to the user's head movement and improve the user experience.

In exemplary embodiments of the present disclosure, adjusting the first weight and the second weight according to the user's usage can make the detection of head movements more in line with the usage habits and actual needs of current users of smart head-mounted devices, and improve user experience.

In an exemplary embodiment of the present disclosure, a head movement detection device is provided, which is applied to electronic equipment. Figure 6 is a block diagram of a head movement detection device according to an exemplary embodiment. As shown in Figure 6, it includes:

The first determination module 601 is configured to determine the posture of the head movement based on the head movement and eye movement;

The second determination module 602 is configured to determine the operation instruction for the electronic device according to the posture of the head movement.

Regarding the devices in the above embodiments, the specific manner in which each module performs operations has been described in detail in the embodiments related to the method, and will not be described in detail here.

FIG. 7 is a block diagram of an electronic device 700 for head motion detection according to an exemplary embodiment. For example, the device 700 may be AR glasses, VR glasses, a camera that detects head movements, a head-mounted display, a handheld display, or the like.

Referring to Figure 7, device 700 may include one or more of the following components: a processing component 702, a memory 704, a power supply component 706, a multimedia component 708, an audio component 710, an input/output (I/O) interface 712, a sensor component 714, and communications component 716.

Processing component 702 generally controls the overall operations of device 700, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 702 may include one or more processors 720 to execute instructions to complete all or part of the steps of the above method. Additionally, processing component 702 may include one or more modules that facilitate interaction between processing component 702 and other components. For example, processing component 702 may include a multimedia module to facilitate interaction between multimedia component 708 and processing component 702.

Memory 704 is configured to store various types of data to support operations at device 700 . Examples of such data include instructions for any application or method operating on device 700, contact data, phonebook data, messages, pictures, videos, etc. Memory 704 may be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EEPROM), Programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.

Power supply component 706 provides power to the various components of device 700 . Power supply components 706 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to device 700 .

Multimedia component 708 includes a screen that provides an output interface between the device 700 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide action. In some embodiments, multimedia component 708 includes a front-facing camera and/or a rear-facing camera. When the device 700 is in an operating mode, such as a shooting mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each front-facing camera and rear-facing camera can be a fixed optical lens system or have a focal length and optical zoom capabilities.

Audio component 710 is configured to output and/or input audio signals. For example, audio component 710 includes a microphone (MIC) configured to receive external audio signals when device 700 is in operating modes, such as call mode, recording mode, and speech recognition mode. The received audio signal may be further stored in memory 704 or sent via communication component 716 . In some embodiments, audio component 710 also includes a speaker for outputting audio signals.

The I/O interface 712 provides an interface between the processing component 702 and a peripheral interface module, which may be a keyboard, a click wheel, a button, etc. These buttons may include, but are not limited to: Home button, Volume buttons, Start button, and Lock button.

Sensor component 714 includes one or more sensors that provide various aspects of status assessment for device 700 . For example, sensor component 714 can detect the open/closed state of device 700, the relative positioning of components, such as the display and keypad of device 700, and sensor component 714 can also detect a change in position of device 700 or a component of device 700. , the presence or absence of user contact with device 700 , device 700 orientation or acceleration/deceleration and temperature changes of device 700 . Sensor assembly 714 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 714 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 714 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

Communication component 716 is configured to facilitate wired or wireless communications between device 700 and other devices. Device 700 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In one exemplary embodiment, communication component 716 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, the communications component 716 also includes a near field communications (NFC) module to facilitate short-range communications. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

In an exemplary embodiment, device 700 may be configured by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable Gate array (FPGA), controller, microcontroller, microprocessor or other electronic components are implemented for executing the above method.

In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions, such as a memory 704 including instructions, which are executable by the processor 720 of the device 700 to complete the above method is also provided. For example, the non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.

A non-transitory computer-readable storage medium that, when instructions in the storage medium are executed by a processor of a device, enables the device to perform a method for detecting head movements, and the method includes any of the above methods.

Other embodiments of the disclosure will be readily apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure that follow the general principles of the disclosure and include common knowledge or customary technical means in the technical field that are not disclosed in the disclosure. . It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It is to be understood that the present disclosure is not limited to the precise structures described above and illustrated in the accompanying drawings, and various modifications and changes may be made without departing from the scope thereof. The scope of the disclosure is limited only by the appended claims.

Industrial applicability

In this article, the posture of the head movement is determined based on the head movement and eye movement, and the operating instructions for the electronic device are determined based on the posture of the head movement. The head movement and eye movement can be comprehensively considered to accurately detect the current head movement. posture to accurately determine the operating instructions for controlling the head-mounted smart device.

Claims

A head movement detection method, applied to electronic equipment, including:

Determine the posture of the head movement based on head movement and eye movement;

According to the posture of the head movement, an operation instruction for the electronic device is determined.
The head movement detection method according to claim 1, wherein the determining the posture of the head movement according to the head movement and eyeball movement includes:

Get the initial posture of the head movement;

Obtain the posture of eye movements;

After compensating the initial posture of the head movement based on the posture of the eyeball movement, the posture of the head movement is determined.
The method for detecting head movements according to claim 2, wherein the initial posture of the head movement includes a first parameter; the posture of the eye movement includes a second parameter;

Determining the posture of the head movement after compensating the initial posture of the head movement through the posture of the eye movement includes:

Determine the first weight of the first parameter and the second weight of the second parameter;

The posture of the head movement is determined according to the first parameter and the first weight, and the second parameter and the second weight.
The head movement detection method according to claim 3, wherein the head movement is determined based on the first parameter and the first weight, and the second parameter and the second weight. gestures, including:

The difference or sum of the product of the first parameter and the first weight and the product of the second parameter and the second weight is used as the posture of the head movement.
The head movement detection method according to claim 3, wherein said obtaining the initial posture of the head movement includes:

Get the first initial parameters related to the head movement;

If the first initial parameter is greater than the first preset threshold, the first initial parameter is used as the first parameter; otherwise, the first parameter is set to 0.
The head movement detection method according to claim 3, wherein said obtaining the posture of eye movement includes:

Obtain the second initial parameters related to eye movement;

If the second initial parameter is greater than the second preset threshold, the second initial parameter is used as the second parameter; otherwise, the second parameter is set to 0.
The head movement detection method according to claim 3, wherein the first parameter includes at least one of the following: angular velocity and movement direction of head movement;

The second parameter includes the movement speed of the eyeball.
The method for detecting head movements according to claim 7, said detection method further comprising:

Determine whether the head movement belongs to a preset movement according to the movement direction;

If so, adjust the first weight and the second weight according to preset rules.
The head movement detection method according to claim 8, wherein determining whether the head movement belongs to a preset movement according to the movement direction includes:

If the head movement includes more than two movement directions within the preset time period, it is determined that the head movement is a preset movement.
A head movement detection device, applied to electronic equipment, including:

The first determination module is configured to determine the posture of the head movement based on the head movement and the eye movement;

The second determination module is configured to determine an operation instruction for the electronic device according to the posture of the head movement.
An electronic device including:

processor;

Memory used to store instructions executable by the processor;

Wherein, the processor is configured to perform the method according to any one of claims 1-9.
A non-transitory computer-readable storage medium that, when instructions in the storage medium are executed by a processor of the device, enables the device to perform the method according to any one of claims 1-9.