WO2023072195A1

WO2023072195A1 - Athletic analysis method and apparatus, and electronic device and computer storage medium

Info

Publication number: WO2023072195A1
Application number: PCT/CN2022/127953
Authority: WO
Inventors: 孙宇; 刘航; 徐腾; 陈霄汉
Original assignee: 华为技术有限公司
Priority date: 2021-10-29
Filing date: 2022-10-27
Publication date: 2023-05-04
Also published as: CN116072291A

Abstract

Provided are an athletic analysis method and apparatus, and an electronic device and a computer storage medium. The method comprises: acquiring first data of a target object according to body parameters of the target object (S201); acquiring second data of the target object, and the off-ground state of feet (S202); calculating a first numerical value and a second numerical value of an ankle joint on the basis of the off-ground state (S203); constructing a first coordinate system on the basis of an athletic posture of the target object, wherein the first coordinate system is used for constructing a homogeneous transformation matrix and acquiring first coordinates of a human body joint in the first coordinate system (S204); calculating the angular velocity of lower legs on the basis of the homogeneous transformation matrix and according to the first coordinates and the first data (S205); and calculating a third numerical value and a fourth numerical value of a knee joint on the basis of the first data, the second data, the first numerical value and the second numerical value of the ankle joint, and the angular velocity of the lower legs (S206). By means of the present application, a relatively simple method can be acquired to calculate a joint stress condition, so as to determine an athletic injury risk.

Description

Motion analysis method, device, electronic equipment and computer storage medium

This application claims the priority of the Chinese patent application with the application number 202111276279.2 and the application title "Motion analysis method, device, electronic equipment and computer storage medium" submitted to the China Patent Office on October 29, 2021, the entire content of which is incorporated by reference incorporated in this application.

technical field

The present application relates to the technical field of motion analysis, in particular to a motion analysis method, device, electronic equipment and computer storage medium.

Background technique

Exercise is an important part of human daily life, and exercise requires the cooperation of different joints of the human body. During exercise, people may suffer from different degrees of sports injuries due to non-standard exercise posture and excessive joint force.

At present, professional motion capture system and inverse dynamics analysis software can be used to simulate and solve the joint force, and then complete the motion guidance. However, the algorithm of this scheme is complicated, the equipment cost is high, and it is not convenient for users to use it daily.

Therefore, how to obtain a relatively simple and low-cost method to calculate joint force to effectively provide early warning of injury risk is a technical problem to be solved by those skilled in the art.

Contents of the invention

The embodiment of the present application discloses a motion analysis method, device, electronic equipment, and computer storage medium, which calculate the stress on the joints in a relatively simple way to provide early warning of the risk of injury.

In the first aspect, the embodiment of the present application provides a motion analysis method, which includes:

Acquiring the first data of the target object according to the physical parameters of the target object; the first data includes the mass, center of mass, and moment of inertia of the human body link;

Obtaining the second data of the target object and the ground-off state of the feet; the second data includes the movement velocity, angular velocity and position information of the human body joints of the center of mass of the human body link;

calculating a first value and a second value of the ankle joint based on the ground lift state;

Constructing a first coordinate system based on the movement posture of the target object, the first coordinate system is used to construct a homogeneous transformation matrix and obtain the first coordinates of the human joints in the first coordinate system;

calculating the angular velocity of the calf according to the first coordinates and the first data based on the homogeneous transformation matrix;

calculating a third value and a fourth value of the knee joint based on the first data, the second data, the first value and the second value of the ankle joint, and the angular velocity of the lower leg.

In this application, the joint force and moment of the target object's ankle joint is calculated according to the momentum theorem and momentum moment theorem by obtaining the human body inertial parameters and motion posture data of the target object combined with the ground-off state, and combined with the joint force and moment of the ankle joint to calculate For the joint force and moment of the knee joint, compared with the existing solutions, it is necessary to detect the joint force of the ankle joint through professional motion analysis equipment, calculate the moment of the ankle joint based on the joint force, and then calculate the moment of the knee joint. This application can calculate the joint force and moment of the ankle joint based on the ground-off state of the target object, and then calculate the joint force and moment of the knee joint. The calculation method is relatively simple, and there is no need to use professional motion analysis equipment during use to reduce costs.

With reference to the first aspect, in one possible implementation manner, the method further includes: calculating the angular velocity of the thigh according to the first coordinate and the first data based on the homogeneous transformation matrix; One data, the second data, the first value and the second value of the ankle joint, the third value and the fourth value of the knee joint and the angular velocity of the thigh calculate the fifth value and the value of the hip joint sixth value.

On the basis of calculating the joint force and moment of the ankle joint and knee joint, the application can also calculate the joint force and moment of the hip joint by combining the angular velocity of the thigh, the inertial parameters of the human body and the motion posture data.

With reference to the first aspect, in one possible implementation manner, calculating the first value and the second value of the ankle joint based on the ground-off state includes: when the ground-off state is the first state , the first value and the second value of the ankle joint are both 0; when the off-the-ground state is the second state, calculate the first value of the ankle joint according to the first data and the second data A numerical value and a second numerical value; when the ground-off state is a third state, calculate the first numerical value and the second numerical value of the ankle joint according to the first data and the second data; the first numerical value The second data is the position information of the human joints, the second coordinates are the projected coordinates of the center of gravity of the target object, the third coordinates and the fourth coordinates are the coordinates of the ankle joints, the second coordinates, the third coordinates, the fourth Coordinates are obtained from said second data.

This application divides the ground-off state into three situations, including the state of one foot touching the ground, the state of both feet touching the ground and the state of both feet in the air, and calculates the joint force and moment of the ankle joint based on the detected different ground-off states. Based on different ground-off states and using different data for calculation, the joints and moments of the ankle joints in different ground-off states can be calculated quickly and easily.

With reference to the first aspect, in one implementation manner, the calculating the first value and the second value of the ankle joint according to the first data and the second data includes: calculating the first value by the following formula a value and a second value,

F ₁ +F ₂ =Σm _i Δv _ci +G

M ₁ +M ₂ ＝Σ(J _i Δω _i -r _i ×m _i g)

Wherein: F1, F2 are the first numerical value of described ankle joint, M1, M2 are the second numerical value of described ankle joint, m _i is the quality of described human body link, v _ci is the movement velocity of described human body link barycenter, G is the weight of the user calculated according to the body parameters, J _i is the moment of inertia of the human body link, ω _i is the angular velocity of the center of mass of the human body link, r _i is the distance from the center of mass of the human body link to the reference point Vector, g is the acceleration due to gravity.

This application is based on the off-the-ground state of one foot touching the ground. The joint force and moment of the ankle joint in the vacant state are 0. The ankle joint in the ground-contact state can be calculated by combining the relevant information of the inertial parameters of the human body and the motion data of the human body joints according to the above formula. force and moment.

With reference to the first aspect, in one possible implementation manner, the first value and the second value of the ankle joint are calculated according to the first data and the second data; the second data is the human body The position information of the joint, the second coordinate is the projection coordinate of the center of gravity of the target object, the third coordinate and the fourth coordinate are the coordinates of the ankle joint, and the second coordinate, the third coordinate and the fourth coordinate are based on the second The data acquisition includes: calculating the first value and the second value by the following formula,

F ₁ +F ₂ =Σm _i Δv _ci +G

M ₁ +M ₂ ＝Σ(J _i Δω _i -r _i ×m _i g)

Wherein: F1, F2 are the first numerical value of described ankle joint, M1, M2 are the second numerical value of described ankle joint, m _i is the quality of described human body link, v _ci is the movement velocity of described human body link barycenter, G is the weight of the user calculated according to the body parameters, J _i is the moment of inertia of the human body link, ω _i is the angular velocity of the center of mass of the human body link, r _i is the vector from the center of mass of the human body link to the reference point , P _proj is the second coordinate, P ₁ is the third coordinate, and P ₂ is the fourth coordinate.

This application is based on the off-the-ground state of both feet touching the ground, and can combine the relevant information of human body inertia parameters, human body joint motion data and joint node coordinates of ankle joints to calculate joint forces and moments according to the above formula.

With reference to the first aspect, in one possible implementation manner, based on the homogeneous transformation matrix, calculating the angular velocity of the calf according to the first coordinate and the first data includes: corresponding the first coordinate to the following The formula calculates the rotation angle of the human body joint, and calculates the angular velocity of the lower leg based on the rotation angle of the human body joint,

(1≤i≤6, i is a positive integer)

Wherein, m is a coefficient, p is the first coordinate, a, d, and α are known distances or angles in the first coordinate system, and θ is the initial included angle + the rotation angle of the human joint.

With reference to the first aspect, in one possible implementation manner, the calculation based on the first data, the second data, the first value and the second value of the ankle joint and the angular velocity of the lower leg The third numerical value and the fourth numerical value of the knee joint include: calculating the third numerical value and the fourth numerical value by the following formula,

Wherein, F3 is the third numerical value, M4 is the fourth numerical value, m _shank is the calf mass in the first data,

is the velocity of the center of mass of the calf in the second data, r _shank is the vector of the distance from the center of mass of the calf to the reference point based on the first data and the second data, r _foot is based on the first data and the The vector of the center of mass of the foot obtained from the second data from the reference point, J _shank is the moment of inertia of the calf in the first data,

is the angular velocity of the lower leg.

With reference to the first aspect, in one possible implementation manner, the calculating the angular velocity of the thigh according to the first coordinate and the first data based on the homogeneous transformation matrix includes: converting the first coordinate The angle of rotation of the human joint is calculated corresponding to the following formula, and the angular velocity of the thigh is calculated based on the angle of rotation of the human joint,

(1≤i≤6, i is a positive integer)

With reference to the first aspect, in one possible implementation manner, the said first data, the second data, the first value and the second value of the ankle joint, the third value of the knee joint The numerical value and the fourth numerical value and the angular velocity of the thigh are used to calculate the fifth numerical value and the sixth numerical value of the hip joint, including: calculating the fifth numerical value and the sixth numerical value by the following formula,

Wherein, F5 is the fifth numerical value, M6 is the sixth numerical value, m _thigh is the thigh mass in the first data,

is the velocity of the center of mass of the thigh in the second data, r _thigh is the vector of the center of mass of the thigh from the reference point based on the first data and the second data, and r _shank is the vector based on the first data and the second data The second data obtains the vector of the calf center of mass distance from the reference point, and J _thigh is the moment of inertia of the thigh in the first data,

is the angular velocity of the thigh.

With reference to the first aspect, in one possible implementation manner, the first coordinate system includes: a reference sub-coordinate system, a first sub-coordinate system, and a second sub-coordinate system;

The homogeneous transformation matrix is constructed based on the relationship between the reference sub-coordinate system, the first sub-coordinate system and the second sub-coordinate system; the relationship between the reference sub-coordinate system, the first sub-coordinate system and the second sub-coordinate system The relationship between them includes the distance and angle between the coordinate axes;

The first coordinates are coordinates of the human body joints in the reference sub-coordinate system.

With reference to the first aspect, in one possible implementation manner, acquiring the ground lift state of the foot includes: displaying a first user interface, where the first user interface is used to display the setting of the ground lift reference value; The ground lift reference value is used to judge the ground lift state of the foot; and a setting operation for the ground lift reference value is received. By obtaining the setting of the ground lift reference value, it can be used to judge the ground lift state of the foot.

With reference to the first aspect, in one possible implementation manner, the method further includes: displaying a second user interface, where the second user interface displays a first image of the target object, and on the first image superimposing a first area and a first identification; the first area is the area of the human joint on the first image, and the first identification is the first value and the second value of the ankle joint, the At least one of the third value and the fourth value of the knee joint and the fifth value and the sixth value of the hip joint. In the above method, the joint forces and moments of the human joints can be displayed on the moving image, and the stress situation of the target object can be displayed more intuitively.

With reference to the first aspect, in one possible implementation manner, after calculating the fifth value and the sixth value of the hip joint, it further includes: based on the first value and the second value of the ankle joint, the knee At least one of the third numerical value and the fourth numerical value of the joint and the fifth numerical value and the sixth numerical value of the hip joint are used to determine whether a movement risk occurs.

In one possible implementation manner, judging whether a movement risk occurs includes: judging the first value and the second value of the ankle joint, the third value and the fourth value of the knee joint, and the value of the hip joint. The ratio of at least one of the fifth value and the sixth value to the first reference value and the first threshold value; if the ratio is greater than the first threshold value, a risk warning message is output.

In a possible implementation manner, outputting risk prompt information includes: outputting a first prompt; or outputting a first prompt, the first prompt including a first option; receiving a second operation acting on the first option , outputs the second prompt. Therefore, the above method can output the degree of risk of injury to human joints, and can also output a guidance plan for actions or exercise courses with risk of injury, which helps users adjust their own exercise posture and reduce the possibility of injury risk.

In a possible implementation manner, the first reference value is the human body joint stress threshold.

With reference to the first aspect, in one possible implementation manner, before obtaining the first data of the target object according to the physical parameters of the target object, the method further includes: performing anthropometric assessment on the user; the anthropometric assessment includes assessing physical state, the body state includes the injury site and the injury degree of the injury site. By detecting the user's physical state, it is possible to know whether the user has an injured part and the degree of injury of the injured part, so that the corresponding sports action can be adjusted or the user can be prompted to reduce the force on the injured part to reduce the risk of the user's sports injury.

In a possible implementation manner, evaluating the physical state includes: detecting that a first part is placed on the damaged part of the user, and detecting the time when the first part is placed on the damaged part; the body part of the user; and determine the extent of the injury based on the time. By detecting the time when the body part is placed on the injured part, the injury status can be easily informed without complicated procedures.

In a possible implementation manner, the first reference value is a bearing reference value, and the bearing reference value is adjusted according to the body measurement assessment. Dynamically adjust the load reference value through body measurement and evaluation, the load reference value can be adjusted according to the information of the body measurement evaluation, and the load reference value can also be dynamically adjusted according to the information after the body measurement evaluation changes, so it can be more based on the user's own Adjusting the load-bearing reference value according to the situation can reduce the risk of injury more accurately.

With reference to the first aspect, in one possible implementation manner, the target object is the user or a motion image in a selected exercise course. By detecting the actual movement of the user, the user's real-time analysis movement situation can be analyzed. By detecting the moving images in the selected exercise course, it is possible to simulate the detection of the moving images in the selected exercise course to analyze the exercise situation in the exercise course. Further, risk warnings about the selected exercise course can be output to determine whether the exercise in the exercise course is suitable for the user.

In a second aspect, the present application provides a motion analysis device, including a unit for performing the method described in the first aspect above.

In a third aspect, the present application provides an electronic device, including a touch screen, memory, one or more processors, multiple application programs, and one or more programs; wherein, the one or more programs are stored in In the memory; it is characterized in that, when the one or more processors execute the one or more programs, the electronic device implements the method described in the first aspect above.

In a fourth aspect, the present application provides a computer storage medium, which is characterized by comprising computer instructions, and when the computer instructions are run on an electronic device, the electronic device is made to execute the method described in the first aspect above.

To sum up, the embodiment of the present application calculates the force on the ankle joint by distinguishing between different ground-off states, and then obtains the force on the knee joint and hip joint by establishing a coordinate system in the lower limbs, so that a relatively simple method can be obtained. Calculate the stress on the joints to judge the risk of sports injuries.

Description of drawings

In order to illustrate the technical solutions of the embodiments of the present application more clearly, the following briefly introduces the drawings that need to be used in the description of the embodiments.

FIG. 1 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;

FIG. 2 is a software structural block diagram of an electronic device provided by an embodiment of the present application;

FIG. 3A is a schematic diagram of a user interface for an application program menu on an electronic device provided by an embodiment of the present application;

3B-3E are schematic diagrams of a scenario involved in this application;

FIG. 3F is a schematic diagram of a scene involved in this application;

FIG. 3G-FIG. 3H are schematic diagrams of another scene of the present application;

4A-4D are a set of schematic diagrams of interfaces provided by the embodiment of the present application;

Figure 4E-Figure 4I are another set of schematic diagrams of the interface provided by the embodiment of the present application;

Figure 4J-Figure 4N is another set of schematic diagrams of interfaces provided by the embodiment of the present application;

Figures 5A-5C are schematic diagrams of another set of interfaces provided by the embodiment of the present application;

Fig. 6 is another set of interface diagrams provided by the embodiment of the present application;

Fig. 7 is a schematic diagram of another group of interfaces provided by the embodiment of the present application;

8A-8C are schematic diagrams of another set of interfaces provided by the embodiment of the present application;

9A-9E are schematic diagrams of another set of interfaces provided by the embodiment of the present application;

Fig. 10 shows a flow chart of a motion analysis method;

Fig. 11 is a schematic diagram of a skeleton node provided by the embodiment of the present application;

FIG. 12 is a schematic diagram of a reference coordinate system provided by the embodiment of the present application;

Fig. 13 is a flow chart of a motion analysis method provided by the embodiment of the present application;

FIG. 14 is a schematic diagram of a center of gravity ground projection provided by an embodiment of the present application;

Fig. 15 is a schematic diagram of a lower limb coordinate system provided by the embodiment of the present application;

Fig. 16 is a schematic diagram of an initial state quantity of a lower limb coordinate system provided by the embodiment of the present application;

FIG. 17 is a flow chart of another motion analysis method provided by the embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

It should be understood that when used in this specification and the appended claims, the terms "comprising" and "comprises" indicate the presence of described features, integers, steps, operations, elements and/or components, but do not exclude one or Presence or addition of multiple other features, integers, steps, operations, elements, components and/or collections thereof.

It should also be understood that the terminology used in the specification of this application is for the purpose of describing particular embodiments only and is not intended to limit the application. As used in this specification and the appended claims, the singular forms "a", "an" and "the" are intended to include plural referents unless the context clearly dictates otherwise.

It should also be further understood that the term "and/or" used in the description of the present application and the appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations .

As used in this specification and the appended claims, the term "if" may be construed as "when" or "once" or "in response to determining" or "in response to detecting" depending on the context . Similarly, the phrase "if determined" or "if [the described condition or event] is detected" may be construed, depending on the context, to mean "once determined" or "in response to the determination" or "once detected [the described condition or event] ]” or “in response to detection of [described condition or event]”.

Electronic devices, user interfaces for such electronic devices, and embodiments for such electronic devices are described below. In some embodiments, the electronic device may be a portable electronic device that also includes other functions such as a personal digital assistant and/or a music player, such as a mobile phone, a tablet computer, a wearable electronic device with a wireless communication function (such as a smart watch) )wait. Exemplary embodiments of portable electronic devices include, but are not limited to, portable electronic devices running iOS, Android, Microsoft, or other operating systems.

The term "user interface (UI)" in the specification, claims and drawings of this application is a medium interface for interaction and information exchange between an application program or an operating system and a user, and it realizes the internal form of information Convert between forms that the user can receive. The user interface of the application program is the source code written in specific computer languages such as java and extensible markup language (XML). Such as pictures, text, buttons and other controls. Control (control), also known as widget (widget), is the basic element of user interface. Typical controls include toolbar (toolbar), menu bar (menu bar), text box (text box), button (button), scroll bar (scrollbar), images and text. The properties and contents of the controls in the interface are defined through labels or nodes. A node corresponds to a control or property in the interface, and after the node is parsed and rendered, it is presented as the content visible to the user. In addition, the interfaces of many applications, such as hybrid applications, usually include web pages. A web page, also called a page, can be understood as a special control embedded in an application program interface. A web page is a source code written in a specific computer language, such as hypertext markup language (HTML), cascading style Tables (cascading style sheets, CSS), java scripts (Java scriptvv, JS), etc., the source code of the webpage can be loaded and displayed as user-recognizable content by a browser or a webpage display component similar in function to the browser. The specific content contained in the webpage is also defined by the tags or nodes in the source code of the webpage. For example, HTML defines the elements and attributes of the webpage through <p>, <img>, <video>, and <canvas>.

The commonly used form of user interface is the graphical user interface (GUI), which refers to the user interface related to computer operation displayed in a graphical way. It can be an icon, window, control and other interface elements displayed on the display screen of the electronic device, where the visible control includes icons, buttons, menus, tabs, text boxes, dialog boxes, status boxes, navigation bars, widgets, etc. Visual interface elements.

The following embodiments of the present application provide a motion analysis method, a graphical user interface, and electronic equipment, which can calculate joint forces/torques, determine the injury risk of related sports, provide injury risk assessment and early warning, and reduce the possibility of sports injuries.

Exemplary electronic devices provided in the following embodiments of the present application are introduced below.

FIG. 1 shows a schematic structural diagram of an electronic device.

The electronic device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, Mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and user An identification module (subscriber identification module, SIM) card interface 195 and the like. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and an environment sensor. 180L, bone conduction sensor 180M, etc.

It can be understood that, the structure shown in the embodiment of the present application does not constitute a specific limitation on the electronic device. In other embodiments of the present application, the electronic device may include more or fewer components than shown in the illustrations, or combine certain components, or separate certain components, or arrange different components. The illustrated components can be realized in hardware, software or a combination of software and hardware.

The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (Application Processor, AP), a modem processor, a graphics processor (Graphics Processing unit, GPU), an image signal processor (Image Signal Processor, ISP), controller, memory, video codec, digital signal processor (Digital Signal Processor, DSP), baseband processor, and/or neural network processor (Neural-network Processing Unit, NPU) wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors. In some embodiments, the electronic device may also include one or more processors 110.

Wherein, the controller may be the nerve center and command center of the electronic equipment. The controller can generate an operation control signal according to the instruction opcode and timing signal, and complete the control of fetching and executing the instruction.

A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the processor 110 is reduced, thereby improving the efficiency of the electronic device.

In some embodiments, processor 110 may include one or more interfaces. The interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous transmitter (universal asynchronous receiver/transmitter, UART) interface, mobile industry processor interface (MIPI) interface, general-purpose input/output (general-purpose input/output, GPIO) interface, SIM interface, and/or USB interface, etc.

The I2C interface is a bidirectional synchronous serial bus, including a serial data line (serial data line, SDA) and a serial clock line (derail clock line, SCL). In some embodiments, processor 110 may include multiple sets of I2C buses. The processor 110 may be respectively coupled to the touch sensors 180K through different I2C bus interfaces, so that the processor 110 and the touch sensors 180K communicate through the I2C bus interfaces to realize the touch function of the electronic device.

I2S can be used for audio communication. In some embodiments, processor 110 may include multiple sets of I2S buses. The processor 110 may be coupled to the audio module 170 through an I2S bus to implement communication between the processor and the audio module 170 . In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the I2S interface, so as to realize the function of answering calls through the Bluetooth headset.

The PCM interface can also be used for audio communication, quantizing and encoding analog signal samples. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 through the PCM interface, so as to realize the function of answering calls through the Bluetooth headset.

The UART interface is a universal serial data bus used for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is usually used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to realize the Bluetooth function. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the UART interface, so as to realize the function of playing music through the Bluetooth headset.

The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193 . MIPI interface includes camera serial interface (camera serial interface, CSI), display serial interface (display serial interface, DSI), etc. In some embodiments, the processor 110 communicates with the camera 193 through the CSI interface to realize the shooting function of the electronic device. The processor 110 communicates with the display screen 194 through the DSI interface to realize the display function of the electronic device.

The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like. The GPIO interface can also be configured as an I2C interface, I2S interface, UART interface, MIPI interface, etc.

The USB interface 130 is an interface conforming to the USB standard specification, specifically, it can be a Mini USB interface, a Micro USB interface, a USB Type C interface, and the like. The USB interface 130 can be used to connect a charger to charge the electronic device, and can also be used to transmit data between the electronic device and peripheral devices. It can also be used to connect headphones and play audio through them. This interface can also be used to connect other electronic devices, such as AR devices.

It can be understood that the interface connection relationship between the modules shown in the embodiment of the present application is only a schematic illustration, and does not constitute a structural limitation of the electronic device. In other embodiments, the electronic device may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

The charging management module 140 is configured to receive a charging input from a charger. Wherein, the charger may be a wireless charger or a wired charger. In some embodiments of the wired charger, the charging management module 140 can receive the charging input of the wired charger through the USB interface 130 . In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging ring of the electronic device. While the charging management module 140 is charging the battery 142 , it can also provide power for electronic devices through the power management module 141 .

The power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 . The power management module 141 receives the input from the battery 142 and/or the charging management module 140 to provide power for the processor 110 , the internal memory 121 , the external memory, the display screen 194 , the camera 193 , and the wireless communication module 160 . The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle times, and battery health status. In some other embodiments, the power management module 141 may also be disposed in the processor 11Ω. In some other embodiments, the power management module 141 and the charging management module 140 may also be disposed in the same device.

The wireless communication function of the electronic device can be realized by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in an electronic device can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 can provide wireless communication solutions including 2G/3G/4G/5G applied to electronic devices. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (Low Noise Amplifier, LNA) and the like. The mobile communication module 150 can receive electromagnetic waves through the antenna 1, filter and amplify the received electromagnetic waves, and send them to the modem processor for demodulation. The mobile communication module 150 can also amplify the signals modulated by the modem processor, and convert them into electromagnetic waves through the antenna 1 for radiation. In some embodiments, at least part of the functional modules of the mobile communication module 150 may be set in the processor 110 . In some embodiments, at least part of the functional modules of the mobile communication module 150 and at least part of the modules in the processor 110 may be set in the same device.

A modem processor may include a modulator and a demodulator. Wherein, the modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator sends the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal is passed to the application processor after being processed by the baseband processor. The application processor outputs sound signals through audio equipment (not limited to speaker 170A, receiver 170B, etc.), or displays images or videos through display screen 194 . In some embodiments, the modem processor may be a stand-alone device. In some other embodiments, the modem processor may be independent from the processor 110, and be set in the same device as the mobile communication module 150 or other functional modules.

The wireless communication module 160 can provide wireless local area networks (wireless local area networks, WLAN) (such as wireless fidelity (Wi-Fi) network), bluetooth (bluetooth, BT), global navigation satellite system, etc. (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 . The wireless communication module 160 can also receive the signal to be sent from the processor 110 , frequency-modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.

The electronic device realizes the display function through the GPU, the display screen 194, and the application processor. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos and the like. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode). diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Mini LED, Micro LED, Micro-OLED, quantum dot light-emitting diodes (quantum dot light emitting diodes, QLED), etc. In some embodiments, the electronic device may include 1 or N display screens 194, where N is a positive integer greater than 1.

In some embodiments of the present application, the display screen 194 displays moving images of the user.

The electronic device can realize the display function through ISP, camera 193 , video codec, GPU, display screen 194 and application processor. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute instructions to generate or alter display information.

The ISP is used for processing the data fed back by the camera 193 . For example, when taking a picture, open the shutter, the light is transmitted to the photosensitive element of the camera through the lens, the light signal is converted into an electrical signal, and the photosensitive element of the camera transmits the electrical signal to the ISP for processing, and converts it into an image or video visible to the naked eye. ISP can also perform algorithm optimization on image noise, brightness, etc. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP may be located in the camera 193 .

Camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects it to the photosensitive element. The photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then transmits the electrical signal to the ISP for conversion into a digital image or video signal. ISP outputs digital image or video signal to DSP for processing. DSP converts digital images or video signals into standard RGB, YUV and other formats of images or video signals. In some embodiments, the electronic device may include 1 or N cameras 193, where N is a positive integer greater than 1.

In some embodiments of the present application, the two-dimensional position information of the user's feet, knees, hips, wrists, elbows, head and neck, etc. is detected in real time by the camera 193 .

Digital signal processors are used to process digital signals. In addition to digital image or video signals, they can also process other digital signals. For example, when an electronic device selects a frequency point, a digital signal processor is used to perform Fourier transform on the frequency point energy, etc.

Video codecs are used to compress or decompress digital video. An electronic device may support one or more video codecs. In this way, the electronic device can play or record videos in various encoding formats, such as: Moving Picture Experts Group (Moving Picture Experts Group, MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

NPU is a neural network (Neural-Network, NN) computing processor. By referring to the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can continuously learn by itself. Applications such as intelligent cognition of electronic devices can be realized through NPU, such as: image recognition, face recognition, speech recognition, text understanding, etc.

The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. Such as saving music, video and other files in the external memory card.

The internal memory 121 may be used to store computer-executable program codes including instructions. The processor 110 executes various functional applications and data processing of the electronic device by executing instructions stored in the internal memory 121 . The internal memory 121 may include an area for storing programs and an area for storing data. Wherein, the stored program area can store an operating system, at least one application program required by a function (such as a sound playing function, an image and video playing function, etc.) and the like. The storage data area can store data (such as audio data, phone book, etc.) created during the use of the electronic device. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (universal flash storage, UFS) and the like.

The electronic device can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. Such as music playback, recording, etc.

The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal.

Speaker 170A, also referred to as a "horn", is used to convert audio electrical signals into sound signals. When the electronic device receives a call or a voice message, it can listen to the voice by placing the receiver 170B close to the human ear.

Receiver 170B, also called "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device receives a call or a voice message, it can listen to the voice by placing the receiver 170B close to the human ear.

The microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can put his mouth close to the microphone 170C to make a sound, and input the sound signal to the microphone 170C. The electronic device may be provided with at least one microphone 170C.

The earphone interface 170D is used for connecting wired earphones.

The sensor module 180 may include one or more sensors, which may be of the same type or of different types. It can be understood that the sensor module 180 shown in FIG. 1 is only an exemplary division manner, and there may be other division manners, which are not limited in the present application.

The pressure sensor 180A is used to sense the pressure signal and convert the pressure signal into an electrical signal. In some embodiments, pressure sensor 180A may be disposed on display screen 194 . When a touch operation acts on the display screen 194, the electronic device detects the intensity of the touch operation according to the pressure sensor 180A. The electronic device may also calculate the touched position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities may correspond to different operation instructions. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities may correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view short messages is executed. When a touch operation whose intensity is greater than or equal to the first pressure threshold acts on the icon of the short message application, the instruction of creating a new short message is executed.

The gyro sensor 180B can be used to determine the motion posture of the electronic device. In some embodiments, the angular velocity of the electronic device about three axes (ie, x, y, and z axes) may be determined by the gyro sensor 180B. The gyro sensor 180B can be used for image stabilization.

The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist in positioning and navigation.

The magnetic sensor 180D includes a Hall sensor. The electronic device may detect opening and closing of the flip holster using the magnetic sensor 180D.

The acceleration sensor 180E can detect the acceleration of the electronic device in various directions (generally three axes). When the electronic device is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of electronic devices, and can be used in applications such as horizontal and vertical screen switching, pedometers, etc.

The distance sensor 180F is used to measure the distance. Electronic devices can measure distance via infrared or laser light. In some embodiments, when shooting a scene, the electronic device can use the distance sensor 180F to measure the distance to achieve fast focusing.

Proximity light sensor 180G may include, for example, light emitting diodes (LEDs) and light detectors, such as photodiodes. The light emitting diodes may be infrared light emitting diodes. Electronic devices emit infrared light outwards through light-emitting diodes. Electronic devices use photodiodes to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object in the vicinity of the electronic device. When insufficient reflected light is detected, the electronic device may determine that there is no object in the vicinity of the electronic device. The electronic device can use the proximity light sensor 180G to detect that the user holds the electronic device close to the ear to make a call, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode, automatic unlock and lock screen in pocket mode.

The ambient light sensor 180L is used for sensing ambient light brightness. The electronic device can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness.

The fingerprint sensor 180H is used to acquire fingerprints. Electronic devices can use the acquired fingerprint features to unlock fingerprints, access application locks, take pictures with fingerprints, answer incoming calls with fingerprints, and so on.

The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device uses the temperature detected by the temperature sensor 180J to implement a temperature treatment strategy.

The touch sensor 180K is also called a touch panel or a touch-sensitive surface. The touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen”. The touch sensor 180K is used to detect a touch operation on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194 . In some other embodiments, the touch sensor 180K may also be disposed on the surface of the electronic device, which is different from the position of the display screen 194 .

The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire the vibration signal of the vibrating bone mass of the human voice. The bone conduction sensor 180M can also contact the human pulse and receive the blood pressure beating signal. In some embodiments, the bone conduction sensor 180M can also be disposed in the earphone, combined into a bone conduction earphone. The audio module 170 can analyze the voice signal based on the vibration signal of the vibrating bone mass of the vocal part acquired by the bone conduction sensor 180M, so as to realize the voice function. The application processor can analyze the heart rate information based on the blood pressure beating signal acquired by the bone conduction sensor 180M, so as to realize the heart rate detection function.

The keys 190 include a power key, a volume key and the like. The key 190 may be a mechanical key. It can also be a touch button. The electronic device can receive key input and generate key signal input related to user settings and function control of the electronic device.

The motor 191 can generate a vibrating reminder. The motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations applied to different applications (such as taking pictures, playing audio, etc.) may correspond to different vibration feedback effects. The motor 191 may also correspond to different vibration feedback effects for touch operations acting on different areas of the display screen 194 . Different application scenarios (for example: time reminder, receiving information, alarm clock, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

The indicator 192 can be an indicator light, and can be used to indicate charging status, power change, and can also be used to indicate messages, missed calls, notifications, and the like.

The SIM card interface 195 is used for connecting a SIM card. The SIM card can be inserted into the SIM card interface 195 or pulled out from the SIM card interface 195 to realize contact and separation with the electronic device. The electronic device can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The electronic device interacts with the network through the SIM card to realize functions such as calling and data communication. In some embodiments, the electronic device adopts a SIM, that is, an embedded SIM card. A SIM card can be embedded in an electronic device and cannot be separated from the electronic device.

The electronic device exemplarily shown in FIG. 1 can display various user interfaces described in various embodiments through a display screen 194 . The electronic device can detect a touch operation in each user interface through the touch sensor 180K, such as a click operation (such as a touch operation on an icon, a double-click operation) in each user interface, and for example, an upward or downward movement in each user interface. swipe down, or perform a circle gesture, and so on. In some embodiments, the electronic device may detect motion gestures performed by the user holding the electronic device, such as shaking the electronic device, through the gyroscope sensor 180B, the acceleration sensor 180E, and the like. In some embodiments, the electronic device can detect non-touch gesture operations through the camera 193 .

In some embodiments of the present application, the electronic device can capture the moving image of the user through the camera 193 .

The software system of the electronic device may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. In this embodiment of the present application, the Android system with layered architecture is taken as an example to illustrate the software structure of the electronic device.

FIG. 2 is a block diagram of a software structure of an electronic device according to an embodiment of the present application.

The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate through software interfaces. In some embodiments, the system is divided into four layers, which are application program layer, application program framework layer, runtime (Android runtime) and system library, and kernel layer from top to bottom.

The application layer can consist of a series of application packages.

As shown in FIG. 2, the application package may include application programs (also called applications) such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and short message.

The application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

As shown in Figure 2, the application framework layer can include window managers, content providers, view systems, phone managers, resource managers, notification managers, and so on.

A window manager is used to manage window programs. The window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc.

Content providers are used to store and retrieve data and make it accessible to applications. Said data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebook, etc.

The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on. The view system can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.

The phone manager is used to provide communication functions of electronic devices. For example, the management of call status (including connected, hung up, etc.).

The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and so on.

The notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages, and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify the download completion, message reminder, etc. The notification manager can also be a notification that appears on the top status bar of the system in the form of a chart or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog interface. For example, prompting text information in the status bar, issuing a prompt sound, vibrating the electronic device, and flashing the indicator light, etc.

The runtime includes the core library and virtual machine. The runtime is responsible for the scheduling and management of the system.

The core library includes two parts: one part is the function function that the programming language (for example, java language) needs to call, and the other part is the core library of Android.

The application layer and the application framework layer run in virtual machines. The virtual machine executes programming files (for example, java files) of the application program layer and the application program framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

A system library can include multiple function modules. For example: surface manager (surface manager), media library (media libraries), 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL), etc.

The surface manager is used to manage the display subsystem, and provides fusion of two-dimensional (2-Dimensional, 2D) and three-dimensional (3-Dimensional, 3D) layers for multiple applications.

The media library supports playback and recording of various commonly used audio and video formats, as well as still image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing, etc.

2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is the layer between hardware and software. The kernel layer includes at least a display driver, a camera driver, an audio driver, a sensor driver, and a virtual card driver.

The workflow of the software and hardware of the electronic device will be exemplarily described below in conjunction with capturing a photographing scene.

When the touch sensor 180K receives a touch operation, a corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes touch operations into original input events (including touch coordinates, time stamps of touch operations, and other information). Raw input events are stored at the kernel level. The application framework layer obtains the original input event from the kernel layer, and identifies the control corresponding to the input event. Take the touch operation as a touch click operation, and the control corresponding to the click operation is the control of the camera application icon as an example. The camera application calls the interface of the application framework layer to start the camera application, and then starts the camera driver by calling the kernel layer. Camera 193 captures still images or video.

The term "user interface" in the specification, claims and drawings of this application is a medium interface for interaction and information exchange between an application program or an operating system and a user. conversion between. The commonly used form of user interface is the graphical user interface (graphic user interface, GUI), which refers to the user interface related to computer operation displayed in a graphical way. It can be an icon, window, control and other interface elements displayed on the display screen of the electronic device, where the control can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc. Visual interface elements.

An exemplary user interface for the application menu on the electronic device 100 is described below.

FIG. 3A exemplarily shows an exemplary user interface 31 on an electronic device for displaying applications installed on the electronic device.

The user interface 31 displays an interface on which application icons are placed, and the interface may include a plurality of application icons, for example, a clock application icon 309, a calendar application icon 311, a calendar application icon 311, a gallery application icon 313, a memo application icon 315, a file management Application icon 317, email application icon 319, music application icon 319, wallet application icon 323, Huawei video application icon 325, sports health application icon 327, weather application icon 329, browser application icon 331, smart life application icon 333, settings An application icon 335, a recorder application icon 337, an application store application icon 339, and the like. One or more signal strength indicators 303, a time indicator 305, a battery status indicator 307, etc. of mobile communication signals may be displayed above the plurality of application icons. An interface indicator 349 may also be displayed below the above-mentioned multiple application icons to indicate the positional relationship between the currently displayed interface and other interfaces. There are multiple tray icons below the interface indicator, such as a phone application icon 345 , an information application icon 347 , an address book application icon 343 , and a camera application icon 341 . The tray icon remains displayed when the interface is switched. The embodiment of the present application does not limit the content displayed on the user interface 31 .

It can be understood that FIG. 3A only exemplarily shows a user interface on an electronic device, and should not be construed as limiting the embodiment of the present application.

In the following embodiments of the present application, the application programs "Sports Health" and "Camera" of the electronic device can provide the function of "motion detection", wherein the "motion detection" function can be used to detect the user's motion posture during the exercise process , calculate the joint force/moment of the relevant joints of the user during the exercise, and learn the user's injury risk during the exercise.

"Sports and health" and "camera" are applications installed on electronic devices, and this application does not limit the names of the applications.

The motion analysis method provided by the embodiment of this application can be applied to various scenarios, including but not limited to:

(1) Scenarios for motion detection in motion applications

scene one:

As shown in Figure 3B, the electronic device can detect a user operation 200 (such as a click operation on the icon 327) acting on the "exercise and health" icon 327, and in response to this operation, the user interface shown in Figure 3C can be displayed exemplarily 32. User interface 32 may be the main user interface of the "Exercise and Health" application, which may include exercise mode list 351 , navigation bar 352 , search bar 353 , controls 354 , controls 355 , controls 356 , controls 357 , and controls 358 .

Wherein, the exercise mode list 351 may display one or more exercise mode options. The one or more exercise mode options may include: an indoor running option, a fitness option, a yoga option, a walking option, a cycling option, and a rope skipping option. The one or more exercise mode options can be presented as text information on the interface. Not limited thereto, the one or more exercise mode options may also be represented as icons or other forms of interactive elements (interactive element, IE) on the interface.

Among them, the

controls

354 and 356 can be used to monitor user operations that trigger opening of the "exercise course". The electronic device 100 may detect a user operation on the control 354 (such as a click operation on the control 354 ), and in response to the operation, the electronic device 100 may display the user interface 33 shown in FIG. 3D . User interface 33 may include

controls

360 , 361 . Control 360 may be used to listen for user actions that trigger opening of "Start Training". The electronic device may detect a user operation on the control 360 (such as the click operation 202 on the control 360), and in response to the operation, the electronic device 100 may display the user interface 34 as shown in FIG. 3E.

User interface 34 may include

controls

362 , 363 . The control 362 can be used to monitor the user's operation (such as the click operation 203 on the control 362 ) that triggers the selection of the motion gesture detection function control. The control 363 can be used to monitor the user's operation (such as a click operation on the control 363 ) to trigger the control not to select the motion posture detection function.

Scene two:

As shown in Figure 3B, the electronic device can detect the user's operation 200 (such as a click operation on the icon 327) acting on the icon 327 of "Exercise and Health", and in response to this operation, the user operation 200 exemplarily shown in Figure 3C can be displayed. interface32. The user interface 32 may be the user interface of the "Exercise and Health" application, and the user interface may include an exercise mode list 351 , a navigation bar 352 , a search bar 353 , controls 354 , 355 , 356 , 357 , and 358 .

Among them, the control 358 can be used to monitor the user operation that triggers the opening of "simulation detection". As shown in FIG. 3F , the electronic device 100 may detect a user operation on the control 358 (such as the click operation 204 on the control 358 ), and in response to the operation, the electronic device 100 triggers the activation of the analog motion detection function.

Another situation, as shown in Figure 3D,

The user interface 33 may include a control 361, and the control 361 may be used to monitor a user operation that triggers turning on "simulation detection". The electronic device can detect a user operation on the control 361 (such as a click operation on the control 361 ), and in response to the operation, the user interface 32 exemplarily shown in FIG. 3C can be displayed. The user interface 32 may be the user interface of the "sports and health" application program, and the electronic device 100 triggers to start the simulated exercise detection function.

Scene three:

As shown in FIG. 3G, the electronic device can detect a user operation 205 (such as a click operation on the icon 341) acting on the icon 341 of the "camera", and in response to the operation, the user interface shown in FIG. 3H can be displayed exemplarily. 35. User interface 35 may be that of a “camera” application, which may include camera settings list 364 , capture mode list 365 , motion detection options 366 , controls 367 , controls 368 , controls 368 , and fields 370 . in:

The camera setting list 364 can be used to display one or more camera setting options, so that the user can adjust the camera setting parameters. The shooting mode list 365 may display one or more shooting mode options, which may include: aperture options, night scene options, portrait options, photo taking options, video recording options, professional options, and motion detection options. The control 367 is used to monitor the user operation of starting to open the “Gallery”. Control 368 is used to monitor the user's operation to start shooting. The control 369 is used to monitor the user's operation of starting and switching the camera. Area 370 may be used to display images captured by the camera.

The electronic device 100 may detect a user action on the motion detection option (such as the click operation 206 on the motion detection option 366), and in response to the action, the electronic device 100 may trigger the motion detection function.

It can be understood that the above scenarios are only examples, and the motion analysis method provided in the embodiment of the present application can also be applied to other scenarios, which is not limited here.

Based on the above scenario, some embodiments of a user interface (user interface, UI) implemented on the electronic device 100 are introduced below.

4A-4D exemplarily show the user interface of the face recognition module in the "Sports and Health" application program. The electronic device 100 may detect a user operation on the control 362 of the user interface 34, and in response to the operation, the electronic device may display the user interface 40 as exemplarily shown in FIG. 4A. The user interface 40 can be used to remind the user that face recognition is about to be performed. For example, the text "face recognition is about to be displayed" 401 is displayed, and the prompt time can be 5 seconds. After the prompt time is over, the electronic device 100 can display the user interface 41 and start face recognition. As shown in FIG. 4B , the user interface 41 exemplarily shows a face recognition interface to collect face information. After the electronic device 100 collects the face information through the camera, it can perform some necessary processing, and match the processed face information with the stored face information template, so as to retrieve the user's physical assessment based on the face information template. information. The face information template may be input by the user before the electronic device 100 performs face recognition.

If the collected face information fails to match the stored face information template, the electronic device 100 may display a user interface 42 as shown in FIG. 4C . The user interface 42 can display a prompt 403, which is used to prompt the user to be a new user, that is, the user's face information is not stored in the stored face information template, and the identity evaluation information cannot be retrieved, and the user needs to perform body measurement evaluation to obtain user information. physical assessment information. The prompt time of prompt 403 may be 5s, and after the prompt ends, the electronic device may display the user interface provided by the body measurement evaluation function exemplarily shown in Fig. 4E-Fig. 4I.

If the collected face information matches the stored face information template successfully, the electronic device 100 can detect the user's last login time, and if the user's last login time does not exceed the preset time period, the electronic device 100 can obtain the user's last login time. identity assessment information.

If the collected face information is successfully matched with the stored face information template, the electronic device 100 can detect the user's last login time, and if the user's last login time exceeds the preset time period, the electronic device can display the user interface 43 . User interface 43 may include prompt 404 , control 405 , control 406 . Prompt 404 is used to prompt the user for the user whose login time exceeds the preset time period, suggesting that the user perform body measurement assessment again. Control 405 is used to listen for user operations that trigger re-measurement evaluation. The electronic device may detect a user operation acting on the control 405 (such as a click operation on the control 405), and in response to the operation, the electronic device may display the body measurement evaluation function provided by the body measurement evaluation function as exemplarily shown in FIGS. 4E-4I. User Interface. Control 406 can be used to monitor user operations that trigger the use of original data. The original data indicates the user's physical assessment information stored in the electronic device 100 before that.

4E-4I exemplarily illustrate user interfaces provided by the anthropometric assessment function. Anthropometric assessment may include two aspects: physical parameter assessment and physical state assessment.

4E-4I exemplarily illustrate relevant user interfaces for physical parameter assessment.

As shown in FIG. 4E , the electronic device 100 may display a control 407 and a control 408 on the user interface 44 .

Control 407 may listen for user operations that trigger device detection. The electronic device 100 may detect a user operation on the control 407 (such as a click operation on the control 407 ), and in response to the operation, the electronic device 100 may turn on the camera and display the user interface 45 . As shown in FIG. 4F , the user interface 45 may include a user image 409 detected by a camera and a prompt box 410 . Prompt 410 may display the user's height information. In a specific implementation, the electronic device 100 may turn on the camera, detect the user's height, and display the user's height information in the prompt box 410 . The electronic device 100 can detect the height of the user by: aiming the electronic device 100 at the user to be measured, pointing at the position of the foot and clicking to create a measurement point, moving the electronic device up to the head of the user to measure the height information. After the electronic device 100 detects the height information, it may display the user interface 46 . As shown in FIG. 4G , the user interface 46 may include: a prompt box 411 , a control 412 and a control 413 . The prompt box 411 can be used to display whether the user is connected to the body fat scale to obtain the user's weight and body fat percentage information (body mass index, BMI). Control 412 may listen for user operations that trigger connection to the body fat scale. The electronic device 100 may detect a user operation on the control 412 (such as a click operation on the control 412 ), and in response to the operation, the electronic device 100 may connect to the body fat scale and display the user interface 47 . As shown in FIG. 4H , the user interface 47 can display the body weight and body fat percentage information obtained through the body fat scale. After the electronic device 100 acquires the user's height, weight, and body fat percentage information, it may display a user interface for body state assessment as shown in FIGS. 4J-4N .

Control 408 may listen for user operations that trigger user input of relevant data. The electronic device 100 may detect a user operation on the control 408 (eg, a click operation on the control 408 ), and in response to the operation, the electronic device 100 may display the user interface 48 . The user interface 48 may include an input box 416, which may be used to receive user-entered information on height, weight, and body fat percentage. The electronic device 100 may detect a user operation acting on the input box 416 (such as an input operation on the input box 416), and in response to the operation, may display a user interface for body state assessment as shown in FIGS. 4J-4N.

4J-4N exemplarily illustrate user interfaces for physical state assessment.

As shown in FIG. 4J , the user interface 49 may include: a prompt box 417 , a control 418 , and a control 419 . The prompt box 417 may be used to prompt that a physical state assessment is about to be performed.

The control 418 may listen for user operations that trigger the device to detect a body state. The electronic device 100 may detect a user operation on the control 418 (eg, a click operation on the control 418 ), and in response to the operation, the electronic device 100 may display the user interface 50 . As shown in FIG. 4K, the user interface 50 may include a prompt box 420, which can be used to prompt the user to pay attention to the information when evaluating the physical state. The information may be a prompt "The camera is about to be turned on, please place your hand on the injured part , will reflect the severity according to the time the hand is placed." The prompt time of the prompt box 420 can be 5s, and when the prompt time ends, the electronic device can turn on the camera and display the user interface 51 . As shown in FIG. 4L , the user interface 51 may include an area 421 and a display frame 422 . The area 421 may display the image of the user collected by the electronic device 100 through the camera, and the area 421 may display the overall image of the user, or the image of the user's lower limbs. The display frame 422 can be used to display the damage degree reflected by the time when the user puts the hand on the damage site. The display frame 422 can include the damage degree frame reflected when the placement time is <2s, 2-4s, 4-6s, 6-8s, >8s, <2s, 2-4s, 4-6s, 6-8s, >8s The color of the damage degree box gradually changes from short to long with the placement time, and can be displayed as blue, green, yellow, orange, and red respectively. For example, when the electronic device 100 detects that the user left it for 5s, the damage degree box corresponding to 4-6s will turn red. The electronic device 100 may display the user interface 52 after detecting that the color of the damage degree frame is displayed. As shown in FIG. 4M , the user interface 52 may include a prompt box 423 . The prompt box 423 can be used to display the percentage of the force on the damaged part of the user as the standard force. After the electronic device 100 acquires the user's body state assessment information, it may display the user interface for detecting bone nodes as shown in FIGS. 5A-5C . Control 419 may listen for user operations that trigger manual input of the body state. The electronic device 100 may detect a user operation on the control 419 (eg, a click operation on the control 419 ), and in response to the operation, the electronic device 100 may display the user interface 53 . The user interface 53 may include

input boxes

424 , 425 . The input box 424 can be used to receive the name of the injury site input by the user. The input box 425 can be used to receive the damage degree of the damaged part of the user, and the damage degree can be divided into 1-5 grades, and the larger the number, the more serious the damage degree. Gears 1-5 correspond to the corresponding damage degree boxes, which can be displayed as blue, green, yellow, orange, and red respectively. The electronic device 100 may detect a user operation acting on the 1-5 damage degree box on the input box 425 (for example, a click operation on any one of the 1-5 grades on the input box 425), and the corresponding damage degree box displays a corresponding color. The electronic device 100 may display the user interface 52 after detecting that the user operation on the user interface 53 is completed. The user interface 52 may include a prompt box 423 . The prompt box 423 can be used to display the percentage of the force on the damaged part of the user as the standard force. After the electronic device 100 acquires the user's body state assessment information, it may display the user interface for detecting bone nodes as shown in FIGS. 5A-5C .

5A-5C exemplarily illustrate a user interface for detecting skeletal nodes.

As shown in FIG. 5A , the electronic device turns on a camera and displays a user interface 54 , which may include an area 501 and a prompt box 502 . The area 501 can be used to display the user image collected by the camera in real time, and the electronic device 100 can refresh the displayed content therein in real time, so that the electronic device 100 can detect the position of the user's bone nodes through the collected user image. The prompt box 502 can display the state of the detected bone node, which can be the text "Detecting the bone node...". After the detection of the skeletal nodes is completed, the electronic device 100 may display a user interface for space attitude calibration as shown in FIG. 6 .

In some embodiments, when the user image is collected by the electronic device 100 in real time, as shown in FIG. 5B and FIG. 5C , if the electronic device 100 detects that the user is not in an upright state, and there is an abnormal posture, such as the left leg is bent, etc., it can A prompt message 504 is output in the prompt box 502. The prompt message 504 may be the text "abnormal posture, please keep upright", which may be used to prompt the user to adjust the posture and maintain an upright state. After the electronic device 100 detects that the user adjusts to the upright state, it may display the user interface 54 .

Fig. 6 exemplarily shows a user interface for space attitude calibration.

As shown in FIG. 6 , the user interface 60 may include a prompt box 601 and a prompt box 602 .

The prompt box 601 may be used to display that the user interface 60 is an interface for setting the reference value of the ground lift, and the prompt box 601 may be the text "Space attitude calibration...".

The prompt box 602 can be used to output the countdown of the time, which can be a change of the

number

3, 2, 1, to remind the user of the time required for the attitude calibration of the control.

When the electronic device 100 detects that the space attitude calibration is completed, it may display the user interface for setting the ground clearance reference value as shown in FIG. 7 .

FIG. 7 exemplarily shows a user interface for setting the ground lift/ground contact reference value.

As shown in FIG. 7 , the user interface 70 may include a prompt box 701 , a control 702 and an input box 703 .

The prompt box 701 may be used to display that the user interface 70 is an interface for setting the ground lift reference value, and may be the text "set the ground lift reference value".

Control 702 may listen for a user operation that triggers the device to set the user's ground clearance reference value. The electronic device 100 may detect a user operation on the control 702 (such as a click operation on the control 702 ), and in response to the operation, the electronic device 100 may set the user's ground clearance reference value. After the electronic device 100 detects that the user's ground lift/ground contact reference value is set, it may display a force detection user interface as shown in FIG. 8A or FIG. 8B .

The input box 703 can be used to receive the ground reference value input by the user. The electronic device 100 may detect a user operation acting on the input box 703 (such as an input operation on the input box 703), and in response to the operation, may display a force detection user interface as shown in FIG. 8A or FIG. 8B.

8A-8C exemplarily illustrate the user interface of force detection.

As shown in FIG. 8A , the user interface 80 may include an area 801 , an area 802 , a prompt box 803 , and a prompt box 804 .

The area 801 can be used to display the moving images of the user collected by the camera 193 in real time. Area 802 may be used to display exemplary action images for an exercise session. The prompt box 803 can be used to display the name of the current sports action. The prompt box 804 can be used to display the user's exercise amount, which can be a combination of numbers and words, such as "5 kcal".

In some embodiments, as shown in FIG. 8B , the user interface 81 may include an area 801 , an area 802 , a prompt box 803 , a prompt box 804 , an icon 805 , and a prompt box 806 . For the area 801 , the area 802 , the prompt box 803 , and the prompt box 804 , reference may be made to the relevant description in the user interface 80 , and details are not repeated here. The icon 805 can be used to highlight the force-bearing parts of the user's joints, and highlight the magnitude of the force through color marking. For example, when the joint force is small, it can be displayed in green on the icon 805; when the joint force is large, it can be displayed in yellow on the icon 805; It is displayed in red on the 805. The prompt box 806 can be used to display the force value of the corresponding joint.

The electronic device 100 detects that the user has a certain risk of injury, and may display a user interface for outputting risk prompt information as shown in FIGS. 9A-9D .

FIG. 8C exemplarily shows a user interface for simulated testing of exercise sessions. The user interface 82 includes an area 807 that may be used to display images of exemplary moves during an exercise session.

9A-9E exemplarily show a user interface for outputting risk warning information.

As shown in FIG. 9A , the user interface 90 may include

prompt boxes

901 , 902 and a control 903 . The prompt box 901 may be used to display high-risk information of sports actions, which may be the text "It is detected that the current sports action has a high risk of injury". The prompt box 902 can be used to display the reason why the current action has a higher risk, and it can be the text "excessive force on the left leg". The control 903 may monitor user operations that trigger returning to force detection. The electronic device 100 may detect a user operation on the control 903 (such as a click operation on the control 903 ), and in response to the operation, the electronic device 100 may display a user interface for force detection as shown in FIG. 8A or 8B .

The electronic device 100 may display the user 91 when no user operation on the control 903 is detected within the preset time period, or when the display time of the user interface 90 exceeds the preset time period. As shown in FIG. 9B , the user interface 91 may include a control 903 , a prompt box 904 , and controls 905 and 906 . For the control 903, reference may be made to related descriptions in the user interface 90, and details are not repeated here. The prompt box 904 may display the text "Continue this exercise?".

The control 905 may listen for user operations that trigger continued movement and receive movement guidance. The electronic device 100 may detect a user operation on the control 905 (eg, a click operation on the control 905 ), and in response to the operation, the electronic device 100 may display the user interface 92 . As shown in FIG. 9C , the user interface 92 may include a control 903 and a prompt box 907 . The prompt box 907 may display an adjustment plan for sports actions with higher risks. The electronic device 100 may detect that the display time of the user interface 92 exceeds a preset time period, and may display the force detection user interface as shown in FIG. 8A or FIG. 8B .

Control 906 may listen for user operations that trigger switching of exercise classes. The electronic device 100 may detect a user operation on the control 906 (such as a click operation on the control 906 ), and in response to the operation, the electronic device 100 may display the user interface 93 . User interface 93 may include control 908 and control 909 . Control 908 may listen for user operations that trigger a return to the original exercise session. The electronic device 100 may detect a user operation acting on the control 908 (such as a click operation on the control 908), and in response to the operation, the electronic device 100 may display a force detection user interface as shown in FIG. 8A or FIG. 8B or user interface92. Control 909 may listen for user actions that trigger selection of a recommended exercise session. The electronic device 100 may detect a user operation on the control 909 (such as a click operation on the control 909 ), and in response to the operation, the electronic device 100 may switch to the recommended exercise course selected by the user.

In some embodiments, the electronic device 100 may display the user interface 92 after displaying the user interface 90 . The user interface 92 may include

prompt boxes

901 , 902 and a control 903 . When the electronic device 100 detects that the display time of the user interface 90 exceeds a preset time period, it may display the user interface 92 . The user interface 92 may include a control 903 and a prompt box 907 . The electronic device 100 may detect a user operation acting on the control 906 (such as a click operation on the control 906), and in response to the operation or detect that the display time of the user interface 92 exceeds a preset period of time, it may display the user interface as shown in FIG. 8A or FIG. 8B The user interface of the force detection is shown.

FIG. 9E exemplarily shows a user interface for performing a simulation test on an exercise course. The user interface 94 may include: a prompt box 910 , and the prompt box 910 may include

prompts

911 , 912 , and 913 . Prompt 911 can be used to prompt that the simulation test of the exercise course is completed, prompt 912 can be used to prompt the degree of injury risk of the exercise course, and prompt 913 can be used to display the action with a higher risk of injury in the exercise course and the adjustment plan for the action .

In the following, a motion analysis method provided by the present application will be described in detail by taking motion analysis using an electronic device as an example.

FIG. 10 shows a detailed flow of a method for motion analysis. As shown in Figure 10, the method may include:

S101: The electronic device receives a user operation of a user on a first application, where the user operation is used to instruct the electronic device to obtain identity evaluation information.

The first application may be a motion application in an electronic device, such as a motion application in a smart phone or a TV, a professional motion detection system, etc., or may be a camera.

Exemplarily, the first application may be the "sports and health" application in the electronic device 100 in FIG. 3A, and may be the "camera" in the electronic device in FIG. 3A. "Sports Health" is a sports and fitness application program on electronic devices such as smart phones and tablet computers. The embodiment of this application does not limit the name of the application program. "Camera" is a photo-taking application program on electronic devices such as smart phones and tablet computers, and the embodiment of the present application does not limit the name of the application program.

The user operation for the first application may be a user's touch operation, or may be a user's voice operation, gesture operation, etc., which is not limited herein.

The identity evaluation information may include physical parameter evaluation information, and may also include physical state evaluation information. The body parameter evaluation information may include the user's height, weight, and body fat percentage, and the body state evaluation information may include the user's injury site and injury degree. Injury refers to the destruction of the human body's skin, muscles, bones, viscera and other tissue structures caused by various external traumatic factors and the resulting local or systemic reactions. The damaged part refers to the damaged part of the human body, such as ankle and knee.

The way for the user to trigger the acquisition of physical assessment information on the electronic device may be to trigger a control with the function of starting motion detection in the main interface of the first application; or, the user may trigger a certain exercise course control in the main interface of the first application to display The main interface of the exercise course, triggering the control with the function of starting the exercise detection in the main interface of the exercise course, so as to obtain identity evaluation information.

In a possible implementation manner, the user interface may be the user interface shown in FIG. 3B-FIG. 3E. The electronic device may detect a user operation 200 (such as a click operation on the icon 327 ) acting on the icon 327 of "exercise and health", and in response to the operation, the user interface 32 exemplarily shown in FIG. 3C may be displayed. The electronic device 100 may detect a user operation on the control 354 in the user interface 32 (such as a click operation on the control 354 ), and in response to the operation, the electronic device 100 may display the user interface 33 shown in FIG. 3D . The user interface 33 is the main interface for introducing the exercise course. The electronic device 100 may detect a user operation on the control 360 in the user interface 33 (such as a click operation on the control 360 ), and in response to the operation, the electronic device 100 may display the user interface 34 . The electronic device may detect a user operation on the control 362 in the user interface 34 (such as a click operation on the control 362 ), and trigger the operation of acquiring identity assessment information.

In a possible implementation manner, the user interface may be the user interface shown in FIG. 3B-FIG. 3E. The electronic device 100 may detect a user operation on the control 358 in the user interface 33 (such as a click operation on the control 358 ), and in response to the operation, the electronic device 100 triggers and activates a simulated motion detection function to obtain identity assessment information.

In a possible implementation manner, the user interface may be the user interface shown in FIG. 3B and FIG. 3C . The electronic device may detect a user operation 200 (such as a click operation on the icon 327 ) acting on the icon 327 of "exercise and health", and in response to the operation, the user interface 32 exemplarily shown in FIG. 3C may be displayed. The electronic device 100 may detect a user operation on the control 358 in the user interface 32 (such as a click operation on the control 358 ), and in response to the operation, the electronic device 100 triggers the activation of a simulated motion detection function to obtain identity assessment information.

In another possible implementation manner, the user interface may be the user interface shown in FIG. 3G and FIG. 3H . As shown in FIG. 3G, the electronic device can detect a user operation 205 (such as a click operation on the icon 341) acting on the icon 341 of the "camera", and in response to the operation, the user interface shown in FIG. 3H can be displayed exemplarily. 35. The electronic device 100 can detect a user operation acting on the motion detection option in the user interface 35 (such as a click operation on the shooting mode list 365), and in response to the operation, the electronic device 100 can trigger the motion detection function to obtain identity assessment information .

S102: The electronic device acquires identity assessment information of the user, where the identity assessment information includes physical parameter assessment information.

Physical parameter assessment information may include weight and height.

Identity assessment information may also include physical status assessment information. The physical state evaluation information may include the user's injury site and injury degree.

The identity evaluation information may also include an exercise ability index, which refers to the exercise intensity that the user can bear.

In some embodiments, the electronic device may detect or receive the identity assessment information input by the user through a detection device such as a camera. For example, the electronic device can turn on the camera, detect the user's image, and obtain the user's height, weight, injury site and injury degree through the detected user image; the electronic device can detect the user's weight by jumping to the installed weight measurement application. The user's weight; by processing the obtained user's height data and weight data, the user's BMI can be obtained. For another example, the electronic device may obtain information such as height, weight or BMI value, injury site and injury degree input by the user. The electronic device can use the obtained height and weight to calculate the BMI value by weight ÷ height ² .

In one implementation, the electronic device may obtain the user's identity evaluation information through a detection device such as a camera. For example, the electronic device can turn on the camera, detect the user's image, and obtain the user's height through the detected user image; the electronic device can connect to the body fat scale through Bluetooth, and obtain the user's weight and BMI value; The user places a certain part of the body on the damaged part and the time it was placed to obtain the user's physical state assessment information. For example, the electronic device can obtain the user's physical state assessment information by turning on the camera to detect the user's hand placed on the damaged part and the time it was placed. Specifically, it can be shown in FIG. 4E-FIG. 4H, FIG. 4J-FIG. 4M, which will not be repeated here.

In another implementation, the electronic device receives identity assessment information input by a user. For example, the electronic device may receive the user's input of height, weight, BMI value, injury site and injury degree. As shown in FIGS. 4E and 4I , the electronic device 100 may detect a user operation on the control 408 (such as a click operation on the control 408 ), and in response to the operation, the electronic device 100 may display the user interface 48 . The user interface 48 may include an input box 416, which may be used to receive user-entered information on height, weight, and body fat percentage. The electronic device 100 may detect a user operation on the input box 416 (such as an input operation on the input box 416), and in response to the operation, may display a user interface for body state assessment as shown in FIG. 4J . The electronic device 100 may detect a user operation on the control 419 in the user interface 49 (such as a click operation on the control 419 ), and in response to the operation, the electronic device 100 may display the user interface 53 . The user interface 53 may include

input boxes

424 , 425 . The input box 424 can be used to receive the name of the injury site input by the user. The input box 425 can be used to receive the damage degree of the damaged part of the user, and the damage degree can be divided into 1-5 grades, and the larger the number, the more serious the damage degree. Gears 1-5 correspond to the corresponding damage degree boxes, which can be displayed as blue, green, yellow, orange, and red respectively. The electronic device 100 can detect a user operation acting on the 1-5 damage degree box on the input box 425 (for example, a click operation on any one of the 1-5 grades on the input box 425), and the corresponding damage degree box displays a corresponding color. The electronic device 100 may display the user interface 52 after detecting that the user operation on the user interface 53 is completed. The user interface 52 may include a prompt box 423 . The prompt box 423 can be used to display the percentage of the force on the damaged part of the user as the standard force.

In some other embodiments, the electronic device may acquire the identity feature of the user, and acquire the identity evaluation information based on the identity feature. Identity features can be face information, fingerprint information, etc. For example, after receiving the user's operation, the electronic device can turn on the camera, obtain the face image, and obtain the face information after processing; match the processed face information with the face information template stored in the electronic device, and call the body assessment information; for example:

In one implementation, the electronic device obtains the identity feature of the user, and when the identity feature stored in the electronic device does not include the identity feature, it can detect or receive the identity evaluation information input by the user through a detection device such as a camera. For example, an electronic device may obtain a face image through a camera, and obtain face information after processing. Match the processed face information with the stored face information template, and if the electronic device detects that the matching fails, the electronic device can detect or receive identity evaluation information input by the user through a detection device such as a camera.

In another implementation, the electronic device obtains the user's identity feature, and includes the identity feature in the existing identity feature of the electronic device. The electronic device detects that the user's last login time exceeds a preset time period, and the electronic device can and other detection devices to detect or receive identity assessment information input by users. For example, an electronic device may obtain a face image through a camera, and obtain face information after processing. Match the processed face information with the stored face information template, the electronic device detects the matched face information template, the electronic device detects that the user's last login time exceeds the preset time period, and the electronic device can pass through the camera, etc. The detection device detects or receives user-entered identity assessment information.

Exemplarily, the user interface may be the user interface shown in FIGS. 4A-4D . After the electronic device 100 collects the face information through the camera, it can perform some necessary processing, and match the processed face information with the stored face information template, so as to retrieve the user's physical assessment based on the face information template. information. The face information template may be input by the user before the electronic device 100 performs face recognition. The embodiment of the present application does not limit the devices and specific algorithms for face recognition, as long as the face recognition can be realized.

If the collected face information is successfully matched with the stored face information template, the electronic device 100 can detect the user's last login time, and if the user's last login time exceeds the preset time period, the electronic device can display the user interface 43 . User interface 43 may include prompt 404 , control 405 , control 406 . Prompt 404 is used to prompt the user for a user whose login time exceeds a preset time period, suggesting that the user re-perform body measurement assessment. Control 405 is used to listen for user operations that trigger re-measurement evaluation. The electronic device may detect a user operation acting on the control 405 (such as a click operation on the control 405), and in response to the operation, the electronic device may display the body measurement evaluation function provided by the body measurement evaluation function as exemplarily shown in FIGS. 4E-4I. User Interface. Control 406 can be used to monitor user operations that trigger the use of original data. The original data indicates the user's physical assessment information stored in the electronic device 100 before that.

In a specific implementation, the electronic device can distribute the body mass of each part of the user by acquiring the user's body parameter evaluation information, and can also calculate the exercise capacity index according to the body parameter evaluation information and the user's exercise amount within a preset time period, and use BMI and The exercise capacity index can correspond to the calculation of the user's load-bearing reference value. Electronic equipment can set the limit of the standard body's ability to bear the joints of the human body as the standard force. Users of different body types have different limits to the bearing capacity of their joints. In an implementation, the force reference value may be equal to the standard force multiplied by the parameter. Its specific implementation may include: the electronic device can divide the obtained BMI value into multiple BMI value intervals, and set different percentages of standard force corresponding to the multiple BMI value intervals as the BMI force of different BMI value intervals. The percentage is initial benchmark ratio. The electronic device can set a standard amount of exercise according to the user's BMI, and then dynamically adjust the standard amount of exercise according to the percentage of the maximum amount of exercise in the user's daily exercise amount. When the user's daily exercise volume increases from 0 to the standard exercise volume, the initial baseline ratio is dynamically reduced by 10%. For example, the BMI value can be divided into n BMI value intervals, and the BMI force of the n BMI value intervals can be: 100% × standard force, 90% × standard force, 80% × standard force.... (10－(n－1))×standard force.

In some embodiments, the electronic device can divide the obtained BMI value into five intervals of <24, 24-27, 27-30, 30-35, and >35, and the corresponding BMI force can be: 100%×standard Force, 90%×standard force, 80%×standard force, 70%×standard force, 60%×standard force, the BMI force is the bearing reference value.

Further, in a specific implementation, the electronic device can also obtain the user's physical state evaluation information to know whether there is a damaged part of the user's body and the degree of damage of the damaged part, so as to calculate and reduce the force evaluation of the damaged part, and combine the user's BMI The force and the standard amount of exercise can be used to calculate the reference value of the force of the injured part. The electronic device can divide the damage degree of the user's damaged part into multiple degrees, evaluate the relationship between the force of the damaged part and the standard force according to the different degrees of damage, and then correspond to the standard force after multiple BMI intervals and damage weighting. Calculate BMI force.

In some embodiments, the user's placement time at the damaged part can be set to be less than 2s, 2-4s, 4-6s, 6-8s, >8s, and the placement time of the damaged part is related to the force evaluation of the damaged part one by one. Correspondingly, according to the placement time from short to long, the force evaluation of the damaged part is 90%, 80%, 70%, 60% and 50% of the standard force respectively. For example, if the electronic device detects that the user's hand is placed on the knee joint for 4-6 seconds, the force evaluation of the damaged part corresponds to 70% of the standard force. Then the BMI force is calculated correspondingly according to multiple BMI intervals and the force evaluation of the damaged part.

It can be understood that step S102 may also be performed after step S103 or S104.

S103: The electronic device detects the positions of the skeletal nodes of the target object, so as to obtain the spatial positional relationship of the skeletal nodes.

The above-mentioned target object can be a user, and can also be a moving image in a selected exercise course, such as an image of a standard demonstration action in an exercise course.

The electronic device can analyze the user's bone points, such as ankle joint points, knee joint points, hip joint points, etc., through the bone point recognition technology for the user or in the video, such as images of standard demonstration actions in sports courses.

The electronic device can detect the user's skeletal nodes through cameras, sensors, etc., and the positions of the above-mentioned skeletal nodes are used to indicate the user's joints and the connection relationship between each joint and the spatial position relationship of the skeletal nodes.

Further, the electronic device can combine the depth camera module or analyze the user's body proportions, fat and thin, etc. according to the above-mentioned body parameter evaluation information.

Exemplarily, the electronic device may detect the user's bone nodes through sensors such as cameras, infrared sensors, optical markers, and 3D scanners. Electronic devices can also build bone models through deep learning networks such as skinned multi-person linear (SMPL) and visual background extractor (VIBE). For example, when building a human skeleton model through the SMPL model, the height, weight, etc. in the user's physical parameter evaluation information collected above can be used to construct it in conjunction with the national standard GB-T17245-2004.

Specifically, the electronic device can detect the user's bone node by using the acquired user image and the human body bone point positioning algorithm, where the bone node refers to the coordinates of the determined bone point. Further, the body shape of the user may be determined in combination with the coordinates of the skeletal nodes and the above body parameter evaluation information. Wherein, the input of the human skeleton point positioning algorithm may be the user's image, and the output may be the coordinates of the skeleton nodes. The electronic device can detect basic human skeleton nodes as shown in FIG. 11 , such as left hip joint, right hip joint, left knee joint, right knee joint, and the like. It can be understood that, not limited to the skeleton nodes shown in FIG. 11 , the electronic device can detect more or less skeleton nodes.

In some embodiments, the electronic device can turn on the camera, acquire user images, and identify skeletal nodes by analyzing the user images, and the acquired skeletal node graph can be shown in FIG. 11 .

In one implementation, the electronic device turns on the camera to acquire the image, if the electronic device fails to detect the skeletal node from the image, it indicates that the electronic device fails to detect the user, and the electronic device can output a prompt message that the user cannot be detected , which can be the text "No user detected".

In another implementation, as shown in FIG. 5A , the electronic device turns on the camera, acquires an image, and identifies the user's bone nodes based on the image.

In a specific implementation, the electronic device may detect the skeletal nodes of the user, and during the detection process, if the electronic device detects that the posture of the user is abnormal, it may output a relevant abnormal prompt. Abnormal posture means that the user does not maintain an upright state when performing bone node detection before the user is in motion. Upright refers to the natural standing state in which the upper limbs naturally hang down, the toes are forward, and the eyes are forward. The abnormal posture of the lower limbs can be that the legs are bent and the feet are off the ground. If the user does not maintain an upright state, the skeletal node graph detected by the electronic device may be inaccurate, resulting in errors in subsequent force detection. As shown in FIGS. 5B-5C , when the electronic device 100 detects that the posture of the user's lower limbs is abnormal, it outputs a prompt 504 of abnormal posture, prompting the user to adjust the posture, maintain an upright state, and continue to detect bone nodes. It can be understood that the reminder of the abnormal posture can be a text display on the screen of the electronic device, or a voice reminder, etc.

S104: The electronic device performs space attitude calibration, and constructs a reference coordinate system.

Spatial posture calibration refers to setting a reference coordinate system for the movement of the target object according to the above-mentioned skeletal nodes when the target object is in an upright state, so as to calibrate the motion state of the target object. For example, taking the detection of the user as an example, the ground and the user's upright direction can be used to construct a reference system, then the user's jumping action presents a motion state of both feet away from the ground and upward jumping relative to this coordinate system. Without spatial attitude calibration, the user's motion state cannot be specifically determined.

In a specific embodiment, the reference coordinate system can be based on the user's waist or feet, the midpoint of the line connecting the two feet, etc. As the coordinate axis, establish a space coordinate system. The reference coordinate system is the coordinate system relative to which the user moves in subsequent movements.

In order to facilitate physical space posture calibration, for example, as shown in Figure 12, the midpoint of the line connecting the user's feet is the origin, the direction of the line connecting the two feet is the u-axis, and the vertical distance between the head and neck is the v-axis. The distance is the vertical direction as the w-axis, and the vertical direction of the uv plane as the w-axis to establish a reference coordinate system uvw.

It can be understood that after the reference coordinate system is established, the coordinates of the bone nodes detected through the aforementioned bone nodes can be obtained through the reference coordinate system.

Optionally, when the electronic device performs space attitude calibration, it may display a calibration countdown on the user interface. For example, the electronic device may display a user interface 60 as shown in FIG. 6 , and the user interface 60 is used to display

countdowns

3 , 2 , and 1 of space attitude calibration. It can be understood that the calibration countdown can be a text display on the screen of the electronic device, or a voice reminder, etc.

S105: The electronic device acquires a ground lift reference value setting, and the ground lift reference value is used to determine the user's ground lift state.

The ground lift reference value refers to the minimum distance when the user's feet are detected to be in the ground lift state relative to the state of both feet touching the ground, and the left and right ankle joints are relative to the above-mentioned reference coordinate system.

In some embodiments, the electronic device can obtain the ground lift reference value by setting itself, so as to judge the user's ground lift state.

In some embodiments, the electronic device can obtain the ground lift reference value by setting itself or receiving user input, so as to judge the user's ground lift/bottomed state.

In an implementation manner, the electronic device can set the user's ground clearance reference value by itself. As shown in FIG. 7, the electronic device 100 can detect a user operation acting on the control 702 (such as a click operation on the control 702), and in response to this operation, the electronic device 100 can set the user's ground lift/bottom reference by itself. value.

In another implementation manner, the electronic device may detect the ground clearance reference value input by the user. As shown in FIG. 7, the electronic device 100 can detect a user operation acting on the input box 703 (such as an input operation on the input box 703), and in response to the operation, the electronic device 100 can receive the reference value of the ground clearance set by the user. .

In some other embodiments, the electronic device may also set the user's ground clearance reference value according to the user's physical parameter evaluation information. The electronic device can dynamically adjust the user's ground clearance reference value according to the level of the BMI value obtained from the body parameter evaluation information. For example, the user's BMI value is divided into multiple BMI intervals. When the BMI value is in the normal interval, the user's ground clearance reference value can be set to xcm. The BMI interval with a larger BMI value has a lower ground clearance reference value.

Exemplarily, the reference coordinate system is the above-mentioned reference coordinate system uvw, and the electronic device can receive the user's reference value of 15cm from the ground, which means that when the distance between the user's ankle joint and the uv plane of the reference coordinate system is greater than or equal to 15cm, The electronic device can detect that the user's feet are off the ground, and the user may be doing jumping exercises.

S106: The electronic device acquires the force condition of the target object based on the bone node.

The above-mentioned target object may be a user, or a moving image in a video, such as an image of a standard demonstration action in an exercise course.

The electronic device can obtain the force value of the user for the user, and analyze the force of the user during the exercise. The electronic device can also analyze the stress situation in the image based on the moving image in the video, such as the image of the standard demonstration action in the exercise course, combined with the user's body parameter evaluation information and/or body state evaluation information.

The specific steps to obtain the force of the target object are shown in Figure 13.

S201: Obtain the first data of the target object according to the body parameters of the target object; the first data includes the mass, center of mass, and moment of inertia of the human body links.

The inertial parameters of the human body include the mass of the human body, the position of the center of mass and its moment of inertia, which are the basic parameters for the research on human motion and sports injury and prevention. Human body links include: thighs, calves, feet, upper arms, forearms, etc. For example, the mass, center of mass, and moment of inertia of human body links, such as the mass, center of mass, and moment of inertia of thighs, calves, and feet.

It is understandable that according to the body parameter information of the target object, such as height and weight, the mass of the thigh, calf, and foot, the position of the center of mass, and the moment of inertia can be obtained. These data can be combined with the national standard of adult human body inertia parameters through the body parameter information (GB-T17245-2004) obtained. For example, through the regression equation Y=B ₀ +B ₁ X ₁ +B ₂ X ₂ of man’s thigh (wherein B ₀ is the constant term of the regression equation, B ₁ is the regression coefficient of weight, B ₂ is the regression coefficient of height) Calculate the mass or center-of-mass position of the man's thigh.

After obtaining the center of mass of the human body link in the inertial parameters of the human body, the coordinates of the center of mass of the human body link can be obtained through the above reference coordinate system.

It can be understood that the first data obtained in S201 may also be obtained in step S102.

S202: Obtain second data of the target object and the ground-off state of the foot; the second data includes movement speed, angular velocity, and position information of human joints.

The motion velocity and angular velocity of the center of mass of the above-mentioned human body links can refer to the motion speed and angular velocity of human body links such as thighs and calves, and the position information of human body joints can be obtained by detecting the coordinate values of human body joints in the above-mentioned reference coordinate system.

The foot-off state may include a first state, a second state, and a third state. The first state indicates the state of both feet in the air, the second state indicates the state of one foot touching the ground, and the third state indicates the state of both feet touching the ground. Specifically, the ground lift state can be judged according to whether the distance between the target object's feet relative to the reference plane (such as the uv plane in the above reference coordinate system) exceeds the ground lift reference value, which can be referred to the description in step S105.

S203: Calculate a first numerical value and a second numerical value of the ankle joint based on the ground-off state.

The first numerical value and the second numerical value of the ankle joint can be calculated by judging the ground-off state of the foot. The first value is the joint force of the ankle joint, and the second value is the moment of the ankle joint. It can be understood that the human body has left and right feet, that is, left and right ankle joints, the first value may include the joint forces of the left and right ankle joints, and the second value may include the moments of the left and right ankle joints. In the force calculation of the left/right knee joint, hip joint, etc., the joint force or moment of the left/right ankle joint is correspondingly used.

Understandably, the first numerical value and the second numerical value of the ankle joint can be calculated according to the three states of the foot.

When the ground-off state is the first state, both feet are in the air, and the first value and the second value of the left and right ankle joints are both 0.

When the off-the-ground state is the second state, one foot touches the ground, the force on one of the left and right ankle joints is 0, and it is only necessary to calculate the force on the other ankle joint. The joint force of the other ankle joint can be calculated by summing the product of the mass of the human body link and the velocity of the human body link, and subtracting the vector from the mass center of the human body link to the reference point and the human body The difference between the products of the link weights is summed to calculate the moment at the other ankle joint. The reference point can be the origin in the above reference coordinate system, and the vector from the centroid of the human body link to the reference point can be obtained by calculating the coordinates of the centroid of the human body link in the above reference coordinate system and the coordinates of the reference point.

Specifically, the force of another ankle joint can be calculated by the following formula, where F ₁ , M ₁ or F ₂ , M ₂ are 0, and the values of F ₂ , M ₂ or F ₁ , M ₁ can be calculated,

F ₁ +F ₂ =Σm _i Δv _ci +G

M ₁ +M ₂ ＝Σ(J _i Δω _i -r _i ×m _i g)

Among them: F ₁ and F ₂ are the first numerical value of the ankle joint, M ₁ and M ₂ are the second numerical value of the ankle joint, m _i is the mass of the human body link, v _ci is the movement speed of the mass center of the human body link, and G is the The weight of the user calculated by the parameters, J _i is the moment of inertia of the human body link, ω _i is the angular velocity of the center of mass of the human body link, _ri is the vector from the center of mass of the human body link to the reference point, and g is the acceleration of gravity. The following will not repeat them.

Take the left foot touching the ground as an example, the force/moment of the right foot is 0, let the force/moment of the left foot be F _left , M _left respectively, and the force/moment of the right foot be F _right , M _right , according to the momentum theorem, momentum moment Theorem can be calculated:

F _left +F _right ＝Σm _foot Δv _cfoot +G

M _left +M _right ＝Σ(J _foot Δω _foot -r _foot ×m _foot g)

Since F _right and M _right are 0, so F _left and M _left are:

F _left ＝Σm _i Δv _ci +G

M _ieft ＝Σ(J _i Δω _i -r _i ×m _i g)

When the ground-off state is the third state, the feet touch the ground, and the first value and the second value of the ankle joint can be calculated according to the first data and the second data; the first data is the mass, center of mass, and rotation of the human body link Inertia, the second data is the position information of human joints, the second coordinate is the projection coordinate of the center of gravity of the target object, the third and fourth coordinates are ankle joint coordinates, the second coordinate, the third coordinate, and the fourth coordinate are based on the second Data learned. Specifically, the sum of the joint forces of the left and right ankle joints can be calculated by summing the product of the mass of the human body link and the velocity of the human body link, and subtracting the mass center of the human body link from the product value of the mass of the human body link and the angular velocity of the human body link to the reference The difference summation of the product of the vector of the point and the weight of the human body links is used to calculate the torque sum of the left and right ankle joints. The reference point can be the origin in the above reference coordinate system, and the vector from the centroid of the human body link to the reference point can be obtained by calculating the coordinates of the centroid of the human body link in the above reference coordinate system and the coordinates of the reference point. Then calculate the joint forces of the left and right ankle joints and the left and right ankle joints through the projected coordinates of the center of gravity, the coordinates of the left and right ankle joints, the sum of the joint forces of the left and right ankle joints, and the sum of the moments of the left and right ankle joints moment. The projected coordinates of the center of gravity can be determined according to the vertical mapping between the center of gravity and the reference plane (such as the uv plane mentioned above) of the above reference coordinate system. The third coordinate and the fourth coordinate are the coordinates of the left and right ankle joints in the above reference coordinate system, which can be obtained according to the above reference coordinate system, as shown in FIG. 14 . Let P _proj be the projected coordinates of the center of gravity, P ₁ be the coordinates of the left ankle joint, and P ₂ be the coordinates of the right ankle joint.

In this state, the first value and the second value can be calculated by the following formula:

F ₁ +F ₂ =Σm _i Δv _ci +G

M ₁ +M ₂ ＝Σ(J _i Δω _i -r _i ×m _i g)

S204: Based on the motion posture of the target object, construct a first coordinate system, the first coordinate system is used to construct a homogeneous transformation matrix and obtain first coordinates of human joints in the first coordinate system.

Wherein, the first coordinate system may include: a reference sub-coordinate system, a first sub-coordinate system, and a second sub-coordinate system; the homogeneous transformation matrix is based on the relationship between the reference sub-coordinate system, the first sub-coordinate system, and the second sub-coordinate system Relationship construction: the relationship between the reference sub-coordinate system, the first sub-coordinate system, and the second sub-coordinate system includes the distance and angle between the coordinate axes; the first coordinate is the coordinate of the human body joint in the reference sub-coordinate system. It is understandable that the lower limb coordinate system can be established according to the bone node position of the target object, and the coordinate system can be established at the hip joint, knee joint, and ankle joint. The reference sub-coordinate system is the coordinate system established based on a certain bone node, and the second and third coordinate systems are the coordinate systems established based on the other two bone nodes.

Among them, the reference coordinate system can be established at the spherical center of the spherical ankle of the hip joint. The hip joint contains three rotational degrees of freedom, the knee joint contains one rotational degree of freedom, and the ankle joint contains two rotational degrees of freedom. The electronic device can also establish an artificial coordinate system on the foot to describe the orientation of the foot.

For example, the lower limb coordinate system as shown in Figure 15 can be established. The establishment process is as follows: Assume that the reference coordinate system is established with the hip joint, assuming that the first rotation is around the Z ₀ axis, X ₀ Y ₀ Z ₀ is the reference coordinate system, X ₀ faces the front of the foot, and Z ₀ faces the side of the human body. The Y ₀ orientation determined by the right-hand rule. Assuming that the hip joint lifts the leg around Z ₁ for the second time, the direction of X ₁ is determined according to the right-hand rule, and Z ₀ is transformed into Z ₁ . Assuming that the hip joint rotates the leg around Z ₂ for the third time, the direction of X ₂ is determined according to the right-hand rule, and Z ₁ is transformed into Z ₂ . Therefore, the above three times complete the rotation of the hip joint. Suppose the fourth rotation is around the knee joint, the axis of rotation is Z ₃ , the direction of X ₃ is determined according to the right-hand rule, Z ₂ is transformed into Z ₃ , and so on to establish the lower limb coordinate system as shown in Figure 15. Where a is the z-axis distance of the adjacent sub-coordinate system, d is the x-axis distance of the adjacent sub-coordinate system, α is the z-axis angle between the adjacent sub-coordinate systems, and θ is the initial angle between the X-axis + the joint rotation angle to be calculated , the initial state scale shown in Figure 16 can be obtained. As an example, X ₀ and X ₁ intersect, so d is 0; Z ₀ and Z ₁ intersect, so a is 0; the angle between Z ₀ and Z ₁ is 90, so α is 90.

It can be understood that the establishment of the reference coordinate system is not limited.

S205: Based on the homogeneous transformation matrix, calculate the angular velocity of the calf according to the first coordinates and the first data.

According to the above lower limb coordinate system, the distance and included angle between coordinate axes of adjacent joint coordinate systems can be obtained. For example, the distance between the x and z axes of adjacent coordinate systems and the included angle between the z axes of adjacent coordinate systems can be obtained according to the lower limb coordinate system shown in FIG. 15 . The homogeneous transformation matrix can be constructed through the distance and angle between the coordinate axes of the adjacent joint coordinate systems. The homogeneous transformation matrix is as follows:

(1≤i≤6, i is a positive integer)

Among them, p is the coordinate value of the ankle joint, knee joint and hip joint in the above reference coordinate system, a is the z-axis distance of the adjacent sub-coordinate system, d is the x-axis distance of the adjacent sub-coordinate system, and α is the adjacent sub-coordinate is the included angle of the z-axis, and θ is the initial included angle between the x-axes + the joint rotation angle to be calculated. For example, according to the lower extremity coordinate system shown in Figure 15, a is the z-axis distance of adjacent sub-coordinate systems, d is the x-axis distance of adjacent sub-coordinate systems, α is the z-axis angle between adjacent sub-coordinate systems, and its initial state quantity It can be shown in Figure 16.

Construct the following matrix according to the coordinates of the human body joints in the above-mentioned reference coordinate system (such as the hip joint coordinate system):

Among them, m is the coefficient obtained by multiplying the A matrix, that is, the coefficient of the trigonometric function multiplication, p is the first coordinate, a is the z-axis distance of the adjacent coordinate system, d is the x-axis distance of the adjacent coordinate system, and α is the phase The included angle between the z axes of the adjacent coordinate system, θ is the initial included angle + the rotation angle of the human joint.

By corresponding the data in the T matrix to the homogeneous transformation matrix, the value of the rotation angle θ can be solved, and the angular velocity of this link can be calculated by derivation. Exemplarily, the angular velocity of the link can be derived from the rotation angle of the joint through a first-order differential.

By bringing the data in the T matrix corresponding to the homogeneous transformation matrix into the above data of the detected knee joint, the angular velocity of the lower leg can be calculated.

Further, the angular velocity of the thigh can also be calculated by bringing the above-mentioned detected data of the hip joint into the T matrix and the homogeneous transformation matrix.

S206: Calculate a third value and a fourth value of the knee joint based on the first data, the second data, the first value and the second value of the ankle joint, and the angular velocity of the knee joint.

Based on the mass, center of mass and moment of inertia of the calf obtained above, the velocity of the center of mass of the calf, the position information of the knee joint and ankle joint, the joint force and moment of the ankle joint, and the angular velocity of the calf calculated above, the third angle of the knee joint can be calculated. value and the fourth value. Wherein, the third numerical value refers to the joint force of the knee joint, and the fourth data refers to the torque of the knee joint. The third and fourth values of the knee joint can be calculated by the following formulas:

is the velocity of the center of mass of the calf in the second data, r _shank is the vector from the center of mass of the calf to the reference point, r _foot is the vector from the center of mass of the foot to the reference point, J _shank is the moment of inertia of the calf,

is the angular velocity of the leg.

It is understandable that after calculating the third value and the fourth value of the knee joint, the mass of the thigh, the center of mass, the moment of inertia, the speed of motion, the position information of the knee joint and the hip joint, the joint force and moment of the knee joint and the above-mentioned The calculated angular velocity of the thigh can be used to calculate the fifth value and the sixth value of the hip joint. Wherein, the fifth numerical value refers to the joint force of the hip joint, and the sixth data refers to the torque of the hip joint. The fifth and sixth values of the hip joint can be calculated by the following formula:

Among them, F ₅ is the fifth value, M ₆ is the sixth value, m _thigh is the mass of the thigh,

is the velocity of the center of mass of the thigh, r _thigh is the vector from the center of mass of the thigh to the reference point, _rshank is the vector from the center of mass of the calf to the reference point, J _thigh is the moment of inertia of the thigh in the first data,

is the angular velocity of the thigh.

It can be understood that when the electronic device detects the motion of the user, it may display the detected motion image of the user on the screen. Furthermore, the electronic device can also display the user's joint force on the displayed motion image, such as the position of the joint force and the magnitude of the joint force.

In a possible implementation manner, the electronic device may display the moving image of the user. For example, the electronic device can display the user's moving image while displaying the action demonstration in the exercise course, or the electronic device can only display the user's moving image. As shown in FIG. 8A , the electronic device displays a user interface 80 , and the user interface 80 may display an image 802 of an exercise course demonstration action and a detected motion image 801 of the user.

In another possible implementation manner, when the user's moving image is displayed, the value of the joint force or moment obtained through the above calculation may also be superimposed and displayed on the corresponding part of the user in the moving image through a color code. Specifically, as shown in FIG. 8B , a circle may be superimposed on the corresponding force-bearing part of the user, and the numerical value of the joint force/moment of the part is displayed beside the circle. It is also possible to superimpose a colored circle on the user's corresponding force-bearing part. The color can include yellow, green and red. The corresponding force value is small and yellow can be displayed; the force value gradually increases, changing from yellow to green and then to red. It can be understood that the shape and color of the superimposed color scale are not limited thereto. It can be understood that the user image shown in FIG. 8B can be marked to mark the force-bearing part for a clearer illustration. The user image in FIG. The actual moving image of , and mark it on the moving image.

In a possible implementation, when the electronic device simulates and detects the exercise course, it may display images of standard demonstration actions in the exercise course, as shown in FIG. 8C .

Optionally, the electronic device can detect the ground projection of the center of gravity in real time before or during the force detection, so as to determine whether the user's center of gravity deviates from the stable range. If the user's center of gravity deviates from the stable range, the user may experience unstable posture or fall, and the electronic device can prompt the user to adjust the body's center of gravity. The prompt can be prompted through text on the user interface, or when it is detected that the user deviates from the stable range during exercise, the user can be prompted to adjust the center of gravity by voice.

S107: The electronic device judges the occurrence of a movement risk based on the stress on each joint when the target object moves, and outputs risk prompt information.

In a specific embodiment, when the electronic device detects the force of the target object, it can obtain the corresponding joint force data of each joint when the target object moves, such as the first value and the second value of the ankle joint, the first value and the second value of the knee joint. At least one of the three numerical values and the fourth numerical value and the fifth numerical value and the sixth numerical value of the hip joint are compared with the reference data, and when the numerical comparison result exceeds a preset threshold, the electronic device can display risk warning information.

It can be understood that the preset threshold can be set according to actual needs, which is not limited in the present application.

The stress situation of the joint may be a numerical value of the joint force. The above-mentioned reference data of joint force may be the stress threshold of human joints (it may be the above-mentioned BMI force), or it may be the above-mentioned force-bearing reference value. The joint force threshold can be evaluated by counting the maximum joint force of a certain number of users in the experiment. The electronic device can determine the risk of sports injury by calculating whether the ratio of the joint force to the human joint force threshold or the force reference value is the ratio to a preset threshold (such as a value of 1).

It is understandable that the electronic device can also judge the occurrence of movement risk based on the joint torque, and output a risk prompt. The electronic device can calculate the cumulative work through the joint torque of the target object, and judge the risk of sports injury by comparing the cumulative work with the cumulative work threshold, and if the ratio of the cumulative work to the cumulative work threshold is the ratio of the preset threshold (such as 1).

In some embodiments, the electronic device may display the first prompt. As shown in FIG. 9A , the electronic device 100 may display a user interface 90 based on the above force detection. The user interface 90 may display a prompt 901, and the electronic device 100 detects a user operation acting on the control 903 (such as a click operation on the control 903), and in response to the operation, the electronic device 100 may display the The user interface for force testing.

In some embodiments, after the electronic device displays the first prompt, it may display the second prompt. For example, based on the above-mentioned force detection, the electronic device obtains the corresponding joint force value of each part when the user is exercising, and compares the value with the corresponding joint force threshold. If the joint force value is less than the joint force threshold, the electronic device repeats. Force detection; if the joint force value is greater than or equal to the joint force threshold, the electronic device outputs a first prompt. For example, as shown in FIG. 9A and FIG. 9C , when the electronic device 100 detects that the value of the joint force is greater than the joint force threshold, it can display the user interface 90, and the user interface 90 can display a prompt box 901 to prompt the user that the current motion action has a higher value. Injury risk can also show the reason why the user is at risk of injury, for example, the user's left leg is under too much force. After the electronic device displays the prompt box 901 beyond the preset time period, it may display the user interface 92, and the user interface 92 may display the prompt box 907 to guide the user to adjust the exercise posture. The electronic device 100 may detect that the user chooses to return to the original exercise course or detect that the display time of the user interface 92 exceeds a preset time period, and may display the force detection user interface as shown in FIG. 8A or FIG. 8B .

In some other embodiments, after the electronic device displays the first information, it may display the first option and the second option, and when a user operation on the first option is detected, in response to the operation, the electronic device may display the second prompt ; When the electronic device detects a user operation on the first option by the user, in response to the operation, the electronic device may display a third prompt.

Specifically, as shown in FIG. 9A , FIG. 9B , and FIG. 9C , based on the force detection, the electronic device 100 may display a user interface 90 to prompt that the current exercise action has a high risk. The electronic device 100 may display the user 91 when no user operation on the control 903 is detected within the preset time period, or when the display time of the user interface 90 exceeds the preset time period. The electronic device can detect a user operation on the control 905 (eg, a click operation on the control 905 ), and in response to the operation, the electronic device 100 can display the user interface 92 . The user interface 92 may include a prompt box 907, and the prompt box 907 may display an adjustment plan for an exercise action with a higher risk. The electronic device 100 may detect that the display time of the user interface 92 exceeds a preset time period, and may display the force detection user interface as shown in FIG. 8A or FIG. 8B .

In a specific embodiment, as shown in FIG. 9A , FIG. 9B , and FIG. 9D , based on the force detection, the electronic device 100 may display a user interface 90 to prompt that the current exercise action has a high risk. The electronic device 100 may display the user 91 when no user operation on the control 903 is detected within the preset time period, or when the display time of the user interface 90 exceeds the preset time period. The electronic device can detect a user operation on the control 906 (such as a click operation on the control 906 ), and in response to the operation, the electronic device 100 can display the user interface 93 . The electronic device 100 can detect a user operation (such as a click operation on the control 908) acting on the control 908 in the user interface 93, and in response to the operation, the electronic device 100 can display the force detection as shown in FIG. 8A or FIG. 8B The user interface or user interface 92. The electronic device 100 may also detect a user operation acting on the control 909 (such as a click operation on the control 909), and in response to the operation, the electronic device 100 may switch to the recommended exercise course selected by the user.

In the case of simulated detection of exercise courses, the electronic device can output a risk prompt when it detects that the exercise action has a certain risk of injury to the user; the electronic device can also output the exercise after the simulation detection of the exercise course Risk warning of the course. For example, as shown in FIG. 9A-FIG. 9D, the electronic device 100 can detect that the sports action in the exercise course has a higher risk of injury than the user, that is, output a risk reminder that the sports action has a higher risk. The specific steps are not as follows: Let me repeat. For another example, as shown in FIG. 9E , after the electronic device 100 completes the exercise course detection, it displays the user interface 94. The user interface 94 is used to prompt that the simulation test has been completed, and can also display the degree of injury risk of the exercise course, which has a relatively high risk of injury. High-risk sports activities, etc.

In some embodiments, based on the above force detection, the electronic device obtains the corresponding joint force value of each part when the target object moves, and can compare the value with the force reference value, if the ratio of the joint force value/joint force threshold is less than 0.6 , the movement is a low-risk movement, and the electronic device repeatedly performs force detection; if the ratio of the joint force value/joint force threshold is 0.6-0.9, the movement is a medium-risk movement, and the electronic device can continue to perform stress detection. At the same time, the electronic device can also output guidance information for adjusting the movement; if the ratio of joint force value/joint force threshold is greater than 0.9, the movement is a high-risk movement, and the electronic device can output risk warning information.

FIG. 17 shows the flow of another motion analysis method, which is to perform simulated detection of joint force/torque for a motion course. As shown in Figure 17, the method may include:

S301: The electronic device receives a user operation by a user on a first application, where the user operation is used to instruct the electronic device to obtain identity evaluation information of the user.

For the electronic device receiving the user's user operation on the first application and the electronic device acquiring the user's identity evaluation information, reference may be made to the above step S101.

S302: The electronic device acquires identity evaluation information of the user.

For S302, reference may be made to relevant descriptions in the above step S102.

S303: The electronic device detects the position of the bone nodes in the image of the standard demonstration action in the exercise course, so as to obtain the spatial position relationship of the bone nodes.

For S303, reference may be made to the relevant description of the above-mentioned step S103.

S304: The electronic device performs spatial attitude calibration on images of standard demonstration actions in the exercise course, and constructs a reference coordinate system.

For S304, reference may be made to the relevant description of the above-mentioned step S104.

S305: Based on the skeletal nodes, the electronic device performs force analysis in combination with images of standard demonstration actions in the exercise course to obtain force conditions.

In this step, the electronic device needs to set a ground-off reference value by itself, and the ground-lift reference value is used to determine whether the image of the standard demonstration action in the exercise course is in the ground-off state.

Status, you can refer to the relevant description in the above step S105.

It can be understood that the electronic device can obtain the corresponding height and weight information for the image of the standard demonstration action in the exercise course, and combine the height and weight information and the position of the bone nodes to obtain the mass between the bone nodes, the position of the center of mass, the moment of inertia, etc. For details, reference may be made to relevant descriptions in the above step S106.

S306: The electronic device judges the occurrence of exercise risk based on the stress of each joint in the image of the standard demonstration action in the exercise course, and outputs risk prompt information.

For S306, reference may be made to relevant descriptions in the above-mentioned step S107.

As mentioned above, the above embodiments are only used to illustrate the technical solutions of the present application, and are not intended to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still understand the foregoing The technical solutions described in each embodiment are modified, or some of the technical features are replaced equivalently; and these modifications or replacements do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the various embodiments of the application.

Claims

A motion analysis method, characterized in that, comprising:

Acquiring the first data of the target object according to the physical parameters of the target object; the first data includes the mass, center of mass, and moment of inertia of the human body link;

Obtaining the second data of the target object and the ground-off state of the feet; the second data includes the movement velocity, angular velocity and position information of the human body joints of the center of mass of the human body link;

calculating a first value and a second value of the ankle joint based on the ground lift state;

Constructing a first coordinate system based on the movement posture of the target object, the first coordinate system is used to construct a homogeneous transformation matrix and obtain the first coordinates of the human joints in the first coordinate system;

calculating the angular velocity of the calf according to the first coordinates and the first data based on the homogeneous transformation matrix;

calculating a third value and a fourth value of the knee joint based on the first data, the second data, the first value and the second value of the ankle joint, and the angular velocity of the lower leg.
The method according to claim 1, further comprising:

calculating the angular velocity of the thigh according to the first coordinates and the first data based on the homogeneous transformation matrix;

Calculate the hip joint based on the first data, the second data, the first value and the second value of the ankle joint, the third value and the fourth value of the knee joint and the angular velocity of the thigh fifth and sixth values.
The method according to claim 1 or 2, wherein calculating the first value and the second value of the ankle joint based on the off-the-ground state comprises:

When the ground-off state is the first state, both the first value and the second value of the ankle joint are 0;

When the ground-off state is a second state, calculate a first value and a second value of the ankle joint according to the first data and the second data;

When the ground-off state is the third state, calculate the first value and the second value of the ankle joint according to the first data and the second data; the second data is the human body joint The position information of the target object, the second coordinate is the projection coordinate of the center of gravity of the target object, the third coordinate and the fourth coordinate are the coordinates of the ankle joint, and the second coordinate, the third coordinate and the fourth coordinate are based on the second data get.
The method according to claim 3, wherein the calculating the first value and the second value of the ankle joint according to the first data and the second data comprises: calculating the first value by the following formula a value and a second value,

F 1 +F 2 =Σm i Δv ci +G

M 1 +M 2 ＝Σ(J i Δω i -r i ×m i g)

Wherein: F1, F2 are the first numerical value of described ankle joint, M1, M2 are the second numerical value of described ankle joint, m i is the quality of described human body link, v ci is the movement velocity of described human body link barycenter, G is the weight of the user calculated according to the body parameters, J i is the moment of inertia of the human body link, ω i is the angular velocity of the center of mass of the human body link, r i is the distance from the center of mass of the human body link to the reference point Vector, g is the acceleration due to gravity.
The method according to claim 3, characterized in that, the first value and the second value of the ankle joint are calculated according to the first data and the second data; the second data is the human body The position information of the joint, the second coordinate is the projection coordinate of the center of gravity of the target object, the third coordinate and the fourth coordinate are the coordinates of the ankle joint, and the second coordinate, the third coordinate and the fourth coordinate are based on the second The data acquisition includes: calculating the first value and the second value by the following formula,

F 1 +F 2 =Σm i Δv ci +G

M 1 +M 2 ＝Σ(J i Δω i -r i ×m i g)

Wherein: F1, F2 are the first numerical value of described ankle joint, M1, M2 are the second numerical value of described ankle joint, m i is the quality of described human body link, v ci is the movement velocity of described human body link barycenter, G is the weight of the user calculated according to the body parameters, J i is the moment of inertia of the human body link, ω i is the angular velocity of the center of mass of the human body link, r i is the vector from the center of mass of the human body link to the reference point , P proj is the second coordinate, P 1 is the third coordinate, and P 2 is the fourth coordinate.
The method according to any one of claims 1-5, wherein, based on the homogeneous transformation matrix, calculating the angular velocity of the calf according to the first coordinates and the first data includes: converting the first The coordinates correspond to the following formula to calculate the rotation angle of the human joint, and calculate the angular velocity of the lower leg based on the rotation angle of the human joint,

Wherein, m is a coefficient, p is the first coordinate, a, d, and α are known distances or angles in the first coordinate system, and θ is the initial included angle + the rotation angle of the human joint.
The method according to claim 6, wherein the knee joint is calculated based on the first data, the second data, the first value and the second value of the ankle joint, and the angular velocity of the lower leg. The third numerical value and the fourth numerical value of the joint, comprising: calculating the third numerical value and the fourth numerical value by the following formula,

Wherein, F3 is the third numerical value, M4 is the fourth numerical value, m shank is the calf mass in the first data,
is the velocity of the center of mass of the calf in the second data, r shank is the vector of the distance from the center of mass of the calf to the reference point based on the first data and the second data, r foot is based on the first data and the The vector of the center of mass of the foot obtained from the second data from the reference point, J shank is the moment of inertia of the calf in the first data,
is the angular velocity of the lower leg.
The method according to claim 7, wherein the calculating the angular velocity of the thigh according to the first coordinate and the first data based on the homogeneous transformation matrix comprises: corresponding the first coordinate to the following The formula calculates the rotation angle of the human body joint, and calculates the angular velocity of the thigh based on the rotation angle of the human body joint,

Wherein, m is a coefficient, p is the first coordinate, a, d, and α are known distances or angles in the first coordinate system, and θ is the initial included angle + the rotation angle of the human joint.
The method according to claim 8, characterized in that, based on the first data, the second data, the first value and the second value of the ankle joint, the third value of the knee joint and The fourth numerical value and the angular velocity of the thigh are used to calculate the fifth numerical value and the sixth numerical value of the hip joint, including: calculating the fifth numerical value and the sixth numerical value by the following formula,

Wherein, F5 is the fifth numerical value, M6 is the sixth numerical value, m thigh is the thigh mass in the first data,
is the velocity of the center of mass of the thigh in the second data, r thigh is the vector of the center of mass of the thigh from the reference point based on the first data and the second data, and r shank is the vector based on the first data and the second data The second data obtains the vector of the calf center of mass distance from the reference point, and J thigh is the moment of inertia of the thigh in the first data,
is the angular velocity of the thigh.
The method according to any one of claims 1-9, wherein the first coordinate system comprises: a reference sub-coordinate system, a first sub-coordinate system, and a second sub-coordinate system;

The homogeneous transformation matrix is constructed based on the relationship between the reference sub-coordinate system, the first sub-coordinate system and the second sub-coordinate system; the relationship between the reference sub-coordinate system, the first sub-coordinate system and the second sub-coordinate system The relationship between them includes the distance and angle between the coordinate axes;

The first coordinates are coordinates of the human body joints in the reference sub-coordinate system.
The method according to any one of claims 1-10, wherein obtaining the ground-off state of the foot comprises:

Displaying a first user interface, the first user interface is used to display the setting of the ground lift reference value; the ground lift reference value is used to judge the ground lift state of the foot;

A setting operation for the ground clearance reference value is received.
The method according to any one of claims 1-11, wherein the method further comprises:

Displaying a second user interface, where the second user interface displays a first image of the target object, and a first area and a first logo are superimposed on the first image; the first area is where the human joint is located. The area on the first image, the first identification is the first value and the second value of the ankle joint, the third value and the fourth value of the knee joint, and the fifth value and the second value of the hip joint At least one of the six values.
The method according to any one of claims 2-12, characterized in that, after calculating the fifth value and the sixth value of the hip joint, further comprising:

Based on at least one of the first value and the second value of the ankle joint, the third value and the fourth value of the knee joint, and the fifth value and the sixth value of the hip joint, determine whether a movement risk occurs .
The method according to claim 13, wherein said judging whether a movement risk occurs comprises:

judging the difference between at least one of the first value and the second value of the ankle joint, the third value and the fourth value of the knee joint, the fifth value and the sixth value of the hip joint and the first reference value the size of the ratio to the first threshold;

If the ratio is greater than the first threshold, output risk prompt information.
The method according to claim 14, characterized in that outputting risk warning information includes:

output the first prompt;

or,

Outputting a first prompt, the first prompt including a first option; receiving a second operation acting on the first option, outputting a second prompt.
The method according to claim 14 or 15, characterized in that the first reference value is the stress threshold of the human body joints.
The method according to any one of claims 1-16, wherein, before obtaining the first data of the target object according to the physical parameters of the target object, further comprising:

An anthropometric evaluation is performed on the user; the anthropometric evaluation includes evaluating a physical state, and the physical state includes an injury site and an injury degree of the injury site.
The method according to claim 17, wherein said assessing the physical state comprises:

Detecting that the first part is placed on the damaged part of the user, and detecting the time when the first part is placed on the damaged part; the first part is a body part of the user;

The degree of damage is determined based on the time.
The method according to claim 17 or 18, characterized in that, the first reference value is a bearing reference value, and the bearing reference value is adjusted according to the body measurement assessment.
The method according to any one of claims 1-19, wherein the target object is a moving image in the user or a selected exercise course.
A motion analysis device, characterized by comprising a unit for performing the method according to any one of claims 1 to 20.
An electronic device comprising a touch screen, memory, one or more processors, multiple application programs, and one or more programs; wherein, the one or more programs are stored in the memory; its features That is, when the one or more processors execute the one or more programs, the electronic device implements the method according to any one of claims 1-20.
A computer storage medium, characterized by comprising computer instructions, and when the computer instructions are run on an electronic device, the electronic device is made to execute the method according to any one of claims 1-20.